It shouldn't.
The Load Balancing Method L4 should fallback to L3 (L3 to L2) depending on processed packets and it should do it transparently.
Probably moving from L2 to L3 and finally to L4 the switch, always depending on outgoing traffic it processes (I mean the traffic leaving the LAG's member interfaces), should distribute the data traffic better and better enhancing the LAG members' ports usage (de facto balancing better the data flows)...so the effect should be overall positive.