At the L2 distance you'd have passed out of Earth's shadow cone even if exactly at L2, at best you'd be in the penumbra. But Webb has an orbit of 800,000 km radius around L2, which would put it will outside of that regardless.

This gives some more appreciation for how large the sun is.