With less time used taking classes like Psych 101 (which is generally a waste of time for engineering and science majors) you have more time to study and complete assignments in your core classes. The university says it wants you to take these classes to be "well rounded", but honestly, they just want more money from students.
Regarding Calculus and Chemistry (all important to physics of course);There were several students I knew that clipped out of all of the freshman/sophomore chemistry and calculus classes and just started with organic chemistry and differential equations. This meant freshman year was a little rougher, but they were done with all of their non-major courses by sophomore year, so they were able to take a lower course load in their next three years and better absorb the core classes. I majored in electrical engineering, and still really struggled with all my calculus classes despite taking AP Calculus in high school. So instead of just focusing on circuits, coding, control systems...etc, I had to split my time with stuff like chemistry/calculus/random classes like Psych, so there was a lot less time to use for homework, projects, and harder subjects (assembly and microprocessors aren't too bad by themselves, but when you're mentally sharing that same space with a bunch of other classes it is brutal). Of course, most colleges are like this, but I think I'd rather have less required subjects, but time to go into them in additional depth.