> Last I checked the public sector is covered by OSHA.
Federal agencies can apply alternate standards if they decide general OSHA rules don't work for them; while this requires DoL sign-off, IIRC, this option is not available to individual private employers.
> What rules apply to the private sector that don't apply to the public sector?
Aside from the above, another example is that a variety of regulations under FLSA, including standards for exemption, do not apply to federal employees when adopted by the Labor Department; OPM sometimes adopts conforming regulations that apply similar standards to the federal civilian workforce and sometimes does not.
Similarly, states often limit the applicability of their own labor laws to themselves, though they are of course bound by federal laws to the extent that they aren't either specifically exempted or Constitutionally immune.