Whilst that is totally correct morally, law enforcement must be very careful about applying that. There is a trade-off between having a stable and predictable set of laws (i.e. strict enforcement) and having room for judgement calls when the letter of the law is unfair (i.e. discretion in enforcement).
I understand when regulators decide to side with strict enforcement when a companies only advantage comes from not following the rules. Especially when it is disputed the rules shouldn't be there.