There is no such thing as “following the rules” in an apolitical way. Congress writes very broad laws, and the executive branch exercises a tremendous amount of discretion in enforcing and executing those laws. The founders understood that, and their solution to the problem was frequent elections, not the fiction of neutral, apolitical credentialed bureaucrats.
[1] A good example of this is the bank bailouts in the first Obama administration. Even though the voters were outraged at Wall Street, Obama followed the bailout strategy developed by Wall Street. He replaced Hank Paulson (Goldman Sachs) with Tim Geithner (NY Fed then private equity), but everyone underneath stayed the same and the bailout strategy stayed the same.