Sometimes, not following the plan is exactly the right thing to (not) do. Remember: you always have more information now than when you made those plans.
I like to think of plans as sane defaults - "do this, unless you have a good reason to do something else". Just having a default improves my time management significantly.