Ironically though, I wonder if not using Firefox much is the cause of that annoyance. In other words, Firefox usually waits for an opportune time to update, but if it's been closed for a long time, it likely decides that it's too out of date, and updating asap is critical for security.
I'll reiterate my recommendation for ESR, it's Firefox but for people who want less frequent updates. :)