That's been my experience too, taking gyms is considerably easier than successfully holding them for any length of time.
That said, you only really need to hold it long enough to claim your coins, and the XP for fighting rival gyms is probably more valuable in the long run.