ImageMagick clearly grew up in environments with short lived processes - the command line, php, etc. Run it in a long lived process at your peril, and watch all your memory leak away. I also don't think it makes very good use of available GPUs at all.
