Yes that's one of the downside. Also, the binaries can get fat really quick. Especially when you link statically with some of the Qt components.
I guess it's a fair trade-off when you target today's desktop systems. Otherwise, it might worth looking at Qt for Embedded Linux.