Sorry for the belated answer - but yes, it is inevitable. Black body radiation means everything in the universe glows.
This whole thing is just a problem with an universe both infinite and old, though. In a young universe, the dust might still be cold enough (yet still hotter than it is in reality), and in a finite universe, there could be a steady state as you described.