The rest of your post is pretty accurate, except for the goal of comfortably transporting humans. That "comfortably" is suffering the death of a thousand cuts.
The main point is that going faster requires more energy, and this is the primary limiting function of air transport speed.
