It's a condition they, and their family, have to live with their entire life. You can't really be permanently sad about a condition you have literally been born with and can't expect to change.
Meanwhile, there are conditions that significantly decrease quality of life even though one's intelligence is unaffected. I think the factor is better described as choice. There are a large number of things a person with Downs just does not have the choice to do differently.