If that was not allowed, if people could only use my work for no profit purposes, I agree.
That's what CC (creative commons) is for, though.
I am also in favour of people "remixing" and even making money out of it, but the intent it's paramount to me.
As a long time copyleft activist, I do not understand what limiting authors rights brings to the table, in your opinion.
More than once I contacted the author of some work I liked and they gave me free license to use it, no questions asked (after explaining what I would use it for).
IMO basic cooperation between good willing people goes a long way, without stripping authors of their rights.
Edit: typos