I've also heard this quite a lot. If they've never actually had to use the product or similar products in a professional setting, where their results mattered, then they aren't qualified to play the part of the user.
If the product has actual users, it's always better to talk to them directly, than to trust the opinions of someone who doesn't use the product to generate value every day.