> it's really just a logical and common-sense way of looking at things.
To you, yes. Plenty of other Muslims find it utterly illogical why some random people who happened to be in the right place 14 centuries ago should be taken as any sort of authority. It's as black to them as it is white to you. We all think our own particular beliefs are the logical and common-sense way of looking at things.
In matters of faith, all judgments are subjective by definition. It's human, but delusional and dangerous nevertheless, to assume that they extend to hold objectively.