I think hierarchy of needs comes into play here. You may not spend all that much time thinking about philosophy if you're foraging or farming, and busy with physical labor.
Also, messages get lost, and misinterpreted. Quickly. I do believe that most [non explicit cult] religious texts shouldn't be interpreted literally, but instead take them the lessons they teach, or are interpreted to be.
It’s an interesting discussion, really. A lot of wisdom literature outside of academic discourse emphasizes the philosophy of the common man. This gets lost at higher levels of study. Zen Buddhism emphasizes the mundane ("chop wood, carry water"), while some Christian sects embody their philosophy through work and service to others. I agree with what you say about not interpreting texts literally, but we have a real problem in the US with angry, vocal, and frankly violent religious people who defend inerrant scriptural readings of the text. Outside of the US, I think it would be difficult to have a discussion in, let’s say, a predominantly Muslim county, where I held a debate about how the Quran should not be interpreted literally. So while I agree completely with the spirit of what you say, the practical reality is very different.