That's the position I'm in, along with some other people I've talked to recently, too.
For our situations, the M4 would likely offer more than enough processing power, and the efficiency and physical size are attractive, but a maximum of 32 GB of RAM definitely isn't sufficient.
The M4 Pro's 64 GB of RAM is somewhat better, but the cost of those upgrades are very hard to justify.
I'd also prefer to use the system for at least 5 years, and likely up to 10 years, if not longer. Even if 64 GB is tolerable now, I can easily see it becoming insufficient for my needs before then.
The lack of reasonably-priced internal storage, while easier to work around than the lack of sufficient and reasonably-priced RAM, doesn't help matters, too.
Even if future Studio models, for example, might allow for a more ideal amount of RAM, I have to expect that unjustifiable upgrade costs will likely still be an issue, and then there's the wait on top of that.
I can easily see myself and the others I've talked to settling for PCs, rather than making unjustifiably-expensive Mac purchases.