You are probably too young to remember the php Cpanel hosts then.
Linode was one of the big names in being cheap and having an actual vps where you could do whatever. Short of actually buying a rack and the accompanying hardware/networking software (not renting and having your electric/network subsidized) having a vps is the cheapest slickest option to do whatever, part of why I have never bothered with any of the Iaas options. At least AWS blows hard-core in comparison, a lot of the alternatives focus on optimizing some use case, not doing whatever the hell you want.
I'm not sure how you would even compare tailscale, that's focused more on connecting all your boxes e.g. on linode...