undefined | Better HN

0 pointslatchkey4mo ago0 comments

wow, you downvoted me.

this is still devops. we use cloud-init to setup the vm.

i run the underlying hardware infrastructure and we've automated the provisioning such that we have an api that can start/stop compute at will. even bare metal.

the point of this is that the current $/token model is awful, especially if you're using a lot of tokens. it should be $/minute. pay for what you use.

0 comments

2 comments · 2 top-level

verdverm4mo ago

tokens are a rough proxy for usage over time, so I am paying for what I use, less than running a TPU pod myself, required for the models I use, i.e. I don't saturate the compute so it's cheaper to pay-go

3 more replies

verdverm4mo ago

> wow, you downvoted me.

1. No, I commented, it is not even possible to downvote a reply to your own comment, seems other people must disagree with what you said or how you said it

2. It's against HN guidelines to talk about your downvotes, especially making claims about who has done it

The most likely reason for your downvotes is promoting your own (incomplete) project under someone else's. What did you hope to bring to the conversation?

j / k navigate · click thread line to collapse