undefined | Better HN

0 pointsindoordin0saur9d ago0 comments

> And I can always see its full thoughts, don't have to worry about where my data is getting sent, and know it can't get secretly nerfed.

For this reason I wonder if local models are a potential business opportunity. Provide the service to engineering teams to give them a pre-built and setup GPU rig they can run in a closet. No need to worry about all the things you mentioned and clients can rest-assured their data isn't disappearing into a sketchy data center. There might be regulatory reasons that make on-prem setups appealing as well.

0 comments

6 comments · 3 top-level

suncemoje9d ago· 3 in thread

On-premise (1960-2010) -> Cloud (2010-2026) -> On-premise (2026+)?

indoordin0saurOP9d ago

I think that's overstated, but the loss of trust companies have with the big AI players is pretty serious. Not a big deal if your app is for sharing cat videos, but if you're medical or wealth management or a government contractor or the like enterprise clients really like to see good data security policies.

lelanthran9d ago

> Not a big deal if your app is for sharing cat videos, but if you're medical or wealth management or a government contractor or the like enterprise clients really like to see good data security policies.

If this mattered to them, they wouldn't be running so much in the cloud or in proprietary software that they have no ability to air-gap.

If companies ever cared about this, Windows would not be dominant on the desktop.

1 more reply

suncemoje9d ago

Agree. I also wonder how zero e.g., Claude Enterprise ZDR really is, and what their data pipeline actually looks like.

amoshebb9d ago

This is, as far as I know, the business model of coys like mistral and cohere

cyanydeez9d ago

I think the next step to anyone but overbloated USA models is to follow https://chatjimmy.ai/ with one of the qwen models. If they can mass produce something at relative cost, these would be awesome sidecars.

j / k navigate · click thread line to collapse