We use it in our research group to run the largest LLMs quickly on a descent server. However, the people with the latest MacBooks don’t bother and prefer to use their laptops as they are fast enough.
We also throw money at Microsoft and OpenAI when we evaluate
ChatGPT. But open LLMs are cheaper to play with if you already have the hardware. And more aligned to our research values.
