> The cost of LLM inference has dropped by a factor of 1,000 in 3 years.
— https://a16z.com/llmflation-llm-inference-cost/
AI startups are not profitable because they are throwing vast sums of money at growth and R&D, not because inference is unaffordable.