Model routing lets companies cut AI costs, threatening OpenAI and Anthropic’s pricing power
AI-summarised brief · reviewed before publication
Companies are shifting away from using expensive AI models for all tasks, instead adopting a practice called model routing to control costs. This change threatens the business model of OpenAI and Anthropic, which rely on demand for premium-priced models. Large enterprises, such as Cisco, are prioritizing efficiency due to spiraling AI costs, with Cisco's annual AI bill reaching $900 million. Model routing sends difficult problems to expensive models and simple ones to cheaper alternatives, achieving substantial cost savings. This shift is driven by chief financial officers and boards demanding efficiency, with companies aiming to achieve five to ten times better cost efficiency on routine work.
💡 Why It Matters
- · The shift to model routing undermines OpenAI and Anthropic's pricing power by limiting their revenue to complex jobs.
- · It challenges their valuation assumptions, which are built on enormous demand at premium prices.