Project dossier

Gemini 3.8 Flash is 5x cheaper and 2x faster than Opus 5 for similar intelligence

Curious how people handle this in practice. New models keep coming out and every release looks great on paper, but once you already have something working in production I assume the bar for switching gets a lot higher. For those of you running LLMs in a real product, what actually makes you decide it’s worth changing models? And when you do look at switching, what part tends to be more annoying or time-consuming than you expected? Would be interested to hear from people who’ve gone through this