Model Cascades: Send Easy Requests to the Cheap Model First
Small models now cost a fortieth of the top tier, so routing easy requests to them is worth doing. How a cascade decides what escalates, where its hidden costs are (cold caches, long-prompt pricing, wrong answers that pass), and when one model is simpler.