What is model routing?
Model routing chooses different models or configurations based on task complexity, latency needs, cost, or safety requirements.
- Cheaper models for simple tasks
- Stronger models for harder tasks
- Routing policy is a product decision
What is model routing?