Skip to main content
A fallback model should support the same required input, context size, and tool behavior as the primary model. Use a short ordered list and trigger fallback only for known transient failures. Record which model produced each response.
Fallbacks can change quality, latency, and cost. Test them with production-like requests.
Last modified on July 2, 2026