Set a timeout and a fallback
Decide what happens if an answer doesn’t arrive in time. Usually that’s the same path as a low-confidence answer: send it to a person or a safe default.Log every decision
Store the request id, the top answer, and its confidence. You’ll need them to audit decisions, tune thresholds, and spot drift.Pin the model
Use a dated model id in production, such astacet-alpha-2026-10, so answers don’t shift when we release an update. Use tacet-alpha to always get the latest.