JEV USE CASE
AI Model Routing.
Send routine decisions to a low-cost path and reserve slower reasoning models for genuinely difficult requests.
THE DECISION CONTRACT
STATE
A user asks for a one-sentence rewrite with no external context or tools.
QUESTION
Which model tier is sufficient?
CHOICES
deterministic fast_model reasoning_model human_review
TYPESCRIPT EXAMPLE
Ask for one bounded answer
This Vercel AI SDK-shaped example is illustrative. Check the current provider documentation before shipping.
import { experimental_evaluate as evaluate } from 'ai';
const result = await evaluate({
model: 'typesafe-ai/jev',
state: "A user asks for a one-sentence rewrite with no external context or tools.",
questions: {
decision: {
type: 'choice',
instructions: "Which model tier is sufficient?",
options: ["deterministic","fast_model","reasoning_model","human_review"]
}
}
});
// Validate permissions and thresholds before acting.
console.log(result.answers.decision);SAFE IMPLEMENTATION
Keep the boundary clear
Guardrail
Calibrate thresholds on your own labelled traffic. A confidence value is not a universal permission to automate.
- Log the input, answer distribution, chosen threshold and resulting route.
- Test on labelled examples from your own production distribution.
- Send low-confidence, high-impact or out-of-distribution cases to a safer fallback.
- Re-evaluate thresholds when the model or workflow changes.
PRIMARY SOURCES