Agent Tool Selection.

Ask for one bounded answer

This Vercel AI SDK-shaped example is illustrative. Check the current provider documentation before shipping.

import { experimental_evaluate as evaluate } from 'ai';

const result = await evaluate({
  model: 'typesafe-ai/jev',
  state: "The user asks to compare today’s forecast with an event already on their calendar.",
  questions: {
    decision: {
      type: 'choice',
      instructions: "Which capability should handle this turn?",
      options: ["weather","calendar","general_reasoning","ask_user"]
    }
  }
});

// Validate permissions and thresholds before acting.
console.log(result.answers.decision);

Keep the boundary clear

• Log the input, answer distribution, chosen threshold and resulting route.
• Test on labelled examples from your own production distribution.
• Send low-confidence, high-impact or out-of-distribution cases to a safer fallback.
• Re-evaluate thresholds when the model or workflow changes.