Evaluate your Torq AI
Release checklist
An AI earn experience is ready for a controlled use when it passes every applicable test.
Golden questions
Maintain versioned fixtures for questions such as:
- Which eligible vaults accept this asset on this network?
- What are this vault's allocation, liquidity, fee, and redemption conditions?
- What changed in this wallet's position since the previous canonical block?
- Can this partner path offer the same vault, and what fee difference is evidenced?
- Why is this redemption not complete?
Each expected answer should list required sources, required live fields, forbidden claims, and the correct refusal state when evidence is missing.
Workflow mutation tests
For each workflow an AI may propose, mutate one protected field at a time: chain, target, sender, receiver, asset, amount, resource ID, workflow type, calldata hash, or request ID. The signer adapter must reject every mutation before signature.
Privacy and logging
Verify prompts, traces, analytics, support exports, and model-provider logs exclude secrets, reusable authorization proofs, full wallet histories not needed for the task, and unrelated customer data.
Monitor in preview
Track refusal rate, unsupported-question rate, citation accuracy, stale-state stops, signer mismatch stops, canonical-completion latency, and human corrections. A high answer rate is not success if the model is quietly inventing missing facts.