QAVE Studio Docs
QAVE Studio Docs
Sign inGet started — the Studio loop
Getting StartedFirst assurance runQuick assure
ConceptsLifecycleGlossaryHow QAVE Studio worksComing soon
Account & workspaceSignup and loginPeopleDemo creditsRolesSettings
Generate simulation suitesContext templatePII and field enhanceDimensionsAgents and plannerDraft review and Save
ExportExport formatsExport formats (detail)
Assurance SDKSDK overviewQAVE Studio suite fetch APIAgent and JSONL queueLangfuse bridge
Execute and tracesRecipe chatbot (reference SUT)TracingFetch tracing
AssureEvaluate APIRubrics and evidenceReading scores
History
WorkbenchGolden data
CoverageCoverage dashboardCoverage strategiesCoverage advisorTest case quality
RAG AssuranceRAG runsRAG datasetsRAG analytics
Project evalsError analysisUnderstanding scores
Studio guidesDimensionsTuplesConversation modesMulti-lingual testingWorkflowsHuman reviewBest practices
ReferenceAPI and packagesTroubleshooting
Project evals & analysis

Error analysis

Annotate runs or uploads, then generate project failure modes.

Error Analysis (/error-analysis) helps you label conversations from Assurance Lab runs or uploaded transcripts, then generate project-level failure modes.

How to annotate

  1. Open Error Analysis.
  2. Choose Lab runs or upload conversations (partial uploads are fine).
  3. Annotate each conversation: Pass, Fail, or Unsure, and add observations on Fail / Unsure.
  4. Unannotated conversations are skipped when you submit.

Generate failure modes

Submit needs at least three Fail or Unsure annotations with observations. QAVE Studio proposes failure modes you can promote into Project Evals.

Tips

  • Prefer short, concrete observations (“hallucinated policy id”) over vague notes.
  • Re-run after a model change to see whether the same modes still appear.

Related

  • Project evals
  • Assure

Project evals

Reusable evaluation definitions and failure modes for a project.

Understanding scores

Understanding scores

On this page

How to annotateGenerate failure modesTipsRelated