QAVE Studio Docs
QAVE Studio Docs
Sign inGet started — the Studio loop
Getting StartedFirst assurance runQuick assure
ConceptsLifecycleGlossaryHow QAVE Studio worksComing soon
Account & workspaceSignup and loginPeopleDemo creditsRolesSettings
Generate simulation suitesContext templatePII and field enhanceDimensionsAgents and plannerDraft review and Save
ExportExport formatsExport formats (detail)
Assurance SDKSDK overviewQAVE Studio suite fetch APIAgent and JSONL queueLangfuse bridge
Execute and tracesRecipe chatbot (reference SUT)TracingFetch tracing
AssureEvaluate APIRubrics and evidenceReading scores
History
WorkbenchGolden data
CoverageCoverage dashboardCoverage strategiesCoverage advisorTest case quality
RAG AssuranceRAG runsRAG datasetsRAG analytics
Project evalsError analysisUnderstanding scores
Studio guidesDimensionsTuplesConversation modesMulti-lingual testingWorkflowsHuman reviewBest practices
ReferenceAPI and packagesTroubleshooting
Getting Started

First assurance run

End-to-end path from context template to History using the reference SUT.

This walkthrough is a tutorial path for the Studio loop (see also the docs home map): generate a suite in Setup Wizard, export it, exercise the reference chatbot, score in Assurance Lab, and read results in History.

Overview

  1. Create a context template
  2. Generate and approve dimensions
  3. Select agents and generate drafts
  4. Review drafts and Save an approved suite
  5. Export JSONL
  6. Exercise the recipe-chatbot (or your own SUT)
  7. Assure via Studio or Gateway
  8. Open History

Steps

1. Generate an approved suite

In Studio, open Setup Wizard, or follow Generate: Context Template → optional PII → field enhance → Generate Dimensions → hub (agents + dimensions) → draft review → Save (new suite or merge). Suites are APPROVED at Save.

2. Export

Open Exports, select the suite, choose JSONL or Simulator JSONL. See Export formats.

3. Exercise the system under test

Use the recipe-chatbot reference SUT:

curl -s http://localhost:9000/api/chat \
  -H 'Content-Type: application/json' \
  -d '{"message":"Suggest a vegetarian pasta for two"}'

Prefer enabling Langfuse on the chatbot so traces are named recipe-chatbot-session.

4. Assure

Pick one:

  • Studio paste / JSONL — paste the conversation into Assurance (see Assure)
  • Langfuse bridge — SDK Langfuse bridge
  • Eval-only API — supply execution_results to QAVE Studio workflows (see SDK overview)

5. Read History

Open History to inspect scores, evidence, and filters.

Next

  • Wire the Assurance SDK for repeatable runs
  • Add SME review in Workbench
  • See Coming soon for one-step drive-and-score status

Getting Started

Tutorial paths for your first successful QAVE Studio assurance loop.

Quick assure

Score an existing conversation or trace without generating a suite first.

On this page

OverviewSteps1. Generate an approved suite2. Export3. Exercise the system under test4. Assure5. Read HistoryNext