QAVE Studio Docs
QAVE Studio Docs
Sign inGet started — the Studio loop
Getting StartedFirst assurance runQuick assure
ConceptsLifecycleGlossaryHow QAVE Studio worksComing soon
Account & workspaceSignup and loginPeopleDemo creditsRolesSettings
Generate simulation suitesContext templatePII and field enhanceDimensionsAgents and plannerDraft review and Save
ExportExport formatsExport formats (detail)
Assurance SDKSDK overviewQAVE Studio suite fetch APIAgent and JSONL queueLangfuse bridge
Execute and tracesRecipe chatbot (reference SUT)TracingFetch tracing
AssureEvaluate APIRubrics and evidenceReading scores
History
WorkbenchGolden data
CoverageCoverage dashboardCoverage strategiesCoverage advisorTest case quality
RAG AssuranceRAG runsRAG datasetsRAG analytics
Project evalsError analysisUnderstanding scores
Studio guidesDimensionsTuplesConversation modesMulti-lingual testingWorkflowsHuman reviewBest practices
ReferenceAPI and packagesTroubleshooting
Assurance SDK

SDK overview

Packages, responsibilities, and the honest boundary between eval-only and SUT drive.

Packages (code names)

PackageRole
qurator clientQurator.evaluate → sovereign/pilot evaluate endpoints
qurator-sdk-agentPolling agent, JSONL loader, Langfuse tracer, local agent API
QAVE Studio qurator_clientStudio backend calls into Gateway for eval-only workflows

What works today

  • Eval-only: caller supplies execution_results (messages / traces); QAVE Studio or Gateway scores them
  • Live suite fetch: project SDK API key → GET /sdk/projects/{id}/test-suites and .../cases (see QAVE Studio suite fetch API)
  • Langfuse → Gateway: fetch + normalize + POST /v1/assure/evaluate
  • JSONL agent loop: polls inputs and calls MCP evaluate_conversation (reference SUT MCP is not closed — use mock for demos)

QAVE Studio workflow (eval-only)

POST /workflows/execute-and-evaluate

Requires suite + cases APPROVED and a non-empty execution_results payload. This path does not load target_config or drive the SUT by itself.

A single execute_and_evaluate call that drives your SUT and scores in one step is coming soon. Use fetch + evaluate today.

Assurance SDK

The unifying runtime for execution, trace normalization, and assure calls.

QAVE Studio suite fetch API

Project SDK keys and paginated /sdk routes for listing approved suites and cases.

On this page

Packages (code names)What works todayQAVE Studio workflow (eval-only)