QAVE Studio Docs
QAVE Studio Docs
Sign inGet started — the Studio loop
Getting StartedFirst assurance runQuick assure
ConceptsLifecycleGlossaryHow QAVE Studio worksComing soon
Account & workspaceSignup and loginPeopleDemo creditsRolesSettings
Generate simulation suitesContext templatePII and field enhanceDimensionsAgents and plannerDraft review and Save
ExportExport formatsExport formats (detail)
Assurance SDKSDK overviewQAVE Studio suite fetch APIAgent and JSONL queueLangfuse bridge
Execute and tracesRecipe chatbot (reference SUT)TracingFetch tracing
AssureEvaluate APIRubrics and evidenceReading scores
History
WorkbenchGolden data
CoverageCoverage dashboardCoverage strategiesCoverage advisorTest case quality
RAG AssuranceRAG runsRAG datasetsRAG analytics
Project evalsError analysisUnderstanding scores
Studio guidesDimensionsTuplesConversation modesMulti-lingual testingWorkflowsHuman reviewBest practices
ReferenceAPI and packagesTroubleshooting
Project evals & analysis

Project evals

Reusable evaluation definitions and failure modes for a project.

Project Evals (/project-evals) stores reusable evaluation definitions for the current project. Create them manually or approve them from Error Analysis.

How to work with project evals

  1. Open Project Evals.
  2. Review existing definitions (versions, approval state).
  3. Create a definition manually when you already know the failure mode, or generate candidates from Error Analysis annotations.
  4. Approve definitions you want the project to keep using.

Related

GuidePurpose
Error analysisAnnotate conversations and generate failure modes
Understanding scoresInterpret evaluation scores
Reading scores (Assure)Studio score cards and quality labels

RAG analytics

Compare RAG assurance runs and spot regressions.

Error analysis

Annotate runs or uploads, then generate project failure modes.

On this page

How to work with project evalsRelated