Project evals & analysis
Project evals
Reusable evaluation definitions and failure modes for a project.
Project Evals (/project-evals) stores reusable evaluation definitions for the current project. Create them manually or approve them from Error Analysis.
How to work with project evals
- Open Project Evals.
- Review existing definitions (versions, approval state).
- Create a definition manually when you already know the failure mode, or generate candidates from Error Analysis annotations.
- Approve definitions you want the project to keep using.
Related
| Guide | Purpose |
|---|---|
| Error analysis | Annotate conversations and generate failure modes |
| Understanding scores | Interpret evaluation scores |
| Reading scores (Assure) | Studio score cards and quality labels |