Workbench
Golden data
How SME annotations become calibration and preference pairs.
Golden data is the flywheel fuel:
- Assurance produces a score + evidence
- SMEs confirm, correct, or preference-rank outcomes
- Labels land in the calibration store
- Future runs and (eventually) customer SLMs improve against your bar
Keep PII redacted in review UIs. Prefer structured feedback over free-text-only notes when exporting for training.