Troubleshooting
Common customer-facing issues across Studio, generation, SDK, and assure.
I cannot open Documentation without logging in
/documentation on the app redirects to the public docs site at docs.<your domain>. That site does not require a login. If you are sent to login instead, contact support — the auth allowlist may be misconfigured.
Signup email never arrives
- Check spam for the verification message.
- Use the copy-code / verify screen if the product shows a code.
- Wait a minute and retry; mail providers can delay delivery.
Login fails with correct password
Use the main Sign in form with your organisation email and password. Do not use Staff sign-in unless your Qapitol contact told you to.
Demo credits request is blocked
Only one credit request can be pending. Wait for approval or rejection, then try again. See Demo credits.
Export empty / suite missing
Suites must be APPROVED. Save from Generation already approves; older drafts need approval first. See Export.
Assure returns 401
SDK or API keys must match the project. Rotate keys under Settings and update your client.
SDK agent never scores the real chatbot
The recipe-chatbot reference SUT has no MCP evaluate tool. Use HTTP chat + Langfuse/paste for real scoring, or mock MCP for demos only. See Execute.
Scores look wrong
- Confirm messages/trace shape matches the normalizer
- Confirm Criterion / rubric selection
- Spot-check evidence for / against against human judgment
- See Reading scores and Understanding scores
History empty
Ensure evaluate completed and you are on the correct project. Check History filters if results seem missing.
Coverage looks stuck or misleading
If the coverage banner is amber (in flight), wait for the pipeline stage to finish before trusting readiness. See Coverage dashboard.
Error Analysis will not submit
You need at least three Fail or Unsure annotations with observations. Unannotated rows are skipped. See Error analysis.