Failure analyses with the numbers attached
Every teardown here is produced by the same open-source harness we point at customer systems. No screenshots of dashboards, no anecdotes — metric definitions, raw output, and a fix whose effect is measured rather than asserted.
The 12-point fix: what one retrieval miss actually costs
74.5 → 86.4 overall, hallucination rate 19% → 3%, with no re-indexing and no embedding vendor. Full before/after table and the method.
Read →Nine answers, three fabrications
Auditing an assistant from a trace export alone: no VPN, no credentials. An invented SLA, a refund policy that doesn't exist, and a GDPR commitment nobody approved.
Read →A refusal is not a hallucination
The scoring bug that rates a fabrication as twice as trustworthy as an honest "I don't know" — plus two more measurement bugs from an audit of our own harness.
Read →Want this run against your system?
A fixed-scope reliability audit takes 10 working days and needs either a query endpoint or an export of your production traces.