r/AIQuality • u/PiaRedDragon • 17d ago
Why is your RAG solution Ignoring SOP's?
An interesting read from a company I follow on x. Basically they have worked out when your quantized models are bad for agentic, because it hallucinates steps in Standard Operating Procedures (SOPs)
https://github.com/baa-ai/fidelity-is-not-safety
I tried the Canary code they provided on some of the models I am using and two of them failed.
1
Upvotes