When Claude changed, everything changed: Managing AI blast radius in production

A natural-language-to-API reporting system broke after upgrading to a newer LLM that sometimes moved request parameters into the description field or asked clarifying questions, causing missing filters and downstream failures. The article argues for an evals-first approach where evaluation suites define system behavior and gate model or prompt changes.