AI Reliability Engineering is Dead. Welcome to Probabilistic SRE.

Classic reliability engineering assumes software behaves deterministically: given input X, it produces output Y. AI models are non-deterministic, probabilistic systems. This article outlines the telemetry, SLIs, and SLOs required to operate generative agents in production.

Probabilistic SLIs and SLOs

• Semantic Correctness Rate
• Tool Invocation Accuracy
• Context Retention Window