← Home
Writing
Notes on analytics engineering, alerting, and LLM systems that have to be right.
-
A check that always passes scores 100%
Nov 2026I built a guard that verifies every number an LLM states against the query it came from. Its score was perfect, and it was broken. How a deliberately lying stub found the bug.
-
I audited a week of our Slack alerts and most of them were noise
May 2026An alert bot everyone had learned to scroll past. What a week of its own messages showed, and the four changes that cut the volume by about two thirds.