Blog

Notes on building things — AI systems, side projects, tools, and whatever I'm tinkering with.


All Posts

Testing Non-Deterministic Agents in CI

A practical design for combining deterministic contracts, semantic checks, DeepEval, Promptfoo, and dual LLM judges without letting flaky evaluation hold every pull request hostage.

LLM EvaluationDeepEvalPromptfooCI-CDTesting