Blog

Notes on building things — AI systems, side projects, tools, and whatever I'm tinkering with.


Testing Non-Deterministic Agents in CI

A practical design for combining deterministic contracts, semantic checks, DeepEval, Promptfoo, and dual LLM judges without letting flaky evaluation hold every pull request hostage.

LLM EvaluationDeepEvalPromptfooCI-CDTesting

Lessons from Building a Hybrid RAG Pipeline

Why pure vector search isn't enough, and how combining knowledge graphs with embedding retrieval produces significantly better results.

RAGKnowledge GraphsLlamaIndexPython

Building Multi-Agent Systems with LangGraph

Lessons learned from architecting a production multi-agent system for supply chain Q&A — from naive chains to specialized agent orchestration.

LangGraphMulti-AgentLLMPython