Articles
Mostly about building products, healthcare tech, and lessons learned along the way.
Loading articles
Tagged: evals
4 articles on evals.
•4 min read
What an AI Audit Actually Finds
Most teams asking for AI don't have a model problem. They have a "which problem is even worth it" problem. Here's what a real AI audit surfaces — and why "don't build this" is often the most valuable line in the report.
EngineeringRead more →
·8 min read
Table Stakes for Pragmatic Development Using LLMs
Updated for 2026: lessons from two years using Claude Code in production. Context engineering, real eval frameworks, model economics, and agent workflows. What works.
EngineeringRead more →
·7 min read
Every Failed AI Product Has the Same Root Cause
The same failure pattern shows up everywhere: teams shipping fast and iterating on vibes instead of building systematic evaluation. Evals aren't a nice-to-have. They're the core competency of any serious AI product team.
ProductRead more →
·7 min read
Why Your LLM Evaluator Is Lying to You
LLM-as-judge evaluators feel like quality assurance but behave like rubber stamps. They fail hardest on the outputs that matter most: edge cases, safety-critical errors, domain-specific nuance. What to do instead.
EngineeringRead more →