Tagged: Evals

3 articles on evals.

Table Stakes for Pragmatic Development Using LLMs
•6 min read

Table Stakes for Pragmatic Development Using LLMs

Updated for 2026: lessons from two years of using Claude Code in production. Context engineering, real eval frameworks, model economics, and agent workflows — what actually works.

EngineeringRead more →
Every Failed AI Product Has the Same Root Cause

Every Failed AI Product Has the Same Root Cause

After 12 years in ML and AI, I keep seeing the same failure pattern: teams that ship fast and iterate on vibes instead of building systematic evaluation systems. Evals are not a nice-to-have — they are the core competency of any serious AI product team.

ProductRead more →
Why Your LLM Evaluator Is Lying to You

Why Your LLM Evaluator Is Lying to You

LLM-as-judge evaluators feel like quality assurance but behave like rubber stamps. They fail hardest on the outputs that matter most — edge cases, safety-critical errors, domain-specific nuance. Here is what to do instead.

EngineeringRead more →