Articles
Mostly about building products, healthcare tech, and lessons learned along the way.
Loading articles
Tagged: LLM evaluation
2 articles on llm evaluation.
•8 min read
Product Evals in Three Steps (That You'll Actually Do)
Most teams skip evals because the process feels overwhelming. The three steps that make eval-driven development achievable: label a small dataset, calibrate an LLM evaluator to human judgment, then iterate configs against the harness.
ProductRead more →
·7 min read
Why Your LLM Evaluator Is Lying to You
LLM-as-judge evaluators feel like quality assurance but behave like rubber stamps. They fail hardest on the outputs that matter most: edge cases, safety-critical errors, domain-specific nuance. What to do instead.
EngineeringRead more →