Tagged: AI systems
3 articles on ai systems.
Context Rot: The Silent Performance Killer in Your LLM Application
Your LLM system works great in demos and degrades in production. The culprit is almost never the model. It's what you're feeding it. Here's how to diagnose and fix context rot before it kills your product.
EngineeringRead more →
Multi-Agent Orchestration in Practice: What I Learned Building Parallel Agent Systems
The orchestrator/worker pattern is the key mental model for multi-agent systems. Here is how to structure orchestrators, spawn and manage workers, aggregate results, and avoid the coordination failures that will sink you.
EngineeringRead more →
Three Hard Truths About LLMs in Production Nobody Warned Me About
Twelve years in ML and I still got burned. Stochasticity is a systems design problem. Your target model will be deprecated. Silent failures are worse than loud ones. Here is what production healthcare AI actually taught me.
ProductRead more →