Articles
Mostly about building products, healthcare tech, and lessons learned along the way.
Loading articles
Tagged: LLM
3 articles on llm.
•7 min read
RAG Isn't Dead. You're Just Using It Wrong.
The 'RAG is dead' narrative is wrong, but it's wrong in an interesting way. What kills LLM context quality in production, and what to do about it.
EngineeringRead more →
·8 min read
Fine-Tuning a 70B Model on a Consumer GPU: The Q-LoRA Practical Guide
Q-LoRA + SFTTrainer + Flash Attention v2 means you can fine-tune a 70B parameter model on 24GB of VRAM. What that looks like end-to-end, what it costs in quality, and when to just use the API instead.
EngineeringRead more →
·7 min read
When Recommendations Meet Language: The LLM-RecSys Convergence
Most AI stacks treat the recommendation engine and the language model as two separate systems that hand off to each other. A new class of hybrid models eliminates that seam. The implications for domain-specific AI are significant.
EngineeringRead more →