llama.cpp vs vLLM vs SGLang: Choosing an Inference Engine You Can Self-Host
Three open-source engines, three different jobs. What each one is built for, the ideas that actually separate them, and how to decide for your own workload.
#llm
What Actually Happens When You Quantize a Language Model
How shrinking a model's numeric precision cuts memory and speeds up inference, and exactly what you trade away to get there.