Stream LLM Responses Through a Reverse Proxy Without Buffering
Tokens stream on localhost, then arrive late and in clumps behind a production proxy. How nginx, HAProxy, Caddy and Cloudflare can hold them, how to survive idle timeouts, and a probe that measures per-event latency and fails CI when events are held.