Streaming Chat API Endpoint

Build the server-side of a streaming chat — an SSE endpoint that proxies LLM chunks to the client in real time. Learn async generators, backpressure, and stream piping.

You will learn to:

• Understand the Server-Sent Events (SSE) protocol and its use cases
• Build a streaming endpoint that proxies LLM response chunks in real time
• Use Python async generators or Node.js streams for efficient chunk forwarding
• Detect client disconnections and cancel upstream requests to avoid waste
• Log streaming sessions with completion status and token counts