Building with AI
Streaming responses
Reference entryStreaming responses
Streaming responses deliver a model’s output incrementally as it is generated, improving perceived speed and enabling responsive conversational interfaces.
Where it sits
Streaming responses deliver a model’s output incrementally as it is generated, improving perceived speed and enabling responsive conversational interfaces.