WebSocket support for OpenAI Responses API live on AI Gateway

AI Gateway now supports WebSocket mode for the OpenAI Responses API. You can keep a persistent connection open and continue each turn by sending only new input items plus previous_response_id, instead of re-sending the full context over a fresh HTTP request every turn.

OpenAI reports up to ~40% faster end-to-end execution on WebSockets for agentic rollouts with 20 or more tool calls.

Route Responses API traffic over WebSocket

The Responses route opens at GET /v1/responses and accepts raw response.create frames over a persistent WebSocket connection. The mode is compatible with store=false and Zero Data Retention, and follows OpenAI's WebSocket mode specification upstream.

See the AI Gateway documentation for setup and the full route list.

Read more