Skip to content

Support stateful /v1/responses WebSockets API #1337

Description

@jtechapps

Follow up to #1187

OpenAI specification has a WebSocket mode for /v1/responses API.

https://developers.openai.com/api/docs/guides/websocket-mode.

Websocket mode is also supported in agentic-api.

aiperf should support the following:

  1. Conversations maps one-to-one with WS connections. concurrency parameter still limits the number of in-flight requests at once.
  2. Can be used with traces and other modes that do not override server responses.

Note: stream_id multiplexing (running forked conversations in parallel over a single WebSocket connection) is not part of this issue. It has been split out into a follow-up: #1390. This issue covers the one-connection-per-conversation model only.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions