You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
#654 ships a deliberately provider-agnostic session DX — provider is an explicit, required knob and the transport matrix is multi-provider — but OpenAI WebRTC is the only fully-wired realtime path today. realtime-offer hard-gates to provider=openai+transport=webrtc and posts to api.openai.com/v1/realtime/calls; the declared openrouter: audio_turns pair has no handler.
This issue tracks growing sessions into genuinely multi-provider realtime ingress, so AgentField is the provider boundary for more than just OpenAI.
Azure OpenAI Realtime — near drop-in; Azure documents the same SDP-proxy pattern (/openai/v1/realtime/calls, ephemeral via /openai/v1/realtime/client_secrets). Mostly an endpoint + auth swap in createOpenAIRealtimeCall.
Google Gemini Live — different protocol (WebSocket bidi streaming, not WebRTC/SDP); needs a dedicated control-plane adapter.
Deepgram Voice Agent / others — evaluate transport + tool-calling fit.
Umbrella tracking issue from #654.
#654 ships a deliberately provider-agnostic session DX —
provideris an explicit, required knob and the transport matrix is multi-provider — but OpenAI WebRTC is the only fully-wired realtime path today.realtime-offerhard-gates toprovider=openai+transport=webrtcand posts toapi.openai.com/v1/realtime/calls; the declaredopenrouter: audio_turnspair has no handler.This issue tracks growing sessions into genuinely multi-provider realtime ingress, so AgentField is the provider boundary for more than just OpenAI.
Candidate providers / transports
/openai/v1/realtime/calls, ephemeral via/openai/v1/realtime/client_secrets). Mostly an endpoint + auth swap increateOpenAIRealtimeCall.Design principles to hold across providers
provider/transportstay explicit — no inference, no silent switching (existing validation philosophy).execute/asyncwithX-Session-IDso every provider lands in the same workflow DAG.Acceptance criteria (behavior)
Related: #662 (sideband tools), #663 (VAD/turn-detection config), #664 (websocket transport + live loop), #665 (OpenRouter).