Skip to main content
The plugin runs in one of two dialogue modes. They use the same media bridge and the same features; they differ only in how speech becomes a reply.

Realtime

Speech-to-speech via a realtime model (OpenAI / Azure OpenAI). Lowest latency, natural barge-in, most expressive. Needs a realtime provider key.

Streaming

STT → your agent → TTS. Uses your host’s existing speech stack and full agent toolchain. Needs ffmpeg on PATH. No realtime key required.

​
How each mode flows

Both modes share the same inbound/outbound media path through StandIn; they differ only in the middle - how speech becomes a reply.

​
Choosing

Both modes support barge-in (the caller can interrupt), the vision ring, group-call gating, DTMF, multilingual replies, and the avatar driver cues. The languages setting (e.g. EN/AR/FR/DE; auto-detect when unset) applies to realtime mode; streaming mode is multilingual through the host’s own model/STT/TTS configuration instead.

​
Switching

Set mode in the plugin config:
Streaming shells out to ffmpeg for resampling - make sure it’s installed and on PATH.