AIAudioController
private

Experimental

Central controller for all AI audio operations: recording (microphone input), transcription, and text-to-speech playback. Created by the AI feature and shared with the chat panel so both layers can control audio through a single object without reaching into each other's internals.

No results

Configs

Configs are options you supply in a configuration object when creating an instance of this class

autoReadAloud : Boolean/'audio-input''audio-input'

Set to true to always read aloud received messages. Set to false to not read aloud responses to recorded messages. Defaults to audio-input which reads received messages aloud if they are a response to a local audio message.
autoRecord : Booleanfalse

Set to true to automatically start recording again after a voice response finishes playing. Only applies when the previous message was sent via voice input.
stopAudioOnHide : Booleantrue

Set to true to automatically stop any ongoing recording and audio playback when the chat panel is hidden.
textToSpeechUrl : String

URL to send text for speech synthesis
transcribeUrl : String

URL to send audio blobs for transcription

Properties

Properties are getters/setters or publicly accessible variables on this class

playbackPromise : Promise/null

READONLY

A promise that resolves when the current playback completes, or null if not playing. Useful for awaiting speech completion externally (e.g. voice conversation loop).

Functions

Functions are methods available for calling on the class

handleResponse( text, wasAudioInput )
: Promise

ASYNC

Handles an incoming AI response, deciding whether to read it aloud and whether to auto-record afterwards based on the current mode: conversation mode always speaks and records, otherwise uses autoReadAloud and autoRecord configs.
speak( text )
: Promise

ASYNC

Speak the given text using text-to-speech. Returns a promise that resolves when playback completes.
startConversation( options )
Enter voice conversation mode. While conversing, all responses are read aloud and each read-aloud automatically starts a new recording. The conversation ends when:
- The timeout expires
- No audio is detected during a recording
- stopConversation is called explicitly
startRecording( timeouts )
: Promise

ASYNC

Start recording from the microphone. Resolves with the transcribed text, or null if cancelled.
stopAll( cancelRecordingfalse )

Stop all audio activity (recording + playback)
stopConversation( )

End the current voice conversation
stopRecording( cancelfalse )

Stop an ongoing recording
stopSpeaking( )

Stop any ongoing speech — cancels the TTS fetch if still waiting, or stops playback if already playing
transcribe( audioBlob )
: Promise

ASYNC

Transcribe an audio blob to text

Source path

Core/util/AIAudioController.js

Inheritance tree1

AIAudioController

AIAudioController private Experimental