Navigation audio detection while media playback

[wkl3968]

I'm working on custom audio system to detect the navigation audio coming from Android Auto/google map/waze so that I can channel this audio to a specific channels like (FR and FC). so far I cannot detect it as it seems like Navigation Audio and Media Playback have been mixed earlier on with ducking of media playback. so is there a way to detect such navigation event? I tried the existing API but it could not detect navigation audio interrupts.

[wkl3968]

Hi Hudiy team, I need some guidance here. Thanks in advanced!

[hudiy]

All audio streams in Hudiy are separate sink inputs in PipeWire. You should check the audio from sink inputs rather than from sinks, where PipeWire mixes all the streams from the sink inputs.

Android Auto has a shared audio stream for navigation maneuvers and the voice assistant (speech channel). Similarly, in the CarlinKit dongle, a separate sink input is created for each sample rate. For both CarlinKit and Android Auto, speech audio streams are usually 16kHz or 8kHz mono.

[wkl3968]

So the Hudiy api cannot detect the change and we need to rely on 16khz or 8khz? Assistant so far is ok because it paused the media. But not navigation audio that appear while music is on.

[Kaiis]

@hudiy, would it be possible to add a flag or metadata to the stream indicating that it is for navigation rather than voice? That would greatly simplify detection.

[hudiy]

In both CarPlay (CarlinKit) and Android Auto, there is no dedicated audio stream for navigation. Instead, there is a general speech channel through which navigation instructions, voice assistants and phone calls are transmitted (in CarPlay, as Android Auto uses Bluetooth Hands-free for phone calls). Therefore, from Android Auto/CarlinKit protocol standpoint, it is impossible to distinguish whether the audio is a navigation instruction or a response from Siri/Gemini.