MVA Multi-Modality Interaction Developer

Mercedes-Benz Group China Ltd.

Mercedes-Benz Group China Ltd., Beijing (Hybrid)

Job Type Full-time

Posted 5 hours 4 minutes ago

Hybrid

Tasks

Develop based on mainstream speech systems, including SSPE, wakeup, VAD, ASR, NLU, dialogue management, TTS, and LLM.
Design and implement multimodal fusion combining speech, DMS camera, OMS camera, dashboard camera, microphones, sensors, audio system state, voice print, and vehicle state data.
Normalize and structure multimodal inputs into system context representations suitable for LLM reasoning and future assistant use cases.
Design and maintain multimodal data pipelines with time alignment, normalization, and state coherence.
Consume vehicle system capabilities through service-oriented APIs for intent-driven control of vehicle functions.
Integrate and abstract data from multiple vehicle ECUs, including audio, cameras, sensors, body, and ADAS systems.
Collaborate with EE, platform, AI, and UX teams as a cross-team technical bridge.

Qualifications

Experience developing speech or voice assistant systems, including wake word, VAD, ASR, NLU, dialogue management, TTS, and LLM integration.
Hands-on experience with multimodal data integration and fusion involving audio, camera, sensor, and vehicle state information.
Strong understanding of multimodal data pipelines, normalization, temporal alignment, and state consistency for LLM-ready context.
Practical experience using LLMs as a reasoning layer, including context preparation and safe application of outputs.
Ability to consume service-oriented vehicle APIs for intent-driven control of vehicle capabilities.
Experience integrating with embedded or automotive systems across multiple ECUs.
Solid understanding of Android system architecture, preferably Android Automotive OS.
Strong cross-team technical communication and independent problem-solving skills.

Benefits

Benefits include employee events, flextime, possible hybrid work, health benefits, mobility offers, employee discounts, possible good public transport access, a barrier-free workplace, parking, an in-house doctor, and a canteen and café.