Mercedes-Benz Unveils Next-Gen MBUX Virtual Assistant

Mercedes-Benz is setting a new benchmark in automotive excellence with the unveiling of its MBUX Virtual Assistant. This groundbreaking system redefines the relationship between driver and vehicle, merging sophisticated generative AI with intuitive design to offer an unprecedented level of personalised interaction
Picture of Aaron Kelly

Aaron Kelly

Motoring Editor at The Executive Magazine

Mercedes-Benz stands at the forefront of automotive innovation with the introduction of its latest advancement, the MBUX Virtual Assistant. This development heralds a new chapter in automotive user interfaces, delivering a highly personalised interaction between the driver and their vehicle through natural conversation.

Innovation at Its Core

The MBUX Virtual Assistant is a cornerstone of Mercedes-Benz’s vision for an enhanced user experience, both within the vehicle and extending into the digital realm. This cutting-edge system employs sophisticated software and generative AI to facilitate a more intuitive and human-like interaction with the car. The assistant, which is a significant evolution from the existing ‘Hey Mercedes’ voice command, now enters a visually enriched domain powered by Unity’s high-resolution gaming graphics. Set to debut on the Mercedes-Benz Modular Architecture (MMA) platform, starting with the Concept CLA Class at CES 2024, the MBUX Virtual Assistant is designed to seamlessly integrate into the Mercedes-Benz Operating System (MB.OS), illustrating the brand’s commitment to in-house development and innovation.

“Through advances in artificial intelligence, tomorrow’s Mercedes-Benz will know its driver like never before. It will enhance and complement our customers’ lives – in their cars and in other areas too. We have already made strong progress on this journey. The latest proof points on show at CES provide an exciting glimpse of what lies ahead.”

Markus Schäfer, Member of the Board of Management at Mercedes-Benz Group AG, Chief Technology Office

Enhancing the Drive

The MBUX Virtual Assistant is engineered to simplify the driving experience through proactive and intelligent support. Utilising generative AI, the system offers personalised suggestions and automations, such as morning news updates or direct meeting dial-ins if the driver is running late. This assistant is not just a technological marvel but a testament to Mercedes-Benz’s dedication to comfort, convenience, and efficiency, augmented by ambient lighting and sound system integrations for an immersive experience.

A Symphony of Features

The assistant’s design is rooted in four key traits: Natural, Predictive, Personal, and Empathetic, ensuring a comprehensive and attuned user interface. Speech recognition leverages large language models for fluid dialogues, moving beyond the transactional interactions of traditional systems to create a conversational experience that mirrors human interaction. Furthermore, the assistant’s predictive capabilities and personalisation options underscore the brand’s focus on delivering a bespoke user experience.

Visual and Navigational Brilliance

MBUX Surround Navigation introduces an innovative layer of visual communication, pairing real-time situational awareness with striking 3D graphics. This feature not only enhances the driving experience but also elevates safety and convenience by providing a comprehensive overview of the vehicle’s surroundings and intended route, all rendered with unparalleled clarity and intuition.

“The Mercedes-Benz user experience of tomorrow will be hyper-personalised. With generative AI, our MBUX Virtual Assistant brings more trust and empathy to the relationship between car and driver. Thanks to our MB.OS chip-to-cloud architecture, our future vehicles will provide customers with exactly what they need when they need it.”

Magnus Östberg, Chief Software Officer, Mercedes-Benz AG

Expanding Horizons with Third-Party Applications

Mercedes-Benz continues to enrich its ecosystem with an expanding portfolio of third-party apps, elevating productivity, entertainment, and convenience within its vehicles. Noteworthy is the integration of major video conferencing tools and a partnership with Sony Pictures Entertainment for the RIDEVU video streaming service, alongside the introduction of cloud-based gaming and digital art exhibitions through MBUX Collectibles, showcasing Mercedes-Benz’s dedication to offering a diversified and rich in-car experience.

The Future is Now with Concept CLA Class

The upcoming MMA platform and the Concept CLA Class not only signify Mercedes-Benz’s innovative stride but also provide a glimpse into the future of personalised automotive experiences. The integration of MB.OS and its sophisticated hardware, such as the NVIDIA high-performance chip, exemplifies the brand’s ambition to redefine the digital life of its customers, ensuring that Mercedes-Benz vehicles remain at the pinnacle of technological advancement and personalisation.

Continue reading