Skip links

New Features and Updates for Meta’s AI Agent Muse Unveiled

Meta has accelerated its investment in consumer AI with the introduction of its latest personal AI agent, Muse, just weeks after its initial launch.

During the annual Connect event in Menlo Park, Meta CEO Mark Zuckerberg emphasized the company’s commitment to Muse. “We’re going all-in,” he stated, indicating that this AI platform is central to Meta’s vision for the future.

The Muse agent, which has a physical representation named Jolly, is designed to streamline daily tasks by integrating with users’ various applications and services, such as email and calendar tools. At the event, Zuckerberg unveiled several new features and integrations aimed at making Muse a vital part of users’ everyday activities. It will also be accessible through upcoming Meta AI glasses.

Launched in early September, Muse interacts seamlessly across multiple devices and digital accounts. It leverages Muse Spark, Meta’s multimodal AI model designed specifically for more effective agent-based work. The company claims that Muse will be a more user-friendly option compared to existing competitors, providing an AI assistant capable of automating many routine tasks.

“Muse is the centerpiece of our vision,” Zuckerberg noted while speaking at the event. He expressed optimism that it would evolve into a personal superintelligence widely used to enhance users’ lives. He also hinted at monetization possibilities, suggesting Muse will eventually generate revenue for both users and Meta.

Zuckerberg commented, “We are backing this initiative by offering Muse free for numerous transactions, with future plans to implement a small fee.”

Muse’s New Digital Avatar

A particularly engaging announcement was that users will soon be able to create a unique digital avatar for Muse, allowing real-time video chats. This feature, powered by a new AI model called Muse Realtime Avatar, aims to humanize the AI’s presence.

This development brings a more personable aspect to Meta’s previously faceless AI, allowing users to perform live interactions by assigning tasks and posing questions.

Additionally, Muse will be integrated with Meta’s smart glasses, permitting voice-activated interactions. Users will be able to ask Muse to guide them through workouts, log meals, schedule appointments, and help with shopping, all initiated by simply speaking to the glasses.

The company mentioned that Muse will operate in the background and provide updates upon task completion. While a specific launch date for these features has yet to be announced, Meta indicated they expect to roll them out in the coming months.

Muse to Operate on Mac

In another significant announcement, Meta confirmed that Muse will extend its functionality to the Mac platform. Users will soon be able to delegate various tasks to their AI agent, allowing Muse to manage applications on their desktops.

“You can let it help manage your small business or simply take care of your workload,” said Alexandr Wang, Meta’s Chief AI Officer, during the keynote. “You can step away from your computer, and Muse will continue working on the tasks you’ve lined up.”

Muse Will Have Its Own Email Address

To enhance its utility, Muse will require a dedicated email address, which Meta plans to roll out soon. This feature will enable users to involve Muse in email threads or forward messages for the AI to manage.

The company has also secured partnerships with prominent platforms such as Stripe and Shopify, further demonstrating Muse’s role in e-commerce. Muse will be capable of accessing entire product catalogs and utilizing payment methods through Shop Pay and PayPal.

Furthermore, Muse will connect with retailers like Best Buy, Gap, Sephora, Walmart, and Wayfair. It will also integrate with services such as Expedia and soon Instacart. Meta has opened its platform to developers, allowing them to create specialized connectors for Muse, leading to an overwhelming response of over 1,500 applications in under a week.

Editor’s Take

The launch of Muse signifies a significant leap in AI integration into everyday life, particularly in simplifying complex tasks and enhancing user experiences. Its multifaceted capabilities, particularly with retail and productivity tools, position it as a pivotal resource for both consumers and businesses. As developers begin building on this platform, we may see an exciting evolution in the types of applications that emerge.

Source: techcrunch.com

Leave a comment