Meta is integrating its Muse AI agent into smart glasses, allowing users to execute tasks via voice commands without using a smartphone. The system is powered by the Muse Spark AI model, which operates within a private, persistent cloud-based Linux virtual machine equipped with its own browser, file system, and terminal.
Muse is designed for consumer use with a simplified, chat-like interface and an anthropomorphic avatar. The agent can write and execute code, manage sub-agents, and create scheduled tasks. It generates interactive tools such as documents, PDFs, websites, and data dashboards to assist with daily activities.
The agent handles practical tasks including booking travel, sending emails, filling out forms, and purchasing items. For payments, Muse utilizes Stripe Link with virtual, single-use cards to ensure that the AI does not access the user's primary financial information. It can also negotiate bills and assist in selling vehicles.
Specific smart glasses features include scheduling appointments, checking flight prices, tracking diet, and identifying products in the user's field of view. Users initiate commands by saying 'Hey Muse' or a custom name. The agent then performs background operations and provides feedback upon completion.
Regarding privacy, Meta states that Muse data will not be used for advertising, though it may be used to train future models unless the user opts out. Currently, the cloud environment is isolated but accessible by Meta. The company plans to introduce a Confidential VM option later this year to restrict even Meta's access to the environment.
