Meta Explores AI Glasses That Remember What Users See, Hear
Meta is reportedly developing AI-powered smart glasses that could analyze a user’s surroundings through continuous audio and periodic images, allowing its assistant to answer questions about places visited, objects seen and conversations heard.
Topics
News
- CEA Nageswaran Pushes GCCs On AI Skills
- European Banking Regulators Warn on Frontier AI Risks
- Meta Explores AI Glasses That Remember What Users See, Hear
- Mistral Launches Robotics AI Model for Factories
- Meta Defends Child Safety Measures After Instagram Ad Row
- Google Cloud Plans More AI Data Centers in India
Image Credit- Chetan Jha/ MIT Sloan Management Review India
Meta is developing a new generation of AI-powered smart glasses that could monitor a user’s surroundings, enabling its artificial intelligence assistant to recall what the wearer saw or heard throughout the day, according to a report by the Financial Times.
The experimental feature, internally known as “super sensing,” would use the glasses’ cameras and microphones to periodically capture visual and audio information, allowing users to later ask Meta AI questions about their daily activities.
According to the report, the glasses would collect audio continuously while capturing images every few seconds. Unlike the current generation of Meta smart glasses, which illuminate an LED indicator when recording photos or videos, the report said Meta is considering not activating the light when the new AI-powered sensing feature is running.
The capability could also potentially be introduced to existing Meta smart glasses through a software update, the report added.
One version of the proposed system would avoid storing raw photos or audio recordings. Instead, Meta is reportedly evaluating a process that extracts metadata from captured images and sound before uploading that information to its servers, where Meta AI would process user queries.
The feature could allow users to ask questions such as where they left a personal item, details about a location they visited earlier in the day or information from previous conversations.
The company is also reportedly discussing whether data collected through the glasses could be used to train its AI models, as Meta continues investing heavily to compete with rivals including OpenAI, Google and Anthropic.
Responding to the report, Meta declined to comment on what it described as “internal prototypes.” The company said its approach focuses on “privacy built in from the ground up” and pointed to its research initiative, Project Aria, which develops privacy-preserving technologies for wearable devices.
Meta said Project Aria includes technologies that help users without capturing photos and videos in the same way as conventional cameras, including features that automatically convert spoken language into text.
Chief Executive Mark Zuckerberg has repeatedly described AI-powered glasses as a potential successor to smartphones, arguing they could become the primary interface for interacting with AI assistants.
During the company’s first-quarter earnings call earlier this year, Zuckerberg said he expects future AI glasses to evolve beyond answering questions.
“I’m also really excited to see the glasses evolve from being able to answer questions to being able to be a personal agent that’s with you all day long, helping you remember things and achieve your goals beyond glasses,” he said.
Meta has been steadily expanding its wearable AI ambitions. In December last year, the company acquired AI pendant startup Limitless, whose devices record and transcribe conversations in real time and allow users to search those interactions later through an AI-powered application.
The latest reported prototype signals Meta’s continued push toward always-on AI assistants that can understand users’ environments and provide contextual assistance throughout the day, even as such capabilities are expected to intensify debates around privacy, consent and data collection.
