New AR Capability Integrated into Gemini Live

Google has placed hidden code in the most recent Android version of its Google app that enables an augmented‑reality (AR) overlay of Google Maps information within the Gemini Live experience. When users point their phone camera at a street, restaurant or other point of interest, the overlay can display the name of the place and its Google Maps rating directly on the viewfinder. This mirrors the functionality of the existing Google Lens AR feature inside the Google Maps app, but it is now embedded in the conversational AI environment of Gemini Live.

How the Feature Works

Gemini Live already allows users to chat naturally with the AI while showing it the world through the phone’s camera, answering questions about landmarks, businesses and other visual cues. With the new code activated, the system adds map data to the visual feed, providing a richer context. The Android Authority team was able to enable the feature and observed a basic yet functional overlay. In addition to visual cards, the system can deliver map details in audio mode, though users must specify the exact places they want information about.

Potential Uses and Extensions

The AR overlay is seen as particularly useful for emerging smart‑glass platforms. By projecting a Google Maps info card directly into a wearer’s line of sight, the technology could support hands‑free navigation and location awareness. The article notes the possibility of a new Samsung‑made pair of smart glasses arriving before the end of the month, suggesting a near‑term hardware pairing for the feature.

Relationship to Other Gemini Live Features

This development builds on the visual‑guidance functionality that Google demonstrated at the Pixel 10 launch event. That feature highlights specific objects in the camera view—such as buttons, parking spots or tools—to aid user interaction. The new AR map overlay extends that concept by adding contextual location data, further blending AI‑driven visual assistance with real‑world navigation.

Rollout Outlook

Google has not provided a specific timeline for a mass rollout of the AR map overlay. However, the presence of the code in the current app version and Google’s recent push to release AI features quickly suggest that broader availability could follow relatively soon. The article emphasizes that while the feature is still in a prototype stage, the groundwork is already laid for deeper integration of map data into Gemini Live’s AI‑enhanced camera experience.

Used: News Factory APP - news discovery and automation - ChatGPT for Business