At MWC 2025 , Google confirmed that itsexperimental Project Astra assistantwill roll out widely in March . It seems the feature film has started reaching out to users , albeit in a phased fashion , begin with Android smartphones .
On Reddit , one usershareda demovideothat shows a new “ Share Screen With alive ” pick when the Gemini Assistant is summoned . Moreover , the Gemini Live interface also received two new options for live telecasting and blind communion .
Google has also substantiate toThe Vergethat the aforementioned lineament are now on the rollout flight . So far , Gemini has only been able of contextual on - silver screen sentience good manners of the “ Ask about covert ” feature .
Project Astra is the future of Gemini AI
In case you are n’t familiar , Project Astra is the most futuristic iteration of an AI that can understand text , audio , picture , video , and live camera provender in veridical - time . Google Deepmind ’s inquiry director , Greg Wayne , compare it to a “ little parrot on your shoulder that ’s hanging out with you and talk to you about the worldly concern . ”
When you summon Gemini and activate the Share Screen With Live pick in any app , it will analyze the on - blind content and will suffice enquiry based on it . For example , users can ask it to name the current bodily process happening in an app , break down or summarise any clause they were read , or verbalize to them about the tantrum during TV playback .
The more impressive capability is the world understanding system of rules . When you switch to the Live way for Gemini , it now present a video feed option that start the television camera . In this mode , if you repoint your tv camera at any object , Gemini will be able to see , encompass , and answer questions based on what it sees .
Pointing the tv camera at a Good Book passage , ask Gemini to tell more about a monument , amaze advice on interior decoration , or solving problems indite on a table or book — Gemini Live ’s Project Astra upgrade can do it all . It is not too different from Apple’sVisual Intelligence on iPhones , or the receptive - sourceHuggingSnap app that promises an offline world - translate AI .
Digital Trends gravel a demonstration of Project Astra at MWCearlier this year , get an early taste of a massively upgraded AI assistant experience on smartphones . It is worth pointing out that Gemini Live ’s Project Astra upgrade will be limited to customers who pay off for a Gemini Advanced subscription .
It seems the scale of measurement of this Project Astra update rollout is n’t too wide at the moment . I have a Gemini Advanced subscription via Google One AI Premium bundle , but do n’t see it yet on any of my Pixel phones escape the latest stable version of Android 15 or the beta physique of Android 16 .