Gemini AI has eyes: you can share your smartphone's camera or screen with it, here's what it's for

Google announces the rollout of screen and camera sharing to Gemini on Android smartphones. Far from being a gimmick, the feature increases the possibilities of artificial intelligence tenfold. Let's see... how it can be useful to you on a daily basis.

The Project Astra is now a reality. Behind this code name for Google's Gemini artificial intelligence lies a very simple idea on paper: allowing AI to see and analyze what our smartphone screen or camera displays. A possibility that multiplies the uses of the AI assistant. Thanks to it, it could quickly become the essential daily companion for even the most reluctant to use the tool.

Last March, the first appearances of camera and screen sharing with Gemini began to make waves on the Internet. A sign that global deployment is approaching, and indeed, it has. Now, the question everyone is asking is: what can it possibly be used for? Google provides several examples that are far from exhaustive. There's something for everyone, from cleaning to object repair, including professional advice.

Here's what Gemini Live allows with camera and screen sharing on Android

Imagine you decide to start a big spring cleaning. Your home is a mess, and the mere sight of your closet makes you want to give up. Film it with your smartphone and ask Gemini how you could categorize clothes, maximize space, or sort out what you could donate to charity.

Another situation: you notice that your window is creaking, but you don't really know what to do. Show this to Gemini and the AI will tell you what to do after identifying the problem. This also works with a connected speaker that is acting up, for example.

Read also – This robot uses Google's Gemini AI and what it can do is impressive, discover it in video

Last example. You are browsing online sales sites to find clothes, except that you can't decide what to buy. Share your screen with Gemini so that the AI can advise you. Ask it to compare products, and show it your wardrobe to the camera so that it can tell you what would go well with your future purchase.

The functionality Gemini Live with camera and screen sharing is available starting today, April 7, 2025, for all Gemini Advanced subscribers on compatible smartphones. The subscription costs €21.99 per month, but you can try it free for 30 days. Note that if you have a Pixel 9 series phone (including the Pixel 9a) or a Samsung Galaxy S25, you have access at no additional cost.