Google is testing a more responsive split-screen function for Gemini that enables the AI to read and respond to whatever appears on another app operating beside it. There is some speculation that the new function is focusing on larger displays to begin, such as tablets and book foldables. It may not initially be accessible on normal phones.
How does this new experience function? Via a test found inside Google app v16.46.62, a “Share screen and app contents” control appears at the top of Gemini’s text input. When tapping it, Gemini is granted permission to evaluate what’s occurring in split-screen in the adjacent app, with no reliance on the flow-of-control overlay or presentation in Gemini Live. You can run the Play Store on one side and ask Gemini “what’s this” on the other to get a description rooted in that app’s on-screen material.
Early behaviors are still somewhat unpolished: it may sum up wide interfaces but yield unclear insights when examining comprehensive app reports. These aberrations exemplify characteristics that are still being improved in advance; Google is refining how Gemini detects on-screen elements and limits of context.
Why are big screens the main focus for now? At this point, the function is geared toward configurations designed for continuous side-by-side multitasking, with large displays generally making split-screen beneficial: two applications sharing a display needn’t be too confined; likewise, the AI can understand more of the interface simultaneously, aiding it in identifying matters and replying.
That’s noteworthy because Google has invested a ton of effort into optimizing these larger Android screens, from updating the taskbar to improving multi-window quirks with each successive edition of Android. Industry momentum supports that focus. According to IDC, foldable telephone shipments were more than 15 million in 2023 with tablets continuing as a key productivity and education sidekick. The addition of Gemini context-aware assistance to these formats is key, as that’s where multitasking really takes place.
Until recently, Gemini has simply relied on overlays like Circle to Search or the Gemini bubble to determine what’s on screen. They are useful but flimsy for multitasking — the overlay frequently disappears as you return to the app you are trying to analyze. Gemini Live can see your screen during a shared session, but its interface is different from the typical chat experience and it’s overkill for a quick look-see.
The split-screen approach lowers friction. Keep your document (or storefront, or map) open on one side and chat with Gemini on the other. Ask it to:
- Summarize a section of a PDF
- Compare product specs
- Pull dates out of an itinerary
- Translate a paragraph
When working across multiple apps, that slight change can be a big win in usability.
Privacy, consent, and the technical guardrails involved
The opt-in prompt is critical. On Android today, screen sharing typically uses the MediaProjection framework (which displays a system consent sheet and capture indicator). The share sheet and the label on apps suggest Gemini won’t actively read anything unless you give explicit authorization, and it should be a revocable session. Look for Google to point out once again that recorded content can be used for answering questions, as detailed in its Gemini data usage information.
Performance will matter, too. In order to parse a live app view you need fast on-device capture and intelligent server-side interpretation. That’s also why tablets and foldables are a natural place to start; they have big-screen hardware, often with more RAM and higher-end chipsets, that gives you the headroom required for a responsive experience.
What to watch next as Google expands split-screen tests
There’s also no rollout timeline just yet, and the feature may appear in beta channels before it arrives for everyone. The big unknown here is whether Google would roll this out to legacy phones after getting rid of edge cases. Android’s split-screen is getting better in newer versions, but the confined layout can affect how much context Gemini can parse with any real accuracy from a smaller screen.
If Google pulls this off, Gemini is more than just a general chatbot — it’s a real-time, on-device companion that knows what you’re up to outside of apps and can assist in context without ruining your flow. That could be one of this year’s most legitimately useful quality-of-life upgrades for large-screen Android users.
