Try AI Pointer here

Start with the two official demos. Create is for changing something on screen; Find is for pointing at visual information and asking AI to identify or locate it.

What it is

AI Pointer is a Google DeepMind experiment where the mouse pointer becomes part of the AI interface.

Instead of describing everything in a chat box, you point at the thing you mean, then ask for the action you want.

Why it matters

A lot of AI work today still feels like translating your screen into text. You copy something, open another tab, paste it into a chatbot, explain the context, write the prompt, then bring the answer back into the original workflow.

That works, but it adds friction exactly when you are already thinking. The tool is powerful, yet the interface keeps asking you to leave the place where the work is happening.

AI Pointer treats pointing as context. The cursor can say "this thing, right here" before you type the rest of the request. That moves AI closer to the work on screen instead of forcing every task through a separate chat window.

Try the Create demo

Use Create when you want AI to modify or generate something based on the area you point at.

The demo already includes the on-screen instructions, so the easiest path is to open it, follow the built-in guide, and notice how little setup text you need compared with a normal chatbot workflow.

Try the Find demo

Use Find when you want AI to understand or locate something visual on the screen.

This is the side of AI Pointer that feels closest to search, but with the screen itself becoming the query instead of a typed description.

Googlebook note

Google also mentioned a related Magic Pointer idea for Googlebook, where Gemini can offer contextual suggestions around what you point at.

That connects AI Pointer to a bigger product direction: if the pointer can carry context, AI does not always need a separate chat window.

What to watch for

These are still experimental demos, not a finished everyday product.

You may need a Google account, and the demos can change as Google updates AI Studio.

If this kind of interface becomes common, the important questions will be privacy, screen permissions, app support, and how clearly the AI shows what part of the screen it is using as context.

Links