Gemini Computer Use API

Google's Gemini API documentation describes a Computer Use tool in which the model reads screenshots and returns UI actions such as clicks, typing and navigation, with each step carrying an intent field explaining it. The developer's client executes the actions, for example through Playwright, in a sandboxed environment, and sends back a new screenshot in a loop. Gemini 4 and 3.x models cover browser, mobile and desktop, with configurable safety policies and opt-in prompt injection detection. Several details, including model recommendations, are not independently sourced.