- Google launched Computer Use in the Gemini app for Mac, enabling the AI assistant to interact independently with apps, websites and local files based on text instructions.
- The feature is gradually becoming available in English to users in the United States.
- Users can monitor Gemini’s actions, pause tasks, limit app access and approve important operations.
Google announced the launch of Computer Use in the Gemini app for Mac, allowing the AI assistant to perform complex tasks across local files, apps and websites. The rollout expands Gemini from answering queries to directly handling everyday computer work and is gradually reaching English-language users in the United States.
Users can describe a desired outcome in text, after which Gemini can click buttons, enter text, open menus and complete forms. Google said the feature is expected to reduce the time spent on repetitive work that would otherwise require dozens of manual actions.
Tasks Gemini can perform on Mac
Google said Computer Use can handle multistep tasks involving graphics, forms, presentations and online product listings.
For graphics work, Gemini can carry out batch color correction for photos in design apps and configure complex 3D scenes. It can also extract weights, dimensions and addresses from local PDF files and use the information to create delivery requests automatically.
For presentations, the assistant can collect metrics and screenshots from monitoring dashboards covering different regions and assemble the material in Google Slides.
Gemini can also analyze photographs of clothing saved in a local folder, research prices, save product specifications and prepare listings for resale platforms.
User controls and availability
Gemini performs Computer Use tasks in an isolated background window, while a preview of its actions appears in the chat. The setup leaves the Mac’s main screen and cursor available, allowing the user to continue working while the assistant completes a task.
Users can choose which apps Gemini may access, watch its actions in real time and pause execution. The assistant also requests permission before carrying out important operations.
Computer Use is gradually becoming available in English through the Gemini app for Mac in the United States. Users must download the desktop app from Google’s website to access the feature.
Source: Incrypted
