Google is upgrading the Gemini app on Mac with computer use capabilities that can work across local desktop applications and the web. The existing Task (previously Gemini Spark) functionality in the Mac app could just access local files in conjunction with Connected Apps, like @Gmail or @Google Calendar. Computer use lets Gemini for Mac click and type on your behalf to accomplish multi-step tasks in local desktop apps and the web, like navigating menus and filling out forms. Gemini works in an “isolated background window with a live preview right in your chat,” while your main screen and cursor remain free to use. On the safety front, you can stop Gemini at any time with one click, while you choose what apps Gemini uses. Google will pause for logins and payments, with confirmation needed for sensitive actions. Many everyday tasks span desktop apps and websites that don’t connect to each other. Computer use handles the tedious steps in the background so you can save time without giving up your screen or cursor. Example use cases include: Speed up creative workflows: Batch color-grade photos in your favorite design software or set up complex 3D scenes. Skip manual form entry: Extract weights, dimensions, and addresses from local PDFs to fill out multi-box shipping quotes. Turn live data into ready-to-present decks: Pull metrics and screenshots from live dashboards across multiple regions and build a presentation in Google Slides. Batch-list items for sale: Analyze clothing photos from a local folder, research pricing, log item details, and stage listings on resale platforms. To use, add @Computer use to your prompt. In Customize > Connectors, you’ll see new “Desktop” apps like Blender and Autodesk Fusion join the existing Git and Obsidian integrations. Computer use is rolling out in US English starting today for Google AI Plus, Pro, and Ultra subscribers. FTC: We use income earning auto affiliate links. More.
Gemini app for Mac adds computer use to control desktop apps
Full Article
Original Source
Read the full article at 9to5google →KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.