Chrome Boosts Browser Experience with Three New AI Features

Google Chrome is enhancing its browser capabilities with a significant refresh, integrating three powerful new AI features powered by Gemini. Available across Windows, MacOS, and Chromebook Plus, these updates introduce an AI side panel for seamless multitasking, the innovative Nano Banana tool for direct image editing within the browser, and an advanced agentic AI Auto Browse feature.

AI Side Panel for Enhanced Multitasking

A new AI-powered side panel is designed to streamline user workflows, allowing direct interaction with Gemini without the need to switch between multiple browser tabs. This feature aims to save time and simplify multitasking, providing a more integrated browsing experience.

Google explains: "Our testers have been using it for all sorts of things: comparing options across too-many-tabs, summarizing product reviews across different sites, and helping find time for events in even the most chaotic of calendars."

Before utilizing the AI chat feature within the side panel, users must consent to share their URLs and browser data with Google, a crucial step for enabling personalized AI interactions.

Nano Banana: In-Browser Image Editing

Leveraging the new AI side panel, users can now directly modify and update images displayed in their browser window using a feature called Nano Banana. This eliminates the need for copying, downloading, or uploading images, allowing for instant, in-browser adjustments.

Chrome Auto Browse: Agentic AI for Premium Users

For subscribers to Google’s AI Pro and Ultra tiers, Chrome introduces Auto Browse, an agentic AI that can perform complex actions on behalf of the user. This advanced feature is capable of tasks such as researching hotels and flights, comparing costs across specific dates, obtaining work quotes, and verifying bill payments.

Auto Browse is also multimodal, meaning it can identify items within a photo, then locate where they can be purchased online, add them to a shopping cart, and even apply relevant discount codes. With explicit user permission, the AI agent can also securely access passwords and log into online stores and services to complete transactions.

Building on Google's Personal Intelligence Initiative

These new features expand upon Google's ongoing commitment to integrating AI into its ecosystem. Building on previous updates that connected Chrome's AI with apps like Calendar, Gmail, Google Shopping, Google Flights, Maps, and YouTube, these enhancements are part of Google’s broader Personal Intelligence initiative. This initiative aims to develop a more personalized and proactive AI assistant for users.

In a related development, Google recently published research exploring how on-device and in-browser AI can extract a user’s intent to deliver more personalized and proactive responses. This research highlights the potential future applications of on-device AI. For more details, read Google’s New User Intent Extraction Method.

Featured Image by Shutterstock/f11photo