Google Boosts Accessibility and AI on Android and Chrome

Google has launched new AI-powered accessibility features for Android and Chrome, significantly improving user experience for people with disabilities.

Gemini Enhances TalkBack Screen Reader

TalkBack, Android's screen reader, now integrates with Google's Gemini AI. This allows users to ask questions about images and on-screen content, even without alt text. For example, users can inquire about the details of a picture or the material of an item in a shopping app.

This builds upon last year's Gemini integration, which provided AI-generated image descriptions. The enhanced functionality offers a more interactive and informative experience for visually impaired users.

Expressive Captions Get More Expressive

Google also updated Expressive Captions, Android's real-time captioning feature. The update introduces a duration feature, allowing users to perceive the emphasis in spoken words. It also includes new labels for sounds like whistling or throat clearing. This update is available in English for users in the U.S., U.K., Canada, and Australia on devices running Android 15 and above.

Improved PDF Accessibility in Chrome

Chrome now utilizes Optical Character Recognition (OCR) to make scanned PDFs accessible. Users can now highlight, copy, search text, and use screen readers with scanned PDFs, just like any other webpage.

Enhanced Page Zoom in Chrome on Android

Page Zoom on Chrome for Android now allows users to increase text size without affecting the page layout. Users can customize zoom levels and apply preferences to specific or all websites. This feature is accessible through the three-dot menu in Chrome's top right corner.

These updates demonstrate Google's commitment to improving accessibility and leveraging AI to enhance user experience across its platforms.