
Following Apple’s rollout of a suite of accessibility features in recognition of Global Accessibility Awareness Day on May 16, Google has also unveiled a range of accessibility enhancements across Android and Chrome platforms to commemorate the occasion.
Among the highlights is the integration of Gemini AI technology into Android’s screen reader, “TalkBack.” This enhancement enables the generation of image descriptions even when on-screen visuals lack accompanying text. Users can engage with the AI to inquire further about the image—for instance, asking about a person’s attire or accessories. The feature also facilitates interaction with shopping platforms, allowing users to explore product materials or check for available discounts.
In the latest version of “Expressive Captions,” Google leverages artificial intelligence to analyze the tone and emotional nuance of speech in videos. The subtitles not only transcribe spoken words but also reflect emotional inflections—such as adding elongated punctuation or expressive tags when a commentator shouts “What a goal!” during an intense moment in a match—thus enabling hearing-impaired users to experience the excitement conveyed by the speaker.
Initially, this feature will be available only in English-speaking regions, including the United States, United Kingdom, Canada, and Australia, and will require devices running Android 15 or later.
Through its “Euphonia” project, launched in 2019, Google has also improved speech recognition for users with non-native accents or atypical pronunciation. This initiative ensures that voice commands spoken in imperfect English are still accurately interpreted. The Euphonia project’s source code has been made available on GitHub, empowering developers to build customized services or train models for diverse speech recognition needs.
Additionally, Google.org has partnered with University College London to establish the Center for Digital Language Inclusion (CDLI), aimed at advancing voice recognition technologies for non-English speakers across Africa. This effort includes the creation of open-source datasets for ten African languages and the development of new voice models to support a wider array of speech-enabled applications.
Other updates include facial expression-based controls for Chromebooks to assist users with mobility impairments, expanded customization options in reading mode, and enhanced screen-reading capabilities through TalkBack. The Chrome browser now features improved optical character recognition (OCR), making it easier to identify text within PDF documents. Users can now select, copy, or search PDF content, and visually impaired individuals can benefit from automatic magnification for easier web navigation.