Google rolls out new AI and accessibility features to Android and Chrome

Google announced connected Thursday that it’s rolling retired caller AI and accessibility features to Android and Chrome. Most notably, TalkBack, Android’s surface reader, present lets you inquire Gemini astir what’s successful images and what’s connected your screen.

Last year, Google brought Gemini’s capabilities to TalkBack to springiness radical who are unsighted oregon person debased imaginativeness entree to AI-generated descriptions for images, adjacent erstwhile Alt substance isn’t available. Now, radical tin inquire questions and get responses astir their images.

Image Credits:Google

For example, if a person texts you a photograph a their caller guitar, you tin get a statement of it and inquire questions astir the marque and color. In addition, you tin present get descriptions and inquire questions astir your full telephone screen. So, if you’re buying successful an app, you tin inquire Gemini astir the worldly of an point you’re funny successful oregon if determination is simply a discount available.

Google besides announced contiguous that it’s updating Expressive Captions, Android’s real-time captions diagnostic that uses AI to seizure what idiosyncratic says, and however they accidental it.

Google says it’s alert that 1 of the ways radical explicit themselves is by dragging retired the dependable of their words, which is wherefore it has developed a caller duration diagnostic connected Expressive Captions. Now, you’ll cognize if a sports announcer is calling retired an “amaaazing shot” oregon erstwhile idiosyncratic isn’t simply saying “no” but “nooooo.” You’ll besides commencement to spot caller labels for sounds, specified arsenic erstwhile a idiosyncratic is whistling oregon clearing their throat.

Image Credits:Google

The update is rolling retired successful English successful the U.S., U.K., Canada, and Australia for devices moving Android 15 and above.

Google is besides making it easier to entree PDFs connected Chrome. Up until now, you wouldn’t beryllium capable to usage your surface scholar to interact with a scanned PDF successful your desktop Chrome browser. Now, Chrome automatically recognizes these types of PDFs, allowing you to highlight, copy, and hunt for substance similar immoderate different leafage and usage your surface scholar to work them. This is acknowledgment to the instauration of Optical Character Recognition (OCR), Google says.