Apple announces Apple Intelligence powered accessibility feature updates

In a significant announcement, Apple has revealed a series of innovative accessibility updates that harness the power of Apple Intelligence. These enhancements, which include improvements to VoiceOver, voice control, live recognition, and real-time video captioning, aim to create a more inclusive experience for users ahead of Google's developer conference. One of the most notable updates is designed for Vision Pro users, who will now have the ability to control compatible wheelchairs using just their eye movements. This feature, which requires no recalibration in varying lighting conditions, will initially support Tolt and LUCI alternative drive systems in the U.S., offering both Bluetooth and wired accessory options. Apple's advancements in image recognition within VoiceOver also make a significant impact, as the technology can now interpret images with greater accuracy and detail. For example, it can analyze a bill and read out key information such as the total amount due and the payment deadline. Furthermore, users will benefit from improved descriptions of photographs and personal documents. The introduction of the Live Recognition feature allows users to utilize their iPhone's camera to identify objects and scenes in real-time, enabling them to ask follow-up questions for further information. Additionally, users with low vision can set the Magnifier feature to the action button, providing access to content in high contrast, while voice commands such as “zoom in” or “turn on flashlight” facilitate easier navigation. Apple is also enhancing its Reader app, which will now support complex documents—like scientific papers—featuring multiple columns, images, and tables. Users will be able to receive AI-driven summaries or read texts in their preferred language while preserving custom fonts and colors, catering to those with dyslexia and low vision. Moreover, Apple is set to introduce AI-generated subtitles for videos lacking pre-existing captions, applicable to content captured on iPhones or shared by contacts. This feature will be available on multiple devices, including iPhone, iPad, Mac, Apple TV, and Apple Vision Pro, with customizable subtitle appearances. In addition to these advancements, the name recognition feature has been extended to support 50 languages, alerting users with hearing impairments when their name is mentioned. The rollout of large text support for tvOS and improved device handoff for Made for iPhone hearing aids are also on the horizon, with all these features expected to be included in the upcoming iOS 27 release later this year.