Adam Engst crashed his ElliptiGO on September 15 and fractured his wrist. He couldn’t type. He couldn’t even hold his phone steady enough to swipe through his usual apps. So he talked to his iPhone instead, leaning on Apple’s new iOS 27 accessibility features. For once, it actually understood him.
Those features rolled out free on September 14. They aren’t flashy. But if you’ve ever needed to get through a day without typing, or you’re one of the roughly 1 in 4 American adults living with a disability, this update might matter more than anything else Apple shipped this year.
Your iPhone Can Now Caption Any Video, Automatically
iOS 27 generates synced captions for any video you watch on your phone, and translates captions that already exist. Not just Netflix or YouTube. Home movies count too, along with the blurry clip your kid sent in the family group chat. Apple hasn’t published every detail yet, and language support is still fuzzy. But the feature works at the system level, so it reaches videos that never had captions before.
Picture a hard-of-hearing nurse working the night shift. Her sister keeps sending unedited video updates from a family trip: no captions, mumbled audio, background noise. Before this update, she either missed half of it or waited for someone to describe it later. Now she just watches it. That’s five minutes of her evening back, and one less moment of feeling shut out of her own family.
Voice Control Finally Talks Like a Person
The bigger shift sits under the hood. Voice Control used to demand memorized commands: tap that button, then select that field, in exactly that order. Apple’s new AI accessibility tools let you describe what you want in plain English, the way you’d explain it to a friend.
Engst felt that shift firsthand. Writing on TidBITS Talk, he described how iOS 27’s improved Dictation let him fix mistakes mid-sentence by voice, saying “capitalize that” or “replace that phrase,” instead of stopping to type a correction he physically couldn’t make.
“Grammarly does an excellent job of figuring out what I intended to say.”
He wrote that about the tool he paired with Voice Control to catch what dictation missed. It wasn’t flawless: it still trips over homophones and plurals, and it doesn’t work inside every app yet. But it kept him working through six weeks in a cast, work he’d have otherwise turned down or paid someone else to finish. Six weeks of lost freelance income runs into the thousands for many people. A free update that keeps you earning through a broken wrist beats most $200 accessibility gadgets.
Who These AI Accessibility Features Actually Help
Apple also sped up image descriptions for blind and low-vision users. According to AppleVis, the new tools describe a photo, or an entire screen, out loud in under three seconds, no separate app required. Combined with captions and smarter Voice Control, this one update reaches a wide range of people:
- Deaf and hard-of-hearing users who watch uncaptioned home videos and voice messages daily
- Blind and low-vision users who need fast, accurate descriptions of photos and screens
- People recovering from a broken wrist, surgery, or any injury that makes typing painful
- Parents watching videos on mute next to a sleeping baby, and commuters who forgot headphones
One caveat: Apple hasn’t said which languages get captions first, and the heaviest AI features need an iPhone 15 Pro or newer. Update anyway if you qualify. As Forbes contributor Keely Cat-Wells put it, good AI accessibility shifts the burden off the person and onto the device. This update actually pulls that off.
Open Settings, tap General, then Software Update tonight. It costs nothing, and you might not realize how much you need it until the week you can’t type.