iPhone can recognize door, display live subtitles and much more

iPhone can recognize door, display live subtitles and much more
Written by insideindyhomes

New functions such as door recognition or live subtitles are intended to help users with disabilities in everyday life.

On the third Thursday in May (May 19, 2022), Apple presented a whole series of new accessibility features to help users with disabilities to coincide with the day of action for digital accessibility. In addition to door recognition and live subtitles, the Apple Watch has new gestures.

Door detection for the blind and visually impaired

When arriving at a new destination, an iPad or iPhone can now help the visually impaired locate a door, describing type and symbols. The new Door Detection feature detects doors, indicating the distance and type of a door, as well as whether it is open or closed. The function is available via the system’s magnifying glass function and supplements the person recognition and image descriptions here. However, only devices with a lidar sensor such as iPhone Pro from iPhone 12 Pro and iPad Pro are supported.

Door detection provides information about a door


Door detection provides information about a door


live subtitles

For the deaf and hard of hearing, the new live subtitles function will also be available in the course of the year, but this is only available to English users for the time being. The function automatically creates subtitles for audio content via a cross-app system function: for telephone calls, Facetime, video conferences, but also videos and a conversation with a counterpart. In Facetime, the speakers are automatically recognized. Interesting: During phone calls, answers can also be typed in, and the system then reads them out loud. The function is available from iPhone 11 (for iPads from A12 CPU), initially as a beta version.

Improved voiceover

Apple’s screen reader continues to improve, adding 20 new languages ​​and dialects, including Ukrainian. Users can also choose from dozens of new voices and there is a new correction tool for common formatting errors.

Better Apple Watch controls like Apple Watch Mirroring

Apple Watch Mirroring will soon be available to users with physical and motor impairments who have problems with the touch operation of the Apple Watch. This new feature allows the Apple Watch to be controlled via iPhone – for better access to functions such as blood oxygen measurement and heart rate. Easier operation is also possible via so-called Quick Actions, new operating gestures. For example, you can answer or end a call, dismiss a notification, take photos or start or end workouts with a double press of your fingers.

Additional functions

Other new features:

  • Want to play a game with a friend or caregiver? This is possible with the new function Buddy Controller, here one player can be played with several controllers.

  • Also new: Siri’s response time can be extended, helpful for users with language restrictions.

  • There’s a new spelling mode for voice control to dictate custom spellings to the letter. (only English for the time being)

  • Well-known sound detection can be customized to recognize specific important sounds, such as a specific alarm or a crying baby.

  • Apple Books also gets new themes and customization options, like showing text in bold and adjusting character, line, and word spacing.

Global Day of Action for Digital Accessibility

This week, Apple is celebrating the Global Day of Action for Digital Accessibility with special events.

  • A SignTime service will also be available in Canada from May 19, which is already available in the USA, UI and France. Apple Store or Apple Support customers can request an interpreter for American Sign Language in these countries and French Sign Language in France.

  • Live sessions showcasing iPhone’s accessibility features will be held in Apple stores around the world this week, as well as how-to guides across social channels.

  • A new shortcut, Accessibility Assistant, is rolling out on Apple Watch and Mac.

  • Apple Fitness + should become more accessible for everyone, with the help of subtitles, the integration of sign language and audio instructions.

  • Introductions to these functions will be provided by trainer Bakari William this week – using American Sign Language.

  • In the US, Apple Maps receives guides from the National Park Foundation that highlight accessible offerings, and Gallaudet University showcases businesses and organizations that value and include the deaf.

  • The App Store, Apple Books, and Apple Podcast also provide accessibility content.

  • Apple Musics introduces the Saylists playlist, a collection of playlists focused on one sound—for vocal sounds and speech therapy.

  • Apple TV is also showing hit movies and series this week, including Marlee Matlin (“CODA”), Lauren Ridloff (“Eternals”), Selma Blair (“Introducing, Selma Blair”), Ali Stroker (“Christmas Ever After”)


#iPhone #recognize #door #display #live #subtitles

About the author


Leave a Comment