Mobile

An app that describes the world for the visually impaired

The world can be a beautiful place with sunsets, mountains and a plethora of beautiful sites to see all over the world. However, our vision can be one of the most precious things we have, this is only truly realized when we consider all of those who are unfortunately without vision or are somewhat impaired.

For many without vision, the simplest of tasks can present a problem. However, thanks to a new app, the struggles which blind people currently face may become a lot easier.

Aipoly is a new app which can recognize objects using a smartphone’s camera, and then pronounce out what it ‘sees’ to give blind people, more detailed information about what is in front of them. While there are other apps out there that provide a similar service, AIPOLY is the first app that does not require internet as it stores the information within the app.

It is very quick to identify what is in front of the camera and can analyze the camera image three times a second while feeding back what it sees. Though it still makes occasional errors, it is definitely a step forward in the right direction. This technology holds great promise when collaborated with other areas of technology. For example with the implementation of smart glasses such as Google Glass, those who are visually impaired could have a better chance of visualizing or at least a greater understanding of what they are looking at.

Robin Christopherson, who is blind, described his anticipation for the possibilities with this technology in a recent blog post on abilitynet.org.uk. He states “Combining such a useful app with a head-mounted camera would make AIPOLY a winner for me. Having a camera with this kind of intelligent object and text recognition, observing and analyzing whatever it is I’m looking at, is a dream I’ve had ever since the advent of Google Glass ushered in a new era of raised awareness of our surroundings.”

Sam Brake Guia

Sam is an energetic and passionate writer/presenter, always looking for the next adventure. In August 2016 he donated all of his possessions to charity, quit his job, and left the UK. Since then he has been on the road travelling through North, Central and South America searching for new adventures and amazing stories.

View Comments

  • The app works in a number of scenarios. As well as recognizing people it’s seen before and guessing strangers’ age and emotion, it can identify household products by scanning barcodes. It also reads and scan documents, and recognizes US currency. This last function is a good example of how useful it can be. As all dollar bills are the same size and color regardless of value, spotting the difference can be difficult or even impossible for the visually impaired. An app like Seeing AI helps them find that information.

  • Braille Works looks to the tech world this week, by highlighting some of the most useful apps which play a role in the visually impaired community.

Recent Posts

AI reasoning and the infinite puzzle of Borges’ Library of Babel

Many people have the intuition that an LLM (Large Language Model, e.g. ChatGPT) doesn't really understand…

3 days ago

UK’s DARPA-inspired ARIA opens ‘Engineering Ecosystem Resilience’ research opportunity

ARIA's opportunity space for engineering ecosystem resilience follows a global trend of public and private…

3 days ago

Healthcare providers now have unprecedented data insights into the patient journey as PurpleLab® acquires KAID Health

In the U.S., we’re seeing an incredible growth of the healthcare analytics market, with the…

4 days ago

First Financial Federal Credit Union prioritizes empathy with Ribbon partnership for inheritance claims 

When our loved ones pass on, it can be one of the most traumatic events…

4 days ago

Tackling antimicrobial resistance with new cleaning protocols

When we hear the word pandemic, our mind is likely to jump to the events…

5 days ago

Peru makes history: defeats Japan to claim Pokémon Unite World Championship title

Team Peru Unite made history in Anaheim, California by defeating Japan’s powerhouse Zeta Division 3-1…

5 days ago