App Review: can Image recognition Apps be Useful to Blind and Visually impaired photographers?

Nowadays the app store offers a large variety of free and paid image recognition and magnification apps. Most of them are designed to help blind and visually impaired people to identify everyday objects such as written documents and household items like cans or bottles. However, all these projects take visual impressions and convert them into text or speech output, which in a way makes them similar to our photo descriptions. Of course our descriptions are written by real people, putting their own interpretations and associations into the texts, and not by machines, using image databases to recognize objects. Still, we were wondering, if some of the apps could be useful for artistic purposes e.g. to help blind photographers to identify what’s in front of their camera or to sort photos after they were taken. I found numerous detailed tests of the various apps, but none of them focused on the artistic aspect.

Work in progress

Throughout the next weeks we are collecting apps to feature in our comparison. The aim is to get a comprehensive list of apps and to test them not on household items, but on photo motives such as landscapes, people and animals and artworks like paintings, sculptures and photographs from our blog. Therefore, we encourage you to send us names of image recognition apps and pictures of the above mentioned things as test motives. Of course you can also do tests yourself and send us your results to be published here. Are there any other apps you use to take or modify pictures? I’ll do my tests with an IPhone and IOS apps, but Android tests are also welcome. Some of the below mentioned apps work with live-recognition, so I’ll try them on potential photo motives.

I’m especially interested in how the apps deal with more complex motives such as portraits, group shots and images working with light and shadow as well as subtle colour shades. Are the live-recognition apps good enough to focus on an object before taking the actual picture? And are apps working with already taken photos good enough to help us to sort pictures or even to decide which ones are ‘good’ and ‘bad’?

Here are my initial lists of apps and thinks I want to try them out on. This is just a very general outline of the test, so feel free to add suggestions in the comments below or e-mail us at picdesc@gmail.com

Apps to test

Some of the apps are especially designed for visually impaired an blind users, others are shopping and price comparison apps.

  • Aipoly Vision (iOS, Free)
  • CamFind
  • Leavesnap
  • TapTapSee
  • ThirdEye Technologies Inc. (iOS, Free)

Test objects:

Naturally I can only test things I’ll find in my surrounding or objects we have pictures of in our blog. This is just a random list of things coming to my mind at the time of writing.

  • Different animals
  • Beach, mountains
  • reflection in water or glass
  • sky, sunset, moon
  • fire or candle
  • Portrait, only part of a body
  • group of more than 2 people
  • tree, leave of tree, flower
  • house, staircase
  • car
  • food
  • writing on a sign or wall
  • shop window
  • statue,
  • painting

Please feel free to send us items to add to the list of apps and objects. We look forward to reading your suggestions.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s