Advanced AI Software Provides Natural Description of Images

Deque Systems

By Deque Systems

February 9, 2015

Image: Advanced AI Software Provides Natural Description of ImagesGoogle software can interpret and describe complex images as naturally and accurately as a sighted person – without human assistance.

Beyond Object Recognition

Two new artificial intelligence software programs can accurately interpret images and describe them more accurately than ever before. Developed independently by Stanford University and Google, the software programs can often describe images as accurately and meaningfully as humans.

Until now, image recognition software was limited to understanding individual objects in an image. The new software teaches itself to understand an entire scene, capturing how the objects relate to one another and describing it in a natural-sounding language. For example, “A group of young people playing a game of frisbee.”

The immediate application for the software will be to catalog all of the images on the Internet. But its potential for assisting the blind is obvious.

Applying Neural Networks in Software

To develop their software, Google and Stanford researchers used programs known as neural networks. Functioning much like neural networks in human brains, these computer programs train themselves to learn the relationships between objects and to identify patterns – even when their human creators can’t identify them.

The programs aren’t perfect and often misinterpret an image with errors that range from “minor errors” to “unrelated to the image.” However, the success is far greater than any software has achieved to date. The initial results are very promising.

To learn more about Google’s new image software, check out the article on the Google Research Blog.

Next Steps

 

Deque Systems

Deque Systems

Deque is the global leader in digital accessibility, helping the world’s top enterprises build inclusive products, services, and experiences and achieve lasting compliance. Recognized by leading industry analysts for its AI-powered tools, comprehensive services, and developer-trusted solutions, Deque delivers the industry’s most complete accessibility offering. The Axe platform, anchored by Axe-core, has more than 3 billion downloads and 875,000 installed extensions, making it the global standard for accessibility testing. As a pioneer of people-first accessibility, Deque applies a human-in-the-loop approach that blends expert insight with AI innovation to advance its mission of digital equality for all.

More on this topic

Google I/O and GenAI’s Impact on Accessibility

Divya Rustagi
May 28, 2024 By Divya Rustagi

I have been watching Google I/O online since 2015. It’s their flagship tech conference for anyone in the tech industry, including accessibility professionals. This year,…

Read Article
Blog Google IO

Multimedia Accessibility: Is it important?

aparna pasi
November 19, 2018 By Aparna Pasi

It’s no surprise that blind people can’t see your multimedia and deaf people can’t hear it. What IS surprising though is the frequency with which…

Read Article