Advanced AI Software Provides Natural Description of Images

Share on FacebookShare on LinkedInShare on Twitter

Image: Advanced AI Software Provides Natural Description of ImagesGoogle software can interpret and describe complex images as naturally and accurately as a sighted person - without human assistance.

Beyond Object Recognition

Two new artificial intelligence software programs can accurately interpret images and describe them more accurately than ever before. Developed independently by Stanford University and Google, the software programs can often describe images as accurately and meaningfully as humans.

Until now, image recognition software was limited to understanding individual objects in an image. The new software teaches itself to understand an entire scene, capturing how the objects relate to one another and describing it in a natural-sounding language. For example, "A group of young people playing a game of frisbee."

The immediate application for the software will be to catalog all of the images on the Internet. But its potential for assisting the blind is obvious.

Applying Neural Networks in Software

To develop their software, Google and Stanford researchers used programs known as neural networks. Functioning much like neural networks in human brains, these computer programs train themselves to learn the relationships between objects and to identify patterns - even when their human creators can't identify them.

The programs aren't perfect and often misinterpret an image with errors that range from "minor errors" to "unrelated to the image." However, the success is far greater than any software has achieved to date. The initial results are very promising.

To learn more about Google's new image software, check out the article on the Google Research Blog.

Next Steps



For over fifteen years, Deque has been helping major corporations, government agencies, and other organizations ensure that their websites and mobile apps are accessible to everyone. We have more than fifteen years of history of serving the federal government, including undertaking the biggest accessibility program that's occurred in the United States government or anywhere. Deque also works with .edu's and mission-focused nonprofits to ensure that their materials and systems are usable and barrier free for users with disabilities. The company invented the first accessibility plug-in software, the first web-based testing platform, and the first server-based accessibility solution. All of these have been created in the service of helping our customers become accessible, advance the goals of their organization, and remove barriers for all users on the web.

  • twitter
  • facebook
  • linkedin
  • youtube