It’s basically the first time we’ve automated perception of vision as it relates semantically with language.

In terms of theory, such systems are candidates for a generic perception engine you might use in say, a robot with cameras, speaker and a microphone.

Perception is just one aspect of intelligence, but this research ultimately makes it possible for a machine to encode data semantically.