Experience-Based Language Acquisition (EBLA) is
an open computational framework for visual
perception and grounded language acquisition. It
can "watch" a series of short videos and acquire
a simple language of nouns and verbs
corresponding to the objects and object-object
relations in those videos. Upon acquiring this
protolanguage, it can perform basic scene
analysis to generate descriptions of novel videos.
While there have been several systems capable of
learning object or event labels for videos, this
is the first known system to acquire both nouns
and verbs using a grounded computer vision system.
