In this talk I will present some results from a recent EU project on Cognitive Vision. Our main goal was to build a system which could take perceptual inputs (both visual and auditory) turn them into symbols, reason about the behaviour being observed and then demonstrate the understanding by having the computer perform actions in the world. Moreover, our aim was for the system to learn all this autonomously, simply by observing the world.

I will discuss a system which achieves this in a simple table top game world, watching two players, and then taking over the part of one of the players using a talking head.

The behavioural descriptions are learned through inductive logic programming (Progol). We are also able to learn mathematical principles such as equivalence and transitivity of orderings. I will also discuss how we were able to improving classification by reasoning