Geometric Deep Learning for Perceiving and Modelling Humans

Francesc Moreno-Noguer (Institut de Robotica i Informatica Industrial, Barcelona, Spain)

Abstract:

Perceiving and modelling shape and appearance of the human body from single images is a severely under-constrained problem that not only requires large volumes of data, but also prior knowledge. In this talk I will present recent solutions on how deep learning can leverage on geometric reasoning to address tasks like 3D estimation of the body pose and the shape of the clothes. In the second part of the talk I will also describe novel GAN’s conditioning schemes to model full body’s appearance and facial expressions in a weakly supervised manner.