I will then show that the same type of approach can be applied to register non-rigid 3D surfaces. However, since monocular non-rigid reconstruction is severely under-constrained we will have to consider additional constraints, either based on local rigidity (to reconstruct deformable and inextensible surfaces), or based on shading coherence (to reconstruct deformable and stretchable surfaces).
In the final part of the talk, I will discuss the major limitations of these linear formulations and propose a novel and alternative stochastic exploration strategy. I will present results both for non-rigid shape and human pose recovery.