Cosyne 2008 Workshops
March 3-4, 2008
Snow Bird, Utah
Speaker Name
A. Blake
Talk Title
Face-fitting Stereoscopically
Talk Abstract
with B. Amberg, A. Fitzgibbon, S. Romdhani, T. Vetter
Broadly, we are addressing in our "C-Slate" project the problems of teleconferencing including face-to-face interaction and interacting with documents. Stereoscopy has a potentially powerful role here, both in sensing the hands for object interaction and in sensing the face. To this end we have built a series of "i2i" stereo webcams which deal naturally with face to face viewing. In particular, this talk summarises progress towards our goal of real-time face fitting. Our 3D morphable face model based stereo system applies a strong face-prior to extract accurately the 3D shape and pose of faces from stereo. Results using two and three input images are presented. The use of stereo obviates the reliance on modelling of illumination and albedo that is required with monocular capture, resulting in a system that is more accurate and robust.
