Kinect Personalized Avatar

Proposal
13 May 2014
Automatic reconstruction of personalized avatars from 3D face scans
Total votes: 0

Degree:

Automatic reconstruction of personalized avatars from 3D face scans

3D face scanning with kinect

Abstract

We propose to work on a simple algorithm for computing a high-quality personalized avatar from a single color image and the corresponding depth map which have been captured by Microsoft&'s Kinect sensor. Due to the low market price of our hardware setup, 3D face scanning becomes feasible for home use. The proposed algorithm combines the advantages of robust non-rigid registration and fitting of a morphable face model. We obtain a high-quality reconstruction of the facial geometry and texture along with one-to-one correspondences with our generic face model.
This representation allows for a wide range of further applications such as facial animation or manipulation.

Further possible extensions/variations:
- use ETH facial point feature in [2] (code in [3])
- find the best sw for meshing
- realize cartoon-like version of the avatar

References: 

[1] Michael Zollhofer, Michael Martinek, Gunther Greiner, Marc Stamminger and Jochen Sußmuth, Automatic reconstruction of personalized avatars from 3D face scans, Comp. Anim. Virtual Worlds 2011; 22:195–202, DOI: 10.1002/cav.405
[2] M. Dantone, J. Gall, G. Fanelli, and L. Van Gool Real-time Facial Feature Detection using Conditional Regression Forests IEEE Conference on Computer Vision and Pattern Recognition (CVPR'12) http://www.vision.ee.ethz.ch/~gfanelli/pubs/cvpr12.pdf
[3] Code of Real-time Facial Feature Detection using Conditional Regression Forests http://blog.gimiatlicho.webfactional.com/?page_id=38