Kinect Personalized Avatar

Proposta
13 Maggio 2014
Automatic reconstruction of personalized avatars from 3D face scans
Voti totali: 0
Automatic reconstruction of personalized avatars from 3D face scans

3D face scanning with kinect

Abstract We propose to work on a simple algorithm for computing a high-quality personalized avatar from a single color image and the corresponding depth map which have been captured by Microsoft&'s Kinect sensor. Due to the low market price of our hardware setup, 3D face scanning becomes feasible for home use. The proposed algorithm combines the advantages of robust non-rigid registration and fitting of a morphable face model. We obtain a high-quality reconstruction of the facial geometry and texture along with one-to-one correspondences with our generic face model. This representation allows for a wide range of further applications such as facial animation or manipulation. Further possible extensions/variations: - use ETH facial point feature in [2] (code in [3]) - find the best sw for meshing - realize cartoon-like version of the avatar

References: 

[1] Michael Zollhofer, Michael Martinek, Gunther Greiner, Marc Stamminger and Jochen Sußmuth, Automatic reconstruction of personalized avatars from 3D face scans, Comp. Anim. Virtual Worlds 2011; 22:195–202, DOI: 10.1002/cav.405
[2] M. Dantone, J. Gall, G. Fanelli, and L. Van Gool Real-time Facial Feature Detection using Conditional Regression Forests IEEE Conference on Computer Vision and Pattern Recognition (CVPR'12) http://www.vision.ee.ethz.ch/~gfanelli/pubs/cvpr12.pdf
[3] Code of Real-time Facial Feature Detection using Conditional Regression Forests http://blog.gimiatlicho.webfactional.com/?page_id=38