3D Head Tracking

12 May 2014
Total votes: 0


i3D — Head Tracking for iPad: Glasses-Free 3D Display

The project defines a new possibilities for input and output interaction with mobile devices.
For input, the algorithm uses the front camera of the device in order to track the face of the user in real time. This information tells the application how and where the user is looking at the display. Possible implementation in [1] and [2]. It does not use the accelerometers or the gyroscopes: only on the front camera.
For output, by computing the position of the device according to the user’s head, it is possible, for example, to realistically control the viewpoint on a 3D scene [video,3], providing a perception of a 3D view. It provides a kind of monocular 3D display: the same picture is seen by both eyes.

[1] - Original work: "Using the Userʼs Point of View for Interaction on Mobile Devices" In Actes de la 23ème Conférence francophone sur l’Interaction Homme-Machine (IHM’2011, Nice, Octobre2011).
[2] - Other possible solutions: http://www.vision.ee.ethz.ch/~gfanelli/
[3] - iphone demo: http://youtu.be/2pRamDMOUkk
[4] - 3D Head Tracking Webcam OpenCV http://youtu.be/h9kPI7_vhAU