Get Technabob in Your Mailbox Every Day! Join our Mailing List!
subscribe to our rss feedsubscribe via e-mailfollow technabob on twittertechnabob facebook fan pageGoogle+follow us in feedly
Follow Us:

iPhone 4 & iPad 2 Head Tracking via Front Camera: It’s 3DTime!


I’m sure most of you have seen Johnny Chung Lee’s Wii head tracking demo. But while Lee had to use a Wiimote and IR diodes (and a PC) for his hack, Jeremie Francone and Laurence Nigay of the Grenoble Informatics Laboratory were able to pull off the same trick on the iPhone 4 and the iPad 2 using only the front-facing cameras on the devices. Plus some magical code of course.

ipad 2 head tracking 3d by Jeremie Francone and Laurence Nigay

Lee had to use IR LEDs because that’s the only thing that the Wiimote can detect. But Francone and Nigay’s program seems to be able to visually tag an object to follow, which I think is quite similar to how the Kinect works. Note that only the front-facing camera is used, and not the built-in accelerometers. Here’s the hack on the iPad 2:

YouTube Preview Image

And here it is on the iPhone 4:

YouTube Preview Image

The practical applications of such a feature are of course another matter altogether. Perhaps it could be used in games – perhaps a new version of FixPix or an evade-bullets-Matrix-style game – or combined with the rear-facing camera to create more interactive AR apps.

[via IntoMobile]


Comments (3):

  1. Michel says:

    I’d like to see this set up in a room…ceiling, walls and floors with this type of technology. Instead of looking through a head gear for 3D worlds, you can step into the world. awesome!

  2. BennyJ says:

    Please release some apps on the app store!!! This technology for iPad 2 and iPhone 4 would be a HUGE hit!!

  3. Kevin Doyle says:

    Looks like they either used Lee’s code or were heavily and directly inspired by his work. I hope they give him some credit, demmit.

Post a Comment:

Want a personal avatar on your comments? Sign up for a free Gravatar now!

Note: All comments with links in them will be held for moderation in order to prevent spam, so you may not see your post appear immediately.

More from Awesomer Media...