This website uses cookies.

This website uses cookies to improve user experience. By using our website you consent to all cookies in accordance with our Cookie Policy.

I agree
Learn More
Great Geek Gifts in the Technabob Shop!Get Technabob Daily: Join our Mailing List! | Follow Us: Facebook | Twitter
subscribe to our rss feedsubscribe via e-mailfollow technabob on twittertechnabob facebook fan pageGoogle+follow us in feedly
Follow Us:

iPhone 4 & iPad 2 Head Tracking via Front Camera: It’s 3DTime!

by Lambert Varias

I’m sure most of you have seen Johnny Chung Lee’s Wii head tracking demo. But while Lee had to use a Wiimote and IR diodes (and a PC) for his hack, Jeremie Francone and Laurence Nigay of the Grenoble Informatics Laboratory were able to pull off the same trick on the iPhone 4 and the iPad 2 using only the front-facing cameras on the devices. Plus some magical code of course.

ipad 2 head tracking 3d by Jeremie Francone and Laurence Nigay

Lee had to use IR LEDs because that’s the only thing that the Wiimote can detect. But Francone and Nigay’s program seems to be able to visually tag an object to follow, which I think is quite similar to how the Kinect works. Note that only the front-facing camera is used, and not the built-in accelerometers. Here’s the hack on the iPad 2:

YouTube Preview Image

And here it is on the iPhone 4:

YouTube Preview Image

The practical applications of such a feature are of course another matter altogether. Perhaps it could be used in games – perhaps a new version of FixPix or an evade-bullets-Matrix-style game – or combined with the rear-facing camera to create more interactive AR apps.

[via IntoMobile]


Comments are closed for posts older than 90 days.

Comments (3):

  1. Michel says:

    I’d like to see this set up in a room…ceiling, walls and floors with this type of technology. Instead of looking through a head gear for 3D worlds, you can step into the world. awesome!

  2. BennyJ says:

    Please release some apps on the app store!!! This technology for iPad 2 and iPhone 4 would be a HUGE hit!!

  3. Kevin Doyle says:

    Looks like they either used Lee’s code or were heavily and directly inspired by his work. I hope they give him some credit, demmit.

Recent Posts

Guy Builds a 200-Watt Laser Bazooka

Guy Builds a 200-Watt Laser Bazooka

Game of Thrones Xbox One Giveaway: Winning Is Coming

Game of Thrones Xbox One Giveaway: Winning Is Coming

Review: ExoLens iPhone Lens System with ZEISS Optics

Review: ExoLens iPhone Lens System with ZEISS Optics

Roomba Beer Pong Ups the Ante

Roomba Beer Pong Ups the Ante


Selk'bag Original 5G Onesie Sleeping Bag: Sleep Walker


More from Awesomer Media...

The Awesomer Logo MightyMega Logo 95octane Logo