New work: First AR Pop-up Book for iPad 2 and iPhone 4 using image recognition

Introducing a few sample pages from my new Augmented Reality  (AR) Pop-up Book, “Who’s Afraid of Bugs?” with video and images below.

I’d like to present the first AR Pop-up Book for mobile devices using image recognition (a.k.a. regular images to trigger augmented content, as opposed to the black and white square glyphs that are common in AR). Integrating image recognition in the design, the book can hence be enjoyed alone as a regular pop-up book, or supplemented with augmented digital content when viewed through a mobile device equipped with a camera, such as an iPad 2 or iPhone 4.

Playful rhyming text takes you through the storybook where various ‘creepy crawlies’ (spider, ant, and butterfly) are awaiting to be discovered, appearing virtually as 3D models you can interact with. A tarantula attacks when you touch it, an ant hyperlinks to educational content with images and diagrams, and a butterfly appears flapping its wings atop a flower in a meadow.

AR Pop-up Book by Helen Papagiannis

AR Pop-up Book by Helen Papagiannis

AR Pop-up Book by Helen Papagiannis

(Above: Screen grabs from AR Pop-up Book working on iPad 2.)

The story for the AR Pop-up Book was inspired by AR psychotherapy studies for the treatment of phobias such as arachnophobia. AR provides a safe, controlled environment to conduct exposure therapy within a patient’s physical surroundings, creating a more believable scenario with heightened ‘presence’ and greater immediacy than Virtual Reality (VR).

[Article: Juan, Carmen M. et al. “Using Augmented Reality to Treat Phobias.” IEEE  Computer Graphics and Applications 25.6 (2005): 31-37.]

In some ways, the AR Pop-up Book, “Who’s Afraid of Bugs?” provides a playful method for exposure and learning through story and technology to help children overcome their fear of bugs and discover that they aren’t so scary after all.

A portion of the AR Pop-up Book was demoed live during my talk on AR and Storytelling at ARE 2011 in Silicon Valley — watch video of my talk and slides here.

Design, concept, paper-engineering and production: Helen Papagiannis

Special thanks to Lukas Gruber for support with 3D model conversions.

AR Software: Junaio

*UPDATE: I’ve been so flattered by the wonderful response to my AR Pop-Up Book! Great big thanks to everyone for blogging, tweeting, and sharing my work, I really appreciate it! Here’s some of the coverage, thanks again: WIRED, Games Alfresco, Augmented Reality World, Adafruit, VR News, Junaio

17 Comments

  1. […] Augmented reality pop up book via Bruce… Introducing a few sample pages from my new Augmented Reality  (AR) Pop-up Book, “Who’s Afraid of Bugs?” with video and images below. I’d like to present the first AR Pop-up Book for mobile devices using image recognition (a.k.a. regular images to trigger augmented content, as opposed to the black and white square glyphs that are common in AR). Integrating image recognition in the design, the book can hence be enjoyed alone as a regular pop-up book, or supplemented with augmented digital content when viewed through a mobile device equipped with a camera, such as an iPad 2 or iPhone 4. […]

    Reply

  2. We love it here @goaugmented – anything that is beautiful and next generation and helps proclaim the greatness of #AR especially in #mobile is wonderful in our book

    Reply

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s