MORPHOSIS: THROUGH THE HAPTIC AR
A HANDHELD HAPTIC AR DEVICE FOR TANGIBLE AND INTERACTIVE EXHIBITION EXPERIENCE

Inspired by metamorphosis process from caterpillar to butterfly, we added an augmented reality (AR) layer on top of displayed works at an exhibition. With the device, guests were able to not only enjoy the display works as they are but also to interact with them through AR lense and haptic sensation.

PROJECT:INTERNSHIP
DATE:NOV 2018
LOCATION:WOW INC., JAPAN
FIELD:MULTIMODAL INTERACTION | EXHIBITION EXPERIENCE | PRODUCT DESIGN

 
image-34.png
 
process-35.png

PROJECT BRIEF
WOW INC's 25th ANNIVERSARY EXHIBITION

I had an opportunity to do internship at WOW inc, Japan, and was given a task to come out with a theme and idea for WOW inc's 25th Anniversary exhibition. At that time, we were allowed to come out with any idea in any form.

To find some inspiration, I did some online research and encountered WOW inc's vision of beyond motion graphics. It is a phrase that talks about future expression using future technology. It is an imagination of having experience beyond visual sense.

With that, I decided to focus on creating an experience that could show WOW inc's vision.

 

RESEARCH AND IDEATION
DESIGN FOR VISION

VISIT TO 20th ANNIVERSARY EXHIBITION
I visited WOW inc's 20th Anniversary exhibition to understand WOW inc's strength through their work.

From the visit, I understand that WOW inc's core strength is in motion graphics and the use of compelling visual to innovate experiences in art and design.

MIND-MAPPING | BRAINSTORMING
I started brainstorming by writing the keywords related to WOW inc's values and words related to vision and forward-thinking future.

 

CONCEPT
MORPHOSIS: THROUGH THE HAPTIC AR

morph.gif


I got inspired by the transformation process from larva to butterfly, or often known as metamorphosis and imagined WOW inc's existing work to morph into a future work.

But the key essence of metamorphosis is the fact that the butterfly was a caterpillar, and it shouldn't forget of its past. In a similar way, we should not omit WOW's past work, but leveraged on it to create a future work.

Then I had the idea of using augmented reality (AR) technology to augment an animation of WOW inc's future on top of existing works. It's like a lense to see the future. Finally, the idea materialised into a handheld haptic AR device.
The addition of haptic technology was to enhance the affective aspect of the experience.

 

DESIGN
MORPHOSIS: USER JOURNEY

Upon arrival to the exhibition hall, users will be given the haptic device.

Thay can scan the displayed work. And once they scan it, they will see a layer of animation that interacts with the displayed installation.

They can interact with the animation through simple gestures like tilting, and a haptic sensation will be played.

 

THE MAKING
3D PRINTING, MAX/MSP PROGRAMMING, HAPTIC TECHNOLOGY

We modeled a case for the vibrotransducer and 3d printed it. As for the interactivity, we took the accelerometer sensor data of the phone and sent the x,y values to MAX/MSP. The x,y values then controlled the power distribution of the vibrotransducer, hence creating the interactive haptic sensation.

 

FINAL PROTOTYPE
MORPHOSIS HANDHELD

product-37.png