Multi-sensory Interactions
in Human-Computer Interaction.
I began with Audio-Visual — creating media that responds to sound and language.
Then, I brought the body into the loop — turning movement into dialogue with technology.
Now, I explore audio-visual-haptic systems that invite broader audiences
to feel interaction beyond sight and sound.
This is the most inclusive, immersive, and interactive experience that I believe.
.png)
Audio-Reactive Haptic Spheres / 2025
Transforms audio signals & body movement into haptic transforms.
Bridges sound and touch to explore how multisensory feedback can expand shared perception.
Puppets / 2024
Visualizes invisible voices through brainwave and motion data.
Explores how technology can externalize inner presence and connect minds beyond language.
Doppelgänger Instruments / 2024
A live performance with one’s past self — an invisible duet across time, where gestures become sound and memory takes form as harmony.
Knowledge is Power / 2025
Audiences trace the path of a wheelchair ramp—feeling the distance, hearing the stories. An immersive AR narrative built from real accessibility experiences.
Audio-Visual Immersive Stories / 2025
Story begins from the darkness, with the curated setlist by DJ Kao. As it goes for higher BPM, story changes.
VOGA Compilation Vol.2 - Live / 2024
Eyes doesn't follow you—it follows the sound.
Real-Time solo VJ Performance. Audio-reactive 3D Animation.
Instinctive Beats / 2024
Converts body movement into reactive visuals and rhythm.
Invites audiences to perceive music through the act of dancing—where movement becomes listening.
Stanford Interactive AR Map / 2025
Audiences trace the path of a wheelchair ramp—feeling the distance, hearing the stories. An immersive AR narrative built from real accessibility experiences.
TreeHacks: Pose-detective Game & Installation / 2025
Do a "Tree Pose" and you will be the one. Detects face & hand location, map the animation on the face.
Sensory Maze for Children with All Abilities / 2025
Inclusive Play Equipment, prototyped in collaboration with Magical Bridge Foundation. Various texture and sensory features: high visual contrast, rotational motion, sound effect, etc.
Burning Away the Past / 2024
Eat your bitter melons, and our bitter past will be awakened.
Invites audiences to feel this lingering memory through 5 senses—transforming history’s absence into a tangible presence.
Crochella Official 3D-CG Animations / 2025
Each band's background animation for the Stanford's biggest on-campus music festival. Python scripting in Blender.
Gesture Based Motor Control / 2025
Basic structure of using MediaPipe for fine tuning the motor control.
Live-Coding Visual: CHydra / 2024
Not just a normal geometry.
Mobile version coming soon. For now, please use a desktop.
© 2021 - 2025 Anna Matsumoto. All Rights Reserved.