
PERCEPTUNE
A device to shape our auditory perception of the world
“PercepTUNE” is a device that plays with sound and light to create a user-controlled experience based on movement and elevation. It works to manipulate auditory and visual cues to change our perception and exploration as we interact within a space. This multidimensional exploration involves a deep dive into the intricate interplay between the human body, our senses, and the surrounding environment.
Timeline
5 Weeks
(Fall 2023)
Programs
Adobe PS/Ai/AE
Rhino
Roles
Creative Technologist
Spatial Designer
Skills
3D Modeling
Experience Design
Interaction Design
Lo-Fi Prototyping
Research
Augmenting the Body
I started my research into sensory perception, interactive design principles, augmentation techniques, and methods of altering human senses. I was particularly intrigued by scientific studies on illusions, where perception is manipulated by augmenting physical senses. These studies provided valuable insights into how sensory distortions can be designed to create immersive and interactive experiences. Click here to read my process.
The Concept
What we see shapes what we hear and where we hear
Can we manipulate auditory and visual cues to change our perception of space?
Sound and vision share the same spatial properties. In other words, the brain treats it as coming from the same source (the way we understand it is congruent on the same dimension). These associations take effect regardless of culture, age, and even visual disability because its an innate way of how we process information. Evidence of this finding can be found as such:
Pitch in many languages uses terms having a spatial connotation such as “high” and “low”.
Speeded reaction tasks, responding to the written word “high” is faster in the presence of a high pitch.
Music notation system maps pitches to vertical locations, whereby notes corresponding to higher pitches are represented with higher spatial positions on the staff.
The Concept
Layering the Experience
I explored directionality by linking auditory and visual cues, as they are both mapped on a vertical scale.
Creative Technology
Physical Prototyping
I built a working prototype for this experience, using physical prototyping tools like Arduino to code and build the internal working parts, as well as 3D modeling and printing the form.
Form Considerations
Arduino

Material Testing
To examine how light interacts with different materials, I tested corrugated plastic, poster board, an uncovered setup, tracing paper, a milk jug, and a poster board with a hole. The most effective result came from using a covered front with a hole, as it allowed the most light to shine through while enabling better control over the projection size.
Creative Technology
Systems Diagram
Final Thoughts
Reflection & Takeaways
Through the development of this project, I gained a deeper understanding of how auditory and visual cues shape human perception and spatial interaction. Designing a device that responds to movement and elevation challenged me to think critically about the relationship between the body, the senses, and the environment. I explored how subtle changes in sound and light can influence the way we navigate and experience a space, reinforcing the importance of multi-sensory design in interactive experiences.
This project also taught me the value of iteration and experimentation, as fine-tuning the balance between sensory manipulation and user control required continuous testing. I learned how crucial it is to design interactions that feel intuitive yet impactful, allowing users to actively shape their own experiences. Moving forward, I am excited to further explore how technology can be used to enhance perception and create immersive environments that challenge the way we experience the world around us.