PERCEPTUNE

A device to shape our auditory perception of the world

“PercepTUNE” is a device that plays with sound and light to create a user-controlled experience based on movement and elevation. It works to manipulate auditory and visual cues to change our perception and exploration as we interact within a space. This multidimensional exploration involves a deep dive into the intricate interplay between the human body, our senses, and the surrounding environment.

Timeline

5 Weeks
(Fall 2023)

Programs

Adobe PS/Ai/AE
Rhino

Roles

Creative Technologist

Spatial Designer

Skills

3D Modeling
Experience Design
Interaction Design
Lo-Fi Prototyping

Research

Augmenting the Body

I started my research into sensory perception, interactive design principles, augmentation techniques, and methods of altering human senses. I was particularly intrigued by scientific studies on illusions, where perception is manipulated by augmenting physical senses. These studies provided valuable insights into how sensory distortions can be designed to create immersive and interactive experiences. Click here to read my process.

The Concept

What we see shapes what we hear and where we hear

Can we manipulate auditory and visual cues to change our perception of space?
Sound and vision share the same spatial properties. In other words, the brain treats it as coming from the same source (the way we understand it is congruent on the same dimension). These associations take effect regardless of culture, age, and even visual disability because its an innate way of how we process information. Evidence of this finding can be found as such:

  • Pitch in many languages uses terms having a spatial connotation such as “high” and “low”.

  • Speeded reaction tasks, responding to the written word “high” is faster in the presence of a high pitch.

  • Music notation system maps pitches to vertical locations, whereby notes corresponding to higher pitches are represented with higher spatial positions on the staff.

The Concept

Layering the Experience

I explored directionality by linking auditory and visual cues, as they are both mapped on a vertical scale.

Creative Technology

Physical Prototyping

I built a working prototype for this experience, using physical prototyping tools like Arduino to code and build the internal working parts, as well as 3D modeling and printing the form.

Form Considerations

Arduino

Material Testing

To examine how light interacts with different materials, I tested corrugated plastic, poster board, an uncovered setup, tracing paper, a milk jug, and a poster board with a hole. The most effective result came from using a covered front with a hole, as it allowed the most light to shine through while enabling better control over the projection size.

Creative Technology

Systems Diagram

Final Thoughts

Reflection & Takeaways

Through the development of this project, I gained a deeper understanding of how auditory and visual cues shape human perception and spatial interaction. Designing a device that responds to movement and elevation challenged me to think critically about the relationship between the body, the senses, and the environment. I explored how subtle changes in sound and light can influence the way we navigate and experience a space, reinforcing the importance of multi-sensory design in interactive experiences.


This project also taught me the value of iteration and experimentation, as fine-tuning the balance between sensory manipulation and user control required continuous testing. I learned how crucial it is to design interactions that feel intuitive yet impactful, allowing users to actively shape their own experiences. Moving forward, I am excited to further explore how technology can be used to enhance perception and create immersive environments that challenge the way we experience the world around us.