Interactive 3D Space
highly interactive audio-visual experience
A creative coding experiment is driven by a design vision of the future where visuals become an inseparable part of the music...
Course
Creative programming
Main Deliverables
Processing/Arduino code Experienceable prototype Promotional video Poster + Visual assets
Expertise areas
Maths Data & Computing, Creativity & Aesthetics, Technology and realization
Date
November 2022
This interactive experience makes use of ultra-sonic sensors that detect movement and manipulate an animation accordingly. The program takes uploaded images rasterizing them using a 2-dimensional grid. Later, it samples the brightness from the center of each tile to determine the size of the corresponding cell and displaces them in 3 dimensions accordingly - Essentially, turning a 2D image into a 3D grid of blocks that pixelate and recreate the image at high resolutions. By combining the input from ultrasonic sensors connected to an Arduino the listener has the ability to manipulate the animation in the 3D space. To complete the code I followed an iterative design process, where issues get identified and resolved through testing and modifications.
More concretely i envision this core concept to evolve into engaging VR/AR music experiences that respond to the way a listener moves or dances along. Having done preliminary interviews with avid listeners and Hi-Tec enthusiasts The main takeaway from the project is the value of following a complete iterative design process guided by a design vision. With an overarching goal, my project had a layer of meaning that directed my work ensuring concentrated and efficient advancement. This project was inspired by Tim Reden Broeke's project on redrawing images.