Piano Projection Mapping

About

This project takes real time MIDI data and uses projection mapping techniques to visualize the notes being played on a piano. Various effects and trail effects can be created and modified in real time.

Process

• Midi keyboard sends data to FL Studio for the sound and TouchDesigner for visualization using LoopMIDI
• TouchDesigner calibrates the projection area with calibration points at each corner of the piano keys
• The data is used to map each key in projection space and applies note On/Off effects for each note and trail
• The final image is warped to the calibration points to fit the projection surface perfectly

Built with TouchDesigner

This project was built using TouchDesigner, FL Studio and LoopMIDI along with a MIDI keyboard and projector.