This individual project was developed for the Introduction to Multimedia class at University of Central Arkansas using the language C#, Visual Studio as IDE and Unity 3D cross-platform game engine.

“Music to Colors” is an app for Oculus Quest 2 that converts music MIDI files into colors in a VR environment. The user is able to listen to MIDI music and at the same time visualize the representation of the sound converted into 3D objects/effects with colors related to the notes played. This relation between color and notes are defined according to the information of a paper that explains the synesthesia sound-color (also called chromesthesia).

Functionality

1. The app processes the MIDI files, extracts the note information (duration and pitch) and converts them into colored objects that are synchronized with the music. This was made using a free toolkit: Maestro – Midi Player Tool Kit.
2. The app simulates a VR environment where the colored objects (representing the sound) are approaching the user while the music is being played.
3. The user is able to select from a list of pieces/songs in the app menu to start the VR music/color experience.

If someone is interested to support the project or collaborate with the development, please send a message.