http://www.sonictroller.com/

sonictroller

The goal was to improve upon our physical interface that allows the user to control a video game with sound. For this version we wanted to allow two users to play against each other. After attempting to map musical phrases to sequences in the game to make a more musical experience, we decided to make the game more accessible to non-musicians. We played Mortal Kombat on the Nintendo64 system with midi keyboards controlling direction and vocals triggering punches.

In our first version, we were successful in mapping single notes from a classical guitar and trumpet to buttons on the nintendo controller. Chords were impossible to map from the guitar so it was limited to single, impulse controls; the trumpet has a better capability to sustain. Therefore, we used both instruments to control one character in Rampage. The trumpet controlled direction and the guitar the punch/jump buttons and start/pause buttons. This version is intended for use by musicians or performance artists. The user does not need to be a skilled musician to play, but musicans can take advantage of the setup to create choreographed musical performances.

For future versions we plan to: develop a custom video game for music instruction; develop the ability to change mappings with software on some sort of removable disk (ie flash card).

Fuente: pixelsumo