The project is named as Virtual DJ, namely, our group intends to bring fresh experience to the people for trying out DJ activities. Typical DJ actions include "mixing" and "scratching", which generally manipulates the music track that is been played. In our example, we use color recognition as interaction method. The program been created is to capture color movements within a given space then generates various types of music sample loops. In this case a web cam is been used as a capture tool for the movement. We then introduced some specially marked gloves, with different colors on each fingertip. These colors are the key to the manipulation of the music. With a combination of these elements, users can easily perform actions as if they are real DJs.
Design Motivation
Our initial goal is to design a simple interface with easy to execute operations to recieve satisfying feedback. We first came across with the idea of using Wii controller as an input device, but as same decisions has been applied with many other project ideas, we abandoned this thought and stick with hand gesture and movements, as it is indeed very simple to initiate. Not only because it is directly percieved through the senses, but also resembles the actions of a real DJ. We want to stick true to the concept, so the decision had risen to the surface at the end: pure and simple hand actions only. Despite limitations and other issues, we decided to include "scratching" and "mixing" in this particular installation.
Related and Influential works
During the brainstorming process, we came across with some cool ideas related to manipulation of music, such as video game controller and DJ style music, we later decided to combine these together to form a more understandable and unique object. We discovered that the idea has already been created by someone else which uses the Nintendo Wii controller to achieve DJ actions. Although it is quite similar to some of the existing video game ideas such as Dance Dance Revolution and Guitar Hero, both use simulations of real life tools to perform actions of the actual activity. As for the Wii controller, it does not resemble anything related to the actual DJ movements, so we didn't choose this idea and approached from a more intuitive view.
Technical Method
We used Max/MSP as the programming tool, together with some jitter patches for performing various actions. The program is been run on a Vista installed PC, rather than a typical Mac, but the actions are all there as for the compatibility is no different.
Web Cam is using to capture the movement of the color markers within the given space. With different positions input different data, the program needs to recognize all the changes and initialize actions at the same time. In the final stage we decided to use 4 types of colors, and thus for the operator to see through the changes clearly, 4 visual screens were embeded using jitter patchs, each screen recognize one specific color.
As for the scratching part, another jitter patch is been applied for manipulating the basic looping sample. By apply the x and y axis into a radial style marker, the program controlls the playback speed from slow to fast. The camera captures the movement of the red color markeron the right hand, the radial marker analyse the angles and send the data though a bucket in order to manipulate the playback speed.
The music was composed with usability of the interface in mind. Knowing that tempo and dynamics were our main controls, I composed the piece so that it builds in intensity and power from beginning to end. This enables the operator to instinctually feel, when something is to be louder or softer, or speed up. The song goes for three minutes and has 4 major sections to it. The 16 or 32 bar sections enable the user to easily manipulate the song, as it is easy to perceive an oncoming change even if you are not familiar with the song.
