Spatial Practice - Melodic Gestural Movements

I then mapped the X plane to the tuning control of Operator, ableton's native synth across 2 octaves.

The furthest leftmost value of the surface being 24 semitones apart from the furthest rightmost value. I also assigned the filter to open more on the higher notes and close on the lower notes to accentuate the gestural movements a little more to make the results more apparent.

This allowed a rudimentary keyboard effect from the surface, you can hear the latency (time delay) of the webcamera processing the image and sending it to CCV, then to Osculator then finally to Ableton as midi control change values.

Most of this latency is attributed to the placement and speed of capture by the camera. CCV reads this as about 4 frames per second (about 20fps short of animation speed) which leads to jerky/choppy articulations of any gestural movement (the changes are not produced smoothly)

This latency even more pronounced in my next experiment, instead of using gestural movements for Control Change values (using the surface to move a digital "knob") I assigned Midi Note values to each  new "blog" ID number, so that: 

one finger down triggers the note C1 being played 

two fingers down trigger to C1 & C2 being played

three fingers down triggers to C1, C2 & C3

four fingers down triggers C1, C2, C3 & C4 all being played

This allows polyphony, and tested the multitouch aspect of the surface. The gaps between my placement of fingers and the note being played is the latency explained above.

The initial note was too low to be picked up by my camera's mic (bass frequencies)