Aims:
- Compare and contrast sonic biofeedback as an effective modality against the absence of sonic stimuli and trial this as an effective entrainment method for precision in body and movement kinematics.
- Collect quantitative pressure and centre of mass (COM) data during movement routines for analysis.
- Trial extended gesture driven sonification techniques to interrogate and build upon existing literature.
Early interaction design ideas:
- Needs to be expressive and immediate (sound felt, not heard)
- Exponential/logarithmic curvature in MIDI scaling (greater expression)
Literature to read:
Sonification - Stephen Barrass (University of Canberra)
Barrass papers:
http://www.canberra.edu.au/about-uc/faculties/arts-design/courses/undergraduate/media-arts-and-production/tabs/staff/media-arts-and-production-staff/barass-stephen
Exponential/Log tools:
https://www.desmos.com/calculator
http://www.timotheegroleau.com/Flash/experiments/easing_function_generator.htm
http://www.mathsisfun.com/algebra/exponents-logarithms.html
Kirsten Packham (De Quincey Co) is the sole study participant. A trained professional in body and movement work, KP has provided the following information to guide the sound design.
These 'Images' are imaginative qualitative descriptors that assist focus and interoceptive kinesthetic awareness while conducting the respective routine they describe.
I have used these to make early sound design notes which will be put into practice later.
1. MOVE LIKE YOU DON'T WANT TO DISTURB THE AIR
Very slow. All the molecules in the room are affected by your movement.
- (bass rumble + high end - high and lowpass filters :: mids notched out )
- chimes
Colluding with the air.
- reverb on top end? ie: room size, decay
Feet lift slightly, glide across floor and negotiate with the air.
- Filter (opening? / closing? - small range)
Minimal articulation and gait.
- articulation spikes to be sonified? possible distraction here
Weight held in core.
- central bass tone at centre of gravity
Legato.
- pitch bend
- max 1 semitone on bass *if at all*
- maybe 2+ semitones on high tone
2. PUPPET
Slow.
- Fine control
- Rhythmic
Articulate loose feet.
- Wide control mapping??
- Rhythmic articulation, tight envelopes
- Each note discrete playing in a “circus” scale
Awkward.
- Wide range
Sense of up/down, lifting and lowering.
- Filter
- Pitch
- Wide control range
- Bells, FMBacking track?
Variation in each iteration/step.
- cycling MIDI notes through scale?
- pitch modulation?
3. GLACIER CALVING
Slow-very slow.
- Drone
Feet - ball/heel/toes sink as if crumbling and breaking off into floor - being absorbed by floor.
- Filter closing with each step
- Delay/Reverb
- Noise/Pitched down Ice crunchy sound on top through filter
Scale is massive.
- Bass
Energy down.
- Bass
4. OMNIPRESENT - ALL SEEING BEING
Slow.
Purposeful, forward direction but sensing/360 Omni central awareness.
- Panning
- Constant tone, amp + possibly filtering independent stereo channels drops and raises to indicate unbalanced gait
- Mid High frequencies
- Chords (synth tbd - basic fm)
Weight held in core.
- Pan triggered from Centre of Mass
- Perhaps all triggers from COM
Whole body glides. Gait even.
- Sound cues to entrain central movement
5. GULLIVER'S TRAVELS
Slow.
Incrementally lifted and lowered.
Weight lifted up by many hands, carried and carefully lowered.
- Up fast, lowered slow
- Pitch going up matched to pressure
- Pitch alone?
- Distinct Clear tonal change between up and down env
Articulate feet.
7. DEER PREY
Slow with variation and stops.
- Rhythmic? ala ‘Puppet'
- Use sound cues to reinforce stops
Light feet listening, sensing vibrations.
- Pressure too heavy or uneven gait - wobble filter?
Articulate.
- Precise mapping
Weight held in core.
- Centre of Mass
Also - Music references
Machinefabriek - Singel
Oren Ambarchi - Song of Separation part 2
Alva Noto - J
Christina Kubsich - In Transition
Triosk - Lazyboat
Oren Ambarchi - Song of Separation part 2
Alva Noto - J
Christina Kubsich - In Transition
Triosk - Lazyboat
Finally from Frank:
"Finally - i've been finding this paper by Varni et al 2012 attached quite cool as it uses a MOOG cutoff filter to respond to ideas of energy. Have a look and we can discuss tomorrow. btw i have a MOOG minitaur !!"
(Think i'll keep hardware out of this in the aim of simplicity - dynamic parameter mapping using some digital, some outboard will be a mess)
Eyetracking/Gazepoint 4D study resources:
GP3 Model
http://www.gazept.com/developer/
(Designed for windows 7&8)
API doc: http://www.gazept.com/Publications/Gazepoint_API_v2.0.pdf
TCIP Comms in Max:
http://www.maxobjects.com/?v=objects&id_objet=4684
https://cycling74.com/2006/10/23/networking-max-talking-to-max/#.V7UqHj5962w
No comments:
Post a Comment