Monday 11:30 – 2:30 |45.01.003
Thursady 11:30 – 2:30 | 45.01.003

Lecturers: Dr Frank Feltham and Ana Davila Veytia

Sonic Efforts will explore the role that live interactive sound can have as information on movement effort. In this studio you will use interactive data to and manual visualization methods to extract the patterns and features of human movement to explore sounds capability to express these patterns to improve movement awareness and health.

Sound in this context is not for musical expression, but rather a means to inform and express the efforts and gestures when we move. If we consider the screen to me made of pixels and colours, that are varied to express a visual image, what is the equivalent information in sound to express a movement and a gesture. It could be argued that sound through the auditory sense provides information that is spatially already in 3D without the need for VR goggles. When coupled to live interactive data, sound synthesis can be manipulated to provide both pleasing and information rich auditory experiences.

As a method you will document, visualize and analyse a movement activity of your choice using video, sound and movement data samples. You will select patterns and features from this data to couple to sound synthesis and evaluate the effectiveness of your sound choices in a user study. The software used to generate the sound is called Max 8 from Cycling 74 – you may have come across this software in Interactive Systems Design or other sources.

All methods and techniques will be taught to enable a basic user study. At mid semester you will elect to use Max in whatever form required to prototype a movement to sound experience for user evaluation. The emphasis here is on evaluating the user experience, not developing complex interactive sound synthesisers.

Research partners – RMIT School of Engineering (Biomechanical)