This interdisciplinary project, combining scientific, technological and artistic methods, proposes three crucial topics for future development of multimodal media devices: 1) the importance of action-sound couplings for both performance and perception of music, 2) the control potential of human bodily movement, 3) a move towards active music experience. These topics will be explored through experiments, observation studies and modelling of action-sound couplings; and prototyping of enactive media devices . This requires development of "human-friendly" sensor technologies, and machine-learning techniques for extracting actions from movement, and semantics from actions (i.e. gestures). The extracted data will be used to control hypermusic, i.e. music which is flexible in both complexity and duration, and provide for an active music experience controlled by body movement. As partners in the new EU COST Action Sonic Interaction Design, we are at the frontier of European research in the field. The project wil l stimulate further interdisciplinary collaboration between science, technology and art; and will also explore the large potential for knowledge transfer to industry, the arts and society at large.
Project leader: Rolf Inge Godøy
Institution: UNIVERSITETET I OSLO