MotionLab Sonify: A Framework for the Sonification of Human Motion Data

A. Effenberg, J. Melzer, Andreas Weber, and Arno Zinke
In proceedings of The 9th International Conference on Information Visualisation (IV'05), pages 17-23, IEEE Press, July 2005
Presented at The 9th International Conference on Information Visualisation (IV'05)
 

Abstract

Sonification of human movement offers a wide range of new kinds of information for supporting motor learning in sports and rehabilitation. Even though motor learning is dominated visually, auditory perception offers unique subtle temporal resolution as well as enormous integrative capacity – both are important features on perception of human movement patterns. But how to address the auditory system adequately? A Sonification based on kinematic movement data can mediate structural features of movement via the auditory system, like polyrhythms of movement etc. And Sonification of dynamic movement data makes muscle forces audible approximately. Here a flexible framework for the sonification of human movement data is presented, capable of processing standard kinematic motion capture data as well as derived quantities such as force data. Force data are computed by inverse dynamics algorithms and can be used as input parameters for real time sonification. Simultaneous visualization is provided using OpenGL.

Keywords: computer animation, inverse dynamics, sonification

Images

Bibtex

@INPROCEEDINGS{effenberg-2005-motionlab,
      author = {Effenberg, A. and Melzer, J. and Weber, Andreas and Zinke, Arno},
       pages = {17--23},
       title = {MotionLab Sonify: A Framework for the Sonification of Human Motion Data},
   booktitle = {The 9th International Conference on Information Visualisation (IV'05)},
        year = {2005},
       month = jul,
   publisher = {IEEE Press},
    keywords = {computer animation, inverse dynamics, sonification},
    abstract = {Sonification of human movement offers a wide range of new kinds of
                    information for supporting motor learning in sports and
                    rehabilitation. Even though motor learning is dominated visually,
                    auditory perception offers unique subtle temporal resolution as
                    well as enormous integrative capacity -- both are important
                    features on perception of human movement patterns. But how to
                    address the auditory system adequately? A Sonification based on
                    kinematic movement data can mediate structural features of
                    movement via the auditory system, like polyrhythms of movement
                    etc. And Sonification of dynamic movement data makes muscle forces
                    audible approximately. Here a flexible framework for the
                    sonification of human movement data is presented, capable of
                    processing standard kinematic motion capture data as well as
                    derived quantities such as force data. Force data are computed by
                    inverse dynamics algorithms and can be used as input parameters
                    for real time sonification. Simultaneous visualization is provided
                    using OpenGL.},
  conference = {The 9th International Conference on Information Visualisation (IV'05)}
}