Hand-Tracking & Interaction


Since several decades researchers investigate the use of the human hand as a direct input device for enabling different possibilities of human computer interaction. To this end, the hand has to be tracked in real-time. Having such a method at hand, suitable interaction techniques are needed for establishing an efficient and intuitive interaction interface. We are working on markerless tracking of both human hands as well as suitable interfaces for complex 3D interaction.

Completed Projects

In the COHERENT project, six leading European organisations provide complementary competencies to create a new networked holographic audio-visual platform to support real-time collaborative 3D interaction between geographically distributed teams.
The goal of this project is markerless and real-time tracking a human hand (position, orientation and joint angles) based on computer vision in order to enable natural and efficient human computer interaction.


Katharina Stollenwerk, Anna Vögele, Ralf Sarlette, Björn Krüger, André Hinkenjann, and Reinhard Klein
In proceedings of 13. Workshop Virtuelle Realität und Augmented Reality der GI-Fachgruppe VR/AR, Bielefeld, Germany, Sept. 2016
Katharina Stollenwerk, Anna Vögele, Björn Krüger, André Hinkenjann, and Reinhard Klein
In proceedings of Computational Science and Its Applications -- ICCSA 2016: 16th International Conference, Beijing, China, July 4-7, 2016, Proceedings, Part II, Beijing, China, pages 433-449, Springer International Publishing, July 2016
In proceedings of SIGGRAPH ASIA '09: ACM SIGGRAPH ASIA 2009 Sketches, Yokohama, Japan, pages 1, ACM, Dec. 2009
Markus Schlattmann, Johannes Broekelschen, and Reinhard Klein
In proceedings of IADIS International Conference Game and Entertainment Technologies (GET '09), pages 59-66, IADIS Press, June 2009
In proceedings of Virtual Reality International Conference (VRIC), Apr. 2009
Markus Schlattmann, Tanin Na Nakorn, and Reinhard Klein
In proceedings of International Conference on Computer Graphics, Visualization and Computer Vision (WSCG '09), Feb. 2009
In proceedings of Eurographics Symposium on Virtual Environments (EGVE), May 2008
V. Skala (Editors)
In: Journal of WSCG (Feb. 2008), 16:1-3
In proceedings of ACM Symposium on Virtual Reality Software and Technology (VRST '07), Nov. 2007
D. Cohen-Or and P. Slavík (Editors)
In: Computer Graphics Forum (Sept. 2007), 26:3(467-476)
In proceedings of Workshop on Camera Calibration Methods for Computer Vision Systems (CCMVS2007), Mar. 2007
In proceedings of Computer Graphics International 2004 (CGI 2004), pages 403-410, IEEE Computer Society, June 2004
In proceedings of International Working Conference on Advanced Visual Interfaces (AVI 2004), pages 283-289, ACM Press, May 2004