Markerless 4 gestures 6 DOF real-time visual tracking of the human hand with automatic initialization

D. Cohen-Or and P. Slavík (Editors)
In: Computer Graphics Forum (Sept. 2007), 26:3(467-476)
Presented at Eurographics 2007
 

Abstract

In this paper we present a novel computer vision based hand-tracking technique, which is capable of robustly tracking 6+4DOF of the human hand in real-time (at least 25 frames per second) with the help of 3 (or more) off-the-shelf consumer cameras. 6+4DOF means that the system can track the global pose (6 continuous parameters for translation and rotation) of 4 different gestures. A key feature of our system is its fully automatic real-time initialization procedure, which, along with a sound tracking-lost detector, makes the system fit for real-world applications. Because of this, our method acts as an enabling technology for uncumbersome hand-based 3D Human-Computer-Interaction (HCI). Previously, using the hand as an at least 6DOF input device involved the use of either datagloves or markers. Using our tracking we evaluated the use of the hand as an input device for two prevalent Virtual Reality applications: fly-through exploration of a virtual world and a simple digital assembly simulation.

This technique is protected by an international patent of the University of Bonn. If you intend to use it commercially please contact ProVendis or one of the authors.

Images

Download Paper

Download Paper

Additional Material

  • Video (AVI video, 19.4 MB)

Bibtex

@ARTICLE{schlattmann-2007-markerless,
      author = {Schlattmann, Markus and Kahlesz, Ferenc and Sarlette, Ralf and Klein, Reinhard},
      editor = {Cohen-Or, D. and Slav{\'i}k, P.},
       pages = {467--476},
       title = {Markerless 4 gestures 6 DOF real-time visual tracking of the human hand with automatic
                initialization},
     journal = {Computer Graphics Forum},
      volume = {26},
      number = {3},
        year = {2007},
       month = sep,
   publisher = {Eurographics Association},
    abstract = {In this paper we present a novel computer vision based hand-tracking technique, which is capable of
                robustly tracking 6+4DOF of the human hand in real-time (at least 25 frames per second) with the
                help of 3 (or more) off-the-shelf consumer cameras. 6+4DOF means that the system can track the
                global pose (6 continuous parameters for translation and rotation) of 4 different gestures. A key
                feature of our system is its fully automatic real-time initialization procedure, which, along with a
                sound tracking-lost detector, makes the system fit for real-world applications. Because of this, our
                method acts as an enabling technology for uncumbersome hand-based 3D Human-Computer-Interaction
                (HCI). Previously, using the hand as an at least 6DOF input device involved the use of either
                datagloves or markers. Using our tracking we evaluated the use of the hand as an input device for
                two prevalent Virtual Reality applications: fly-through exploration of a virtual world and a simple
                digital assembly simulation.},
  conference = {Eurographics 2007}
}