Mixed reality based respiratory liver tumor puncture navigation

Ruotong Li, Weixin Si, Xiangyun Liao, Qiong Wang, Reinhard Klein, and Pheng-Ann Heng
In: Computational Visual Media (2019), 5:4
 

Abstract

This paper presents a novel mixed reality based navigation system for accurate respiratory liver tumor punctures in radiofrequency ablation (RFA). Our system contains an optical see-through head-mounted display device (OST-HMD), Microsoft HoloLens for perfectly overlaying the virtual information on the patient, and a optical tracking system NDI Polaris for calibrating the surgical utilities in the surgical scene. Compared with traditional navigation method with CT, our system aligns the virtual guidance information and real patient and real-timely updates the view of virtual guidance via a position tracking system. In addition, to alleviate the difficulty during needle placement induced by respiratory motion, we reconstruct the patient-specific respiratory liver motion through statistical motion model to assist doctors precisely puncture liver tumors. The proposed system has been experimentally validated on vivo pigs with an accurate real-time registration approximately 5-mm mean FRE and TRE, which has the potential to be applied in clinical RFA guidance.

Keywords: human computer interaction, Mixed Reality, Statistical Motion Model

Images

Download Paper

Download Paper

Bibtex

@ARTICLE{li2019cvm,
    author = {Li, Ruotong and Si, Weixin and Liao, Xiangyun and Wang, Qiong and Klein, Reinhard and Heng,
              Pheng-Ann},
     title = {Mixed reality based respiratory liver tumor puncture navigation},
   journal = {Computational Visual Media},
    volume = {5},
    number = {4},
      year = {2019},
  keywords = {human computer interaction, Mixed Reality, Statistical Motion Model},
  abstract = {This paper presents a novel mixed reality based navigation system for accurate respiratory liver
              tumor punctures in radiofrequency ablation (RFA). Our system contains an optical see-through
              head-mounted display device (OST-HMD), Microsoft HoloLens for perfectly overlaying the virtual
              information on the patient, and a optical tracking system NDI Polaris for calibrating the surgical
              utilities in the surgical scene. Compared with traditional navigation method with CT, our system
              aligns the virtual guidance information and real patient and real-timely updates the view of virtual
              guidance via a position tracking system. In addition, to alleviate the difficulty during needle
              placement induced by respiratory motion, we reconstruct the patient-specific respiratory liver
              motion through statistical motion model to assist doctors precisely puncture liver tumors. The
              proposed system has been experimentally validated on vivo pigs with an accurate real-time
              registration approximately 5-mm mean FRE and TRE, which has the potential to be applied in clinical
              RFA guidance.},
       url = {https://link.springer.com/article/10.1007/s41095-019-0156-x#citeas},
       doi = {10.1007/s41095-019-0156-x}
}