Sparse-then-dense alignment-based 3D map reconstruction method for endoscopic capsule robots


Creative Commons License

Turan M., Pilavci Y. Y., Ganiyusufoglu I., Araujo H., Konukoglu E., Sitti M.

MACHINE VISION AND APPLICATIONS, cilt.29, sa.2, ss.345-359, 2018 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 29 Sayı: 2
  • Basım Tarihi: 2018
  • Doi Numarası: 10.1007/s00138-017-0905-8
  • Dergi Adı: MACHINE VISION AND APPLICATIONS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.345-359
  • Anahtar Kelimeler: Endoscopic capsule robots, 3D map reconstruction, Sparse-then-dense feature tracking, ACTUATED SOFT CAPSULE, SHAPE, IMAGE
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

Despite significant progress achieved in the last decade to convert passive capsule endoscopes to actively controllable robots, robotic capsule endoscopy still has some challenges. In particular, a fully dense three-dimensional (3D) map reconstruction of the explored organ remains an unsolved problem. Such a dense map would help doctors detect the locations and sizes of the diseased areas more reliably, resulting in more accurate diagnoses. In this study, we propose a comprehensive medical 3D reconstruction method for endoscopic capsule robots, which is built in a modular fashion including preprocessing, keyframe selection, sparse-then-dense alignment-based pose estimation, bundle fusion, and shading-based 3D reconstruction. A detailed quantitative analysis is performed using a non-rigid esophagus gastroduodenoscopy simulator, four different endoscopic cameras, a magnetically activated soft capsule robot, a sub-millimeter precise optical motion tracker, and a fine-scale 3D optical scanner, whereas qualitative ex-vivo experiments are performed on a porcine pig stomach. To the best of our knowledge, this study is the first complete endoscopic 3D map reconstruction approach containing all of the necessary functionalities for a therapeutically relevant 3D map reconstruction.