Rau, A; Bhattarai, B; Agapito, L; Stoyanov, D; (2023) Bimodal Camera Pose Prediction for Endoscopy. IEEE Transactions on Medical Robotics and Bionics 10.1109/TMRB.2023.3320267. (In press).

Preview

Text Rau_Bimodal_Camera_Pose_Prediction_for_Endoscopy.pdf - Accepted Version Download (4MB) | Preview

Abstract

Deducing the 3D structure of endoscopic scenes from images is exceedingly challenging. In addition to deformation and view-dependent lighting, tubular structures like the colon present problems stemming from their self-occluding and repetitive anatomical structure. In this paper, we propose SimCol, a synthetic dataset for camera pose estimation in colonoscopy, and a novel method that explicitly learns a bimodal distribution to predict the endoscope pose. Our dataset replicates real colonoscope motion and highlights the drawbacks of existing methods. We publish 18k RGB images from simulated colonoscopy with corresponding depth and camera poses and make our data generation environment in Unity publicly available. We evaluate different camera pose prediction methods and demonstrate that, when trained on our data, they generalize to real colonoscopy sequences, and our bimodal approach outperforms prior unimodal work. Our project and dataset can be found here: http://www.github.com/anitarau/simcol.

Download activity - last month

Export as JSONXMLCSV

Download activity - last 12 months

Export as JSONCSVXML

Downloads by country - last 12 months

Export as JSONXMLCSV

Archive Staff Only

View Item