Publications – Research Group CAMMA

2024

K. Yuan, V. Srivastav, N. Navab, N. Padoy, Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentation, Proceedings of the Thirty-Eighth Annual Conference on Neural Information Processing Systems (NeurIPS), arXiv preprint, 2024
V. Srivastav, K. Chen , N. Padoy, SelfPose3d: Self-Supervised Multi-Person Multi-View 3d Pose Estimation, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), arXiv preprint, 2024
J. Alekseenko, A. Karargyris, N. Padoy, Distance-Aware Non-IID Federated Learning for Generalization and Personalization in Medical Imaging Segmentation, Proceedings of Medical Imaging with Deep Learning (MIDL), 2024
S. El Hadramy, J. Verde, N. Padoy, S. Cotin, Towards Real-time Vessel Guided Augmented Reality for Liver Surgery, Proceedings of IEEE International Symposium on Biomedical Imaging (ISBI), 2024
J. Hassanpour, V. Srivastav, N. Padoy, Overcoming Dimensional Collapse in Self-supervised Contrastive Learning for Medical Image Segmentation, Proceedings of IEEE International Symposium on Biomedical Imaging (ISBI), 2024
J. Lavanchy, S. Ramesh, D. Dall’Alba, C. Gonzalez, P. Fiorini, B. Mueller-Stich, P. C. Nett, J. Marescaux, D. Mutter, N. Padoy, Challenges in Multi-centric Generalization: Phase and Step Recognition in Roux-en-Y Gastric Bypass Surgery, International Journal of Computer Assisted Radiology and Surgery (IJCARS), arXiv preprint, 2024
L. Cafarelli, C. Graëff, T. Lampert, N. Padoy, N. Meyer, D. Armaghan, P. Liverneaux, Influence of Surgeon’s Expertise on the Duration of Approach and Closure during Osteosynthesis of Distal Radius Fractures, Journal of Wrist Surgery, 2024
A. Meyer, J-P. Mazellier, J. Dana, N. Padoy, On-the-Fly Point Annotation for Fast Medical Video Labeling, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), arXiv preprint, 2024
S. Satyanaik, A. Murali, D. Alapatt, X. Wang, P. Mascagni, N. Padoy, Optimizing Latent Graph Representations of Surgical Scenes for Zero-Shot Domain Transfer, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), arXiv preprint, 2024
K. Yuan, M. Kattel, J. Lavanchy, N. Navab, V. Srivastav, N. Padoy, Advancing Surgical VQA with Scene Graph Knowledge, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), arXiv preprint, dataset and code, 2024
K-P. Beaudet, A. Karargyris, S. El Hadramy, S.Cotin, J-P. Mazellier, N. Padoy, J. Verde, Towards Real-time Intrahepatic Vessel Identification in Intraoperative Ultrasound-Guided Liver Surgery, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024
D. Wang, K. Yuan, C. Muller, F. Blanc, N. Padoy, H. Seo, Enhancing Gait Video Analysis in Neurodegenerative Diseases by Knowledge Augmentation in Vision Language Model, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2024
D. Alapatt, A. Murali, V. Srivastav, P. Mascagni, AI4SafeChole Consortium, N. Padoy, Jumpstarting Surgical Computer Vision , Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), arXiv preprint, code, 2024
K. Yuan, V. Srivastav, N. Navab, N. Padoy, HecVL: Hierarchical Video-Language Pretraining for Zero-shot Surgical Phase Recognition, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), arXiv preprint, 2024
C. Nwoye, N. Padoy , SurgiTrack: Fine-Grained Multi-Class Multi-Tool Tracking in Surgical Videos, Elsevier Medical Image Analysis, arXiv preprint, 2024
C. Nwoye, K. Elgohary, A. Srinivas, F. Zaid, J. Lavanchy, N. Padoy, CholecTrack20: A Dataset for Multi-Class Multiple Tool Tracking in Laparoscopic Surgery, arXiv preprint, 2024
A. Meyer, A. Murali, D. Mutter, N. Padoy, UltraSam: A Foundation Model for Ultrasound using Large Open-Access Segmentation Datasets, arXiv preprint, 2024
M. Hu, K. Yuan, Y. Shen, F. Tang, X. Xu, L. Zhou, W. Li, Y. Chen, Z. Xu, Z. Peng, S. Yan, V. Srivastav, D. Song, T. Li, D. Shi, J. Ye, N. Padoy, N. Navab, J. He, Z. Ge, OphCLIP: Hierarchical Retrieval-Augmented Learning for Ophthalmic Surgical Video-Language Pretraining, arXiv preprint, 2024
A. Murali, P. Mascagni, D. Mutter, N. Padoy, CycleSAM: One-Shot Surgical Scene Segmentation using Cycle-Consistent Feature Matching to Prompt SAM, arXiv preprint, 2024
C. Nwoye, R. Bose, K. Elgohary, L. Arboit, G. Carlino, J. Lavanchy, P. Mascagni, N. Padoy, Surgical Text-to-Image Generation, arXiv preprint, project & survey, 2024

2023

A. Murali, D. Alapatt, P. Mascagni, A. Vardazaryan, A. Garcia, N. Okamoto, G. Costamagna, D. Mutter, J. Marescaux, B. Dallemagne, N. Padoy, The Endoscapes Dataset for Surgical Scene Segmentation, Object Detection, and Critical View of Safety Assessment: Official Splits and Benchmark, arXiv preprint, dataset, 2023
J. Lavanchy, S. Ramesh, D. Dall’Alba, C. Gonzalez, P. Fiorini, B. Muller-Stich, P. C. Nett, J. Marescaux, D. Mutter, N. Padoy, Challenges in Multi-centric Generalization: Phase and Step Recognition in Roux-en-Y Gastric Bypass Surgery, arXiv preprint, dataset, 2023
C.I. Nwoye, T. Yu, S. Sharma, A. Murali, D. Alapatt, A. Vardazaryan, […], C. Gonzalez, D. Mutter, N. Padoy, CholecTriplet2022: Show me a tool and tell me the triplet – an endoscopic vision challenge for surgical action triplet detection, Elsevier Medical Image Analysis, arXiv preprint, code, 2023
L. Sestini, B. Rosa, E. De Momi, G. Ferrigno, N. Padoy, FUN-SIS: a Fully UNsupervised approach for Surgical Instrument Segmentation, Elsevier Medical Image Analysis, arXiv preprint, 2023
T. Yu, P. Mascagni, J. Verde, J. Marescaux, D. Mutter, N. Padoy, Live Laparoscopic Video Retrieval with Compressed Uncertainty, Elsevier Medical Image Analysis, arXiv preprint, 2023
S. Ramesh, D. Dall’Alba, C. Gonzalez, T. Yu, P. Mascagni, D. Mutter, J. Marescaux, P. Fiorini, N. Padoy, Weakly Supervised Temporal Convolutional Networks for Fine-grained Surgical Activity Recognition, IEEE Transactions on Medical Imaging (TMI), arXiv preprint, 2023
P. Mascagni, D. Alapatt, A. Lapergola, A. Vardazaryan, J. Mazellier, B. Dallemagne, D. Mutter, N. Padoy, Real-Time Artificial Intelligence Assistance for Safe Laparoscopic Cholecystectomy: Early-Stage Clinical Evaluation, British Journal of Surgery, arXiv preprint, 2023
J. Lavanchy, A. Vardazaryan, P. Mascagni, AI4SafeChole Consortium, D. Mutter, N. Padoy, Preserving Privacy in Surgical Video Analysis Using Artificial Intelligence: A Deep Learning Classifier to Identify Out-of-Body Scenes in Endoscopic Videos, Nature Scientific Reports, arXiv preprint, code, 2023
P. Germain, A. Vardazaryan, A. Labani, N. Padoy, C. Roy, S. El Ghannudi, Deep Learning to Classify AL versus ATTR Cardiac Amyloidosis MR Images, Biomedicines, 2023
J. Mazellier, C. Rolland, E. Wernert, J. Montanelli, A. Hostettler, L. Swanstrom, B. Gallix, L. Sosa Valencia, T. Collins, N. Padoy, Electromagnetic tracking of endoscopic ultrasound probe for pancreas examination: accuracy assessment under realistic medical conditions, Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2023
S. Ramesh, D. Dall’Alba, C. Gonzalez, T. Yu, P. Mascagni, D. Mutter, J. Marescaux, P. Fiorini, N. Padoy, TRandAugment: Temporal Random Augmentation Strategy for Surgical Activity Recognition from Videos, International Journal of Computer Assisted Radiology and Surgery (IJCARS), 2023
I. Hamoud, M.A. Jamal, V. Srivastav, D. Mutter, N. Padoy, O. Mohareri, ST(OR)^2: Spatio-Temporal Object Level Reasoning for Activity Recognition in the Operating Room, International Conference on Medical Imaging with Deep Learning (MIDL), 2023
S. Sharma, C. Nwoye, D. Mutter, N. Padoy, Rendezvous in Time: An Attention-based Temporal Fusion approach for Surgical Triplet Recognition, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), arXiv preprint, 2023
C. Graeff, T. Lampert, J.-P. Mazellier, N. Padoy, L. El Amiri, P. Liverneaux, The Preliminary Stage in Developing an Artificial Intelligence Algorithm: A Study of the Inter- and Intra-Individual Variability of Phase Annotations in Internal Fixation of Distal Radius Fracture Videos, Artificial Intelligence Surgery, 2023
C. Graeff, L. El Amiri, T. Lampert, N. Padoy, M. Cécile Sap, P. Liverneaux, Preliminary stage in the development of an artificial intelligence algorithm: Variations between 100 surgeons in phase annotation in a video of internal fixation of distal radius fracture, Orthopaedics & Traumatology: Surgery & Research, 2023
A. Karargyris et al., MedPerf: Open Benchmarking Platform for Medical Artificial Intelligence using Federated Evaluation, Nature Machine Intelligence, arXiv preprint, 2023
J.A. Eckhoff, G. Rosman, M.S. Altieri, S. Speidel, D. Stoyanov, M. Anvari, L. Meier-Hein, K. März, P. Jannin, C. Pugh, M. Wagner, E. Witkowski, P. Shaw, A. Madani, Y. Ban, T. Ward, F. Filicori, N. Padoy, M. Talamini, O.R. Meireles, SAGES consensus recommendations on surgical video data use, structure, and exploration (for research in artificial intelligence, clinical quality improvement, and surgical education), Surgical Endoscopy, 2023
R. Pedrett, P. Mascagni, G. Beldi, N. Padoy, J.L. Lavanchy, Technical skill assessment in minimally invasive surgery using artificial intelligence: a systematic review, Surgical Endoscopy, 2023
M. Villa, B. Nasr, D. Benoit, N. Padoy, D. Visvikis, J. Bert, Fast dose calculation in x-ray guided interventions by using deep learning, Physics in Medicine & Biology, 2023
M. D’Oria, P. Mascagni, I. Boškoski, N. Padoy, S. Alfieri, G. Costamagna, G. Scambia, Artificial Intelligence in Surgery, In: A. Cesario, M. D’Oria, C. Auffray, G. Scambia (eds) Personalized Medicine Meets Artificial Intelligence. Springer, doi, 2023
M. Eisenmann et al., Why is the winner the best?, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023
A. Yamlahi, T. Nuong Tran, P. Godau, M. Schellenberg, D. Michael, F-H. Smidt, J-H. Nölke, T. Adler, M. D. Tizabi, C. Nwoye, N. Padoy, L. Maier-Hein, Self-distillation for surgical action recognition, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023
S. El Hadramy, J. Verde, N. Padoy, S. Cotin, Intraoperative CT augmentation for needle-based liver interventions, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023
S. El Hadramy, J. Verde, K-P. Beaudet, N. Padoy, S. Cotin, Trackerless Volume Reconstruction from Intraoperative Ultrasound Images, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023
S. Sharma, C. Nwoye, D. Mutter, N. Padoy, Surgical Action Triplet Detection by Mixed Supervised Learning of Instrument-Tissue Interactions, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023
A. Murali, D. Alapatt, P. Mascagni, A. Vardazaryan, A. Garcia, N. Okamoto, D. Mutter, N. Padoy, Encoding Surgical Videos as Latent Spatiotemporal Graphs for Anatomy-Driven Reasoning, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2023
L. Sestini, B. Rosa, E. De Momi, G. Ferrigno, N. Padoy, SAF-IS: a Spatial Annotation Free Framework for Instance Segmentation of Surgical Tools, arXiv preprint, 2023
K. Yuan, V. Srivastav, T. Yu, J. Lavanchy, P. Mascagni, N. Navab, N. Padoy, Learning Multi-modal Representations by Watching Hundreds of Surgical Video Lectures, arXiv preprint, code, 2023

2022

A. Murali, D. Alapatt, P. Mascagni, A. Vardazaryan, A. Garcia, N. Okamoto, D. Mutter, N. Padoy, Latent Graph Representations for Critical View of Safety Assessment, IEEE Transactions on Medical Imaging (TMI), arXiv preprint, code, dataset 2022
C.I. Nwoye, T. Yu, C. Gonzalez, B. Seeliger, P. Mascagni, D. Mutter, J. Marescaux, N. Padoy, Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos, Elsevier Medical Image Analysis, arXiv preprint, doi:10.1016/j.media.2022.102433, code1, code2, 2022
V. Srivastav, A. Gangi, N. Padoy, Unsupervised domain adaptation for clinician pose estimation and instance segmentation in the OR , Elsevier Medical Image Analysis, arXiv preprint, code, 2022
H. Kassem, D. Alapatt, P. Mascagni, Consortium AI4SafeChole, A. Karargyris, N. Padoy, Federated Cycling (FedCy): Semi-supervised Federated Learning of Surgical Phases, IEEE Transactions on Medical Imaging (TMI), arXiv preprint, 2022
C.I. Nwoye, D. Alapatt, T. Yu, A. Vardazaryan, […], C. Gonzalez, N. Padoy, CholecTriplet2021: A benchmark challenge for surgical action triplet recognition, Elsevier Medical Image Analysis, arXiv preprint, code, 2022
S. Ramesh, V. Srivastav, D. Alapatt, T. Yu, A. Murali, L. Sestini, C.I. Nwoye, I. Hamoud, A. Fleurentin, G. Exarchakis, A. Karargyris, N. Padoy, Dissecting Self-Supervised Learning Methods for Surgical Computer Vision, Elsevier Medical Image Analysis, arXiv preprint, code, 2022
P. Mascagni, D. Alapatt, L. Sestini, M.S. Altieri, A. Madani, Y. Watanabe, A. Alseidi, J.A. Redan, S. Alfieri, G. Costamagna, I. Boškoski, N. Padoy, D.A. Hashimoto, Computer vision in surgery: from potential to clinical value, npj Digital Medicine, Volume 5 (163), 2022<rend/li>
J.L. Lavanchy, C. Gonzalez, H. Kassem, P.C. Nett, D. Mutter, N. Padoy, Proposal and multicentric validation of a laparoscopic Roux‑en‑Y gastric bypass surgery ontology, Surgical Endoscopy, 2022
P. Mascagni, D. Alapatt, G. G. Laracca, L. Guerriero, A. Spota, C. Fiorillo, A. Vardazaryan, G. Quero, S. Alfieri, L. Baldari, E. Cassinotti, L. Boni, D. Cuccurullo, G. Costamagna, B. Dallemagne, N. Padoy, Multicentric validation of EndoDigest: A computer vision platform for video documentation of the critical view of safety in laparoscopic cholecystectomy, Surgical Endoscopy, 2022
G. Quero, P. Mascagni, F. Kolbinger, C. Fiorillo, D. De Sio, F. Longo, C.A. Schena, V. Laterza, F. Rosa, R. Menghi, V. Papa, V. Tondolo, C. Cina, M. Distler, J. Weitz, S. Speidel, N. Padoy, S. Alfieri, Artificial Intelligence in Colorectal Cancer Surgery: Present and Future Perspectives, Cancers, 2022
L. Cobianchi, J. Verde, T. Loftus, D. Piccolo, F. Dal Mas, P. Mascagni, A. Garcia Vazquez, L. Ansaloni, G. R. Marseglia, M. Massaro, B. Gallix, N. Padoy, A. Peter, H. M. Kaafarani, Artificial intelligence and surgery: Ethical dilemmas and open issues, Journal of the American College of Surgeons, 2022
P. Germain, A. Vardazaryan, N. Padoy, A. Labani, C. Roy, T.H. Schindler, S. El Ghannudi, Deep Learning Supplants Visual Analysis by Experienced Operators for the Diagnosis of Cardiac Amyloidosis by Cine-CMR, Diagnostics 12(69), 2022
A. Krebs, J. Mazellier, J. Verde, C. Rolland, J. Bert, N.Padoy, Organ-based estimation and minimization of clinician’s X-ray dose, International Journal of Computer Assisted Radiology and Surgery (IJCARS), 2022
I. Hamoud, A. Karargyris, A. Sharghi, O. Mohareri, N. Padoy, Self-supervised learning via cluster distance prediction for operating room context awareness, International Journal of Computer Assisted Radiology and Surgery (IJCARS), IPCAI Special Issue, 2022
C.I. Nwoye, N. Padoy, Data splits and metrics for method benchmarking on surgical action triplet datasets, arXiv preprint, code, 2022
A. Fleurentin, J. Mazellier, A. Meyer, J. Montanelli, L. Swanstrom, B. Gallix, L. Sosa Valencia, N. Padoy, Automatic pancreas anatomical part detection in endoscopic ultrasound videos, Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2022
A. Krebs, J. Mazellier, C. Rolland, A. Meyer, J. Bert, J. Verde, N. Padoy, Multi-objective optimization for X-ray exposure reduction during image-guided needle-based procedure, Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2022
A. Meyer, A. Fleurentin, J. Montanelli, J. Mazellier, L. Swanstrom, B. Gallix, G. Exarchakis, L. Sosa Valencia, N. Padoy, Spatio-Temporal Model for EUS Video Detection of Pancreatic Anatomy Structures, Proceedings of MICCAI Workshop on Simplifying Medical Ultrasound, 2022

2021

P. Mascagni, D. Alapatt, T. Urade, A. Vardazaryan, D. Mutter, J. Marescaux, G. Costamagna, B. Dallemagne, N. Padoy, A Computer Vision Platform to Automatically Locate Critical Events in Surgical Videos: Documenting Safety in Laparoscopic Cholecystectomy, Annals of Surgery, 2021
P. Mascagni, M. R. Rodriguez-Luna, T. Urade, E. Felli, P. Pessaux, D. Mutter, J. Marescaux, G. Costamagna, B. Dallemagne, N. Padoy, Intraoperative time out to promote the implementation of the critical view of safety in laparoscopic cholecystectomy: a video-based assessment of 343 procedures, Journal of The American College of Surgeons, to appear, arXiv preprint, 2021
P. Mascagni, N. Padoy, OR black box and surgical control tower: Recording and streaming data and analytics to improve surgical care, Journal of Visceral Surgery, 2021
D. Alapatt, P. Mascagni, A. Vardazaryan, A. Garcia, N. Okamoto, D. Mutter, J. Marescaux, G. Costamagna, B. Dallemagne, N. Padoy, Temporally Constrained Neural Networks (TCNN): A framework for semi-supervised video semantic segmentation, arXiv preprint, 2021
M. Wagner et al., Comparative Validation of Machine Learning Algorithms for Surgical Workflow and Skill Analysis with the HeiChole Benchmark, Elsevier Medical Image Analysis, arXiv preprint, 2021
I. Luengo et al., 2020 CATARACTS Semantic Segmentation Challenge, arXiv preprint, 2021
L. Maier-Hein et al., Surgical Data Science–from Concepts toward Clinical Translation, Elsevier Medical Image Analysis, to appear, arXiv preprint, 2021
O.R. Meireles, G. Rosman, M.S. Altieri, L. Carin, G. Hager, A. Madani, N. Padoy, C.M. Pugh, P. Sylla, T.M. Ward, D.A. Hashimoto, SAGES consensus recommendations on an annotation framework for surgical video, Surgical Endoscopy, 2021
P. Germain, A. Vardazaryan, N. Padoy, A. Labani, C. Roy, T.H. Schindler, S. El Ghannudi, Classification of Cardiomyopathies from MR Cine Images Using Convolutional Neural Network with Transfer Learning, Diagnostics 11(9), 2021
F. Aspart, J.L. Bolmgren, J.L. Lavanchy, G. Beldi, M.S. Woods, N. Padoy, E. Hosgor, ClipAssistNet: bringing real-time safety feedback to operating rooms, International Journal of Computer Assisted Radiology and Surgery (IJCARS), 2021
T.M. Ward, P. Mascagni, A. Madani, N. Padoy, S. Perretta, D.A. Hashimoto, Surgical data science and artificial intelligence for surgical education, Journal of Surgical Oncology, 2021
L.R. Kennedy-Metz, P. Mascagni, A. Torralba, R.D. Dias, P. Perona, J.A. Shah, N. Padoy, M.A. Zenati, Computer Vision in the Operating Room: Opportunities and Caveats, IEEE Transactions on Medical Robotics and Bionics, 2021
M. Vannucci , G. Laracca , P. Mercantini , S. Perretta , N. Padoy, B. Dallemagne , P. Mascagni, Statistical models to preoperatively predict operative difficulty in laparoscopic cholecystectomy: a systematic review, Surgery, 2021
S. Ramesh, D. Dall’Alba, C. Gonzalez, T. Yu, P. Mascagni, D. Mutter, J. Marescaux, P. Fiorini, N. Padoy, Multi-Task Temporal Convolutional Networks for Joint Recognition of Surgical Phases and Steps in Gastric Bypass Procedures, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI) & International Journal of Computer Assisted Radiology and Surgery (IJCARS) , 2021
A. Krebs, C. Rolland, J. Verde, N. Padoy, Pose optimization of X-ray protective shields for staff radiation exposure minimization, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), 2021
L. Sestini, B. Rosa, E. De Momi, G. Ferrigno, N. Padoy, A Kinematic Bottleneck Approach For Pose Regression of Flexible Surgical Instruments directly from Images, IEEE Robotics and Automation Letters (RA-L) & IEEE International Conference on Robotics and Automation (ICRA), 2021
P. Mascagni, D. Alapatt, A. Garcia, N. Okamoto, A. Vardazaryan, G. Costamagna, B. Dallemagne, N. Padoy, Surgical data science for safe cholecystectomy: a protocol for segmentation of hepatocystic anatomy and assessment of the critical view of safety, arXiv preprint, 2021

2020

P. Mascagni, A. Vardazaryan, D. Alapatt, T. Urade, T. Emre, C. Fiorillo, P. Pessaux, D. Mutter, J. Marescaux, G. Costamagna, B. Dallemagne, N. Padoy, Artificial Intelligence for Surgical Safety: Automatic Assessment of the Critical View of Safety in Laparoscopic Cholecystectomy using Deep Learning, Annals of Surgery, 2020
Try out the online DeepCVS demo.
A. Kadkhodamohammadi, N. Padoy, A generalizable approach for multi-view 3D human pose regression, Machine Vision Applications (MVA), Springer, arXiv preprint, 2020
T. Yu, N. Padoy, Encode the Unseen: Predictive Video Hashing for Scalable Mid-Stream Retrieval, Asian Conference on Computer Vision (ACCV), arXiv preprint, 2020
C.I. Nwoye, C. Gonzalez, T. Yu, P. Mascagni, D. Mutter, J. Marescaux, N. Padoy, Recognition of Instrument-Tissue Interactions in Endoscopic Videos via Action Triplets, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), arXiv preprint, code, 2020
V. Srivastav, A. Gangi, N. Padoy, Self-supervision on Unlabelled OR Data for Multi-person 2D/3D Human Pose Estimation, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), arXiv preprint, code, 2020
T.M. Ward, P. Mascagni, Y. Ban, G. Rosman, N. Padoy, O. Meireles, D.A. Hashimoto, Computer vision in surgery, Surgery, 2020
L. Maier-Hein et al., Surgical Data Science–from Concepts toward Clinical Translation, arXiv preprint, 2020
D. Alapatt, P. Mascagni, V. Srivastav, N. Padoy, Neural Networks and Deep Learning. In Hashimoto
D.A. (Ed.) Artificial Intelligence in Surgery. New York: McGraw Hill. ISBN: 978-1260452730. arXiv preprint, code, 2020

2019

T. Vercauteren, M. Unberath, N. Padoy, N. Navab, CAI4CAI: The Rise of Contextual Artificial Intelligence in Computer Assisted Interventions, Proceedings of IEEE, arXiv preprint, 2019
P. Mascagni, C. Fiorillo , T. Urade , T. Emre , T. Yu, T. Wakabayashi , E. Felli , S. Perretta , L. Swanstrom , D. Mutter , J. Marescaux , P. Pessaux , G. Costamagna , N. Padoy, B. Dallemagne, Formalizing video documentation of the Critical View of Safety in laparoscopic cholecystectomy: a step towards artificial intelligence assistance to improve surgical safety, Surgical Endoscopy, 2019
S. Kannan, G. Yengera, D. Mutter, J. Marescaux, N. Padoy, Future-State Predicting LSTM for Early Surgery Type Recognition, IEEE Transactions on Medical Imaging (TMI), arXiv preprint, doi:10.1109/TMI.2019.2931158, 2019
V. Srivastav, A. Gangi, N. Padoy, Privacy-Preserving Human Pose Estimation on Low-Resolution Depth Images, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), arXiv preprint, code, 2019
C.I. Nwoye, D. Mutter, J. Marescaux, N. Padoy, Weakly Supervised Convolutional LSTM Approach for Tool Tracking in Laparoscopic Videos, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), arXiv preprint, code, 2019
T. Yu, D. Mutter, J. Marescaux, N. Padoy, Learning from a tiny dataset of manual annotations: a teacher/student approach for surgical phase recognition, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), arXiv preprint, 2019
T. Issenhuth, V. Srivastav, A. Gangi, N. Padoy, Face Detection in the Operating Room: Comparison of State-of-the-art Methods and a Self-supervised Approach, International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), arXiv preprint, 2019
N. Padoy, Machine and deep learning for workflow recognition during surgery, Minimally Invasive Therapy and Allied Technologies, Taylor & Francis, 2019
C. Rocha, N. Padoy, B. Rosa, Self-Supervised Surgical Tool Segmentation using Kinematic Information, IEEE International Conference on Robotics and Automation (ICRA), arXiv preprint, 2019

2018

N. Padoy. Vers une tour de contrôle des blocs opératoires ?, Santé et intelligence artificielle, sous la direction de Bernard Nordlinger et Cédric Villani, CNRS Editions, 2018
N. Loy Rodas and N. Padoy. Augmented Reality for reducing intraoperative radiation exposure to patients and clinicians during X-ray guided procedures, In Terry Peters, Ziv Yaniv, and Cristian Linte, editors, Mixed and Augmented Reality in Medicine, CRC Press, 2018
G. Yengera, D. Mutter, J. Marescaux, N. Padoy, Less is More: Surgical Phase Recognition with Less Annotations through Self-Supervised Pre-training of CNN-LSTM Networks, arXiv:1805.08569, 2018
A. Kadkhodamohammadi, N. Padoy, A generalizable approach for multi-view 3D human pose regression, arXiv:1804.10462, 2018
A.P. Twinanda, G. Yengera, D. Mutter, J. Marescaux, N. Padoy, RSDNet: Learning to Predict Remaining Surgery Duration from Laparoscopic Videos Without Manual Annotations, IEEE Transactions on Medical Imaging (TMI), to appear, arXiv preprint, 2018
V. Srivastav, T. Issenhuth, A. Kadkhodamohammadi, M. de Mathelin, A. Gangi, N. Padoy, MVOR: A Multi-view RGB-D Operating Room Dataset for 2D and 3D Human Pose Estimation, MICCAI-LABELS, arXiv preprint, code, 2018
A. Vardazaryan, D. Mutter, J. Marescaux, N. Padoy, Weakly-Supervised Learning for Tool Localization in Laparoscopic Videos, MICCAI-LABELS, arXiv preprint, 2018
L. Belguerras, A. Kadkhodamohammadi, A. Delmas, M. Miralipoor, N. Weber, A. Gangi, J. Felblinger, N. Padoy, C. Pasquier, Evaluation of occupational exposure to static magnetic field in MRI sites based on body pose estimation and SMF analytical computation, Bioelectromagnetics, 2018
N. Loy Rodas, A. Kadkhodamohammadi, M. de Mathelin, A. Gangi, N. Padoy, A Global Radiation Awareness System using Augmented Reality and Monte Carlo Simulations, European Congress of Radiology (ECR), 2018
N. Loy Rodas, P. Ghimire, M. de Mathelin, A. Gangi, N. Padoy, Teaching Radiation Safety Intuitively with a Head-Mounted Display, European Congress of Radiology (ECR), 2018

2017

L. Maier-Hein, S.S. Vedula, S. Speidel, N. Navab, R. Kikinis, A. Park, M. Eisenmann, H. Feussner, G. Forestier, S. Giannarou, M. Hashizume, D. Katic, H. Kenngott, M. Kranzfelder, A.Malpani, K. März, T. Neumuth, N. Padoy, C.M. Pugh, N. Schoch, D. Stoyanov, R.H. Taylor, M. Wagner, G.D. Hager, P. Jannin: Surgical Data Science for Next-Generation Interventions, Nature Biomedical Engineering, Volume 1, pp. 691–696, 2017
I. Aksamentov, A.P. Twinanda, D. Mutter, J. Marescaux, N. Padoy, Deep Neural Networks Predict Remaining Surgery Duration from Cholecystectomy Videos, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Oral, 2017
A. Kadkhodamohammadi, A. Gangi, M. de Mathelin, N. Padoy, A Multi-view RGB-D Approach for Human Pose Estimation in Operating Rooms, Proceedings of IEEE Winter Conference on Applications of Computer Vision (WACV), arXiv preprint, 2017
N. Loy Rodas, J. Bert, D. Visvikis, M. de Mathelin, N. Padoy, Pose Optimization of a C-arm Imaging Device to Reduce Intraoperative Radiation Exposure of Staff and Patient during Interventional Procedures, IEEE International Conference on Robotics and Automation (ICRA), 2017

2016

A. Kadkhodamohammadi, A. Gangi, M. de Mathelin, N. Padoy, Articulated Clinician Detection Using 3D Pictorial Structures on RGB-D Data, Elsevier Medical Image Analysis (MEDIA), arXiv preprint, doi:10.1016/j.media.2016.07.001, 2016
N. Loy Rodas, F. Barrera, N. Padoy, See It With Your Own Eyes: Marker-less Mobile Augmented Reality for Radiation Awareness in the Hybrid Room, IEEE Transactions on Biomedical Engineering (TBME), Volume: 64, Issue: 2, Pages: 429 – 440, Feb. 2017 (online version), doi:10.1109/TBME.2016.2560761, 2016
A.P. Twinanda, S. Shehata, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos, IEEE Transactions on Medical Imaging (TMI), arXiv preprint, doi:10.1109/TMI.2016.2593957, 2016
A.P. Twinanda, P. Winata, A. Gangi, M. de Mathelin, N. Padoy, Multi-Stream Deep Architecture for Surgical Phase Recognition on Multi-View RGBD Videos, 7th MICCAI Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), 2016 (preprint)
A.P. Twinanda, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, Single- and Multi-Task Architectures for Surgical Workflow Challenge at M2CAI 2016, technical report, 2016
A.P. Twinanda, D. Mutter, J. Marescaux, M. de Mathelin, N. Padoy, Single- and Multi-Task Architectures for for Tool Presence Detection Challenge at M2CAI 2016, technical report, 2016

2015

N. Loy Rodas, F. Barrera, N. Padoy, Marker-less AR in the Hybrid Room using Equipment Detection for Camera Relocalization, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Oral, 2015
A. Kadkhodamohammadi, A. Gangi, M. de Mathelin, N. Padoy, Pictorial Structures on RGB-D Images for Human Pose Estimation in the Operating Room, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2015
A.P. Twinanda, E. O. Alkan, A. Gangi, M. de Mathelin, N. Padoy, Data-driven Spatio-temporal RGBD Feature Encoding for Action Recognition in Operating Rooms, International Journal of Computer Assisted Radiology and Surgery (IJCARS), IPCAI Special Issue, 2015
A.P. Twinanda, J. Marescaux, M. de Mathelin, N. Padoy, Classification Approach for Automatic Laparoscopic Video Database Organization, International Journal of Computer Assisted Radiology and Surgery (IJCARS), IPCAI Special Issue, 2015
N. Loy Rodas, N. Padoy, Seeing Is Believing: Increasing Intraoperative Awareness to Scattered Radiation in Interventional Procedures by Combining Augmented Reality, Monte Carlo Simulations and Wireless Dosimeters, International Journal of Computer Assisted Radiology and Surgery (IJCARS), MICCAI Special Issue, Volume 10, Number 8, pp. 1181-1191, 2015

2014

F. Barrera, N. Padoy, Piecewise Planar Decomposition of 3D Point Clouds Obtained from Multiple Static RGB-D Cameras, Proceedings of International Conference on 3D Vision (3DV), 2014
N. Loy Rodas, N. Padoy, 3D Global Estimation and Augmented Reality Visualization of Intra-operative X-ray Dose, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Oral, 2014
A.P. Twinanda, M. de Mathelin, N. Padoy, Fisher Kernel Based Task Boundary Retrieval in Laparoscopic Database with Single Video Query, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), 2014
A. Kadkhodamohammadi, A. Gangi, M. de Mathelin, N. Padoy, Temporally Consistent 3D Pose Estimation in the Interventional Room using Discrete MRF Optimization Over RGBD Sequences, Proceedings of International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), 2014
A.P. Twinanda, J. Marescaux, M. de Mathelin, N. Padoy, Towards Better Laparoscopic Video Database Organization by Automatic Surgery Classification, Proceedings of International Conference on Information Processing in Computer-Assisted Interventions (IPCAI), 2014

2012

N. Padoy, G.D. Hager, Deformable Tracking of Textured Curvilinear Objects, Proceedings of British Machine Vision Conference (BMVC), Guildford, UK, September 2012

2011

N. Padoy, G.D. Hager, Spatio-Temporal Registration of Multiple Trajectories, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Toronto, Canada, September 2011
N. Padoy, G.D. Hager, Human-Machine Collaborative Surgery Using Learned Models, Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China, May 2011, pp 5285-5292
N. Padoy, G.D. Hager, 3D Thread Tracking for Robotic Assistance in Tele-surgery, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), San Francisco, USA, September 2011

2010

N. Padoy, T. Blum, A. Ahmadi, H. Feußner, M.O. Berger, N. Navab, Statistical Modeling and Recognition of Surgical Workflow, Medical Image Analysis, In Press, doi:10.1016/j.media.2010.10.001, 2010

2009

N. Padoy, D. Mateus, D. Weinland, M.O. Berger, N. Navab, Workflow Monitoring based on 3D Motion Features, ICCV Workshop on Video-oriented Object and Event Classification, Kyoto, Japan, September, 2009 (IBM Best Paper Award)
O. Pauly, N. Padoy, H. Poppert, L. Esposito, N. Navab, Wavelet Energy Map: A Robust Support for Multi-modal Registration of Medical Images, IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Miami, Florida, USA, June 2009
O. Pauly, N. Padoy, H. Poppert, L. Esposito, H-H. Eckstein, N. Navab, Towards Application-specific Multi-modal Similarity Measures: a Regression Approach, MICCAI Workshop on Probabilistic Models in Medical Image Analysis (PMMIA), London, UK, September 2009
A. Ahmadi, N. Padoy, K. Rybachuk, H. Feußner, S.M. Heining, N. Navab, Motif Discovery in OR Sensor Data with Application to Surgical Workflow Analysis and Activity Detection, MICCAI Workshop on Modeling and Monitoring of Computer Assisted Interventions (M2CAI), London, UK, September 2009

2008 and earlier

N. Padoy, T. Blum, H. Feußner, M.O. Berger, N. Navab, On-line Recognition of Surgical Activity for Monitoring in the Operating Room, Proceedings of the 20th Conference on Innovative Applications of Artificial Intelligence (IAAI 2008), held in conjunction with the 23rd AAAI Conference on Artificial Intelligence, Chicago, Illinois, USA, July 2008, pp. 1718-1724
T. Blum, N. Padoy, H. Feußner, N. Navab, Workflow Mining for Visualization and Analysis of Surgeries, International Journal of Computer Assisted Radiology and Surgery, Volume 3, Number 5, November 2008, pp. 379-386
T. Blum, N. Padoy, H. Feußner, N. Navab, Modeling and Online Recognition of Surgical Phases using Hidden Markov Models, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), New York, USA, September 2008, pp. 627-6354
U.F. Klank, N. Padoy, H. Feußner, N. Navab, An Automatic Approach for Feature Generation in Endoscopic Images, International Journal of Computer Assisted Radiology and Surgery, Volume 3, Number 3-4, September 2008, pp. 331-339
A. Ahmadi, N. Padoy, S.M. Heining, H. Feußner, M. Daumer, N. Navab, Introducing Wearable Accelerometers in the Surgery Room for Activity Detection, 7. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC), 2008
J. Traub, A. Ahmadi, N. Padoy, L. Wang, S.M. Heining, E. Euler, P. Jannin, N. Navab, Workflow Based Assessment of the Camera Augmented Mobile C-arm System, International Workshop on Augmented Reality environments for Medical Imaging and Computer-aided Surgery (AMI-ARCS), New York, NY, USA, September 2008
N. Padoy, T. Blum, I. Essa, H. Feußner, M.O. Berger, N. Navab, A Boosted Segmentation Method for Surgical Workflow Analysis, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Brisbane, Australia, October 2007, pp. 102-109
M. Groher, T. F. Jakobs, N. Padoy, N. Navab, Planning and Intraoperative Visualization of Liver Catheterizations: New CTA Protocol and 2D-3D Registration Method, Academic Radiology 14 (11), pp.1324-1339. Special issue of MICCAI 2006
N. Padoy, M. Horn, H. Feußner, M.O. Berger, N. Navab, Recovery of Surgical Workflow: a Model-based Approach, Proceedings of Computer Assisted Radiology and Surgery (CARS), 21st International Congress and Exhibition, Berlin, Germany, June 2007
J. Cohen, E. Jeannot, N. Padoy, F. Wagner, Messages Scheduling for Parallel Data Redistribution between Clusters, IEEE Transactions on Parallel and Distributed Systems, Volume 17, Number 11, November 2006
M. Groher, N. Padoy, T. F. Jakobs, N. Navab, New CTA Protocol and 2D-3D Registration Method for Liver Catheterization, Proceedings of Medical Image Computing and Computer-Assisted Intervention (MICCAI), Copenhagen, Denmark, October 2006
M. Groher, T. F. Jakobs, N. Padoy, N. Navab, Towards a Feature-based 2D-3D Registration Method of CTA and 2D Angiograms for Liver Tumor Chemoembolizations, 4. Jahrestagung der Deutschen Gesellschaft für Computer-und Roboter-Assistierte Chirurgie (CURAC), Berlin, Germany, September 2005
J. Cohen, E. Jeannot, N. Padoy, Messages Scheduling for Data Redistribution between Clusters, Proceedings of the 5th International Conference on Parallel Processing and Applied Mathematics (PPAM), Czestochowa, Poland, September 2003