I am a Research Associate at the University of Edinburgh working on robot vision, with interests in 3D perception, motion estimation, and visual navigation. My research combines geometric modelling and deep learning, with recent work on depth estimation, visual odometry, and segmentation for medical robotics and bronchoscopic navigation. I received my PhD from Durham University, where I studied geometric representations for clinical video analysis. More broadly, I am interested in how robots use visual information to understand their surroundings and navigate reliably, and I am open to research and engineering opportunities in robotic perception and applied computer vision.
I design and build applied machine learning systems for safety-critical and data-constrained domains,
with an emphasis on end-to-end pipelines: data curation, model training, evaluation, and deployment-ready inference.
My work spans geometry-aware perception, temporal and graph-based modeling, and reproducible tooling that produces
integration-friendly outputs (e.g., depth, graphs, structured predictions) for downstream systems.
If you’d like to collaborate, please reach out at
francis.xiatian.zhang@outlook.com (primary) or
francis.zhang@ed.ac.uk (academic).
Geometry-Aware VO
ICRA 2026 · Best Paper Award in Medical Robotics
Geometry-Aware Visual Odometry for Bronchoscopic Navigation via High-Gain Observer Fusion
IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2026
Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Training
Assesses acupuncture and Tuina training skills by combining visual and pose features, learning from first-person and third-person videos while requiring only a third-person view at inference.
Introduces two synchronized dual-view datasets with expert annotations from 61 participants for each task.
Provides training and inference code, sample videos, and demonstrations of skill assessment.
Publishes ready-to-run inference code for bronchoscopic navigation research stacks, adapting foundation models to bronchoscopy footage so downstream perception modules inherit reliable depth.
Produces stable depth estimates that downstream planners can use for CT-to-video alignment and collision checks.
Pipeline: synthetic airway renderer → domain adaptation → depth inference package → evaluation harness, all versioned so surgical robotics teams can reproduce deployments.
Provides a depth-aware inpainting toolkit that teams can run locally to clean surgeon video archives prior to research sharing or dataset release.
Accepts raw video plus masks and returns temporally consistent fills, ready for downstream training or review.
Bundled training/inference scripts with deterministic preprocessing and checkpoints so biomedical researchers can rerun inpainting and compare outputs to their own reference sets.
My research focuses on
Computer-assisted Intervention,
Medical Robotics, and
Vision-based Skill Assessment.
Below are selected publications, including recent collaborations in biomedical engineering and medical robotics.
A complete list of my publications can be found on my Google Scholar page.
Conference Papers:
FDRAS: Failure Diagnosis and Repair for Airway Segmentation
Francis Xiatian Zhang, Kevin Dhaliwal and Mohsen Khadem
MICCAI 2026 |
paper |
code
Contribution: Predicts geometric and connectivity error maps to guide targeted repair of airway segmentations under domain shift.
Medical Imaging
Geometry-Aware Visual Odometry for Bronchoscopic Navigation via High-Gain Observer Fusion
Mohammadreza Kasaei, Francis Xiatian Zhang, Feng Li, Farshid Alambeigi, Kevin Dhaliwal and Mohsen Khadem
IEEE International Conference on Robotics and Automation (ICRA) 2026 |
paper |
arXiv
Contribution: Combines BREA-Depth-based depth perception with high-gain observer fusion to improve bronchoscopic tracking and reduce trajectory drift.
Robotics
A Model-Based Framework for Assessing Operator Performance in Navigational Bronchoscopy
Zhaoxing Deng, David Hanley, Francis Xiatian Zhang, Kevin Dhaliwal and Mohsen Khadem
IEEE International Conference on Robotics and Automation (ICRA) 2026 |
paper
Contribution: Uses tracked bronchoscope poses, kinematic constraints, and model-predictive reference trajectories to assess operator performance.
Robotics
ROOM: A Physics-Based Continuum Robot Simulator for Photorealistic Medical Datasets Generation
Salvatore Esposito, Matías Mattamala, Daniel Rebain, Francis Xiatian Zhang, Kevin Dhaliwal, Mohsen Khadem and Subramanian Ramamoorthy
IEEE International Conference on Robotics and Automation (ICRA) 2026 |
paper |
arXiv
Contribution: Combines continuum robot simulation with photorealistic rendering to generate datasets for robotic bronchoscopy.
Robotics
Navigational Bronchoscopy in Critical Care via End-to-End Pose Regression
Emile Mackute, Francis Xiatian Zhang, Kevin Dhaliwal and Mohsen Khadem
MICCAI 2025 |
paper
Contribution: Estimates bronchoscope pose directly from video to support navigation in critical care.
Robotics
BREA-Depth: Bronchoscopy Realistic Airway-geometric Depth Estimation
Francis Xiatian Zhang, Emile Mackute, Mohammadreza Kasaei, Kevin Dhaliwal, Robert Thomson and Mohsen Khadem
MICCAI 2025 |
paper |
arXiv |
code
Contribution: Adapts foundation models for bronchoscopic depth estimation using depth-aware domain translation, airway structure losses, and airway-specific evaluation metrics.
Medical Imaging
Depth-Aware Endoscopic Video Inpainting
Francis Xiatian Zhang, Shuang Chen, Xianghua Xie and Hubert P. H. Shum
MICCAI 2024 |
paper |
arXiv |
code
Contribution: Combines spatial-temporal depth estimation, bi-modal fusion, and a depth-enhanced discriminator to recover occluded anatomy in endoscopic video.
Medical Imaging
Pose-Based Tremor Classification for Parkinson's Disease Diagnosis from Video
Haozheng Zhang, Edmond S. L. Ho, Francis Xiatian Zhang and Hubert P. H. Shum
MICCAI 2022 |
paper |
arXiv |
code
Contribution: Supports pose-based Parkinsonian tremor classification through dataset curation, evaluation design, and clinical interpretation.
Human Motion Analysis
Journal Papers:
Cross-view Multimodal Vision-Based Assessment Framework for Traditional Chinese Medicine Rehabilitation Training
Francis Xiatian Zhang, Hao Yao, Shengxuan Chen, Hong Zhu, Hongxiao Jia, Sisi Zheng and Hubert P. H. Shum
IEEE Transactions on Neural Systems and Rehabilitation Engineering 2026 |
paper |
arXiv |
code
Contribution: Combines visual and pose features with cross-view training to assess acupuncture and Tuina skills using expert-annotated dual-view datasets.
Human Motion Analysis
Adaptive Anticipation: Adaptive Graph Learning From Spatial Information for Surgical Workflow Anticipation
Francis Xiatian Zhang, Jingjing Deng, Robert Lieck and Hubert P. H. Shum
IEEE Transactions on Medical Robotics and Bionics 2024 |
paper |
arXiv |
code
Contribution: Learns spatial relationships between surgical instruments with an adaptive graph to anticipate surgical workflow.
Robotics
Advancing healthcare practice and education via data sharing: demonstrating the utility of open data by training an artificial intelligence model to assess cardiopulmonary resuscitation skills
Merryn D. Constable, Francis Xiatian Zhang*, Tony Conner, Daniel Monk, Jason Rajsic, Claire Ford, Laura Jillian Park, Alan Platt, Debra Porteous, Lawrence Grierson and Hubert P. H. Shum
Advances in Health Sciences Education 2024 |
paper |
code |
dataset
Contribution: Combines multi-view pose estimation and spatial-temporal graph modelling to assess CPR skills.
Research Associate at The University of Edinburgh, 11/2024-.
Develops deep learning visual navigation prototypes for robotic bronchoscopy—airway segmentation, geometric graph construction, and failure-aware inference evaluated on recorded clinical video streams.
Research supervisor: Dr Mohsen Khadem
Research Assistant at Durham University, 10/2023-11/2023;7/2024-9/2024.
Delivered the Edge Computing and Analytics 2.0 course by teaching end-to-end model workflows—from training to ONNX export and deployment through Python APIs with lightweight GUIs.
PI: Dr Anish Jindal
Demonstrator at Durham University, 11/2021-6/2024.
Led weekly lab support for Computational Thinking, Data Science, Programming for Data Science, and Text Mining modules—debugging starter code, clarifying marking rubrics, and routing stubborn tooling issues to instructors.
Student Helper at Durham University, 08/2022-09/2022.
Handled visiting speaker transport, couch bookings, and leisure tours around Durham Castle for the 21st ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA 2022).
Research Assistant at Northumbria University, 04/2022-07/2022.
Set up multi-camera capture, collected nursing simulation footage, and led training of the automatic rating system that turned pose-estimation outputs into competency scores.
PI: Dr Merryn Constable
Grants Involved
U-care: Deep Ultraviolet Light Therapies
Research Associate; EPSRC programme grant: EP/T020903/1; Total award: £6,132,366
Programme PI: Prof Robert Thomson
Research supervisor: Dr Mohsen Khadem
Funded by UKRI, 2021–2026 (I joined in 2024)
Course Development in Edge Computing and Analytics 2.0
Research Assistant, UK-Egypt Trans-National Education (TNE) Grant: £30,000 (PI: Dr. Anish Jindal)
Funded by the British Council, UK, 2022–2024
Pose Estimation for Health Professional Education: Development of an Objective Computerized Approach for Measuring and Assessing Technical Competencies in Nursing
Research Assistant, Northumbria University Application Seed Funding Scheme: £16,428 (PI: Dr. Merryn Constable)
Funded by Northumbria University, UK, 2022
Thanks to Yunhe Wang, who kindly shared the open-source code for the website template I used ✩.
Powered by w3.css