Automated medical examinations
Al Smith, Wenzou Ding, Yifan Zhu, Yuanyi Feng, Mark Draelos, Kris Hauser, Anthony Kuo, Joseph Izatt, Ryan McNabb
Summary
With collaborators at Duke University, we are studying automated medical examinations using robot-controlled examination instruments. Automation of medical examinations can reduce costs and increase availability of routine screening, which may ultimately improve health outcomes. In the context of optometric, ophthalmic, and vital signs monitoring tasks, this integrative research seeks to attain both clinical efficacy and patient safety using a combination of computer vision, machine learning, decision-making, control, and sensor design techniques. Novel methods are needed to attain safe robot operation in close proximity to sensitive anatomical locations, to validate control strategies in the presence of variability in patient appearance, physiology, and pathology, and to manage patient communication and non-compliance.
- A.D. Smith, W. Ding, L. Vianello, E. Person, and K. Hauser. The EYESIGHT Robotic Eye Examination System for Non-Mydriatic Indirect Retinal Imaging on Unconstrained Individuals. To appear in International Journal of Medical Robotics Research (JMRR), 2026.
- A.D. Smith, B. Muthumanickam, Y. Feng, W. Ding, and K. Hauser. UnityEyes 2: Open Source Robust Synthetic Eye Generation for Camera-Based Eye Tracking with Machine Learning. ACM Symposium on Eye Tracking Research & Applications Late Breaking Work, May 2025.
- A.D. Smith, W. Ding, Y. Feng, and K. Hauser. EYESIGHT: Eye Examination System with Intelligent Guidance and Human Tracking. IEEE International Symposium on Medical Robotics (ISMR), May 2025.
Supplemental video
- Y. Zhu, A. Smith, and K. Hauser. Automated Heart and Lung Auscultation in Robotic Physical Examinations. IEEE Robotics and Automation Letters, 7(2):4204-4211, April 2022. doi: 10.1109/LRA.2022.3149576
- M. Draelos, P. Ortiz, R. Qian, B. Keller, K. Hauser, A. Kuo, and J. Izatt. Automatic Optical Coherence Tomography Imaging of Stationary and Moving Eyes with a Robotically-Aligned Scanner. IEEE International Conference on Robotics and Automation, May, 2019. ICRA video
