Medical Image-Patient Space Registration for Augmented Reality Surgery

Our system runs on high-performance laptops, including personalized markers, intraoperative X-ray imaging systems, monocular cameras, and screens as augmented reality display tools.

To achieve patient registration in both the medical image coordinate system and patient coordinate system in the world space coordinate system defined by the monocular camera, this study uses personalized markers that are rigidly fixed to the patient during surgery and registers the marker coordinate system with the patient coordinate system as a whole. The breakthrough in aligning the medical image coordinate system with the world coordinate system lies in the registration of medical images with the patient. Since medical images are obtained from the patient's scan, this paper registers the two coordinate systems based on the fact that the patient and markers exist in the real world and also in the image space. The medical image-patient space registration process is shown in Figure 1.