Augmented reality based surgery navigation system


Abstract—A surgery navigation system based on augmented reality is presented. The system is based on 3D visualization and 3D registration techniques with an infrared tracking device and a 3D scanner. After reconstructing the 3D model of the patient’s organs and scanning the surface of the patient’s face, the system uses Iterative Closest Point (ICP) algorithm to calculate the transformation between the 3D model of patient and the three-dimensional scanner. During the surgery navigation, 3D model can be overlaid onto the image of the real patient. The proposed system doesn’t require the attachment of markers because of the adoption of 3D scanner. Experimental result shows that the tracking accuracy of the system is appropriate for the requirements of actual surgery and can bring down the risk of endoscopic surgery.