Real-time 3D reconstruction of deforming organ surfaces and augmented reality overlays of preoperative MRI/CT tumor margins.
Pulsating organs and breathing motions invalidate rigid SLAM assumptions. SurgicalSwarm utilizes dynamic non-rigid neural radiance fields and optical flow to continuously track tissue deformation during active surgery.
Subsurface blood vessels and tumor boundaries segmented from preoperative 3D imaging are projected directly into the surgeon's 3D binocular display, aligned with anatomical landmarks in real time.