Metaverse Surgical Planning with Three-dimensional Virtual Models for Minimally Invasive Partial Nephrectomy.

Abstract

The recent integration of new virtual visualization modalities with artificial intelligence and high-speed internet connection has opened the door to the advent of the metaverse in medicine. In this totally virtual environment, three-dimensional virtual models (3DVMs) of the patient's anatomy can be visualized and discussed via digital avatars. Here we present for the first time a metaverse preoperative clinical case discussion before minimally invasive partial nephrectomy. The surgeons' digital avatars met in a virtual room and participated in a virtual consultation on the surgical strategy and clamping approach before the procedure. Robotic or laparoscopic procedures are then carried out according to the simulated surgical strategy. We demonstrate how this immersive virtual reality experience overcomes the barriers of distance and how the quality of surgical planning is enriched by a great sense of "being there", even if virtually. Further investigation will improve the quality of interaction with the models and among the avatars.