The ARAILIS project aims to make Augmented Reality (AR) and Artificial Intelligence (AI) usable for surgical interventions in order to improve minimally invasive surgery by combining pre- and intraoperative data.

Preoperative data from CT, MRI or ultrasound images are used to identify important structural information such as the location of tumors, blood vessels and resection lines. These form the basis for planning surgical interventions and support orientation and decision-making during the operation. Surgeons mainly rely on their (spatial) imagination to transfer the preoperative data to the current surgical situation during the operation. This increases the cognitive workload of surgeons, especially during laparoscopic procedures (minimally invasive surgery), as small camera views, limited depth vision, difficult hand-eye coordination and reduced tactile ability present additional challenges.

Since a minimally invasive procedure offers advantages for the patient, such as lower risk of infection, shorter hospital stay and smaller scars, the ARAILIS project aims to develop a system to support laparoscopic interventions. This system will merge and integrate existing preoperative data sets with live intraoperative data during surgery. Thus, innovative computer-assisted surgery will support intraoperative decision making by using Augmented Reality (AR) and Artificial Intelligence (AI). The overall goal is to reduce the risk of complications, reduce the need for follow-up care and thus increase patient safety.

The ARAILIS research project brings together scientists from the TU Dresden, the Carl Gustav Carus University Hospital and the Medical Faculty of the TU Dresden as well as the National Center for Tumor Diseases Dresden. Raimund Dachselt‘s working group is mainly responsible for the conception and evaluation of the Human-Machine-Interface (AP 7). This development is based on the extensive previous research of the Interactive Media Lab Dresden on Information Visualization and Human-Computer Interaction.

Further information can be found on the ARAILIS project page of the Chair of Software Technology.

Related Publications

  • ROS-based Image Guidance Navigation System for Minimally Invasive Liver Surgery

    ROS-based Image Guidance Navigation System for Minimally Invasive Liver Surgery

    Docea, R.; Müller, J.; Krug, K.; Hardner, M.; Riedel, P.; Pfeiffer, M.; Menzel, M.; Kolbinger, F.; Frohneberg, L.; Weitz, J.; Speidel, S.

    To appear in RosCon Kyoto 2022.RosCon '22, Kyoto, Japan.Open Robotics,2022.

    @inproceedings{docea22,
       author = {Reuben Docea and Jan M\"{u}ller and Katja Krug and Matthias Hardner and Paul Riedel and Micha Pfeiffer and Martin Menzel and Fiona R. Kolbinger and Laura Frohneberg and J\"{u}rgen Weitz and Stefanie Speidel},
       title = {ROS-based Image Guidance Navigation System for Minimally Invasive Liver Surgery},
       booktitle = {RosCon Kyoto 2022},
       year = {2022},
       month = {10},
       location = {Kyoto, Japan},
       publisher = {Open Robotics}
    }

    List of additional material

  • @inproceedings{fixme,
       author = {Weizhou Luo and Eva Goebel and Patrick Reipschl\"{a}ger and Mats Ole Ellenberg and Raimund Dachselt},
       title = {Demonstrating Spatial Exploration and Slicing of Volumetric Medical Data in Augmented Reality with Handheld Devices},
       booktitle = {2021 IEEE International Symposium on Mixed and Augmented Reality},
       year = {2021},
       month = {10},
       location = {Bari, Italy}
    }

    List of additional material

    Video

  • @inproceedings{fixme,
       author = {Weizhou Luo and Eva Goebel and Patrick Reipschl\"{a}ger and Mats Ole Ellenberg and Raimund Dachselt},
       title = {Exploring and Slicing Volumetric Medical Data in Augmented Reality Using a Spatially-Aware Mobile Device},
       booktitle = {2021 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)},
       year = {2021},
       month = {10},
       location = {Bari, Italy},
       doi = {10.1109/ISMAR-Adjunct54149.2021.00076},
       publisher = {IEEE}
    }

    List of additional material

    Video, Poster