Overview
This thesis examines spatial interaction for immersive mixed-reality visualizations.
It investigates three core research questions:
- What are promising types of immersive mixed-reality visualizations, and how can advanced interaction concepts be applied to them?
- How does spatial interaction benefit these visualizations, and how should such interactions be designed?
- How can spatial interaction in these immersive environments be analyzed & evaluated?
To address the first question, the thesis examines how various visualizations, such as 3D node-link diagrams and volume visualizations, can be adapted for immersive mixed-reality settings and how they stand to benefit from advanced interaction concepts.
Regarding the second question, it shows how spatial interaction in particular can help to explore data in mixed reality. There, it provides a look into spatial device interaction in comparison to touch input, the use of additional mobile devices as input controllers, and the potential of transparent interaction panels.
Finally, to address the third question, this thesis presents research on how user interaction in immersive mixed-reality environments can be analyzed directly in the original, real-world locations, and how this can provide new insights. Overall, with this research, the thesis contributes interaction and visualization concepts, software prototypes, and findings from several user studies on how spatial interaction techniques can support the exploration of immersive mixed-reality visualizations.
Wolfgang Büschel
APB/2037, (+49) 351 / 463 38202
wolfgang.bueschelThis is a spam protection.tu-dresden.de
Quick Access
Defense
The successful defense of the PhD thesis took place on April 17, 2023.
Download
Spatial Interaction for Immersive Mixed-Reality Visualizations
@phdthesis{fixme,
author = {Wolfgang B\"{u}schel},
title = {Spatial Interaction for Immersive Mixed-Reality Visualizations},
year = {2023},
month = {4},
location = {Dresden},
url = {https://nbn-resolving.org/urn:nbn:de:bsz:14-qucosa2-857141},
publisher = {Qucosa - Technische Universit\"{a}t Dresden}
}Weitere Materialien
Research Projects
Spatial Interaction for 3D Data Visualization with Mobile Devices
In this study, spatial interaction and touch interaction for 3D visualizations on mobile devices were examined. It investigated task performance and user preferences for different basic tasks. Furthermore, this project also describes interaction patterns identified during the analysis of the camera trajectories recorded during the study.
@inproceedings{Bueschel2017_3DInfoVis,
author = {Wolfgang B\"{u}schel and Patrick Reipschl\"{a}ger and Ricardo Langner and Raimund Dachselt},
title = {Investigating the Use of Spatial Interaction for 3D Data Visualization on Mobile Devices},
booktitle = {Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces},
series = {ISS '17},
year = {2017},
month = {10},
isbn = {978-1-4503-4691-7},
location = {Brighton, United Kingdom},
pages = {62--71},
numpages = {10},
doi = {10.1145/3132272.3134125},
url = {https://doi.org/10.1145/3132272.3134125},
acmid = {3134125},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {3D Data Visualization, Immersive Visualization, Mobile Devices, Spatial Input, Tangible Displays}
}Weitere Materialien
Mobile-Assisted Exploration of 3D Data Spaces in AR
Building on the results of the previous project, this project is a study on the smartphone-assisted exploration of 3D data spaces in head-mounted augmented reality. Similar to the previous study, it compares interaction techniques with spatial components (i.e. moving a smartphone as a means of input) with more traditional on-phone touch input. However, this project concentrates on an AR setup using a head-mounted display. Furthermore, the project explicitly looks into combinations of touch and spatial interaction, also considering the degrees of spatiality, simultaneity, and guidance of the resulting compound techniques
@inproceedings{bueschel2019,
author = {Wolfgang B\"{u}schel and Annett Mitschick and Thomas Meyer and Raimund Dachselt},
title = {Investigating Smartphone-based Pan and Zoom in 3D Data Spaces in Augmented Reality},
booktitle = {Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services},
series = {MobileHCI ’19},
year = {2019},
month = {10},
isbn = {9781450368254},
location = {Taipei, Taiwan},
pages = {1--13},
numpages = {13},
doi = {10.1145/3338286.3340113},
url = {https://doi.org/10.1145/3338286.3340113},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {Augmented Reality, 3D Navigation, 3D Data Exploration, Pan \& Zoom, Interaction Techniques, Immersive Visualization}
}
AR Graph Visualizations
This project explores data encoding using the edges of 3D AR node-link diagrams. It highlights how immersive visualizations open up opportunities for specialized visualizations. The project shows how the special properties of stereoscopic presentation in AR and data exploration by physical navigation inform the design of 3D graphs. It compares several basic edge variants in a user study regarding task performance and subjective scores. While this project is mainly focused on the visuals, it also examined how users made use of the physical space during the study
@article{fixme,
author = {Wolfgang B\"{u}schel and Stefan Vogt and Raimund Dachselt},
title = {Augmented Reality Graph Visualizations: Investigation of Visual Styles in 3D Node-Link Diagrams},
journal = {IEEE Computer Graphics and Applications},
volume = {39},
number = {3},
year = {2019},
month = {2},
isbn = {0272-1716},
pages = {29--40},
numpages = {12},
doi = {10.1109/MCG.2019.2897927},
url = {https://doi.org/10.1109/MCG.2019.2897927},
publisher = {IEEE}
}
Transparent Tablets for Head-Mounted AR
This project examines the use of transparent, spatially tracked tablets as tangible controllers for head-mounted AR. This effectively brings the concept of a tangible magic lens for immersive environments to HMD-based AR. This research also draws from previous projects already examined additional mobile devices in AR for 3D data space exploration. This project resulted in the open research platform CleAR Sight for transparent tablet input in AR. It presents interaction and visualization concepts based on three use case applications, and describes expert feedback, which was collected through hands-on sessions.
@inproceedings{fixme,
author = {Katja Krug and Wolfgang B\"{u}schel and Konstantin Klamka and Raimund Dachselt},
title = {CleAR Sight: Exploring the Potential of Interacting with Transparent Tablets in Augmented Reality},
booktitle = {Proceedings of the 21st IEEE International Symposium on Mixed and Augmented Reality},
series = {ISMAR '22},
year = {2022},
month = {10},
isbn = {978-1-6654-5325-7/22},
location = {Singapore},
pages = {196--205},
doi = {10.1109/ISMAR55827.2022.00034},
publisher = {IEEE}
}Weitere Materialien
Mixed Reality Interaction Analysis
This project presents the concept and implementation of the MIRIA application and toolkit for the mixed-reality visualization and analysis of spatial interaction data from immersive and multi-display environments. This research shows how interaction data from such immersive systems can effectively be visualized in-situ, i.e., in the same real-world context from which the data originates. This context can inform the information needs of the users, and incorporating it into the analysis process may often prove beneficial. This project is in part based on earlier experiences with the analysis of study data from previous projects.
@inproceedings{fixme,
author = {Wolfgang B\"{u}schel and Anke Lehmann and Raimund Dachselt},
title = {MIRIA: A Mixed Reality Toolkit for the In-Situ Visualization and Analysis of Spatio-Temporal Interaction Data},
booktitle = {Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems},
series = {CHI '21},
year = {2021},
month = {5},
isbn = {978-1-4503-8096-6/21/05},
location = {Yokohama, Japan},
numpages = {15},
doi = {10.1145/3411764.3445651},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {interaction analysis, immersive analytics, in-situ analysis, in-situ visualization, augmented reality, human-computer interaction, visualization}
}Weitere Materialien
Further Publications
In addition to the main research projects of the PhD thesis, a variety of further publications, workshops contributions and accompanying demonstrations were published:
@inproceedings{fixme,
author = {Wolfgang B\"{u}schel and Katja Krug and Konstantin Klamka and Raimund Dachselt},
title = {Demonstrating CleAR Sight: Transparent Interaction Panels for Augmented Reality},
booktitle = {Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems},
year = {2023},
month = {2},
isbn = {978-1-4503-9422-2/23/04},
location = {Hamburg, Germany},
pages = {1--5},
numpages = {5},
doi = {10.1145/3544549.3583891},
publisher = {ACM}
}@inproceedings{langner:2021:marvis,
author = {Ricardo Langner and Marc Satkowski and Wolfgang B\"{u}schel and Raimund Dachselt},
title = {MARVIS: Combining Mobile Devices and Augmented Reality for Visual Data Analysis},
booktitle = {Proceedings of the 2021 ACM Conference on Human Factors in Computing Systems},
year = {2021},
month = {5},
isbn = {978-1-4503-8096-6/21/05},
location = {Yokohama, Japan},
numpages = {17},
doi = {10.1145/3411764.3445593},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {data visualization, mobile devices, head-mounted augmented reality, cross-device interaction, data analysis, mobile data visualization, augmented displays, immersive analytics}
}Weitere Materialien
@inproceedings{fixme,
author = {Barrett Ens and Benjamin Bach and Maxime Cordeil and Ulrich Engelke and Marcos Serrano and Wesley Willett and Arnaud Prouzeau and Christoph Anthes and Wolfgang B\"{u}schel and Cody Dunne and Tim Dwyer and Jens Grubert and Jason H. Haga and Nurit Kirshenbaum and Dylan Kobayashi and Tica Lin and Monsurat Olaosebikan and Fabian Pointecker and David Saffo and Nazmus Saquib and Dieter Schmalstieg and Danielle Albers Szafir and Matthew Whitlock and Yalong Yang},
title = {Grand Challenges in Immersive Analytics},
booktitle = {Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems},
series = {CHI '21},
year = {2021},
month = {05},
isbn = {978-1-4503-8096-6/21/05},
location = {Yokohama, Japan},
numpages = {17},
doi = {10.1145/3411764.3446866},
publisher = {ACM},
address = {New York, NY, USA}
}Weitere Materialien
@inproceedings{fixme,
author = {Wolfgang B\"{u}schel and Georg Eckert and Raimund Dachselt},
title = {Challenges in Collaborative Immersive Visualization},
booktitle = {CHI 2020 Workshop on Immersive Analytics: Envisioning Future Productivity for Immersive Analytics},
series = {CHI '20},
year = {2020},
month = {4},
location = {Honolulu, Hawaii, USA},
pages = {1--6},
numpages = {6}
}Weitere Materialien
@inbook{fixme,
author = {Wolfgang B\"{u}schel and Jian Chen and Raimund Dachselt and Steven Drucker and Tim Dwyer and Carsten G\"{o}rg and Tobias Isenberg and Andreas Kerren and Chris North and Wolfgang Stuerzlinger},
editor = {Kim Marriott and Falk Schreiber and Tim Dwyer and Karsten Klein and Nathalie Henry Riche and Takayuki Itoh and Wolfgang Stuerzlinger and Bruce H. Thomas},
title = {Interaction for Immersive Analytics},
booktitle = {Immersive Analytics},
series = {Lecture Notes in Computer Science},
volume = {11190},
year = {2018},
month = {10},
isbn = {978-3-030-01388-2},
pages = {95--138},
doi = {10.1007/978-3-030-01388-2_4},
url = {https://doi.org/10.1007/978-3-030-01388-2_4},
publisher = {Springer International Publishing},
address = {Cham}
}Weitere Materialien
@inproceedings{Bueschel2018b,
author = {Wolfgang B\"{u}schel and Stefan Vogt and Raimund Dachselt},
title = {Investigating Link Attributes of Graph Visualizations in Mobile Augmented Reality},
booktitle = {CHI 2018 Workshop on Data Visualization on Mobile Devices},
series = {CHI '18},
year = {2018},
month = {4},
location = {Montreal, QC, Canada}
}Weitere Materialien
@inproceedings{fixme,
author = {Wolfgang B\"{u}schel and Patrick Reipschl\"{a}ger and Raimund Dachselt},
title = {Foldable3D: Interacting with 3D Content Using Dual-Display Devices},
booktitle = {Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces},
year = {2016},
month = {11},
isbn = {978-1-4503-4248-3},
location = {Niagara Falls, ON, Canada},
pages = {367--372},
numpages = {6},
doi = {10.1145/2992154.2996782},
url = {https://doi.org/10.1145/2992154.2996782},
acmid = {2996782},
publisher = {ACM},
address = {New York, NY, USA},
keywords = {3d interaction, augmented reality, dual-display device, head-coupled perspective, virtual reality}
}Weitere Materialien
@inproceedings{fixme,
author = {Wolfgang B\"{u}schel and Patrick Reipschl\"{a}ger and Raimund Dachselt},
title = {Improving 3D Visualizations: Exploring Spatial Interaction with Mobile Devices},
booktitle = {ISS 2016 Workshop Immersive Analytics: Exploring Future Interaction and Visualization Technologies for Data Analytics},
year = {2016},
month = {11},
location = {Niagara Falls, ON, Canada},
numpages = {7},
doi = {10.1145/3009939.3009949},
url = {http://dx.doi.org/10.1145/3009939.3009949},
publisher = {ACM},
keywords = {Spatial Interaction, 3D Visualization, Head-coupled Perspective, Information Visualization, Tangible Displays}
}Weitere Materialien
@article{fixme,
author = {Wolfgang B\"{u}schel and Ricardo Langner and Ulrich von Zadow and Tom Horak and Raimund Dachselt},
title = {Towards Cross-Surface Content Sharing Between Mobile Devices and Large Displays in the Wild},
booktitle = {CHI 2016 Workshop on Interacting with Multi-Device Ecologies "'in the Wild"'},
year = {2016},
month = {5},
location = {San Jose, CA, USA},
numpages = {5}
}Weitere Materialien
Related Student Theses
Untersuchung der Kantendarstellung in räumlichen Visualisierungen von 3D-Node-Link-Diagrammen
Stefan Vogt 9. Oktober 2017 bis 8. April 2018
Betreuung: Wolfgang Büschel, Raimund Dachselt
Räumliche Informationsvisualisierung in der realen und virtuellen Welt
Felix Thalmann 2. Mai 2016 bis 1. November 2016
Betreuung: Wolfgang Büschel, Raimund Dachselt
3D-Informationsvisualisierung mit mobilen Geräten: Nutzereingaben durch Kopf-gebundene Perspektive und räumliche Bewegung
Christian Porzig 20. Juli 2015 bis 17. Januar 2016
Betreuung: Raimund Dachselt, Patrick Reipschläger, Wolfgang Büschel, Ricardo Langner
Unterstützung von Augmented-Reality-Datenanalyse mittels 3D-registrierter Eingabe auf einer transparenten Oberfläche
Katja Krug 5. Februar 2021 bis 9. Juli 2021
Betreuung: Wolfgang Büschel, Raimund Dachselt
Unterstützung der In-situ-Analyse von Interaktionsdaten in Augmented-Reality-Umgebungen
Andreas Wilke 12. Oktober 2018 bis 15. März 2019
Betreuung: Wolfgang Büschel, Anke Lehmann, Raimund Dachselt
Verknüpfte Visualisierungen für die Datenanalyse in Mixed-Reality Multi-Display-Umgebungen
Georg Eckert 18. Mai 2018 bis 8. November 2018
Betreuung: Wolfgang Büschel, Raimund Dachselt
Tangible Views für Informationsvisualisierungen mit vertikalen Kontextdisplays
Lucas Recknagel 25. April 2016 bis 3. Oktober 2016
Betreuung: Ricardo Langner, Wolfgang Büschel, Raimund Dachselt
Schematische Visualisierung von Bewegungsdaten in der Mensch-Computer-Interaktion
Leon Georgi 5. Juni 2020 bis 22. Oktober 2020
Betreuung: Raimund Dachselt, Anke Lehmann, Wolfgang Büschel
Erweiterte Visualisierungskonzepte zur Ergänzung eines Augmented-Reality-Analyse-Frameworks
Yanchen Zhao 19. Juli 2019 bis 4. Oktober 2019
Betreuung: Wolfgang Büschel, Raimund Dachselt
Verbesserung eines Analyse- und Visualisierungsframeworks durch zentrale Datenhaltung und -vorverarbeitung
Florian Skamrahl 5. Juli 2019 bis 20. September 2019
Betreuung: Wolfgang Büschel, Anke Lehmann, Raimund Dachselt
Mobilgeräte zur Unterstützung der Exploration multivariater Daten in Augmented Reality
Peter Egermann 11. Januar 2019 bis 29. März 2019
Betreuung: Wolfgang Büschel, Raimund Dachselt
Konzepte zur Unterstützung kollaborativer Datenanalyse in Augmented Reality
David Köhler 11. Januar 2019 bis 29. März 2019
Betreuung: Wolfgang Büschel, Raimund Dachselt
Untersuchung von Verknüpfungen zwischen Visualisierungen in Augmented Reality
Phillip Cosel 20. Juli 2018 bis 5. Oktober 2018
Betreuung: Wolfgang Büschel, Raimund Dachselt
Mobile 3D-Netzwerkvisualisierung in Augmented-Reality-Umgebungen
Sinthujan Thanabalasingam 21. November 2016 bis 5. Februar 2017
Betreuung: Wolfgang Büschel, Raimund Dachselt
Verwendung von Ebenen-Werkzeugen zur Interaktion mit räumlicher 3D-Informationsvisualisierung
Philipp Roscher 15. Juli 2016 bis 6. Oktober 2016
Betreuung: Patrick Reipschläger, Wolfgang Büschel, Raimund Dachselt
Mobile Visualisierung von Netzwerkstrukturen in Augmented-Reality-Umgebungen
Georg Eckert 4. April 2016 bis 26. Juni 2016
Betreuung: Wolfgang Büschel, Raimund Dachselt
Untersuchung von 3D-Node-Link-Diagrammen zur Visualisierung von Virtual Private Networks
Stefan Vogt 13. Februar 2017 bis 12. Juni 2017
Betreuung: Wolfgang Büschel, Raimund Dachselt