youtouch-teaser

We present YouTouch!, a system that tracks users in front of an interactive display wall and associates touches with users. With their large size, display walls are inherently suitable for multi-user interaction. However, current touch recognition technology does not distinguish between users, making it hard to provide personalized user interfaces or access to private data. In our system we place a commodity RGB + depth camera in front of the wall, allowing us to track users and correlate them with touch events. While the camera’s driver is able to track people, it loses the user’s ID whenever she is occluded or leaves the scene. In these cases, we re-identify the person by means of a descriptor comprised of color histograms of body parts and skeleton-based biometric measurements. Additional processing reliably handles short-term occlusion as well as assignment of touches to occluded users. YouTouch! requires no user instrumentation nor custom hardware, and there is no registration nor learning phase. Our system was thoroughly tested with data sets comprising 81 people, demonstrating its ability to re-identify users and correlate them to touches even under adverse conditions.

Full video of YouTouch!

Veröffentlichungen

  • YouTouch! - Low-Cost User Identification at an Interactive Display Wall

    YouTouch! - Low-Cost User Identification at an Interactive Display Wall.

    von Zadow, U.; Reipschläger, P.; Bösel, D.; Sellent, A.; Dachselt, R.;

    In Proceedings of the 14th International Working Conference on Advanced Visual Interfaces 2016.AVI '16, Bari, Italy.ACM,2016.

    @inproceedings{Zadow2016_YouTouch,
       author = {Ulrich von Zadow and Patrick Reipschl\"{a}ger and Daniel B\"{o}sel and Anita Sellent and Raimund Dachselt},
       title = {YouTouch! - Low-Cost User Identification at an Interactive Display Wall},
       booktitle = {Proceedings of the 14th International Working Conference on Advanced Visual Interfaces 2016},
       year = {2016},
       month = {6},
       location = {Bari, Italy},
       numpages = {8},
       publisher = {ACM},
       address = {New York, NY, USA},
       keywords = {Display wall, multitouch, RGBD sensor, user identification, multi- user interaction, re-identification, interactive surface}
    }

    Weitere Materialien

    Video

Zugehörige Abschlussarbeiten

Im Rahmen von YouTouch! sind folgende studentische Arbeiten am Interactive Media Lab entstanden:

  • Daniel Bösel

    Bildbasierte Nutzeridentifizierung an einer interaktiven Displaywand mittels künstlicher neuronaler Netzwerke

    Daniel Bösel 1. April 2016 bis 9. September 2016

    Betreuung: Raimund Dachselt, Ulrich von Zadow

  • Daniel Bösel

    Robuste Zuordnung von Interaktionen an einer Displaywand zu Benutzern mittels Tiefenkamera

    Daniel Bösel 15. August 2014 bis 6. November 2014

    Betreuung: Raimund Dachselt, Ulrich von Zadow