An in-the-wild study of learning mid-air gestures to browse hierarchical information at a large interactive public display

Christopher James Ackad, Andrew Clayphan, Martin Tomitsch, Judy Kay: An in-the-wild study of learning mid-air gestures to browse hierarchical information at a large interactive public display. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2015, Osaka, Japan, September 7-11, 2015, pp. 1227–1238, 2015.

Abstract

This paper describes the design and evaluation of our Media Ribbon, a large public interactive display for browsing hierarchical information, with mid-air gestures. Browsing a hierarchical information space is a fundamental form of interaction. Designing learnable mid-air gestures is a current challenge for large display interaction. Our in-the-wild evaluation draws on 41 days of quantitative log data, with 4484 gestures detected, and qualitative data from 15 interviews, and associated video. We explored: whether our design enabled people to learn the gestures; how our tutorial and feedback mechanisms supported learning; and the effectiveness of support for browsing hierarchical information. Our contributions are: (1) design of large public display for browsing of hierarchical information; (2) with its gesture set; (3) insights into the ways people learn and use this interface in our context; and (4) guidelines for designing learnable mid-air gestures.

BibTeX (Download)

@inproceedings{Ackad2015an36,
title = {An in-the-wild study of learning mid-air gestures to browse hierarchical  information at a large interactive public display},
author = {Christopher James Ackad and Andrew Clayphan and Martin Tomitsch and Judy Kay},
url = {http://doi.acm.org/10.1145/2750858.2807532},
doi = {10.1145/2750858.2807532},
year  = {2015},
date = {2015-01-01},
booktitle = {Proceedings of the 2015 ACM International Joint Conference on Pervasive and 
 Ubiquitous Computing, UbiComp 2015, Osaka, Japan, September 7-11, 2015},
pages = {1227--1238},
abstract = {This paper describes the design and evaluation of our Media Ribbon, a large public interactive display for browsing hierarchical information, with mid-air gestures. Browsing a hierarchical information space is a fundamental form of interaction. Designing learnable mid-air gestures is a current challenge for large display interaction. Our in-the-wild evaluation draws on 41 days of quantitative log data, with 4484 gestures detected, and qualitative data from 15 interviews, and associated video. We explored: whether our design enabled people to learn the gestures; how our tutorial and feedback mechanisms supported learning; and the effectiveness of support for browsing hierarchical information. Our contributions are: (1) design of large public display for browsing of hierarchical information; (2) with its gesture set; (3) insights into the ways people learn and use this interface in our context; and (4) guidelines for designing learnable mid-air gestures.},
keywords = {gestural interaction, interactive public information displays, pervasive computing, project:Mediawall, user centred design},
pubstate = {published},
tppubtype = {inproceedings}
}