User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality

Daniel Harris; Dominic Potts; Steven Houben

doi:10.1145/3528575.3551443

User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality

Daniel Harris
, Dominic Potts
, Steven Houben

EAISI Health

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

1 Citation (Scopus)

89 Downloads (Pure)

Abstract

Recent advancements in mobile and AR technology can facilitate powerful and practical solutions for six degrees of freedom (6DOF) manipulation of 3D objects on mobile devices. However, existing 6DOF manipulation research typically focuses on surface gestures, relying on widgets for modal interaction to segment manipulations and degrees of freedom at the cost of efficiency and intuitiveness. In this paper, we explore a combination of surface and motion gestures to present an implicit modal interaction method for 6DOF manipulation of 3D objects in Mobile Augmented Reality (MAR). We conducted a guessability study that focused on key object manipulations, resulting in a set of user-defined motion and surface gestures. Our results indicate that user-defined gestures both have reasonable degrees of agreement whilst also being easy to use. Additionally, we present a prototype system that makes use of a consensus set of gestures that leverage user mobility for manipulating virtual objects in MAR.

Original language	English
Title of host publication	MobileHCI '22
Subtitle of host publication	Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services
Editors	Pourang P. Irani, Xiaojuan Ma, Jason Alexander, Bing-Yu Chen, Petra Isenberg
Publisher	Association for Computing Machinery, Inc.
Number of pages	6
ISBN (Electronic)	978-1-4503-9341-6
DOIs	https://doi.org/10.1145/3528575.3551443
Publication status	Published - 28 Sept 2022
Event	24th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2022 - Vancouver, Canada Duration: 28 Sept 2022 → 1 Oct 2022 Conference number: 22 https://mobilehci.acm.org/2022/

Conference

Conference	24th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2022
Abbreviated title	MobileHCI 2022
Country/Territory	Canada
City	Vancouver
Period	28/09/22 → 1/10/22
Internet address	https://mobilehci.acm.org/2022/

Access to Document

10.1145/3528575.3551443

pdfFinal published version, 10.8 MBLicence: TAVERNE
ARElicitation-MobileHCI'22

Cite this

Harris, D., Potts, D., & Houben, S. (2022). User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality. In P. P. Irani, X. Ma, J. Alexander, B.-Y. Chen, & P. Isenberg (Eds.), MobileHCI '22: Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services Association for Computing Machinery, Inc.. https://doi.org/10.1145/3528575.3551443

Harris, Daniel ; Potts, Dominic ; Houben, Steven. / User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality. MobileHCI '22: Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services. editor / Pourang P. Irani ; Xiaojuan Ma ; Jason Alexander ; Bing-Yu Chen ; Petra Isenberg. Association for Computing Machinery, Inc., 2022.

@inproceedings{335884e9ccc44a408f1cad28d2ba2783,

title = "User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality",

abstract = "Recent advancements in mobile and AR technology can facilitate powerful and practical solutions for six degrees of freedom (6DOF) manipulation of 3D objects on mobile devices. However, existing 6DOF manipulation research typically focuses on surface gestures, relying on widgets for modal interaction to segment manipulations and degrees of freedom at the cost of efficiency and intuitiveness. In this paper, we explore a combination of surface and motion gestures to present an implicit modal interaction method for 6DOF manipulation of 3D objects in Mobile Augmented Reality (MAR). We conducted a guessability study that focused on key object manipulations, resulting in a set of user-defined motion and surface gestures. Our results indicate that user-defined gestures both have reasonable degrees of agreement whilst also being easy to use. Additionally, we present a prototype system that makes use of a consensus set of gestures that leverage user mobility for manipulating virtual objects in MAR.",

author = "Daniel Harris and Dominic Potts and Steven Houben",

year = "2022",

month = sep,

day = "28",

doi = "10.1145/3528575.3551443",

language = "English",

editor = "Irani, \{Pourang P.\} and Xiaojuan Ma and Jason Alexander and Bing-Yu Chen and Petra Isenberg",

booktitle = "MobileHCI '22",

publisher = "Association for Computing Machinery, Inc.",

address = "United States",

note = "24th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2022, MobileHCI 2022 ; Conference date: 28-09-2022 Through 01-10-2022",

url = "https://mobilehci.acm.org/2022/",

}

Harris, D, Potts, D & Houben, S 2022, User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality. in PP Irani, X Ma, J Alexander, B-Y Chen & P Isenberg (eds), MobileHCI '22: Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services. Association for Computing Machinery, Inc., 24th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2022, Vancouver, Canada, 28/09/22. https://doi.org/10.1145/3528575.3551443

User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality. / Harris, Daniel; Potts, Dominic; Houben, Steven.
MobileHCI '22: Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services. ed. / Pourang P. Irani; Xiaojuan Ma; Jason Alexander; Bing-Yu Chen; Petra Isenberg. Association for Computing Machinery, Inc., 2022.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality

AU - Harris, Daniel

AU - Potts, Dominic

AU - Houben, Steven

N1 - Conference code: 22

PY - 2022/9/28

Y1 - 2022/9/28

N2 - Recent advancements in mobile and AR technology can facilitate powerful and practical solutions for six degrees of freedom (6DOF) manipulation of 3D objects on mobile devices. However, existing 6DOF manipulation research typically focuses on surface gestures, relying on widgets for modal interaction to segment manipulations and degrees of freedom at the cost of efficiency and intuitiveness. In this paper, we explore a combination of surface and motion gestures to present an implicit modal interaction method for 6DOF manipulation of 3D objects in Mobile Augmented Reality (MAR). We conducted a guessability study that focused on key object manipulations, resulting in a set of user-defined motion and surface gestures. Our results indicate that user-defined gestures both have reasonable degrees of agreement whilst also being easy to use. Additionally, we present a prototype system that makes use of a consensus set of gestures that leverage user mobility for manipulating virtual objects in MAR.

AB - Recent advancements in mobile and AR technology can facilitate powerful and practical solutions for six degrees of freedom (6DOF) manipulation of 3D objects on mobile devices. However, existing 6DOF manipulation research typically focuses on surface gestures, relying on widgets for modal interaction to segment manipulations and degrees of freedom at the cost of efficiency and intuitiveness. In this paper, we explore a combination of surface and motion gestures to present an implicit modal interaction method for 6DOF manipulation of 3D objects in Mobile Augmented Reality (MAR). We conducted a guessability study that focused on key object manipulations, resulting in a set of user-defined motion and surface gestures. Our results indicate that user-defined gestures both have reasonable degrees of agreement whilst also being easy to use. Additionally, we present a prototype system that makes use of a consensus set of gestures that leverage user mobility for manipulating virtual objects in MAR.

U2 - 10.1145/3528575.3551443

DO - 10.1145/3528575.3551443

M3 - Conference contribution

BT - MobileHCI '22

A2 - Irani, Pourang P.

A2 - Ma, Xiaojuan

A2 - Alexander, Jason

A2 - Chen, Bing-Yu

A2 - Isenberg, Petra

PB - Association for Computing Machinery, Inc.

T2 - 24th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2022

Y2 - 28 September 2022 through 1 October 2022

ER -

Harris D, Potts D, Houben S. User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality. In Irani PP, Ma X, Alexander J, Chen BY, Isenberg P, editors, MobileHCI '22: Adjunct Publication of the 24th International Conference on Human-Computer Interaction with Mobile Devices and Services. Association for Computing Machinery, Inc. 2022 doi: 10.1145/3528575.3551443

User-Elicited Surface and Motion Gestures for Object Manipulation in Mobile Augmented Reality

Abstract

Conference

Access to Document

Fingerprint

Cite this