SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality

Leon Müller; Ken Pfeuffer; Jan Gugenheimer; Bastian Pfleging; Sarah Prange; Florian Alt

doi:10.1145/3411764.3445560

SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality

Leon Müller
, Ken Pfeuffer
, Jan Gugenheimer
, Bastian Pfleging
, Sarah Prange
, Florian Alt

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

24 Citations (Scopus)

213 Downloads (Pure)

Abstract

Spatial computing devices that blend virtual and real worlds have the potential to soon become ubiquitous. Yet, creating experiences for spatial computing is non-trivial and needs skills in programming and 3D content creation, rendering them inaccessible to a wider group of users. We present SpatialProto, an in-situ spatial prototyping system for lowering the barrier to engage in spatial prototyping. With a depth-sensing capable Mixed Reality headset, SpatialProto lets users record animated objects of the real-world environment (e.g. paper, clay, people or any other prop), extract only the relevant parts, and directly place and transform these recordings in their physical environment. We describe the design and implementation of SpatialProto, a user study evaluating the system's prototype with non-expert users (n=9), and demonstrate applications where multiple captures are fused for compelling Augmented Reality experiences.

Original language	English
Title of host publication	CHI '21
Subtitle of host publication	Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems
Place of Publication	New York
Publisher	Association for Computing Machinery, Inc.
Pages	13
ISBN (Electronic)	978-1-4503-8096-6
DOIs	https://doi.org/10.1145/3411764.3445560
Publication status	Published - 7 May 2021
Event	2021 CHI Conference on Human Factors in Computing Systems, CHI 2021 - Virtual, Online, Yokohama, Japan Duration: 8 May 2021 → 13 May 2021 https://chi2021.acm.org/

Conference

Conference	2021 CHI Conference on Human Factors in Computing Systems, CHI 2021
Abbreviated title	CHI 2021
Country/Territory	Japan
City	Yokohama
Period	8/05/21 → 13/05/21
Other	"Making Waves, Combining Strengths"
Internet address	https://chi2021.acm.org/

Keywords

Animation
Interaction
Mixed reality
Spatial prototyping

Access to Document

10.1145/3411764.3445560

Spatial Proto Author-Prepared VersionFinal author version , 11.6 MBLicence: Other
pdfFinal published version, 11.7 MBLicence: CC BY

Cite this

Müller, L., Pfeuffer, K., Gugenheimer, J., Pfleging, B., Prange, S., & Alt, F. (2021). SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality. In CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 13). Article 363 Association for Computing Machinery, Inc.. https://doi.org/10.1145/3411764.3445560

@inproceedings{649915b36ed44503a6dfd28e5df118c1,

title = "SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality",

abstract = "Spatial computing devices that blend virtual and real worlds have the potential to soon become ubiquitous. Yet, creating experiences for spatial computing is non-trivial and needs skills in programming and 3D content creation, rendering them inaccessible to a wider group of users. We present SpatialProto, an in-situ spatial prototyping system for lowering the barrier to engage in spatial prototyping. With a depth-sensing capable Mixed Reality headset, SpatialProto lets users record animated objects of the real-world environment (e.g. paper, clay, people or any other prop), extract only the relevant parts, and directly place and transform these recordings in their physical environment. We describe the design and implementation of SpatialProto, a user study evaluating the system's prototype with non-expert users (n=9), and demonstrate applications where multiple captures are fused for compelling Augmented Reality experiences.",

keywords = "Animation, Interaction, Mixed reality, Spatial prototyping",

author = "Leon M{\"u}ller and Ken Pfeuffer and Jan Gugenheimer and Bastian Pfleging and Sarah Prange and Florian Alt",

year = "2021",

month = may,

day = "7",

doi = "10.1145/3411764.3445560",

language = "English",

pages = "13",

booktitle = "CHI '21",

publisher = "Association for Computing Machinery, Inc.",

address = "United States",

note = "2021 CHI Conference on Human Factors in Computing Systems, CHI 2021, CHI 2021 ; Conference date: 08-05-2021 Through 13-05-2021",

url = "https://chi2021.acm.org/",

}

Müller, L, Pfeuffer, K, Gugenheimer, J, Pfleging, B, Prange, S & Alt, F 2021, SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality. in CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems., 363, Association for Computing Machinery, Inc., New York, pp. 13, 2021 CHI Conference on Human Factors in Computing Systems, CHI 2021, Yokohama, Japan, 8/05/21. https://doi.org/10.1145/3411764.3445560

SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality. / Müller, Leon; Pfeuffer, Ken; Gugenheimer, Jan et al.
CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. New York: Association for Computing Machinery, Inc., 2021. p. 13 363.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - SpatialProto

T2 - 2021 CHI Conference on Human Factors in Computing Systems, CHI 2021

AU - Müller, Leon

AU - Pfeuffer, Ken

AU - Gugenheimer, Jan

AU - Pfleging, Bastian

AU - Prange, Sarah

AU - Alt, Florian

PY - 2021/5/7

Y1 - 2021/5/7

N2 - Spatial computing devices that blend virtual and real worlds have the potential to soon become ubiquitous. Yet, creating experiences for spatial computing is non-trivial and needs skills in programming and 3D content creation, rendering them inaccessible to a wider group of users. We present SpatialProto, an in-situ spatial prototyping system for lowering the barrier to engage in spatial prototyping. With a depth-sensing capable Mixed Reality headset, SpatialProto lets users record animated objects of the real-world environment (e.g. paper, clay, people or any other prop), extract only the relevant parts, and directly place and transform these recordings in their physical environment. We describe the design and implementation of SpatialProto, a user study evaluating the system's prototype with non-expert users (n=9), and demonstrate applications where multiple captures are fused for compelling Augmented Reality experiences.

AB - Spatial computing devices that blend virtual and real worlds have the potential to soon become ubiquitous. Yet, creating experiences for spatial computing is non-trivial and needs skills in programming and 3D content creation, rendering them inaccessible to a wider group of users. We present SpatialProto, an in-situ spatial prototyping system for lowering the barrier to engage in spatial prototyping. With a depth-sensing capable Mixed Reality headset, SpatialProto lets users record animated objects of the real-world environment (e.g. paper, clay, people or any other prop), extract only the relevant parts, and directly place and transform these recordings in their physical environment. We describe the design and implementation of SpatialProto, a user study evaluating the system's prototype with non-expert users (n=9), and demonstrate applications where multiple captures are fused for compelling Augmented Reality experiences.

KW - Animation

KW - Interaction

KW - Mixed reality

KW - Spatial prototyping

UR - https://www.scopus.com/pages/publications/85106715093

U2 - 10.1145/3411764.3445560

DO - 10.1145/3411764.3445560

M3 - Conference contribution

SP - 13

BT - CHI '21

PB - Association for Computing Machinery, Inc.

CY - New York

Y2 - 8 May 2021 through 13 May 2021

ER -

SpatialProto: Exploring Real-World Motion Captures for Rapid Prototyping of Interactive Mixed Reality

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this