Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research

Kathrin Gerling; Max V. Birk

doi:10.1145/3505270.3558360

Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research

Kathrin Gerling
, Max V. Birk

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

8 Citations (Scopus)

24 Downloads (Pure)

Abstract

Games research routinely employs custom-designed artifacts as research tools, but there is no standard for their description. To improve rigor and reproducibility of experimental games research within the CHI PLAY community, this piece of work argues for the development of a community standard for the description of games that are used as research tools, allowing authors to describe their interventions in a structured way, and making it easier for all of us to understand and reproduce each other's work.

Original language	English
Title of host publication	CHI PLAY '22:
Subtitle of host publication	Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play
Editors	Katrin Gerling, Jo Jacovides, Rainer Malaka, Beth Bonsignore, Julian Frommel
Publisher	Association for Computing Machinery, Inc.
Pages	266-267
Number of pages	2
ISBN (Electronic)	978-1-4503-9211-2
DOIs	https://doi.org/10.1145/3505270.3558360
Publication status	Published - 7 Nov 2022
Event	9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022 - Bremen, Germany Duration: 2 Nov 2022 → 5 Nov 2022 https://chiplay.acm.org/2022/

Conference

Conference	9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022
Country/Territory	Germany
City	Bremen
Period	2/11/22 → 5/11/22
Internet address	https://chiplay.acm.org/2022/

Keywords

Experimental Games Research
Game Descriptions
Reproducibility

Access to Document

10.1145/3505270.3558360

pdfFinal published version, 412 KBLicence: TAVERNE

Cite this

Gerling, K., & Birk, M. V. (2022). Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. In K. Gerling, J. Jacovides, R. Malaka, B. Bonsignore, & J. Frommel (Eds.), CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (pp. 266-267). Association for Computing Machinery, Inc.. https://doi.org/10.1145/3505270.3558360

Gerling, Kathrin ; Birk, Max V. / Reflections on Rigor and Reproducibility : Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play. editor / Katrin Gerling ; Jo Jacovides ; Rainer Malaka ; Beth Bonsignore ; Julian Frommel. Association for Computing Machinery, Inc., 2022. pp. 266-267

@inproceedings{780ab10538a6409a8e61bd059ec7ef5b,

title = "Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research",

abstract = "Games research routinely employs custom-designed artifacts as research tools, but there is no standard for their description. To improve rigor and reproducibility of experimental games research within the CHI PLAY community, this piece of work argues for the development of a community standard for the description of games that are used as research tools, allowing authors to describe their interventions in a structured way, and making it easier for all of us to understand and reproduce each other's work.",

keywords = "Experimental Games Research, Game Descriptions, Reproducibility",

author = "Kathrin Gerling and Birk, \{Max V.\}",

year = "2022",

month = nov,

day = "7",

doi = "10.1145/3505270.3558360",

language = "English",

pages = "266--267",

editor = "Katrin Gerling and Jo Jacovides and Rainer Malaka and Beth Bonsignore and Julian Frommel",

booktitle = "CHI PLAY '22:",

publisher = "Association for Computing Machinery, Inc.",

address = "United States",

note = "9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022 ; Conference date: 02-11-2022 Through 05-11-2022",

url = "https://chiplay.acm.org/2022/",

}

Gerling, K & Birk, MV 2022, Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. in K Gerling, J Jacovides, R Malaka, B Bonsignore & J Frommel (eds), CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery, Inc., pp. 266-267, 9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022, Bremen, Germany, 2/11/22. https://doi.org/10.1145/3505270.3558360

Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. / Gerling, Kathrin; Birk, Max V.
CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play. ed. / Katrin Gerling; Jo Jacovides; Rainer Malaka; Beth Bonsignore; Julian Frommel. Association for Computing Machinery, Inc., 2022. p. 266-267.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Reflections on Rigor and Reproducibility

T2 - 9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022

AU - Gerling, Kathrin

AU - Birk, Max V.

PY - 2022/11/7

Y1 - 2022/11/7

N2 - Games research routinely employs custom-designed artifacts as research tools, but there is no standard for their description. To improve rigor and reproducibility of experimental games research within the CHI PLAY community, this piece of work argues for the development of a community standard for the description of games that are used as research tools, allowing authors to describe their interventions in a structured way, and making it easier for all of us to understand and reproduce each other's work.

AB - Games research routinely employs custom-designed artifacts as research tools, but there is no standard for their description. To improve rigor and reproducibility of experimental games research within the CHI PLAY community, this piece of work argues for the development of a community standard for the description of games that are used as research tools, allowing authors to describe their interventions in a structured way, and making it easier for all of us to understand and reproduce each other's work.

KW - Experimental Games Research

KW - Game Descriptions

KW - Reproducibility

UR - https://www.scopus.com/pages/publications/85143119414

U2 - 10.1145/3505270.3558360

DO - 10.1145/3505270.3558360

M3 - Conference contribution

AN - SCOPUS:85143119414

SP - 266

EP - 267

BT - CHI PLAY '22:

A2 - Gerling, Katrin

A2 - Jacovides, Jo

A2 - Malaka, Rainer

A2 - Bonsignore, Beth

A2 - Frommel, Julian

PB - Association for Computing Machinery, Inc.

Y2 - 2 November 2022 through 5 November 2022

ER -

Gerling K, Birk MV. Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. In Gerling K, Jacovides J, Malaka R, Bonsignore B, Frommel J, editors, CHI PLAY '22: Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery, Inc. 2022. p. 266-267 doi: 10.1145/3505270.3558360

Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research

Abstract

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this