Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research

Kathrin Gerling; Max V. Birk

doi:10.1145/3505270.3558360

Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research

Kathrin Gerling, Max V. Birk

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

6 Citations (Scopus)

Abstract

Games research routinely employs custom-designed artifacts as research tools, but there is no standard for their description. To improve rigor and reproducibility of experimental games research within the CHI PLAY community, this piece of work argues for the development of a community standard for the description of games that are used as research tools, allowing authors to describe their interventions in a structured way, and making it easier for all of us to understand and reproduce each other's work.

Original language	English
Title of host publication	CHI PLAY 2022 - Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play
Publisher	Association for Computing Machinery, Inc
Pages	266-267
Number of pages	2
ISBN (Electronic)	9781450392112
DOIs	https://doi.org/10.1145/3505270.3558360
Publication status	Published - 2 Nov 2022
Event	9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022 - Bremen, Germany Duration: 2 Nov 2022 → 5 Nov 2022 https://chiplay.acm.org/2022/

Conference

Conference	9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022
Country/Territory	Germany
City	Bremen
Period	2/11/22 → 5/11/22
Internet address	https://chiplay.acm.org/2022/

Bibliographical note

Publisher Copyright:
© 2022 Owner/Author.

Keywords

Experimental Games Research
Game Descriptions
Reproducibility

Access to Document

10.1145/3505270.3558360

Cite this

Gerling, K., & Birk, M. V. (2022). Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. In CHI PLAY 2022 - Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play (pp. 266-267). Association for Computing Machinery, Inc. https://doi.org/10.1145/3505270.3558360

@inproceedings{780ab10538a6409a8e61bd059ec7ef5b,

title = "Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research",

abstract = "Games research routinely employs custom-designed artifacts as research tools, but there is no standard for their description. To improve rigor and reproducibility of experimental games research within the CHI PLAY community, this piece of work argues for the development of a community standard for the description of games that are used as research tools, allowing authors to describe their interventions in a structured way, and making it easier for all of us to understand and reproduce each other's work.",

keywords = "Experimental Games Research, Game Descriptions, Reproducibility",

author = "Kathrin Gerling and Birk, {Max V.}",

note = "Publisher Copyright: {\textcopyright} 2022 Owner/Author.; 9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022 ; Conference date: 02-11-2022 Through 05-11-2022",

year = "2022",

month = nov,

day = "2",

doi = "10.1145/3505270.3558360",

language = "English",

pages = "266--267",

booktitle = "CHI PLAY 2022 - Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play",

publisher = "Association for Computing Machinery, Inc",

address = "United States",

url = "https://chiplay.acm.org/2022/",

}

Gerling, K & Birk, MV 2022, Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. in CHI PLAY 2022 - Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery, Inc, pp. 266-267, 9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022, Bremen, Germany, 2/11/22. https://doi.org/10.1145/3505270.3558360

Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research. / Gerling, Kathrin; Birk, Max V.
CHI PLAY 2022 - Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play. Association for Computing Machinery, Inc, 2022. p. 266-267.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › Academic › peer-review

TY - GEN

T1 - Reflections on Rigor and Reproducibility

T2 - 9th ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play, CHI PLAY 2022

AU - Gerling, Kathrin

AU - Birk, Max V.

PY - 2022/11/2

Y1 - 2022/11/2

N2 - Games research routinely employs custom-designed artifacts as research tools, but there is no standard for their description. To improve rigor and reproducibility of experimental games research within the CHI PLAY community, this piece of work argues for the development of a community standard for the description of games that are used as research tools, allowing authors to describe their interventions in a structured way, and making it easier for all of us to understand and reproduce each other's work.

AB - Games research routinely employs custom-designed artifacts as research tools, but there is no standard for their description. To improve rigor and reproducibility of experimental games research within the CHI PLAY community, this piece of work argues for the development of a community standard for the description of games that are used as research tools, allowing authors to describe their interventions in a structured way, and making it easier for all of us to understand and reproduce each other's work.

KW - Experimental Games Research

KW - Game Descriptions

KW - Reproducibility

UR - http://www.scopus.com/inward/record.url?scp=85143119414&partnerID=8YFLogxK

U2 - 10.1145/3505270.3558360

DO - 10.1145/3505270.3558360

M3 - Conference contribution

AN - SCOPUS:85143119414

SP - 266

EP - 267

BT - CHI PLAY 2022 - Extended Abstracts of the 2022 Annual Symposium on Computer-Human Interaction in Play

PB - Association for Computing Machinery, Inc

Y2 - 2 November 2022 through 5 November 2022

ER -

Reflections on Rigor and Reproducibility: Moving Toward a Community Standard for the Description of Artifacts in Experimental Games Research

Abstract

Conference

Bibliographical note

Keywords

Access to Document

Other files and links

Fingerprint

Cite this