Community heuristics for user interface evaluation of crowdsourcing platforms

Simon à Campo (Corresponding author), Vasssilis Javed Khan, Konstantinos Papangelis, Panos Markopoulos

Research output: Contribution to journalArticleAcademicpeer-review

1 Citation (Scopus)

Abstract

Crowdsourcing is growing rapidly in both industry and academia, introducing new ways of conducting work and improving our understanding of how to utilize the potential of crowds. Related research has emphasized on how to improve crowdsourcing platforms and related practices to foster collaboration, motivation, trust, quality and creativity. However, these challenges do not seem to be as apparent in vibrant online communities. Research in how to make online communities work provides insights into how to address the challenges crowdsourcing is facing right now. For this work, we have gathered from literature relevant design guidelines (heuristics) for online communities and have applied them to 20 crowdsourcing platforms to evaluate how those platforms conform to the heuristics. The heuristics can be used as a tool for designers of crowdsourcing platforms, to evaluate how to improve these platforms and to compare them to their competition. Finally, our paper highlights the current challenges crowdsourcing platforms face to acquire positive aspects of online communities.

LanguageEnglish
Pages775-789
JournalFuture Generation Computer Systems
Volume95
DOIs
StatePublished - 2019

Fingerprint

User interfaces
Industry

Keywords

  • Crowdsourcing
  • Design methods
  • Online community analysis and support

Cite this

@article{9c8db662789e45c8b029635cabf5e400,
title = "Community heuristics for user interface evaluation of crowdsourcing platforms",
abstract = "Crowdsourcing is growing rapidly in both industry and academia, introducing new ways of conducting work and improving our understanding of how to utilize the potential of crowds. Related research has emphasized on how to improve crowdsourcing platforms and related practices to foster collaboration, motivation, trust, quality and creativity. However, these challenges do not seem to be as apparent in vibrant online communities. Research in how to make online communities work provides insights into how to address the challenges crowdsourcing is facing right now. For this work, we have gathered from literature relevant design guidelines (heuristics) for online communities and have applied them to 20 crowdsourcing platforms to evaluate how those platforms conform to the heuristics. The heuristics can be used as a tool for designers of crowdsourcing platforms, to evaluate how to improve these platforms and to compare them to their competition. Finally, our paper highlights the current challenges crowdsourcing platforms face to acquire positive aspects of online communities.",
keywords = "Crowdsourcing, Design methods, Online community analysis and support",
author = "{{\`a} Campo}, Simon and Khan, {Vasssilis Javed} and Konstantinos Papangelis and Panos Markopoulos",
year = "2019",
doi = "10.1016/j.future.2018.02.028",
language = "English",
volume = "95",
pages = "775--789",
journal = "Future Generation Computer Systems",
issn = "0167-739X",
publisher = "Elsevier",

}

Community heuristics for user interface evaluation of crowdsourcing platforms. / à Campo, Simon (Corresponding author); Khan, Vasssilis Javed; Papangelis, Konstantinos; Markopoulos, Panos.

In: Future Generation Computer Systems, Vol. 95, 2019, p. 775-789.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Community heuristics for user interface evaluation of crowdsourcing platforms

AU - à Campo,Simon

AU - Khan,Vasssilis Javed

AU - Papangelis,Konstantinos

AU - Markopoulos,Panos

PY - 2019

Y1 - 2019

N2 - Crowdsourcing is growing rapidly in both industry and academia, introducing new ways of conducting work and improving our understanding of how to utilize the potential of crowds. Related research has emphasized on how to improve crowdsourcing platforms and related practices to foster collaboration, motivation, trust, quality and creativity. However, these challenges do not seem to be as apparent in vibrant online communities. Research in how to make online communities work provides insights into how to address the challenges crowdsourcing is facing right now. For this work, we have gathered from literature relevant design guidelines (heuristics) for online communities and have applied them to 20 crowdsourcing platforms to evaluate how those platforms conform to the heuristics. The heuristics can be used as a tool for designers of crowdsourcing platforms, to evaluate how to improve these platforms and to compare them to their competition. Finally, our paper highlights the current challenges crowdsourcing platforms face to acquire positive aspects of online communities.

AB - Crowdsourcing is growing rapidly in both industry and academia, introducing new ways of conducting work and improving our understanding of how to utilize the potential of crowds. Related research has emphasized on how to improve crowdsourcing platforms and related practices to foster collaboration, motivation, trust, quality and creativity. However, these challenges do not seem to be as apparent in vibrant online communities. Research in how to make online communities work provides insights into how to address the challenges crowdsourcing is facing right now. For this work, we have gathered from literature relevant design guidelines (heuristics) for online communities and have applied them to 20 crowdsourcing platforms to evaluate how those platforms conform to the heuristics. The heuristics can be used as a tool for designers of crowdsourcing platforms, to evaluate how to improve these platforms and to compare them to their competition. Finally, our paper highlights the current challenges crowdsourcing platforms face to acquire positive aspects of online communities.

KW - Crowdsourcing

KW - Design methods

KW - Online community analysis and support

UR - http://www.scopus.com/inward/record.url?scp=85045314163&partnerID=8YFLogxK

U2 - 10.1016/j.future.2018.02.028

DO - 10.1016/j.future.2018.02.028

M3 - Article

VL - 95

SP - 775

EP - 789

JO - Future Generation Computer Systems

T2 - Future Generation Computer Systems

JF - Future Generation Computer Systems

SN - 0167-739X

ER -