How to provide automated feedback on the writing process? A participatory approach to design writing analytics tools

Rianne Conijn (Corresponding author), Roberto Martinez-maldonado, Simon Knight, Simon Buckingham Shum, Luuk van Waes, Menno Van Zaanen

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Current writing support tools tend to focus on assessing final or intermediate products, rather than the writing process. However, sensing technologies, such as keystroke logging, can enable provision of automated feedback during, and on aspects of, the writing process. Despite this potential, little is known about the critical indicators that can be used to effectively provide this feedback. This article proposes a participatory approach to identify the indicators of students’ writing processes that are meaningful for educational stakeholders and that can be considered in the design of future systems to provide automated, personalized feedback. This approach is illustrated through a qualitative research design that included five participatory sessions with five distinct groups of stakeholders: bachelor and postgraduate students, teachers, writing specialists, and professional development staff. Results illustrate the value of the proposed approach, showing that students were especially interested in lower-level behavioral indicators, while the other stakeholders focused on higher-order cognitive and pedagogical constructs. These findings lay the groundwork for future work in extracting these higher-level indicators from in-depth analysis of writing processes. In addition, differences in terminology and the levels at which the indicators were discussed, highlight the need for human-centered, participatory approaches to design and develop writing analytics tools.

Original languageEnglish
Pages (from-to)1-31
JournalComputer Assisted Language Learning
VolumeXX
Issue numberXX
DOIs
Publication statusE-pub ahead of print - 2020
Externally publishedYes

Keywords

  • Feedback
  • learning analytics
  • participatory consultation
  • writing process
  • writing tools

Fingerprint Dive into the research topics of 'How to provide automated feedback on the writing process? A participatory approach to design writing analytics tools'. Together they form a unique fingerprint.

Cite this