How to provide automated feedback on the writing process? A participatory approach to design writing analytics tools

Rianne Conijn (Corresponding author), Roberto Martinez-Maldonado, Simon Knight, Simon Buckingham Shum, Luuk Van Waes, Menno van Zaanen

Onderzoeksoutput: Bijdrage aan tijdschriftTijdschriftartikelAcademicpeer review

11 Citaten (Scopus)
22 Downloads (Pure)


Current writing support tools tend to focus on assessing final or intermediate products, rather than the writing process. However, sensing technologies, such as keystroke logging, can enable provision of automated feedback during, and on aspects of, the writing process. Despite this potential, little is known about the critical indicators that can be used to effectively provide this feedback. This article proposes a participatory approach to identify the indicators of students’ writing processes that are meaningful for educational stakeholders and that can be considered in the design of future systems to provide automated, personalized feedback. This approach is illustrated through a qualitative research design that included five participatory sessions with five distinct groups of stakeholders: bachelor and postgraduate students, teachers, writing specialists, and professional development staff. Results illustrate the value of the proposed approach, showing that students were especially interested in lower-level behavioral indicators, while the other stakeholders focused on higher-order cognitive and pedagogical constructs. These findings lay the groundwork for future work in extracting these higher-level indicators from in-depth analysis of writing processes. In addition, differences in terminology and the levels at which the indicators were discussed, highlight the need for human-centered, participatory approaches to design and develop writing analytics tools.

Originele taal-2Engels
Pagina's (van-tot)1838-1868
Aantal pagina's31
TijdschriftComputer Assisted Language Learning
Nummer van het tijdschrift8
Vroegere onlinedatum2020
StatusGepubliceerd - 10 nov. 2022
Extern gepubliceerdJa


Duik in de onderzoeksthema's van 'How to provide automated feedback on the writing process? A participatory approach to design writing analytics tools'. Samen vormen ze een unieke vingerafdruk.

Citeer dit