Analysis of the features important for the effectiveness of physical activity–related apps for recreational sports: Expert panel approach

Joan Dallinga, Mark Janssen, Jet Van Der Werf, Ruben Walravens, Steven Vos, Marije Deutekom

Research output: Contribution to journalArticleAcademicpeer-review

Abstract

Background: A large number of people participate in individual or unorganized sports on a recreational level. Furthermore, many participants drop out because of injury or lowered motivation. Potentially, physical activity–related apps could motivate people during sport participation and help them to follow and maintain a healthy active lifestyle. It remains unclear what the quality of running, cycling, and walking apps is and how it can be assessed. Quality of these apps was defined as having a positive influence on participation in recreational sports. This information will show which features need to be assessed when rating physical activity–related app quality. Objective: The aim of this study was to identify expert perception on which features are important for the effectiveness of physical activity–related apps for participation in individual, recreational sports. Methods: Data were gathered via an expert panel approach using the nominal group technique. Two expert panels were organized to identify and rank app features relevant for sport participation. Experts were researchers or professionals in the field of industrial design and information technology (technology expert panel) and in the field of behavior change, health, and human movement sciences who had affinity with physical activity–related apps (health science expert panel). Of the 24 experts who were approached, 11 (46%) agreed to participate. Each panel session consisted of three consultation rounds. The 10 most important features per expert were collected. We calculated the frequency of the top 10 features and the mean importance score per feature (0-100). The sessions were taped and transcribed verbatim; a thematic analysis was conducted on the qualitative data. Results: In the technology expert panel, applied feedback and feedforward (91.3) and fun (91.3) were found most important (scale 0-100). Together with flexibility and look and feel, these features were mentioned most often (all n=4 [number of experts]; importance scores=41.3 and 43.8, respectively). The experts in the health science expert panels a and b found instructional feedback (95.0), motivating or challenging (95.0), peer rating and use (92.0), motivating feedback (91.3), and monitoring or statistics (91.0) most important. Most often ranked features were monitoring or statistics, motivating feedback, works good technically, tailoring starting point, fun, usability anticipating or context awareness, and privacy (all n=3-4 [number of experts]; importance scores=16.7-95.0). The qualitative analysis resulted in four overarching themes: (1) combination behavior change, technical, and design features needed; (2) extended feedback and tailoring is advised; (3) theoretical or evidence base as standard; and (4) entry requirements related to app use. Conclusions: The results show that a variety of features, including design, technical, and behavior change, are considered important for the effectiveness of physical activity–related apps by experts from different fields of expertise. These insights may assist in the development of an improved app rating scale.

LanguageEnglish
Article numbere143
Number of pages12
JournalJMIR Mhealth and Uhealth
Volume6
Issue number6
DOIs
StatePublished - 1 Jun 2018

Fingerprint

Sports
Technology
Health
Privacy
Running
Walking
Motivation
Referral and Consultation
Research Personnel
Wounds and Injuries

Keywords

  • Exercise
  • Features
  • Health behavior
  • Healthy lifestyle
  • Measures
  • MHealth
  • Mobile applications

Cite this

@article{6cbbc26113384c58bd120e557fb83ced,
title = "Analysis of the features important for the effectiveness of physical activity–related apps for recreational sports: Expert panel approach",
abstract = "Background: A large number of people participate in individual or unorganized sports on a recreational level. Furthermore, many participants drop out because of injury or lowered motivation. Potentially, physical activity–related apps could motivate people during sport participation and help them to follow and maintain a healthy active lifestyle. It remains unclear what the quality of running, cycling, and walking apps is and how it can be assessed. Quality of these apps was defined as having a positive influence on participation in recreational sports. This information will show which features need to be assessed when rating physical activity–related app quality. Objective: The aim of this study was to identify expert perception on which features are important for the effectiveness of physical activity–related apps for participation in individual, recreational sports. Methods: Data were gathered via an expert panel approach using the nominal group technique. Two expert panels were organized to identify and rank app features relevant for sport participation. Experts were researchers or professionals in the field of industrial design and information technology (technology expert panel) and in the field of behavior change, health, and human movement sciences who had affinity with physical activity–related apps (health science expert panel). Of the 24 experts who were approached, 11 (46{\%}) agreed to participate. Each panel session consisted of three consultation rounds. The 10 most important features per expert were collected. We calculated the frequency of the top 10 features and the mean importance score per feature (0-100). The sessions were taped and transcribed verbatim; a thematic analysis was conducted on the qualitative data. Results: In the technology expert panel, applied feedback and feedforward (91.3) and fun (91.3) were found most important (scale 0-100). Together with flexibility and look and feel, these features were mentioned most often (all n=4 [number of experts]; importance scores=41.3 and 43.8, respectively). The experts in the health science expert panels a and b found instructional feedback (95.0), motivating or challenging (95.0), peer rating and use (92.0), motivating feedback (91.3), and monitoring or statistics (91.0) most important. Most often ranked features were monitoring or statistics, motivating feedback, works good technically, tailoring starting point, fun, usability anticipating or context awareness, and privacy (all n=3-4 [number of experts]; importance scores=16.7-95.0). The qualitative analysis resulted in four overarching themes: (1) combination behavior change, technical, and design features needed; (2) extended feedback and tailoring is advised; (3) theoretical or evidence base as standard; and (4) entry requirements related to app use. Conclusions: The results show that a variety of features, including design, technical, and behavior change, are considered important for the effectiveness of physical activity–related apps by experts from different fields of expertise. These insights may assist in the development of an improved app rating scale.",
keywords = "Exercise, Features, Health behavior, Healthy lifestyle, Measures, MHealth, Mobile applications",
author = "Joan Dallinga and Mark Janssen and {Van Der Werf}, Jet and Ruben Walravens and Steven Vos and Marije Deutekom",
year = "2018",
month = "6",
day = "1",
doi = "10.2196/mhealth.9459",
language = "English",
volume = "6",
journal = "JMIR Mhealth and Uhealth",
issn = "2291-5222",
publisher = "JMIR Publications",
number = "6",

}

Analysis of the features important for the effectiveness of physical activity–related apps for recreational sports : Expert panel approach. / Dallinga, Joan; Janssen, Mark; Van Der Werf, Jet; Walravens, Ruben; Vos, Steven; Deutekom, Marije.

In: JMIR Mhealth and Uhealth, Vol. 6, No. 6, e143, 01.06.2018.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Analysis of the features important for the effectiveness of physical activity–related apps for recreational sports

T2 - JMIR Mhealth and Uhealth

AU - Dallinga,Joan

AU - Janssen,Mark

AU - Van Der Werf,Jet

AU - Walravens,Ruben

AU - Vos,Steven

AU - Deutekom,Marije

PY - 2018/6/1

Y1 - 2018/6/1

N2 - Background: A large number of people participate in individual or unorganized sports on a recreational level. Furthermore, many participants drop out because of injury or lowered motivation. Potentially, physical activity–related apps could motivate people during sport participation and help them to follow and maintain a healthy active lifestyle. It remains unclear what the quality of running, cycling, and walking apps is and how it can be assessed. Quality of these apps was defined as having a positive influence on participation in recreational sports. This information will show which features need to be assessed when rating physical activity–related app quality. Objective: The aim of this study was to identify expert perception on which features are important for the effectiveness of physical activity–related apps for participation in individual, recreational sports. Methods: Data were gathered via an expert panel approach using the nominal group technique. Two expert panels were organized to identify and rank app features relevant for sport participation. Experts were researchers or professionals in the field of industrial design and information technology (technology expert panel) and in the field of behavior change, health, and human movement sciences who had affinity with physical activity–related apps (health science expert panel). Of the 24 experts who were approached, 11 (46%) agreed to participate. Each panel session consisted of three consultation rounds. The 10 most important features per expert were collected. We calculated the frequency of the top 10 features and the mean importance score per feature (0-100). The sessions were taped and transcribed verbatim; a thematic analysis was conducted on the qualitative data. Results: In the technology expert panel, applied feedback and feedforward (91.3) and fun (91.3) were found most important (scale 0-100). Together with flexibility and look and feel, these features were mentioned most often (all n=4 [number of experts]; importance scores=41.3 and 43.8, respectively). The experts in the health science expert panels a and b found instructional feedback (95.0), motivating or challenging (95.0), peer rating and use (92.0), motivating feedback (91.3), and monitoring or statistics (91.0) most important. Most often ranked features were monitoring or statistics, motivating feedback, works good technically, tailoring starting point, fun, usability anticipating or context awareness, and privacy (all n=3-4 [number of experts]; importance scores=16.7-95.0). The qualitative analysis resulted in four overarching themes: (1) combination behavior change, technical, and design features needed; (2) extended feedback and tailoring is advised; (3) theoretical or evidence base as standard; and (4) entry requirements related to app use. Conclusions: The results show that a variety of features, including design, technical, and behavior change, are considered important for the effectiveness of physical activity–related apps by experts from different fields of expertise. These insights may assist in the development of an improved app rating scale.

AB - Background: A large number of people participate in individual or unorganized sports on a recreational level. Furthermore, many participants drop out because of injury or lowered motivation. Potentially, physical activity–related apps could motivate people during sport participation and help them to follow and maintain a healthy active lifestyle. It remains unclear what the quality of running, cycling, and walking apps is and how it can be assessed. Quality of these apps was defined as having a positive influence on participation in recreational sports. This information will show which features need to be assessed when rating physical activity–related app quality. Objective: The aim of this study was to identify expert perception on which features are important for the effectiveness of physical activity–related apps for participation in individual, recreational sports. Methods: Data were gathered via an expert panel approach using the nominal group technique. Two expert panels were organized to identify and rank app features relevant for sport participation. Experts were researchers or professionals in the field of industrial design and information technology (technology expert panel) and in the field of behavior change, health, and human movement sciences who had affinity with physical activity–related apps (health science expert panel). Of the 24 experts who were approached, 11 (46%) agreed to participate. Each panel session consisted of three consultation rounds. The 10 most important features per expert were collected. We calculated the frequency of the top 10 features and the mean importance score per feature (0-100). The sessions were taped and transcribed verbatim; a thematic analysis was conducted on the qualitative data. Results: In the technology expert panel, applied feedback and feedforward (91.3) and fun (91.3) were found most important (scale 0-100). Together with flexibility and look and feel, these features were mentioned most often (all n=4 [number of experts]; importance scores=41.3 and 43.8, respectively). The experts in the health science expert panels a and b found instructional feedback (95.0), motivating or challenging (95.0), peer rating and use (92.0), motivating feedback (91.3), and monitoring or statistics (91.0) most important. Most often ranked features were monitoring or statistics, motivating feedback, works good technically, tailoring starting point, fun, usability anticipating or context awareness, and privacy (all n=3-4 [number of experts]; importance scores=16.7-95.0). The qualitative analysis resulted in four overarching themes: (1) combination behavior change, technical, and design features needed; (2) extended feedback and tailoring is advised; (3) theoretical or evidence base as standard; and (4) entry requirements related to app use. Conclusions: The results show that a variety of features, including design, technical, and behavior change, are considered important for the effectiveness of physical activity–related apps by experts from different fields of expertise. These insights may assist in the development of an improved app rating scale.

KW - Exercise

KW - Features

KW - Health behavior

KW - Healthy lifestyle

KW - Measures

KW - MHealth

KW - Mobile applications

UR - http://www.scopus.com/inward/record.url?scp=85048853070&partnerID=8YFLogxK

U2 - 10.2196/mhealth.9459

DO - 10.2196/mhealth.9459

M3 - Article

VL - 6

JO - JMIR Mhealth and Uhealth

JF - JMIR Mhealth and Uhealth

SN - 2291-5222

IS - 6

M1 - e143

ER -