TY - JOUR
T1 - Agreement and consensus in a Q-mode research design : an empirical comparison of measures, and an application
AU - Dijkstra, L.
AU - Eijnatten, van, F.M.
PY - 2009
Y1 - 2009
N2 - Subject of this paper is the analysis of consensus within small groups of respondents, based on a proportionally large number of variables. The target group is researchers who are interested in Q-mode research. Measures of agreement are compared, and an application from a recent project is presented. Cohen’s ¿ is the preferable measure, Krippendorff’s a is an alternative, which is based on a different concept of expected disagreement. At group level, along with ¿ and a for multiple raters, additional measures are r wg, intraclass correlation, and ¿ SC. Predictions about level differences between groups can be assessed by a t-test and ¿.
AB - Subject of this paper is the analysis of consensus within small groups of respondents, based on a proportionally large number of variables. The target group is researchers who are interested in Q-mode research. Measures of agreement are compared, and an application from a recent project is presented. Cohen’s ¿ is the preferable measure, Krippendorff’s a is an alternative, which is based on a different concept of expected disagreement. At group level, along with ¿ and a for multiple raters, additional measures are r wg, intraclass correlation, and ¿ SC. Predictions about level differences between groups can be assessed by a t-test and ¿.
U2 - 10.1007/s11135-009-9249-4
DO - 10.1007/s11135-009-9249-4
M3 - Article
VL - 43
SP - 757
EP - 771
JO - Quality and Quantity : International Journal of Methodology
JF - Quality and Quantity : International Journal of Methodology
SN - 0033-5177
IS - 5
ER -