Does the collection of ego-centered network data on the web reduce the data quality? : an experimental comparison of online versus offline data collection

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademic

Abstract

We analyze whether differences in kind and quality of ego-centered network data that were collected on the web compared to data collected with the help of an interviewer are caused by the different data collection procedures. The quality of web survey data has been analyzed (Couper 2000) for more or less standard questions. The collection of ego-centered network data, however, is notoriously more difficult than the collection of other survey data because it faces the respondent with a more complex answering task. Until now, we know that the wording of the items influences the measured size of the network and the drop out rate (Lozar Manfreda, Vehovar & Hlebec 2004). Also, it is known that when respondents can freely choose between a web survey and an interview, then those who choose the web survey have a higher drop out rate and more missing values (Snijders & Matzat 2005). However, we do not know whether the web survey itself reduces the data quality or whether the reduction can be explained by other unobserved differences between the groups. In our study university researchers of different disciplines at a Dutch university (n=270) were randomly divided into two groups. They either filled out ego-centered data through a web questionnaire or were probed about their network in a personalized interview. Ego-centered network data collection makes use of so-called \"name generators\" that are both hard to explain properly and moreover give the respondent a special opportunity to shorten the answer procedure. For this reason, interviewers are often deemed critical in the proper collection of ego-centered network data. Our analysis provides a strong test of whether the collection of network data through the Internet reduces the data quality. One could argue that respondents who are not interviewed in person are tempted to answer in a much more time saving manner than other respondents, and are moreover more likely to make mistakes or simply quit. We focus on drop out rates, the number of missing values, the size and density of the ego-centered networks, as well as other properties of the networks. The paper presents the results of the hypotheses testing.
Original languageEnglish
Title of host publicationGeneral Online Research, GOR06, Bielefeld, Germany, 21-22 March 2006
Publication statusPublished - 2006
Eventconference; General Online Research, GOR06; 2006-03-21; 2006-03-22 -
Duration: 21 Mar 200622 Mar 2006

Conference

Conferenceconference; General Online Research, GOR06; 2006-03-21; 2006-03-22
Period21/03/0622/03/06
OtherGeneral Online Research, GOR06

Fingerprint Dive into the research topics of 'Does the collection of ego-centered network data on the web reduce the data quality? : an experimental comparison of online versus offline data collection'. Together they form a unique fingerprint.

  • Cite this