The Library
Fieldwork effort, response rate and the distribution of survey outcomes : a multi-level meta-analysis
Tools
Tools
Tools
Sturgis, Patrick, Williams, Joel, Brunton-Smith, Ian and Moore, Jamie (2017) Fieldwork effort, response rate and the distribution of survey outcomes : a multi-level meta-analysis. Public Opinion Quarterly, 81 (2). pp. 523-542. doi:10.1093/poq/nfw055
|
PDF
WRAP-fieldwork-rate-distribution-multi-level-2017.pdf - Accepted Version - Requires a PDF viewer. Download (2163Kb) | Preview |
Official URL: https://doi.org/10.1093/poq/nfw055
Abstract
This study assesses how survey outcome distributions change over repeated calls made to addresses in face-to-face household interview surveys. We consider this question for 541 survey variables, drawn from six major face-to-face UK surveys that have different sample designs, cover different topic areas, and achieve response rates between 54 and 76 percent. Using a multilevel meta-analytic framework, we estimate for each survey variable the expected difference between the point estimate for a proportion at call n and for the full achieved sample. Results show that most variables are surprisingly close to the final achieved sample distribution after only one or two call attempts and before any post-stratification weighting has been applied; the mean expected difference from the final sample proportion across all 559 variables after one call is 1.6 percent, dropping to 0.7 percent after three calls and to 0.4 percent after five calls. These estimates vary only marginally across the six surveys and the different types of questions examined. Our findings add weight to the body of evidence that questions the strength of the relationship between response rate and nonresponse bias. In practical terms, our results suggest that making large numbers of calls at sampled addresses and converting “soft” refusals into interviews are not cost-effective means of minimizing survey error.
| Item Type: | Journal Article | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Subjects: | H Social Sciences > HB Economic Theory | ||||||||
| Divisions: | Faculty of Social Sciences > Sociology | ||||||||
| Library of Congress Subject Headings (LCSH): | Household surveys -- Response rate -- Great Britain | ||||||||
| Journal or Publication Title: | Public Opinion Quarterly | ||||||||
| Publisher: | Oxford University Press | ||||||||
| ISSN: | 0033-362X | ||||||||
| Official Date: | 30 May 2017 | ||||||||
| Dates: |
|
||||||||
| Date of first compliant deposit: | 21 October 2016 | ||||||||
| Volume: | 81 | ||||||||
| Number: | 2 | ||||||||
| Page Range: | pp. 523-542 | ||||||||
| DOI: | 10.1093/poq/nfw055 | ||||||||
| Status: | Peer Reviewed | ||||||||
| Publication Status: | Published | ||||||||
| Access rights to Published version: | Restricted or Subscription Access | ||||||||
| Funder: | Economic and Social Research Council (Great Britain) (ESRC) | ||||||||
| Grant number: | ES/L008351/1 | ||||||||
| Related URLs: |
Request changes or add full text files to a record
Repository staff actions (login required)
 |
View Item |
Downloads
Downloads per month over past year
