A Review of Conceptual Approaches and Empirical Evidence on Probability and Nonprobability Sample Survey Research

Journal of Survey Statistics and Methodology
,
vi, 4-36 S.
,
2020,

Cornesse, Carina, Annelies G. Blom, David Dutwin, Jon A. Krosnick, Edith de Leeuw, Stéphane Legleye, Josh Pasek, Darren Pennay, Benjamin Phillips, Joseph W. Sakshaug, Bella Struminskaya, Alexander Wenz
ISSN: 2325-0984 (print), 2325-0992 (online)
DOI: 
10.1093/jssam/smz041
Abstract

There is an ongoing debate in the survey research literature about whether and when probability and nonprobability sample surveys produce accurate estimates of a larger population. Statistical theory provides a justification for confidence in probability sampling as a function of the survey design, whereas inferences based on nonprobability sampling are entirely dependent on models for validity. This article reviews the current debate about probability and nonprobability sample surveys. We describe the conditions under which nonprobability sample surveys may provide accurate results in theory and discuss empirical evidence on which types of samples produce the highest accuracy in practice. From these theoretical and empirical considerations, we derive best-practice recommendations and outline paths for future research.