Survey Research

Five Ways to Use Historical Survey Data to Improve Quality in a Survey

Five Ways to Use Historical Survey Data to Improve Quality in a Survey

When you find yourself surveying a population where significant information is known about those who are in the study prior to them completing the survey (such as in a longitudinal survey, a panel, or when the respondents are part of a known group such as a membership organization), such data can be used as part of the survey instrument design.  

While it is tempting to do whenever possible, when using such data, care should be given to how and when it is used…

read more

Peer Review as a Necessary but Unscientific Process – Can we just do some iterative science already?

Peer review is wonderful in theory.  Scientists reviewing other scientists’ work to evaluate whether the science was applied thoroughly, implemented well, and interpreted effectively can be a wonderful way to allow the best science through.  But the Reproducibility Project clearly demonstrated that something is broken – when over a quarter of the published studies reviewed could not be replicated. 

It is not a surprise to most.  Humans are involved.  We make mistakes…

read more

Research Wonder: Response Motivation – Important for Interpretation

Most agree that people have numerous motivations to participate in research.  In a recent article, Florian Keusch thoroughly details the various reasons why people participate in web surveys.  It is clear that there is no single reason — societal characteristics, individual characteristics, and survey characteristics all play a role.  But like most strong literature reviews do, it left me with this…

read more

Jim Harbaugh – A Solution to Sagging Response Rates?

Bear with me — but I have an idea.  I may have stumbled upon the solution to a troubling trend in our science.  Response rates are dropping.  We used to say that it was critical to get high response rates in our studies.  We spoke of our fight against our nemesis of “Non-Response Error”!

But then as it became clear that we were losing that fight…

read more