Skip to content

White Paper: Experiences Using Online Testing to Support Survey-Methods Research and Pre-Testing in the Federal Government

Working Paper Number rsm2019-06
Erica Yu, Aleia Clark Fobia, Jessica Graber, Jessica Holzberg, Robin Kaplan, Brandon Kopp, Kashka Kubzdela, Bill Mockovak, Rebecca Morrison, Paul Scanlon
Component ID: #ti1165408359

Abstract

A recent innovation in federal agencies is the use of online testing methods to conduct questionnaire pretesting and evaluation, cognitive interviews, usability testing, and primary methodological research. Results from small-scale research conducted online can provide evidence to support changes to survey questionnaires and data collection procedures before they are implemented in the field while reducing the costs and staff time needed to conduct the research and improving data quality compared to other data collection methods.

This white paper offers an introduction to conducting online testing within the federal system. The authors, who are researchers from federal agencies including the U.S. Census Bureau and Bureau of Labor Statistics, provide a foundation for thinking about when online testing methods are appropriate, guidance on how to use online testing methods to supplement and complement in-lab research, and case studies from experience using several platforms. The paper also provides practical considerations for using these platforms in federal agencies, including the use of contracting tools and services.

 

 

X
  Is this page helpful?
Thumbs Up Image Yes    Thumbs Down Image No
X
No, thanks
255 characters remaining
X
Thank you for your feedback.
Comments or suggestions?