Skip Header

SSM2015-03
Joanne Pascale
Component ID: #ti658942473

Abstract

Measurement error can be very difficult to assess and reduce. While there have been great strides in the field of survey methods research in recent years, m any ongoing federal surveys were initiated decades ago, before testing methods were fully developed. However, the longer a survey is in use, the more established the time series becomes, and any change to a questionnaire risks a break in that time series. This paper documents how a major federal survey – the health insurance module of the Current Population Survey (CPS) – was redesigned over the course of 15 years (1999 - 2014) through a systematic series of small, iterative tests, both qualitative and quantitative , and implemented in production beginning in the spring of 2014 . This overview summarizes those tests and results, and illustrates how particular questionnaire design features were identified as problematic, and how improvements were developed and evaluated. The paper also addresses measurement challenges that emerged during the testing: passage of federal legislation on health reform (aka: the Affordable Care Act). While the particular topic is health insurance, the general approach (a coordinated series of small tests), along with the specific tests and methods employed, are not uniquely applicable to health insurance. Furthermore, the particular questionnaire design features of the CPS health module that were found to be most problematic are used in many other major surveys on a range of topic areas.

Back to Header