The model-based estimates almost certainly differ from the figures that would result from administering the American Community Survey (ACS) to all households in the nation. These differences might arise because a sample was surveyed rather than all households, because our model does not fit all counties, or for other reasons. The possibility of these differences creates uncertainty about the estimates. Standard errors are produced for all of the model-based estimates, largely to provide an indication of the overall quality of the set of all county estimates. With some caution they may also be used to provide confidence intervals for individual estimates.
The standard errors represent "uncertainty" arising from several sources, especially:
ACS sampling variation creates uncertainty about the model predictions because the direct estimation of variance becomes more precise as county size increases. It is also present but reduced in the shrinkage estimates for counties with ACS sample households. We represent the uncertainty arising from lack of fit of the model as a variance constant over all counties, since we do not know which counties the model doesn't fit. In general, the sampling variance is large compared with the lack of fit variance.
These standard errors are quite different from the estimates of direct sampling variation which characterize the uncertainty of U.S. Census Bureau estimates, both because they include nonsampling variance and because of the way sampling variance influences them. We employ these standard errors to form 90 percent confidence intervals and construct the relative width of the 90 percent confidence interval. We use these relative widths to compare standard errors.
Several sources of uncertainty are not represented in the standard errors, including the following:
Some of these sources of uncertainty are alluded to elsewhere on this web site, as points of difference among the three sets of estimates: census, ACS, and model-based. While we can give examples of the underlying mechanisms for each, we have not made a quantitative assessment of the uncertainty they contribute to the present estimates.