U.S. flag

An official website of the United States government

Skip Header

Introduction to Quality Indicators: Operational Metrics

Written by:

In the coming weeks, the U.S. Census Bureau will release the first set of results from the 2020 Census. Our goal for every census is to count everyone once, only once, and in the right place.

While we know that no census is perfect, how will we know if the 2020 Census results are good enough for their constitutional purpose and their many other uses? The answer to this question is perhaps more important than ever before because of the unprecedented challenges this census faced.

To answer this question, we are engaged in several efforts to assess the quality of the census data (as we do after each census). We’ve previously described these efforts in more detail.

For a quick summary, these efforts include:

Today, we’ll dive deeper into the operational metrics we plan to provide, particularly the host of metrics we plan to release along with the first results from the 2020 Census.

Why provide operational metrics?

Operational metrics are data points related to how we manage census operations. For example, we can look at data about response characteristics, such as how we obtained a response for an address.

No singular number can definitively quantify the quality of the census. However, looking at these metrics and comparing them across geographies and with past censuses can give us insight into the quality of the data.

For example, we know from past research that the best quality information usually comes from a person within the household. As a result, understanding the percentage of self-responses (a response submitted online, by phone or by mail by a member of the household) is important. Similarly, understanding the percentage of population counts collected by talking to “proxies,” such as neighbors or building managers, is also important. 

When and what operational metrics will be published?

We have already released a number of preliminary data quality metrics, including:

  • Self-response rates down to the tract level.
  • Total completion rates at the state level.
  • Nonresponse Followup workload completion for area census offices.
  • National administrative records and proxy respondent enumeration rates.

These metrics all gave a preliminary look at how we collected responses and accounted for each address.

We know many people are interested in more detailed metrics, so we’ve accelerated our schedule for releasing them. We plan to release the next set of metrics in April — on the same day we release the first 2020 Census results — followed by another set in May.

Each set will provide information for the nation, all 50 states, the District of Columbia, and Puerto Rico.

The operational metrics planned for April will provide information on the status of addresses in the census and how we resolved addresses in the Nonresponse Followup operation. (See the table shell.) The May set will provide similar information by average household size, and percentage of single-person housing units and two-person housing units.

What will the April metrics show about the status of addresses?

For every address in the census, we need to know whether it is a real and livable residence and if so, whether it is vacant or occupied. The April metrics will show the percentage of addresses we determined to be occupied, vacant or nonexistent.

We’ll also show how that status was determined:

  • Self-response: A household member responded online, by phone or by mail of their own accord.
  • Nonresponse Followup: A census taker collected a response from a household member or a proxy respondent, such as a neighbor, building manager or landlord.
  • Group quarters: We collected the response through the Group Quarters operation, which counts people living in places such as college dormitories, prisons and nursing homes.
  • Unresolved: We used imputation to assign a status and population count for addresses that remained unresolved after we concluded our data collection operations. (Imputation is a statistical technique that fills in missing information using other available information. We’ll talk more about it in an upcoming blog.)

What information will be available about Nonresponse Followup?

During the Nonresponse Followup operation, census takers knock on the doors of addresses that did not self-respond to the census to try to get a response or to verify whether the address is vacant.

The April operational metrics will show the percentage of occupied addresses resolved by:

  • An interview with someone in the household.
  • Administrative records: If a household didn’t respond on their own, a census taker would visit to collect a response. If they couldn’t reach the household, we attempted to use high-quality, existing records about the household. This new method for the 2020 Census provided a way to count people who otherwise wouldn’t respond.
  • An interview with a proxy: If census takers couldn’t get a response directly from a household after three visits (except where high-quality administrative records were available), they tried to get information about the address from a proxy such as a neighbor, landlord or building manager.

The metrics will also provide:

  • The percentage of vacant addresses.
  • The percentage of deleted addresses resolved with a proxy interview or by administrative records, respectively. (We delete addresses we confirm don’t exist.) 

Are these new metrics?

For decades, we have produced similar metrics to those we are releasing. What’s new is that we are releasing the metrics sooner than with past censuses, and we are releasing the metrics at the state-level in addition to the national level.

While there is interest in data at levels of geography below the state level, it is important to note that the Census Bureau is required by law to safeguard the privacy of respondents and the confidentiality of their responses. This requires that we balance the level of detail we provide, especially for smaller geographies, with that need for confidentiality.

We will apply privacy protections to the operational metrics we release to guard respondent privacy. We will also be limited in what detail we can publish at a local level for the operational metrics.

What comparable data will be available?

To make comparing the metrics among the nation and states easy, we plan to release the metrics through an interactive dashboard and downloadable tables. Alongside the 2020 Census numbers, we’ll also provide comparable metrics from the 2010 Census.

It’s important to note that we expect to see differences across geographies and the two decades. “Different” doesn’t necessarily mean “better” or “worse.” Many differences are a result of changes to the way we conducted the 2020 Census as compared with the 2010 Census, for example, implementing an internet response option.

A difference is just another data point as we consider the breadth of quality assessments in the works for the 2020 Census. 

Stay Tuned

The Census Bureau is committed to sharing what we know, when we know it, to help the nation understand the quality of the 2020 Census results. We are just a few weeks away from the first release of 2020 Census data, which represents the culmination of over a decade of hard work. We hope you will join us for the live news conference to hear these first results and stay tuned for more information over the coming months.

Related blogs

Random Samplings Blog
Upcoming 2020 Census Coverage Estimates
The U.S. Census Bureau released coverage estimates for the 2020 Census.

Random Samplings Blog
The Post-Enumeration Survey: Measuring Coverage Error
Although we undertake extensive efforts to accurately count everyone in the decennial census, sometimes people are missed or duplicated.

Random Samplings Blog
Using Demographic Benchmarks to Help Evaluate 2020 Census Results
One of the primary methods of evaluating the quality of a census is comparing the results to other population benchmarks.

Random Samplings Blog
Programa de Evaluaciones y Experimentos del Censo del 2020
Este blog describe la serie de evaluaciones formales que miden diferentes aspectos de las operaciones del censo y los desafíos.

Random Samplings Blog
2020 Census Program for Evaluations, Experiments, and Assessments
This blog describes the series of formal evaluations and assessments that measure different aspects of census operations and specific challenges.

Random Samplings Blog
Improvements to the 2020 Census Race and Hispanic Origin Question Designs, Data Processing, and Coding Procedures
This blog discusses how we improved the census questions on race and Hispanic origin, also known as ethnicity, between 2010 and 2020.

Random Samplings Blog
Improvements to the 2020 Census Race and Hispanic Origin Question Designs, Data Processing, and Coding Procedures
This blog discusses how we improved the census questions on race and Hispanic origin, also known as ethnicity, between 2010 and 2020.

Random Samplings Blog
How We Complete the Census When Demographic and Housing Characteristics Are Missing
Although we strive to obtain all demographic and housing data from every individual in the census, missing data are part of every census process.

Random Samplings Blog
Censo del 2020: Métricas de calidad, Publicación 2
Este blog proporciona datos destacados del segundo grupo de métricas operacionales de calidad del Censo del 2020.

Random Samplings Blog
2020 Census Operational Quality Metrics: Release 2
Today we released the second round of 2020 Census operational quality metrics.

Random Samplings Blog
Examining Operational Quality Metrics
The Census Bureau is taking a multifaceted approach to studying the quality of the 2020 Census, so as to produce a more complete and informative picture.

Random Samplings Blog
Comparisons to Benchmarks as a Measure of Quality
Data quality is multidimensional and so approaching it from multiple angles produces a more insightful and holistic picture of a dataset.

Random Samplings Blog
2020 Census Data Review
For the 2020 Census, we are conducting one of the most comprehensive reviews in recent census history.

Random Samplings Blog
Revisión de los datos del Censo del 2020
En este blog hablamos sobre cómo estamos realizando una de las revisiones de datos más completas en la historia reciente del censo, para el Censo del 2020.

Random Samplings Blog
Completing the Census When Households or Group Quarters Don't Respond
As we continue to process 2020 Census responses, people have asked what happens when we don’t get a response from an address.

Random Samplings Blog
Cómo completamos el censo cuando los hogares no responden
Mientras continuamos procesando las respuestas al Censo del 2020, las personas han preguntado qué sucede cuando no obtenemos una respuesta de una dirección.

Random Samplings Blog
Administrative Records and the 2020 Census
Each decade we are asked, “Why don’t you just use the information the government already has about me for the census? Why ask me again?”

Random Samplings Blog
Los registros administrativos y el Censo del 2020
Este blog describe cómo el Censo del 2020 usó los registros administrativos para contar a las personas que no respondieron.

Random Samplings Blog
Introduction to Quality Indicators: Operational Metrics
In the coming weeks, the U.S. Census Bureau will release the first set of results from the 2020 Census. Our goal for every census is to count everyone once, only once, and in the right place.

Random Samplings Blog
2020 Census Group Quarters
As we continue processing 2020 Census results, we’d like to provide more information on how we count people living in group quarters (GQs).

Random Samplings Blog
Finding 'Anomalies' Illustrates 2020 Census Quality Checks Are Working
We’re in the midst of data processing for the 2020 Census. As Acting Census Bureau Director Ron Jarmin acknowledged in a recent blog, we’ve discovered some “anomalies” along the way that we’re looking into and resolving.

Random Samplings Blog
Encontrar ‘anomalías’ demuestra que los controles de calidad funcionan
El 9 de marzo de 2021, la Oficina del Censo de los EE. UU. publicó un blog (en inglés) sobre las “anomalías” que encontramos al procesar los datos del Censo del 2020.

Random Samplings Blog
Adapting Field Operations to Meet Unprecedented Challenges
As we process census responses and analyze the quality of the 2020 Census, it’s helpful to look back at some of the unprecedented challenges we faced during this census.

Random Samplings Blog
Adaptación de las operaciones de campo para enfrentar desafíos
La oficina del Censo de los EE. UU. compartió información en una publicación de blog el 1 de marzo de 2021, acerca de cómo la realización de un censo es una tarea enorme, incluso en circunstancias ideales.

Random Samplings Blog
Ensuring a Robust and Accurate Data Quality Analysis in the 2020 Census
Asking outside experts to review our work is standard operating procedure at the U.S. Census Bureau. It underscores our commitment to quality and transparency.

Random Samplings Blog
Timeline for Releasing Redistricting Data
We expect to deliver the redistricting data to the states and the public by Sept. 30, 2021.

Random Samplings Blog
Census Data Processing 101
Michael Thieme describes how census data processing works to ensure the census is accurate.

Directors Blog
2020 Census Processing Updates
I’m writing to provide an update on data processing for the 2020 Census.

Random Samplings Blog
Update on 2020 Census Data Processing and Quality
The Census Bureau has begun processing the data collected for the 2020 Census. Data collection for the decennial census is always a herculean task and 2020 was no exception.

Page Last Revised - March 21, 2023
Is this page helpful?
Thumbs Up Image Yes Thumbs Down Image No
255 characters maximum 255 characters maximum reached
Thank you for your feedback.
Comments or suggestions?


Back to Header