U.S. Department of Commerce

Research Reports

You are here: Census.govSubjects A to ZResearch Reports Sorted by Year › Abstract of RSM2006/09
Skip top of page navigation

Cognitive Testing of Translations of ACS CAPI Materials in Multiple Languages

Yuling Pan, Marjorie Hinsdale, Alisú Schoua-Glusberg, and Hyunjoo Park

KEY WORDS: Translation of survey materials, cognitive testing, multiple languages

ABSTRACT

In an effort to ensure high-quality data from linguistically isolated populations included in the American Community Survey (ACS) sample, the ACS language team at the Census Bureau took the initiative to develop translations of ACS supporting documents into five languages: Spanish, Chinese, Korean, Russian, and Vietnamese. This report documents a study conducted by the U.S. Census Bureau, in collaboration with RTI International and Research Support Services, that cognitively pretested translations of survey letters and brochures in multiple languages (Spanish, Chinese, Korean, and Russian).

The study was designed to include the following steps: 1) organize a panel of experts in each language consisting of survey methodologists and language experts; 2) adopt the committee approach in translating interview protocols from English into target languages; train language experts for cognitive interviews; 3) conduct cognitive interviews in multiple languages; and 4) recommend changes for translations through the panel of experts. Using this approach and design, we successfully identified a set of issues that are not normally informed by the traditional translation-review process. In addition to translation issues, we identified problems caused by differences in preferred norms of communication or presentation styles, and variations in culturally-driven expectations regarding certain topics. These issues affect respondents’ reaction to and interpretation of the messages conveyed in the translated materials.

Findings from this project demonstrate the importance of pretesting translation in the target language, effectiveness of the committee approach in survey translation, and the value of pairing survey methodologists with language experts for cognitive testing in non-English languages. This report documents all aspects of this research, from recruitment through protocol development to results of cognitive interviews.

CITATION:

Source: U.S. Census Bureau, Statistical Research Division

Created: December 12, 2006
Last revised: December 12, 2006


[PDF] or PDF denotes a file in Adobe’s Portable Document Format. To view the file, you will need the Adobe® Reader® Off Site available free from Adobe.

This symbol Off Site indicates a link to a non-government web site. Our linking to these sites does not constitute an endorsement of any products, services or the information found on them. Once you link to another site you are subject to the policies of the new site.

Source: U.S. Census Bureau | Statistical Research Division | (301) 763-3215 (or chad.eric.russell@census.gov) |   Last Revised: October 08, 2010