WPCI qɭTL&;$ذhG9ߖA>_ y6)~dhgA OpvpX(EHd.xy,465&޽hײ1q]Nˁ ru VzJg6nb9 fm()GԞiAU7Nخ@DTs; nɷ^(|q+v@nUǂt!0672J05+tf!rgC \ll]\'ce;#@y,s rPE5$Eܠŭ [5w/ pH@`Ń/&G~eސQ8y7 ͼ+' 0+wi) 72) 0+* 1* 1U#+ 0Dx+ 1, 72G- 72y- 1- 12. 72. 72./ 14 14 1+55 72=7&o7 727 17 1N8 728 729 C99 1S9 0A9 0V: 1q: 72: 1*;; 1w< 72< 720= 1b=N=&= 72> 1C> 72> 1? 1? 72:@ 1l@ 72 A 1=A 72A 1B 72B 1B 72~C 1C 72OD 1D 72 E 1RE 72F 043F 1gF 72G 18G BG 72G 1&H 72H 1HfI=1MU(@nNN 0VtO 1O 72QP CP 1P 72$Q 0TVQ 0hQ 1R 1R 1 S 72SS 0(U iV 1V B<-uW 0+W 0+VX 0+Y 0+YZ 1[4\L\^^&_ 72_ A_ 72` 0` D-c B *c 1c"d"d 0Kd 1e Ae 72Cf 1uf&f 1"g 72g 72g 72 h 72?h 72qh 1h 1*i 1i 728j 1jj 72 k 1;k 72k 72k 72&l 1Xl 1l"fm&m 72mm&n 1nESoUo&jo&oo"Br&dr"r"r 1r 72Us 1s&t@4tJt 1vodfv 0/ 0(U> 0V 1^ 72 72 1I 0U"%&G 1m 0.~ 0.Dr 0 72 1L i8]p 1 C 72 7 " B &="c 1 72 $> 1b 1&p 0 72U 72 1O 0 72 1 0H& 1! 72 1&a 72 1&@ 72f 1P 72o& 1F 72 C 1 72iU2&tpg" 72 0+ 72  1&.T 1; 72 0Jj<" 72&&9 0_ 0 0 0Z 72% 0W" 07 1 72e" 0 72Z  0  1' B  72 UN" p "  0  0=  0 "S uB 0"} 0gfa" 0"h 0 0. 0 72d 0"("J 0l& 0" 0< 0fa fa 4fJaL&`f"afmEoa!:7#q&'*+ 0N--@.f\0^0a^1fr1at1f1a1U:112336:f=>a?>fS>aU>;i>f?a?f?a???$??AU NWCWCWCWCUNCCCCUNC 1AD 72D 1D 72EEEEEEEEEEEEEEEEEEEEEEEEEEEEEEESEE 1H 72H 1H 72^IPDF9950(9 Z6Times New Roman RegularX($USUS.,  ($USUS.,    5    _Y XXT#XX Ye#XXoassessthevariabilityinrecruitingperformanceacrossallLCOsandtheimportanceofvariousfactors  affectingrecruitingperformance,WestatusedtheratioofLCOapplicantstorecruitinggoalsduringFebruary2000 t (whenrecruitinggoalsweremetforthenationasawhole)asameasureofindividualLCOdifferencestomeeting 8 recruitinggoals.#XX# `     h      p      x   3#37=CIQYag1.a.i.(1)(a)(i)1)a)i)  d>/ (;3$2#  0  .3  0  (xir$0  0` (#(#0 ` (#` (#2#(  0  )3  0 (# (#**/am Files3|x  wxyzpo"Gaeimquy}Bullet ListBullets List:U(դEGMSY_ekqAutoList381.1.1.1.1.1.1.1.(EGQ[eoyAutoList161.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 (%EGMSY_ekqAutoList151.1.1.1.1.1.1.1.1.1 1.(EEGMSY_ekqAutoList17I.I.I.I.I.I.I.I.I.(UEGMSY_ekqAutoList181.1.1.1.1.1.1.1.1.<:P1Stand Par      2( 4 <DL2,&&&    2( 4 <DL2    4 ($USUS.,    13    _XXTheOperationsControlSystem(OCS)wasanautomateddatabasethatresidedateachLCO.Itsprimary  usewastomakeinitialenumeratorworkassignments,controlandmonitortheflowofworkbetweentheLCOand t thefieldstaff,capturelimiteddatafromcompletedquestionnaires,andprepareshippingdocuments/tracking 8 numbersformaterialsshippedfromtheLCOs.(O;$0  2#  a  .3  0` (#(#1.(b$0  0` (#(#2#   .3  0 ` (#` (#(EGMSY_ekqAutoList391.1.1.1.1.1.1.1.(359=AEIMQ1nnnnnnnn(F$0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(#0p(#(#2#     )3  0p(#p(#   wxyzxCcgkosw{TrianglesTriangle Bullet$#!1.(EGMSY_ekqAutoList401.1.1.1.1.1.1.1.(eEGMSY_ekqAutoList191.1.1.1.1.1.1.1.(1.'1. FrontloadingNonresponse NRFU CIFUReinterviewNonflaggedmailback HUs GQs LCOsLCOMsgeocoded DSF TQAgeocodingrecanvass LUCA TEAs AAsprecensuscolonias RCC ACRs ACR FFU DMAF LMR HCEFDSCMOnonhouseholdnonresponding LMRs AMFOnontargetedfrontloadedflashcards HCUFPetta YuddMangaroo MoulMcNallyPenningtonRosenthalTenebaumZajacBorsa MAFJackobson LCOWestatnoncityRecanvassingUU CLDhireesflashcardhousematesTagologBroadnaxReengineeringRobey DMD PAMSmailout MCD CSMRFTCDOHU(EGMSY_ekqAutoList201.1.1.1.1.1.1.1.(EGMSY_ekqAutoList411.1.1.1.1.1.1.1. 6+CEKQW]cioAutoList11.a.a.1.1.1.1.1.  ($USUS.,    18    _XXdTheDRF2wasusedtoobtaindatafromtheRespondentInformationandInterviewSummarysectionsof  theenumeratorquestionnaire.#dXXdf##XXXdX✅#,1. 8h-1.(EGMSY_ekqAutoList421.1.1.1.1.1.1.1.(%EGMSY_ekqAutoList211.1.1.1.1.1.1.1.41.31.dd(EGMSY_ekqAutoList541.1.1.1.1.1.1.1.(Vm$0   (.3$ !USUS.,  (ŤEGMSY_ekqAutoList431.1.1.1.1.1.1.1.;1.(EEGMSY_ekqAutoList231.1.1.1.1.1.1.1.Level 1Level 2Level 3Level 4Level 5(5EGMSY_ekqAutoList221.1.1.1.1.1.1.1.?1.=1.(դEGMSY_ekqAutoList441.1.1.1.1.1.1.1. 8hB1.(EGQ[eoyAutoList241.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 F1.1   wxyzhsCEIMQUY]aAutoList6""""""""i)1)a)(EGQ[eoyAutoList251.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 I1.1 (EGQ[eoyAutoList261.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 K1.1 (EGQ[eoyAutoList271.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 M1.1 (EGQ[eoyAutoList281.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 O1.1 (EGQ[eoyAutoList291.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 Q1.1 (EGQ[eoyAutoList301.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 S1.1 (EGQ[eoyAutoList311.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 U1.1 (EGS_kwAutoList321.1. 1.1. 1.1. 1.1. 1.1. 1.1. 1.1. 1.1. W1.1. &c$""0 (EGQ[eoyAutoList331.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 Z1.1 (EGQ[eoyAutoList341.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1  d\1.1 )EGMSY_ekqAutoList351.1.1.1.1.1.1.1._1.(EGMSY_ekqAutoList451.1.1.1.1.1.1.1.  ($USUS.,    19    _Y XXԀ#XX Yf#XXTheDRF2consistedof38.6millionNRFUenumeratorquestionnaireswhichrepresented37.4million  uniqueHUs.B   (9,page11,_ԍR24) RC  ԀThedifferenceintheprecedingtwonumbersistheresultofmultiplequestionnairereceiptsfromabout t 1.2millionunits.Whiletherewere42.4millionHUsintheNRFUuniversefollowingtheremovalofLateMail 8  Returns,thedifferencebetweenthe42.4millionfieldNRFUworkloadandthe38.6millionrecordsintheDRF2is  theresultoftheDRF2creationprocesswhichlinkedformsandimplementedtheprimaryselectionalgorithm.#XX# 3 ($USUS.,    22    _XXRefertoMoul(2002)fordetailedbreakdownsofrespondenttypeinformationbyformtypeforoccupied  andvacantunits.#XXf#(O Z(Times New Roman Level 1Level 2Level 3Level 4Level 5(.3$ !USUS.,  (EGMSY_ekqAutoList361.1.1.1.1.1.1.1.g1.d(EGMSY_ekqAutoList531.1.1.1.1.1.1.1.a1.(,!$0  0` (#(#  (@$0  0` (#(#0 ` (#` (# ` (EGMSY_ekqAutoList461.1.1.1.1.1.1.1.(EGMSY_ekqAutoList751.1.1.1.1.1.1.1.(EEGMSY_ekqAutoList571.1.1.1.1.1.1.1.n1.  ($USUS.,    39    _XXAfterremovingduplicateHUsandpersonswhoreportedblankorotherinvaliddatafortheirage/dateof  birth,thebaseuniversefortheevaluationconsistedofapproximately252.5millionpersons,orabout93percentof t HUpersonsontheHCUF.#XXf#<sy:N22nd Bulle      ,"| | <DL,&&&    2( 4 <DL2   (EGMSY_ekqAutoList471.1.1.1.1.1.1.1.)Hairline d($0  0` (#(#0 ` (#` (#0 (# (#2#(  a  )3  0h(#(#(F$0  0` (#(#0 ` (#` (#0 (# (#0h(#(#2#(   )3  0h(#h(#($0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#2#  0  )3  0(#(#({$0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(#2#  a  )3  0p(#(#Level 1Level 2Level 3Level 4Level 5(EGMSY_ekqAutoList861.1.1.1.1.1.1.1. 8  ($USUS.,    32    _XXOfB  ԍfC  the26.4millionoccupiedHUs,117,730(0.4percent)hadnopopulationcountinOCS2000.#XXf#XXԀForthe  entireCensus2000,therewere193,753HUsthatrequiredtotalimputation.#XX#ԄLevel 1Level 2Level 3Level 4Level 5Level 1Level 2Level 3Level 4Level 5 8h|1.&Draw Object =8C HKKKKu1.< :Outline001_1   /%| | <DL/GKr`WingdingsG23  S\  `&Times New RomanSGKr`WingdingsG..S\  `&Times New RomanS  2( 4 <DL2  )!dxdx&0 d d(EGMSY_ekqAutoList681.1.1.1.1.1.1.1.        ( $ Figure  1  (ŤEGMSY_ekqAutoList371.1.1.1.1.1.1.1.ef&OLE 2.0 Box <=8C HKKKK1.(EGMSY_ekqAutoList481.1.1.1.1.1.1.1. 8h(EGMSY_ekqAutoList851.1.1.1.1.1.1.1.81.j1.o1.1.1.(%EGMSY_ekqAutoList551.1.1.1.1.1.1.1.(%EGMSY_ekqAutoList491.1.1.1.1.1.1.1.(EGMSY_ekqAutoList761.1.1.1.1.1.1.1.1.( EGQ[eoyAutoList821.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.(դEGMSY_ekqAutoList501.1.1.1.1.1.1.1.1.1.1.(eEGMSY_ekqAutoList591.1.1.1.1.1.1.1.(UEGMSY_ekqAutoList581.1.1.1.1.1.1.1.     8h1.Level 1Level 2Level 3Level 4Level 5 8h(EGMSY_ekqAutoList79I.I.I.I.I.I.I.I.    8h 8h  ($USUS.,    15    _XXThisstatusincludedaddressesthatwereoccupiedonCensusDaybythesamehouseholdlivingthereat  thetimeoftheenumeratorsvisitandthosethatwereoccupiedbyadifferenthouseholdonCensusDay.Once t enumeratorsdeterminedthecorrecthouseholdforwhichtocompletethequestionnaire,themechanicsofcompleting 8 thequestionnairewasthesameforalloccupiedunits.#XXf#Y XX     8h  8 8   8 8 (ťEGMSY_ekqAutoList771.1.1.1.1.1.1.1.1.(EGMSY_ekqAutoList691.1.1.1.1.1.1.1. 8h*OLE*  ($USUS.,    16    _XXThisstatusincludedbothregularvacantssuchasforsale,forrent,etc.,andvacantusualhomeelsewhere  (UHE)situations.AvacantUHEoccurswhentheNRFUunitisoccupiedonCensusDay,butthehouseholdreports t havingaUHE.#XXf#(EGMSY_ekqAutoList511.1.1.1.1.1.1.1.WPCaf(*(*"5139hD !(*   !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~a}sϏO/?oL߯O? ?O??O??̅{3OD_/_3߬.7_/o.ߓ3o/_2;)ߜ?A?>2_?_O/+.? ?5_/o+_?1oo//_7) O:+?AO=?0/=?$o-+?._ O??4+0?/"4?)$_8+o@o=??O/;?'?.+?. ?3_,/?/$3?O*&_6+@=?O~pP00.`/? 0:p? O_/>?Z +@2__o/: . Oo? P/0$2pP00*/%_050m``<pP 0- O_?8_  _ .O*?.o1_? ,??- O 0&_1*O'5*? ?<￟? ߿_. ?7/ ??0Ͽ? ߂0o __2/ _-߿/ ?Ͽ. 2 O 1￟? ߿_.Ͽ? OO 6 ς?_ <￟? ߿_ ??0??6/ ?2 o3 /3/O0 0o4? _ 3 ??2  7? ?> o? ??~)p8P?0P`5/ /P@[E/0< b/8/Q0? 3)pT/ ` `j` ~`0@/O`  5/ _@?2 F0$`2@?a/ op04@ _ ?@=`0PM / _@6@ @D `Ip P~ W`:O _"020 3 $ 2/P p0 & /PU? = '2 @ >p 0'~@b/  90 ?@ZPO?P3  ?p9 ?`00 bP`V _1@ _W?P= O =07~.. ?`?8 z@p0B  9Pp`@6P/9 _ @\Q@? p5 @<_h ~ 0.@0 2p/ ?/6`j!?2`߿<p&P.@@￯`40 < 03p 50dp`H?~VP@ 1 o@0P2 [P?PT?  @`1P 0&.P@P QP 02[0P p?P= ,~0`PM$@RWa? o/p20?/0/ = 6~pMp pRP oppO t~pPL`/O@[40 @PPP t~p0L ` Z/0xp^p `t~pK / `?[px0`/00/Ps~fp/@JP O o@O@ `m0  ? s~f0 J   Pp0l@P`pOr~f ?H/ pp/O@ 0 o@k@O?`_P `r~f@ `Gp ? 0N P 0j/P` r~gp `F @0 NP 0 ? @h_/PP @@@q~g D@ /pN P pgP ? q~gp _@C/ @  M`/ @O  d0oo@PPP` _p~h/ @0 ?@oN O` ?Ѐb/`O _ `p~i op?p `?`M0 @  @_/p_ P  p~i  @=  Mp_ ? P  \@//P @@o~j0  FPON__Ѐ`?ߐX _O Op ` o~k0?߀90u`HOPNoP`opS @___`C@:P  _n~l0/`8p @jH N `@J߿/_p@_?D :?   O pn~m _0`?O`/?߀@?/Y_ߠ `/O] 9@  n~n?πJo@O0o@ _`V? @`? o]p9` P/0m~pP_0J  P/? T?0? _08_`` m~q/π`Kp/Q@O@ ?PUo`oP` Pl~s@П߃ L 0R_`BO/ PoߐIσ9/0 Opl~u`?0 @`M0 S?O_Ao А [0@p`80 l~vO0 /pT0_ ?/H@_ O0p`/0k~x /  -@  UP /@ /J@? 0 ?pPP` k~z@П 7@@oW_ _` /L 0@Po  p Pj~|`o /,?`W/ 0? _PMP/@ ?pj~} o +   X@   N0/ ?p0/ j~@/ +P 0POZ ?@p `NO@`?  ``? i~_ _ *POPZP 0/ O  ` i~/ P+P  Z0 O 0O@O@0o ?P`(`i~ + @p?[0 p8r  P  )`h~0s @+@ o@[p? 8Ps@_ @P0/P:0q  ?*:,~t` *0O p [ P 0QP09r`? OP+? g~p0@M` `+@ p/[@ ./0L OQ `/p0@K `?? /`0P~06  0[p. &M[ /0}0_ P `/ &~@M06@/@0 [8p0U0@L OPP ?`8P0~00N6 /Z 80p@M@00L  Op .0~`?0PN 6`?@ p c.P0`?0`Mp/ `? -`/0`~  PX`,p @oc .P0PXQ / 0P N OP`/ ` - 0` ~@@@O0 -?b`.0 @N 0QP 00@P@O@_ ` `.@P/@~p.``@ ?. @d0PC@0/@P@.P@`PP / P0pP p ?P-pO.0/ X 1?O?1?O///??o1  /1O4  5 )_! ?- O~ / OO4@0Wp" PS`@/ /p/@`4?pP1 p 1 / OOQp/  4"00(!P?@, / OO ~p/  _? 00 /# U`_?0SF?0P`N@p=@ P2pS ?0O?p'@?P"` -p~`@_?@/`02p_ /  < 1  p?^p`1?po/?@OO _ 2`@_?@5@_ />pFp# ?@,`@_?@~O`06`_?@3/ /@?2"7`F02 _0`6 2p 4Op06 @2"@,@?# O -Op0~`?`0o@6o04/ `W[ >@`O?`3@`6`o3P 0    4`?`0o@U 1PP/ $ O ,`?`0O@~p8_p` 5/ o` V@\/D@_4pOp8P> 0O ?6pWp/ <@00%@?%P -p  ?2 O _9/ ߏ/-Ͽo ? O-_? ?0 ? 7 ?/2 ? ? 1߿ ρ_ /8 ?4￟/ o ?(ϯ_ ?/ "/_߿/ o+ ?  ? 3 o_ _;_/oￏ_ -?,?,o ?0 /? 9_ ?ߏ2 O 2(/: ? 5?o_(-"O o+ ?  OO/ 4?? >?/-/,?,_ ?0/_o? ; /_O 3Oo? 3'o= OO/ 6?O(-"? ?, O_/  /5!@O$/-?,? ?0!O=?4!/3%?/7/?'-" /-/ o6oC? 0-?,__?0@o65#?Co7 '-O"/o _9ϏO_G__2-,??1o?C_o9?6/_F_9'-?!o0__/?ϟo?/Lo/?5﮿,ϐ?6O/_HOO?_/O9ߝN_/;'߭!ߒ3_/ϟO?/?_G߿?/?ORo??_Ƈ;o??_OϏ??oHϯo??OϟO?/?_lϟO?/?_AJPO?[?_o/O߁o?P/[_O ~P@cPO?/0   $.O]  TO)F 0ooo/?_No%?c o  O&/-] _ TO+G O/?/L??$c~  &//-Ph `O]*@R.?pPp@3/0J?P$Pc /'o._oWO,I0Ooϯ/H$c O(.O/`/_YO-I?0/ _G$Od ?(.a_o o?Z?-J0??O F%d ?(o /Z-??JO0o/ /)??O [oo.oJ/0O_?)? /\?O/o??-J/0_O?o(O] /o-I_0o__O ?/o _?߃?/o//__?/o? ߏ?/ _?o?? /o/?oO?? ߁?ߏ?O?O o_ o?? ߂o?__O?_ _o//?/O//o?ߏ?__/Oo? O?o _?_/O _?o___/O/_o o /??_ ?  ?_/  ?? ??__    OO_O__?/ _ O  o? ? ?_?/ ? ??? ??? _?O_ O /_o_? O? _ o _ // o  /  O?_/ oO   ?/ ??/  / ? ??? oo/ oo/ o_? __/?/ _ߟ/_? ?_?oO   O_/ o/ o o/o/  o _ OOo?? //_ _?߯_/o _/o __? _ ? _o /  ?oO  o / o_ ?/? ? /o ? ? ?o_ //? __ _//? _oO /o_? /? /oo/??  ? ?O/ _ /  oO ? O/  O o/ _  _/ o  _/? o//_? _ o??oo_? _ / Oo/_? /?O? ? /_O //? ?/ O o /?     _ ? _ ?OO_o   ?// ?_o_ /o_   ?/߿/?/_  / O??/? O  / /o _ o_O/ O//  ?? O_   !_/ / _ Oo/o   _O ?/ ? _O _ o/ ??// O _/ O?/_   o    /_?? O߿? /_ _ o/ ?_? O o" O ? ?/_? /? O/ o O/  /?   //O/  // O? __ o /  ?ooO _  ??#/O _ ? /o  _ /? ?_ O_   ?O_Oo_ ?  / _ ? O ?_O/?  /?O /O  #  ??? /? ?   _o   oo O OoO_? /O? O_O/ _/ o _o ?_ _ # / ?o O?o?O _  ?/OOo_ ?/??  _ _?o?/??__  ??_? ?? ? Oo _O? ?/  // / #o O  ?o   O?O_O//  _  //__ ? OO_o/_/_  ?? /_?_/o _ oo  ?/ O$   ?O? _o ? ?/  /?  /  _// _/ o/ oo  _ ooo/  ?/ _  _  ?$   o O  ?_ OO   _? OO _?ߏ _/ O_ o _ _/o ?? _ _oO  _? /? ? /O o$? O/ ?/ O_O  o_??   o  o OO?o _?_/o  ?o?? / /? O  /o /o   o  O ?$? ? O__??/O  ?/O? _"_  ?O   _  /O   ??_ _ ?// o /o o ???o? ?    _ # o _?oo o O/O%/ ?  _  ?? _ ?_O O_??oO/  /  ?? o?O o /  ? o$  /o?O?_  /+/   /?  _ _ /? _O/o/?/  O  o ?? ? _ _ _/O?$o  _?oo_? ?O ?+_ O    O  _/? oO   _ ~ 0(P ?P  p/   p@ P/@P$@0 _/`@ OP00@P_@P/@@ PO`>0 PP  @  `_ P`PP P %p`_ 0POP / p  P/p@    Pp/0/__o   _  ?_$? ? O O///_ ? o_  /O    _  /OOoO??//o??_ O_ / /? o/ / /  ??  o ?#_  o /__O ?_ O?/  o/   _ O  ? O  ?/_?/ ? oo_??o  ?  /?O ~@` / @/P  /? 0 `?/  @/  O@@#  @0/ P0/0@ p0 ?p@/0__`@ @0/ @ Po0/ P Pp0 `O`oP  @P @P @@ ?  0  @p P/0 Pp @Џ_0 `0@`P?o@ ?P ?0 @ /pO` 0 O _ ??  ? _ ? ?O/O/$? _O/ o O O ?_/  _?? /  _ /  o O?? ?/ OO/?o? oo? o ?o _ O/    _oo/_$ / ? ߿  ?_/? OOOߏ/ O ? _ oO  ? oOO_?ߟ?o ?/?O/oO// _O / ?_ _ ??????O?   /!o O_ߟ/O  oO/oO? _o/?? o/Ϗo / _ oO? /o?o??/o??__oo ? ?OO/      ? ?  _!O / ? ?O ?_  o _  ?  /  o /?_ _?/_   ?  /? / _   _ o_?/ Oo  ? oo O? _?  o ? /?/ ? O  ? ? //? o  O  ?  o  _   //_ ?O/?߄  O?/!ߊOO/oτ?o ?OO?_  _? o?/_ ߄  OO?o?oO _?O  //o ?? 4߿%_V _@aD\߿m߿`Ͽ*Ͽ)Ͽ@\bi\Ooj_\_Poj?\?Q /jo[oQ_? j[Qoko[oQ??l/[/Sn?Z?S_ /noZ߁X߯oq<g+a :N2-2nd Bulle &&&  2( P hp x (#223  ..8.` hp x (#8 &&&<33 :P1-Stand Par  &&&,  &&&\  `&Times New Roman(.3$ !USUS.,  (EGMSY_ekqAutoList601.1.1.1.1.1.1.1.1.1.(EGMSY_ekqAutoList521.1.1.1.1.1.1.1.*+ (_2623  ..     8h  wxyz`EGKQUY]aeAutoList11"1)""""""1)a)(.(3($ !USUS.,      0  (#$  0  *D+D (_25   ," <DL,23  ..," <DL,   1.(եEGMSY_ekqAutoList781.1.1.1.1.1.1.1.  ($USUS.,    7    _XXTheWindowRock,ArizonaLCOandnineLCOsinPuertoRicowereomittedduetoinsufficient  administrativedata.] ( c WPWin 6.0/OLE 1.0 Prefix Information MarkerPresentations.Drawing.10ࡱ> 8  !"#$%&'()*+,-./01234567:;<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYRoot EntryPRP'X)Ole WPG20dfCompObj} PRP'Corel Presentations 10 Drawing Embed SourcePresentations.Drawing.109qWPCaf(*(*"5139hD !(*   !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~a}sϏO/?oL߯O? ?O??O??̅{3OD_/_3߬.7_/o.ߓ3o/_2;)ߜ?A?>2_?_O/+.? ?5_/o+_?1oo//_7) O:+?AO=?0/=?$o-+?._ O??4+0?/"4?)$_8+o@o=??O/;?'?.+?. ?3_,/?/$3?O*&_6+@=?O~pP00.`/? 0:p? O_/>?Z +@2__o/: . Oo? P/0$2pP00*/%_050m``<pP 0- O_?8_  _ .O*?.o1_? ,??- O 0&_1*O'5*? ?<￟? ߿_. ?7/ ??0Ͽ? ߂0o __2/ _-߿/ ?Ͽ. 2 O 1￟? ߿_.Ͽ? OO 6 ς?_ <￟? ߿_ ??0??6/ ?2 o3 /3/O0 0o4? _ 3 ??2  7? ?> o? ??~)p8P?0P`5/ /P@[E/0< b/8/Q0? 3)pT/ ` `j` ~`0@/O`  5/ _@?2 F0$`2@?a/ op04@ _ ?@=`0PM / _@6@ @D `Ip P~ W`:O _"020 3 $ 2/P p0 & /PU? = '2 @ >p 0'~@b/  90 ?@ZPO?P3  ?p9 ?`00 bP`V _1@ _W?P= O =07~.. ?`?8 z@p0B  9Pp`@6P/9 _ @\Q@? p5 @<_h ~ 0.@0 2p/ ?/6`j!?2`߿<p&P.@@￯`40 < 03p 50dp`H?~VP@ 1 o@0P2 [P?PT?  @`1P 0&.P@P QP 02[0P p?P= ,~0`PM$@RWa? o/p20?/0/ = 6~pMp pRP oppO t~pPL`/O@[40 @PPP t~p0L ` Z/0xp^p `t~pK / `?[px0`/00/Ps~fp/@JP O o@O@ `m0  ? s~f0 J   Pp0l@P`pOr~f ?H/ pp/O@ 0 o@k@O?`_P `r~f@ `Gp ? 0N P 0j/P` r~gp `F @0 NP 0 ? @h_/PP @@@q~g D@ /pN P pgP ? q~gp _@C/ @  M`/ @O  d0oo@PPP` _p~h/ @0 ?@oN O` ?Ѐb/`O _ `p~i op?p `?`M0 @  @_/p_ P  p~i  @=  Mp_ ? P  \@//P @@o~j0  FPON__Ѐ`?ߐX _O Op ` o~k0?߀90u`HOPNoP`opS @___`C@:P  _n~l0/`8p @jH N `@J߿/_p@_?D :?   O pn~m _0`?O`/?߀@?/Y_ߠ `/O] 9@  n~n?πJo@O0o@ _`V? @`? o]p9` P/0m~pP_0J  P/? T?0? _08_`` m~q/π`Kp/Q@O@ ?PUo`oP` Pl~s@П߃ L 0R_`BO/ PoߐIσ9/0 Opl~u`?0 @`M0 S?O_Ao А [0@p`80 l~vO0 /pT0_ ?/H@_ O0p`/0k~x /  -@  UP /@ /J@? 0 ?pPP` k~z@П 7@@oW_ _` /L 0@Po  p Pj~|`o /,?`W/ 0? _PMP/@ ?pj~} o +   X@   N0/ ?p0/ j~@/ +P 0POZ ?@p `NO@`?  ``? i~_ _ *POPZP 0/ O  ` i~/ P+P  Z0 O 0O@O@0o ?P`(`i~ + @p?[0 p8r  P  )`h~0s @+@ o@[p? 8Ps@_ @P0/P:0q  ?*:,~t` *0O p [ P 0QP09r`? OP+? g~p0@M` `+@ p/[@ ./0L OQ `/p0@K `?? /`0P~06  0[p. &M[ /0}0_ P `/ &~@M06@/@0 [8p0U0@L OPP ?`8P0~00N6 /Z 80p@M@00L  Op .0~`?0PN 6`?@ p c.P0`?0`Mp/ `? -`/0`~  PX`,p @oc .P0PXQ / 0P N OP`/ ` - 0` ~@@@O0 -?b`.0 @N 0QP 00@P@O@_ ` `.@P/@~p.``@ ?. @d0PC@0/@P@.P@`PP / P0pP p ?P-pO.0/ X 1?O?1?O///??o1  /1O4  5 )_! ?- O~ / OO4@0Wp" PS`@/ /p/@`4?pP1 p 1 / OOQp/  4"00(!P?@, / OO ~p/  _? 00 /# U`_?0SF?0P`N@p=@ P2pS ?0O?p'@?P"` -p~`@_?@/`02p_ /  < 1  p?^p`1?po/?@OO _ 2`@_?@5@_ />pFp# ?@,`@_?@~O`06`_?@3/ /@?2"7`F02 _0`6 2p 4Op06 @2"@,@?# O -Op0~`?`0o@6o04/ `W[ >@`O?`3@`6`o3P 0    4`?`0o@U 1PP/ $ O ,`?`0O@~p8_p` 5/ o` V@\/D@_4pOp8P> 0O ?6pWp/ <@00%@?%P -p  ?2 O _9/ ߏ/-Ͽo ? O-_? ?0 ? 7 ?/2 ? ? 1߿ ρ_ /8 ?4￟/ o ?(ϯ_ ?/ "/_߿/ o+ ?  ? 3 o_ _;_/oￏ_ -?,?,o ?0 /? 9_ ?ߏ2 O 2(/: ? 5?o_(-"O o+ ?  OO/ 4?? >?/-/,?,_ ?0/_o? ; /_O 3Oo? 3'o= OO/ 6?O(-"? ?, O_/  /5!@O$/-?,? ?0!O=?4!/3%?/7/?'-" /-/ o6oC? 0-?,__?0@o65#?Co7 '-O"/o _9ϏO_G__2-,??1o?C_o9?6/_F_9'-?!o0__/?ϟo?/Lo/?5﮿,ϐ?6O/_HOO?_/O9ߝN_/;'߭!ߒ3_/ϟO?/?_G߿?/?ORo??_Ƈ;o??_OϏ??oHϯo??OϟO?/?_lϟO?/?_AJPO?[?_o/O߁o?P/[_O ~P@cPO?/0   $.O]  TO)F 0ooo/?_No%?c o  O&/-] _ TO+G O/?/L??$c~  &//-Ph `O]*@R.?pPp@3/0J?P$Pc /'o._oWO,I0Ooϯ/H$c O(.O/`/_YO-I?0/ _G$Od ?(.a_o o?Z?-J0??O F%d ?(o /Z-??JO0o/ /)??O [oo.oJ/0O_?)? /\?O/o??-J/0_O?o(O] /o-I_0o__O ?/o _?߃?/o//__?/o? ߏ?/ _?o?? /o/?oO?? ߁?ߏ?O?O o_ o?? ߂o?__O?_ _o//?/O//o?ߏ?__/Oo? O?o _?_/O _?o___/O/_o o /??_ ?  ?_/  ?? ??__    OO_O__?/ _ O  o? ? ?_?/ ? ??? ??? _?O_ O /_o_? O? _ o _ // o  /  O?_/ oO   ?/ ??/  / ? ??? oo/ oo/ o_? __/?/ _ߟ/_? ?_?oO   O_/ o/ o o/o/  o _ OOo?? //_ _?߯_/o _/o __? _ ? _o /  ?oO  o / o_ ?/? ? /o ? ? ?o_ //? __ _//? _oO /o_? /? /oo/??  ? ?O/ _ /  oO ? O/  O o/ _  _/ o  _/? o//_? _ o??oo_? _ / Oo/_? /?O? ? /_O //? ?/ O o /?     _ ? _ ?OO_o   ?// ?_o_ /o_   ?/߿/?/_  / O??/? O  / /o _ o_O/ O//  ?? O_   !_/ / _ Oo/o   _O ?/ ? _O _ o/ ??// O _/ O?/_   o    /_?? O߿? /_ _ o/ ?_? O o" O ? ?/_? /? O/ o O/  /?   //O/  // O? __ o /  ?ooO _  ??#/O _ ? /o  _ /? ?_ O_   ?O_Oo_ ?  / _ ? O ?_O/?  /?O /O  #  ??? /? ?   _o   oo O OoO_? /O? O_O/ _/ o _o ?_ _ # / ?o O?o?O _  ?/OOo_ ?/??  _ _?o?/??__  ??_? ?? ? Oo _O? ?/  // / #o O  ?o   O?O_O//  _  //__ ? OO_o/_/_  ?? /_?_/o _ oo  ?/ O$   ?O? _o ? ?/  /?  /  _// _/ o/ oo  _ ooo/  ?/ _  _  ?$   o O  ?_ OO   _? OO _?ߏ _/ O_ o _ _/o ?? _ _oO  _? /? ? /O o$? O/ ?/ O_O  o_??   o  o OO?o _?_/o  ?o?? / /? O  /o /o   o  O ?$? ? O__??/O  ?/O? _"_  ?O   _  /O   ??_ _ ?// o /o o ???o? ?    _ # o _?oo o O/O%/ ?  _  ?? _ ?_O O_??oO/  /  ?? o?O o /  ? o$  /o?O?_  /+/   /?  _ _ /? _O/o/?/  O  o ?? ? _ _ _/O?$o  _?oo_? ?O ?+_ O    O  _/? oO   _ ~ 0(P ?P  p/   p@ P/@P$@0 _/`@ OP00@P_@P/@@ PO`>0 PP  @  `_ P`PP P %p`_ 0POP / p  P/p@    Pp/0/__o   _  ?_$? ? O O///_ ? o_  /O    _  /OOoO??//o??_ O_ / /? o/ / /  ??  o ?#_  o /__O ?_ O?/  o/   _ O  ? O  ?/_?/ ? oo_??o  ?  /?O ~@` / @/P  /? 0 `?/  @/  O@@#  @0/ P0/0@ p0 ?p@/0__`@ @0/ @ Po0/ P Pp0 `O`oP  @P @P @@ ?  0  @p P/0 Pp @Џ_0 `0@`P?o@ ?P ?0 @ /pO` 0 O _ ??  ? _ ? ?O/O/$? _O/ o O O ?_/  _?? /  _ /  o O?? ?/ OO/?o? oo? o ?o _ O/    _oo/_$ / ? ߿  ?_/? OOOߏ/ O ? _ oO  ? oOO_?ߟ?o ?/?O/oO// _O / ?_ _ ??????O?   /!o O_ߟ/O  oO/oO? _o/?? o/Ϗo / _ oO? /o?o??/o??__oo ? ?OO/      ? ?  _!O / ? ?O ?_  o _  ?  /  o /?_ _?/_   ?  /? / _   _ o_?/ Oo  ? oo O? _?  o ? /?/ ? O  ? ? //? o  O  ?  o  _   //_ ?O/?߄  O?/!ߊOO/oτ?o ?OO?_  _? o?/_ ߄  OO?o?oO _?O  //o ?? 4߿%_V _@aD\߿m߿`Ͽ*Ͽ)Ͽ@\bi\Ooj_\_Poj?\?Q /jo[oQ_? j[Qoko[oQ??l/[/Sn?Z?S_ /noZ߁X߯oqBOlePartOlePres0009&@V ?    V   HC 0;0;(;0@;  !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~_O___?/O??OO/??//???_/o???????????O_??_?//??o??O??__/???_???O?O?OO????????????/??_????????O?????????/O?OO???????????????????????߿??????????????/?????O????????_?????????????????/???OO?????/?o????/???????ooo????????/O??_?????/?_OoO/?O_???/?o??__?lϏ/?o߯O??O METAFILEPICTV?V     V   HC 0;0;(;0@;  !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~_O___?/O??OO/??//???_/o???????????O_??_?//??o??O??__/???_???O?O?OO????????????/??_????????O?????????/O?OO???????????????????????߿??????????????/?????O????????_?????????????????/???OO?????/?o????/???????ooo????????/O??_?????/?_OoO/?O_???/?o??__?lϏ/?o߯O??O0BEGMS]ciouAutoList561.1.1.1 1.1.1.1.1. d1."n  8 8  d 8h      wxyzhsCEIMQUY]aAutoList7""""""""i)1)a)p1.   88  wxyzhEGKOSW[_cAutoList10"""""""")1)a)  wxyzhEEGKOSW[_cAutoList14"""""""")1)a) 8h*5+5 (_24  ) <DL)23  ..) <DL)  1.1   ($USUS.,    17    _XXAlsoknownasdeletes,theseareNRFUaddressesthatareremovedfromtheenumerationprocessbecause  theaddressnolongerqualifiestobeincludedintheinventoryofresidentialaddressesforthecensus.Examplesof t nonexistentunitsincludeunitsthathavebeendemolishedorburneddown,duplicatesofotheraddresses, 8 nonresidentialaddresses,andvacantunitsthathavebeencondemned.#XXf#Y XX1.(%EGMSY_ekqAutoList611.1.1.1.1.1.1.1.*2+2 (_23 ` &<<DL&23  ..&<<DL& ` 1.(5EGMSY_ekqAutoList621.1.1.1.1.1.1.1.*/+/ (_22  #DL#23  ..#DL#   8h(եEGMSY_ekqAutoList841.1.1.1.1.1.1.1.1.(EEGMSY_ekqAutoList631.1.1.1.1.1.1.1. 8h1.(UEGMSY_ekqAutoList641.1.1.1.1.1.1.1. 8h1.(eEGMSY_ekqAutoList651.1.1.1.1.1.1.1. F ($USUS.,    23    _XXRefertoMoul(2002)foradditionaldatapertainingtothedistributionsofaddedanddeletedaddressesby  typeofaddressandunittype.#XXf#1. 8h u ($USUS.,    24    _XXNRFUoccurredinTEA1(mailout/mailback),TEA2(Update/Leave),TEA6(militaryinUpdate/Leave),  TEA7(UrbanUpdate/Leave),andTEA9(Update/Leaveconvertedfrommailout/mailback).#XXf#(uEGMSY_ekqAutoList661.1.1.1.1.1.1.1.1.Pd  ($USUS.,    25    _XXHUsaddedduringU/L(March2000)werenotprocessedintimetoupdatetheNRFUaddressregisters.  Consequently,NRFUenumeratorsmayhaveaddedthesameaddressesagainandthusinflatedthepercentageof t addedaddressesinTEAs2and9.#XXf#(EGMSY_ekqAutoList671.1.1.1.1.1.1.1.1.Kr`Wingdings 8h j ($USUS.,    45    _XXUnitsthatwereidentifiedasvacantordeleteintwopreviouscensusoperations,unitsidentifiedas  seasonalvacants,andunitsidentifiedasundeliverableasaddressedwereexcludedfromtheCIFUworkload. f ($USUS.,    26    _Y XX YThefieldoperationsexpensedoesnotincludeCensusHQ,regionalinfrastructurecosts,orPuertoRico  anditexcludesanyreworkedcases.#Y #    1.*,+, (_21   DL 23  .. DL  1.  ($USUS.,    28    _XXOfthe520LCOs,300wereTypeCoffices.Theseoffices,whichincludedsuburbanareas,smalland  mediumsizecities,towns,andruralareas,usedtheU/L,mailout/mailback,andruralUpdate/Enumerate t enumerationmethodologies.(ťEGMSY_ekqAutoList831.1.1.1.1.1.1.1. 8h  ($USUS.,    29    _Y XX YThiswasnotthefinalCensus2000modelusedforbudgetformulation.Theallocationmodelcontaineda  contingencyreserveheldbytheDecennialManagementDivisiontosupportvariablepayratesandvariabilityin t workloadsizeforLCOs.#Y #(uEGMSY_ekqAutoList721.1.1.1.1.1.1.1.1.  ($USUS.,    34    _XXԀ AnMCD[mobilecomputingdevice]isasmallelectronicdevicethathasselfcontainedprocessing  units,containswirelesstelecommunicationscapabilities,andiseasilytransportable.Thesedevicesalsoarereferred t toaspersonaldigitalassistants,palmtops,andhandheldcomputers.(Gore2002).*)+) (_20 h DDL23  ..DDL h  @ ($USUS.,    30    _Y XX YTheDSCMOredeliveredcorrectedNRFUfileswithoutcausinganydelayintheNRFUoperations  schedule.#Y # `     #Xd#    ($USUS.,    8    _XXWithintheapplicantgroupingsonselectioncertificates(preferenceandnonpreferencecandidates),  applicantswereprioritizedintestscoreorderwiththehighesttestscoreapplicantsappearingatthetopofeach t groupingofcandidates.Unlessalanguageorotherspecialskillwasneeded,theLCOshiredapplicantsusingtest 8 scoreastheprimaryselectingcriteria.Westatsanalysisindicatesthatapplicantswithtestscoresabove82 L completedNRFUnosoonerthanapplicantswithatestscoreof82.  ($USUS.,    31    _Y XX YNRFUenumeratorsweregivensupplementaryDSCMOproducedaddresslistingscontainingsurname  data.Theenumeratorsreceivedadditionaltrainingonhowtobestusetheselistingsinthefield.#Y #    I. 8h 8h*&+& (_19  L23  ..L  *#+# (_18   L23  .. L  *>> (_17  2( 4 <DL223  Ԁ2( 4 <DL2  *DD (_16   ," <DL,23  Ԁ," <DL,   i)*55 (_15  ) <DL)23  Ԁ) <DL)    ($USUS.,    33    _Y XX YIncludedarerecommendationsfromMoul(2002)andMonaco(2002).#Y #    *22 (_14 ` &<<DL&23  Ԁ&<<DL& ` (EGMSY_ekqAutoList801.1.1.1.1.1.1.1.1.  8 8 *// (_13  #DL#23  Ԁ#DL#  1.*,, (_12   DL 23  Ԁ DL  (EGMSY_ekqAutoList811.1.1.1.1.1.1.1. 8 ($USUS.,    35    _XXBydesign,theimpactoftrainingeffectivenessonorganizationperformance(levelfour)wasnotincluded  intheevaluation.#XXf# 1.(9 Z 6Times New Roman Regular    8 8 *)) (_11 h DDL23  ԀDDL h *&& (_10  L23  ԀL  (## &_9   L23  Ԁ L        ($USUS.,    38    _XXThereferencestoobservationsinSections4.7.9through4.7.15pertaintofieldobserverswhoused  observationprotocolsdevelopedbytheCenterforSurveyMethodsResearch(CSMR),FieldTrainingandCareer t DevelopmentOffice(FTCDO),andFLDtoobserveandrecordtheperformanceofNRFUenumerators.#XXf#http://www.census.gov/pred/www/.(>> &_8  2( 4 <DL223  2( 4 <DL2    8 8 (DD &_7   ," <DL,23  ," <DL,    ($USUS.,    6    _XXSeefootnote4.TABLE I x ($USUS.,    37    _XXObserverstoldenumeratorstheywerebeingobservedaspartofanevaluationofNRFUtrainingandthat  theresultswouldnotbeusedtoevaluatetheirperformance.Additionally,enumeratorsobservedbyHQstaffand t externalcontractorsweretoldthattheobservationresultswouldnotbesharedwiththeircrewleaderorotherLCO 8 staff#ƅ#.#XXf#  8 8 (55 &_6  ) <DL)23  ) <DL)      (22 &_5 ` &<<DL&23  &<<DL& ` (// &_4  #DL#23  #DL#  (,, &_3   DL 23   DL  1.()) &_2 h DDL23  DDL h       8 8 (&& &_1  L23  L   8h&## $_   L23   L      <:Default Para.mm,Title     2( 4 <DL2    2( 4 <DL2  TABLE ADTABLE E  ѤTABLE G 8ht    TABLE D  ($USUS.,    40    _XXTheseareasincludedthefollowingtypesofenumeration(TEA)areas:mailout/mailback(TEA1),  Update/Leave(TEA2),Military(TEA6),UrbanUpdate/Leave(TEA7),andmailout/mailbackconvertedto t Update/Leave(TEA9).#XXf# ; ($USUS.,    41    _XXIncludesactualmailreturnquestionnaires,BeCountedforms,Internetreturns,andresponsesfrom  TelephoneQuestionnaireAssistance,andCoverageEditFollowup.TABLE B  ($USUS.,    42    _XXUndeliverableasaddressed(UAA)questionnairesaswellasdeletedaddressesfromTEA2andTEA7  areaswereexcludedfromthedenominator.Tobeincludedinthedenominator,addressesmusthavebeenaddedto t theDMAFthroughanoperationthatoccurredpriortoNRFU.#XXf# ~ ($USUS.,    43    _XXPersonswhoseageandyearofbirthtotaledsomethingotherthan2000or1999wereeliminatedfromthe  analysis.Thisreducedtheuniversefortheanalysisphasetoabout244.2millionpersons.#XXf# 0 ($USUS.,    11    _Y XX YAlatemailreturn(LMR)operationsubsequentlyidentifiedabout2.5millionHUsthatwerecheckedin  aftertheinitialNRFUuniversewasidentified.B   (9,page9,R7) WC  ԀThesespecificaddressesweremanuallyremovedfromtheNRFU t workloadattheappropriateLCOs.AsaresultoftheLMRoperation,thenationalNRFUworkloadwasreducedto 8 42.3millionHUsor35.6percentoftheeligibleuniverse.B   (9,page9,_ԍR8) C  #Y # 'USUS.,  _   OIXX#XX OII#  ($USUS.,    12    _Y XX YMorethan98percentofNRFUenumeratorquestionnaireswerecheckedinsometimeduringtheofficial  NRFUstartandenddates.B   (9,page10,_ԍR9) ?C  ԀAbout1.6percentoftheNRFUworkloadwascheckedinaftertheendofNRFU.B   (9,page10,R10) C  ԀThese t wereprimarilypopulationunknown(code99)casesorlostquestionnairesthatwererecontactedduringtheResidual 8 NRFUoperation.#Y #  ($USUS.,    44    _Y XX#XX Yf#XXBecausetheCensus2000age/dateofbirthquestionaskedforeachpersonsfulldateofbirth,theCensus  Bureauwasabletodevelopadistributionofdatesofbirthforeachdayofcalendaryear2000.#XX#  ($USUS.,    14    _XXWeeks2through18aresevendayweeksSundaythroughSaturday.Tobeconsistentwiththeother  weeks,Week1shouldhavestartedApril23.Sincetherewereonly37NRFUquestionnairescheckedinonApril21 t andnoquestionnairescheckedinonApril22,thesedayswereincludedwithWeek1.#XXf#(O$  ($USUS.,    20    _Y XX#XX Yf#XXdTheDRF2wasusedtoobtaindatafromtheRespondentInformationandInterviewSummarysectionsof  theenumeratorquestionnaire.ThetableincludesdataforPuertoRicoandexcludesdatafortheHialeah,LCO.#dXXd##XXXdX#{ ($USUS.,    4    _XXTheWindowRock,ArizonaLCOwasomittedfromthestudyduetoincompletedata.#XXe#TABLE D,STABLE CKTABLE AA,*AZ"Arial Regular  ($USUS.,    9    _XXԀThediscussionoffieldverificationislimitedtotheBeCounted/TelephoneQuestionnaireAssistanceField  Verification(BC/TQA)operationanddoesnotincludeanyprecensusfieldverificationactivitiessuchastheLocal t UpdateofCensusAddresses(LUCA)FieldVerificationprogram.#XXe# ( ($USUS.,    36    _XX{BothprotocolsweredevelopedbystafffromtheCenterforSurveyMethodsResearch(CSMR),Field 8 TrainingandCareerDevelopmentOffice(FTCDO),andFLDbasedoninputfromthedecennialareasregarding  whichworkbehaviorswouldhavethegreatestimpactoncensusdataquality.#{XRX{f##XXX{XR#  ($USUS.,    1    _XXSourcesforthissectioninclude:(a)Census2000OperationalPlan;(b)200YearsofCensusTaking:  PopulationandHousingQuestions,1790!1990##;_(c_)TwentyCensuses!PopulationandHousingQuestions;(d) t MeasuringAmerica:TheDecennialCensusesFrom1790!2000;(e)TwoHundredYearsandCounting:The1990 8 Census;(f)1990CensusofPopulationandHousingHistory(PartsAandD);(g)1980CensusofPopulationand L Housing!History;(h)1970CensusofPopulationandHousing!ProceduralHistory;(_i_)ProceduralHistoryofthe  1960CensusesofPopulationandHousing;(j)The1950Censuses!HowTheyWereTaken,ProceduralStudiesof  the1950Censuses;and(k)ProceduralHistoryofthe1940CensusofPopulationandHousing.  ($USUS.,    2    _XXXXXXThefirststageofthe1960processwasdesignedtoconcentrateprimarilyoncoverage,withthegoalof  providingimprovedcountsofpeopleandhousingunits.Duringthesecondstageofthe1960enumeration,the t censusenumeratorsconcentratedprimarilyoncollectingacceptablesampleinformationonthevarioussubjects 8 coveredbythecensuses.Theseparationoftheenumerationintotwostageswasintendedtosimplifythejobofthe L enumeratorsanditwashopedthatiftheenumeratorsforeachstagehadfewertaskstoperform,theywouldmaster  thembetter#e#.#XX#yTABLE OTABLE E 1 ($USUS.,    27    _XXThesedata,whichwereobtainedfromMonaco(2002),includeNRFU,POP99,ResidualNRFU,and  Reinterviewcases.Theydonotcontainanyreworkedcases. TABLE DTABLE A     ($USUS.,    3    _XXԀFrontloadingis, theCensusBureauspracticeofhiringandtrainingapproximatelytwiceasmany  enumeratorsasneededfordecennialfieldoperationstocompensatefornoshows,dropouts,andexpectedturnover. t (Gore2002).#XXe#  ($USUS.,    10    _XXNRFUoperationalplanswerebasedona70percentmailresponserate.Whenthe1990Censusmail  responserateturnedouttobe63percent,theworkloadwasnotablyincreasedandmorefieldstaffwereneeded.#XXf#(hH  Z6Times New Roman Regular(hH  Z 6Times New Roman Regular(hH  Z6Times New Roman Regular(UEGMSY_ekqAutoList701.1.1.1.1.1.1.1.1.(eEGMSY_ekqAutoList711.1.1.1.1.1.1.1.1. I ($USUS.,    21    _XXNotethatthepercentageofoccurrencesforeachcategoryinthetableisnottotaledundertheTotalForms  column.Thisisbecausethecategoriesarenotmutuallyexclusive.Forexample,anenumeratorfilledquestionnaire t couldbeapartialinterviewcompletedinSpanish,oraproxyinterviewthatwascompletedduringtheFinalAttempt 8 phaseofNRFU.#XXf#(EGMSY_ekqAutoList731.1.1.1.1.1.1.1.1.(EGQ[eoyAutoList741.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 1.1 !USUS.,  _8hU OIXX  t?<dO=%t?E;dOF<t?>>u@@dO?-t?A5dOB3t?IJuKLdOJ)dO6 dO4t?:Euut?dOdOudO}uu u!u"u#@$u&dO%dO'u)dO1Duuu u u u uuuudO-@.1u,t?+ BCensus2000Testing,Experimentation, B andEvaluationProgram#XX OIn#0 h 0h(#h(#0(#(#0p(#(#0p(#p(#0 (#(#September30,2003|: (# (# A]) xdExA t   V TopicReportSeries,No.13  o U   `     h      p      x FXX  DATACOLLECTION I   inCensus2000 G  #XXFL#k OIXX#XX OI# OIXX#XX OI6#Qualityassuranceprocedureswereappliedthroughoutthecreationofthisreport. i' Thistopicreportintegratesfindingsandprovidescontextandbackgroundforinterpretationof A resultsfromCensus2000evaluations,tests,andotherresearchundertakenbytheU.S. - CensusBureau.Itispartofabroadprogram,theCensus2000Testing,Experimentation,and  Evaluationprogram,designedtoassessCensus2000andtoinform2010Censusplanning.    Preparedby: )#" ChristineL.HoughandFredR.Borsa *$#   A]) xdE*xA *%$   m9)%`|0,I `(*E.,II+m (#(#(#(#Planning,ResearchandEvaluationDivision *%% andContractor +&&  x #-~(((#(# # B    8h8XXdd8    TheCensus2000Test,Experimentation,andEvaluationProgramprovidesmeasuresof  effectivenessfortheCensus2000design,operations,systems,andprocessesandprovides  informationonthevalueofnewordifferentmethodologies.Theresultsandrecommendations t fromtheseanalysesprovidevaluableinformationcrucialtoplanningthe2010Census.By ` providingmeasuresofhowwellCensus2000wasconducted,thisprogramfullysupportsthe L  CensusBureausstrategytointegratethe2010earlyplanningprocesswithongoingMaster 8  AddressFile/TopologicallyIntegratedGeographicEncodingandReferencing(_MAF_/TIGER) $ t enhancementsandtheannualAmericanCommunitySurvey.Thepurposeofthereportthat  ` followsistosynthesizeresultsfromCensus2000evaluations,experiments,andother  L  assessmentsandtomakerecommendationsforplanningthe2010Census.Census2000Testing,  8  Experimentation,andEvaluationreportsareavailableontheCensusBureausInternetsiteat: $  4+ YO  5  http://www.census.gov/pred/www/. 6;YOO  7 }       E     TABLEOFCONTENTS   *,X'` XX* (B03" 3"   32B  1  .3  0 '   Introduction#""J(#. '(#'(##1 3݌ t Ќ  ! ! ( 802.0 ' Scope#""J(#.'(#'(##4 L   (ť88! !" 3"   32ť  3  .3  0 '   Limits#""J(#.//'(#'(##6 3<݌ $ t Ќ  4.0 ' Findings#""J(#.'(#'(##6  L  9,X'4` X,X'` X90 ' 4.104'(#'(#Recruiting,PayRates,andFrontloading#""J(#.94(#4(##6 $   (%88! !0 ' 4.204'(#'(#FieldVerification#`"`"I(#. #4(#4(##13   0 ' 4.304'(#'(#Update/LeaveandUrbanUpdate/Leave(stateside)#`"`"I(#.@4(#4(##16    ' 4.40 4 Update/LeaveinPuertoRico#`"`"I(#.DD,4(#4(##18   0 ' 4.504'(#'(#Update/EnumerateandList/Enumerate#`"`"I(#.\\44(#4(##19   0 ' 4.604'(#'(#NonresponseFollowup(andToolKitMethods)#`"`"I(#.<4(#4(##21 p 0 ' 4.704'(#'(#NRFUEnumeratorTrainingandAdministeringthe\4(#4(#  '  4 Questionnaire`"`"I(#. 38 H 0 ' 4.804'(#'(#QuestionnaireAssistanceCenters#`"`"I(#.14(#4(##46 4 0 ' 4.904'(#'(#CensusDay(April1,2000)astheReferenceDate#`"`"I(#.A4(#4(##49  p  (e88! !0 ' 4.1004'(#'(#CoverageImprovementFollowup#`"`"I(#..4(#4(##51  \  '  4  `  |(88 ! !" 3"   32  5  .3  0 '   SynthesisofFindingsandRecommendationsforFutureStudy#`"`"I(#.G'(#'(##52 3 ݌ 4 Ќ  0 ' Acknowledgments#`"`"I(#. '(#'(##55   0 ' References#`"`"I(#. '(#'(##56   (88|! !   I!  l t! ! (88   LISTOFTABLES   4"?,X'A X,X'4` X?Table1:0  RecruitingPerformanceGroups#""J(#.ss/(#(##8  Table2:0  FieldVerificationWorkload#`"`"I(#.aa-(#(##14 ` Table3:0  FieldVerificationWorkloadbyTypeofEnumerationArea(TEA)#`"`"I(#.O(#(##15 8  Table4:0  DistributionofNRFUQuestionnairesCheckedinby `(#(# 0 ' 0'(#'(#WeekandbyFormType#`"`"I(#.??'(#(##24  L  Table5:0  NRFUHUStatusbyFromType#`"`"I(#.-(#(##27 $  Table6:0  CharacteristicsofNRFUEnumeratorQuestionnairesbyFormType#`"`"I(#.P(#(##28   Table7:0  DistributionofRespondentTypebyFormType#`"`"I(#.cc>(#(##29   Table8:0  DistributionofRespondentTypebyHUStatusforPartialInterviews#`"`"I(#.U(#(##30 \  '    A    h      p   Table9:0  TotalCostforFieldandOfficeOperations#`"`"I(#.<(#(##32 4 Table10:0  dXXXX SummaryofFieldOperationCostforNRFU(includingPOP99s)#XXXdX'##`"`"I(#.M(#(##32  \ Table11:0  PercentofVariancedXXXX(NRFU,RNRFU,POP99s,Reinterview)#XXXdX(##`"`"I(#.J(#(##33 4 Table12:0  EvaluationLevelsofKirkpatrickModel#`"`"I(#.8(#(##40   Table13:0  Numberof2000CensusQuestionnaireAssistanceCentersandTypesofCensus  TractswithQuestionnaireAssistanceCenters#`"`"I(#.>(#(##47   '    A    h      p       (ť88  |*%) t t t  " 3"   3K,2ť  1  .3  0 '   Introduction _g #  1      _Ԁ 3K,x,݌'(#'(#   ! !Q+ ` hp x ,X'A XQXXXXWiththegoaltoobtainacompletedquestionnaireforeveryhousingunitinCensus2000,the  UnitedStatesCensusBureauusedthreebasicdatacollectionmethodsandotherspecialstrategies x toensuredeliveryofquestionnairestoeveryhousingunit.#XXXX.#XXXXThebasicmethodsincluded doorto d doorcanvassing,avariationofwhichhasbeendonesincethefirstcensusin1790,theuseofthe P  postalservicetobothdeliverquestionnairesandreceivequestionnaireresponses <  (_mailout_/mailback),whichwasinitiatedinthe1970census,andthepersonaldeliveryofcensus ( x questionnairestotherespondentswithinstructionsforthemtomailthecompletedquestionnaires  d backtotheCensusBureau(update/leave).#XXXXz/#XXXXԀThisreport,#XXXX 2#XXXXDataCollectioninCensus2000#XXXX`2#XXXX,  P  synthesizesresultsfromevaluationsandassessmentsthatpertaintothesedatacollection  <  methods.Thisincludes,invaryingdegrees,operationssuchasNonresponseFollowup, (  Update/Leave,UrbanUpdate/Leave,Update/Enumerate,List/Enumerate,CoverageImprovement   Followup,andFieldVerification.Thereporthighlightsthemajorchallengesandsuccessesof   datacollectionoperations,citesresultsfromtheevaluationsandassessments,andincludes   recommendationsforplanninganddesigningfuturedatacollectionoperations.#XXXX2#    Background  ` CensustakingeffortswereinitiatedshortlyafterourfirstPresident,GeorgeWashington,was 8 inauguratedin1790.InaccordancewithArticleI,section2,oftheUnitedStatesConstitution, $t thefirstenumerationoftheinhabitantsoftheUnitedStatesbeganonthefirstMondayofAugust ` inthatsameyear. L From1790to1960,thebasicmethodofcollectingcensusinformationfromthepopulation $ remainedthesame.Itisreferredtoas doortodoorenumeration.XXXXԀThroughoutthisperiod,  however,thecensusschedules,fieldprocedures,training,andquestionnaireswerecontinually  improvedfromthepreviousexperience.Changesorimprovementsrelatedtodatacollectionare  highlightedbelow.  Upto1840,thehousehold,ratherthantheindividual,remainedtheunitofenumerationinthe \  populationcensus.TheU.S.marshalsresponsibleforcollectingdataenteredonlythenamesof H! the householdheadsonthecensusschedules.#XXXX 8#XXXX 4"  From1850through1870,theactthatgovernedthetakingoftheSeventh,Eighth,andNinth  $\" DecennialCensusesinitiatedchangesinthecensusdatacollectionprocess.Themarshalswere $H # required,forthefirsttime,tosubdividetheirdistrictsinto knowncivildivisionssuchas  counties,townships,orwardsandtheywerealsoresponsibleforcheckingthecompletedcensus  worktoensurethatthereturnsoftheirassistantswereproperlycompleted.  #XXXX✦:#XXXXThreeimportantchangeswereinitiatedforthe1880census.Speciallyappointedagents(experts ` assignedtocollecttechnicaldata)alongwithsupervisorsandenumeratorsreplacedmarshalsand L  theirassistants.Enumeratorswereforbiddentodisclosecensusinformation.Inpriorcensuses, 8  censusscheduleswerepostedpublicly.Third,enumeratorsweregivendetailedmapstofollow $ t sothattheycouldaccountforeverystreetorroad,andnotstraybeyondtheirassigned  ` boundaries.  L  The1890censusutilized,forthefirsttimeinhistory,aseparatescheduleforeachfamily.The $  1900censusfeaturedthefirstU.S.censusesconductedoutsideofthecontinentalstatesand   territories.The1910censushadseveralnotablefeatures.Mostimportantlyfromadata   collectionperspective,thiswasthefirsttimethatprospectivecensusemployeeswererequiredto   takeopencompetitiveexaminationsthatwereadministeredthroughoutthecountry.Previously,   startingin1880,appointeeshadbeengivennoncompetitivetestspriortoworkingascensus p enumerators. \ Therewereminorchangesinthescopeandthedatacollectionmethodsofthe1920and1930 4 censuses.However,aprofoundchangewasintroducedwiththecensusof1940.Samplinginthe  p 1940censusallowedfortheadditionofseveralquestionsforjustfivepercentofthehouseholds  \ enumeratedwithoutundulyincreasingtheoverallburdenonrespondentsoronthedata H processingrequirements.Itwasalsothefirsttoincludeacensusofhousingwhichobtaineda 4 varietyoffactsonthegeneralconditionoftheNationshousinginventory.     The1950populationandhousingcensuswasconductedfollowingtheconventionalmethodof  doortodoorenumeration.However,acensustestconductedinOctoberof1948indicatedthat  selfenumerationappearedfeasibleforuseinthecensusofagriculturein1950.Priortothe  actualdecennialcensusinApril1950,anexperimentwasconductedinsixdistrictofficesand l indicatedthatageneral20percentsamplingpatternwouldbefeasibleduringthecensus.This X  samplingpatternwasinstitutedduringthe1950census. D!   Asinallpreviouscensuses,the1960censusstillreliedondoortodoorenumeration.However, #l! itwasthefirsttimethattheUnitedStatesPostalService(USPS)wasusedextensivelytodeliver $X" censusself-administeredquestionnaires.Priortothedoortodoorenumeratorcanvassing $D # operation,theUSPSdeliveredaquestionnairecontainingthe100percentquestionstoevery %0!$ occupiedhousingunit.Householderswereaskedtocompletethequestionnaireandholdituntil &"% thecensusenumeratorcametopickitup.Thiswasregardedasthefirststageinthe1960census. '#& Thesecondstagepertainedtothesamplequestions,whichwereonaseparatequestionnaire.In (#' theurbanareasofthecountry(whichcontainedabout80percentofthepopulation),the )$( enumeratorscarriedthesamplequestionnaireswiththemwhilecanvassingandleftoneatevery |*%)  h+&* Du D D  fourthhouseholdaskingtheoccupantstocompletethesamplequestionnaireandmailitbackto  theCensusBureau.h #  2      ׀  The1970censusintroducedthefirstdatacollectionmethodthatdidnotrequirea100percent t doortodoorcanvassing.Asin1960,theUSPSdeliveredselfadministeredquestionnairesto ` households,butin1970thehouseholdrespondentwasinstructedtomailreturntheirresponses L  backtotheCensusBureau.Thismethodisreferredtoas_mailout_/mailback.Approximately60 8  percentofthepopulation(essentiallyinlargemetropolitanareas)receivedandwereaskedto $ t returntheircensusquestionnairesviathemail.Intheseareas,enumeratorscontactedonlythose  ` householdsthatdidnotreturnquestionnairesorthathadgivenincompleteanswerstothe  L  questions(anonresponsefollowupoperation).Fortheremaining40percentofthepopulation,  8  predominately#XXXX.=#XXXXԀlocatedinruralareas,themailcarriersdeliveredaquestionnairetothehouseholds $  andthehouseholderswereaskedtocompleteandholdthemforpickupbyacensusenumerator.   Theenumeratorswereresponsibleforobtainingmissingorincompleteinformation.Three   hundredandninetythreedistrictofficeswereestablishedinthe50statesandtheDistrictof   Columbia.Inaddition,sixtemporarydistrictofficesandoneareaofficewereestablishedforthe   censusofPuertoRico.In181ofthedistrictoffices,thecensuswastakenintheconventional p (traditional)manner;thatis,anenumeratorvisitedeachhousetocollecttheinformation.In167 \ ofthedistrictoffices,thecensuswastakenbythedecentralizedmailmethod.Thedecentralized H mailmethodinvolvedlisting,byenumerators,thestreetaddressesofeveryhousingunitandthe 4 addressing,byclerks,ofmailingpieces(questionnairepackages)tobemailedtoeveryhousing  p unit.Intheremaining45districtoffices,wherecommercialmailinglistswereavailablefor  \ purchasebytheCensusBureau,thecentralized(_mailout_/mailback)methodwasusedtocollect H thecensusinformation. 4 The1980censusbasicallyinvolvedthesamemethodsusedin1970.The_mailout_/mailback   methodwasusedinareasofthecountrycontaining95.5percentofthepopulationandthe  conventionalmethod(goingdoortodoor)wasusedfortheremainderofthecountry.#XXXXQ#XXXXԀTheUSPS  deliveredaddressedcensusquestionnairestoover80millionhousingunitsattheendofMarch,  1980.Inaddition,byCensusDay,allofthemaildistrictofficeshadtelephonelinesinstalledfor l thepurposeofhelpingrespondentscompletetheirquestionnaires.Alldistrictofficesprovided X  thesameserviceforrespondentswhoappearedinpersonthroughtheuseofwalkinassistance D! centers. 0"  #XXXXNX#?+ ` hp x X?XXXXTheCensusBureauconductedthe1990Censususingthethreebasiccensusmethodologies: $X"  _mailout_/mailback,enumeratordelivery/mailback,andmailoutwithadoortodoorcanvass, $D # (U.S.DepartmentofCommerce1993).Ninetyfivepercentofthepopulationwascountedby %0!$ u    mailcensusprocedures.Notably,the1990Censuswasthefirstnationalcensusthatused  computersatthelocaldistrictofficeleveltocheck-in,monitor,andcheckoutcensus  questionnaires.Fielddatacollectionoperationswerestructured,monitored,andevaluated  throughtheuseofcomputerprogramsavailableatthelocaldistrictofficelevel,the13regional t censuscenters,andthenationalCensusBureauHeadquarters.Applicant,employee,andpayroll ` datawerealsomaintainedonfilesateachofthe449temporarylocaldistrictofficesestablished L  toconductthefielddatacollectionprocedures.The1990Censusinvolvedthemailingor 8  deliveryofover96millionquestionnairestohousingunitsacrosstheUnitedStates. $ t #XXXXZ#XXXXCensus2000markstheculminationof210yearsofcensustaking.Everyeffortwasmadeto  L  ensurethatthefielddatacollectionprocessesemployedwerethemostthoroughandefficient  8  possible.Formorethan80percentofthehouseholdsinthecountry,theUnitedStatesPostal $  Servicedeliveredthecensusquestionnaires.Atthevastmajorityoftheremaininghousingunits,   censusenumeratorspersonallydeliveredquestionnaireswhileupdatingthelistofaddressesfor   theirassignedareas.Intheremainingsparselysettledorremoteareas,censusenumerators   createdanaddresslistand,whiledoingso,enumeratedtheresidentsofeachlistedhousehold.   Refinementsintheuseofcomputertechnologydesignedtoaugmentthefielddatacollection p effortswereinstitutedandnewinnovationssuchastheuseoftheInternettobroadenresponse \ optionswereavailable. H #XXXXh`#XXXXMoredetailedbackgroundinformationonthespecificdatacollectionmethodologiesemployedin  p boththe1990CensusandCensus2000arepresentedinSection4ofthisreport.#XXXXd#XXXX  \ #XXXXe# $'XX$2.0 ' Scope 4'(#'(# ( X'XDf(Thisreportincludesinformationonenumeratorrecruitingandenumeratorpayrates,and   discussesdataqualityintermsoftheactualwordingofquestionsandtheactualreferencedate.  Additionally,thefollowingresearchquestionsareaddressed:     wxyz(o"p8" 3"  $,` XX$ 3~h2o"3  0    Howwelldidfieldoperationswork? 3~hh݌l(#(# Ќ  ! !" 3"   3i2o"3  0    Whatoperationalproblemsoccurredandhowweretheyaddressed? 3ii݌X (#(# Ќ  " 3"   3j2o"3  0    Werefieldoperationscompletedontime? 3jj݌D!(#(# Ќ  " 3"   3pk2o"3  0    Howdidfielddatacollectionschedulesandproceduresaffectdataquality(rateofproxy 0"  response, unclassified,andpartialinterviews)? 3pkk݌#l!(#(# Ќ  " 3"   3l2o"3  0    Howwastheplanningdatabaseused,andwasithelpfulintargetinglocationsfortoolkit $X" applications? 3ll݌$D #(#(# Ќ  " 3"   3m2o"3  0    Howcantheplanningdatabasebeimprovedforfutureuse? 3m+n݌%0!$(#(# Ќ  " 3"   3n2o"3  0    HoweffectivewastrainingfortheNonresponseFollowupOperation? 3no݌&"%(#(# Ќ  " 3"   3o2o"3  0    Howwelldidnonresponseenumeratorsadministertheinstrument? 3op݌'#&(#(# Ќ  " 3"   3p2o"3  0    DidnonresponseenumeratorsadheretoCensusDayasthereferencedate? 3pq݌(#'(#(# Ќ   (8p   wxyzWiththerelativelylargenumberofsourcedocumentsusedtocompilethistopicreport,the |*%) background,studymethodologies,limitations,results,andrecommendationsforeachsourceare h+&* u     presentedseparatelyinSection4ofthereport.Themajorrecommendationsarepresentedin  Section5.Sourcedocumentsincludeonetopicreport,twelveformalevaluations,andtwo  assessmentreports.Theyarelistedbelow.(Notethatthisreportdoesnotintegrateresultsfrom  theAccuracyandCoverageEvaluationdatacollectionoperations.) t    wxyz(o"p8" 3"  3,X, X,` X3 3u2o"3  0    CoverageImprovementinCensus2000Enumerationtopicreport 3uv݌L (#(# Ќ  " 3"   3v2o"3  0    EvaluationoftheUpdate/LeaveOperation(F.10) 3vw݌8 (#(# Ќ  " 3"   3w2o"3  0    UrbanUpdate/Leave(F.11) 3ww݌$ t(#(# Ќ  " 3"   3x2o"3  0    Update/Enumerate(F.12) 3xx݌ `(#(# Ќ  " 3"   3ky2o"3  0    List/Enumerate(F.13) 3kyy݌ L (#(# Ќ  " 3"   36z2o"3  0    Census2000StaffingPrograms,PayComponent(partofG.1) 36zcz݌ 8 (#(# Ќ  " 3"   3&{2o"3  0    Census2000StaffingPrograms,RecruitingComponent(partofG.1) 3&{S{݌$ (#(# Ќ  " 3"   3|2o"3  0    OperationalAnalysisofFieldVerificationOperationforNonIDQuestionnaires(H.2) 3|J|݌ (#(# Ќ  " 3"   3'}2o"3  0    QuestionnaireAssistanceCentersforCensus2000(H.4) 3'}T}݌ (#(# Ќ  " 3 "   3~2o"3  0    NonresponseFollowupforCensus2000(H.5) 3~@~݌ (#(# Ќ  " 3 "   3~2o"3  0    StudyofNonresponseFollowup(NRFU)EnumeratorTraining(H.7) 3~ ݌ (#(# Ќ  " 3 "   32o"3  0    OperationalAnalysisofEnumerationofPuertoRico(H.8) 3݌p(#(# Ќ  " 3 "   3Հ2o"3  0    DateofReferenceforRespondentsofCensus2000(H.10) 3Հ݌\(#(# Ќ  ! !   wxyz(o"pp   wxyz" 3"   3d2o"3  0    AssessmentReportforNonresponseFollowup 3d݌H(#(# Ќ  " 3"   3D2o"3  0    AssessmentofNonTypeofEnumerationArea(TEA)ToolKitMethods 3Dq݌4(#(# Ќ  7,` X,X, Xu7OtherCensus2000topicreportsthatcomplementand/orcoincidewiththeinformationcontained  \ inthisreportaredescribedbelow. H    wxyz(o"pp  wxyz" 3"   32o"3  0    ThetopicreportonCoverageImprovementinCensus2000Enumerationprovides   informationaboutfieldoperationsthatwereintendedtoimprovecoverageofbothhousing   units(HUs)andpersonsinthecensus.Itcomplementsinformationinthisreportand  providesfurtherinsightintotheeffectivenessofthedatacollectioneffort. 3ͅ݌(#(# Ќ  " 3"   32o"3  0    ThetopicreportonPuertoRicoprovidesasynthesisofinformationaboutCensus2000in l PuertoRico,includingfielddatacollection.Giventhis,thisdocumentonDataCollectionin X  Census2000providesacomparisonofdatacollectionmethodsbetween1990and2000,but D! doesnotcoverevaluationresults. 3݌0" (#(# Ќ  " 3"   3"2o"3  0    ThetopicreportonSpecialPlace/GroupQuartersEnumerationprovidesasynthesisof $X" informationaboutSpecialPlace/GroupQuarters(SP/GQ)includingthedevelopmentofthe $D # SP/GQinventory,theenumerationofGQs,andprocessingactivitiesrelatedtoGQ %0!$ enumeration.AlthoughSP/GQswereenumeratedapartfromregularHUs,SP/GQoperations &"% wereamajorpartoftheoverallfielddatacollectioneffortconductedbytheLocalCensus '#& Offices(LCOs). 3"O݌(#'(#(# Ќ   h+&* u     " 3"   3x2o"3  0    ThetopicreportonAddressListDevelopmentinCensus2000providesawidearrayof  informationpertainingtofieldactivitieswhoseprimarypurposewastobuildaddressfiles  andrelatedgeographicdatabases.Whilethemajorityofthesefieldoperationswere  conductedtocollectinformationforMasterAddressFilebuildingpurposes,operationssuch t asUpdate/Leave,Update/EnumerateandList/Enumerateservedadualpurpose:to ` create/updateaddresslistsandtocollectHUandpersoninformationforthecensus.Please L  seetheLimitssection,below. 3x݌8 (#(# Ќ     wxyz(o"pp  wxyz o(8p  wxyz! ! " 3"  *'X,` X* 32  3  .3  0 '   Limits  3]݌ `'(#'(# Ќ  .,` X'X3.AsynthesisofthefieldcollectionmethodsusedinCensus2000islimitedtoonlyafew  8  operations.AlthoughthereareformalevaluationsspecifictoUpdate/Enumerate,List/Enumerate, $  Update/Leave,andUrbanUpdate/Leave,theyfocusonaddresslistdevelopmentandnoton   operationalaspects.Forthesecollectionmethods,thisdocumentonDataCollectioninCensus   2000providesacomparisontowhatwasdonein1990andonlycoversthetimingofthe   operationsinCensus2000.    " 3"  *'X,` X* 32  4  .3  0 '   Findings  3݌\'(#'(# Ќ  .,` X'XÕ.Thissectiondiscussesthebackground,methods,limits,results,andrecommendationsfromeach 4 oftheindividualevaluations,assessments,andauxiliaryreports.  p  (ե88o! ! 4.10  Recruiting,PayRates,andFrontloading u #  3      H(#(# Forthe1990Census,sourceinformationcomesfromU.S.DepartmentofCommerce(1996),and   forCensus2000,fromJacobson,PettaandYudd(2002)andJacobsonandPetta(2002).    4.1.10  Recruiting (#(# ! ! $  wxyz#(x8" 3"  0   323  0(#(#  1990Census  3ܚ݌l(#(# Ќ  Recruitingfordecennialcensuseshasalwaysbeenamonumentalundertaking.Forthe1990 H! Census,staffingrequirementsdictatedthattheCensusBureaurecruitandtestabout2million 4"  applicantsforapproximately500,000temporarypositions.Overall,the1990Censusrecruiting  #p! programwasverysuccessful.Therewereareasofthecountrythatexperiencedshortagesofjob  $\" applicants,especiallywherethecostoflivingwashighandtheunemploymentnumberswere $H # low.Fortheseareas,theCensusBureaumadeupwardadjustmentstoitspayscaleduringthe %4!$ censustoencourageapplicantstoapplyforacensusposition.B   (16,Page618,R1) pC  ԀThisactionprovedsuccessfulin & "% bolsteringtherecruitmentofjobapplicantsintheseareas. ' #& u     ! ! $  wxyz#(xx$  wxyz#" 3"  0   3623  0(#(#  Census_2000 _ 36o݌(#(# Ќ  TheCensus2000recruitingprogramwasalsocomprehensive,farreaching,andhighly x successful.AttheCensusBureausrequest,Westat(Jacobson,Petta,andYudd2002)reviewed d andanalyzedthefactorsaffectingCensus2000recruitingeffortsin519ofthe520LCOsduring P  Census2000.] #  4       <  Westatexaminedtheeffectsofseveraldifferentfactorsonrecruitingincluding:  d ! !   wxyz(o"px$  wxyz#" 3"  0   32o"3  0(#(#  Censuspayrelativetothelocallyprevailingpayrate. 3:݌ < (#(# Ќ  " 3"  0   32o"3  0(#(#  RecruitinggoalsestablishedbyCensusHeadquarters(HQ). 3;݌( (#(# Ќ  " 3"  0   32o"3  0(#(#  ExpectedNonresponseFollowup(NRFU)workloads. 3>݌ (#(# Ќ  " 3"  0   32o"3  0(#(#  Managementturnover. 37݌ (#(# Ќ  " 3"  0   3ܧ2o"3  0(#(#  Areacharacteristicssuchaspopulationdensity,privatefirmemployment,andpercapita   income. 3ܧ݌ (#(# Ќ   4.1.20  RecruitingStudyMethodology   `(#(# _Westat_sanalysisoffactorsaffectingCensus2000recruitingperformancewasmodeledontheir 8 similaranalysisofenumerationperformanceduringthe1990decennialcensus.The $t methodologyincludeddevelopingabenchmarkforcomparingrecruitingperformanceacross ` LCOsT #  5      ׀andplacingeachintooneoffiveperformancegroupsbasedontheextenttowhichthe L _LCO_sperformancedeviatedfromaverage.Table1showsthenumberofLCOsineach 8 performancegroup.ThemethodologythencomparedthecharacteristicsoftheLCOsineach $ performancegrouptoobtainapreliminaryreviewofwhichfactorshadstrongeffectson  performanceandwhichhadweakeffects.Theeffectsofvariousfactorswereexaminedusing  multipleregressionanalysis.     u       $OYTable1  RecruitingPerformanceGroup B  ԍ (1,page11&12,R1) C  s   '*E]Fddd Xdd Xdd X(#(#,Fdd ,dd ,dd +  tt XX   Performance ( GroupҮP 0&!  0F  PerformanceMeasure ( (asofFebruary2000)O 0&!  0  CNumberofLCOsWithin ( EachPerformanceGroupQ XN!    ?1? X  1 ND? @ "  ?1 ?  NExceededrecruitinggoalby60%ormore PF @    ;@27;@ P27 wm@ @ "  ;@27 ;@   @2@ w2 ND?H  "  @2 @  NExceededrecruitinggoalsby25%to59% PFH    E@43E@ P43 wm@H "  E@43 E@   @3@ w3 ND? "  @3 @  NExceededrecruitinggoalsby<25% QG    a@137 a@ Q137 xnA "  a@137  a@   @4@ x4 ND? H "  @4 @  NRecruitingaveraged80%ofgoal H> H    p@258 p@ H  258 xnA H    p@258  p@   @5@x   5 ND?P "  @5 @ NRecruitingaveraged50%ofgoal G=P   K@54K@G  54 XN@P    K@54 K@  X 0&! "  0  Total: QG! 0  8@5198@ Q.  519/ #  6      QGE   8@519  8@  Q#XX$#XX  Source:(Jacobson,Petta,andYudd2002)#XX#    B  C   4.1.30  RecruitingStudyResults  1 8(#(# Analysisofthestudydatayieldednumerousresults.Thisreporthighlightssomeofthekey `  findings. L! ! !   wxyz(o"pp  wxyzTherewasconsiderable variationinrecruitingperformanceacrosstheLCOs.Notably,byApril $# 2000,about82percentofLCOssubstantiallyexceededtheirrecruitinggoals.B   (1,pageiii,  R1) C  OftheLCOsthat $ ultimatelydidnotmeettheirrecruitinggoals,onlyfivefellwellbelow70percentoftheirgoals. % Importantly,everyLCOrecruitedatleastthreeapplicantsforeachenumeratorpositiontobe & filled.B   (1,pageiii,R1) *C   ' Enumeratorpay,relativetothelocallyprevailingrate,wasakeydeterminantofrecruiting `) performance.Thecorrelationbetweenhighcensuspay(relativetoprevailingpay)andabove L* averagerecruitingperformancewasmuchstrongerthanWestatinitiallyexpected.B   (1,pagei,R2) C  Ԁ  8 +  An_LCO_sexpectedNRFUworkloadstronglyinfluenceditsrecruitingefforts.Anincreasein "`- workloadof24,000cases,aboutonestandarddeviation,wasassociatedwitha13percent "L. increaseinqualifiedapplicants.B   (1,page52,R3) PC  ԀTherewasastrongcorrelationbetweenrecruitingperformance #8/ andenumerationperformance.B   (1,Page21,R4)C  Ԁ Thisfindingsuggeststhathighpay,effectivemanagement,and $$ 0 otherfactorsdiscussedintheWestatreportstronglyaffectedbothrecruitingandtheNRFU %!1 enumeration. &"2 Oneofthemoreinterestingfindingspertainedtoapplicanttestscores.Westatobservedthatone (#4 standarddeviationintestscores,anincreasefrom85.6to88.4,wasassociatedwithadecreasein t)$5 u     thenumberofapplicantsofalmost11percent.Thissuggeststhatrecruitingmayhavebeenmore  difficultinareaswheremanypeoplewereapttodowellonthecensustest(evenholdingrelative  wagesandpercapitaincomeconstant).B   (1,Page52,R5) C  ԀIf_Westat_sspeculationiscorrect,theeffectislarge  enoughthatvariationintestscoresshouldbetakenintoaccountwhensettingpayrates,and t LocalCensusOfficeManagers(LCOMs)shouldanticipatetheneedforalternatemethodsto ` boostrecruitinginareaswithhightestscores. L    XXB( 4 <DL,` XB,         <( 4 <DLX<,,&W%      #XX%&W#XXXX&W%XX   #XX%&WL#Westatstatedintheirfindingsthattheydidnothavethedataneededtostatisticallylink $ t cross-regionaldifferencesinrecruitingperformancetospecificmanagementdifferences,nor  c couldtheyentirelyeliminatethepossibilitythatthedifferencesinrecruitingperformancemaybe  R  overstatedbecauseofsomeimportantexogenousfactorsthatwereomittedfromtheirdatabase.  A  Nevertheless,Westathadlittledoubtthatregionalmanagementdifferenceswerethesourceof 0  muchofthevariationinrecruitingperformance.݌   Ќ  XX,,   XX    XX       <( 4 <DLX<,,&W%XX  XX%&W"  "݌   Ќ  XXXX,,   XX      #XXXX-#,XXXX  Westatheldthisviewbecausetheirstatisticalresultsareconsistentwithmoresubjective :  evidencedevelopedduringtheirsitevisitsandthedirectobservationsoftheU.S.CensusBureau & headquartersstaffinterviewed.Inaddition,theytestedtheeffectofabroadrangeofvariables,  andregressionadjustingtheresultsmadeasignificantdifference.Forexample,LosAngeles  unadjustedperformancewasaboutasgoodastheregionwiththebestperformance,butits  adjustedperformancewasintheaveragerange.#XXXX#XXXX  Ѐ#XXXX#XX r 8 "(8p  wxyz<( 4 <DLX<,#XX/##XXXXN#XXXX  Itis_Westat_sviewthattheinfluenceofregionalmanagementissogreatthatitwouldbevery ^ worthwhiletodeterminepreciselywhatmanagerialelementsledtoaboveaveragerecruiting M performance.Basedontheirsitevisits,theyidentifiedthefollowingsixkeyfactorsassociated < withsuperiorrecruiting performance: +{      wxyz(p8"#XXXX✧#" 3"    6"| | <DLX6XXXX, 3|2o"3  0    EncouragingLCOstodevelopplansthatwillleadtomeetingorexceedingthekeygoalslaid F outbyheadquarters,includingdetailedimplementationplansfordealingwithunanticipated 2 challenges; 3|݌n(#(# Ќ  #XXXX#" 3"  9"| | <DL| | X9XXXX 32o"3  0    ProvidingaccurateandtimelyfeedbacktotheLCOMsaboutthestrengthsandweaknessesof  F recruitingineachareaofeachLCO; 39݌!2(#(# Ќ  #XXXX#" 3"  9"| | <DL| | X9XXXX 3x2o"3  0    HelpingLCOMsdevelopeffectivestrategiestodealwithproblemsassoonastheydevelop; 3x݌# !(#(# Ќ  #XXXX#" 3"  9"| | <DL| | X9XXXX 32o"3  0    Providingtimelydirectassistancethroughuseofregionaltechnicians; 3݌% #(#(# Ќ  #XXXXi#" 3"  9"| | <DL| | X9XXXX 3|2o"3  0    AvoidingmicromanagementbygivingbroaddiscretiontotheLCOMstomeetagreedupon j'"% goalsandresolveproblemsinkeepingwithgeneralguidelinesestablishedbytheregion;and 3|݌V(#&(#(# Ќ  #XXXX#" 3"  9"| | <DL| | X9XXXX 3t2o"3  0    RapidlyreplacingLCOMsandAssistantManagersforRecruitingwhoareunabletoeffectively .*~%( identifyandresolveproblems.&W%XX 3t݌+j&)(#(# Ќ    #XX%&W##XXXX#   ,V'* Finally,Westatreportedthatresignations,terminationsforcause,ordeparturesforanyother  reasonbyLCOmanagementstaffduringtherecruitingperiodwereassociatedwithareductionin  thenumberofapplicantsbyapproximately12percent.ThisfindingsuggeststhatLCOMsplayed  akeyroleindeterminingrecruitingsuccessandthatmanagersneededtobeonboardfora t substantialperiodinordertobehighlyeffective.B   (1,Pagei,R6) C   `   * X| | X*4.1.40  RecruitingRecommendations forthe2010Census   8 (#(# . | | X X.Westatidentifiedseveralkeyfactorsassociatedwithsuperiorrecruitingperformance.These  d factorsincluded:  P  " 3"  0,' X| | X00 '  32o"3  0'(#'(#  XXXXEncourageLCOstodevelopplansthatwillmeetorexceedgoalsestablishedbyCensus (  HQ,includingdetailedimplementationplansfordealingwithunanticipatedchallenges. 3݌ (#(# Ќ  " 3"  0 '  3Z2o"3  0'(#'(#  AvoidmicromanagementbygivingbroaddiscretiontotheLCOMstomeetagreedupon   goalsandresolveproblemsinkeepingwithgeneralguidelinesestablishedbytheregion. 3Z݌ (#(# Ќ  #XXXX7#XXXX" 3"  0 '  3'2o"3  0'(#'(#  N+P P hp x (#,' XN#XXXX#XXXXRapidlyreplacing#XXXX#ԀLCOMsandAssistantManagersforRecruitingwhoareunableto ` effectivelyidentifyandresolveproblems. 3'`݌L(#(# Ќ  6, XP P X(#6 4.1.50  CensusPayandFrontloading $t(#(#  $  wxyz#(xp   wxyz" 3"  0   3<23  0(#(#  1990Census  3<u݌L(#(# Ќ  Thepayprogramforthe1990Censusincludedseparatepayrolloperationsforfourdistinct ( groupsofemployees.Districtofficeintermittentemployees,byfarthelargestgroup,included  enumerators,crewleaders,fieldoperationssupervisors,officeoperationssupervisors,andoffice  clerks.Evenbeforethestartofthe1990Census,theCensusBureauraisedthepayratesfor  districtofficeemployeesbecauseofdifficultiesrecruitingsufficientnumbersofworkersinmany  partsofthecountryduringthe1988DressRehearsalandthenationaladdresslistingoperation.B   (16,page622,R2) C   t Theoveralldesignofthe1990payprogramincludedsevenpaylevels.Todeterminewhichpay `  leveltoapplytoaparticulardistrictoffice,theCensusBureauconsidereditsdegreeof L! enumerationdifficulty,abilitytorecruitjobapplicants,andcompetitivelocalwagerates.Pay 8"  ratesforruralareastendedtobeinthelowrange,whereaspayratesforlargemetropolitanhard $#t! toenumerateareas/upperwagescaleareas,Hawaii,andAlaskawereatthehighend. $`" TheCensusBureauagainrevisedpayratesduringJune1990forfieldstaffincertaindistrict %8!$ officeswhereshortagesoffieldenumerationstaffexistedandrecruitingenoughqualified &$"% personnelcontinuedtobeaproblem. B  ԍ(16,page622,R3) dC   '#& Forthe1990Census,theCensusBureaualsoadministeredanationwidesupplementalpay )$( program.Inadditiontohourlywages,fieldemployeescouldearnadditionalmoniesforquality *%) performanceduringboththeL/EandNRFUoperations.B   (16,page622,R4) C  ԀThesupplementalpayprogramwas t+&* usedasanincentivetomotivateandretainworkersandtostimulateproductionandquality.The  amountofsupplementalpaywasbaseduponthetotalnumberofquestionnairescompleted  duringtheoperation.Enumeratorshadtomeetcertainqualityandtimerequirementstobe  eligibleforsupplementalpay. t Becauseofcontinuingproblemswithemployeeturnoverandshortagesofstaff,theCensus L  Bureauextendedthedurationofthesupplementalawardprogramtoencourageemployeesto 8  remainonthejob.B   (16,page623,R5) C  ԀAdditionally,apiecerateplanwasimplementedduringJune1990.Thisplan $ t paidenumerators$1.50,crewleaders$0.20andfieldoperationssupervisors$0.05foreach  ` completedcaseinadditiontotheirregularhourlyrates.B  ԍ (16,page623,R6) FC    L  ! ! $  wxyz#(xx$  wxyz#" 3"  0   3G23  0(#(#  Census2000  3G݌$ (#(# Ќ  ForCensus2000,theCensusBureausignificantlyincreasedthehourlypayratesofits   intermittentworkforcerelativetothe1990Census(adjustedforinflation).Asaresult,Census   2000experienceddramaticimprovementsinLCOrecruitingperformance,enumeratorretention,   andNRFUcompletiontimewhencomparedtothe1990Census. t AttheCensusBureausrequest,Westat(JacobsonandPetta2003)alsoexaminedtheeffectsof L payandfrontloadingonhowquicklyNRFUwascompletedinCensus2000.Theprimaryfocus 8 of_Westat_sworkwasonwhetherincreasingenumeratorwagesandfrontloadinghadthedesired $t effectofallowingtheCensusBureautoquicklycompleteNRFU.Ofsecondaryinterest,the ` CensusBureaualsowantedtoknowwhetherthereweresystematicdifferencesinNRFU L performancethatcouldbelinkedtothecharacteristicsofenumerators,theareasinwhichthey 8 worked,theirpay,orthewayinwhichtheyweremanaged.Ifso,thesevariableswouldbe $ importantwhenplanningthe2010Census.   4.1.60  PayandFrontloadingStudyMethodology (#(# _Westat_sanalysisoffactorsaffectingCensus2000NRFUpayrateswasmodeledontheirearlier p workdonein1977.ToassessNRFUperformance,Westatusedpublishedreportsplus \  tabulationsdevelopedfromadministrativedatatomakecomparisonsbetween1990Censusand H! Census2000NRFUperformance,administrativedatabasescoupledwithpublishedstatistics 4"  describingareacharacteristicstocompareperformanceacross510 #  7      ׀Census2000LCOsandfive  #p! Westatexecutedsurveystocompareenumeratorperformanceacross27LCOs.  $\"  4.1.70  PayandFrontloadingStudyLimitations %4!$(#(# _Westat_smethodologyhadtwolimitations.First,alackofdataonthenumber,timing,and ' #& refusalrateofapplicantstoacceptpositions,andontheintentionsofcensusmanagers, (#' prohibitedWestatfromdefinitivelysortingouttherelativeimportanceofalternateexplanations  forwhysomeLCOMsdidnotmeetfrontloadinggoals.Additionally,withrespecttoidentifying  anoptimalNRFUscheduleforthe2010Census,_Westat_sanalysisexaminedonlyCensus2000  NRFUcompletionspeed.Itdidnotaddresstheeffectsofspeedonaccuracyandcost. t  4.1.80  PayandFrontloadingStudyResults L (#(# Westat(JacobsonandPetta2002)reportednumerousfindingsregardingpayandfrontloading. $ t Thisreporthighlightsonlysomeofthemajorfindings.  ` Westatfoundthatsettingpaycompetitivelywasessentialtorecruitingsufficientnumbersof  8  wellqualifiedapplicantsandtoretainenumeratorsaslongastheywereneeded.ԀB  (2,pageiii,R1)C  Ԁ  ForCensus $  2000,hourlypaywasincreasedby37.8percentonaveragerelativetothe1990Census(adjusted   forinflation)andenumeratorretentionwasincreasedby22.6percent.B   (2,pagei,R2/R3)  C  ԀTheincreaseinretention   coupledwithfrontloadingpermittedtheaverageLCOtocompleteNRFUin7.19weeks   comparedto9.72weeksinthe1990Census.B   (2,Pagei,R4)  C  ԀSignificantly,theslowestperformingLCOs   completedtheirworkabout1.5weeksfasterthanthefastestperformingLCOin1990.B   (2,Pagei,R5)  C   t Basedontheresultsof_Westat_sstudy,webelievethatwhenbasicpay,recruiting,and ` frontloadingplanswerefollowed,LCOssucceededinsecuringandretainingasufficientnumber L ofapplicantstostaffNRFUwithhighlycompetentenumeratorswhoalsowerestrongly 8 motivatedtoworkaslongasneeded. B  ԍ(2,pageii,R6) C  ԀThedegreetowhichLCOsexceededoperationalschedules $t waslargelyafunctionoftheamountoffrontloadingthatwasachievedbyaparticularLCO.B   (2,pageii,R7) C  Ԁ d About80percentoftheLCOsmetorexceededtheirfrontloadinggoals.B  ԍ (2,pageii,R8) vC  Ԁ P  4.1.90  PayandFrontloadingRecommendationsforthe2010Census ((#(# ! !   wxyz(o"px$  wxyz#" 3"  0   32o"3  0(#(#  Considerreassessinghowtestscoresandtheavailabilitytoworkmanyhoursareusedas  hiringscreens._Westat_sanalysissuggeststhatthecapacitytocompleteNRFUwould  havebeenenhancedhadtestscoresofabout82percentbeenusedasthefirstselecting  criteria(unlessapplicantshadaspeciallanguageskill)andtheorderofcontacting t applicantshadbeenbasedonthehoursofavailability(atleast20hoursperweek)as `  reportedontheirjobapplications.  #  8      ׀ 3݌L!(#(# Ќ  " 3"  0   3a2o"3  0(#(#  Furtherexpandupon_Westat_sfindingstoestablishtheNRFUscheduleanddegreeof $#t! frontloadingforthe2010Censusthatwouldsubstantiallyreducecostwithoutreducing $`" thelikelihoodofmeetingtheoperationalschedule. 3a݌$L #(#(# Ќ   &$"% " 3"  0   3j2o"3  0(#(#  Implementaplanthatusesthefullsixweekstoreachthe95percentleveliftheCensus  2000goalofcompleting95percentoftheNRFUcasesinthefirstsixweeksisretained  forthe2010Census.WestatopinedthatincreasingNRFUspeediscostlybecausethe  lesstimethatisallocated,themorestaffareneededandthisreducestheflexibilitycrew t leadershaveinassigningworktothemostproductiveenumerators.Increasing ` enumeratorstaffingisalsocostlybecauseaboutonethirdofallcompensationisspenton L  trainingandsupervision.Notallocatingworktothemostproductiveenumeratorsisalso 8  costlybecause,withinanygivenLCO,aboveaverageenumeratorscompleteabouttwice $ t asmanycasesperhourasbelowaverageenumerators.Thus,Westatbelievesthatusinga  ` fullsixweekperiodtoreachthe95percentcompletiongoalwouldhaveapositiveeffect  L  onNRFUcosts. 3j݌ 8 (#(# Ќ   (դ8p  wxyz! !9,'pX, X9 4.20 ' FieldVerification  '(#'(# Forthe1990CensusandCensus2000,sourceinformationcomesfromTenebaum(2001a).   9,' X,'pX9! ! $  wxyz#(x8" 3"  0 '  323  0'(#'(#  1990Census  3"݌p(#(# Ќ  Forthe1990Census,theCensusBureaureliedonaseriesofclericalprocessesandtheUnited L StatesPostalService(USPS)toconfirmthatanaddresswasvalidbeforeaddingittothecensus 8 files.B   (3,page2,R3)  C  ԀFormsgeneratedfromtheWereYouCountedcampaignandWholeHouseholdUsual $t ResidenceElsewherewereprocessedthroughaclericalsearch/matchprocedureafterfirstbeing ` geocodedtoacensusblock.WhenaddressescouldbegeocodedandwerenotontheCensus L BureausAddressControlFile(ACF),theyweresenttotheUSPSforverificationthatthe 8 addresswascompleteanddeliverable.About35,000HUswereaddedtotheACFasaresultof $ thesearch/matchoperations.B  ԍ (3,page2,R4) P#C    ! ! $  wxyz#(xx$  wxyz#" 3"  0 '  3M$23  0'(#'(#  Census2000  3M$$݌(#(# Ќ  ForCensus2000,theCensusBureauhadenumeratorsconductafieldverificationratherthan t relyingontheUSPStoverifythestatusofpotentiallymissedaddresses.Thisdecisionwasbased `  onthefactthattheCensusBureauhadalreadyusedtheUSPSsDeliverySequenceFiletohelp L! buildtheCensus2000MAF. 8"  FieldVerificationwasonecomponentofamultifacetedoperationforhandlingnonID $`" questionnairesinCensus2000.d #  9      ׀DuringBeCounted/TelephoneQuestionnaireAssistance $L # (BC/TQA)FieldVerification,enumeratorsvisitedthelocationofunitswithoutanassigned %8!$ censusidentificationnumbertoverifytheirexistencepriortoincludingtheiraddressesinCensus &$"% 2000. '#& u    PotentialcasesforBC/TQAFieldVerificationincludedthosefromtheBeCountedprogram,  TelephoneQuestionnaireAssistance,ServiceBasedEnumeration,GroupQuartersEnumeration,  Military/MaritimeCrewsofVesselsEnumeration,MilitaryUnitEnumeration,andInMovers/  WholeHouseholdsprograms. t Inaddition,unitsthatweredeletedintwoormorepreviousoperations(doubledeletes),butfor L  whichtheCensusBureaureceivedamailreturn,alsowereincludedinBC/TQAField 8  Verification.TheFieldVerificationworkloadconsistedof884,896addresses.B   (3,page7,R1) +C  ԀTables2and3, $ t respectively,showtheworkloadbytypeofcaseandthedistributionoftheworkloadbytypeof  ` enumerationarea(TEA).  L    Table2   ,@11FieldVerificationWorkload B  ԍ (2,page7,R2) f-C  Ԉ   *H]ItddFdd Fdd dd E]F(#(#,dd ,dd +  *]]   *XX 򀀀TypeofCase .]]8]] .Ѐ No.% )8  ]] )BeCounted(NonID)  D 195,81222.13  D TelephoneQuestionnaireAssistance(NonID)   155,14817.53   IndividualCensusReport(NonID)  L 101,45811.47  L MilitaryCensusReport(NonID)  X Ѐ16,1311.82  X DoubleDeletes   416,34747.05#XX.# ]  XXTotal *]` ] *884,896100.00(`   ] (<,' X,' X<#XXl1#XX '   Source:(Tenebaum2001a) X  +&1 u    #XXS2# Table @` 3   X3 @ FieldVerificationWorkloadbyTEA  ؀B  - (2,page8,R3)  4C  Ԉ  *~K]Mtdddd dd H]I(#(#~,hdd ,dd ,dd +  &]xx  & .]!, ]  .XX  Ӏ CasesSentTo #XX5#Ԁ XXField , Verification #XX5# D]3)    ] D5 򀀀XXTEA .]$ t] .   No. 7]&!$ t ] 727   Ӏ% 2(&$ t    ] 27_Mailout_/Mailback B8    &+'A759187&+'AB759,187 mc5  3 &+'A759187 &+'A (\rU@85.79(\rU@m85.79 @64  3 (\rU@85.79 (\rU@ @Update/Leave B8  P  6@1114676@B111,467 mc5 P3 6@111467 6@ 333333)@12.60333333)@m12.60 @64 P3 333333)@12.60 333333)@ @List/Enumerate @6 \  :@2973:@@2,973 j`3\ 3 :@2973 :@ (\?0.34(\?j0.34 ?53\ 3 (\?0.34 (\? ?RemoteAlaska >4    @@33@@>Ѐ33 ZP1 3  @@33 @@ # Z0.00 1'% 3 #  1RuralUpdate/Enumerate @6 d  @3328@@3,328 j`3d 3 @3328 @ RQ?0.38RQ?j0.38 ?53d 3 RQ?0.38 RQ? ?MilitaryinUpdate/Leave @6 p  B@2209B@@2,209 j`3p 3 B@2209 B@ ?0.25?j0.25 ?53p 3 ?0.25 ? ?UrbanUpdate/Leave @6  ~@2111~@@2,111 j`33 ~@2111 ~@ Q?0.24Q?j0.24 ?533 Q?0.24 Q? ?UrbanUpdate/Enumerate ?5 (x pq@279pq@?279 i_2(x 3 pq@279 pq@ Q?0.03Q?iЀ0.03 ?53(x!3 Q?0.03 Q? ?Update/LeaveConvertedFromMO/MB @6 " ک@3309ک@@3,309 j`3#3 ک@3309 ک@ Gz?0.37Gz?jЀ0.37 E]83$3 Gz?0.37 Gz? ETotal N]A0% ] @+A884896@+A N  884,896 z]mD0&0 @+A884896 @+A ] Y@100.00Y@ zA  100.00TJH0'0 Y@100.00 Y@ ] T#XX6# \(8x$  wxyz# XX0 ' 0'(#'(#Source:(Tenebaum2001a)#XX7C# ('(#(#  B  ԍ C  <,' X,' X<4.2.10  FieldVerificationStudyMethodology )(#(# @,' X,' XC@ToassesstheeffectivenessofBC/TQAFieldVerification,theCensusBureauuseddatafrom d+ variousfiles.Thesefilesidentifiedsuchinformationasthetypesofcasesthatweresentto P, BC/TQAFieldVerification,summarytalliesoftheresultsofautomatedandclericalgeocoding, <- OperationsControlSystem(OCS)workloads,andcharacteristicsofaddressesincludedinthe (x. censusandaredocumentedin(Tenebaum2001a).  d/  ?,X'X,' X?4.2.20  FieldVerificationStudyLimitations !<1(#(# ThenonIDquestionnaireprocessforCensus2000wascomplexandconsistedofseveral #3 componentsincludingautomatedmatchingandclericalgeocoding.However,thisevaluation $ 4 waslimitedonlytotheverificationofgeocodedaddresseswhichdidnotmatchtheMAF.Thus, % 5 thedatacannotbeusedtodrawconclusionsaboutanyothercomponentsofthenonID &!6 questionnaireprocess.Further,thestudyisunabletostateanyconclusionsabouthowaccurately t'"7 enumeratorsidentifiedduplicateaddressesbecauseinsufficientinformationwascapturedforthe `(#8 addressestoproperlylinktheduplicateaddresses.Lastly,althoughqualityassuranceconducted L)$9 onenumeratorsworksuggeststhattheworkwasofanacceptablelevel,therewasno 8*%: independentvalidationoftheprocesstoconfirmthatthefieldworkimprovedthecensusfiles. $+t&;  _(88\  ,`'< u    4.2.30  FieldVerificationStudyResults (#(# ResultsoftheCensusBureausassessmentoftheBC/TQAFieldVerificationindicatethatthe  operationwasconductedonscheduleandwithinbudget,andthattheoperationimprovedthe t accuracyoftheMAF.Thestudyresultsalsoshowthattherewerenoqualityoroperational ` problemsassociatedwiththeBC/TQAFieldVerificationprogram. L  Morethan50percentoftheassignedaddresseswerecodedasvalidlivingquarters.Inaddition, $ t about14percentoftheassignedaddresseswerecodedasduplicatesofanotheraddresswhile  ` nearly35percentoftheassignedaddresseswerecodedasdeletes.(Thedeletesincluded1,113  L  casesthatenumeratorsreturnedwithstatusunknown.)Ofthe416,347doubledeletecases  8  includedinBC/TQAFieldVerification,about53percentweredeterminedtobevalidHUs.B   (3,   page7,R2) PC   $   4.2.40  FieldVerificationRecommendationsforthe2010Census  (#(#    wxyz(o"p8_" 3"  ?,X'hX,X'X?0 '  3Q2o"3  0'(#'(#  Captureinformationonduplicateaddressesforuseduringqualityassuranceandfor   futureresearchintothecausesofduplicateaddresses. 3Q[R݌p(#(# Ќ  " 3"  0 '  3S2o"3  0'(#'(#  ConsiderwaystoindependentlyvalidatetheresultsoftheFieldVerificationoperationto H determinewhethertheprocessimprovesthecensusfiles. 3SS݌4(#(# Ќ  " 3"  0 '  3T2o"3  0'(#'(#  Assesstheimpactofadditionalresponseoptionsforthe2010CensusontheField  \ Verificationworkload. 3T7U݌H(#(# Ќ   (e8p  wxyz! ! 4.30 ' Update/LeaveandUrbanUpdate/Leave (stateside)  '(#'(#  4.3.10  Update/Leave (#(# Forthe1990Census,sourceinformationcomesfromU.S.DepartmentofCommerce(1993)and,  _for_ԀCensus2000,fromPennington(2003). p ! ! $  wxyz#(x8" 3"  0 '  3Y23  0'(#'(#  1990Census  3Y=Y݌H!(#(# Ќ  The1990CensusUpdate/Leave(U/L)methodologyemployedacombinationofadependent $#t! canvassforcoverage,questionnairedeliverybyenumerators,andselfenumerationandmailback $`" censustaking.B   (16,page631,R7) ZC  ԀDespitesomesignificantdelaysincompletingthe1990CensusU/Lfieldwork, $L # U/Lenumeratorsaddedalmost400,000validaddressestotheCensusBureausaddresscontrol %8!$ filewhiledeliveringquestionnairesto10.4millionHUs.B   (16,page632,R8) ?\C   &$"% " 3"  0 '  3\23  0'(#'(#  Census2000  3\\݌(#'(#(# Ќ  TheCensus2000U/Loperationwasconductedinareaswheretheaddressesusedformail *%) deliverywerepredominatelynoncitystyle(e.g.,POBoxorRuralRoute).Theseareastypically t+&* u    lackedmailingaddressesthatidentifiedtheirexactgeographiclocation.ThelocationsofHUs  andSP/GQsintheU/LuniversewerecapturedduringtheAddressListingoperation.Address  ListingandU/LwereincludedinTEA2.AllofPuertoRico,includingmilitarybases,wasalso  includedinTEA2. t ForCensus2000,TEAsreflectednotonlythetypeofenumeration,butalsothemethodusedto L  compilethecensusaddresslistthatcontrolledtheenumerationprocess.Theaddressesusedfor 8  U/LwerederivedfrominformationcollectedduringAddressListingandupdatedduringthe $ t LocalUpdateofCensusAddresses(LUCA)1999Recanvassingoperation.TheGeographyand  ` Field(FLD)divisionsidentifiedsomeblocksinTEA1(citystyleaddresses)thatcontaineda  L  significantnumberoflivingquarterswithnoncitystyleaddresses.Theseblockswereremoved  8  fromTEA1,assignedaTEAcodeof9,andincludedinU/L.This,coupledwiththeconversion $  ofsomeformerList/EnumerateareastoUpdate/Leaveareas,significantlyincreasedtheU/L   universeduringCensus2000.   U/LwasconductedduringtheperiodMarch3toMarch30,2000.Threehundredandsixtythree   ofthe520LCOshadU/Lworkassignments.Bytheconclusionofthefieldwork,U/L p enumeratorshadupdatedtheirassignmentmapsandaddressbindersanddroppedoff \ questionnairesatapproximately23.5millionoccupiedandvacantHUs.B   (5,pagev,R1) yeC  ԀIncreasefromthe1990 H U/Lworkload(10.4millionHUs)isduetochangesinthecriteriafordefiningTEAs.The1990 4 TEAfor_prelist_Ԁ_mailout_/mailbackwaseliminatedandsomeHUswereconvertedtoU/L.  p  4.3.20  UrbanUpdate/LeaveH(#(#  Forthe1990CensusandCensus2000,sourceinformationcomesfromRosenthal(2002b).    ! ! $  wxyz#(xx$  wxyz#" 3"  0 '  3ah23  0'(#'(#  1990Census 3ahh݌(#(# Ќ  TheUrbanUpdate/Leave(_UU_/L)methodologywasusedinselectedinnercitydistrictofficesto  enumeratecensusblocksthatcontainedmostlypublichousingdevelopments.Oneofthemajor l featuresofthe_UU_/Lwasthepromotionactivitythatprecededtheenumeration. B  ԍ(16,page647,R9)C  Ԁ jThese X  promotionprogramspublicizedthecensusandweredesignedtofostertheunderstandingthat H! censusinformationwasconfidential.Enumeratorswerehiredfromamongtheresidentsfromthe 4"  targetedhousingprojects.Theseenumeratorswerespeciallytrainedtohangpostersinarea  #p! buildings,distributecensuspamphletstorespondents,andattendvariouscommunityfunctions  $\" andtenantassociationmeetings.  $H # " 3"  0 '  3m23  0'(#'(#  Census2000 3mTm݌& "%(#(# Ќ  6,XXhX,X'hX6 The_UU_/LoperationwasconductedintargetedurbanareaswheretheCensusBureauwasnot (#' confidentthattheUSPSwoulddelivercensusquestionnairestothecorrectHUs.Theareas )$( includedknownmultiunitapartmentbuildingswheretenantsreceivedmailatacommondrop *%)  l+&* t? 88   point,locationsthatdidnothavehousenumber/streetnameaddressesusedformaildelivery,and 8 HUswhoseoccupantsreceivedmailatapostofficebox. $ ThelocationsofHUsandSP/GQsinblockscoveredbythe_UU_/LTEAwereidentifiedduring  theBlockCanvassingoperationandafieldrecanvassoftargetedblocksfromtheLUCA  operation._UU_/LwasincludedinTEA7.PuertoRicohadno_UU_/Lworkload.ForCensus  2000,TEAsreflectednotonlythetypeofenumeration,butalsothemethodusedtocompilethe   censusaddresslistthatcontrolledtheenumerationprocess.Astheseresidenceshadcitystyle  t addresses,therewasnoneedforenumeratorstoassignmapspotstoassistenumeratorsin  ` locatingtheseunitsduringsubsequentcensusoperations.  L  Thescopeof_UU_/Lwasrelativelylimitedwithanationalworkloadof310,114HUsthatwas \$  brokendownintoslightlylessthan13,000assignmentareas(AAs).B   (6,pageiv,R1 tԍ)C  The_UU_/Loperationwas H  conductedfromMarch3toMarch31,2000. 4  Usingtheircensusmaps,_UU_/Lenumeratorscanvassedtheirassignedarea,oneblockatatime,    andidentifiedeachHU.EnumeratorsthenverifiedorupdatedthelocationofeachHU,obtained  thenameofthehouseholdateachaddress,andleftacensusquestionnaire.Census  questionnaireswereleftatbothoccupiedandvacantHUs.    B   (6,pagev,R2/R3) wC  ! ! $  wxyz#(xx$  wxyz# 4.40  Update/LeaveinPuertoRico p(#(# Forthe1990Census,sourceinformationcomesfromU.S.DepartmentofCommerce(1996)and, H forCensus2000,fromMcNally(2003). l4 " 3"  6,X'X,XXhX60 '  3xy23  0'(#'(#  1990Census  3xyy݌D (#(# Ќ  The1990CensusrepresentedthefirsttimethattheTopologicallyIntegratedGeographic   EncodingandReferencing(TIGER)systemwasusedtoproduceproductstocontrolthe   enumerationandtabulationprocess.B   (17,page134,R1) {C  ԀQuestionnairesgenerallyfollowedthestatesideversions;  however,givensocioeconomic,cultural,andclimaticdifferencesbetweenPuertoRicoandthe  States,theCensusBureautailoredquestionnairecontenttofulfillthespecificdataneedsofthe   Commonwealth.DatawerecollectedusingtheL/Emethodology. !  " 3"  0 '  3_}23  0'(#'(#  Census2000  3_}}݌#\"(#(# Ќ  Census2000markedthefirsttimeinthehistoryofcensustakinginPuertoRicothata p%8!$ conventional(List/Enumerate)methodologywasnotemployed.Followingthe1990Census,the \&$"% CensusBureaurecognizedthatagrowingpartofPuertoRicowasbecomingurbanizedenoughto H'#& useamailcensusmethodologytoenumerateitsresidents.B   (4,pagei,R1) C  ԀUnfortunately,thelackofa 4(#' comprehensiveandaccurateaddressmailinglistfortheseurbanareasnegatedanypossibilityof  )$( usinga_mailout_/mailbackmethodologyinPuertoRicoforCensus2000.  *%)  +'+ u 88   In1996,theCensusBureaudecidedtouseamodifiedU/Lmethodologyfortheentireislandof  PuertoRico.Althoughthisdecisionwouldrequirethataprecensusaddresslistingoperationbe  conductedforallofPuertoRico,threeimportantbenefitswouldresult:(1)asingleenumeration  methodologycouldbeusedwhichpresumablywouldbelessexpensivethanusingmultiple t methodologies,(2)residentswould,forthefirsttime,assumeresponsibilityforreturningtheir ` censusformbymail,and(3)themailinglistresultingfromtheprecensusaddresslisting L  operationcouldbeusedasthebasisforusinga_mailout_/mailbackmethodologyinurbanareasfor 8  the2010Census.ItcouldalsobeusedasabasisforU/Lwithoutaddresslistingin2010aswell. $ t DuringU/L,enumeratorscanvassedtheirassignedareasandupdatedtheiraddresslistsand  L  censusmaps.TheyalsoaddedaddressesofHUsthatwerefoundonthegroundbutnotincluded  8  ontheiraddresslistsanddeletedaddressesforunitsthatdidnotqualifytobeincludedinthe $  census,e.g.,unitsthatweredemolished,condemned,convertedtoabusiness,andsoforth.The   U/LoperationwasconductedduringtheperiodMarch3to31,2000.TheLCOwasableto   recruitandhirequalifiedfieldstaffthemajorityofthetime.   ! !   wxyz(o"px$  wxyz# 4.50 ' Update/EnumerateandList/Enumerate p'(#'(#  4.5.10  Update/Enumerate H(#(# Forthe1990CensusandCensus2000,sourceinformationcomesfromRosenthal(2002a).  p  $  wxyz#(xp  wxyz" 3"  0 '  323  0'(#'(#  1990Census  3R݌H(#(# Ќ  Forthe1990Census,anurbanUpdate/Enumerate(_UU_/E)methodologywasusedinNewYork $ andDetroittoenumeratewholepreidentifiedcensusblocksofboardedupbuildings._UU_/E  questionnairesfollowedthesameprocessingrouteasregularquestionnaires,exceptthatthe  _UU_/Equestionnaireswereexcludedfromtelephonefollowup,NRFU,andthevacant/delete  checkportionoftheFieldFollowupoperation.Dataarenotavailabletodrawanyconclusions  abouttheeffectivenessofthe1990_UU_/Eoperation. p ! ! $  wxyz#(xx$  wxyz#" 3"  0 '  323  0'(#'(#  Census2000  3Î݌H!(#(# Ќ  Thetargeted_UU_/Emethodologyusedforboardedupbuildingsinselectedcitiesduringthe1990 $#t! CensuswasdroppedforCensus2000.Initsplace,theCensusBureauemployedan $`" Update/Enumerate(U/E)methodologyfortargetedareaswithspecialenumerationneeds,in $L # areaswheremostHUsmaynothavehadhousenumberandstreetnamemailingaddresses,and %8!$ whereitwasnotlikelythatrespondentswouldmailbacktheircensusquestionnaires. &$"% U/EareasincludedresortareaswithhighconcentrationsofseasonallyvacantHUs,selected (#' AmericanIndianreservationsandthecolonias.Thecoloniasareusuallysmalltownsnearthe )$( borderwithMexico.Manyofthesesmalltownsdonothavemaildelivery.#XXXXU/Ewasthe *%)  p+&* dO    preferredmethodofenumerationintheseareasbecauseofconcernsaboutthepossibilityoflow  responseratesandpooraddressintegrity.#XXX#Xؒ#  U/EwasconductedduringtheperiodMarch13toJune5,2000in35stateswhichincludedall t RegionalCensusCenter(RCC)areasexceptDetroit.SimilartoU/L,U/Eenumeratorsupdated ` addresslistingsandcensusmaps,addinganddeletingaddressesasappropriate.However,rather L  thandroppingoffacensusquestionnairefortheresidentstocompleteandreturnbymail,U/E 8  enumeratorsconductedinterviewsandcompletedquestionnairesforthehouseholdlivingatthe $ t units.  `  4.5.20  List/Enumerate 8 (#(#  Forthe1990Census,sourceinformationcomesfromU.S.DepartmentofCommerce(1993)and,   forCensus2000,fromZajac(2002).    ! ! $  wxyz#(xx$  wxyz#" 3"  0 '  3G23  0'(#'(#  1990Census 3G݌ (#(# Ќ  Forthe1990Census,List/Enumerate(L/E)wasconductedinall70type3censusdistrictoffices. \ These70districtoffices,withabout215,000HUseach,wereinsparselysettledpartsoftheWest H andNorth,wheretheprimarydatacollectionmethodsvariedfrom_mailout_/mailbacktoL/E.The 4 nationalL/Eworkloadforthe1990Censuswas5.5millionHUs.B  ԍ (16,Page632,R10)  C    p SeveraldayspriortothestartoftheL/Eoperation,USPSlettercarriersdeliveredAdvance H CensusReports(ACRs)toallknownresidentialaddressesinsparselypopulatedruralareas.All 4 ACRswereunaddressed,shortformquestionnaires.Amemberofthehouseholdwasaskedto   completethequestionnaireandholditforpickupbyanenumerator.L/Eenumeratorscanvassed   theirassignedarea,listedtheaddressofeachHU,markedthelocationofeachunitonacensus  blockmap,andenteredamapspotnumberfortheunitonthemapandonthecorrespondingline  ontheaddressregisterpage.L/Eenumeratorspickeduptherespondentcompletedquestionnaire  orcompletedaquestionnairewhentherespondentdidnothaveacompletedformreadyforpick l up.Forhouseholdsthatweredesignatedontheaddresslistingpagetoreceivealongform X  questionnaire,L/EenumeratorscollectedthecompletedACRandtranscribedtheinformation D! ontoalongformenumeratorquestionnaire.Theythenconductedaninterviewtoobtainthe 0"  remaininglongforminformation. #l! ! ! $  wxyz#(xx$  wxyz#" 3"  0 '  3N23  0'(#'(#  Census2000  3N݌$D #(#(# Ќ  ForCensus2000,theL/Emethodologywasagainusedinsparselypopulatedareas;however,the & "% CensusBureaudecidedtousetheUpdate/Enumerate(U/E)methodologyratherthanL/Efor ' #& mostofthe1990L/Eareas.Thus,thenationalL/Eworkloaddroppedfrom5.5millionHUsin (#' 1990to392,368HUsduringCensus2000.B   (8,pageiv,R1) C   )$(  l+&* TheuseofACRswasdiscontinuedbecauseL/Eareashadbeendelineatedattheblocklevel.  Additionally,USPScarrierroutesdidnotnecessarilyfallintoentireZIPcodessoitwasnot  possibletotellthepostofficewheretodelivertheACRs.  Procedurally,L/Eenumeratorslistedaddresseswithintheirassignmentareainanaddressbinder, ` spottedthelocationofHUsoncensusmaps,assignedeachunitauniquemapspotnumber,and L  conductedaninterviewtocollectcensusinformationforeachaddress.L/E,whichincluded 8  reinterviewandfieldfollowupcomponents,wasconductedfrommidMarchthroughthe $ t beginningofJuly2000.  ` TheL/EoperationwasfollowedbyL/EFieldFollowup(FFU).L/EFFUwasaqualityassurance  8  operationthatwasconductedtorecheckthestatusofunitsthatwereclassifiedasvacantduring $  L/E,toreenumerateHUswhoseoriginalquestionnaireswerenotdatacaptured,andtoconvert   shortformquestionnaireinterviewsatdesignatedHUstolongformquestionnaires.    4.60 ' NonresponseFollowup (andToolKitmethods)  '(#'(# Forthe1990Census,sourceinformationcomesfromU.S.DepartmentofCommerce(1993)and, ` forCensus2000,fromMoul(2002)andMonaco(2002).Withtheexceptionofcertaincost L informationfromMonaco(2002),thestatisticaldatarelatedtoNRFUwereobtainedfromMoul 8 (2002). $t ! ! $  wxyz#(xx$  wxyz#" 3"  0 '  3t23  0'(#'(#  1990Census  3t݌L(#(# Ќ  NRFUwasthelargestfielddatacollectionactivityconductedduringthe1990Censusandittook ( placeinalldistrictofficesexceptfortwoentirelyL/Eoffices(WindowRock,Arizonaand  Hyannis,Massachusetts).TheNRFUuniverseconsistedofHUsforwhichmailreturn  questionnaireswerenotcheckedinbyApril22,1990.TheseHUsoriginatedfromtheinitial  mailout,aswellaslateaddsfromotherprecensusoperations.  Alltype1districtoffices(large,centralcityandmetropolitanareas)werescheduledtostart `  NRFUonApril26,1990.TheremainingdistrictofficesweresupposedtobeginNRFUonMay L! 3,1990.AlldistrictofficesweretofinishNRFUbyJune6,1990. B  ԍ(16,page636,R11) C  ԀTheNRFUoperationwasnot 8"  completedasplanned.AsofJune4,1990,only70percentoftheworkloadwascompleted.By (#x! thisdate,only33percentofthedistrictofficeshadbeguncloseoutproceduresandonlytwo $d" districtofficeshadactuallycompletedNRFU. %P # Mostdelayswereattributedtolargerthanexpectedworkloads, v #  10      ׀staffingdifficulties,employee &("% turnover,andmoreparttimeworkersthananticipated.B  ԍ(16,page636,R12) PC  ԀInresponsetotheseproblems,the '#& CensusBureauinitiatedapayrateincreaseinJuneof1990inanefforttoattractadditional ($'  dO$OY  $ $  workersbycompetingmorefavorablywithotheremployersintheseareasandtomotivate  existingstafftoincreasehoursandproduction.Additionally,theCensusBureauextendedits  supplementalpayprogramandimplementedapiecerateprogramforeachcompleted  questionnaire.(Seesection4.1.5).ByJuly19,1990,98percentofalldistrictofficeshad t finishedNRFU,withtheremaining2percentbyJuly30.B   (16,page636,R13) C  ԀApproximately200,000persons ` workedontheNRFUoperation,whichenumeratedmorethan34millionHUs.B   (16,page ,| 636,R14) C   L  ! ! $  wxyz#(xx$  wxyz#" 3"  0 '  323  0'(#'(#  Census2000  3з݌$ t(#(# Ќ  TheobjectiveofCensus2000NRFUwastoobtainacompletedquestionnairefromhouseholds  P  inmailbackareasthatdidnotrespondtotheCensus.ThepotentialuniverseforNRFUincluded  <  119,090,016HUsinmailbackareas(includingPuertoRico).B   (9,pagev,R1) C  ԀOfthistotal,almost45million (  HUs(37.7percent)wereidentifiedasNRFUcases.B   (9,pagev,R2)C  P   TheNRFUaddresseswereidentifiedonaflowbasisanddistributedtotheLCOs.T #  11      ׀Althoughthe   NRFUoperationwasscheduledtobeconductedduringtheperiodApril27throughJuly7,2000,   theoperationbeganasplanned,butendedtendaysaheadofscheduleonJune26,2000.V #  12      B   (9,page  2,R3) C   t Table4showstheweeklycheckinratesofNRFUenumeratorquestionnairesbyformtype.The L questionnairecheckinactivityshowninthetablewastakenfromtheDMAF. 8 AlthoughtheofficialstartandfinishdatesforNRFUwereApril27andJune26,two ` discrepancieswerenoted.AccordingtoOCS2000x #  13      ׀data,theLCOsstartedNRFUasearlyas L April21andfinishedaslateasSeptember7.B   (9,page10,R4) 9C  ԀThestartandenddatesweredefinedasthedatethe 8 firstandlastNRFUquestionnaireswerecheckedintotheOCS2000.Also,accordingto $ OCS2000data,therangeofstartdatesforNRFUwasfromApril21toMay5,andtherangeof  NRFUenddateswasfromMay5toSeptember7.B   (9,page10,R5) C  B  C    dXXXXApproximately1.6percentoftheNRFUworkload(677,967cases)wascheckedinafterJune26,  2000theofficialendoftheNRFUoperation.Thesewereprimarily NRFUcaseswithunknown p dO    populationcounts(POP99s)orlostNRFUenumeratorreturnsthatwerecontactedinthe  ResidualNonresponseFollowupoperation.#XXXdXL#AccordingtotheDMAFdata,however,therewere  nocheckinactionsforNRFUquestionnairesafterAugust25.B   (9,page10,R6) C     4.6.10  NRFUStudyMethodology `(#(# ToassesstheeffectivenessoftheCensus2000NRFUoperation,theCensusBureauusedthe 8  DMAFtoidentifytheNRFUeligibleuniverse,theinitialNRFUuniverse,thelatemailreturn $ t (LMR)universe,andthefinalNRFUuniverseandtheMarch2001MAFextract.Theywere  ` usedtoidentifyaddressesaddedduringNRFUandtoclassifythemintooneofthefollowingfive  L  categories:completecitystyle,completeruralroute,completeP.O.box,incompleteaddress,and  8  noaddressinformation. $  TheDecennialResponseFileStage2(DRF2),whichrepresentsthecaptureofquestionnaire   datafromCensus2000,wasusedasthesourceforNRFUenumeratorquestionnaireresponses.      p u      Table4B  ԍ(6,page11,R7)bC    DistributionofNRFUQuestionnairesCheckedinbyWeekandbyFormType X #  14      &W%XXB  C    B*C]Dd dhdd hdd dd K]M(#(#,dd ,dd ,dd#,dd#,dd#,dd#,9dd#,dd#,dd#,dd#+  #XX%&W[#XX !]`` !#XXz#XX 3]&] 3 <]/!"] < 3]&!"] 3 3]&] 3 D]]3!"] DFormType 3)$ "]] 3 0& p    0 D]3! p "  DTotalForms <2$ p "]  < D]3! p "  DShortForms <2$ p"]  < D]3! p"  DLongForms :])$ p"] :Week1 7]&| ] 7Date @]/!| ] @# 7]&!| "] 7  % @]/!| #] @ @]/!| 2] @# 7]&!| "] 7  % 7]&!| #] 7 7]&| ] 7# 7]&!| "] 7  % 7]&!| #] 7w 7]&! (0] 7Total Z]I (] 3A42365816P3AZ42,365,816 |]kC (P 3A42365816 3A] Y@100.0Y@|100.0 P]?: ( Y@100.0 Y@] P Z]I (] A33050538PAZ33,050,538 |]kC ( P A33050538 A] Y@100.0Y@|100.0 P]?: (! Y@100.0 Y@] P Y]H ("] yaA9315278PyaAY9,315,278 {]jB (#P yaA9315278 yaA] Y@100.0Y@{100.0 ov^: ($ Y@100.0 Y@]  ?1?o1 Lv;64 %  ?1 ?v LApr21Apr29 XvG4 &v P8@119685PP8@X119,685 xvgA4 'P P8@119685 P8@v 333333?0.3333333?x0.3 Nv=84 ( 333333?0.3 333333?v N XvG4 )v q@104218Pq@X104,218 xvgA4 *P q@104218 q@v 333333?0.3333333?x0.3 Nv=84 + 333333?0.3 333333?v N WvF4 ,v 5@15467P5@W15,467 wvf@4 -P 5@15467 5@v ?0.2?w0.2#XX#XX mv\84 . ?0.2 ?v  @2@m2 Lv;6 /  @2 @v LApr30May06 YvH 0v ]SA5132662P]SAY5,132,662 zviB 1P ]SA5132662 ]SAv 333333(@12.1333333(@z12.1 Ov>9 2 333333(@12.1 333333(@v O YvH 3v  PA4228079P PAY4,228,079 zviB 4P  PA4228079  PAv )@12.8)@z12.8 Ov>9 5 )@12.8 )@v O XvG 6v +A904583P+AX904,583 xvgA 7P +A904583 +Av ffffff#@9.7ffffff#@x9.7 mv\8 8 ffffff#@9.7 ffffff#@v  @3@m3 Lv;6< 9  @3 @v LMay07May13 YvH< :v  aA8924593P aAY8,924,593 zviB< ;P  aA8924593  aAv 5@21.15@z21.1 Ov>9< < 5@21.1 5@v O YvH< =v 84[A7131363P84[AY7,131,363 zviB< >P 84[A7131363 84[Av 5@21.65@z21.6 Ov>9< ? 5@21.6 5@v O YvH< @v \;A1793230P\;AY1,793,230 zviB< AP \;A1793230 \;Av L3@19.3L3@z19.3 nv]9< B L3@19.3 L3@v  @4@n4 Lv;6H C  @4 @v LMay14May20 YvHH Dv aA8927344PaAY8,927,344 zviBH EP aA8927344 aAv 5@21.15@z21.1 Ov>9H F 5@21.1 5@v O YvHH Gv @ZA7046837P@ZAY7,046,837 zviBH HP @ZA7046837 @ZAv L5@21.3L5@z21.3 Ov>9H I L5@21.3 L5@v O YvHH Jv 9 P 3@19.0 3@v O YvH Qv bWA6264203PbWAY6,264,203 zviB RP bWA6264203 bWAv 3@19.03@z19 Ov>9 S 3@19.0 3@v O YvH Tv Q;A1790352PQ;AY1,790,352 zviB UP Q;A1790352 Q;Av 3333333@19.23333333@z19.2 nv]9 V 3333333@19.2 3333333@v  @6@n6 Lv;6PW  @6 @v LMay28Jun03 YvHPXv @SA5196605P@SAY5,196,605 zviBPYP @SA5196605 @SAv (@12.3(@z12.3 Ov>9PZ (@12.3 (@v O YvHP[v NA3941718PNAY3,941,718 zviBP\P NA3941718 NAv '@11.9'@z11.9 Ov>9P] '@11.9 '@v O YvHP^v %3A1254887P%3AY1,254,887 zviBP_P %3A1254887 %3Av +@13.5+@z13.5 nv]9P` +@13.5 +@v  @7@n7 Lv;6\a  @7 @v LJun04Jun10 YvH\bv ]KA3586604P]KAY3,586,604 yvhB\cP ]KA3586604 ]KAv !@8.5!@y8.5 Nv=8\d !@8.5 !@v N YvH\ev CA2616687PCAY2,616,687 yvhB\fP CA2616687 CAv @7.9@y7.9 Nv=8\g @7.9 @v N XvG\hv z-A969917Pz-AX969,917 yvhA\iP z-A969917 z-Av $@10.4$@y10.4 nv]9\j $@10.4 $@v   @8 @n8 Lv;6k   @8  @v LJun11Jun17 YvHlv \6A1442652P\6AY1,442,652 yvhBmP \6A1442652 \6Av 333333 @3.4333333 @y3.4 Nv=8n 333333 @3.4 333333 @v N YvHov '/A1020808P'/AY1,020,808 yvhBpP '/A1020808 '/Av @3.1@y3.1 Nv=8q @3.1 @v N XvGrv PA421844PPAX421,844 xvgAsP PA421844 PAv @4.5@x4.5 mv\8t @4.5 @v  "@9"@m9 Lv;6du  "@9 "@v LJun18Jun24 XvGdvv HA261289PHAX261,289 xvgAdwP HA261289 HAv 333333?0.6333333?x0.6 Nv=8dx 333333?0.6 333333?v N XvGdyv x[A183151Px[AX183,151 xvgAdzP x[A183151 x[Av 333333?0.6333333?x0.6 Nv=8d{ 333333?0.6 333333?v N WvFd|v @78138P@W78,138 wvf@d}P @78138 @v ?0.8?w0.8 nv]8d~ ?0.8 ?v  $@10$@n10 Mv<7p  $@10 $@v MJun25Jul01 WvFpv [@11958P[@W11,958 jvY@pP [@11958 [@v # j0.0 Av0+p # v A VvEpv @9057P@V9,057 ivX?pP @9057 @v # i0.0 Av0+p # v A VvEpv @2901P@V2,901 ivX?pP @2901 @v # i0.0 avP+p # v  &@11&@a11 Mv<7  &@11 &@v MJul02Jul08 VvEv @2061P@V2,061 ivX?P @2061 @v # i0.0 Av0+ # v A VvEv t@1693Pt@V1,693 ivX?P t@1693 t@v # i0.0 Av0+ # v A UvDv w@368Pw@U368 hvW>P w@368 w@v # h0.0 avP+ # v  (@12(@a12 Mv<7(x  (@12 (@v MJul09Jul15 VvE(xv |@1375P|@V1,375 ivX?(xP |@1375 |@v # i0.0 Av0+(x # v A VvE(xv Ԑ@1077PԐ@V1,077 ivX?(xP Ԑ@1077 Ԑ@v # i0.0 Av0+(x # v A UvD(xv r@298Pr@U298 hvW>(xP r@298 r@v # h0.0 avP+(x # v  *@13*@a13 Mv<7  *@13 *@v MJul16Jul22 WvFv @58512P@W58,512 wvf@P @58512 @v ?0.1?w0.1 Nv=8 ?0.1 ?v N WvFv 9@41421P9@W41,421 wvf@P 9@41421 9@v ?0.1?w0.1 Nv=8 ?0.1 ?v N WvFv @17091P@W17,091 wvf@P @17091 @v ?0.2?w0.2 nv]8 ?0.2 ?v  ,@14,@n14 Mv<70  ,@14 ,@v MJul23Jul29 XvG0v A426098PAX426,098 xvgA0P A426098 Av ?1.0?x1.0 Nv=80 ?1.0 ?v N XvG0v XQA300118PXQAX300,118 xvgA0P XQA300118 XQAv ?0.9?x0.9 Nv=80 ?0.9 ?v N XvG0v @125980P@X125,980 xvgA0P @125980 @v ffffff?1.4ffffff?x1.4 nv]80 ffffff?1.4 ffffff?v  .@15.@n15 Mv<7<   .@15 .@v MJul30Aug05 XvG< v P A155946PP AX155,946 xvgA< P P A155946 P Av ?0.4?x0.4 Nv=8<  ?0.4 ?v N XvG< v 0[@112051P0[@X112,051 xvgA< P 0[@112051 0[@v 333333?0.3333333?x0.3 Nv=8<  333333?0.3 333333?v N WvF< v n@43895Pn@W43,895 wvf@< P n@43895 n@v ?0.5?w0.5 nv]8<  ?0.5 ?v  0@160@n16 Mv<7!  0@16 0@v MAug06Aug12 WvF!v @@38922P@@W38,922 wvf@!P @@38922 @@v ?0.1?w0.1 Nv=8! ?0.1 ?v N WvF!v @@28733P@@W28,733 wvf@!P @@28733 @@v ?0.1?w0.1 Nv=8! ?0.1 ?v N WvF!v @10189P@W10,189 wvf@!P @10189 @v ?0.1?w0.1 nv]8! ?0.1 ?v  1@171@n17 Mv<7"D  1@17 1@v MAug13Aug19 WvF"Dv @20008P@W20,008 jvY@"DP @20008 @v # j0.0 Av0+"D # v A WvF"Dv ]@15547P]@W15,547 jvY@"DP ]@15547 ]@v # j0.0 Av0+"D # v A VvE"Dv m@4461Pm@V4,461 ivX?"DP m@4461 m@v # i0.0 a]P+"D # v  2@182@a18 M]<7P$  2@18 2@] MAug20Aug25 V]EP$] S@4947PS@V4,947 i]X?P$P S@4947 S@] # i0.0 A]0+P$ # ] A V]EP$] @3777P@V3,777 i]X?P$P @3777 @] # i0.0 A]0+P$ # ] A V]EP$] H@1170PH@V1,170 i]X?P$P H@1170 H@] # i0.0;1/P$ #  ] ;#XXn#XXTableincludesdataforPuertoRicobutexcludesdataforHialeah,FL(LCO2928).#XX#XX H%  Source:(Moul2002) &`!   '" } } }  #XXF#TheHundredPercentCensusEditedFilewiththeReinstatedHUs(HCEFD),whichcontained   theeditedandimputed100percentdatafromcensusHUsandgroupquarters,wasusedasthe  sourceforthedemographicsfortheNRFUandselfenumeratedHUsandhouseholds.  TheTechnologiesManagementOfficesDecennialDataWarehouse,whichisarepositoryfor ` datafromOCS2000andthePreAppointmentManagementSystem/AutomatedDecennial L  AdministrativeManagementSystem(_PAMS_/ADAMS),wasusedtoobtainNRFUstartandend 8  datesfortheLCOs. $ t  4.6.20  NRFUStudyLimitations  L (#(# TherewasnoofficialcutoffdayfortheinitialNRFUuniverse.TheCensusBureausprocessing $  division,theDecennialSystemsandContractsManagementOffice(DSCMO),usedarangeof   dates,coveringjustoveraweek,toperformtheNRFUselectionprocessonastate/LCObasis.   PriortobeginningtheNRFUselectionprocessforastate,DSCMOranaDMAFupdatebasedon   allcurrentlyavailablecheckedinquestionnaires.Theseupdatesreflectedquestionnaireschecked   inasofthepreviousday.SincetheinitialNRFUuniversewascreatedonaflowbasis,datausers p shouldbeawareofthepossibilityofnoiseinthedatawithrespecttotheinitialuniverseandthe \ LMRuniverseB  ԍ[33,pg1]C  . H  Themeaningfulnessofdataanalysisthatreliesontheinterviewsummarysectiononthe  p enumeratorquestionnaireislimitedduetoenumeratorerrorsincompletingtheseitems.  \ AsaresultofenumerationproblemsintheHialeah,FloridaLCO,enumerationdataforthisLCO 4 wereremovedfromalltabulations.    4.6.30  OverviewofNRFUProcedures (#(# EnumeratorsvisitedeachaddressdesignatedforNRFUtodeterminetheCensusDaystatusofthe  HU.CensusDay,orApril1,2000,wasthefixedreferencedateforthecollectionofcensus l information.DeterminingtheCensusDaystatusoffollowupaddressesnotonlydetermined X  whichsectionsand/orquestionsonthequestionnairetocomplete,butitalsoservedasareminder D! thattheinformationcollectedwouldbeasofApril1,2000. 0"    $X" AllNRFUaddresseshadoneofthefollowingstatusesasofApril1,2000.  " 3"  9,X,hX,X'X90   3:(23  0(#(#  Occupied #  15       3:((݌(#(# Ќ  " 3"  0   3)23  0(#(#  Vacant #  16       3))݌t(#(# Ќ  " 3"  0   3*23  0(#(#  Nonexistent #  17      ׀ 3**݌`(#(# Ќ  0   (#(# AlthoughNRFUenumeratorswereexpectedtoobtaincompleteinterviews,insomeinstances, 8  partialinterviewswereaccepted.Whenenumeratorscouldnotcontactahouseholdmemberata $ t followupaddressaftermakingatleastthreepersonalvisitsandthreetelephoneattempts,  ` enumeratorsattemptedtoobtaintherequiredcensusinformationbycontactingaknowledgeable  L  nonhousehold(proxy)respondent.  8  When95percentoftheNRFUworkloadwascompletedinacrewleaderdistrict(CLD),final   attemptprocedureswereimplementedinthatCLD.Finalattemptwasanintenseeffort,   conductedinashortperiodoftime,toobtainacompletedquestionnaireforeachunresolved   case.   DuringthisphaseofNRFU,enumeratorsmadeonefinalvisittoeachremainingNRFUaddress \ toobtainacompleteinterviewor,ataminimum,theunitstatusandpopulationcountfortheunit. H CompletedNRFUcaseswerereturnedtotheLCOonaflowbasiswhereassignmentcontrol 4 clerksreviewedtheincomingformstoensurethatcriticalquestionnaireitemswerecompleted.  p Clerksreturnedquestionnairesthatfailedthereviewtothefieldforcorrection.Questionnaires  \ thatpassedthereviewwereforwardedtoOCS2000checkin.Duringthecheckinprocess, H OCS2000automaticallyselectedcertainquestionnairesfortheNRFUReinterviewprogram. 4 ThesequestionnairesweretemporarilyroutedtoanothersectionwithintheLCOwhereclerks   transcribedquestionnairedataontoreinterviewforms.Uponcompletionofthetranscription   process,theoriginalquestionnaireswerereturnedtotheflowofformsforOCS2000checkin.  Allquestionnaireswereeventuallyassignedacheckoutstatusandshippedtotheappropriate  DataCaptureCenter(DCC).   X  u    <,X'X,X,hX<4.6.40  NRFUStudyResults (#(# ThekeyNRFUresultsfromMoul(2002)aresummarizedhere.  RegardingtheNRFUuniverse,theevaluationfoundthatapproximately78percentofthe42.4 ` millionB  C  formscomprisingtheNRFUworkloadwereshortformquestionnaireswhile22percent L  werelongB  C  Ԅformquestionnaires(seeTable5).B   (9,page9,R11)C  Ԁ 6ԀThemajority(62.3percent)oftheenumerated 8  unitswereoccupiedandtheoccupancyrateforlongformhouseholdswasgreaterthanfor ( x householdswhoreceivedashortform.B   (9,page9,R12)C  Ԁ 8About470,000NRFUquestionnaires(1.2percent)were  d completedinSpanish.B  ԍ (9,page13,R21) 8C    T  Ofthe26.4millionoccupiedunits,117,730(0.4percent)wereclassifiedbyenumeratorsasCode ,  99PopUnknown.B   (9,page9,R13) 9C  ԀThisclassificationindicatesthattheenumeratorwasunabletodeterminethe   populationcountofthehousehold.Approximately6millionHUs(14.3percent)oftheNRFU   universewereclassifiedbyenumeratorsasnonexistent.B   (9,page10,R14) ;C      dXXXX  Table5B  ԍ(6,page10,R8);C   d ;  NRFUHUStatusbyFormType  P <*OQd ddd dd dd#dd#dd#dd#9dd#9dd#dd#dd#C]D(#(#,dd ,dd ,dd ,dd ,dd ,dd ,dd ,dd ,dd +  !](x(x !dXdX 3]&] 3 <]/!3] < <]/!3] < A]]0!3] A  FormType 3)$#]] 3? A]0!80 A TotalForms <2$8"] < A]0!8" AShortForms <2$8"] < A]0!8" ALongForms 7]&$8"] 7 NRFUStatus 4]#D ] 4  # =],!D!#] =A  % =],!D"#] =.B =],!D#3] =  # =],!D$#] =B  % 4]#!D%#] 4C =],!D&0] =# =],!D'"] =  % 4]#!D(#] 4C  Total `]O)] ({4A42372965P({4A`3v ]A7799783P]Ah7,799,783 vyKX?3P ]A7799783 ]Av 7@23.607@23.60 VvECX@3 7@23.60 7@v V _vNXAv ?A2093263P?A_2,093,263 vyKXB3P ?A2093263 ?Av Qx6@22.47Qx6@22.47 VvECXC3 Qx6@22.47 Qx6@v VDelete _vNDv WA6054399PWA_6,054,399 vyKE3P WA6054399 WAv Gz,@14.29Gz,@14.29 _vNCF3 Gz,@14.29 Gz,@v _ hvW!G3v RA4853394PRAh4,853,394 vyKH3P RA4853394 RAv \(\-@14.68\(\-@14.68 VvECI3 \(\-@14.68 \(\-@v V _vNJv mS2A1201005PmS2A_1,201,005 vyKK3P mS2A1201005 mS2Av Hz)@12.89Hz)@12.89 V]ECL3 Hz)@12.89 Hz)@v VUndetermined \]K!`M] @7163P@\7,163 ]uH!`N3P @7163 @] {Gz?0.02{Gz?0.02 ^]MB!`O3 {Gz?0.02 {Gz?] ^ e]T!!`P3] ݷ@6109Pݷ@e6,109 ]uH!`Q3P ݷ@6109 ݷ@] {Gz?0.02{Gz?0.02 U]DB!`R3 {Gz?0.02 {Gz?] U \]K!`S] x@1054Px@\1,054 ]uH!`T3P x@1054 x@] {Gz?0.01{Gz?0.01RHF!`U3 {Gz?0.01  {Gz?] R#dXXd>##XXXdXu;#dXXXXdY XdXTableincludesdataforPuertoRicoandexcludesdataforHialeah,FL(LCO2928)#Y  dYX#.#XX YX# "XU dXXXXdY XdXSource:(Moul2002);DataSource:DMAF.#Y  dYY##XX YY# " V WithrespecttothecharacteristicsofNRFUquestionnairesbyformtype,/ #  18      ׀theNRFUevaluation $X findingsindicatethatalmost14.5millionofthe38.6millionb #  19      ׀questionnairesintheDRF2were p% Y conductedwithproxyrespondents.Thisrepresentedabout37.5percentofallquestionnaires.B   (9, $ t page13,R15)C  Ԁ 5\Ԁ  About31.1percent(4.5million)oftheproxyinterviewswereforoccupiedHUs.B   (9,page14,  T  R16) ]C  Approximately  63.8percent(9.2million)ofthe14.5millionproxieswereforvacantunits.B   (9,page15,R17) ]C    dXXXX  Table6B  ԍ(6,page13,R18)s^C   P  CharacteristicsofNRFUEnumeratorQuestionnairesbyFormType [ #  20       <  S^*\^d ddd dd dd dd dd dd dd dd dd OQ(#(#,dd ,dd ,dd ,dd ,ddd ,Vdd ,dd ,edd ,`dd +  !] d d !dXdX 7]*x  ] 7 ?]2$x  "] ? A]]0!x  "] A FormType 3)$x  "]] 3 ;]* $   ; Total @ Forms <2$ $ "]  < D]3! $ "  D Short @ Forms <2$ $ "] < D]3! $ " D Long @ Forms :])$ $ "] : ReturnResponses 7]&0 ] 7# @]/!0 "] @  %h #  21      =],!0 #] = e =],!0 3] =  # =],!0 #] =e  % =],!0 #] =Pf =],!0 3] =  # =],!0 #] =f  % 4]#!0 #] 4Ag  TotalReturns `]O ] ]lA38636451P]lA`g38,636,451 ]zL 3P ]lA38636451 ]lA] Y@100.0Y@100.0 _]NC 3 Y@100.0 Y@] _ i]X! 3] 0|A29987599P0|Ai29,987,599 ]yL 3P 0|A29987599 0|A] ffffffS@77.6ffffffS@77.6 ^]MB !3 ffffffS@77.6 ffffffS@] ^ h]W! "3] `A8648852P`Ah8,648,852 ]xK #3P `A8648852 `A] ffffff6@22.4ffffff6@22.4 UvDB $3 ffffff6@22.4 ffffff6@] UProxyInterviews `vO8 %v  kA14474361P kA`14,474,361 vzL8 &3P  kA14474361  kAv Y@100.0Y@100.0 _vNC8 '3 Y@100.0 Y@v _ ivX!8 (3v eA11401120PeAi11,401,120 vyL8 )3P eA11401120 eAv 33333S@78.833333S@78.8 ^vMB8 *3 33333S@78.8 33333S@v ^ hvW!8 +3v lrGA3073241PlrGAh3,073,241 vxK8 ,3P lrGA3073241 lrGAv 3333335@21.23333335@21.2 UvDB8 -3 3333335@21.2 3333335@v UFinalAttempt _vND.v 6/A1042715P6/A_1,042,715 vyKD/3P 6/A1042715 6/Av Y@100.0Y@100.0 _vNCD03 Y@100.0 Y@v _ gvV!D13v x%A703605Px%Ag703,605 vwJD23P x%A703605 x%Av P@67.5P@67.5 ^vMBD33 P@67.5 P@v ^ gvV!D43v A339110PAg339,110 vwJD53P A339110 Av @@@32.5@@@32.5 UvDBD63 @@@32.5 @@@v UPartialInterviews _vN7v jv?A2061930Pjv?A_2,061,930 vyK83P jv?A2061930 jv?Av Y@100.0Y@100.0 _vNC93 Y@100.0 Y@v _ hvW!:3v >0A1064696P>0Ah1,064,696 vxK;3P >0A1064696 >0Av I@51.6I@51.6 ^vMB<3 I@51.6 I@v ^ gvV!=3v n.A997234Pn.Ag997,234 vwJ>3P n.A997234 n.Av 333333H@48.4333333H@48.4 UvDB?3 333333H@48.4 333333H@v URefusals ^vML@v t'A771002Pt'A^771,002 vxJLA3P t'A771002 t'Av Y@100.0Y@100.0 _vNCLB3 Y@100.0 Y@v _ gvV!LC3v tA433448PtAg433,448 vwJLD3P tA433448 tAv L@56.2L@56.2 ^vMBLE3 L@56.2 L@v ^ gvV!LF3v HA337554PHAg337,554 vwJLG3P HA337554 HAv fffffE@43.8fffffE@43.8 UvDBLH3 fffffE@43.8 fffffE@v USpanish ^vMXIv A470184PA^470,184 vxJXJ3P A470184 Av Y@100.0Y@100.0 _vNCXK3 Y@100.0 Y@v _ gvV!XL3v \A366399P\Ag366,399 vwJXM3P \A366399 \Av yS@77.9yS@77.9 ^vMBXN3 yS@77.9 yS@v ^ gvV!XO3v V@103785PV@g103,785 vwJXP3P V@103785 V@v 6@22.16@22.1 U]DBXQ3 6@22.1 6@v UReplacement ^]MR]  %A705936P %A^705,936 ]xJS3P  %A705936  %A] Y@100.0Y@100.0 _]NCT3 Y@100.0 Y@] _ g]V!U3] A507570PAg507,570 ]wJV3P A507570 A] Q@71.9Q@71.9 ^]MBW3 Q@71.9 Q@] ^ g]V!X3] 6A198366P6Ag198,366 ]wJY3P 6A198366 6A] <@28.1<@28.1RHFZ3 <@28.1 <@] R#dXXda##XXXdX4^#dXXXXdY XdXSource:(Moul2002)#Y  dYd##XX Y# Z Approximately771,000(2.0percent)oftheNRFUquestionnaireswereclassifiedasrespondent L] refusals.B  ԍ(9,page13,R18) C  ԀAbout56.2percentofthetotalNRFUrefusalswereforshortformquestionnaires;43.8 8^ percentwereforlongformquestionnaires.B  ԍ(9,page13,R19/R20)C  Ԁ The43.8percentrateofrefusalsthatwerelong $t_ formsissubstantiallyhigherthanthepercentoftotalformsthatwerelongforms(22.4percent). d` Thissuggestspoorerlongformquality.  Pa TheNRFUevaluationalsoexaminedthedistributionofrespondenttypeforlongformandshort !(c formNRFUquestionnaires(seeTable7).QuestionR3,onthebackcoverofthequestionnaire, "d u!    identifiesthetypeofrespondentwhoprovidedcensusinformationtoNRFUenumerators.  QuestionR3identifiedrespondentswholivedattheunitonApril1,2000,movedintotheunit  afterApril1,2000,orwhowereaneighbororothernonhouseholdmember.     Table7B  ԍ(6,page14,R35)_C   L  DistributionofRespondentTypebyFormType  8  B*_`d ddd dd dd dd ddd dVdd Vdd edd e`dd `\^(#(#,dd ,Edd ,dd ,dd ,dd ,dd ,dd ,dd ,dd +  ] ` ` XX 3]&t  ] 3 <]/!t  3] < <]/!t  3] < D]]3!t  3] DFormType 0&$t  "]] 0 ,]   ,TotalForms <2$ "] < D]3! " DShortForms <2$ "] < D]3! " DLongForms 7]&$ "] 7RespondentType 7]&,| ] 7  # @]/!,| #] @2  % @]/!,| #] @ @]/!,| 3] @  # @]/!,| #] @,  % @]/!,| #] @ @]/!,| 3] @  # @]/!,| #] @&  % 7]&!,| #] 7  Total c]R ] ]lA38636451P]lAcג38,636,451 ]}L 3P ]lA38636451 ]lA] Y@100.0Y@100.0 b]QC 3 Y@100.0 Y@] b l][! 3] 0|A29987599P0|Al29,987,599 ]}L !3P 0|A29987599 0|A] Y@100.0Y@100.0 b]QC "3 Y@100.0 Y@] b k]Z! #3] `A8648852P`Ak8,648,852 j]YK $3P `A8648852 `A] j100.0 4v#! %3] 4HHmember `vO4 &v 'uA22078073P'uA`22,078,073 vyL4 '3P 'uA22078073 'uAv ̌L@57.1̌L@57.1 ^vMB4 (3 ̌L@57.1 ̌L@v ^ ivX!4 )3v  mApA17045202P mApAi17,045,202 vyL4 *3P  mApA17045202  mApAv ffffffL@56.8ffffffL@56.8 ^vMB4 +3 ffffffL@56.8 ffffffL@v ^ hvW!4 ,3v 2SA5032871P2SAh5,032,871 vxK4 -3P 2SA5032871 2SAv M@58.2M@58.2 UvDB4 .3 M@58.2 M@v UProxy `vO@/v  kA14474361P kA`14,474,361 vyL@03P  kA14474361  kAv B@37.5B@37.5 ^vMB@13 B@37.5 B@v ^ ivX!@23v eA11401120PeAi11,401,120 vyL@33P eA11401120 eAv C@38.0C@38.0 ^vMB@43 C@38.0 C@v ^ hvW!@53v lrGA3073241PlrGAh3,073,241 vxK@63P lrGA3073241 lrGAv A@35.5A@35.5 QGB@73 A@35.5 A@v QЀInmover ZP8 )A837728P)AZ837,728 yJ93P )A837728 )A @2.2@2.2 YOA:3 @2.2 @ Y cY!;3 Y$A666760PY$Ac666,760 yJ<3P Y$A666760 Y$A @2.2@2.2 YOA=3 @2.2 @ Y cY!>3 A170968PAc170,968 yJ?3P A170968 A @2.0@2.0 TvCA@3 @2.0 @ TЀNeighbor/Other `vOHAv  jA13636633P jA`13,636,633 vyLHB3P  jA13636633  jAv fffffA@35.3fffffA@35.3 ^vMBHC3 fffffA@35.3 fffffA@v ^ ivX!HD3v cydA10734360PcydAi10,734,360 vyLHE3P cydA10734360 cydAv fffffA@35.8fffffA@35.8 ^vMBHF3 fffffA@35.8 fffffA@v ^ hvW!HG3v $FA2902273P$FAh2,902,273 vxKHH3P $FA2902273 $FAv @@33.6@@33.6 U]DBHI3 @@33.6 @@v UNoResponse _]NTJ] ?A2084017P?A_2,084,017 ]wKTK3P ?A2084017 ?A] @5.4@5.4 ]]LATL3 @5.4 @] ] h]W!TM3] 7A1541277P7Ah1,541,277 ]wKTN3P 7A1541277 7A] ffffff@5.1ffffff@5.1 ]]LATO3 ffffff@5.1 ffffff@] ] g]V!TP3] ( A542740P( Ag542,740 ]vJTQ3P ( A542740 ( A] 333333@6.3333333@6.3QGETR3 333333@6.3  333333@] Q#XX"#dXXXXdXdXTableincludesdataforPuertoRicoandexcludesdataforHialeah,FL(LCO2928). LR Source:(Moul2002);DataSource:DRF2.#d##XX.# dS ArespondentwholivedatthefollowupunitonApril1wasconsideredahouseholdmember. U RespondentswhomovedintothefollowupunitafterApril1wereclassifiedasinmovers. V Neighborsandotherswhoprovidedinformationaboutthefollowupunitanditsoccupantswere W classifiedasnonhouseholdmembers.Forpurposesofthestudy,inmovers,neighbors,and X otherswereconsideredproxyrespondents. xY  Thestudyfindingsrevealthatabout57percentofallNRFUrespondentswerehousehold P [ members.Longformquestionnaireshadaslightlyhigherpercentage(1.4percentagepoints)of  (0.5%) @v/!`?3v @ @v/!H@3v @6,902 HA (0.6%) @v/!`B3v @ @v/!HC3v @2,811 HD (0.3%) @v/!`E3v @ @v/!HF3v @1,459 HG (1.8%) 7&!`H3v 7Undetermined 7&lI 768 lJ (0.0%) @/!4K3 @ @/!lL3 @18 lM (0.0%) @/!4N3 @ @/!lO3 @19 lP (0.0%) @/!4Q3 @ @/!lR3 @31 lS (0.0%) 7]&!4T3 7TotalReturnsforRespondentType* ]]LU] ]lA38636451]lA]38,636,451 e]TFV3 ]lA38636451 ]lA] e f]U!W3]  kA14474361 kAf14,474,361 e]TFX3  kA14474361  kA] e f]U!Y3] 'uA22078073'uAf22,078,073 e]TFZ3 'uA22078073 'uA] e e]T![3] ?A2084017?Ae2,084,017UKI\3 ?A2084017  ?A] U#dXXd##XXXdX#Y XX*FromTable7. \ dY  YTableincludesthedataforPuertoRicoandexcludesthedataforHialeah,FL(LCO2928)#Y  dYN#. P] Source:(Moul2002);dY  YDataSource:DRF2.#Y  dY##XX Y #Y XX  h^ #XX Y# Thestudyresultsindicateadisproportionatenumberofpartialinterviewsfortheproxy "a respondentscomparedtohouseholdrespondents.Specifically,thedatarevealthatofthe14.5 #b millioninterviewscompletedwithproxyrespondents,about1.1million(7.6percent)were l$c classifiedasapartialinterview.B   (9,page16,R27) dC  ԀThisiscontrastedtothe22millioninterviewscompletedwith X% d householdrespondentsofwhichabout873,000(4.0percent)wereclassifiedasapartial D&!e interview.B   (9,page16,R28) C  ԀWithrespecttotheuseofcontinuationquestionnairesforhouseholdscontainingmore 0'"f thanfivepersons,thestudydatashowthatalmost1.3millioncontinuationquestionnaireswere (l#g usedduringNRFU.B  C   B  ԍ(9,page20,R29)C  ԀThisrepresentsabout3.2percentofthetotalNRFUreturns(38,636,451).B  C   B  ԍ(9,page16,R30)C  Ԁ )X$h  zAsexpected,about93.6percentofcontinuationquestionnaireusageinvolvedonecontinuation )H%i form.B   (9,page20,R31)C  b *4&j   + 'k u#    4.6.50  EffectsofAddedandDeletedUnitsontheDMAF (#(# TheNRFUevaluationalsoexaminedthedistributionofaddedanddeletedaddressesinNRFUby  TEA. #  23      ׀Themajorityofaddedanddeletedaddresseswerein_mailout_/mailbackareas.Ofthe t 688,944addedunitsinTEAswhereNRFUoccurred, #  24      ׀alladdressesmetthecriteriatobe ` includedontheDMAF.B   (9,page27,R32) C  ԀSlightlymorethan6millionaddressesweredeletedduringNRFU.B   (9,page28,R33) NC   L  ThedistributionofdeletedaddresseswassimilartotheworkloaddistributionacrosstheTEAs, 8  buttherewasadisproportionatenumberofaddedunitsinU/Lareas(31.9percent)comparedto $ t thepercentageoftheNRFUworkload(21.7)inU/Lareas.h #  25      B   (9,page27,R34) 'C    `  4.6.60  NRFUCosts  8 (#(# SourceinformationoncostscomesfromMonaco(2002).   NRFUfieldoperationswerecompletedwithin7.23percentofthe$1.1billionbudget. B  ԍ(10, d page1,R1) gC  Thetotal   costofNRFUfieldandofficeoperationswasderivedfrom_PAMS_/ADAMSthepayrolland   administrativesystemusedtosupportCensus2000(seeTable9).Thealmost$1.2billioncostof p NRFUfieldoperationsincludedthefollowingcomponents:NRFU,POP99,ResidualNRFU(R \ NRFU),andReinterview.| #  26      B   (10,page4,R2) C  ԀThePOP99operationwasconductedtoobtainpopulationcountsfor H occupiedunitsthatwereclassifiedaspopulationunknownduringNRFU.ResidualNRFUwas 4 conductedforquestionnairesthathadbeencheckedin,butcouldnotbeprocessedsuchasfor  p blank,lost,ordamagedquestionnaires.  \ Thecostcomponentofthe$1.12billionexpenseforconductingNRFUandPOP99areshownin 4 Table10.POP99costsareincludedwithNRFUbecausebothoperationsusedthesametask   code.Themileagecostincludesproductionworkandtraveltoandfromtrainingsessions.The   otherobjectscostincludescivilianpersonnelbenefits,telecommunicationservices,andother  costs.     u$      GOYTable9B  ԍ(7,page4,R2)C    TotalCostforFieldandOfficeOperations cX_XXX  #XXXcX_#*k]ldd dd Udd Uedd eUdd Uedd edd edd edd ab(#(#,4$$ ,$$ ,$$ ,$$ ,$$ +  cX_XXX .tt .#XXXcX_v#dXXXXdXdX @/!( @Workload @/!(3 @CostPer ( Case @/!3 @TotalCost @/!(3 @%ofTotal (  Cost 9/! 3  9#dXXd#dXdXTotalfieldandoffice  L  operations e[!    hA44897971PhAe44,897,971m #  27      L L 3P hA44897971 hA ףp= ;@27.09Rףp= ;@ $27.09 {I L3R ףp= ;@27.09 ףp= ;@   0P@A $1,261,707,341 yD L3P  0 @A  ?100?100.00% g]G L3 ?100 ? $gTotalfieldoperations e[! 0 hA44897971PhA e44,897,971 L 03P hA44897971 hA  ףp= :@26.09Rףp= :@$26.09 I 03R ףp= :@26.09 ףp= :@ sA 1171205039PsA$1,171,205,039 N 03P sA 1171205039 sA ~:p?96.27~:p?96.27% f\O 03 ~:p?96.27 $ ~:p? $fNRFUandPOP99s \R . 'A42269216P'A \42,269,216 L .3P 'A42269216 'A  Gz:@26.58RGz:@$26.58 I .3R Gz:@26.58 Gz:@ @nA 1123563961P@nA$1,123,563,961 N .3P @nA 1123563961 @nA  @@0j?89.05% cYL .3  @@ $ 0j? $cRNRFU ZP ,  p@120919Pp@Z120,919 J , 3P p@120919 p@ p= c<@28.39Rp= c<@$28.39 I , 3R p= c<@28.39 p= c<@ }1JA3433211P}1JA$3,433,211 K , 3P }1JA3433211 }1JA  @@Jf?0.27% cYL , 3  @@ $ Jf? $cReinterview [Q*  "CA2507836P"CA[2,507,836 K* !3P "CA2507836 "CA zG1@17.63RzG1@$17.63 I* "3R zG1@17.63 zG1@ wA44207867PwA$44,207,867 L* #3P wA44207867 wA  @@ٔ?3.50% lbL* $3  @@ $ ٔ? $lTotalofficeoperations e[!( % hA44897971PhAe44,897,971 L( &3P hA44897971 hA )\(?1.01R)\(?$1.01 H( '3R )\(?1.01 )\(? xғA45251151PxғA$45,251,151 L( (3P xғA45251151 xғA HP?3.73HP?3.73% e[N( )3 HP?3.73 $ HP? $eAssignmentPreparation \R& * hA44897971PhA\44,897,971 L& +3P hA44897971 hA Q?.56RQ?$0.56 G& ,3R Q?.56 Q? P.xA25356645PP.xA$25,356,645 L& -3P P.xA25356645 P.xA  @@T?2.01% jvYL& .3  @@ $ T? $<jAssignmentControl cvR$ /v hA44897971PhAc44,897,971 vL$ 03P hA44897971 hAv )\(?.44R)\(?$0.44 vG$ 13R )\(?.44 )\(?v rA19894506PrA$19,894,506 vL$ 23P rA19894506 rAv L7A`?1.65L7A`?1.65%#dXXd#^TR$ 33 L7A`?1.65 $<  L7A`?v ^<,X,X,X'X<#XXXdX#    XXSource:(Monaco2002)#XX# (3  dXXXX  Table10B  󍀎 (6,page31,R56)C   x6 SummaryofFieldOperationCostforNRFU(includingPOP99s)d&W%XdX d7 t*ijA d d4$$ 4$$ $$ $$ $$ k]l(#(#, dd ,dd ,dd +  +]]P:P +#dXX%d&W,#dXdX CostComponent =]],!d;]] =   Dollars =]],!d<0]] = ?  Percent =],!d=0]] = Total =],!>] = $1,123,563,961 `]O!?3] Y@100.0Y@` 100.0 _vNC@3 Y@100.0 Y@] _ ProductionSalaryCost dvS!lAv 8A 7577564028Ad 757,756,402 cvRGlB3 8A 757756402 8Av c 67.4B  ԍ[R2]C  =v,!lC3v = TrainingSalaryCost dvS!xDv XA 182201464XAd 182,201,464 cvRGxE3 XA 182201464 XAv c 16.2B  ԍ[R3]C  =v,!xF3v = MileageCost dvS!$Gv LQA 107500627LQAd 107,500,627 cvRG$H3 LQA 107500627 LQAv c 9.6B  ԍ[R4]C  =],!$I3v = OtherObjectsCost c]R!0 J] %A76105468%Ac 76,105,468 ]rF0 K3 %A76105468 %A] 333333@6.8333333@ 6.8B  ԍ[R5]C  QGE0 L3 333333@6.8  333333@] Q#dXXd#dXdX 9,X,A X,X,X90  0(#(# A DataSource:U.S.BureauoftheCensus,2001c.(!xL(#(#      A #dU#Source:(Monaco2002)#XX# !@M  ThefinalNRFUcostsshowedsomevariancebetweenactualspendingandbudgetedamounts $P (seeTable11).ThreeareasofoverspendingforCensus2000resultedfromhigherstaffing |% Q (especiallycrewleader)costs,lowerproductionrates,andlargerReinterviewworkloads. h&!R    @(#T @% 8   Table11B  ԍ(7,page2,R4) C    PercentofVariance   XXd (NRFU,RNRFU,POP99s,Reinterview) #d ##XX #   *n]odA d dd  dd dd ij(#(#,J dd ,dd ,edd ,edd +  XXci .<< . @/! @Variance @/!3 @%Variance  ofBudget @/!h 3 @%ofTotal   Variance#ci # 9/!h  3  9Total e[!    ҒA78946983PҒA e$78,946,983 L  3P ҒA78946983 ҒA  n4@-7.23n4@ -7.23% ~I  3 n4@-7.23 n4@  ?100?100.00% ^TG 3 ?100 ? $^NRFU,POP99s,RNRFU ]S 0 ӎ -64649666Pӎ]($64,649,666) M 03P ӎ -64649666 ӎ ^)˰-6.56^)˰-6.56% I 03 ^)˰-6.56 ^)˰ 8m4?81.898m4?81.89% f\O 03 8m4?81.89 $ 8m4? $ f0 p Enumerators&CrewLeader  . Assistants f\" p p   _dF-2934975P_dF f($2,934,975) L .3P _dF-2934975 _dF  H}m-.36H}m -0.36% ~H .3 H}m-.36 H}m  z6>?4.54z6>?4.54% ndN .3 z6>?4.54 $ z6>? $ n0 p CrewLeaders pf+ p p   > -56043487P> p($56,043,487) M 3P > -56043487 >  x&1ܿ-44.05x&1ܿ -44.05% J 3 x&1ܿ-44.05 x&1ܿ  v?86.69v?86.69% f\O 3 v?86.69 $ v? $ f0 p FieldOperationsSupervisor,   OfficeOperationsSupervisor, j  SpecialPlaceOperations 2  Supervisor e["J p p   \1A1137892P\1A e$1,137,892 K 3P \1A1137892 \1A  St$?3.32St$? 3.32% H !3 St$?3.32 St$?  /n-1.76/n-1.76% f\O "3 /n-1.76 $ /n $ f0 p Clerks&RecruitingAssist. f\"H#p p   Y-6753196PY f($6,753,196) j`LH$3P Y-6753196 Y   jN/A h^'H%3  n?10.45n?h10.45% f\OH&3 n?10.45 $ n? $ f0 p OtherEmployees dZ"F'p p   K-55900PK d($55,900) h^JF(3P K-55900 K   hN/A f\'F)3  H}M?.09H}M?f0.09% mcMF*3 H}M?.09 $ H}M? $ mReinterview f\!D+  P>r -19543013PP>r f($19,543,013) MD,3P P>r -19543013 P>r  ݓZ-79.23ݓZ -79.23% JD-3 ݓZ-79.23 ݓZ  Gz?24.75Gz?24.75% m\OD.3 Gz?24.75 $ Gz? $mMiscellaneous cRB/ T-5245696PTc($5,245,696) LB03P T-5245696 T .!u?6.43.!u?6.43% HB13 .!u?6.43 .!u? St$-6.64St$-6.64%_USB23 St$-6.64 $ St$ _?,XA X,X,A X?#XX #    XXSource:(Monaco2002)#XX"#U  2 :j"#Thelargestoverspending(86.69percent)or$56millionwasforcrewleaderexpenditures.Crew l5 leaderexpendituresexceededthebudgetforallLCOtypes,butespeciallyforTypeCoffices X6 ($42,364,336). #  28      ׀B   (10,page2,R3) $C  ԀThelargedeficitincrewleadercostsisattributedtothefactthatcrewleaders D7 weremodeledat33,401positions(whichincludesa50percentreplacementtrainingrate),buta 08 totalof49,694crewleaderswereactuallyhired.B   (10,page2,R4) %C  ԀAlthoughcrewleaderswerenotthelargest l9 percentageofhirees,theyworkedmoreproductiondaysandhoursatahigherpayratethanother X: staffandexceededthefrontloadinglimit. D; WhenactualcostsforNRFUandPOP99werecomparedtotheCensus2000allocationmodel  = datedMarch30,2000, #  29      ׀theanalysisindicatedthattheactualproductionrateofNRFU !> enumeratorswas1.04casesperhourcomparedtotheallocationmodelproductionrateof1.35 "? casesperhour.B   (10,page3,R5) (C   #@  h% B dO& 8   TheDecennialManagementDivision(DMD)suggeststhatthelowerproductionratemayhave  beeninpartduetoenumeratorsnotbeingonthejoblongenoughtodevelopstrategiesthatcould  resultinproductionefficiencieswhichcharacterizelongertermemployees(Monaco2002).B  ԍ(10,page3,R6) *C    TheNRFUReinterviewwasdifficulttoanalyze.Accordingto_DMD_sanalysis,theNRFU ` Reinterviewworkloadappearedtobe121percentlargerthanplanned,andthecostwasgreater L  by79.23percent.B   (10,page3,R7) j,C  ԀThebudget,whichmodeledonlyforpersonalvisitfollowup,assumeda 8  Reinterviewworkloadof1.1millioncases,buttheOCS2000actualworkloadof2.5million $ t Reinterviewcasesincludedbothpersonalvisitandtelephonefollowup.B   (10,page4,R8) -C  ԀThe_PAMS_/ADAMS  ` dataareforbothpersonalvisitandtelephonefollowup,butseparatetaskcodeswerenot  L  assigned;therefore,thecostsforpersonalvisitandtelephonecouldnotbedistinguished.  8   B,X,A X,XA XB4.6.70  OperationalChallenges  (#(# F,XA X,X,A X7/FAlthoughNRFUwascompletedaheadofschedule,someoperationalchallengeswere   encountered.ErrorsinthesoftwareusedtocreatetheinitialNRFUfilesresultedinsomeaddress   listingsbeingomittedforrespondinghouseholds.Theaddressregisterlistingsshouldhave p containedtheaddressesofHUsforbothrespondingandnonrespondinghouseholds.  #  30      ׀ \ Additionally,thesurnamesofrespondinghouseholdsin_mailout_/mailbackareaswereerroneously 4 omittedintheinitialproductionofNRFUfiles.InU/Lareas,surnameinformationwas  p incorrectlytakenfromanincorrectfilefield.  #  31      ׀Theaddresslistingsalsohadanincorrectstarting  \ address.TheaddresslistingsstartedwiththeaddressofthefirstNRFUcaseineachblockand H omittedtheaddressesofanyrespondingHUsthatshouldhaveappearedpriortothefirstlisting 4 designatedforNRFU.   TheNRFUevaluationreportednumerousotheroperationalchallengesincludingHUsadded  duringU/LnotbeingreflectedontheNRFUlistings,majorenumerationproblemsinthe  Hialeah,FloridaLCO,delaysintheidentificationoftheNRFUuniverse,slowimplementation  andpoormanagementofNRFUReinterview,inconsistentcostandprogressdata,multiple l enumerations,andfailurebyenumeratorstoobtainapopulationcount._~h #  32      _ X   $X" u'    B,X,A X,XA XB4.6.80  FactorsContributingtotheEarlyCompletionofNRFU (#(# F,XA X,X,A X7FTherewerethreefactorsthatcontributedtotheearlycompletionofNRFU.Locallycompetitive  payratesallowedtheregionstoattract,recruit,andretainstaffinitsLCOs.Early,aggressive t frontloadingoffieldstaffcoupledwithtimelyreplacementtrainingensuredsufficientstafflevels ` tobegintheoperationwithafullcomplimentofworkersandtoreplenishitasneeded.(See L  Section4.1foradditionaldetailsregardingtheeffectsoffrontloadingandpayonthecompletion 8  ofNRFU.)ImprovedinformationtechnologysuchastheOCS2000,MasterActivitySchedule, $ t andmapprintingcapabilityintheLCOsalsoplayedanimportantroleinthesuccessofNRFU.  `  ?,X'X,XA X?4.6.90  NRFURecommendationsforthe2010Census  #  33       8 (#(# ! !   wxyz(o"px$  wxyz#" 3"  0 '  3=2o"3  0'(#'(#  Continuetoofferlocallycompetitivepayratestoallowregionstoattract,recruit,and   retainbothofficeandfieldstaffintheirLCOs. 3==݌ (#(# Ќ  " 3"  0 '  3>2o"3  0'(#'(#  Continuethepracticeoffrontloadingfieldstaffandcombineitwithreplacementtraining   toensuresufficientstafflevelsthroughouttheoperation. 3>6?݌p(#(# Ќ  " 3"  0 '  3r@2o"3  0'(#'(#  IdentifyandremoveLateMailReturnsperiodicallyfromtheNRFUworkloadtoreduce H theworkloadandthenumberofHUswithmultipledatacaptures. 3r@@݌4(#(# Ќ  0 ' 0'(#'(#BecauseoftheplannedintroductionofmobilecomputingdevicesT #  34      ׀inthe2010Census,  \ enumeratorswillbeabletotransmitdatadirectlytoheadquartersforprocessingand H receivedailyupdatedfieldassignments(DecennialManagementDivision2003).This 4 potentiallywillimprovetheaccuracyoftheNRFUuniverselistingsandreducemultiple   enumerations. (#(# " 3"  0 '  3*D2o"3  0'(#'(#  ProvidefieldofficeswithDMAFmaintenancecapabilitiesandrealtime,uptothe  minuteaccess. 3*DcD݌(#(# Ќ  " 3"  0 '  3iE2o"3  0'(#'(#  MakeNRFUReinterviewanindependentoperationmanagedbysomeoneotherthanthe X  AssistantManagerforFieldOperations. 3iEE݌D!(#(# Ќ  " 3"  0 '  3F2o"3  0'(#'(#  IncludeResidualNRFUandPOP99operationsinthecensusdesignandplan. 3FF݌#l!(#(# Ќ  " 3"  0 '  3G2o"3  0'(#'(#  Rethinktheassignmentareastructureanddelineationprocesstomakeuseofnew $D # technologyandanintegratedsystemdesign. 3G H݌%0!$(#(# Ќ   &"% dO(    " 3"  0 '  3I2o"3  0'(#'(#  Developandimplementanintegratedtrackingdatabasesystemforplanning,tracking,  propertymanagement,procurement,kitproduction,shippingandreceiving. 3II݌(#(# Ќ  4.6.100  UseofToolKitMethods t(#(# EvaluationsourceinformationcomesfromTenebaum(2001b). L  TheCensus2000OperationalPlan(U.S.DepartmentofCommerce2000)providedfortheuse $ t oftargetedspecialenumerationmethodstoimprovethecountofpopulationgroupsand  ` geographicareaswhichhistoricallyhaveadisproportionateshareofpeoplemissedinthecensus.  L  Theplanincludedtheimplementationofalimitednumberofspecialtoolkitstrategiesto  8  overcomebarrierstosuccessfulenumerationandtoaddressconcernsaboutthepersonalsafetyof $  enumerators,improverespondentcooperation,gainaccess,andimprovecoverage.   ThethreetoolkitstrategiesusedsuccessfullyduringCensus2000NRFUfieldoperationswere   blitzenumeration,pairedenumeration,andlocalfacilitators.   Duringblitzenumeration,acrewofenumeratorsconductedenumerationactivitiesinavery 6 compressedtimeschedule(generallytwoorthreedays)undertheclosepersonalsupervisionofa " crewleader.Thecrewleaderremainedonsitetoresolveproblemsandtoassistwithrespondents  whowerereluctanttoparticipateinthecensus.Blitzenumerationprovedtobesuccessfulin  areaswithcomplexhouseholds,lowlevelsofcooperation,multiunitbuildings,alargernumber  ofrenters,and/orlowenumeratorproductivity.  Pairedenumerationwasusedmostlytoprovidesupportinareaswheretherewereconcernsabout Z thesafetyofenumerators.Oneenumeratorconductedtheactualinterviewwhiletheother F enumerator,keepinganeyeonthesurroundingenvironment,providedsupportfunctionsas 2 needed.PairedenumerationwasusedalsoinruralareascontaininghardtolocateHUs.Inthis n situation,onememberoftheteamservedasanavigatorwhiletheotherpersondrovethecar.  Z Localfacilitators,alsoknownasculturalfacilitators,weregenerallywellknownresidentsofthe F particularareabeingenumerated.Theyweresworntoprotecttheconfidentialityofcensus 2 informationandprovidedassistancesuchasintroducingenumeratorstorespondents,providing   translationservices,convincingresidentstocooperate,andhelpingenumeratorstofindhidden !   livingquarters.Localfacilitatorswerepaidonacontractbasisattherateofanenumerators "! hourlypay. #"  4.6.110  ToolKitMethodsAssessmentFindings j% $(#(# WhileTenebaum(2001b)notesnumerouslimitationstoassessingtheeffectivenessofthetoolkit B'"& methodsemployedduringNRFU,thereportdoesprovidesomeinsightintotheuseofthespecial .(~#' enumerationproceduresandtheirimpactonthelevelofrefusals,partialinterviews,final )j$( attempts,andenumeratorquestionnaireswithoutapopulationcount.Thereportalsocitessome *V%) anecdotalfeedbackfromenumeratorsregardingtheuseofthetoolkitmethods. *B&*  +.'+ Thefindingsrevealthatabout1.7million(4percent)NRFUcaseswereenumeratedusingoneof  thespecialtoolkitenumerationmethods. B  ԍ(11,  page10,R1) YC  ԀThecompletenessofdataforcensustractsinwhich  specialtoolkitenumerationmethodswereemployedwascomparabletonontargetedareas.  Overall,6.64percentoftoolkitenumeratedaddressesweresomethingotherthancomplete x interviewscomparedto5.93percentfortheregularlyenumeratedaddresses.B   (11,page12,R2) [C  ԀThismaysuggest d thatthespecialenumerationmethodswereeffectivebecausetheexpectationwasthattargeted P  areaswouldhavelesscompletedatasincetheywereidentifiedasdifficulttoenumerateareas. <  Additionalfindingsshowsthatblitzedunitshadahigherrateofrefusals,partialinterviews,final  d attempts,andpopulationunknowncasesthantheregularlyenumeratedunits.B   (11,page12,R3) ]C  ԀBlitzedunitsalso  P  hadahigherrateofrefusals,partialinterviews,finalattempts,andpopulationunknowncases  <  thandidunitswhichreceivedpairedorlocallyfacilitatedenumeration.B   (11,page   12,R4) ^C   (  Pairedenumerationhadlowerrefusals,partialinterviews,andfinalattempts,butslightlyhigher   ratesofpopulationunknowncasesthanaddressesenumeratedwithregularprocedures.B   (11,page12, \ R5) #`C  ԀLocally   facilitatedenumerationhadlowerrefusalrates,partialinterviews,andpopulationunknownrates,   butmuchhigherfinalattemptratesthanregularlyenumeratedunits.B   (11,page12,R6) aaC   t AlthoughthereportbyTenebaum(2001b)didnotcollectdetailedfeedbackfromenumerators L andcrewleaderswhoimplementedtoolkitenumerationmethodsduringNRFU,enough 8 informationwasgatheredfromroutinedebriefingquestionnairesandanecdotalinformationto $t reportthatmostenumeratorswhoconductedblitzenumerationthoughtitwasverybeneficialand ` thatitimprovedtheoverallenumerationinthetargetedareas. B  ԍ(11,page  13,R7)cC  B  C  Ԁ Similarly,mostenumeratorswho L conductedpairedenumerationreportedincreasedfeelingsofpersonalsafetyandotherbenefitsof < doingtheenumerationinpairs.B   (11,page13,R8)  eC   (  4.6.120  ToolKitMethodsRecommendationsforthe2010Census (#(# " 3"  0 '  3e2o"3  0'(#'(#  Continuetotargetdifficulttoenumerateareasforspecialenumerationmethodsinthe  2010Census. 3e f݌t(#(# Ќ  " 3 "  0 '  3g2o"3  0'(#'(#  Designcontrolledexperimentsforuseincensuspreteststomeasuretheeffectivenessof L! usingspecialenumerationmethodsondatacontentandcoverage. 3gOg݌8" (#(# Ќ  " 3 "  0 '  3h2o"3  0'(#'(#  Continuetorefinethetargetingalgorithmsusingtheplanningdatabase. 3hh݌$`"(#(# Ќ  " 3 "  0 '  3i2o"3  0'(#'(#  Obtaindetailedfeedbackonenumeratorproductivityandretentionasaresultof %8!$ implementingspecialenumerationmethods. 3ii݌&$"%(#(# Ќ   p+&* u*     -(8p   wxyz! ! <,X' X,X'X<4.70 ' NRFUEnumeratorTrainingandAdministeringtheQuestionnaire '(#'(# Evaluationsourceinformationforthesubsectionsof4.7comesfromBurtandMangaroo(2003).   (88- 6,XXX,X' X64.7.10  DescriptionofNRFUEnumeratorTraining `(#(# NRFUenumeratortrainingbegannationallyonApril24,2000.AllinitialNRFUclassroom 8  trainingsessionswerefrontloaded.Frontloadinganoperationquicklygottheoperationofftoa $ t faststart.Itreducedtheeffectsofstaffattritiononproductionandsomewhatlessenedthe  ` urgencyforthetrainingofreplacementenumerators.Asneeded,enumeratorreplacement  L  trainingsessionswereconductedtokeepcrewleaderdistricts,tothemaximumextentpossible,  8  attheirfullfrontloadedstaffinglevels.Atleastoneenumeratorreplacementtrainingsessionwas $  mandated.   Uponarrivalatthetrainingsession,traineesreceivedatraineekitcontaininganenumerators   manual,aclassroomworkbook,severaljobaids,andasupplyofneededformsandmaterials.   AlthoughtheNRFUenumeratormanualprovideddetailedjobinstructionsonallfacetsofthe p enumeratorsdutiesandresponsibilities,thejobaidsservedasquickreferencestospecific \ procedureswhileenumeratorswereworkinginthefield.Additionally,theNRFUenumerators H weregivenflashcardstoshowtorespondentswhenaskingspecificquestionsduringthe 4 interview.  p NRFUtrainingsessionsweregenerallyconductedbyacrewleaderwhowouldlaterserveasthe H traineesfirstlinesupervisorduringthefielddatacollectioneffort.Crewleaders,liketheir 4 enumeratortrainees,generallywererecenthiresandhadlittleornopreviousknowledgeof   censusoperationsandprocedures.Theireffectivenessastrainerswasvariedandthosewho   excelledastrainersclearlyhadacquiredtherequisiteskills,abilities,andknowledgefromprior  workexperience.  Tohelpensureuniformityandconsistencyinthepresentationofinformation,theNRFUtraining l usedverbatimlecturesandstandardizedvideos.Pairedpracticeinterviewingandroleplay X  situationswereincorporatedthroughoutthetraining.Thepairedpracticeinterviewsandroleplay D! scenariosfocusedlargelyontheimportancefortraineestouseestablishedinterviewing 0"  techniqueswhileadministeringthequestionnaire. #l! AnimportantcomponentoftheNRFUtrainingwas livepracticeinterviewing.Thetrainer $D # gaveeachofthetraineesanactualworkassignment.Forapproximatelyafourhourperiod,the %0!$ traineesweresentoutintothecommunitytoconductliveinterviews.Whenthetraineesreturned &"% tothetrainingsession,theydiscussedtheirfieldexperiencesandsoughtguidancefromthe '#& trainerasneeded.Attheconclusionoftraining,thetraineescompletedamultiplechoicetestto (#' assesstheirunderstandingoftheproceduresandjobresponsibilities.Theanswerstothetest )$( werethendiscussed,andthetraineesweregradedontheirperformance.Followingtraining,the |*%)  h+&* NRFUenumeratorswereimmediatelysentouttocollectcensusdatafromapproximately42  millionnonrespondinghouseholds.   4.7.20  BuildinganEffectiveNRFUTrainingProgram t(#(# TheCensusBureauhaslongrecognizedthatasuccessfulNRFUoperationinitiallydependsupon L  recruitingsufficientnumbersofcandidatesineachLCOareaandimplementingatraining 8  programthatadequatelyteachesthetraineestoperformthedutiesofaNRFUenumerator. $ t InpreparationfortheCensus2000DressRehearsal,theCensusBureauinvestedextensive  ` resourcestodesignandimplementaqualityNRFUenumeratortrainingprogram.Additionally,  L  theCensusBureauhiredanoutsidecontractortoreview,assess,andevaluatetheeffectivenessof  8  theCensus2000DressRehearsalNRFUtrainingprogram.Althoughthefindingsofthe $  evaluationindicatedthattheDressRehearsalNRFUenumeratorsweresuccessfullyand   effectivelytrained,thestudyresultsdidnoteseveralareasforimprovementsincompositionand   deliverythatwouldhelpensureahighlysuccessfulenumerationeffortduringCensus2000.    4.7.30  EvaluatingtheEffectivenessofNRFUEnumeratorTraining p(#(# TheeffectivenessoftheCensus2000NRFUenumeratortrainingprogramwasevaluatedusing H theKirkpatrickmodeloftrainingevaluation.TheKirkpatrickmodelassessesemployeetraining 4 programsonfourlevels:reactiontotraining,learning,application(onthejobperformance),and  p organizationalperformance.! #  35      ׀  \ Thepurposeoftheevaluationwastwofold:(1)toexaminethequalityoftheCensus2000NRFU 4 enumeratortrainingprogram,and(2)toassesshowwellpreparedthetraineeswere,following   training,toperformtheNRFUenumeration.    4.7.40  NRFUTrainingStudyMethodology (#(# AmajorcomponentoftheCensus2000evaluationmethodologyincludedananalysisand l thoroughreviewoftheCensus2000trainingmaterialsinconjunctionwiththeCensus2000 X  DressRehearsalevaluationreportrecommendationsbyBroadnax(1999). D! ThefourevaluationlevelsoftheKirkpatrickEvaluationModelforassessingtraining #l! effectivenessareshowninTable12(BurtandMangaroo2003). $X" TheCensusBureaudevelopedmultipleobservationguidesforusebystaffwhoobservedthe %0!$ classroomtrainingand/orfieldenumerationactivities.Observersusedthetrainingobservation &"% protocoltoreporttheirperceptionsoftrainereffectiveness,trainingdelivery,andtraining '#& materials.Observersusedtheenumerationprotocoltorecordtheirperceptionsofenumerators (#' t?, 88   onthejobperformance,attitudestowardtheirwork,andfeelingsabouthowwellthetraining 8 preparedthemtoperformtheirjob.e #  36      ׀Usingthecollectedobservationdata,theCensusBureau $ producedmeasuresofadequacyofthetrainingcontentandformat,measuresofenumerators  knowledgeofCensus2000conceptsandprocedures,andenumeratorperformancestatistics.    Table12B  ԍ(11,page33,R1) C     EvaluationLevelsofKirkpatrickModel   t *p]qd dJ dd J dd edd eedd en]o(#(#,dd ,dd ,Sdd ,dd +  +i L  L +XXKIRKPATRICK    EVALUATIONLEVEL 8i#! x   i 8WHATDOWE    WANTTOKNOW? 8i#! x   i 8MEASURES 8i#!   i 8DATASOURCE#XX# 2(&     i 2XXREACTION     -#!d, ] -Didtraineesfindthe    trainingeffective,   useful,andenjoyable? d   -#!] -Єattitudeaboutthejob    Єreactionstothetrainer   Єreactionstothetraining d  materials d,  Єreactionstothetraining ,  Єsatisfactionwith   knowledgegained -#!!] -   wxyz(o"p8" 3"  0 ]X eX,XXX0 3d2o"3  0    enumeratordebriefings 3d݌  " " " Ќ  " 3"   3`2o"3  0    postemployment  # telephonesurvey 3`݌d $ " " Ќ  " 3"   3J2o"3  0    crewleaderdebriefings#XX# 3Jw݌d, % " " Ќ  " 3"   3:2o"3  0    XXclassroomtraining , & observations#XX# 3:g݌ 7-+' " "] 7Ќ  XXLEARNING -#!(] -{Didthetraineesgain ) theknowledge * intended?Were p+ trainingobjectives p8, met?#{֕#w -#!8-] -ЄknowledgeofCensus . concepts / ЄknowledgeofCensus p0 procedures p81 Єattitudestowardajob 82 Єknowledgeofeffective 3 interviewingskills -#!4] -" 3"   3-2o"3  0    #wƷ#{classroomtraining 5 observations 3-Z݌6 " " Ќ  " 3"   3X2o"3  0    enumeration p7 observations 3X݌p88 " " Ќ  " 3"   3:2o"3  0    enumeratordebriefings 3:g݌89 " " Ќ  " 3"   32o"3  0    crewleaderdebriefings#{Ø#w 33݌: " " Ќ  " 3"   32o"3  0    tests#wXRXw~# 3B݌ 7-+; " "] 7Ќ  wXwXRAPPLICATION/ $< ONTHEJOB = BEHAVIOR -#!|>] -Canthetrainees $? effectivelydothejob @ aftercompleting |A training? -#!|DB] -Єproductivity $C Єonthejobperformance D Єoperationcompletion |E rates |DF  -#! H] -" 3 "   32o"3  0    enumeration $I observations 3@݌J " " Ќ  " 3 "   32o"3  0    enumeratordebriefings 3"݌|K " " Ќ  " 3 "   32o"3  0    crewleaderdebriefings 3݌|DL " " Ќ  " 3 "   32o"3  0    employeeperformance D M records#wXRXw # 3݌ 7-+ N " "] 7Ќ  wXwXRORGANIZATIONAL h 0O PERFORMANCE -#!0!P  -Whatimpacthasthe h 0Q traininghadonthe 0!R agencysoverall !S performance -#!"T  -N/A -#!h 0U  -N/A#wXRXwư#1'%h 0V    1wXwXRSource:(BurtandMangaroo2003)#wXRXwg# #V #XXXwXR#   wxyz(o"pp   wxyz9,X' X ]X eX9InadditiontotheformalCensus2000EvaluationProgramexaminationintoNRFUenumerator X& "Y training,additionaldataonreactionstothetrainingwereobtainedfromenumeratorandcrew D' #Z leaderdebriefingquestionnairesandfocusgroups. 0(#[ 1u- 188 1  Finally,theCensusBureausupplementedobservationanddebriefingdatathroughtheuseofa  postemploymenttelephoneinterviewofNRFUenumeratorsandcrewleadersandreviewed  performancedataforasampleofNRFUenumerators.   H  wxyz(sxp  wxyz 4.7.50  NRFUTrainingStudyLimitations `(#(# ThemethodologyusedtoevaluateCensus2000NRFUenumeratortrainingwaslimitedin 8  severalways. $ t    wxyz(o"pxH  wxyzDespitetheuseofstructuredobservationguides,thefinalassessmentsofthequalityof  L  enumeratortrainingandonthejobperformancewerebasedonthesubjectivejudgmentsof  8  individualobservers.Thereliabilityandvalidityofthesejudgmentsarehighlycorrelatedwith $  theaccuracyandconsistencyoftheobserversskillsasobservers,andalso,tosomeextent,on   theirknowledgeoftheNRFUoperation(BurtandMangaroo2003).   Theobservationswerenotbasedonascientificallyselectedsample.Becausethetrainingclasses   andindividualenumeratorsobservedwereinformalratherthanpredefinedstatistically p representativesamples,theabilitytogeneralizeevaluationresultsislimited. \ Additionally,itislikelythatenumeratorswereontheirbestbehaviorwhilebeingobserved.2 #  37      ׀ 4 Thus,itispossiblethattheobservationprocessinfluencedtheenumeratorsperformancewhich  p mightimpacttheoverallreliabilityoftheresults.  \  B,X' X,X' XB4.7.60  MeasuresofNRFUEnumeratorTrainingEffectiveness 4(#(# Thebestmeasureoftheeffectivenessofemployeetrainingprogramsisthedegreetowhichthe   skillstaughtintrainingaredemonstratedonthejob.BurtandMangaroo(2003)indicatethatthe  Census2000NRFUenumeratortrainingprogramadequatelypreparedtraineestoeffectively  performthetasksoftheNRFUenumeratorposition.B   (12,pageiv,R1) vC  ԀAdditionally,aboutthreefourthsofthe  NRFUenumeratorswhoparticipatedinasurveyoftrainingsatisfactionreportedthattheywere l satisfiedwiththetrainingtheyreceived.B   (12,page22,R2) C   X  Evaluationresultsrevealthatalmostalloftheenumeratorsproperlyidentifiedthemselvesatthe 0"  followupaddress,showedtheirIDcard,statedthepurposeoftheirvisit,anddeterminedthe #l! _HU_sCensusDaystatus.B   (12,pageiv,R3) -C  ԀAdditionally,mostenumeratorsverifiedthattheywereatthecorrect $X" addressandprovidedrespondentswithaPrivacyActNotice.B   (12,pageiv,R4) C  ԀWhilethemajorityofenumerators $D # recordedresponsesaccuratelyandlegibly,asignificantnumberofenumeratorsdidnotalways %0!$ readquestionnaireitemsaswrittenandoftendidnotusetheflashcardsprovided.B   (12,pagev,R5) `C  ԀInparticular, &"% dO.    enumeratorsseemedlesslikelytofollowtheprocedurestaughtintrainingwhenaskingthe  Hispanicoriginandracequestions.B   (12,pagev,R6) C  ԀAbouthalfoftherecommendationsfromtheCensus2000  DressRehearsalevaluationwereincorporated,eithercompletelyorpartially,intotheCensus  2000NRFUenumeratortrainingprogram.Theincorporatedrecommendationscontributedtoan t improvedtrainingprogram. B  ԍ(12,pageiv,R7) HC   `  4.7.70  NRFUTrainingRecommendationsforthe2010Census < (#(# AlthoughtheresultsofBurtandMangaroo(2003)indicatethattheCensus2000NRFU  d enumeratortrainingprogramwasviewedfavorablybythetraineesanddidproduceenumerators  P  whocouldeffectivelyobtaincensusdatafromnonrespondinghouseholds,theresultsalso  <  suggestsomeareastheCensusBureaushouldfocusonwhendevelopingNRFUenumerator (  trainingforthe2010Census.Somekeyrecommendationsinclude:   " 3"  0   32o"3  0(#(#  ContinuetoprovideanopportunityforthefieldworkcomponentofNRFUtrainingand   enforceinclusionoffieldworkinalltrainingsessions. 3V݌ (#(# Ќ  " 3"  0   32o"3  0(#(#  Continuetoplaceemphasisonreadingallofthequestionsexactlyasworded,adding ` additionalexplanationsonwhyreadingquestionsverbatimissoimportanttodataquality. L ConsidertheuseofavideothatfocusesontheimportanceofreadingtheHispanicorigin 8 andracequestionsexactlyasworded. 3ý݌$t(#(# Ќ  " 3"     32o"3  0    ! !Increasetheuseofroleplaying,varyingthesituationstoincludereluctantrespondents L andrefusals. 3݌8(#(# Ќ  4.7.80  AdministeringtheEnumeratorQuestionnaire (#(# ThepurposeoftheNRFUoperationwastocollectcensusinformationatspecificaddressesfor  whichacensusquestionnairewasnotreturnedtotheCensusBureau.Beforeconductingan  interviewforthehouseholdatthefollowupaddress,enumeratorswererequiredtointroduce p themselvesbystatingtheirname,showtheircensusID,explainthepurposefortheirvisitandthe \  approximatelengthoftimerequiredtocompletetheinterview,andhandtherespondenta H! PrivacyActNotice,D31. 4"  Oncetheseintroductoryactivitieswerecomplete,NRFUenumeratorswererequiredtoanswer  $\" twokeyquestionsbeforeconductingtheinterviewtocollectcensusinformationforthe $H # householdmembersandtheHU. %4!$  4.7.90  InterviewingattheCorrectAddress ' #&(#(# AcrucialjobtaskwasforNRFUenumeratorstoensurethattheywereatthespecificaddress )$( designatedforafollowupinterview.Typically,enumeratorsconfirmedthisbyreadingthe *%) addressonthequestionnairelabeltotherespondentandaskingiftheywereatthecorrect l+&* @/     address.Ofatotalof474enumeratorobservations,* #  38      ׀BurtandMangaroo(2003)revealthat  enumeratorsconfirmedthattheywereatthecorrectaddress92.5percentofthetime.B   (12,page16,R8) C  ԀInonly  sevenpercentoftheobservedinterviewsdidenumeratorsfailtoconsistentlyverifythatthey  wereatthedesignatedfollowupaddress.B  ԍ (12,page16,R9) C  ԀAdministeringenumeratorquestionnairesataddresses t notdesignatedforfollowupcouldaffecttheoverallqualityofcensusdata. `  4.7.100  DeterminingtheCensusDayStatusoftheFollowupUnit 8 (#(# OneofthemostcriticalresponsibilitiesofNRFUenumeratorswastodeterminetheCensusDay  ` statusoftheHUatthefollowupaddress.CensusDay,orApril1,2000,wasthefixedreference  L  dateforthecollectionofcensusinformation.DeterminingtheCensusDaystatusoffollowup  8  addressesnotonlydeterminedwhichsectionsand/orquestionsontheinstrumenttocomplete, $  butitalsoservedasareminderthattheinformationcollectedwouldbeasofApril1,2000.All   NRFUaddresseshadoneofthefollowingstatusesasofApril1,2000occupied,vacant,or   nonexistent.   Evaluationresultsindicateinabout97percentoftheobservedinterviewsenumeratorscorrectly p askedquestionS2, DidyouoranyoneinthishouseholdlivehereonSaturday,April1,2000?B   (12,page17,R10)C  - \ Additionally,inalmost91percentoftheobservedinterviews,enumeratorsaskedfollowup 4 screeningquestions,asappropriate,todeterminetheunitsCensusDaystatus.B   (12,page17, P  R11) VC  ԀForunitsthat  p weredeterminedtohavebeenoccupiedonCensusDay,studyresultsrevealthatinabout94  \ percentoftheobservedinterviews,enumeratorsproperlyaskedthequestioninordertorecorda H CensusDaypopulationcountfortheunitinquestionS5.B   (12,page17,R12) C   4  4.7.110  AskingaboutRelationshipstotheReferencePerson  (#(# Question2ontheenumeratorquestionnaireasksfortherelationshipofeachhouseholdmember  tothereferenceperson.Thereferencepersonisdefinedasthehouseholdmemberwhoownsor  rentstheHUandwho,accordingtoprocedure,islistedasPerson1onthehouseholdrosterin l question1.Failuretolisttheowner/renterasPerson1and/orincorrectlyaskingaboutthe X  referencepersonsrelationshiptotheotherhouseholdmembersratherthanaskingforthe D! relationshipofeachhouseholdmembertothereferenceperson,wouldresultinfaultydata 0"  collection. #l! Evaluationresultsshowthatenumeratorscorrectlyaskedtherelationshipquestioninabout81 $D # percentoftheobservedinterviews,butseldomusedtherelationshipflashcard.B   (12,page18,R13) ZC  ԀSeveralobservers %0!$ notedthattheenumeratorswhodidnotshowtherelationshipflashcardtorespondentsappeared &"% tohavedifficultyrecordingtherelationshipofacommonlawspouseand/oraliveinboyfriend '#& orgirlfriend.WhenrespondentsreportedthattherelationshipofahouseholdmembertoPerson  1wasason/daughter/child,enumeratorsweresupposedtoprobeforamorepreciserelationship  suchasnaturalborn,adopted,orfoster.Observationdatarevealthatenumeratorsprobedfor  morespecificrelationshipinformationforchildreninabout74percentoftheobserved t interviews.B   (12,page17,R14) C   `  4.7.120  AskingaboutHispanicOrigin 8 (#(# DuringNRFUenumeratortraining,considerableemphasiswasplacedontheproperprocedure  ` foraskingtheHispanicoriginquestion.Thiswasaccomplishedthroughacombinationof  L  verbatimtraining,pairedpracticeinterviews,andaninterviewerskillsvideo.Thetraineeswere  8  repeatedlytoldnottomakeassumptionsaboutapersonsoriginandnevertocompletethe $  questionbyobservation.   Rather,enumeratorsweretoshowrespondentstheHispanicoriginflashcard,whichlistedallof   theresponsecategoriesonthequestionnaire,andask: AreanyofthepersonsthatIhavelisted   Mexican,PuertoRican,Cuban,orofanotherHispanicorLatinogroup? p EvaluationresultsindicatethatenumeratorsshowedtheHispanicoriginflashcardtorespondents H inabout42percentoftheobservedinterviews.B   (12,page18,R15) 2C   4 Enumeratorsweresupposedtomarkaresponseboxforeachhouseholdmembertoindicate  \ whetherornotthehouseholdmemberwasofSpanish,Hispanic,orLatinoorigin.Ifthe H householdmemberwasofSpanish,Hispanic,orLatinoorigin,enumeratorsweretomarkthe 4 specificgrouptowhichthehouseholdmemberbelonged.   Despitetheemphasisplacedonhowtoaskthisquestion,NRFUenumeratorsreadtheHispanic  originquestionexactlyaswordedinonlyabout75percentoftheobservedinterviews.B   (12,page  <  18,R16) C  ԀInabout  84percentoftheobservedinterviews,enumeratorsinquiredaboutHispanicoriginforeach  householdmember,butdidnotnecessarilyreadthequestionexactlyasworded.B   (12,page18,R17) 5C   l  4.7.130  AskingaboutRace D!(#(# AswiththeHispanicoriginquestion,theNRFUenumeratortrainingplacedconsiderable #l! emphasisontheproperprocedureforaskingtheracequestion.Traineesweretoldthatracewas $X" basedonselfidentificationandthatobservationshouldneverbeusedtocompletetherace $D # question.Additionally,traineeswereinstructedtoshowtheraceflashcardtorespondentsand %0!$ ask: Nowchooseoneormoreracesforeachperson.Census2000wasthefirsttimethat &"% respondentscouldidentifytheraceofeachhouseholdmemberbychoosingmorethanone '#& responsecategory.Thus,itwasessentialforenumeratorstoreadtheracequestionexactlyas (#' wordedsorespondentswouldclearlyunderstandthatoneormoreracescouldbechosenfora )$( householdmember,ifapplicable. |*%)  h+&* WhenrespondentsreportedAmericanIndianorAlaskaNativeasahouseholdmembersrace,  enumeratorsweretrainedtoaskforandwriteinthenameofthepersonsenrolledorprincipal  tribe.Similarly,whenrespondentschoseotherAsian,otherPacificIslander,orsomeotherrace  asthehouseholdmembersrace,enumeratorsweretrainedtoprobeforandwriteinthespecific t nameoftherace. ` ObservationreportsoftheNRFUenumeratortrainingrevealthatmanytraineeshaddifficulty 8  askingaboutrace.Thus,itwasnotsurprisingthatdatafromenumeratorfieldobservations $ t indicatethatenumeratorswerelesslikelytofollowcorrectprocedureswhenaskingaboutrace  ` thananyothercensusquestion.Studyresultsindicatethatenumeratorsshowedrespondentsthe  L  raceflashcardinabout46percentoftheobservedinterviewsB   (12,page20,R18) C  andreadtheracequestionexactly  8  aswordedin63percentoftheobservedinterviews.B   (12,page19,R19) C  ԀInabout41percentoftheobserved $  interviews,enumeratorsreadalloftheracecategoriestotherespondent.B   (12,page19,R20) ^C     Whenenumeratorswererequiredtoprobeforthenameofanenrolledorprincipaltribeforthe   AmericanIndianandAlaskaNativeracecategories,theydidsoin70percentoftheobserved   interviews.B   (12,page19,R21) C  ԀSimilarly,whenenumeratorsneededtoprobeforthenameofaspecificraceforthe p otherAsian,otherPacificIslander,andsomeotherracecategories,theyaskedfortheracein81 \ percentoftheobservedinterviews.B   (12,page19,R22) C   H  4.7.140  CheckingHouseholdCoverage  p(#(# Anotherimportantenumeratorresponsibilitywastoverifythecompletenessandaccuracyofthe H householdrosterinquestion1.Question1wassupposedtolistallhouseholdmembersatthe 4 followupaddressasofCensusDay.   CoveragequestionC1asked: IneedtomakesureIhavecountedeveryonewholivedorstayed  hereonApril1,2000.DidImiss!anychildren,includingfosterchildren?anyoneawayon  businessorvacation?!anyroomersorhousemates?!anyoneelsewhohadnootherhome?   CoveragequestionC2asked: TheCensusBureauhasalreadycountedcertainpeoplesoIdont l wanttocountthemagainhere.OnApril1,2000,wereanyofthepeopleyoutoldmeabout X  !awayatcollege?!awayinthearmedforces,!inanursinghome,!incorrectionalfacility? D! AskingbothcoveragequestionswasimportanttoCensuscoverageandthefailureby #l! enumeratorstoalwaysaskthesequestionscouldaffectwithinhouseholdcoverage $X" measurements. $D # Evaluationresultsindicatethatenumeratorsaskediftheyhadmissedanyonewhoshouldhave &"% beenincludedonthehouseholdrosterin85percentoftheobservedinterviews.B   (12,page20, $t R23) sC  ԀTheresultsalso '#& showthat,in82percentoftheobservedinterviews,enumeratorsaskedifanyonewhohadbeen (#' includedonthehouseholdrostershouldnothavebeenincluded.B   (12,page T 21,R24) C   )$(  h+&* dO2    4.7.150  ObtainingOtherHouseholdData (#(# Thefieldobservationprotocolalsoprovideddataaboutthecollectionofhouseholdmember  names,theiragesanddatesofbirth,andtheuseofhouseholdorproxyrespondents.Information t aboutthesedataitemswasnotonlyimportanttothemaintenanceofdataquality,butitprovided ` additionalinsightintohoweffectivelyenumeratorsadministeredtheinstrument. L  Studyresultsindicatethatenumeratorsaskedrespondentsforthenamesofallhousehold $ t memberslivingatthefollowupunitinabout94percentoftheobservedinterviews.B   (12,page22, @"  R25) nC    ` Additionally,thedatashowthatenumeratorswereobservedtohaveaskedtheage/dateofbirth  L  questionforeachhouseholdmemberinabout91percentoftheinterviews.B   (12,page22,R26) C    8   (u8p  wxyz! ! 4.80 ' QuestionnaireAssistanceCenters '(#'(#  Forthe1990Census,sourceinformationcomesfromU.S.DepartmentofCommerce(1993)and,   forCensus2000,fromJonesandBarrett(2003).    ! ! $  wxyz#(x8 " 3"  0   3U23  0(#(#  1990Census 3U݌\(#(# Ќ  The1990Censushadtwotypesofquestionnaireassistancetelephoneassistanceandwalkin 4 assistance.Telephoneassistancewasprovidedinalldistrictoffices,excepttype1offices(large,  p centralcityandmetropolitanareas)whichhadwalkinassistancecenters. Telephoneassistance  \ intype1districtofficeswasprovidedbytheservicingprocessingofficebasedonthecallers L originatingareacodeandexchange. 8 QuestionnaireassistancewasavailableinEnglishaswellasCambodian,Chinese,Korean,  Laotian,Spanish,Thai,andVietnamesewhereappropriate.Thewalkincenterswerestaffedby  unaffiliated,bilingual(whenappropriate)volunteerpersonnelwhoansweredrespondents  questionsconcerningthecensusand/orthecompletionoftheirquestionnaires.  Theprogramsufferedstaffingproblemsfromthestartandneverrealizeditsgoalofrendering \  assistanceinalltype1districtoffices,althoughthewalkincentersthatwerestaffedprovided H! valuableinformationtothepublic. 4"   " 3"  0   3!23  0(#(#  Census2000 3!Z݌ $\"(#(# Ќ  Morethan14,000questionnaireassistancecenterswerestaffedduringCensus2000toprovide %4!$ generalhelptorespondentswhohadquestionsordifficultycompletingtheircensus & "% questionnaire,languageassistanceguidesforrespondentswhohadlanguagebarriersto ' #& completingtheirquestionnaire,andBeCountedformstorespondentswhobelievedtheydidnot (#' receiveaquestionnaireorwerenotincludedonthequestionnairefortheirhousehold.Foreach )$( respondentcontactataquestionnaireassistancecenter,censusclerksorvolunteers,as *%) appropriate,completedaD399,RecordofContact,todocumentthereason(s)forthevisit. l+&* GOY3 G G  Table13providesthenumberof_QACs_Ԁestablished,thenumberof_QACs_ԀthathadRecordof  Contactquestionnaireskeyed,andthenumberandtypeofcensustractsthatthekeyeddata  represents.  Ѐ! !   wxyz(o"px$  wxyz#Therewereatotalof23,556_QACs_,nationwide.Datawaskeyedfrom14,222 ` (60.4percent)ofthese_QACs_.The14,222_QACs_Ԁwereestablishedin8,952censustracts. L  Flaggedcensustractsaredefinedtobethosetractsknowntobedifficulttoenumerate,thosethat 8  areheavilypopulatedbyracialandethnicgroups,orthosethatarelinguisticallyisolated.About $ t 97.5percentofthecensustractsfromwhichwehave_QAC_Ԁdatawereflagged.Theremaining2.5  ` percentofcensustractsfromwhichwehave_QAC_Ԁdatawerenotflagged.Nonflaggedtractsare  L  definedtobethosedifficulttoenumeratetractsthatdidnotmeettheflaggedcriteria.  8      Table13    *0]1dddd dd Sdd Sdd p]q(#(#,Ddd ,dd ,dd +  '   {'  Numberof2000CensusQuestionnaireAssistanceCentersandTypesofCensusTracts L  withQuestionnaireAssistanceCenters ;].)8  {  ;Y *]w] *@:Number *]w] *@C!Percent 'w] 'NumberofQuestionnaireAssistanceCenters J@G @23556@J@: 23,556 lb:G @23556 @ Y@100.0Y@l@: : D! 100.0 I?:G Y@100.0 Y@ INumberofQuestionnaireAssistanceCenters(fromkeyeddata) J@w @14222@J  @@= 14,222 tjCw  @14222 @ 333333N@60.4333333N@t@: : C! 60.4 H>9w 333333N@60.4 333333N@ HЀNumberofCensusTractswith_QACs_Ԁ(fromkeyeddata) 'K '@9 8,952 * J@K Y@100.0Y@J  @@!!F! 100.0 RHCK  Y@100.0 Y@ R 󀀀NumberofFlaggedCensusTractswith_QACs_ I?  @8725 @I  8,725 siB   @8725  @ `X@97.5`X@s   Ӏ97.5 QGB  `X@97.5 `X@ Q 󀀀NumberofNonFlaggedCensusTractswith_QACs_ H>O  `l@227`l@H@: 󀀀227 h^8O! `l@227 `l@ @2.5@h  @""J" 󀀀2.5 PFAO"  @2.5 @ PTotalnumberofCensusTractsin2000 J@# @@61258@@J@: 61,258 I?:$ @@61258 @@ I  @@!!F!1'%%    1XX* D399keyeddataisavailablefrom_QACs_Ԁinthesetracts.Theactualnumberoftractswith_QACs_Ԁisunknown#XX#. %  XX Source:(JonesandBarrett2003)#XX# &  4.8.10  QuestionnaireAssistanceCenterStudyMethodology '"w)(#(# Toassessthescopeofthequestionnaireassistanceoperationandtodeterminethetypeof #O+ assistancerequested,theCensusBureaureliedexclusivelyonthedatacontainedontheD399, $; , RecordofContact.  %'!- ?,X'hX,X' X?4.8.20  QuestionnaireAssistanceCenterStudyLimitations'"/(#(#  SincemostD399s,RecordofContact,werefilledoutbyvolunteersratherthanpaidCensus )$1 Bureauclerks,theremaybeapotentialforreduceddataquality.Also,errorsinkeyingdatafrom s*%2 theD399saffecttheaccuracyoftheresults. _+&3 Ї 4.8.30  QuestionnaireAssistanceCenterStudyResults (#(# Atotalof559,027respondentsvisitedquestionnaireassistancecentersforsometypeofhelp ` completingtheirCensus2000questionnaire.B   (13,page5,R1) C  ԀAsexpected,themajorityofrespondentsrequested L  assistancewithcompletingtheshortformEnglishlanguagequestionnaire.B   (13,page6,R2) C   8  Ofthe94,639respondentswhoaskedforalanguageassistanceguide,53percent(50,158)  ` requestedaSpanishlanguageguide.B   (13,page9,R3) } C  ԀLanguageassistanceguidesinRussian(5.2percent)and  L  Chinese(5.1)werethenexttwomostrequestedguidesafterSpanish.B   (13,page9,  R4)C  ^!B  C    8  Almost40percentofrespondentsvisitingquestionnaireassistancecentersweregivenaBe   Countedformbecausetheydidnotreceiveaquestionnaireorthoughttheyweremissedinthe   census.B   (13,page10,R5) "C  ԀBeCountedformswereavailableinsixlanguages(English,Spanish,Chinese,Korean,   Vietnamese,andTagalog).Ofthe220,489peoplewhorequestedBeCountedformsatthe   QuestionnaireAssistanceCenters,mostrequestedtheminEnglish(69.8percent)orSpanish p (24.4percent). \  4.8.40  QuestionnaireAssistanceCenterRecommendationsforthe2010Census 4(#(# Twoimportantrecommendationsforfuturequestionnaireassistancecenteroperationswere:  \ Yc  0 ' Yc%"0'(#'(#  AssessthenumberoflanguagesinwhichweprinttheBeCountedformforthe2010 4 CensusinlightoftheCensus2000evaluationresultsandthepotentialcostofproviding   additionallanguages.TheauthorsoftheQuestionnaireAssistanceCentersevaluation   (JonesandBarrett2003)recommendedthatweincreasethenumberoflanguagesin  whichweprovidetheBeCountedformforthe2010Census.Theybasedthis  recommendationondatathatrespondentsrequestedmorethat1,000LanguageAssistance  GuidesineachofsixlanguagesforwhichtheBeCountedformwasnotavailable. l However,accordingtotheevaluationoftheBeCountCampaign(Carter2002a),overall X  only4.9percentoftheBeCountedformsthatwereprintedwerereturnedtotheCensus D! Bureau.Yc%%݌0" (#(# Ќ  Yc  0 ' Yc)"0'(#'(#  Continuetoestablishquestionnaireassistancecentersincensustractswhichare $X" documentedtohaveresidentswithlanguagebarrierstocompletingthecensus $D # questionnaireorwhichareotherwiseknowntobedifficulttoenumerate.Yc)*݌%0!$(#(# Ќ   h+&*  dO5      4.90 ' CensusDay(April1,2000)astheReferenceDate '(#'(# EvaluationsourceinformationcomesfromCarter(2002b).  AkeyconceptofcensustakingisthecollectionofpersonandHUinformationasofafixeddate. ` Fordecennialcensuses,thisfixedorreferencedatefordatacollectionhastraditionallybeen L  April1.ForCensus2000,theCensusBureauconductedanevaluationtodeterminehowwell 8  respondentsadheredtotheApril1referencedatewhenrespondingtothecensus. $ t  4.9.10  DateofReferenceforAge/DateofBirth  L (#(# TheCensusBureausinvestigationintorespondentadherencetoApril1,2000asthereference $  datefocusedonhowrespondentsansweredtheage/dateofbirthquestionsontheCensus2000   questionnaire.Thewayrespondentsanswerthesequestionscanbeinfluencedbywhetherornot   theyareusingCensusDayastheirdateofreference.ByincludingareferencetoApril1onthe   Census2000agequestion,theCensusBureauhopedtoreducethediscrepancybetween   respondentsreportedagesandactualages.Additionally,theCensus2000age/dateofbirth p questionaskedrespondentstoreportafulldateofbirthforallhouseholdmembersratherthan \ justthepersonsbirthyear. H  4.9.20  DateofReferenceStudyMethodology  p(#(# ThestudymethodologyconsistedofusingtheHundredPercentCensusUneditedFile(HCUF)r #  39      ׀ H soanalysiscouldbedonesolelyondataprovidedbyrespondentspriortotheeditingand 4 imputationprocess.TheCensusBureaualsocalculatedeachpersonsage,asofApril1,2000,   usingthedateofbirthprovidedbytherespondent.Apersonsagewasconsideredtobe   misreportediftheagereportedforthatpersondifferedfromtheagecalculatedfromthedateof  birth.Apersonsageaddedtohisorheryearofbirthshowswhetherornotthatpersonsagehad  incremented(implieshavinghadabirthday)forthatyear.Thesumof2000indicatestheage  havingbeenincrementedfortheyearof2000,whilethesumof1999showsthattheagehasnot l yetbeenincrementedfortheyear.TheCensusBureaucalculatedthesumforeverypersoninthe X  analysis. D! Ifeverypersonsagewascorrectlyreported,theproportionofsumsthatequaled2000wouldbe #l! equaltotheproportionofpersonswhohaveabirthdaybetweenJanuary1andApril1.Ifthe $X" proportionisdifferent,itindicatesthatsomedateotherthanApril1,2000wasusedasa $D # referencedate.Iftheproportionismatchedtoadistributionofdatesofbirththroughouttheyear, %0!$ thedaycorrespondingtothepercentagewouldindicatetheaveragedateofreference(Carter &"% 2002b). '#& ЇTheCensusBureaualsoexaminedfinalmailreturnrates.Themailreturnrateisameasureof  respondentcooperationinmailbackareas.N #  40      ׀Themailreturnraterepresentsthenumberof  occupiedHUswithcorrespondingnonblankquestionnairesP #  41      ׀checkedinthroughtheendofthe  year,December31,2000,dividedbythetotalnumberofoccupiedHUsinthemailback t universe.R, #  42       `  4.9.30  DateofReferenceStudyLimitations 8 (#(# Obtainingcompleteandaccuratedatafromrespondents,whileakeygoalofalldatacollection  ` efforts,isparticularlydifficulttomeasure.Forpurposesoftheevaluationofrespondents  L  answerstotheage/dateofbirthquestions,theCensusBureauassumedthatrespondentscorrectly  8  reporteddatesofbirthsforallhouseholdmembers.Thus,allreporteddiscrepanciesare $  attributedtorespondentsfailingtocorrectlyreporttheagesofhouseholdmembers.    4.9.40  CensusMovementorAverageDateofReference (#(#  Calculatingthesumofallpersonagesanddatesofbirth(either2000or1999)S@  #  43      ׀revealedthat p 29.9percentofpersonshadanobservedsumof2000.Thesearepersonswhoseagehad \ incrementedfortheyear,meaningthattheiragereflectedhavinghadabirthdaysometime H betweenJanuary1andApril1,2000.B   (14,page5,R1) AC  ԀTheremaining70.1percentofpersonshadanobserved 4 sumof1999,meaningthattheiragereflectedthattheirbirthdaywasafterCensusDay.B   (14,page5,R2) AC    p TodeterminetheCensusmovementoraveragedateofreference,theCensusBureaucompared H the29.9percentagainstadistributionofdatesofbirthfortheentireyear.W  #  44      ׀Theresultsofthis 4 analysisrevealedthatApril20wastheaveragedateofreferenceforCensus2000. B  ԍ(14,page5, < R3)C C  ԀThiswasa   notableimprovementcomparedtotheMay5averagedateofreferenceforthe1990Census.   ThemovementoftheaveragereferencedatetoApril20maybeattributedtoincludingaspecific  referencetoApril1,2000ontheagequestion,deliveringCensus2000questionnairesearlier  )dO7 ) )  thaninthe1990CensusandcompletingtheCensus2000NRFUoperationearlierthanin1990.  Additionally,therewasaconsiderabledifferenceintheaveragedateofreferencebetween  householdswhoselfenumeratedandthosewhowereenumeratedbyacensusenumerator.The  averagedateofreferenceforselfenumerationquestionnaireswasApril12comparedtoMay18 t forenumeratorcompletedreturns(Carter2002b).B   (14,page5,R4) "HC   ` Evaluationresultsshowthatastatesmailreturnrateseemstobecorrelatedwiththedateof 8  referenceforthestate.Asastatesmailreturnrateincreases,thedateofreferenceforthestate $ t getsclosertoApril1,2000.B   (14,page6,R5) IC  ԀThisisattributedtothefactthatahighermailreturnratemeans  ` thatmorerespondentsarecompletingtheirquestionnairesandreturningtheformsinthemail.It  L  isalsolikelythattheserespondentswillnotbepartofNRFUastheyareenumeratedcloserto  8  April1.Thus,theserespondentsarelesslikelytomisreporttheirages. $   4.9.50  DateofReferenceRecommendationsforthe2010Census  (#(# Yc  0 ' YcK"0'(#'(#  IncludeareferencetoCensusDay,April1,2010whenaskingrespondentstoprovidethe p agesofhouseholdmembers.YcK L݌\(#(# Ќ  Yc  0 ' Yc M"0'(#'(#  Consideracompressedenumerationtimeframewhichmayaidrespondentstocorrectly 4 reportage.Yc MGM݌ p(#(# Ќ  Yc  0 ' Yc4N"0'(#'(#  StresstheimportanceforenumeratorstostatetheApril1referencedatewhenaskingthe H agequestionduringNRFU. Yc4N[N݌4(#(# Ќ  4.100  CoverageImprovementFollowup  (#(# Forthe1990Census,sourceinformationCoverageImprovementFollowup(CIFU)comesfrom  U.S.DepartmentofCommerce(1993)and,forCensus2000,fromClarkandMoul(2003).   $  wxyz#(xp  wxyz" 3"  0 '  3Q23  0'(#'(#  1990Census  3QAQ݌X (#(# Ќ  TheobjectivesoftheFieldFollowupoperationweretoimprovedataqualityandcensuscoverage 4"  byfollowinguponquestionnaireswithinconsistentormissingdata.Thiswasaccomplishedby  #p! enumeratorswhoverifiedthestatusofunitsreportedduringNRFUasvacantordelete,followed  $\" uponquestionnairesthatwerecheckedin,butwerenotdatacaptured(missingormisplaced), $H # checkedaddressesontheACFforwhichnoquestionnaireswerecheckedin,andrevisitedunits %4!$ withcoverage/contenteditfailures. & "%  '  '  l+&* Ї" 3"  0 '  3T23  0'(#'(#  Census2000  3TT݌(#(# Ќ  TheprogramdesignedtoimprovecoverageofHUsinmailbackareasfollowingthecompletion  ofNRFUwaschangedfromFieldFollowup(usedduringthe1990Census)toCIFU.Whilethe x majorityoftheCIFUworkloadconsistedofunitsclassifiedasvacantornonexistent(delete) #  45       d duringNRFU,someadditionalcomponentsofCIFUincludednewconstructionaddsfromlocal P  officials,blankmailreturnforms,andHUaddsfromvarioussourcesthatcouldnotbeincluded <  inthemaildeliveryorinNRFU. ( x WhiletheprimaryfocusofCIFUwascoverageimprovement,thenatureoftheCIFUfieldwork  P  wassimilartootherdatacollectionoperations.TheeffectivenessofCIFUanditsvaluetothe  <  overallcensustakingprocessisnotedinseveraloperationalresults.Mostnotably,morethan (  ! !   wxyz(o"px$  wxyz#5millionpeoplewereenumerated.B   (15,page18,R1) MZC  ԀSimilartoNRFU,CIFUenumeratedahigherpercentageof   thegroupsthataretypicallyundercounted,suchasmales,youngpeople(34yearsoldand   younger),Hispanics,Blacks,andSomeOtherRace.B  C   B  ԍ(15,page19,R2)C  [ԀImportantly,morethan1.5million   vacant/deleteunitswereconvertedtooccupiedunits.Theseconvertedunitsresultedinagainof   3.1millionpeople.B   (15,page18,R3) \C   t  5.0 ' SynthesisofFindingsandRecommendationsforFutureStudy L'(#'(# ThisreporthighlightedtheresultsofCensus2000evaluations,assessments,andauxiliaryreports $t pertainingtofielddatacollectionactivities.Itsexaminationofthemajorchallengesand ` successesofseveraldatacollectionoperations,coupledwiththeanalysisofstudydataand/or L findingsfromfieldobservations,revealsthattheoveralldatacollectionprogramwas 8 operationallysuccessful. $ TwocomponentsoftheCensus2000datacollectioneffortthatcontributedtoitssuccessfuland  timelycompletionweretheCensusBureausrecruitingcampaignandpayrateprogram.The  Westatstudyfoundahigherthanexpectedcorrelationbetweenhighcensuspay(relativeto  prevailingpayrates)andaboveaveragerecruitingperformance.Arobustnationalrecruiting p program,carefullymonitoredandnurturedbyCensusBureauheadquartersandtheRegional \  CensusCenters,yieldedmorethanenoughapplicantstoefficientlyconductallfielddata H! collectionactivities. 4"   Recruiting 󀄀Althoughtherewereconsiderabledifferencesinrecruitingperformanceacrossall  $\" 520localcensusoffices,mostlocalcensusofficessignificantlyexceededtheirrecruitinggoals. $L # Westat(Jacobson,Petta,andYudd2002),whoexaminedthefactorsaffectingCensus2000 %8!$ recruitingperformance,opinedthatthelocalcensusofficesregardedrecruitinggoalsas &$"% minimums.Notably,byApril2000,82percentofthelocalcensusofficesexceededrecruiting '#& goals,usuallybyconsiderableamounts.B   (1,pageiii,R1) dC   (#' Ї PayRates 󀄀Census2000recruitingeffortsweregreatlyfacilitatedbyincreasesinenumerator  paytomorethan75percentoftheBureauofLaborStatisticsprevailingwagerate.B  d (2,pagei, X R9)  fC  ԀSpecifically,  hourlypaywasincreasedbyalmost38percentonaveragerelativetothe1990Censuspayrate  (adjustedforinflation).B  Zf (2,pagei,R2) @gC  ԀWebelievethisincreaseinpayalsohadacorrespondingeffecton x enumeratorretentionwhichwasimprovednearly23percentfrom1990.B  {g (2,pagei,R3) PhC   d  Frontloading wasaninnovativestrategyinwhichslightlymorethantwicethenumberof <  enumeratorsactuallyneededforfieldproductionworkwereinvitedtotrainingwiththe , | expectationthatmosttraineescouldbegivenaworkassignmentimmediatelyfollowingtraining.  h FrontloadingwasfacilitatedbytheCensusBureaushighlysuccessfulrecruitingprogramwhich,  T  inmostcases,providedsufficientnumbersofqualifiedapplicants.Theincreaseinenumerator  @  retention,coupledwiththefrontloadingofenumeratortrainingsessionsandworkassignments, ,  wereinstrumentalinkeepingmajoroperationsonscheduleandformaintainingtheefficiency   withwhichfieldoperationswereconducted.Theseresultswereevidencedinalloperationsthat   werefrontloaded,butnonemoredramaticallythanNonresponseFollowup,whichwascompleted   intheaverageLCOinaboutsevenweeksduringCensus2000ascomparedtonearlytenweeks   inthe1990Census.B  h (2,pagei,R4) cmC  ԀItappearsthatthedegreetowhichlocalcensusofficesexceededoperational x scheduleswasafunctionoftheamountoffrontloadingthattheywereabletoachieve. d Importantly,about80percentofthelocalcensusofficesmetorexceededtheirfrontloading P goals.InCensus2000,theslowestperforminglocalcensusofficescompletedtheirworkabout < 1.5weeksfasterthanthefastestperforminglocalcensusofficein1990.B  m (2,pagei,R5) oC   (x  NRFUEnumeratorTraining 󀄀TheCensus2000EvaluationH.7,StudyofNonresponse P Followup(NRFU)EnumeratorTraining(BurtandMangaroo2003),indicatesthattheCensus @ 2000NRFUenumeratortrainingprogramadequatelypreparedtraineestoeffectivelyperformthe , tasksoftheNRFUenumeratorposition.B  p (12,pageiv,R1) qC  ԀAboutthreefourthsoftheNRFUenumeratorswho  participatedinasurveyoftrainingsatisfactionreportedthattheyweresatisfiedwiththetraining  theyreceived.Thisevaluationalsorevealsthatalmostalloftheenumeratorsproperlyidentified  themselvesatthefollowupaddress,showedtheirIDcard,statedthepurposeoftheirvisit,and  determinedthe_HU_sCensusDaystatus.B   r (12,pageiv,R3) ;tC  ԀAdditionally,mostenumeratorsverifiedthattheywere x atthecorrectaddressandprovidedrespondentswithaPrivacyActNotice.B  xt (12,pageiv,R4) GuC  ԀWhilethemajorityof d  enumeratorsrecordedresponsesaccuratelyandlegibly,asignificantnumberofenumeratorsdid P! notalwaysreadquestionnaireitemsaswrittenandoftendidnotusetheflashcardsprovided.B  u (12,pagev,R5) vC  Ԁ <"   ToolKit 󀄀Theuseofspecialtoolkitenumerationtechniques(blitzenumeration,paired $d" enumeration,andlocalfacilitators)duringNonresponseFollowupalsocontributedtothe %T # efficiencyoffielddatacollectionoperations.TheAssessmentofNonTEAToolKitMethods %@!$ (Tenebaum2001b),reportedthatthefieldstaffthoughtthetoolkitenumerationtechniques &,"% simplifiedtheirjobs,madethemfeelsafer,improvedsupervision,reducedrespondentreluctance '#& tocooperate,andincreasedproductivity. ($' Betterthanexpectedlocalcensusofficerecruitingperformance,increasedenumeratorpayand *%) retention,frontloading,toolkitstrategies,andeffectiveregionalcensuscentermanagementall x+&* workedtogethertoprovidesynergythatresultedinanoperationallysuccessfuldatacollection  effort.   Recommendationsforfuturestudyand/orimplementation:  t ?,X'A X,X'hX?0 ' Yc  Yc{"0'(#'(#  Continuethepracticeofofferinglocallycompetitivepayratestoallowregionstoattract, L  recruit,andretainstaffintheirlocalcensusoffices.Yc{{݌8 (#(# Ќ  Yc  0 ' Yc|"0'(#'(#  AssesstheoptimalNRFUscheduleanddegreeoffrontloadingfieldstaff(combinedwith  ` replacementtraining)thatwouldsubstantiallyreducecostwithoutreducingthelikelihood  L  ofmeetingtheoperationsschedule.Yc| }݌ 8 (#(# Ќ  Yc  0 ' Yc~"0'(#'(#  PeriodicallyidentifyandremovelatemailreturnsfromtheNonresponseFollowup   workloadtoreducetheworkloadandthenumberofhousingunitswithmultipledata   captures.Theplanneduseofmobilecomputingdevicesinthe2010CensuspotentiallyYc~~݌ (#(# Ќ   ' 0  willimprovethecontrolandtrackingoftheNRFUuniversebyaccountingforLateMail   Returnsand,therefore,reducemultipleenumerations.p(#(# Yc  0 ' Yc"0'(#'(#  Considerreassessinghowtestscoresandtheavailabilitytoworkmanyhoursareusedas H hiringscreens.DataanalysissuggeststhatthecapacitytocompleteNonresponse 4 Followupwouldhavebeenenhancedhadtestscoresofabout82percentbeenusedasthe  p firstselectingcriteria(unlessapplicantshadaspeciallanguageskill)andtheorderof  \ contactingapplicantshadbeenbasedonthehoursofavailability(atleast20hoursper H week)asreportedontheirjobapplications.YcD݌4(#(# Ќ  xXX   +&( t?; 88   Acknowledgments#XXx #  8 (Theauthorsrecognizeandappreciatetheeffortsofthosewhohelpedpreparethisreport.This 8 includesFlorenceAbramsonandRandall_Neugebauer_Ԁwhoprovidedhelpfulcontributionsand $ everyonewhoreviewedthereportandprovidedcomments,includingDeborahBolton,Florence  Abramson,Randall_Neugebauer_,DarleneMonaco,andseveralpeopleintheFieldDivision  (notablyMichael_Weiler_ԀandRichard_Blass_ԀofHeadquartersandFernandoArmstrong,the   PhiladelphiaRegionalDirector).AdditionalthanksgotoTammieShanksforherword   processingsupport.Finally,weacknowledgetheauthorsoftheCensus2000evaluationsand   assessmentsfortheirpertinentandinsightfulanalyses.TheseauthorsincludeGeraldineBurt,  t  RuthMangaroo,NathanCarter,JonClark,DarleneMoul,LouJacobson,IanPetta,ReginaYudd,  `  JohnA.Jones,DianeBarrett,TraceyMcNally,DarleneMonaco,RobinPennington,Miriam L  Rosenthal,MichaelTenebaum,andKevinZajac. p8    \$   (ե8p  wxyz! !xXX   References#XXxˊ#  8     N( 4 <DL,X'A XN  >&W%XX&W%%&W 8 Broadnax,AngelN.,et.al.(1999),EvaluationStudyofNonresponseFollowupandQualityCheck  PersonalInterviewEnumeratorTrainingPrograms,#XX%&W#&W%XX#&W%%&W#&W%%&WCensus2000DressRehearsalEvaluation  Memorandum(G.10),USDepartmentofCommerce,U.S.CensusBureau,Washington,DC,July  1999.  `  p 8 #XX%&W#&W%XX#&W%%&W##&W%%&WBurt,GeraldineandRuthMangaroo(2003),StudyofNonresponseFollowup(NRFU)Enumerator H  Training,Census2000Evaluation(H.7),U.S.DepartmentofCommerce,U.S.CensusBureau#XX%&W:#&W%XX#&W%%&W|#&W%%&W,    Washington,DC,March25,2003.       Carter,Nathan(2002a),BeCountedCampaignforCensus2000,Census2000Evaluation(A.3),U.S. p  DepartmentofCommerce,U.S.CensusBureau#XX%&W#&W%XX#&W%%&Wˏ#&W%%&W,Washington,DC,September25,2002. H  #XX%&W#&W%XX#&W%%&WY#&W%%&W   X    Carter,Nathan(2002b),DateofReferenceforAgeandBirthDateusedbyRespondentsofCensus2000, 0  Census2000Evaluation(H.10),U.S.DepartmentofCommerce,U.S.CensusBureau#XX%&WՑ#&W%XX#&W%%&W#&W%%&W,Washington,   DC,November14,2002.        Clark,JonR.andDarleneMoul(2003),CoverageImprovementinCensus2000Enumeration,Census X 2000TopicReport,U.S.DepartmentofCommerce,U.S.CensusBureau#XX%&WS#&W%XX#&W%%&W#&W%%&W,Washington,DC, h0 September,2003. @ #XX%&W #&W%XX#&W%%&WN#&W%%&W  DecennialManagementDivision(2003),ReengineeringtheDecennialCensus,TheBaselineDesignfor  2010,Census2000TopicReport,U.S.DepartmentofCommerce,U.S.CensusBureau#XX%&Wە#&W%XX#&W%%&W#&W%%&W,Version  1.5,May,2003. h #XX%&W?#&W%XX x@ #&W%%&W#Gore,Edison(2002),DecennialManagementDivisionGlossaryandAbbreviation/AcronymList, P DecennialDirectorate2010CensusPlanningMemorandumNo.12,August12,2002.#XX%&W#&W%XX&W%%&W (       Jacobson,LouandIanPetta(2002),Census2000StaffingPrograms,PayComponent,Census2000  Evaluation(G.1part),U.S.DepartmentofCommerce,U.S.CensusBureau#XX%&WB#&W%XX#&W%%&Wa#&W%%&W,Washington,DC,June x 7,2002. P     ` (!   Jacobson,Lou,IanPetta,andReginaYudd(2002),Census2000StaffingPrograms,Recruiting 8!" Component,Census2000Evaluation(G.1part),U.S.DepartmentofCommerce,U.S.Census "# Bureau#&W%%&W#&W%%&W#XX%&W#&W%XX,Washington,DC,June7,2002. "$    #%   Jenkins,RobertM.(1985),ProceduralHistoryofthe1940CensusofPopulationandHousing,The $` & UniversityofWisconsinPress,Madison,WI,1985. p%8!'    H&"(   Jones,JohnandDianeBarrett(2003),QuestionnaireAssistanceCentersinthe2000DecennialCensus,  '") Census2000Evaluation(H.4),U.S.DepartmentofCommerce,U.S.CensusBureau#&W%%&W#&W%%&W#XX%&WŜ#&W%XX,Washington, '#* DC,June25,2003. ($+    )p%,   McNally,Tracey(2003),EnumerationinPuertoRico,Census2000Evaluation(H.8),U.S.Department *H&-  ofCommerce,U.S.CensusBureau#&W%%&W!#&W%%&W#XX%&Wc#&W%XX,Washington,DC,May19,2003. X+ '. t?= 8888   Monaco,DarleneL.(2002),AssessmentReportForNonresponseFollowup,DecennialManagement 8  Division,U.S.DepartmentofCommerce,U.S.CensusBureau#&W%%&W#&W%%&W#XX%&W#&W%XX,Washington,DC,August5,2002.        Moul,DarleneA.(2002),NonresponseFollowupforCensus2000,Census2000Evaluation(H.5),U.S.  DepartmentofCommerce,U.S.CensusBureau#&W%%&W#&W%%&W#XX%&WƢ#&W%XX,Washington,DC,July25,2002. `    p8   Pennington,RobinA.(2003),Update/Leave,Census2000Evaluation(F.10),U.S.Departmentof H  Commerce,U.S.CensusBureau#&W%%&W#&W%%&W#XX%&WT#&W%XX,Washington,DC,June6,2003.      Robey,Bryant(1989),TwoHundredYearsandCounting:The1990Census.PopulationReference    Bureau,Inc.,Vol.44,No.1,April,1989.  p    H  Rosenthal,Miriam(2002a),Update/Enumerate,Census2000Evaluation(F.12),U.S.Departmentof X  Commerce,U.S.CensusBureau#&W%%&W#&W%%&W#XX%&Wͥ#&W%XX,Washington,DC,December10,2002. 0         $rr" XX$#&W%%&W##XX%&W#&W%XX&W%%&W________(2002b),UrbanUpdate/Leave,Census2000Evaluation(F.11),U.S.DepartmentofCommerce,   U.S.CensusBureau#XX%&W#&W%XX#&W%%&W#&W%%&W,Washington,DC,October3,2002.      X   Tenebaum,Michael(2001a),AssessmentofFieldVerification,Census2000Evaluation(H.2),U.S. h0 DepartmentofCommerce,U.S.CensusBureau#&W%%&W#&W%%&W#XX%&W֩#&W%XX,Washington,DC,August9,2001. @       #&W%%&Wb##XX%&W#XXXX&W%XX________#&W%%&Wl#&W%%&W(2001b),AssessmentofNonTEAToolKitMethods,U.S.DepartmentofCommerce,U.S.  CensusBureau#&W%%&Wլ#&W%%&W#XX%&W#&W%XX,Washington,DC,October1,2001.     h   U.S.DepartmentofCommerce(2000),U.S.CensusBureau,Census2000OperationalPlan, x@ Washington,DC,December2000.#&W%%&W#&W%%&W#XX%&Wӭ#&W%XX P  ( #XX%&WI##XXXX#XXXX&W%XX________(2002),MeasuringAmerica:TheDecennialCensusesFrom1790!2000,Washington,DC,  2002.   x #&W%%&Wد##XX%&W#&W%XX&W%%&W________(1986),1980CensusofPopulationandHousing!History:PartB,Chapter5,Field P Enumeration,Washington,DC,1986. `(    8    #&W%%&W##&W%%&W#XX%&W#&W%XX________(1955),The1950Censuses!HowTheyWereTaken,ProceduralStudiesofthe1950Censuses,  ! No.2,Washington,DC,1955.  "    !#   #&W%%&WF##XX%&W#&W%XX&W%%&W________(1993),1990CensusofPopulationandHousingHistory,PartA,C.H.R2A,Washington,DC, "`$ October,1993. p#8%    H$ &   #&W%%&W##XX%&Wг#&W%XX&W%%&W________(1996),1990CensusofPopulationandHousingHistory,PartD,C.H.R2D,Washington,DC,  % ' March,1996. %!(    &")   #&W%%&WG##XX%&W(#&W%XX&W%%&W_________(1976),1970CensusofPopulationandHousing!ProceduralHistory,Washington,DC, 'p#* 1976. (H$+    X) %,   #&W%%&W##XX%&Wv#&W%XX&W%%&W________(1963),ProceduralReportofthe1960CensusesofPopulationandHousing,WorkingPaper 0*%- No.16,Washington,DC,1963. +&.   +'/ dO> 88   _#&W%%&Wڷ#&W%%&W#XX%&W#&W%XX________(1979),TwentyCensuses!PopulationandHousingQuestions!17901980,Washington,DC,   1979.   ` #&W%%&WJ##XX%&W#&W%XX&W%%&W________(1989),200YearsofCensusTaking:PopulationandHousingQuestions,1790!1990, 8 Washington,DC,November,1989. `    8   Zajac,KevinJ.(2002),List/Enumerate,Census2000Evaluation(F.13),U.S.DepartmentofCommerce,   U.S.CensusBureau,Washington,DC,May23,2002.#XX%&W#    p    #XXXXɺ#