WPC9T `Kb4jV3EYgͣ?;FH{3+.EõQXq1xaѾ "EF{;F={v 5ӕwVf,nWnC]WiVfrdyڇ-U}#^]I+(c{-0 ~W*wMb4J{7$4t[m/kѸ,/9n;Bsjx`tY ̕$fuΊ[2;AU͠ _C9%2U#jЕ#)D_ƭqWPKV}) Y쫂x_+b9ib<+W_{}ˡ1w( 8t#>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~a}sϏO/?oL߯O? ?O??O??̅{3OD_/_3߬.7_/o.ߓ3o/_2;)ߜ?A?>2_?_O/+.? ?5_/o+_?1oo//_7) O:+?AO=?0/=?$o-+?._ O??4+0?/"4?)$_8+o@o=??O/;?'?.+?. ?3_,/?/$3?O*&_6+@=?O~pP00.`/? 0:p? O_/>?Z +@2__o/: . Oo? P/0$2pP00*/%_050m``<pP 0- O_?8_  _ .O*?.o1_? ,??- O 0&_1*O'5*? ?<￟? ߿_. ?7/ ??0Ͽ? ߂0o __2/ _-߿/ ?Ͽ. 2 O 1￟? ߿_.Ͽ? OO 6 ς?_ <￟? ߿_ ??0??6/ ?2 o3 /3/O0 0o4? _ 3 ??2  7? ?> o? ??~)p8P?0P`5/ /P@[E/0< b/8/Q0? 3)pT/ ` `j` ~`0@/O`  5/ _@?2 F0$`2@?a/ op04@ _ ?@=`0PM / _@6@ @D `Ip P~ W`:O _"020 3 $ 2/P p0 & /PU? = '2 @ >p 0'~@b/  90 ?@ZPO?P3  ?p9 ?`00 bP`V _1@ _W?P= O =07~.. ?`?8 z@p0B  9Pp`@6P/9 _ @\Q@? p5 @<_h ~ 0.@0 2p/ ?/6`j!?2`߿<p&P.@@￯`40 < 03p 50dp`H?~VP@ 1 o@0P2 [P?PT?  @`1P 0&.P@P QP 02[0P p?P= ,~0`PM$@RWa? o/p20?/0/ = 6~pMp pRP oppO t~pPL`/O@[40 @PPP t~p0L ` Z/0xp^p `t~pK / `?[px0`/00/Ps~fp/@JP O o@O@ `m0  ? s~f0 J   Pp0l@P`pOr~f ?H/ pp/O@ 0 o@k@O?`_P `r~f@ `Gp ? 0N P 0j/P` r~gp `F @0 NP 0 ? @h_/PP @@@q~g D@ /pN P pgP ? q~gp _@C/ @  M`/ @O  d0oo@PPP` _p~h/ @0 ?@oN O` ?Ѐb/`O _ `p~i op?p `?`M0 @  @_/p_ P  p~i  @=  Mp_ ? P  \@//P @@o~j0  FPON__Ѐ`?ߐX _O Op ` o~k0?߀90u`HOPNoP`opS @___`C@:P  _n~l0/`8p @jH N `@J߿/_p@_?D :?   O pn~m _0`?O`/?߀@?/Y_ߠ `/O] 9@  n~n?πJo@O0o@ _`V? @`? o]p9` P/0m~pP_0J  P/? T?0? _08_`` m~q/π`Kp/Q@O@ ?PUo`oP` Pl~s@П߃ L 0R_`BO/ PoߐIσ9/0 Opl~u`?0 @`M0 S?O_Ao А [0@p`80 l~vO0 /pT0_ ?/H@_ O0p`/0k~x /  -@  UP /@ /J@? 0 ?pPP` k~z@П 7@@oW_ _` /L 0@Po  p Pj~|`o /,?`W/ 0? _PMP/@ ?pj~} o +   X@   N0/ ?p0/ j~@/ +P 0POZ ?@p `NO@`?  ``? i~_ _ *POPZP 0/ O  ` i~/ P+P  Z0 O 0O@O@0o ?P`(`i~ + @p?[0 p8r  P  )`h~0s @+@ o@[p? 8Ps@_ @P0/P:0q  ?*:,~t` *0O p [ P 0QP09r`? OP+? g~p0@M` `+@ p/[@ ./0L OQ `/p0@K `?? /`0P~06  0[p. &M[ /0}0_ P `/ &~@M06@/@0 [8p0U0@L OPP ?`8P0~00N6 /Z 80p@M@00L  Op .0~`?0PN 6`?@ p c.P0`?0`Mp/ `? -`/0`~  PX`,p @oc .P0PXQ / 0P N OP`/ ` - 0` ~@@@O0 -?b`.0 @N 0QP 00@P@O@_ ` `.@P/@~p.``@ ?. @d0PC@0/@P@.P@`PP / P0pP p ?P-pO.0/ X 1?O?1?O///??o1  /1O4  5 )_! ?- O~ / OO4@0Wp" PS`@/ /p/@`4?pP1 p 1 / OOQp/  4"00(!P?@, / OO ~p/  _? 00 /# U`_?0SF?0P`N@p=@ P2pS ?0O?p'@?P"` -p~`@_?@/`02p_ /  < 1  p?^p`1?po/?@OO _ 2`@_?@5@_ />pFp# ?@,`@_?@~O`06`_?@3/ /@?2"7`F02 _0`6 2p 4Op06 @2"@,@?# O -Op0~`?`0o@6o04/ `W[ >@`O?`3@`6`o3P 0    4`?`0o@U 1PP/ $ O ,`?`0O@~p8_p` 5/ o` V@\/D@_4pOp8P> 0O ?6pWp/ <@00%@?%P -p  ?2 O _9/ ߏ/-Ͽo ? O-_? ?0 ? 7 ?/2 ? ? 1߿ ρ_ /8 ?4￟/ o ?(ϯ_ ?/ "/_߿/ o+ ?  ? 3 o_ _;_/oￏ_ -?,?,o ?0 /? 9_ ?ߏ2 O 2(/: ? 5?o_(-"O o+ ?  OO/ 4?? >?/-/,?,_ ?0/_o? ; /_O 3Oo? 3'o= OO/ 6?O(-"? ?, O_/  /5!@O$/-?,? ?0!O=?4!/3%?/7/?'-" /-/ o6oC? 0-?,__?0@o65#?Co7 '-O"/o _9ϏO_G__2-,??1o?C_o9?6/_F_9'-?!o0__/?ϟo?/Lo/?5﮿,ϐ?6O/_HOO?_/O9ߝN_/;'߭!ߒ3_/ϟO?/?_G߿?/?ORo??_Ƈ;o??_OϏ??oHϯo??OϟO?/?_lϟO?/?_AJPO?[?_o/O߁o?P/[_O ~P@cPO?/0   $.O]  TO)F 0ooo/?_No%?c o  O&/-] _ TO+G O/?/L??$c~  &//-Ph `O]*@R.?pPp@3/0J?P$Pc /'o._oWO,I0Ooϯ/H$c O(.O/`/_YO-I?0/ _G$Od ?(.a_o o?Z?-J0??O F%d ?(o /Z-??JO0o/ /)??O [oo.oJ/0O_?)? /\?O/o??-J/0_O?o(O] /o-I_0o__O ?/o _?߃?/o//__?/o? ߏ?/ _?o?? /o/?oO?? ߁?ߏ?O?O o_ o?? ߂o?__O?_ _o//?/O//o?ߏ?__/Oo? O?o _?_/O _?o___/O/_o o /??_ ?  ?_/  ?? ??__    OO_O__?/ _ O  o? ? ?_?/ ? ??? ??? _?O_ O /_o_? O? _ o _ // o  /  O?_/ oO   ?/ ??/  / ? ??? oo/ oo/ o_? __/?/ _ߟ/_? ?_?oO   O_/ o/ o o/o/  o _ OOo?? //_ _?߯_/o _/o __? _ ? _o /  ?oO  o / o_ ?/? ? /o ? ? ?o_ //? __ _//? _oO /o_? /? /oo/??  ? ?O/ _ /  oO ? O/  O o/ _  _/ o  _/? o//_? _ o??oo_? _ / Oo/_? /?O? ? /_O //? ?/ O o /?     _ ? _ ?OO_o   ?// ?_o_ /o_   ?/߿/?/_  / O??/? O  / /o _ o_O/ O//  ?? O_   !_/ / _ Oo/o   _O ?/ ? _O _ o/ ??// O _/ O?/_   o    /_?? O߿? /_ _ o/ ?_? O o" O ? ?/_? /? O/ o O/  /?   //O/  // O? __ o /  ?ooO _  ??#/O _ ? /o  _ /? ?_ O_   ?O_Oo_ ?  / _ ? O ?_O/?  /?O /O  #  ??? /? ?   _o   oo O OoO_? /O? O_O/ _/ o _o ?_ _ # / ?o O?o?O _  ?/OOo_ ?/??  _ _?o?/??__  ??_? ?? ? Oo _O? ?/  // / #o O  ?o   O?O_O//  _  //__ ? OO_o/_/_  ?? /_?_/o _ oo  ?/ O$   ?O? _o ? ?/  /?  /  _// _/ o/ oo  _ ooo/  ?/ _  _  ?$   o O  ?_ OO   _? OO _?ߏ _/ O_ o _ _/o ?? _ _oO  _? /? ? /O o$? O/ ?/ O_O  o_??   o  o OO?o _?_/o  ?o?? / /? O  /o /o   o  O ?$? ? O__??/O  ?/O? _"_  ?O   _  /O   ??_ _ ?// o /o o ???o? ?    _ # o _?oo o O/O%/ ?  _  ?? _ ?_O O_??oO/  /  ?? o?O o /  ? o$  /o?O?_  /+/   /?  _ _ /? _O/o/?/  O  o ?? ? _ _ _/O?$o  _?oo_? ?O ?+_ O    O  _/? oO   _ ~ 0(P ?P  p/   p@ P/@P$@0 _/`@ OP00@P_@P/@@ PO`>0 PP  @  `_ P`PP P %p`_ 0POP / p  P/p@    Pp/0/__o   _  ?_$? ? O O///_ ? o_  /O    _  /OOoO??//o??_ O_ / /? o/ / /  ??  o ?#_  o /__O ?_ O?/  o/   _ O  ? O  ?/_?/ ? oo_??o  ?  /?O ~@` / @/P  /? 0 `?/  @/  O@@#  @0/ P0/0@ p0 ?p@/0__`@ @0/ @ Po0/ P Pp0 `O`oP  @P @P @@ ?  0  @p P/0 Pp @Џ_0 `0@`P?o@ ?P ?0 @ /pO` 0 O _ ??  ? _ ? ?O/O/$? _O/ o O O ?_/  _?? /  _ /  o O?? ?/ OO/?o? oo? o ?o _ O/    _oo/_$ / ? ߿  ?_/? OOOߏ/ O ? _ oO  ? oOO_?ߟ?o ?/?O/oO// _O / ?_ _ ??????O?   /!o O_ߟ/O  oO/oO? _o/?? o/Ϗo / _ oO? /o?o??/o??__oo ? ?OO/      ? ?  _!O / ? ?O ?_  o _  ?  /  o /?_ _?/_   ?  /? / _   _ o_?/ Oo  ? oo O? _?  o ? /?/ ? O  ? ? //? o  O  ?  o  _   //_ ?O/?߄  O?/!ߊOO/oτ?o ?OO?_  _? o?/_ ߄  OO?o?oO _?O  //o ?? 4߿%_V _@aD\߿m߿`Ͽ*Ͽ)Ͽ@\bi\Ooj_\_Poj?\?Q /jo[oQ_? j[Qoko[oQ??l/[/Sn?Z?S_ /noZ߁X߯oqWPWin 6.0/OLE 1.0 Prefix Information MarkerPresentations.Drawing.10ࡱ> 9:8  !"#$%&'()*+,-./01234567<=>?@ABCDEFGHIJKLMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{|}~Root EntryPRP'1Ole WPG20dfCompObj} PRP'Corel Presentations 10 Drawing Embed SourcePresentations.Drawing.109qWPCaf(*(*"5139hD !(*   !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~a}sϏO/?oL߯O? ?O??O??̅{3OD_/_3߬.7_/o.ߓ3o/_2;)ߜ?A?>2_?_O/+.? ?5_/o+_?1oo//_7) O:+?AO=?0/=?$o-+?._ O??4+0?/"4?)$_8+o@o=??O/;?'?.+?. ?3_,/?/$3?O*&_6+@=?O~pP00.`/? 0:p? O_/>?Z +@2__o/: . Oo? P/0$2pP00*/%_050m``<pP 0- O_?8_  _ .O*?.o1_? ,??- O 0&_1*O'5*? ?<￟? ߿_. ?7/ ??0Ͽ? ߂0o __2/ _-߿/ ?Ͽ. 2 O 1￟? ߿_.Ͽ? OO 6 ς?_ <￟? ߿_ ??0??6/ ?2 o3 /3/O0 0o4? _ 3 ??2  7? ?> o? ??~)p8P?0P`5/ /P@[E/0< b/8/Q0? 3)pT/ ` `j` ~`0@/O`  5/ _@?2 F0$`2@?a/ op04@ _ ?@=`0PM / _@6@ @D `Ip P~ W`:O _"020 3 $ 2/P p0 & /PU? = '2 @ >p 0'~@b/  90 ?@ZPO?P3  ?p9 ?`00 bP`V _1@ _W?P= O =07~.. ?`?8 z@p0B  9Pp`@6P/9 _ @\Q@? p5 @<_h ~ 0.@0 2p/ ?/6`j!?2`߿<p&P.@@￯`40 < 03p 50dp`H?~VP@ 1 o@0P2 [P?PT?  @`1P 0&.P@P QP 02[0P p?P= ,~0`PM$@RWa? o/p20?/0/ = 6~pMp pRP oppO t~pPL`/O@[40 @PPP t~p0L ` Z/0xp^p `t~pK / `?[px0`/00/Ps~fp/@JP O o@O@ `m0  ? s~f0 J   Pp0l@P`pOr~f ?H/ pp/O@ 0 o@k@O?`_P `r~f@ `Gp ? 0N P 0j/P` r~gp `F @0 NP 0 ? @h_/PP @@@q~g D@ /pN P pgP ? q~gp _@C/ @  M`/ @O  d0oo@PPP` _p~h/ @0 ?@oN O` ?Ѐb/`O _ `p~i op?p `?`M0 @  @_/p_ P  p~i  @=  Mp_ ? P  \@//P @@o~j0  FPON__Ѐ`?ߐX _O Op ` o~k0?߀90u`HOPNoP`opS @___`C@:P  _n~l0/`8p @jH N `@J߿/_p@_?D :?   O pn~m _0`?O`/?߀@?/Y_ߠ `/O] 9@  n~n?πJo@O0o@ _`V? @`? o]p9` P/0m~pP_0J  P/? T?0? _08_`` m~q/π`Kp/Q@O@ ?PUo`oP` Pl~s@П߃ L 0R_`BO/ PoߐIσ9/0 Opl~u`?0 @`M0 S?O_Ao А [0@p`80 l~vO0 /pT0_ ?/H@_ O0p`/0k~x /  -@  UP /@ /J@? 0 ?pPP` k~z@П 7@@oW_ _` /L 0@Po  p Pj~|`o /,?`W/ 0? _PMP/@ ?pj~} o +   X@   N0/ ?p0/ j~@/ +P 0POZ ?@p `NO@`?  ``? i~_ _ *POPZP 0/ O  ` i~/ P+P  Z0 O 0O@O@0o ?P`(`i~ + @p?[0 p8r  P  )`h~0s @+@ o@[p? 8Ps@_ @P0/P:0q  ?*:,~t` *0O p [ P 0QP09r`? OP+? g~p0@M` `+@ p/[@ ./0L OQ `/p0@K `?? /`0P~06  0[p. &M[ /0}0_ P `/ &~@M06@/@0 [8p0U0@L OPP ?`8P0~00N6 /Z 80p@M@00L  Op .0~`?0PN 6`?@ p c.P0`?0`Mp/ `? -`/0`~  PX`,p @oc .P0PXQ / 0P N OP`/ ` - 0` ~@@@O0 -?b`.0 @N 0QP 00@P@O@_ ` `.@P/@~p.``@ ?. @d0PC@0/@P@.P@`PP / P0pP p ?P-pO.0/ X 1?O?1?O///??o1  /1O4  5 )_! ?- O~ / OO4@0Wp" PS`@/ /p/@`4?pP1 p 1 / OOQp/  4"00(!P?@, / OO ~p/  _? 00 /# U`_?0SF?0P`N@p=@ P2pS ?0O?p'@?P"` -p~`@_?@/`02p_ /  < 1  p?^p`1?po/?@OO _ 2`@_?@5@_ />pFp# ?@,`@_?@~O`06`_?@3/ /@?2"7`F02 _0`6 2p 4Op06 @2"@,@?# O -Op0~`?`0o@6o04/ `W[ >@`O?`3@`6`o3P 0    4`?`0o@U 1PP/ $ O ,`?`0O@~p8_p` 5/ o` V@\/D@_4pOp8P> 0O ?6pWp/ <@00%@?%P -p  ?2 O _9/ ߏ/-Ͽo ? O-_? ?0 ? 7 ?/2 ? ? 1߿ ρ_ /8 ?4￟/ o ?(ϯ_ ?/ "/_߿/ o+ ?  ? 3 o_ _;_/oￏ_ -?,?,o ?0 /? 9_ ?ߏ2 O 2(/: ? 5?o_(-"O o+ ?  OO/ 4?? >?/-/,?,_ ?0/_o? ; /_O 3Oo? 3'o= OO/ 6?O(-"? ?, O_/  /5!@O$/-?,? ?0!O=?4!/3%?/7/?'-" /-/ o6oC? 0-?,__?0@o65#?Co7 '-O"/o _9ϏO_G__2-,??1o?C_o9?6/_F_9'-?!o0__/?ϟo?/Lo/?5﮿,ϐ?6O/_HOO?_/O9ߝN_/;'߭!ߒ3_/ϟO?/?_G߿?/?ORo??_Ƈ;o??_OϏ??oHϯo??OϟO?/?_lϟO?/?_AJPO?[?_o/O߁o?P/[_O ~P@cPO?/0   $.O]  TO)F 0ooo/?_No%?c o  O&/-] _ TO+G O/?/L??$c~  &//-Ph `O]*@R.?pPp@3/0J?P$Pc /'o._oWO,I0Ooϯ/H$c O(.O/`/_YO-I?0/ _G$Od ?(.a_o o?Z?-J0??O F%d ?(o /Z-??JO0o/ /)??O [oo.oJ/0O_?)? /\?O/o??-J/0_O?o(O] /o-I_0o__O ?/o _?߃?/o//__?/o? ߏ?/ _?o?? /o/?oO?? ߁?ߏ?O?O o_ o?? ߂o?__O?_ _o//?/O//o?ߏ?__/Oo? O?o _?_/O _?o___/O/_o o /??_ ?  ?_/  ?? ??__    OO_O__?/ _ O  o? ? ?_?/ ? ??? ??? _?O_ O /_o_? O? _ o _ // o  /  O?_/ oO   ?/ ??/  / ? ??? oo/ oo/ o_? __/?/ _ߟ/_? ?_?oO   O_/ o/ o o/o/  o _ OOo?? //_ _?߯_/o _/o __? _ ? _o /  ?oO  o / o_ ?/? ? /o ? ? ?o_ //? __ _//? _oO /o_? /? /oo/??  ? ?O/ _ /  oO ? O/  O o/ _  _/ o  _/? o//_? _ o??oo_? _ / Oo/_? /?O? ? /_O //? ?/ O o /?     _ ? _ ?OO_o   ?// ?_o_ /o_   ?/߿/?/_  / O??/? O  / /o _ o_O/ O//  ?? O_   !_/ / _ Oo/o   _O ?/ ? _O _ o/ ??// O _/ O?/_   o    /_?? O߿? /_ _ o/ ?_? O o" O ? ?/_? /? O/ o O/  /?   //O/  // O? __ o /  ?ooO _  ??#/O _ ? /o  _ /? ?_ O_   ?O_Oo_ ?  / _ ? O ?_O/?  /?O /O  #  ??? /? ?   _o   oo O OoO_? /O? O_O/ _/ o _o ?_ _ # / ?o O?o?O _  ?/OOo_ ?/??  _ _?o?/??__  ??_? ?? ? Oo _O? ?/  // / #o O  ?o   O?O_O//  _  //__ ? OO_o/_/_  ?? /_?_/o _ oo  ?/ O$   ?O? _o ? ?/  /?  /  _// _/ o/ oo  _ ooo/  ?/ _  _  ?$   o O  ?_ OO   _? OO _?ߏ _/ O_ o _ _/o ?? _ _oO  _? /? ? /O o$? O/ ?/ O_O  o_??   o  o OO?o _?_/o  ?o?? / /? O  /o /o   o  O ?$? ? O__??/O  ?/O? _"_  ?O   _  /O   ??_ _ ?// o /o o ???o? ?    _ # o _?oo o O/O%/ ?  _  ?? _ ?_O O_??oO/  /  ?? o?O o /  ? o$  /o?O?_  /+/   /?  _ _ /? _O/o/?/  O  o ?? ? _ _ _/O?$o  _?oo_? ?O ?+_ O    O  _/? oO   _ ~ 0(P ?P  p/   p@ P/@P$@0 _/`@ OP00@P_@P/@@ PO`>0 PP  @  `_ P`PP P %p`_ 0POP / p  P/p@    Pp/0/__o   _  ?_$? ? O O///_ ? o_  /O    _  /OOoO??//o??_ O_ / /? o/ / /  ??  o ?#_  o /__O ?_ O?/  o/   _ O  ? O  ?/_?/ ? oo_??o  ?  /?O ~@` / @/P  /? 0 `?/  @/  O@@#  @0/ P0/0@ p0 ?p@/0__`@ @0/ @ Po0/ P Pp0 `O`oP  @P @P @@ ?  0  @p P/0 Pp @Џ_0 `0@`P?o@ ?P ?0 @ /pO` 0 O _ ??  ? _ ? ?O/O/$? _O/ o O O ?_/  _?? /  _ /  o O?? ?/ OO/?o? oo? o ?o _ O/    _oo/_$ / ? ߿  ?_/? OOOߏ/ O ? _ oO  ? oOO_?ߟ?o ?/?O/oO// _O / ?_ _ ??????O?   /!o O_ߟ/O  oO/oO? _o/?? o/Ϗo / _ oO? /o?o??/o??__oo ? ?OO/      ? ?  _!O / ? ?O ?_  o _  ?  /  o /?_ _?/_   ?  /? / _   _ o_?/ Oo  ? oo O? _?  o ? /?/ ? O  ? ? //? o  O  ?  o  _   //_ ?O/?߄  O?/!ߊOO/oτ?o ?OO?_  _? o?/_ ߄  OO?o?oO _?O  //o ?? 4߿%_V _@aD\߿m߿`Ͽ*Ͽ)Ͽ@\bi\Ooj_\_Poj?\?Q /jo[oQ_? j[Qoko[oQ??l/[/Sn?Z?S_ /noZ߁X߯oqBOlePartOlePres000;     V h ~   V   H~C HH(H  !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~?????o_?/_//?/?/Oo?????OO??__o/_OO???o?oO?O/o/_o_?/o?ooO?_??/?/??//o?o???????O?/oO/OoOO?o?o/Ϗoo??/o??o??/???__o?O?ooo_??_/OOO/OO?O_??o?/?/oO///?/_??//O/?/?/_OO/o?oOO_??//__o_?O/_?o_/O_OOo????__/?oo//_O//?Oo_?//?__o/O????/o?o/?o?_///_/?_/?O?o??oooO//?_??_??oO//??_oO_?/?o??/O_??OO?o_?_/o??//?Ooo//_?oOO_OO_?_/O_o__o?O??///O?_/_OO_o__o?/?oO?o?O_?O?/?_o??_??_???Oo/?oO_?/O_?/o/?_O_?Oo_/?O??/__o_?OO??_?/?OO/?/O//?_/o/_??Oo?//?o_o_?//?/_/O?O//_O/O?O/o???o_/?__//?_oOo?o??O/oo/o/o_/_/oOO_/oo//oO??//__?_o_/_??_//?_?_???_OO__o???_??__O???/_????o/_?/oߏ/???o???/o?oO???????o_??o???__??__//?//ߏ_Oo???Oo???__?o___/_?/?O/??_O/??ooO_o????OOO//O?/_/OoOo?_o?O??????/O???O?/??/????_o?_??o???O?/?O?/?_O__??oo?/__o_oo??_?o?ooOO/???????_o?/oOO/?O?O_/o___/o_?o???/??o_O_?/??_oO?__/__?o?/?OoOOO?_/??oO?_?O?O/_???/?//O?/O/?O??O/?o/O_?OOO?_?/OO_OO????O/o???o??/???OO????/O??o????oO??_????O/??/OO???oo??//??/?/o????oO???/_?_???_OoO?/???_??/O?o?o_??/__?O//?????OO??o_?_o??//?_oo????O__/??o?_o/??/?/??_??_???o?o/?o??o??///??O??????o????O?//???/?????ߟoo?_?/???_??o?_??/?????__///o????/_???/?o/Oo??o?O_?__?o_??OO?O??O/?_o/oOo_O/O?/??_O???_o?O??_o?o/_O?O/??O???O?NANI METAFILEPICTVpV  ~   V   H~C HH(H  !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~?????o_?/_//?/?/Oo?????OO??__o/_OO???o?oO?O/o/_o_?/o?ooO?_??/?/??//o?o???????O?/oO/OoOO?o?o/Ϗoo??/o??o??/???__o?O?ooo_??_/OOO/OO?O_??o?/?/oO///?/_??//O/?/?/_OO/o?oOO_??//__o_?O/_?o_/O_OOo????__/?oo//_O//?Oo_?//?__o/O????/o?o/?o?_///_/?_/?O?o??oooO//?_??_??oO//??_oO_?/?o??/O_??OO?o_?_/o??//?Ooo//_?oOO_OO_?_/O_o__o?O??///O?_/_OO_o__o?/?oO?o?O_?O?/?_o??_??_???Oo/?oO_?/O_?/o/?_O_?Oo_/?O??/__o_?OO??_?/?OO/?/O//?_/o/_??Oo?//?o_o_?//?/_/O?O//_O/O?O/o???o_/?__//?_oOo?o??O/oo/o/o_/_/oOO_/oo//oO??//__?_o_/_??_//?_?_???_OO__o???_??__O???/_????o/_?/oߏ/???o???/o?oO???????o_??o???__??__//?//ߏ_Oo???Oo???__?o___/_?/?O/??_O/??ooO_o????OOO//O?/_/OoOo?_o?O??????/O???O?/??/????_o?_??o???O?/?O?/?_O__??oo?/__o_oo??_?o?ooOO/???????_o?/oOO/?O?O_/o___/o_?o???/??o_O_?/??_oO?__/__?o?/?OoOOO?_/??oO?_?O?O/_???/?//O?/O/?O??O/?o/O_?OOO?_?/OO_OO????O/o???o??/???OO????/O??o????oO??_????O/??/OO???oo??//??/?/o????oO???/_?_???_OoO?/???_??/O?o?o_??/__?O//?????OO??o_?_o??//?_oo????O__/??o?_o/??/?/??_??_???o?o/?o??o??///??O??????o????O?//???/?????ߟoo?_?/???_??o?_??/?????__///o????/_???/?o/Oo??o?O_?__?o_??OO?O??O/?_o/oOo_O/O?/??_O???_o?O??_o?o/_O?O/??O???O? d)!dxdx( $ Figure  1  38YX&OLE 2.0 Box <=8C HKKKK d !USUS.,  _OY}XX \]}Census2000Testing,Experimentation,  andEvaluationProgram0 h 0h(#h(#0(#(#0p(#(#September30,2003#} \]m#0@!(#p(#:p(#p(# AU) xdE#xA $t    ` XX}TopicReportSeries,No.14 #}XX#    LJ}@ ?JLPuertoRico#LJ ?@ۮ#   $ JL#LJ $#}JLXX}Qualityassuranceprocedureswereappliedthroughoutthecreationofthisreport.   Thistopicreportintegratesfindingsandprovidescontextandbackgroundforinterpretationof  resultsfromCensus2000evaluations,tests,andotherresearchundertakenbytheU.S.Census  Bureau.Itispartofabroadprogram,theCensus2000Testing,Experimentation,andEvaluation s program,designedtoassessCensus2000andtoinform2010Censusplanning.#}XXu# _    `    IdabelleHovlandand $;  ЀJulieBuckleyEss K&! AU) xdE'xA '"    `    BureauoftheCensus ' #  (#(#(#(#m[99)%`|0a+I B `(*Ea+I BI B+ m +*' (#(# XX}TheCensus2000Testing,Experimentation,andEvaluationsProgramprovidesmeasuresof  effectivenessfortheCensus2000design,operations,systems,andprocessesandprovides  informationonthevalueofnewordifferentmethodologies.Theresultsandrecommendations  fromtheseanalysesprovidevaluableinformationcrucialtoplanningthe2010Census.By t providingmeasuresofhowwelltheCensus2000wasconducted,thisprogramfullysupportsthe ` CensusBureausstrategytointegratethe2010earlyplanningprocesswithongoingMaster L  AddressFile/TIGERenhancementsandtheAmericanCommunitySurvey.Thepurposeofthe 8  reportthatfollowsistosynthesizeresultsfromCensus2000evaluations,experiments,andother $ t assessmentstomakerecommendationsforplanningthe2010CensusinPuertoRico.Census  ` 2000Testing,Experimentation,andEvaluationreportsareavailableontheCensusBureaus  L  Internetsiteat:http://www.census.gov/pred/www/.  8  #}XXD#   `     h    4  -8XXdXXd8  $ } Contents  `   1.0  IntroductionXX $#""J(#. (#(##1 6 $ XX2.0  Background#XX $##""J(#. (#(##2 4  0  2.10` (#(#Historical#""J(#.t t ` (#` (##2 F  0  2.20` (#(#QuestionnaireContent#""J(#.ll)` (#` (##2 2  0  2.30` (#(#DataCollection#""J(#.LL#` (#` (##3  n $ XX3.0  Scope#XX $x##""J(#.F F (#(##4 F  $ XX4.0  ResultsofAnalysisXX $#""J(#.**"(#(##5#$ XXH#Ԉ D  0  XX $4.10` (#(#AddressListDevelopmentActivities#""J(#.7` (#` (##5 V  0  4.20` (#(#MailResponseandMailReturnRates#`"`"I(#.HH7` (#` (##10 B 0  4.30` (#(#CompletenessandQualityofData#`"`"I(#.4` (#` (##14 . 0  4.40` (#(#FieldDataCollection#`"`"I(#.)` (#` (##20  0  4.50` (#(#SpecialPlaces/GroupQuarters#`"`"I(#.1` (#` (##24    $ XX5.0  EvaluationAuthorsRecommendationsXX $#`"`"I(#.2(#(##25#$ XXа#Ԉ    XX $$ XX6.0  TopicReportAuthorsRecommendationsXX $#`"`"I(#.jj4(#(##27#$ XXЮ#Ԉ  7.0  ActionstoDateXX $#`"`"I(#. (#(##29#$ XXI#Ԉ  8.0  SummaryXX $#`"`"I(#. (#(##30#$ XX#Ԉ $ 0   (#(# AcknowledgmentsXX $`"`"I(#. 31#$ XXЋ#Ԉ H ReferencesXX $`"`"I(#.31#$ XX #Ԉ "l   .#~   .-PuertoRico     1.0  Introduction ((#(# XX $ThePuertoRicoTopicReportlookedat15evaluations.FourPuertoRicospecificevaluations ( wereconducted:twoinvolvedfocusgroups,oneananalysisofcensusdatafiles,andonean   operationalanalysis.NonresponseandreactionstotheHispanicoriginandracequestionswere   evaluatedusingfocusgroups.FrequencyandcrosstabulationfilestablesforbothPuertoRico   andtheU.S.werepreparedfromthecensusdatafilesonHispanicoriginandrace.PuertoRico   enumerationwasthetopicfortheoperationalanalysis. t   WhilenotspecificallyPuertoRicoevaluations,evaluationsintheAddressListDevelopment L  categoryprovideaconsiderableamountofdataonPuertoRico.Theseevaluationscoveredthe 8  followingoperations:addresslisting,LocalUpdateofCensusAddresses99(LUCA99),and $t  update/leave. `  ManyevaluationsincludedinthistopicreportincludePuertoRicointhestatesideanalysisand 8 providefew,ifany,breakoutsofPuertoRicodata.Anumberofevaluationsthatcouldhave $ providedinformationonoperationsthattookplaceinPuertoRico,didnotprovideanyanalysis  forPuertoRico.Examplesincludeevaluationswhichlookedatthesuccessoftheadvertising  andpromotionprograms,enumerationofspecialplacesandcoverageissues.   $ XX  4 2.0  Background (#(#    `    XX $Census2000inPuertoRicowasmarkedwithtwohistoric firsts:theuseofthesame  questionnairecontentasstatesideandtherequirementthatrespondentsmailbacktheir  questionnaires.Bothofthesesignificantevents,onerequestedbytheGovernmentofPuerto  RicoduringthecontentdeterminationprocessB  d(21,page1,R1)dC  ԀandtheotheraCensusBureaumethodological t  decisionB  d(27,page1,R1)dC  ,affectedtheresultsofmanyoftheevaluationsincludedinthePuertoRicoTopic `  Report. L  2.10  Historical$ t (#(# SpaincededtheislandofPuertoRicototheUnitedStatesin1898.Priortothen,Spainhad L  takencensusesatirregularintervalsbetween1765and1887.TheU.S.WarDepartmenttooka 8  specialcensusofPuertoRicoin1899.PuertoRico,whichbecameacommonwealthin1952,has $  beenincludedineveryU.S.decennialcensussince1910.Beginningin1960,thecensusof   populationandhousingwasconductedasajointprojectoftheU.S.CensusBureauandthe   GovernmentofPuertoRicoB  d(29,page2,R1)dC  .ThePuertoRicoPlanningBoard(PRPB)hasbeenidentifiedbythe  OfficeoftheGovernorastheliaisonagencyforcensusactivitiesontheisland.TheCensus  Bureauwasresponsibleforthedatacollection,andthePRPBprovidedinputoncontentanddata p needs. \ ThispartnershipbetweenthegovernmentofPuertoRicoandtheCensusBureauistheresultof 4 anOctober1958specialagreementconcerningthecensusesinPuertoRico.Thebasicpurposes  p oftheagreementweretoassuretheefficientoperationofthecensusprogram,toprovidethe  \ Commonwealthwithalargeshareoftheresponsibilityforplanningthecensus,andtoassurefull H considerationofitsuniquestatisticalneeds.   #  1      ׀Eachcensusthereafterconformedtothebasic1958 4 agreementwithsubsequentamendments,includingCensus2000.GovernorsofPuertoRico   regularlyhavedirectedthePRPBtoserveasthecoordinatingagencyforthecensusoperationsB  d(29,page4,R2)dC  .   2.20  QuestionnaireContent(#(# From19601990,theCensusBureauworkedwiththePRPBtodevelopquestionnairecontent l! thatmetPuertoRicosuniqueneeds.Forexample,in1990thePuertoRicoquestionnairehad X"  uniquetopicssuchasparentsplaceofbirth,vocationaltraining,andconditionofhousingunit; D#! butdidnotincludestatesidetopicssuchasrace,Hispanicorigin,andhomeheatingfuel. 0$" DuringthequestionnairecontentdevelopmentphaseforCensus2000,however,theGovernment &X!$ ofPuertoRicoinformedtheCensusBureauinalettertoDr.MarthaFarnsworthRiche,Census &D"% BureauDirector,fromNormaBurgos,PRPBChairwoman,datedOctober31,1997,thatPuerto '0#& RicowasrequestingthesamedecennialquestionnairecontentasstatesideB  d(21,page4,R1)dC  .Thereasonsgivenfor ($' thesamecontentrequestincludedquickerprocessingandreleaseofPuertoRicocensusdataand  theinclusionofPuertoRicoinstatesidesummarystatisticsaswellascomparabilitywith  statesidedataB  d(21,page1,R2)dC  .  2.30  DataCollection`(#(# PriortoCensus2000,PuertoRicohadalwaysbeenenumeratedusingthelist/enumerate(L/E) 8  methodologyB  d(29,page3,R3)dC  .WithL/Edatacollection,enumeratorsvisiteachhousingunittocompletea $ t censusquestionnaire,recordaddressesandupdatetheL/Emaps.  ` ForCensus2000,adecisionwasmadebytheCensusBureautousetheupdate/leave(U/L)  8  methodologyfortheentireIslandB  d(27,page1,R1)dC  .   #  2      ׀InordertoconductanU/Loperation,theCensusBureaufirst $  hadtoconductanislandwideaddresslisting(AL)operation.TheALoperationwasconductedin   PuertoRicofromOctober,1998throughJanuary,1999.   DuringU/L,enumeratorscanvassassignmentareastodeliveracensusquestionnairetoeach   housingunit,updatetheaddresslistingpagesandCensusBureaumaps.Thehouseholdthen p completesandreturnsthequestionnairebymail.ThemovetoanU/Lstrategyrespondedto \ changestakingplaceontheIsland,includinganincreaseinlimitedaccesscommunitiesanda H populationthatmirroredtheUnitedStatesintheprevalenceoftwoincomefamilies.Thesetwo 4 trendsindicatedthatitwouldbemoredifficulttoimplementaL/Emethodologyin2000.The  p U/Lmethodologyalsoofferedotherbenefits,availablestatesideformanydecennialcensuses:  \ selfresponseresultinginhigherdataqualityandthedevelopmentofanaddresslistthatcouldbe H usedinfuturedecennialoperationsB  d(27,page1,R2)dC  . 4  $ XX   3.0  Scope XX $(#(#  Thepurposeofthisreportistosummarizethefindingsandrecommendationsfromthe  evaluationstudiesforthose operationswhichtookplaceinPuertoRico.Notallevaluations  provideinformationordataspecifictoPuertoRico.SometimesPuertoRicodataareincluded  withinthestatesideanalysisofanoperation.Thefollowingisalistoftheevaluationswhich t  providedPuertoRicospecificdata: `   ResponseRatesandBehaviorAnalysis  8  0  A.2.b.0` (#(#InternetDataCollection` ` (#` (# 0  A.30` (#(#BeCountedCampaignforCensus2000L ` (#` (# 0  A.80` (#(#PuertoRicoFocusGroupsonWhyHouseholdsDidNotMailBacktheCensus 8  2000Questionnaire$ ` (#` (#  Content/DataQuality    0  B.1.b0` (#(#AnalysisofItemNonresponseRatesforthe100PercentHousingandPopulation  ItemsfromCensus2000p` (#` (# 0  B.120` (#(#PuertoRicoCensus2000ResponsestotheRace&EthnicityQuestions\` (#` (# 0  B.130` (#(#PuertoRicoFocusGroupsontheCensus2000RaceandEthnicityQuestionsH` (#` (# .0  4(#(#  SpecialPlacesandGroupQuarters   p 0  E.50` (#(#GroupQuartersEnumerationH` (#` (#  AddressListDevelopment    0  F.20` (#(#TheAddressListingOperationandItsImpactontheMasterAddressFile` (#` (# 0  F.60` (#(#EvaluationoftheLocalUpdateofCensusAddresses99(LUCA99)` (#` (# 0  F.100` (#(#EvaluationoftheUpdate/LeaveOperation ` (#` (#  FieldOperations  X"  0  H.20` (#(#AssessmentofFieldVerification0$"` (#` (# 0  H.50` (#(#NonresponseFollowupforCensus2000%l #` (#` (# 0  H.80` (#(#OperationalAnalysisofEnumerationofPuertoRico&X!$` (#` (# 0  H.90` (#(#LocalCensusOfficeProfileforCensus2000&D"%` (#` (# 0  H.100` (#(#DateofReferenceforAgeandBirthDateusedbyRespondentsofCensus2000'0#&` (#` (#   +&* 4.0  ResultsofAnalysis (#(# 4.10  AddressListDevelopmentActivities(#(# Theresearchquestionposedwas:Howsuccessfulweretheaddresslistdevelopmentactivities? ` Therearethreerelevantevaluationsinthiscategory:F.2TheAddressListingOperationandIts L  ImpactontheMasterAddressFile,F.6EvaluationoftheLocalUpdateofCensusAddresses99 8  (LUCA99),andF.10EvaluationoftheUpdate/LeaveOperation.Alloftheseevaluations $ t provideasignificantamountofdatathatarePuertoRicospecific.  ` In1990,allofPuertoRicowasenumeratedusingthelist/enumeratemethodology.Adecision  8  wasmadetoenumerateallofPuertoRicousingtheupdate/leavemethodologyinCensus2000 $  basicallyaruralprocedureintheU.S.Whileitrepresentedastepforward,itwasdifficulttouse   arurallistingprocedure,whichincludedmapspotting,inurbanareas.   Inadditiontomethodologicalissues,therewasconcernaboutPuertoRicosuniqueaddressing   conventionsandtheuseofSpanish.Mostnotableisthefourlineaddresswheretheurbanization p name(neighborhoodequivalent/connotation)isusedtoeliminatethetiebetweenrepeatedstreet \ namesindifferenturbanizationsB  d(30,page1,R1)dC  .Insomeinstances,theurbanization,condominium,or H community/districtnameisusedinlieuofastreetname. 4 PuertoRicosuniqueaddressingnormsandsystemsdonotallowtheCensusBureautoapplythe  \ samebusinessrulesforautomatedprocessingthatarefollowedstateside.Theaddresslandscape H acrossPuertoRicoisamixofstylesandstandards.Thesesituationsthatcomplicateparsingand 4 standardizationdooccurstateside,butnottothedegreeandvarietyfoundinPuertoRico.   InadditiontothemixofstylesandstandardsrelatedtoPuertoRicoaddresses,therewereseveral  captureandprocessingproblems.TheproblemsstemfromnotsufficientlymodifyingtheCensus  2000proceduresandinstruments designedforstatesideoperations tocapture,process,transfer,  andstoreaddressinformation.Fromfieldlistingforms,toquestionnairedesign,todataentry p instruments,tofileexchangelayouts,tothebasiclayoutoftheMasterAddressFile(MAF),the \  fieldsandfieldlengthsprovidedwerenotalwaysadequatetohandlePuertoRicoaddressesand H! insomeinstancesnotconsistentfromonemediumtothenext. 4"  AllthreeauthorsacknowledgethatsomepartsoftheiranalysisforPuertoRicoarelimiteddueto  $\" anaddresslistingprocessingerrorofthekeyedlistingpages.ThiserroraffectedthePuertoRico $H # addresslistandsubsequentoperationswhichusedand/orbuiltuponthislist.Thekeyedlisting %4!$ pageshada60characteraddressfieldthatcouldcontainacitystyleaddressoralocation & "% description.Thestatesidefilesusedaflag, A/D,setbythelistertoindicatewhetheritwas A ' #& foracitystyleaddressor Dforalocationdescription.InPuertoRico,theaddresslistingpages (#' wereinSpanishandtheflagsetbythelisterwas D/L.The Dwasusedforcitystyle )$( addressesandstoodfortheSpanishworddirecci;n.The Lwasusedforaphysicallocation *%) descriptionandstoodfortheSpanishwordlocalizaci;n.Anotherdifferencebetweenthe l+&* statesideandPuertoRicolistingpageswastheadditionofafourthlineforurbanizationor  condominiumname.  WhentheDecennialSystemsandContractsManagementOffice(DSCMO)processedthefiles t forPuertoRico,the Dflagwasprocessedasalocationdescription,asitwasintheU.S.,and ` thePuertoRicokeyeddatawererunthroughthestatesidestandardizer.However,theCensus L  BureaudidnothaveastandardizerthatcouldaccommodatetheSpanish,fourlineaddressesfrom 8  PuertoRico.Asaresult,alloftheaddressinformationcollectedinPuertoRicohadtobemoved $ t tothelocationdescriptionfield.Thelocationdescriptionfieldthenhadaflagindicatingwhether  ` theaddresswasacitystyleornoncitystyleaddress.Processingwascomplicatedbythefact  L  thatoftenthe60characterfieldfrequentlycontainedafieldlistingentrythatincorrectlyblended  8  bothcitystyleandlocationdescriptiontogether.Anylistererrorinsettingtheflagsorrecording $  theinformationintheassignedfields,furthercomplicatedthissolution.Whilethissolutionwas   lessthanperfect,itallowedtheCensusBureautousetheaddressesthathadbeencollected   duringaddresslistingforsubsequentcensusoperationsB  d(31,page1,R1)dC  .   F.20  TheAddressListingandOperationandItsImpactontheMasterAddressFilep(#(# ThisevaluationprovidessometableswhereinformationfromtheU.S.andPuertoRicoare H combined,aswellassomespecifictablesforeithertheU.S.orPuertoRico. 4 SinceallofPuertoRicowastobeupdate/leave,theentireIslandneededtobelisted,about1.4  \ millionaddressesB  d(12,pageiv,R1)dC  .Ofthoseaddresseslisted,99.5percentwereDecennialMasterAddressFile H (DMAF)deliverableB  d(12,page17,R3)dC  Ԁandover94percentwereinthefinalcensuscountB  d(12,page18,R4)dC  . 4 TheprocessingerrordescribedinSection4.1affectedtheresultsofthisanalysis,notablythe   absenceofanyinformationonmultiunitandcitystyleaddressesinPuertoRico.Bothitems  requiretheuseofthecitystyleaddressfieldontheMasterAddressFile(MAF)extractasthe  startingpointandallofPuertoRicosaddresseswereinthelocationdescriptionfield.Thusin  thisanalysis,allofPuertoRicohousingunitsweretreatedassingleunitsandtherewerenocity l styleaddressesinPuertoRicoB  d(12,page8,R2)dC  . X  F.60  EvaluationoftheLocalUpdateofCensusAddresses99(LUCA99)0" (#(# TheLUCA99programinvitedlocalgovernmentstoparticipateinthereviewoftheaddresses $X" collectedduringtheaddresslistingoperation.InPuertoRico,50ofthe78muncipiossignedup $D # toparticipate.Thiswasahigherparticipationrate,byeligiblegovernmentalunits,thananyof %0!$ thefourregionsoftheU.S.B  d(13,page15,R2)dC  ԀTheBostonRegionalCensusCenter(RCC)consideredthePuerto &"% RicoLUCA99programasuccessbecausethehighparticipationrateindicatedanawarenessof '#& theimportanceofCensus2000tothelocalgovernments.About20percentofthePuertoRico (#' participantschallengedblocksB  d(13,page15,R3)dC  . )$(  h+&* IntheU.S.,programparticipantswereprovidedmapspottedmaps,acensusblockhousingunit  summarylist,andalistofaddressesfortheirareatobeusedasareference.ALUCA99  materialmodificationwasrequiredforPuertoRicobecauseofmapqualityconcerns.Dueto  mapspotcrowding,programparticipantsreceivedblockmapswiththemapspotsremovedB  d(32, t page1,R1)dC  . t UsingthematerialsprovidedbytheCensusBureau,municipiosidentifiedanyblockcountsthey L  deemedinaccurateandtheCensusBureaurecanvassedthoseblocks.InPuertoRico35,563 8  addressesweresentoutforreview.Enumeratorscouldverify,delete,declarenonresidential, $ t correctoraddaddresses.InPuertoRico:33,029addresseswereverified;2,513weredeleted;21  ` weredeterminedtobenonresidential;andzerowerecorrectedB  d(13,page18,R4)dC  .Inareasthatwererecanvassed,  L  enumeratorsaddedatotalof9,874addressesB  d(13,page22,R5)dC  .  8  Thezerocorrectionsrequiresfurtherexplanation.TheLUCA99fieldverificationlistingsfor   PuertoRicowereerroneouslyrunusingthestatesidelistingpageformatinsteadofthePuerto   Ricoformat.Thiserrorwasdiscoveredwhentheenumeratorswereinthefieldwiththebinders.   Thestatesidelistingpagedidnotdisplaytheadditionallinefortheurbanizationorcondominium   nameandused A/D(address/description)ratherthanthePuertoRico D/L p (direcci;n/localizaci;n)forcapturingaddressesorlocationdescriptions.Thecomplicationwas \ thatenumeratorsmadecorrectionstotheurbanization/condominiumnameanywhereonthe H listingpagetheyfoundspace.ThecorrectPuertoRicoSpanishblankaddpages,however,were 4 insertedintothebinders.  p Asaresult,alladdedaddressesandexistingaddresseswithactioncodesof doesnotexistand H  nonresidentialcouldbekeyed.Correctionstoaddresslistingswerenotkeyedsincethe 4 correctionsmadeonthestatesideaddresslistingpagesforitemssuchas   urbanization/condominiumnamecouldhavebeenplacedanywhereonthelineorpage.The   NationalProcessingCenter(NPC)didnothaveasufficientnumberofbilingualclerksthatcould  haveinterpretedthesecorrectionsB  d(24,page1,R1)dC  .  #  3      ׀  AsinEvaluationF.2,thisevaluationislimitedbytheprocessingerrorthatoccurredduring l addresslistingwithrespecttoanalysisbycitystyleaddressormultiunitstatus.B  d(13,page23,R1)dC   X    F.100  EvaluationoftheUpdate/LeaveOperation0" (#(# AllofPuertoRicowasTypeofEnumerationArea(TEA)2andenumeratedusingupdate/leave $X" (U/L)B  d(14,page1,R1)dC  .ThepreprintedU/LlistingpageforPuertoRicowasinEnglishB  d(33,page %0!$ 1,R1)dC  ԀandtheU/Laddpage $D # wasinSpanishB  d(34,page1,R1)dC  .Bothpagescarriedanadditionallinefortheurbanizationorcondominium %0!$ name. &"%  (#' InPuertoRico,atotalof1,471,225U/Lactionsweretaken.Thisconsistedof:  0  adds0` (#(#0 ` (#` (#111,787 (# (# 0  corrections0 (#(#751,156t (# (# 0  deletes0 (#(#122,815` (# (# 0  verifies0 (#(#485,467B  d(14,page11,R2)dC  L  (# (# TheauthornotesthatPuertoRicoU/Lhadahigherpercentageofadds,deletesandcorrections $ t thanstatesideoperations,butacknowledgesthattheaddresslistingprocessingerrormayaccount  ` fortheadditionalworkthatwasrequiredB  d(14,pagevivii,R3)dC  .  L  Ofthe111,787addedaddresses,nearly90percentoftheaddsperblockoccurredinblockswith $  fewerthantenaddsB  d(14,page33,R5)dC  .ThenumbersofcorrectionsB  d(14,page34,R6)dC  ԀanddeletesB  d(14,page34,R7)dC  Ԁperblockweremorewidely   distributed,especiallycorrections.Thewidedistributionofcorrectionsmaybeattributabletothe   initialprocessingerrorandthatLUCA99fieldverificationcorrectionswerenotkeyed.Ofthe   111,787addressesaddedintheU/Loperation,93,607(83.7percent)wereinthefinalcountB  d(14,pagevi,R8)dC  .   AswithevaluationsF.2andF.6,thisevaluationislimitedbytheprocessingerrorthatoccurred \ duringaddresslistingwithrespecttoanalysisbycitystyleaddressormultiunitstatus.B  d(14,page 4 32,R4)dC  B  d(14,page35,R10)(14,page36,R11)dC  ԀIn H addition,theDeliverySequenceFileanalysisthattheauthorprovidesforstateside,asan 4 indicatorofpossiblefuturemailout/mailbackareas,wasnotdoneforPuertoRicobecausethe  p addresseswerenotmatchablecitystyleaddressesB  d(14, H page30,R9)dC  .  \ IndependentAnalysisofAddressListDevelopmentActivitiesinPuertoRico 4 In1996,aPuertoRico2000WorkingGroupwasformedwithrepresentativesfromthefollowing   divisions:DecennialManagement(DMD),Population(POP),Field(FLD),DecennialStatistical  Studies(DSSD),andGeography(GEO)B  d(36,page1,R1)dC  .(AtthattimeDMDalsoencompassedthefunctionsof  thecurrentDecennialSystemsandContractsManagementOffice).Inretrospect,acritical  omissionfromtheteamwasarepresentativefromtheTechnologiesManagementOfficesince l manyoftheaddresslistingswereoftheautomatedvarietywhosetemplatescouldnotbe X  modifiedintimetoaccommodateSpanish. D! ThePuertoRico2000WorkingGroupwasresponsiblefortheoverallplanningofcensus #l! activities.Inaddition,theyprovidedbackgroundsupporttootherdivisionalteamsthatwere $X" responsibleforspecificoperations(e.g.GroupQuartersenumeration)thatwouldtakeplacein $D # PuertoRicoB  d(37,page1,R1)dC  . %0!$ ThePuertoRico2000WorkingGroupsupportedthemovefromthe1990List/Enumerate '#& methodologytoUpdate/LeaveB  d(37,page2,R2)dC  .The1990censusdatashowed71percentofthepopulationin (#' PuertoRicoasurbanB  d(38,page1,R1)dC  .Therehadevenbeena1990PuertoRicoMultiunitCoverage )$( ImprovementOperationEvaluationthatencompassedthefourSanJuanareaDistrictOfficesB  d(39,page1,R1)dC  . |*%) Thatevaluationfound262eligiblemultiunitswithover34,000unitsB  d(39,page3,R2)dC  .Giventhisinformation, h+&* theworkinggroupevenexploredthepossibilityofhavingaMailout/Mailbacktestsitein  Bayam;nB  d(40,page3,R1)dC  ԀbutconcludedthatitwouldnotbefeasibleB  d(41,page2,R1)dC  Ԁwithouta1990censusaddresslistthat  couldbeusedinconjunctionwiththePuertoRicoUnitedStatesPostalService(USPS)Delivery  SequenceFilethatusedfourlineaddresses.Whiletheworkinggrouprecognizedthat t Update/Leaverepresentedastepforwardalongtheenumerationcontinuum,italsorecognized ` thedrawbackofitsbeingabasicallyruralprocedure. L  Theworkinggroupusedthestatesideaddresslistingpageasthebasefordevelopinganaddress $ t listingpageforPuertoRicoB  d(42,page1,R1)dC  .Concernoverprocessingissues,keptmodificationstoaminimum.  ` Itwasagreedthat,ataminimum,thepagewouldhavetobeinSpanishandafourthlinewould  L  berequiredforurbanizationorcondominiumnameB  d(43,page1,R1)dC  .TheworkinggroupusedthePostal  8  AddressingDirectory,producedbytheUSPSCaribbeanDistrict,asaguideindeveloping $  addresscollectionrequirementsforPuertoRicoB  d(44,page1,R1)dC  .ResearchinPuertoRicorevealedthatE911   addresseswerenotestablished.TheworkinggroupagreedtoremovethatfieldfromthePuerto   Ricolistingpageandallowlargerspacesfortheexistingfields.     Theworkinggroupdiscussedprocessingconcernssuchaslengthsoffields,capturing p diacriticals,andthetransferoffilesbetweenGEOandDMDB  d(45,page1,R1)dC  .Therewasgeneralagreementthat \ modificationsforPuertoRicowouldbenecessaryandmodificationswerekepttoaminimum. H TheworkinggroupwasawareofthechangesthatweremadetotheaddressfieldsinPuertoRico, 4 andcommunicatedthemviamemorandatoaffecteddivisions(PuertoRico2000Memoranda  p Series,NO.9701;MemorandumtoDistributionListfromIdabelleB.Hovland,January28,  \ 1998)B  d(46,page1,R1)(43,page1,R2)dC  .Whilethememorandawerewidelydistributed,theinformationwasnotcommunicatedto H everyonewithineachdivisionwhoneededtoknow.Themostglaringresultofthislackof 4 communicationbetweenallaffectedpartiesisevidencedintheinitialprocessingoftheaddress   listing.   Fromthatpointon,salvagingtheaddresslistingsfromPuertoRicobecamethegoalforeach  successivecensusoperationsomeofwhichintroducednewproblems.Theseunplannedfor  operationalchallenges,plustheuseofabasicallyruralprocedureinapredominantlyurban l environment,complicatedenumerationandaffectedtheaddresslistdevelopmentevaluations. X  Loadingalladdressesintothelocationdescriptionfieldallowedustoproceedwithenumeration D! operations,butcouldnotprovideanyevaluationstatisticsbasedoncitystyleormultiunitstatus. 0"  ThecompromisedstateofthePuertoRicoMasterAddressFile(MAF)attheendofcensus $X" operationswasthereasontheCensusBureauenteredintoacontractwithSeekDatatocleanup $D # thePuertoRicoMAF.SeekDatatookthePuertoRicoMAFrecordsandstandardizedand %0!$ parsedthemintoindividualaddresscomponentsandaddedcomponentsasappropriate.Seek &"% DataiscurrentlyworkingwithGEOtodevelopanewdatamodelforPuertoRicoMAF '#& addressesthatwillbetterenabletheCensusBureautoimplementautomatedaddressprocessing (#' activitiesforthe2010census. )$(  h+&* Theneedtoimprovecommunicationwith,andinvolvementof,allaffectedpartieswithinterest  inthePuertoRicoaddresslistdevelopmentactivitiesisthebasisforourrecommendationto  improvetheprocessforincludingandinformingallpartieswhencustomizationisrequired.  Amongotherthings,wesuggestanincreaseintheuseofJointApplicationDevelopmentsand t theinclusionofinhousepersonnelfromallrelevantsubjectmatterandoperationaldivisionsin ` theplanning,specification,development,andtestingofmaterialsforPuertoRico. L  4.20  MailResponseandMailReturnRates$ t(#(# Theresearchquestionsposedare:Whatwerethemailresponseandmailreturnrates?andHow  L  didtheydifferbylongandshortform?  8  InPuertoRico,theresponserateasofApril18,2000was48.4percentB  d(17,page9,R15)dC  .Stateside,theresponse   rateasofApril18,2000was59.3percentB  d(17,page9,R16)dC  .TheEvaluationH.8authorexplainsthatthemail   responserateisdefinedasthenumberofmailreturnsreceivedpriortothecutdateforthe   NRFUuniversedividedbythetotalnumberofhousingunitsinmailbackareasthatwereeligible   forNRFU.ItisameasurethatrepresentsthepercentageofaddresseseligibleforNRFUthat p returnedquestionnairespriortothedesignationoftheNRFUuniverseB  d(17,page8,R17)dC  .InPuertoRico,forshort \ formquestionnaires,theresponserateasofApril18,2000was50.5percentB  d(17,page9,R18)dC  ;forlongform H questionnairestheresponseratewas37.6percentB  d(17,page9,R19)dC  .Stateside,asofApril18,2000,forshortform 4 questionnairestheresponseratewas61.9percentB  d(17,page9,R20)dC  ;forlongformquestionnairesitwas51.9  p percentB  d(17,page9,R21)dC  .  \ InPuertoRico,themailreturnrateasofApril18,2000was55.0percentB  d(17,page9,R8)dC  .Stateside,thereturn 4 rateasofApril18,2000was69.6percentB  d(17,page9,R22)dC  .TheEvaluationH.8authorexplainsthatthemail   returnrateisdefinedasthenumberofmailreturnsreceivedpriortothecutdatefortheNRFU   universedividedbythetotalnumberof occupied housingunitsinmailbackareasthatwereon  theDMAFpriortoNRFUB  d(17,page9,R7)dC  .InPuertoRico,asofApril18,2000,forshortformquestionnaires  thereturnratewas57.2percentB  d(17,page9, 4"  R23)dC  Ԁandforlongformquestionnairesitwas43.7percentB  d(17,page9,R24)dC  .Stateside,  asofApril18,2000,thereturnrateforshortformquestionnaireswas72.3percentB  d(17,page9,R25)dC  ;forlongform p questionnairesitwas61.9percentB  d(17,page9,R26)dC  . \  TwoevaluationsinthiscategoryaddressadditionalwayspeopleinPuertoRicocouldanswerthe 4"  censusbyrespondingviatheInternetorthroughtheuseofaBeCountedquestionnaire(A.2.b.  #p! InternetDataCollectionandA.3BeCountedCampaignforCensus2000).Thethirdevaluation  $\" inthiscategoryisdevotedsolelytotheissueofwhyPuertoRicohouseholdschosenottomail $H # backthequestionnaire(A.8PuertoRicoFocusGroupsonWhyHouseholdsDidNotMailBack %4!$ theCensus2000Questionnaire).EvaluationH.8OperationalAnalysisofEnumerationinPuerto & "% Rico,discussedmorefullyinthefielddatacollectioncategory,isthesourceforthemail ' #& responseandmailreturnratesforPuertoRico. (#'  l+&* A.2.b.0  InternetDataCollection(#(# ThisevaluationprovidesoperationalsummariesontheuseoftheInternetasaresponsemode.  PuertoRicoisincludedintheoveralldataanalysis.Theauthordoesnotethattherewas t insufficienttimetocreateaSpanishlanguageversionoftheinternetformforPuertoRico. `  Thus,respondentsinPuertoRicoandotherSpanishspeakerscouldrespondontheInternetin L  EnglishonlyB  d(3,page1,R1)dC  . 8  OnlyshortformmailbackhouseholdswithanIDnumberfromthedeliveredquestionnairewere  ` eligiblefortheinternetresponseoptionB  d(3,page1,R2)dC  .PuertoRicohad1,094,593potentiallyeligible  L  householdsB  d(3,page4,R3)dC  Ԁand107householdschosetorespondtothePuertoRicoEnglishshortform  8  questionnaireviatheInternetB  d(35,page1,R1)dC  .TableP19,AgebyLanguageSpokenatHomebyAbilitytoSpeak $  EnglishforthePopulation5YearsandOver,fromtheCensus2000SummaryFile3detailed   tablesforPuertoRicoindicatethatonly30percentofthepopulation18to64yearsoldspeak   onlyEnglishorspeakEnglish verywell.B  d(20,page1,R1)dC     A.30  BeCountedCampaignforCensus2000p(#(# ABeCountedcampaignwasimplementedinPuertoRicoforCensus2000withthesamegoals H asstateside: 4  (Ax3"3"  32A3  0    countpersonswhodidnotreceiveacensusquestionnaire3ͭ݌ \(#(# Ќ  "3"  32A3  0    countpersonswhobelievedtheywerenotincludedonanyothercensusform3݌H(#(# Ќ  "3"  32A3  0    encourageparticipationofpersonswhoaretraditionallyundercountedinthecensus3݌4(#(# Ќ  "3"  32A3  0    provideameansforpersonswithnousualresidencetobecounted3İ݌ (#(# Ќ  InPuertoRico,BeCountedforms(BCFs)wereavailableinSpanishandEnglish.Inaddition,Be  CounteddisplayboxeswereavailablewithBeCountedmessagesinHaitianCreole.  TheauthorincludesPuertoRicointheoverallevaluationoftheBeCountedcampaign.The l authorreportsthat60,000EnglishBCFsand360,000SpanishBCFswereprintedforPuertoRico X  andareincludedinthenumbersoftotalEnglishandSpanishBCFsprintedB  d(5,page9,R2)dC  .TableT.,Costand D! ExpenditureCategory,showsthatprintingtheEnglishandSpanishBCFsforPuertoRicocost 0"  $127,181B  d(5,page27,R3)dC  . #l! A.80  PuertoRicoFocusGroupsonWhyHouseholdsDidNotMailBacktheCensus2000 $D # Questionnaire%0!$(#(# TheauthordrawsconclusionsforreasonsformailnonresponseinPuertoRicobasedonfocus '#& groupsconductedinninesitesacrossPuertoRicowithacombinedtotalof41participants(28 (#' womenand13men)B  d(6,page8,R1)dC  .Theninesiteswere:Mayagez,Ponce,Cayey,Loza,Bayam;n,Humacao, )$( Aasco,OldSanJuanandSanturceB  d(6,page6,R2)dC  .Focusgroupparticipantswerehouseholdheadswhohad |*%)  h+&* notreturnedthequestionnairebymailorhouseholdheadswhohadlaterfilledouttheir  questionnairewiththehelpofanenumeratorB  d(6,page5,R3)dC  .  Theauthordividesherreasonsformailnonresponseintofourbroadcategories: t "3"  3ٸ2A3  0    MotivationalandprocessrelatedB  d(6,page10,R4)dC  3ٸ݌L (#(# Ќ  "3"  32A3  0    PracticalandlogisticalB  d(6,page13,R5)dC  3݌8 (#(# Ќ  "3"  32A3  0    CulturalandpoliticalB  d(6,page14,R6)dC  3݌$ t(#(# Ќ  "3"  3߻2A3  0    RelatedtoquestionnairecontentanddesignB  d(6,page17,R7)dC  3߻ ݌ `(#(# Ќ  Motivationalandprocessrelatedreasons.Alackofclarityaboutthepurposeofthecensusis  8  includedinthiscategoryB  d(6,page10,R8)dC  .Thefocusgroupparticipantsrememberedtheadvertisingcampaignas $  emphasizingmailingbackthequestionnaireandhowthenumberofresponseswasimportantin   determiningfederalaid.Theyfeltthattheadvertisingcampaigndidnotconveyabroadsenseof   purposeandwasreminiscentofapoliticalcampaign.   Alsoincludedinthisbroadcategorywasfocusgroupparticipantsconfusionoverthe p distributionofquestionnairesandtheroleofenumeratorsinCensus2000versus1990B  d(6,page 4 11,R9)dC  . \ ParticipantsmayhaveseenanU/Lenumeratorupdatingaddresslistsanddroppingoff H questionnaires,anAccuracyandCoverageEvaluation(A.C.E.)enumeratorwithA.C.E. 4 questionnaires,and/oraNonresponseFollowup(NRFU)enumeratorwithanEnumerator  p FriendlyQuestionnaire(EFQ).  \ Practicalandlogistical.Thisbroadcategoryincludesfocusgroupparticipantsreportingalackof 4 timetocompletethequestionnaireB  d(6,page13,R10)dC  .Anexamplegivenwasthatofaworkingmotherreturning   homefromworkandhavingtobalancecompetingdemandsonhertimemealpreparation,child   care,andcompletingacensusquestionnaire.  Anotherexampleincludedinthiscategoryisthedifficultysomefocusgroupparticipantshad,  especiallyinruralareas,inreturningtheirformbymailB  d(6,page14,R11)dC  . l Culturalandpolitical.Somefocusgroupparticipantsvoicedtheirfearsabouttheperceivedlack D! ofconfidentialitywithquestionnaireresponsesandtheattendantconsequencesiftheinformation 0"  fellintothewronghandse.g.thetaxauthority,welfareofficials.Thefocusgroupparticipants #l! voicedageneralmistrustofgovernmentandpoliticiansB  d(6,page14,R12)dC  . $X" Nonresponsefocusgroupparticipants inallcommunitiesandacrossalldemographicand %0!$ economicgroupsexpressedastrong,unqualifiedsupportforinpersondatacollectionasthe &"% meansofgatheringthenecessaryinformationB  d(6,page22,R13)dC  .The1990L/Edatacollectionmethodoffered '#& thisapproach.InL/E,anenumeratorcamebyeachhouseholdtopickupacompletedAdvance (#' CensusReportorfilloutaquestionnairewiththerespondentandtookthecompleted )$( questionnairewithhim/her.Anecdoteswhichelaboratedontheperceivedculturalpreferencefor |*%) apersonalapproachweresuppliedbytheA.8authorB  d(6,page16,R14)(6,page16,  R15)(6,page16,R16)dC  . h+&* ЇRelatedtoquestionnairecontentanddesign.AsdiscussedinSection2.2,QuestionnaireContent,  Census2000wasthefirsttimethatstatesidequestionnairecontentwasusedinPuertoRico.The  CensusBureauusedthestatesidequestionnairecontentinPuertoRicoattherequestofthe  PuertoRicoPlanningBoard,theCensusBureausofficiallydesignatedliaison. t Asaresultofthisrequest,severalnewtopicswereintroduced(suchasraceandHispanicorigin) L  whileothertopicsfrompreviouscensusesweredropped.Manynonresponsefocusgroup 8  participantsvoicedtheirobjectionstotheuseoftheraceandHispanicoriginquestionsinPuerto $ t Rico.TheyviewedthequestionsasdivisiveandinsensitivetothemixedrealitiesofPuerto  ` RicoB  d(6,page17,R17)(6,page17,R18)dC  .  L  Variousnonresponsefocusgroupparticipantsalsovoicedobjectionstoquestionsonincome, $  maritalstatusandhouseholdcompositionB  d(6,page18,R19)dC  .However,thesewerenotnewquestionsforCensus   2000inPuertoRico.   Finally,nonresponsefocusgroupparticipantsvoicedconcernsabouttheoveralllengthand   complexityofthelongformquestionnaire.Somenonresponsefocusgroupparticipantsalsofelt p thatthelanguageusedonthequestionnairewashardtounderstandB  d(6,page19,R20)dC  .TheA.8authorsuggeststhat \ insomecasesthebasicissuewasliteracyandreportedthatrespondentstrategiesincluded H waitingforanenumeratororneighbortohelpthemcompletetheformcorrectlyB  d(6,pages1920,R21)dC  . 4 IndependentAnalysisofMailResponseandMailReturnRates  \ AccordingtoEvaluationH.8,OperationalAnalysisofEnumerationinPuertoRico,themail 4 responserateinPuertoRicoasofApril18,2000(NonresponseFollowup[NRFU]cutdate)was   48.4percentB  d(17,page9,R15)dC  andthemailreturnratewas55.0percentB  d(17,page9,R8)dC  .CostmodelassumptionsforthePuerto   RicoNRFUoperationassumeda50percentresponserateB  d(47, D! page1,R1)dC  .Weusedthisratebasedonthefact  thatPuertoRicohouseholdshadnopriorexperiencewithmailbackcensusesorsurveys.(Atthat  timePuertoRicowasnotincludedinsomeofthelargerU.S.surveysconductedbytheCensus  Bureau,suchastheAmericanCommunity,thatrequirerespondentstomailbacka l questionnaire.)Statesiderespondentshavebeenrespondingbymailsince1970.Wewould X  expecttheresponserateinPuertoRicotoincreaseinthe2010Census,giventhemailback D! experienceinCensus2000,andaclearmediamessagein2010tocontinuemailingbackthe 0"  questionnaires.  #l! BeCountedforms(BCFs)wereanotherwayrespondentscouldanswerthecensus.Past $D # experiencehasshownthatthemostusedlanguageinPuertoRicoisSpanish,followedby %0!$ English.ThustheBCFsanddisplayboxesinPuertoRicowereavailableinbothSpanishand &"% English.AJune28,2000checkinrecordofPuertoRicoBCFsshowsthattherewere13,300 '#& Spanishand1,069EnglishBCFscheckedintotheDataCaptureCenterinJeffersonville,IN.B  d(48,  page1,R1)dC   (#' InanefforttocountwhatwasthoughttobeanemergingHaitianimmigrantpopulation,Haitian |*%) CreoleLanguageAssistanceGuideswereavailableforPuertoRicoaswellasaBeCounted h+&* displayboxwithHaitianCreolestickersB  d(49,page1,R1)(50,page1,R1)(51,page2,R1)dC  .ResultsfromCensus2000showthat328residents  claimedHaitiastheirplaceofbirthB  d(52,page $ t 2,R1)dC  .However,wehavenodataontheuseoftheHaitianCreole  languageassistanceguidesinPuertoRico.  Theinternetwasanotherresponseoption.InPuertoRico,thisoptionwasavailableinEnglishto ` shortformmailbackhouseholdrespondentswithanIDnumberfromthedeliveredU/L L  questionnaire.InPuertoRico,only107respondentschosetheInternetasaresponseoptionB  d(35,   page1,R1)dC  .If 8  theInternetresponseoptionisexpandedtoincludeSpanish,wewouldexpectthatthenumberof $ t InternetrespondentsinPuertoRicotoincreasefor2010.Webasethisrecommendationonthe  ` increaseinthenumberofInternetusersandservicesavailabletotheminSpanish.  L  ADecember2002studyconductedinPuertoRicobyResearch&Researchincollaborationwith $  NoboxMarketingGroupforthePuertoRicochapteroftheInternetSociety,pointsto970,000   Internetusers.Thisisupfromanestimated551,000Internetusersin2000./  #  4      ׀Inaddition,several   ofthemostpopularInternetServiceProviders(ISPs)likeAOLandATT,aswellaslocalISPs,   provideservicetotheislandandhaveSpanishspeakingsupport.   TherearemanywebsitesinSpanish,includingmanyofthepopularstatesidewebsitessuchas \ YahooandAmazon,whichhavemirrorpagesinSpanish.Onislandtherearemanywebsites, H suchastheElNuevoDanewspaper,whichprovidecontentsolelyinSpanish.Newerversions 4 ofwebbrowserssuchasInternetExplorerandNetscapeNavigatorcanbesetupinSpanishto  p viewallbrowserbuttonsandmenusinSpanish.  \ Somepotentialrespondentschosenottocompleteaquestionnaire.Manyofthereasonsare 4 familiarcompetingdemandsfortime,thequestionnaireistoolong,thequestionsareoffensive   Єandareapplicableacrosscultures.AsvoicedbythefocusgroupparticipantsinEvaluationA.8,   theredoesappeartobeatleastsomeculturalpreferenceinPuertoRicoforthemorepersonal  approachthatList/Enumerateofferedandfocusgroupparticipantswerewillingtowaitforthe  NRFUenumeratortocomearoundtocompletetheinterview.Whetherthiswouldbetruefora  largersegmentofthepopulationisunclear. l 4.30  CompletenessandQualityofDataD!(#(# Theresearchquestionsposedare:HowcompletearecensusdataforPuertoRicoandWhatis #l! theirqualityasmeasuredbyitemnonresponseandrateofproxyresponses?Twoofthethree $X" evaluationsinthiscategorylookatPuertoRicoresponsestotheHispanicoriginandrace $D # questions:B.12PuertoRicoCensus2000ResponsestotheRaceandEthnicityQuestionsand %0!$ B.13PuertoRicoFocusGroupsontheCensus2000RaceandEthnicityQuestions.Sincethe &"% CensusBureauhasneveraskedtheHispanicoriginquestioninPuertoRico,andracewaslast '#& collectedinthe1950censusB  d(22,page1,R1)dC  ,therehasbeenconsiderableinterestinanalyzingtheresultsofthese (#' questions. )$( ЇOneevaluation,B.1.bAnalysisofItemNonresponseRatesforthe100PercentHousingand  PopulationItemsfromCensus2000,looksatoverallitemnonresponse.  Pastresearch,citedbytheB.12andB.13authors,suggestthatrespondentsofHispanicorigin t tendnottodifferentiatebetweenraceandHispanicoriginB  d(8,page1,R1)(9,page2,R1)dC  .Thisideaismorefullyexploredwith ` theEvaluationB.13focusgroupparticipantswhocorroboratethefindingsfromthisearlier L  research.Resultsfromthefocusgroupsevaluationdiscusshowparticipantsfeltthattheexisting 8  racecategoriesdidnotmatchtheirPuertoRicanidentityB  d(9,page p 12,R2)dC  .Focusgroupparticipantsdiscussed $ t whetherracewasmeasuredbycolor,features,origin,etc.andthatmembersofthesamefamily  ` couldbeclassifieddifferently,dependingonhowracewasdefinedB  d(9,page14,R3)dC  .  L  TheB.13evaluationauthorreportsthatpastresearchhasalsofoundthatHispanicsmayfeel $  pressuretousethe Whitecategoryeventhoughtheydonotconsiderthisresponseaccuratenor   feeltheywouldbeconsidered WhiteintheircountryoforiginB  d(9,page3,R5)dC  .Findingsfromtheresponse   tallyandthefocusgroupparticipantsgivefurthercredencetothistheoryB  d(8,page6,   R2)(9,page16,R4)dC  .   WhileEvaluationB.13indicatestherewascontroversyovertheHispanicoriginandrace p questionsinPuertoRicoB  d(9,page11,R6)dC  ,EvaluationB.12demonstratesthatPuertoRicorespondentsofHispanic \ originseemedtohavelesstroublewiththequestionsthantheirstatesidecounterpartsofHispanic H origin,asmeasuredbyloweritemnonresponseratesB  d(8,page12,R3)(8, X  page13,R4)dC  . 4 B.1.b.0  AnalysisofItemNonresponseRatesforthe100PercentHousingandPopulationItems  \ fromCensus2000H(#(# ItemnonresponseoccurswhennoanswerisprovidedtoanitemonthequestionnaireB  d(7,pageiv, %0!$ R1)dC  .   ExaminingitemnonresponseprovidesinformationaboutdataqualityB  C  .Theitemnonresponse   evaluationuniverseisthehousingunitpopulationB  d(7,pageiv,R2)dC  .  WhiletheanalysisinthisreportdoesnotincludePuertoRico,statisticsforPuertoRicoare  providedinAppendixGB  d(7,page5,R3)dC  .Welookedatsomeofthemajorstatesidefindingstoseeiftheyheld l trueforPuertoRico. X   (AxxIntheU.S.,itemnonresponsefortheCensus2000100percentitemsrangedfrom1.13percent 0"  forthesexitemto4.14percentforthetenureitemB  d(7,pageiv,R4)dC  .InPuertoRico,theoverallitemnonresponse #l! ratefortheCensus2000100percentitemsrangedfrom1.01percentfortheHispanicoriginitem $X" to6.15percentforthetenureitemB  d(7,page33,R5)(7,page33,R6)dC  .ThelownonresponseratetotheHispanicoriginquestionis $D # notsurprisinggiventhatPuertoRicanwasacheckboxchoice. %0!$ IntheU.S.,itemnonresponsewasgenerallyhigherforenumeratorreturnsthanforselfresponse '#& andhigherforlongformsthanshortforms.Forbothshortandlongforms,itemnonresponsefor (#' allquestionsexceptHispanicoriginwashigherforenumeratorreturns.Thetenureandageitems )$( hadthelargestabsolutedifferencesinitemnonresponseratesbetweenresponsemodes.The |*%) absolutedifferenceswere6.22and6.91percentagepoints,respectivelyB  d(7,pageivv,R7)dC  .InPuertoRico,item h+&* nonresponsewasgenerallyhigherforenumeratorreturnsthanforselfresponseandhigherfor  longformsthanshortformsB  d(7,page34,R8)(7,page33,R9)dC  .Forbothshortandlongforms,itemnonresponseforallquestions  exceptracewashigherforenumeratorreturnsB  d(7,   page34,R10)dC  .Theraceandtenureitemshadthelargest  absolutedifferencesinitemnonresponseratesbetweenresponsemodes.Theabsolute t differenceswere3.56and3.15percentagepoints,respectivelyB  d(7,page34,R11)(7,page34,R12)dC  . ` ItisnotsurprisingthattheHispanicorigin(stateside)andrace(PuertoRico)swappedplaces, 8  withregardstotheoneitemwheretheenumeratornonresponseratewaslowerthanself $ t response.PuertoRicanwasanobviouschoiceforPuertoRico,butPuertoRicansarenot  ` accustomedtobeingaskedtheirraceonofficialPuertoRicogovernmentdocuments(see  L  subsequentdiscussionsofEvaluationsB.12andB.13).Enumeratorsweretrainedonthe  8  differencesbetweenraceandHispanicoriginB  d(53,page611,R1)dC  . $  IntheU.S.,tenurehadarelativelyhigheroverallnonresponseratecomparedtootheritems.   Specifically,longformtenurenonresponseratesarehigherperhapsduetotheplacementof   tenureafteralllongformitemsforPerson1B  d(7,pagev,R13)dC  .InPuertoRico,tenurehadarelativelyhigher   overallnonresponserate(6.15percent)comparedtootheritemsB  d(7,page33,R6)dC  .InPuertoRico,thetenure p nonresponseratefortheshortformwas5.35percentand10.26percentforthelongformtenureB  d(7,page33,R14)(7,page33,R15)dC  . \ AsintheU.S.,theplacementofthetenurequestionafterallofthePerson1population H characteristicsmaybethereasonforthis. 4 IntheU.S.,agehaddifferentiallyhighernonresponseforenumerators;whichmaybeduetothe  \ useofproxyinpersonalinterviewsB  d(7,pagev,R16)dC  .InPuertoRico,tenurehaddifferentiallyhighernonresponse H forenumeratorsB  d(7,page34,R8)dC  . 4 IntheU.S.,fortheHispanicoriginitem,nonresponsewashigherforselfresponse.Thelowest   nonresponseforHispanicoriginisassociatedwithenumeratorshortforms.Itappearsthatself  respondentsdonotunderstandthedifferencebetweenraceandHispanicorigin,sotheyanswer  theracequestionandleaveHispanicoriginquestionblankB  d(7,pagev,R17)dC  .InPuertoRico,fortheraceitem,  nonresponsewashigherforselfresponseB  d(7,page34,R18)dC  .Thelowestnonresponseforraceisassociatedwith l enumeratorshortformsB  d(7,page36,R19)dC  .ItappearsthatselfrespondentsinPuertoRicodonotunderstandthe X  differencebetweenraceandHispanicorigin,sotheyanswertheHispanicoriginquestionand D! leavetheracequestionblank. 0"  B.120  PuertoRicoCensus2000ResponsestotheRaceandEthnicityQuestions$X"(#(# EvaluationB.12forPuertoRicolooksattheHispanicoriginandraceresponses,itemnon %0!$ responseratesfortheHispanicoriginandracequestions,andanydifferencesinHispanicorigin &"% andraceresponsesbyresponsemode(respondentorenumeratorsupplied).Manyresultsare '#& comparedwiththoseofrespondentsofHispanicorigininthe50statesandDC. (#' Hispanicoriginresponses.TheanalysisshowsthattheresidentsofPuertoRicoidentified |*%) themselvesasoverwhelminglyofHispanicorigin(98.8percent)B  d(8,page3,R5)dC  .About95.1percentofthe h+&* OY    populationidentifiedthemselvesasofPuertoRicanorigin;1.5percentasofDominicanorigin  andlessthan1.0percentasofeitherCubanorMexicanoriginB  d(8,page3,R6)dC  .Ofthesegroups,onlyDominican  requiredawriteinresponseastherewasnocheckboxforDominican.  Raceresponses.Theanalysisshowsthatmorethan95percentofpeoplewhoidentified ` themselvesasofHispanicorigininPuertoRicoalsoidentifiedthemselvesasofoneraceB  d(8,page 4 6,R7)dC  .The L  greatmajorityofthosewhoidentifiedthemselvesasHispanicalsoreportedthemselvesasWhite 8  alone(80.7percent),while7.9percentidentifiedthemselvesasBlackorAfricanAmerican $ t alone,andjustunder7percentreportedthemselvesasofSomeOtherRacealoneB  d(8,page6,R2)dC  .Thisdiffers  ` fromstatesideHispanicswhereonly47.9percentidentifythemselvesasWhitealone,2.0percent  L  asBlackorAfricanAmericanalone,and42.2percentidentifythemselvesasSomeOtherRace  8  aloneB  d(8,page7,R8)dC  . $  Morethan90percentofthePuertoRicorespondentswhoidentifiedthemselvesasofHispanic   originusedtheracecheckboxes,while9.2percentprovidedwriteinresponsesB  d(8,page11,R9)dC  .Ofthewritein   responses,82.8percentwereinthespaceprovidedtospecifytheSomeOtherRaceresponseB  d(8,page11,R10)dC  .   AlmosttwothirdsoftheseresponsesprovidedHispanicoriginidentificationsandnottheirrace, p whileslightlylessthanonethirdprovidedacolorresponsesuchas morenoor brownB  d(8,page11,R11)dC  . \ ItemnonresponseforHispanicorigin.Itemnonresponse,includinginvalidresponse,canbean 4 indicatorofhowwellaquestionhasbeenreceivedandhandledbytherespondent.Thiscanbe  p measuredbythenumberofresponsesthatneedtobegeneratedbytheeditandallocationprocess  \ duringCensusprocessingB  d(8,page12,R13)dC  . H ThepercentofresponsestotheHispanicoriginquestionresultingfromtheeditandallocationby   Hispanicoriginwas4.6percentinPuertoRicoascomparedtothestatesiderateof9.2percentB  d(8, )$( page12,R3)dC  .   Itemnonresponseforrace.Theauthorlooksatthepercentofresponsestotheracequestionthat  weretheresultoftheeditandallocationprocess,byHispanicorigin,andfindsthatonly6.2  percentofthePuertoRicoresponsesbythoseofHispanicoriginwereeditedandallocated,while l 18.2percentofthestatesideresponseswereeditedandallocatedB  d(8,page13,R4)dC  . X  Differencesbetweenrespondentandenumeratorcompletedquestionnaires.Theauthorexplains 0"  thatanotherindicatorofhowwellaquestionisreceivedandansweredbyrespondentsisifthere #l! aredifferencesinresponsesfromquestionnairesfilledoutbyrespondentsascomparedwith $X" enumeratorcompletedquestionnairesB  d(8,page13,R14)dC  . $D # TheresponsetotheHispanicoriginquestionshowsverylittledifferencebetweenrespondent &"% completedandenumeratorcompletedquestionnairesB  d(8,page14,R15)dC  .Morevariationisshownfortherace '#& question.Duringenumeratorconductedinterviews,thoseofHispanicorigintendedtogivea (#' WhitealoneorBlackorAfricanAmericanaloneresponselessfrequently,whilegivingaSome )$( OtherRacealoneorTwoorMoreRacesresponsemorefrequentlyB  d(8,page14,R16)dC  . |*%)  h+&* B.130  PuertoRicoFocusGroupsontheCensus2000RaceandEthnicityQuestions(#(# Theauthordrawsherconclusionsfrom86participantsatfocusgroupdiscussionsthatwere  conductedin12sitesacrosstheIslandB  d(9,pageiv,R7)dC  .The12sitesrepresentedbothurbanandruralareas t (Arecibo,Isabela,Rinc;n,Mayagez,Lares,Yauco,Ponce,Cidra,Bayam;n,SanJuan,Ro ` GrandeandYabucoa)B  d(9,page7,R8)(9,AppendixA,R9)dC  . L  AsacontextforthediscussiononHispanicoriginandraceinPuertoRico,theauthormakestwo $ t importantobservations:  ` "3"  3r#2A3  0    PuertoRicansarenotaccustomedtobeingaskedfortheirraceinofficialPuertoRico  8  governmentdocumentsB  d(9,page30,R10)dC  .3r##݌$ (#(# Ќ  "3"  3$2A3  0    Issuesofrace,nationality,andidentityarepoliticallychargedB  d(9,page30,R11)dC  .3$%݌ (#(# Ќ  Hispanicorigin.SincePuertoRicanwasoneofthecheckboxoptions,mostparticipantshadno   difficultywiththisquestionanditwasnotsubjecttothesamescrutinyastheracequestionB  d(9, D! page23,R12)dC  .   Somefocusgroupparticipantsdidreportthatthephrase Spanish/Hispanic/Latinooriginwas p confusingormoreappropriatetoaU.S.contextB  d(9,page #l! 24,R13)(9,page25,R14)dC  . \ Race.HavingansweredtheHispanicoriginquestion,manyfocusgroupparticipantsthoughtthe 4 racequestion,whichfollowedtheHispanicoriginquestion,wasredundantB  d(9,pagev,R15)dC  .Theydidnotsee  p themselvesaccuratelyrepresentedintheracequestionanswercategoriesandtheywouldhave  \ preferredtoseethe PuertoRicancategoryasapreprintedcategoryontheracequestionB  d(9,pageiv,R16)dC  . H Focusgroupparticipantsrepeatedlyobservedthattheracequestionwasinappropriatetothe   PuertoRicocontextandinherentlydivisiveB  d(9,pageiv,R17)dC  .Thisvariedsurprisinglylittlebyplaceorsocial   classB  d(9,page11,R18)dC  .TheparticipantspointedoutthatinschooltheylearnthatthePuertoRican raceisa  distinctivemixtureofSpanish,Indian,andAfricanB  d(9,page14,R19)dC  .This,plusthefactthatraceisnotrequested  onofficialPuertoRicogovernmentdocuments,didnotgiveparticipantsalotofexperience  definingraceusingCensusBureaucategories.(AlthoughPuertoRicanswhohavehad l experiencefillingoutotherformsfromtheU.S.governmentmaybefamiliarwithraceand X  ethnicityquestions.)Participantsthereforetendedtothinkofraceintermsofnationalitiesorin D! termsofcolorB  d(9,page13,R20)dC  .Participantsthenreported,however,thattheproblemwithusingcoloror 0"  phenotypiccharacteristicswasthatfamilymemberscouldbedifferentracesB  d(9,page14,R3)dC  .Whilethefocus #l! groupparticipantsreporteddifficultywiththeracequestion,theresultsoftheB.12evaluation $X" showthatonly6.2percentoftheresponsestotheracequestionbyrespondentsofHispanic $D # origininPuertoRicorequirededitandallocationB  d(8,page13,R17)dC  . %0!$ TheB.12evaluationalsoshowsthat80.7percentoftherespondentsinPuertoRicowhoreported '#& HispanicoriginalsoreportedthemselvesintheWhitealonecategoryB  d(8,page6,R2)dC  .Focusgroupparticipants (#' providesomeinsightsastowhythismaybe,including:Whitewasthebestansweramong )$( inappropriatealternativesB  d(9,page16,R24)dC  ,BlackwasonlyforthosewhowerepureBlackB  d(9,page16,R25)dC  ,andthatthereisstilla |*%) stigmatobeingidentifiedasBlackinPuertoRicoB  d(9,page17,R26)dC  . h+&* ЇGiventhatthefocusgroupparticipantsdidnotseetheindividualpreprintedracecategoriesas  applicabletotheirsituation,thequestionremainsastowhytheydidnotcheckmultipleboxesto  indicatetheirmixedheritage.TheB.12evaluationreportsthatonly4.1percentoftheHispanic  originrespondentsinPuertoRicoreportedtwoormoreracesB  d(8,page7,R18)dC  .TheB.13authorobserves: Quite t afewofthefocusgroupparticipantshadnotrealizedtheycouldhavecheckedoffmultipleracial ` categoriesforeachpersonintheirhouseholdB  d(9,page19,R21)dC  .Otherparticipants,whowereawareoftheoption, L  thoughtofthePuertoRicanraceasaunitaryorcontinuousconceptwhichwouldnotbecaptured 8  bycheckingmultipleboxesB  d(9,page19,R22)dC  .Manyfocusgroupparticipantswouldhavepreferredasingle $ t responseoptionthatacknowledgedtheirmixedancestryandsuggested Creole, trigueo,or  `  CaribbeanB  d(9,page20,R23)dC  .  L  IndependentAnalysisofCompletenessandQualityofDatainPuertoRico $  TherehasbeenconsiderableinterestwithinPuertoRicoandtheCensusBureauastohowthe   raceandHispanicoriginquestionswerereceivedbyrespondentsandtheresultingdata.Race   waslastcollectedbyenumeratorsinthe1950CensusofPuertoRico.Hispanicoriginhasnever   beenaskedinPuertoRico.ThesequestionswereaskedinPuertoRicoforCensus2000asthe p resultoftheGovernmentofPuertoRicosrequestforthesamequestionnairecontentasthe \ UnitedStates. H BecausetwoofthethreeevaluationsinthiscategoryfocusexclusivelyontheraceandHispanic  p originquestions,welimitouranalysistothesequestions.  \ AllthreeevaluationssuggestthatinPuertoRicothereismorerespondentdifficultywiththerace 4 questionthantheHispanicoriginquestion.Intuitively,thatseemsreasonablesincePuertoRican   isacheckboxresponsefortheHispanicoriginquestion.AsEvaluationB.1.b.demonstrates,the   raceitemwastheonlyitemwherenonresponsewashigherforselfresponsethanenumerator  returns.Ontheotherhand,EvaluationB.12findsthatforrespondentsofHispanicoriginonly  6.2percentofthePuertoRicoresponsestotheracequestionwereeditedandallocated,while  18.2percentofthestatesideresponsestotheracequestionwereeditedandallocated. l Contextually,astheEvaluationB.13authorpointsout,PuertoRicansarenotaccustomedto D! beingaskedfortheirraceinofficialPuertoRicogovernmentdocumentsandissuesofrace, 0"  nationality,andidentityarepoliticallycharged.Apanelofsocialscientistsandprofessors #l! convenedbytheSanJuanCityMagazinein1995toanalyzethevariationsonracisminPuerto $X" Rico,wouldagreewiththatassertion.ThedirectoroftheInstituteofCaribbeanStudiesatthe $D # UniversityofPuertoRico,AaronGamalielRamos,observed: Totalkaboutraceandracismis %0!$ toagitatethestillwatersofnationalsolidarityB  d(54,page57,R1)dC  .Thisviewcoincideswiththatobservedbythe &"% EvaluationB.13authorthatfocusgroupparticipantssaw PuertoRicanasaunitaryor '#& continuousconceptthatcannotbecapturedbycheckingmultipleracecategories. (#' InadditiontointerestinwhythequestionsonraceandHispanicoriginwerebeingaskedin |*%) PuertoRico,considerableinterestwasgeneratedintheresultingdata.Censusresultsshowed h+&* thatthegreatmajorityofthosewhoidentifiedthemselvesasHispanicinPuertoRicoalso  reportedthemselvesasWhitealone(80.7percent),while7.9percentidentifiedthemselvesas  BlackorAfricanAmericanalone,andjustunder7percentreportedthemselvesasofSomeOther  Racealone.AheadlineinthenewspaperElNuevoDa,datedApril16,2001,read Rechazo t boricuaasuorigennegro(PuertoRicansrejecttheirblackorigins).Personsinterviewedfor ` thearticleindicatedthattheseCensusresultsdonotreflecttheracialrealityofPuertoRicoB  d(55,   page2,R1)(55,page2,R2)dC  . L  AlthoughtheracequestionandresultingdatacausedcontroversywithinPuertoRico,twofacts $ t remain:  `  (Axx"3"  3WI2A3  0    RaceandHispanicoriginappearedonthequestionnaireasadirectresultoftherequest  8  fromtheGovernmentofPuertoRicoforthesamequestionnairecontentasstateside;and3WII݌$ (#(# Ќ  "3"  3J2A3  0    PuertoRicorespondentsofHispanicoriginseemedtohavelesstroublewiththe   questionsthantheirstatesidecounterpartsofHispanicorigin,asmeasuredbyloweritem   nonresponserates.3JJ݌ (#(# Ќ  0   `   (#(# 4.40  FieldDataCollection\(#(# Theresearchquestionposedis:Howwelldidweperformthefielddatacollectionactivities? 4 TopicsreviewedwerefieldverificationforNonIDhousingunits,nonresponsefollowup  p (NRFU),anoperationalanalysisofPuertoRicoenumeration,astatisticalprofileofLocalCensus  \ Offices,andthedateofreferenceusedbyrespondentswhenreportingageanddateofbirth. H Threeofthefielddatacollectionevaluations(fieldverification,NRFU,anddateofreference)   presentPuertoRicodataincombinationwithU.S.data.Twoofthesethreeevaluations(field   verificationanddateofreference)eachprovideonetablewithPuertoRicospecificinformation.  Thethirdevaluation(NRFU)providessixtableswithPuertoRicospecificdata.  EvaluationH.9,LocalCensusOfficeProfileforCensus2000,provideshundredsofPuertoRico l specifictables.EvaluationH.8,OperationalAnalysisofEnumerationofPuertoRico,primarily X  focusesontheupdate/leave(U/L)operation. D! H.20  AssessmentofFieldVerification#l!(#(# ThisevaluationfocusesontheBeCounted/TelephoneQuestionnaireAssistanceField $D # Verificationoperation.Duringthisoperation,enumeratorsvisitedthelocationofunitswithout %0!$ anassignedCensusidentificationnumbertoverifytheirexistencebeforetheywereincludedin &"% Census2000B  d(15,page1,R1)dC  .PuertoRicoisincludedintheoverallanalysis,withonetableprovidingPuerto '#& Ricospecificdata.Thetableshowsthattherewere690assignmentareas(AAs)inPuertoRico (#' withfieldverificationcases.(ForCensus2000,PuertoRicohad6,225AAs.)B  d(59,page1,R1)dC  ԀThese690AAs )$( represent0.16percentofthetotalnumberofAAswithintheU.S.andPuertoRicothathadfield |*%) verificationcasesB  d(15,page9,R2)dC  . h+&* ЇH.50  NonresponseFollowupforCensus2000(#(# TheobjectiveoftheNRFUoperationwastoobtainacompletedquestionnairefromall  householdsinmailbackareasthatdidnotrespondbymail,throughtheInternetorviaa t TelephoneQuestionnaireAssistanceoperatorB  d(16,pagev,R1)dC  .SinceallofPuertoRicowasenumeratedbyL/E ` in1990,NRFUwasanewoperationforPuertoRicoinCensus2000.Fromthepointofviewof L  theBostonRegionalCensusCenter(RCC),NRFUinPuertoRicowasverysuccessfulandall 8  NRFUoperationsattheLocalCensusOffices(LCOs)werefinishedaheadofschedule. $ t Inthisevaluation,PuertoRicostatisticsarecombinedwiththoseoftheU.S.dB  ԍ(16,page8,R2)C  dPuertoRico  L  specificdata,however,areavailablefromsixtablesintheappendiceswhichprovidestatelevel  8  dataB  d(16,page44,R3)(16,page47,R4)(16,page55,R5)(16,page62,R6)(16,page81, $X" R7)(16,page85,R8)dC  .ThedataintheappendicesshowthatwhilePuertoRicohad1,357,301housingunits $  potentiallyeligibleforfollowup,theNRFUworkloaduniverseinPuertoRicowas699,540   housingunitsB  d(16,page46,R11)dC  .      `     h      p      x  ThefollowingNRFUoperationalchallengesinU/Lareas,notedbytheauthor,alsooccurredin   PuertoRico:surnameintheincorrectfieldonthelistingpageB  d(16,page4,R12)dC  ,addressregistersstartedwiththe p addressofthefirstnonrespondinghousingunitoneachblockB  d(16,page4,R13)dC  ,andU/Laddswerenotprocessed \ intimetoupdatetheNRFUregistersB  d(16,page5,R14)dC  .BecausetheU/Laddswerenotkeyedintime,enumerators H mayhaveaddedthemissingunitsagainduringtheNRFUoperationandthusinflatedthe 4 percentageofaddedaddresses.InPuertoRico,NRFUwasresponsibleforadding28,793  p addressesB  d(16,page86,R9)dC  Ԁanddeleting78,680addressesB  d(16,page86,R10)dC  .  \ H.80  OperationalAnalysisofEnumerationofPuertoRico4(#(# Theauthorlooksatthewaytheaddresslistwascompiled,characteristicsoftheU/Loperation   andoperationalproblemswhichoccurredintheNRFUandCoverageImprovementFollowup  (CIFU)operations.AnanalysisofthedebriefingquestionnairescompletedbytheAssistant  ManagerforFieldOperations(AMFO)foundthreemainproblemareas:latearrivaloftraining  materials,maps,andmerginglongformandshortformquestionnairesintheLocalCensus l Offices(LCOs)B  d(17,pageiv,R1)dC  . X  TrainingmaterialsforPuertoRicofieldoperationswereadaptedforaddressingconventionsand 0"  geographicandquestionnairedifferences.Inaddition,allmaterialsforenumerators,crewleaders #l! andfieldoperationssupervisorsweretobetranslatedintoSpanish.WhilematerialsforPuerto $X" Ricowereadaptedandtranslatedonaflowbasis,theycouldnotbefinalizeduntilthestateside $D # materialswerecompleted.ThismeantthatPuertoRicomaterialswerealwaysavailableafter %0!$ statesidematerialswereavailable.Occasionally,therewasnotenoughtimeinthescheduleto &"% allowforthetranslationoffieldoperationssupervisormaterials.Anyproblemswithassembling '#& andshippingmaterialsexacerbatedanalreadytightschedule. (#' TheAMFOsfeltthatnumerousmapupdateswererequired,especiallyinruralareasB  d(17,pageiv, 4 R2)dC  .WhileU/L |*%) isprimarilyaruralprocedureintheU.S.,inPuertoRicoitwasusedislandwide.Becauseof h+&* scaleissues,mapspottinginurbanareaswasdifficult.Furthermore,theprocessofpassingon  mapupdatestosubsequentfieldoperationswasconsideredproblematic.  TheLCOspreparedtheU/Lenumeratorassignments.Oneofthedifficulttasks,reportedinthe t AMFOdebriefingquestionnaires,wasmergingthelongformandshortformquestionnairesso ` thattheyappearedintheorderfoundontheU/LlistingpagesB  d(17,pageiv,R3)dC  . L  Therewere1,471,225addressesinPuertoRico,includingaddressesfromtheaddresslisting $ t operationandaddsfromtheU/Loperation,U/Laddsaccountedfor7.6percentofthePuerto  ` Ricoworkload.Ofthe111,787U/LaddsinPuertoRico,83.7percent(93,607)wereincludedin  L  thefinalcountsB  d(17,page1,R4)dC  .  8  Deletesaccountedforalmost8.4percentofthePuertoRicoU/Lworkload(ascomparedto5.2   percentofthestatesideworkload)B  d(17,page1,R5)dC  .SomeofPuertoRicoshigherdeleteratemayhavebeendue   toachangeinPuertoRicosaddresslistingprocedureswhichallowedfortheinclusionofvacant   damagedlivingquartersintheaddresslistingregisters.Thischangewasmadetotakeinto   accounttheeffectsofHurricaneGeorges,whichoccurredinlateSeptember1998,justbefore p addresslistingwastobegin.AtthattimeitwasestimatedthatHurricaneGeorgeshaddamaged \ ordemolishedover100,000housingunitsinPuertoRico.Addresslistingprocedureswere H modifiedinanticipationthatmanyofthesedamagedunitswouldberepairedorreconstructedon 4 thesamesiteinupcomingmonths.#  #  5        p Correctionsaccountedfor38.45percentofthestatesideU/Lworkloadand51.06percentofthe H PuertoRicoworkloadB  d(17,page7,R6)dC  .PuertoRicoshighercorrectionrateisnotsurprisinggiventheaddress 4 listingprocessingerrorandthedecisionnottokeyLUCAfieldverificationcorrections.   TheAMFOsreportedthattheNRFUworkloadforPuertoRicowaslargerthanitneededtobe.  NotallofthePuertoRicoquestionnairessentinwereprocessedbeforetheNRFUcutdateB  d(17,  8  page10,R11)dC  .The  mapsalsowerecitedbytheAMFOsasNRFUandCIFUproblems.Therewereproblemswith  crowdedmapspotsB  d(17,page10,R12)dC  ԀandU/LmapupdatesnotbeingpassedontotheNRFUandCIFUoperationsB  d(17,page10,R13)dC  . l TheAMFOsdidreportsuccessinretainingqualifiedstafffromearlieroperationstoworkon X  NRFUandCIFUB  d(17,page10R14)dC  . D! H.90  LocalCensusOfficeProfileforCensus2000#l!(#(# Thisprofilecovers16generaltopics,includingcountsbyhousingunittypes,householder $D # demographics,responseratesandworkloadsforvariousfieldoperationsB  d(18,page2,R1)dC  .Inall,thereareover %0!$ 1400statisticsproducedforeachoftheLCOsintheU.S.andPuertoRicoB  d(18,page  p 2,R2)dC  .Whenshowingthe &"% totalsforthevariousstatistics,thetablesgivetheU.S.totalswithandwithoutPuertoRicoB  d(18,page11,R3)dC  . '#& ЇH.100  DateofReferenceforAgeandBirthDateusedbyRespondentsofCensus2000(#(# ThisevaluationanalyzeshowwellrespondentsusedCensusDayastheirdateofreferencewhen  answeringtheageanddateofbirthquestions.ForCensus2000,theaveragedateofreference t wasApril20,2000B  d(19,pageiii,R1)dC  . ` AppendixD,StateReturnRatesasofDecember31,2000andStateDateofReference,shows 8  thatPuertoRicosdateofreferencewasMay3,2000anditsreturnrateasofDecember31,2000 $ t was63.9percentB  d(19,page18,R2)dC  .Theauthorexplainsthatastatesreturnrateseemstobecorrelatedwiththe  ` dateofreferenceforthatstate.Astherateincreases,thedateofreferenceforthestateiscloser  L  toApril1,2000B  d(19,pageiii,R3)dC  .SincePuertoRicosreturnratewaslessthanthatofanyU.S.stateB  d(19,page18,R2)dC  ,itisnot  8  surprisingthatitistheonlystate(equivalent)withareferencedateinMay. $  IndependentAnalysisofFieldDataCollectionActivities   ThestateoftheaddresslistandmailresponserateforPuertoRicoarethetwooverarchingissues   affectingtheevaluationsinthiscategory.FieldVerification(FV),Update/Leave(U/L)and p NonresponseFollowup(NRFU)weretheoperationsmostaffectedbythedifferentaddressing \ conventionsusedinPuertoRicoand/ortheconditionoftheaddresslistattheirrespectivestages. H PuertoRicoslowerreturnrateappearstobeassociatedwithaMaydateofreferencefor 4 respondents(EvaluationH.10)andaffectedNRFUworkloads.  p TheworkloadforPuertoRicofornonMAFIDprocessingwas40,330addressesB  d(56,page28, $ t R1)dC  .TheFV H workloadconsistedofthosenonMAFIDquestionnairesthatcouldnotbematchedtothe 4 existingaddresslists.BecausetheexistingGEOmatchingandgeocodingsoftwarecouldnot   processtheuniqueaddressingconventionsfoundinPuertoRico,GEOenteredintoacontract   withSeekDatatomatchandgeocodenonMAFIDquestionnairesfromPuertoRico.  ThisoperationmarkedthebeginningofanongoingrelationshipwithSeekDatatocleanupand  standardizeaddresscomponentsforthePuertoRicoMAFB  d(57,page1,R1)dC  .  TheU/LandNRFUoperationsinPuertoRicofollowedthestatesidescheduleandthesamebasic X  enumerationprocedures.ThusstatesidesuccessesandchallengesalsoaffectedPuertoRico.The D! inclusionofPuertoRicointheautomatedCostandProgressreports,aswellastheLCOstatistics 0"  reportedinEvaluationH.9,areexamplesofsuccesses.Statesideoperationalchallengesaffecting #l! PuertoRicoareevidentinsomeofthesameNRFUlistingpageerrors. $X" UniquetoPuertoRicowastheuseofabasicallyruralproceduretoenumeratetheentireIsland. %0!$ In1990,PuertoRicoincludedfourMetropolitanStatisticalAreasandoneConsolidated &"% MetropolitanStatisticalAreaB  d(58,page1,R1)dC  .Usingaruralprocedureinthisenvironmentcreatesitsownsetof '#& problemsmostnotablymapspotting. (#' ThestateofthePuertoRicoMAF,afterallcensusdatacollectionoperationswerecompleted,is |*%) thereasonDMDhasfundedGEOscontractwithSeekDatatocleanuptheexistingMAF.Seek h+&* DataiscurrentlyworkingwithGEOtodevelopanewdatamodelforPuertoRicoMAF  addressesthatwillbetterenabletheCensusBureautoimplementautomatedaddressprocessing  activities.ThiswillallowustoexploreadditionalenumerationmethodologiesforPuertoRico  forthe2010censusandbettersupportPuertoRicoCommunitySurveyactivities. t 4.50  SpecialPlaces/GroupQuartersL (#(# TheSpecialPlace/GroupQuartersevaluationthatprovidesPuertoRicospecificdataisE.5 $ t GroupQuartersEnumeration.Onetableintheappendicesprovidesdatausingastatebystate  ` breakout.TheAppendixCtableprovidescountsoftheGQpopulationbyGQcategory.Puerto  L  Ricohadatotalof46,774personsinGQs,distributedasfollows:17,283incorrectional  8  institutions;853injuvenileinstitutions;7,311innursinghomes;3,356inhospitals;2174in $  colleges/universities;1,199inmilitaryfacilities;6,419ingrouphomes;and8,179inservice   basedandotherGQsB  d(10,page55,R1)dC  .   IndependentAnalysisofSpecialPlaces/GroupQuartersEnumeration   TheE.5evaluationprovidesPuertoRicospecificdataonthepopulationassociatedwitheach \ typeofgroupquarters.However,PuertoRicoalsoparticipatedinthefollowingoperations: H SpecialPlaceLUCA,SpecialPlaceAdvanceVisits,Military,Maritime,TNight,MobileFood 4 Vans,ServiceBasedEnumeration,Shelter,SoupKitchenandTargetedNonShelteredOutdoor  p Locations.Operationallytheseoperationsfollowedthestatesideproceduresandschedules,thus  \ conclusionsdrawnfromstatesideevaluationscanprobablybeappliedtoPuertoRicoaswell. H (RefertotheSpecialPlace/GroupQuartersEnumerationTopicReportbyFlorenceH. 4 Abramson,issuedSeptember17,2003.)B  d(60,page1,  L  R1)dC     InPuertoRico,thelongandshortformIndividualCensusReports(ICRs)andIndividualCensus  Questionnaires(ICQs)wereavailableinbothSpanishandEnglish.BetweenICRsandICQs,  therewereeightformsforPuertoRico.InadditiontherewerePuertoRicoMilitaryCensus  Reports(MCRs)andShipboardCensusReports(SCRs)availableonlyinEnglish.InPuerto l Rico,theFacilityQuestionnairewasonlyavailableinSpanishandwasapaperversionasthere X  wasnotenoughtimetotranslatethepaperversionintoacomputerassistedtelephoneinterview D! (CATI)instrument. 0"  Numerousformsandthelatearrivaloftrainingmaterialsweretheissuesthatmostaffected $X" PuertoRicoSpecialPlace/GroupQuartersenumeration.Therewasinsufficientleadtimeto $D # adaptandtranslatealloftheSpecialPlace/GroupQuarterstrainingmaterials.Variousimperfect %0!$ solutionsweretried,includingusingstatesidematerialsoronlyadaptedmaterials.Sometimes, &"% whentherewasnotenoughtimetotranslatethematerials,thepositionswerefilledwithbilingual '#& personnelinordertomeettheenumerationschedule. (#'   |*%) $ XX 5.0  EvaluationAuthors#XX $w#$ XXRecommendations (#(# #XX $ܖ#Thefollowinglistofrecommendationsrepresentsasummaryofthoseprovidedbytheauthorsof & theevaluations.Thespecificstudy (ies)and/orassessmentisprovidedinparentheses.  "3"  3=2A3  0    IncludePuertoRicoinanycognitivetestingoreffortstofieldtestdifferentversionsofthe   racequestion.0 (#(#3=j݌  (# (# Ќ  0  ThefindingsfromtheracequestionsuggestthattheresidentsofPuertoRicointerpreted r  thisquestiondifferentlythanthoseofHispanicoriginandeventhoseofPuertoRican ^  origininthe50statesandDC.Consequently,itwillbeimportanttoincludePuertoRico J   infuturecensustests.(B.12,B.13)6 (#(# "3"  3(2A3  0    InvestigatefurthertheuseoftheSomeOtherRaceCategory.3(U݌^ (#(# Ќ  0  InvestigatefurthertheuseoftheSomeOtherRacecategoryoftheracequestiontoassure J  thattherangeofresponsesexcludesthosethatbetterfittheHispanicoriginquestion. 6  (B.12)"(#(# 0  TheCensusBureaualsoisconductingresearchoneliminatingtheSomeOtherRace  categoryfromtheracequestion.(#(# "3"  3ߝ2A3  0    Improvethecensusmessage.3ߝ ݌n(#(# Ќ  0  ProvidemoreextensivepubliceducationtothePuertoRicanpopulationonthelarger Z missionofthecensus,therationaleforaskingquestionsaboutraceandethnicity,andthe F intendedusesofthedata.(B.13)2(#(# 0  DevelopadvertisingappealsforcensusparticipationmoreattunedtothePuertoRican  Z population.(A.8)F(#(# "3"  32A3  0    Conductasurveyonrespondentsviewsondatacollection,censusmaterials,and  questions.3݌ (#(# Ќ  0  ConsiderusingtheresultsoftheB.13study,alongwiththeresultsoftheA.8study,to   createasurveytobeadministeredtoaprobabilitysampleofresidentsontheIsland.The ! surveycouldseektherespondentsviewsofdifferentapproachestodatacollectionand ~"  theirreactionstoanynewmaterialsdeveloped,includinganyallowablechangesmadeto j#! thestructureandcontentofthequestionsonraceandHispanicorigin.(A.8,B.13) V$"(#(# "3"  32A3  0    PromotetheuseoftheInternetform.3%݌.&~!$(#(# Ќ  0  WhilenotspecifictoPuertoRico,considerhowtopromulgatetheInternetformasan 'j"% optionandconvincethepublicthatthereissufficientdatasecurity.(A.2.b)ForPuerto (V#& Rico,provideaSpanishInternetresponseoptionin2010torespondtotheincreasing (B$' numbersofInternetusersontheisland.).%((#(#  +'* "3"  32A3  0    CreateanewPuertoRicoaddresslist3݌(#(# Ќ  0  Atthepointofquestionnairedelivery,theinitialerrorsintheaddresslistforPuertoRico  havebeencompoundedfromtheeffectsofseveraloperations.Itmightbeadvisablefor  futureeffortsinPuertoRicotocreateanewaddresslistratherthandoadependentlisting t startingfromthecurrentlisting.(F.10)`(#(# "3"  3 2A3  0    Considermailout/mailbackfor20103 8݌8 (#(# Ќ  0  BuildontheexperiencefromCensus2000andthePuertoRicoCommunitySurveyand $ t considermailout/mailbackdatacollectionin2010foratleasttheurbanpartsofthe  ` island.(H.8) L (#(# "3 "  32A3  0    Improvecensusmapsandprovidemoremaptraining3݌$ (#(# Ќ  0  Includereferencepointsandchangethescaleofmapstomakethemeasierfor   enumeratorstouse.Providemoreextensivemaptrainingforenumeratorsandlookinto   thefeasibilityofusingGlobalPositioningSystemtechnologytoimprovetheaccuracyof   enumeratormapspotting.Attempttoautomatechangesandcorrectionstocensusmaps   fromearlycensusfieldoperationssothattheycanbeutilizedinsubsequentfield p operations.(H.8)\(#(# "3 "  3'2A3  0    Ensurethatfieldmaterialsarriveontime3'T݌4(#(# Ќ  0  Buildenoughtimeintothestatesidescheduleforfieldmaterialspreparationsothat  p trainingmaterialsforPuertoRicocanbeadaptedandtranslatedandarriveintheLCOs  \ withenoughleadtimefortrainerpreparation.(H.8)H(#(#     $ XX0W2Oa6.0  TopicReportAuthorsRecommendations#XX $\# (#(# The standardize/customizeconflictaffecteddecennialoperationsforPuertoRico.  Standardizationofferscostsavings,easeofprocessing,quickerreleaseofdataproducts,and  comparabilitywithstatesidedata.CustomizationallowsustopreparematerialsinSpanish,offer  questionnairecontentthatcanmeettheIslandsuniquedataneeds,andutilizedifferent t  addressingrequirementsandgeography.PuertoRicocustomizationrequirements,however, `  competeforlimiteddecennialresources,includingstaff,timeandmoney. L  Census2000wasthefirsttimethattheCensusBureauandPuertoRicoreallyexperiencedthe $ t  benefitsofstandardization.Benefitsincludedtimelyreleaseofdataproductswithintheexisting `  statesideschedule,theinclusionofPuertoRicoinU.S.summarystatistics,andAmericanFact L  Finderavailability.Whilesomeevaluationssuggesttheuseofthestatesidequestionnairein 8  PuertoRicohaditsdrawbacks,theuseofthesamequestionnairecontentsimplifiedthe $  processingandtabulationofdata.ThesebenefitswereavailabletotheCensusBureauand   PuertoRicobecausetheGovernmentofPuertoRicorequestedthesamequestionnairecontent.   However,wecannotassumethatPuertoRicowillrequeststatesidequestionnairecontentin  2010.  SomecustomizationforPuertoRico,beyondthescopeofquestionnairecontent,willalwaysbe \ required.TheuseofSpanishisthemostobvious.Inadditiontoquestionnairesandpublicityfor H thegeneralpopulationinPuertoRico,materialsforapredominantlySpanishspeakinglabor 4 forcealsomustbeavailable.  p SeveralevaluationsaddressedtheproblemsthatresultedfromcustomizingaddressesforPuerto H Ricotoincludecondominiumorurbanizationname,andusingtheSpanishinitialsforaddressor 4 locationdescription.ThiscustomizationwasneededtoensuredeliverabilityinPuertoRico,both   byCensus2000enumeratorsandforfutureusebytheUSPSformaildeliveryofthePuertoRico   CommunitySurvey.Astheevaluationssuggest,theCensusBureausstandardsystemsand  processeswerenotsufficientlypreparedtohandlethesecustomizationrequirements.  Thelongtermsolutionfor2010maybetoconsideratotalredesignofthelistingpagetoallow l! theCensusBureautosuccessfullyparsePuertoRicoaddressesintotheircomponentparts(e.g., X"  urbanization,housenumber,direction,streetname,streettype).Parsingwillallowustodevelop D#! theintelligence/capability,overtime,tobuildthevarioussupplementaltablesneededforPuerto 0$" Ricostandardizationlikealternativenametables. %l #  +&* 0W 0e 0  Giventhe standardize/customizechallenges,werecommend:  Improvetheprocessforincludingandinformingallpartieswhencustomizationisrequired   (Axx "3"  3b2A3  0    IncreasetheuseofJointApplicationsDevelopment.3b݌`(#(# Ќ  "3"  3L2A3  0    Includeinhousepersonnelfromallrelevantsubjectmatterandoperationaldivisionsin 8  theplanning,specification,development,andtestingofmaterialsforPuertoRico.3Ly݌$ t(#(# Ќ  "3"  32A3  0    Ensurethatallteammembers,suchassubjectmatterexpertsandprocessingstaffs,stay  L  activelyinvolvedinthecontinuedadaptationofrequirementsandtheresolutionof  8  technicalissuesthroughoutthedevelopmentandimplementationefforts.3݌$ (#(# Ќ  "3"  32A3  0    Scheduledevelopmentactivitiessothatampletimeisallowedfortheadaptationand   translationofmaterialsforPuertoRico.3݌ (#(# Ќ  Standardizewhereappropriate p "3"  32A3  0    StandardizetheprocessforensuringthatPuertoRicocustomizationrequirementsare H includedinallprocessesandsystems.3E݌4(#(# Ќ  "3"  3^2A3  0    Standardizeprocesses,suchasenumerationmethodology,whentheCensusBureau  \ determinestheycanbeappliedtoPuertoRicowithoutaresultinglossindataquality.3^݌H(#(# Ќ  "3"  32A3  0    CollectPuertoRicoaddressesusingaparsedformatdevelopedspecificallyforPuerto   Rico.3݌ (#(# Ќ  "3"  32A3  0    DevelopaPuertoRicoaddressstandardizer.3#݌(#(# Ќ  Supportearlyplanning l "3"  3 2A3  0    ExplorewaystoimprovethemailbackresponserateforPuertoRico.3 7݌D!(#(# Ќ  "3 "  32A3  0    RedesignthePuertoRicoaddresslistingpage.Conductalimitedaddresscollectionfield #l! testinPuertoRicoandoftheaddresslistingprocessingsystemspriorto2010decennial $X" censusimplementation.31݌$D #(#(# Ќ  "3 "  32A3  0    DedicatemoreCensusBureaustaffresourcestoPuertoRicoenumerationissues,sothat &"% internalexpertisecanbedevelopedacrossdivisions.3݌'#&(#(# Ќ  DevelopPuertoRicospecificevaluations )$( "3 "  3I2A3  0    BuildPuertoRicospecificdatarequirementsandanalysisintotheprogramdesignof h+&* futurecensusevaluations.3Iv݌T,'+(#(# 2Oa  2e 2  ь  $ XX7.0  ActionstoDate    h   XX $(#(# PositivefirststepshavebeentakenfollowingCensus2000towardsimprovingthePuertoRico  MasterAddressFile(MAF).TheGeographyDivision(GEO)hashadacontractsince2000with  SeekData,Inc.,aprivatesectorcompanyexperiencedinworkingwithPuertoRicoaddressesand  geography.SeekDataiscurrentlyalteringmanyexistingMAFrecordsbyparsingand t  standardizingtheindividualaddresscomponents,orbyaddingthesecomponentstosomeMAF `  recordswherenoaddresscomponentsexist.SeekDataalsoisworkingwithGEOtodevelopa L  newdatamodelforPuertoRicoMAFaddressesthatwillbetterenabletheCensusBureauto 8  implementautomatedaddressprocessingactivitiesinthefutureB  d(26,page1,R1)dC  .ThisiskeytotheCensus $ t  BureausabilitytomaintainthePuertoRicoMAFthroughautomatedmeans. `  SeekDataalsohasbegunattemptingtoprovidenew,citystylePuertoRicoaddressestothe 8  CensusBureauforpotentialuseinfutureMAFactivities.Aspartofthis,theyareexaminingthe $  utilityoftheUnitedStatesPostalServicefileofaddresses,whichisakeycomponentofMAF   maintenancestateside.Thisprocesshasonlyrecentlybegun,anditistooearlytopredictwhat   resultswillbeachievedB  d(26,page2,R2)dC  .!  #  6        $ XX   8.0  Summary XX $(#(# Thedecisiontomovefromlist/enumeratetoupdate/leaveforCensus2000inPuertoRico  representedthefirststep,inaseriesofstepsthatstillneedtobemade,ofmovingPuertoRicoto  mailout/mailbackinfuturecensuses.Beginningwithaddresslisting,andcontinuingwith  subsequentcensusoperations,anaddresslistwasbuiltforPuertoRico.ThePuertoRicoaddress t  listrequiredcustomizationfordeliverability,includingSpanishandafourthlinefordevelopment `  orcondominiumname.Astheevaluationsindicate,however,theaddresslistwasflawedfrom L  thebeginninganditseffectsoncensusoperationsanddatawerenoted.TheGEOisnow 8  workingwithSeekDatatorepairandenhancethislistforfuturecensusoperationsandthe $ t  PuertoRicoCommunitySurvey(knownastheAmericanCommunitySurveyintheU.S.). `  ThestandardizationofquestionnairecontenthasresultedinthetimelyreleaseofPuertoRico 8  dataproductsandcomparabilitybetweenstatesideandPuertoRicodata.However,astheauthor $  ofthefocusgroupevaluationspointsout,standardizationoftencomeswithapriceas   evidencedbythefocusgrouprespondentscomplaintswiththeHispanicoriginandrace   questions.  Thestandardization/customizationdebateforPuertoRicowillcontinue,withchoicestobemade p forenumerationmethodologies,content,geography,dataproductsandsoon.Standardizingthe \ processforincludingcustomizationrequirementswillhelpusateverystagealongtheway. H $ XX      1WAcknowledgments     XX $Wewishtothankthefollowingindividualsfortheirassistanceandsupportinthereviewofthis & report:  0  LouisaMiller0 (#(#0 (# (#0h(#(#POP h(#h(# 0  MatthewChristenson (#(# 0  JoelSobel    h GEOr (#(#   $ XX References XX $ ^    AmericanFactFinder,SummaryFile3DetailedTablesforPuertoRico,P19.,AgebyLanguage ^  SpokenatHomebyAbilitytoSpeakEnglishforthePopulation5YearsandOver. J  Berkowitz,Dr.Susan,PuertoRicoFocusGroupsonWhyHouseholdsDidNotMailBackthe "r Census2000Questionnaires,Census2000EvaluationA.8,July2001. ^ Berkowitz,Dr.Susan,PuertoRicoFocusGroupsontheCensus2000RaceandEthnicity 6 Questions,Census2000EvaluationB.13,July2001. " Bryant,BettieJ.,PuertoRico2000MemorandaSeries,MemorandumNo.9701,Memorandum  toDistributionList,TransmissionofAddressListingRequirementsOverviewforPuertoRico,  September10,1997.  Burgos,Norma,ChairwomanofthePuertoRicoPlanningBoard,lettertoDr.MarthaFarnsworth Z Riche,Director,BureauoftheCensus,October31,1997. F Carter,Nathan,BeCountedCampaignforCensus2000,Census2000EvaluationA.3,September n 2002.  Z Carter,NathanandSarahBrady,DateofReferenceforAgeandBirthDateusedbyRespondents !2 ofCensus2000,Census2000EvaluationH.10,November2002. "  CensodePoblaci;nyViviendas:1950,PuertoRico,FormaP93. $" Christenson,Matthew,Ph.D,PuertoRicoCensus2000ResponsestotheRaceandEthnicity ~&!$ Questions,Census2000EvaluationB.12,July2003. j'"% ElNuevoDaInteractivo,Rechazoboricuaasuorigennegro,16deabrilde2001. B)$' FarnsworthRiche,Dr.Martha,Director,BureauoftheCensus,lettertoPlannerNormaBurgos, +j&) ChairwomanofthePuertoRicoPlanningBoard,January13,1998. ,V'* ЇHovland,IdabelleB.,MemorandumfortheRecord,KeyingLUCA99FieldVerificationResults  forPuertoRico,August24,1999.  Hovland,IdabelleB.,NotetoDistributionList,PuertoRicoAddressListingPageFinal, t January28,1998. ` Imel,JerryD.,LocalCensusOfficeProfileforCensus2000,FinalDraftReport,Census2000 8  EvaluationH.9,September2003. $ t Jonas,Kimball,GroupQuartersEnumeration,Census2000EvaluationE.5,Revision1,August  L  2003.  8  McNally,Tracy,OperationalAnalysisofEnumerationofPuertoRico,Census2000Evaluation   H.8,May2003.   Merced,HectorX.,EmailcommunicationtoCarlC.Sanders,March30,1999.   Monaghan,Brian,MemorandumforArthurDukakis,InclusionofVacantDamagedLiving \ QuartersinAddressListingRegistersforPuertoRico,October16,1998. H Moul,DarleneA.,NonresponseFollowupforCensus2000,Census2000EvaluationH.5,July  p 2002.  \ Norris,Sherri,AnalysisofItemNonresponseRatesforthe100PercentHousingandPopulation 4 ItemsfromCensus2000,Census2000EvaluationB.1.b.,September2003.   Owens,KarenL.,EvaluationoftheLocalUpdateofCensusAddresses99(LUCA99),Census  2000EvaluationF.6,May2002.  Pennington,RobinA.,EvaluationoftheUpdate/LeaveOperation,Census2000EvaluationF.10, l June2003. X  PuertoRicoandIslandAreasBranch,Internalbranchrecords,PuertoRicoMailBackand 0"  InternetFormsCheckIn,May18,2000. #l! Ruhnke,MeganC.,TheAddressListingOperationandItsImpactontheMasterAddressFile, $D # Census2000EvaluationF.2,January2002. %0!$ SanJuanCityMagazine,SoAreWeRacists?????AConspiracyofSilence:RacisminPuerto '#& Rico,Dec/Jan1996. (#' Sobel,Joel,MemorandumforLourdesFlaim,AddressListingOperationsforPuertoRico, |*%) October25,1996. h+&* 1W$ 1e 1  Sobel,Joel,EmailcommunicationtoIdabelleB.Hovland,May27,1999.  Sobel,Joel,EmailcommunicationtoMr.G.Maldonado,September25,2002. t Tenebaum,Michael,AssessmentofFieldVerification,Census2000EvaluationH.2,July2001. L  Thompson,JohnH.,2000DecennialCensus,DecisionMemorandumNo.6,Recommendation $ t thattheCensusBureauUsetheUpdate/LeaveMethodologyforDataCollectionDuringtheYear  ` 2000CensusofPuertoRico,signedbyRobertW.MarxonAugust12,1996.  L  U.S.CensusBureau,Census2000FinalResponseRates,FinalUpdate,September7,2000. $  U.S.CensusBureau,1990CensusofPopulationandHousing,History,PartD,Chapter13,   PuertoRico,VirginIslands,andthePacificIslandTerritories,March1996.   Whitworth,Erin,InternetDataCollection,Census2000EvaluationA.2.b.,August2002.