WPC<  r 7.> p,MQ -.J. & + sGDa1UG|Eh(nÄP8}<؈` 4CZX[+HU7zۀĺxB'W Qb0? i^"3$:3@dqֺpYMOူ1F scNN5 nƣq)G0|\Ÿ46iV AHc|/8EƄzQ vd!0|WJB~ud=tI":c9U@wm/Fs,)ƿtۛq# ґ]Н>iι i~pB256A ۉ#D6c{x(vzn0=__GMfVLVDMQk_e3}~H#UN %  0: 1I 0U>V 0 U@* 0zj 0U*pUNEU> ( 0=? 0F| 0P 0Z 0dlM 0UN)(+ 0 IS! 72 1UBvU.\%AR(,V.61w-5415E5 BUT5^ q5}5 m5e5 727 72-8_89 1u:UB: 0c: 0w-; 0; 0.< 0< 0= 0I> 0$? 0D@ 1WAAUNA 0UDB AB8CCCQG 0VHH"rHrH 1UHHH 0rK 0KK D+FLFL@>qL.L ALf~MaMobM 0V.?L/"$0$0$0$0@ F0owP0P0P0P0P0P0P0 00 1W1 0G/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2/2@Jv3v3v3o3333?R\\CENSUS\PRED-TR2-2-HP9000-1A.PRED.DECENNIAL.HQ.CENSUSdttddtdt0(Q Z6Times New Roman RegularX($USUS.,(EhCEKQW]cioAutoList21.1.1.1.1.1.1.1.T:Body Text InBody Text In        %\  `&Times New RomanT! :footnote texfootnote tex            (\ Z(Times New Roman 8! ,toc 1toc 1            `:footnote reffootnote reference        -2A`Arial(9 Z 6Times New Roman Regular\  `&Times New Roman($0 ($0 0 (($0 0 0 (2$0 0 0 0 (<$0 0 0 0 0 (-2$ !USUS.,  (!$      !USUS.,  _E1` hp x (#XE                 1   (      &%XX&%%&ԀResearchofthistypewasconductedaspartofthistask.Focusgroupswereheldin12communities  acrosstheIslandwithadiversegroupofparticipantstoexploretheirviewsandperceptionsofQuestion  8(onethnicity)andQuestion9(onrace).#XɂX%&Q##XɂXXXɂp#XɂXXXɂ2i)(5hCEKQW]cioAutoList11.1.1.1.1.1.1.1. LL *Times New RomanTT<6X9`(Courier  !USUS.,  _E1` hp x (#XE               &%XX&%%&  5   (      ݀Inonesite,datacollectorscouldnotlocateafacilityinwhichtoholdthefocusgroup,andtried,  unsuccessfully,toscheduleindividualinterviewswiththefoureligiblepersonstheyhadidentified  throughrecruitment.Inanotherlargelynonresidentialtract,wheretherecruitmentprocessbeganvery ` late,itrapidlybecameclearthatmuchmoretimethanwasavailablewouldberequiredtoidentifythe 8 requisitenumberofpotentialparticipants.Inthethirdsite,wheresevenoftheeightinviteeshadassured ` thedatacollectorstheywerewillingandabletoparticipate,onlytwopeopleshowedupforthefocus 8 groupattheappointedtimeandplace.Inthisverypoorcommunity,wherefewarefamiliarwithsocial   research,theinviteesmaynothavebelievedthestudywasforreal.Whilewaitingfortheotherstoshow,   oneofthetwowomenwhodidcomewasoverheardsayingtohergrandson,"See,Itoldyouthiswasnot p  CandidCamera."Also,althoughinwalkingdistancefromtheirhomes,participantsmaynothavefelt H   thatthelibrarywherethegroupwasscheduledtotakeplacewasahospitablesetting.Whileeveryone  p  waswaiting,thelibrarianmadeseveraldisparagingcommentsabouttheilliteracyand"ignorance"ofthe  H  peoplefromtheneighborhood,twoofwhomweretheretohearit.#XɂX%&##XɂXXXɂ#XɂXXXɂ R !USUS.,  _E1` hp x (#XE               &%XX&%%&  6   (      ݀NoSpanishquestionnairesweremailedout.However,someparticipantsthoughttheyhadbeen.#XɂX%&##XɂXXXɂ#XɂXXXɂ 7 !USUS.,  _E1` hp x (#XE               &%XX&%%&  7   (      ݀Threeparticipantsinthreedifferentgroupsclaimedtohavescoredwellonthetestbutwerenothiredas  enumerators.Thisperceivedinjusticehadcontributedtotheirreasonsfornotmailingbackthequestion  naires.Othersreportedfriendsorrelativeshavinghadsimilarexperiences.Severalparticipants,andnot ` justthosewhowerethemselvespassedover,feltthehiringprocesshadbeenconductedunfairly,which 8 coloredtheirperceptionsofthecensusnegatively. ` #XɂX%&##XɂXXXɂ#XɂXXXɂ  !USUS.,  _E1` hp x (#XE        &%XX&%%&  8  TheAccuracyandCoverageEvaluationSurveywasbeingconductedatthesametimeandmayhave  causedconfusion.#XɂX%&##XɂXXXɂ#XɂXXXɂ L !USUS.,  _E1` hp x (#XE               &%XX&%%&  9   (      ݀Severalparticipantstriedtogethelpbycallingthe800number.Somefailedtogetthroughdespite  repeatedattempts,whileothersreceivedwhattheyfeltwereunsatisfactoryresponses.AlthoughPuerto  Ricohadover100QuestionnaireAssistanceCenters,theparticipantsapparentlydidn'tknowthis.#XɂX%&##XɂXXXɂ#XɂXXXɂ , !USUS.,  _E1` hp x (#XE                 10   (      &%XX&%%&ԀResearchofthistypeiscurrentlybeingconductedaspartofthistask.Focusgroupsarebeingheldin  12communitiesacrosstheIslandwithadiversegroupofparticipantstoexploretheirviewsand  perceptionsofQuestion8(onethnicity)andQuestion9(onrace).#XɂX%&R##XɂXXXɂq#XɂXXXɂs.y3|x d0. 'U [ !USUS.,  _E1` hp x (#XE               &%XX&%%&  3   (      ݀Althoughweoriginallyintendedtoconductfocusgroupsin12sites,wewereunabletocarryoutthe  groupsasplannedinthreesites.Thereasonsarediscussedinsection3,Limits.1.1. BerkowitzWestatBrudvignonresponsemunicipiosmailbacknonrespondinggeocodemailoutMayagu-zbandshell oldsgeneralizableLoiza misperceptionsfollowupimpersonality  3#37=CIQYag1.a.i.(1)(a)(i)1)a)\  `*Times New RomanTT(;3$2#  0  .3  0  (O;$0  2#  a  .3  0` (#(#(b$0  0` (#(#2#   .3  0 ` (#` (#(xir$0  0` (#(#0 ` (#` (#2#(  0  )3  0 (# (#($0  0` (#(#0 ` (#` (#0 (# (#2#(  a  )3  0h(#(#(F$0  0` (#(#0 ` (#` (#0 (# (#0h(#(#2#(   )3  0h(#h(#($0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#2#  0  )3  0(#(#({$0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(#2#  a  )3  0p(#(#(F$0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(#0p(#(#2#     )3  0p(#p(# 456789:;xGaeimquy}Bullet ListBullets List  X (hH  Z6Times New Roman Regular>a$"Small Circle"0..BWNO I&mage <=8C HKKKKLevel 1Level 2Level 3Level 4Level 5  !USUS.,  _        ?+ 4 <DL!X?X7XXX       &A%hX7  4   (      #X7X%&A5#&A%XX7Ԁ#X7X%&A#&A%XX7&%%&AWecanonlyspeculateastothereasons.Peoplemayhavebeenreluctanttoadmitthattheyhadnot  mailedbacktheirquestionnaires,ortheymayhaveansweredthattheyhadmaileditbacktoavoidhaving  torespondtothesurvey#&A%%&0#&%%&A.#X4X%&# G     X #Xd#(.3$ !USUS.,       $359=AEIMQ2  M$USUS.,  2    _&%XXNocomparableresearchwasdonestatesidetoexplorereactionstonewproceduresinitiatedin1960  (whenquestionnairesweremailed,butpickedupbyenumerators)or1970(whenmailout/mailbackwas  firstusedextensively).However,duringthisperiod,therewereindicationsofincreasedresistanceto ` > beinginterviewed,greateralienationfromanddistrustofgovernment,andmoreorganizedattemptsto  protestthecensus.#XɂX%&Y#(12$ !USUS.,    0  ( $ Figure  1  'dxdVN:\9951\995118\PUERTO~1.TIF $ X     O&Draw Object <<=8C HKKKKTable_AWPC++   ++   !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~݊ } G;LP,KP,KP,JT,JU, Jc, Jc , Jc,Jc1> !,  4% :&     ,                    !       ,                  &,                    %,                      %,                             $,                                   $,                             #,                         #,     '       #,     '       #,  %      ",  "     ",             ",              ",            ",            ",           8,  %  ,     %    8,  ),   #)   8,  ,,   ',   8, -,   (-   ",         #,           #,                   #,                           $                         $                      %                  &                 '                  (                    /L 75%!' )cXY4(dWZ4dCZ4 eC [4 eD [4fD\4gE]4hF^4 jH `4c~ `|_{^z ]y   y     ~y}x|x|x |x  {x    {x   {x {y {y {z {z |{ ||}~    ~   I> G<F<F< E<   |     z zyy  y     x     x     xS9&   xP 6&   xO5&   wN4-    _]N 4-  ]^M 3- [_M  07}[_M    -7}       Y`L,7}     L+7    IM *7     GM  *7  GM    FM       EM     EM   EO     EO      EO    EP     DP     DR DS        DV     D C   C  C+    * *N*)%""j2"i24i24i2Y2  W2V2 U2 U2   U2   2   2   2  2  'f2  $ d2 #c2 # b2 # b2 # a2   # ?2 # =2 9$=2 9$ <2 9& <2 i Dz( <2 iBz+<2 i@z. <2 i @z1 <2 i ?z3<2 i ?z % <2 i  l  % <2 i    j!% <2 i i!& <2 i h C&<2 (< h C(<2 '<   h  )  <2 '=   g   , <2 '=   g 2 '=     g 2 '=   g 2 '=   g  2 '=   g  2 '= g   2 '= h   2 '= h 2 <'=i  2(2 <&=    j  +m2i <&> l +m2o  <&  +m2r  <&+m2w  <& ,m2{ .&    ,m2   ,&  ,92\  +&, 72 */ *&,72 $;*&,62 %> *&-62 &B  )%-62 'E   )%-62 (H   )%- 62 (K  )%k~- 62 )N  )%k~.62 *Q  )%k~.62 +S )%k~%62 +V *%kM-$62 ,X *%kL+$62 -[ +%kL,%62 .\   ,%kK,&62 /] .$kK,' 62 0_ $lK-) 62 2` $lJ-2 2b $lJ-2 5c $lI-2 7d $lI-2 8g $lI.2 :h $lH.2 ;k $lH.2 <l $lG.2 =n $lG.2?q #lG/2 ?s #mF/KT2~ @vY#mF0KR2~AwY#mE/JR2} By}Y#mE/KS2| C|zY#mE0JS2| C~x R#mD0JS2{ DvM#mD1JT2z EsJ#mC0IT2y Gq!F#mC0IU2b Gn'C#mC1IU2` Hl-@"mB1IU2_  Ji3="nB2IV2_  Kg::"nA2HV2^!K?8"nA1HWO^ M =!5"nA2HW L^N<82 iG@2HWK]P ;'8. I/D@2HXJ]S;N<37 * )KB?3GX J\U 58I 6G5& A?2GX I\Y W 0S3! ??3FY     \ ^ X+Y0>>3GY     [q"3&_+=!=>3GZ[t4 !9#I$==4FZ[x6 % 8~V l <=4FZZ} :U1|b M+ ;=4E[ Z +zp   +> :<4F[ Z !v s  >? :<4F\   Y $8# 4$&s w  >? 9<5E\    Y '5" 0&+p{ @? 8;5E\ Y )1 +(,a~@@ 7;5E]   Y -+ &*+] !A@ 7:5D]   X1#  !-+X $B@ 6 :5E^ X 76/*U/R&zC@  : D^ X =&:2*Q1S (wD@  ~9 D^X=&>4*N1S ,rE@  |9D_W>&I4) K3R (oF?   f8 #C_      WM/>&I5) H48 'k G?  &a8 (D`   WM0?&I5)E ,6   #hH>  /\ 8 +C`2WM0?&I5( B - 5  d I5 X 7 0C`2WL 0?&I5( ?0 3  bL3 7T 7 0Ca2WL 0@&I5' @3  ^ M2 8 O 6 ?a2WK /@&I4' A 1 -6P2IJ 6  =b2V  @&J4& /( 0 (8Z1""E 6  9b2V   A&J4&.) .$9]/") 5 6b2V A&J3&/+ ,:`.! " 5 4c2VA&K3%/$,<`-(= 4  2c2VB&K2% 0&*=a, +e 4 1d2VmK2$ 1( )!=c+ .Y 1 /d2V mL1$ '* '# @c+  $1T 0 /d2V   mL1$% - &&)c*;4O 0 .e2W    mM1#!N $(.,b);7I /  -e2W nM0#N#+).a)<:+  .  ,f2W  nN0"P ".$1`)== .  *f2W   nN0"P 13`)=B -  *f2W  nN0"P 46^)>p , ! )g2X  nN/!  Q (79^)>p + " (g2X  nO/!0R!' :=])?p * $ 'h2Y   oO/!-S"% =B\)?p)% %hY    oO/ *S!$ [*?p(& %aZ  oN0 (T"# [*?p'& #] [ )ioN0 %U#!  Z*>p&' $\ \ (h ~oN0"UE  Y,>o%(-[ ] g ~oN/ UN   X,=n$( 8 Z!^ e}oN-!WL"  W,=j#) 6X"_ W|oO,BWL"  W.<Y!*%X"#_  W|oP)JWK"  V.<Q "* %W%$` Y{oQ 'KXg  T0;O &+  )W %a z{oS $f;g T0;M,  +*R %b z'zoU #h9g S2:L ?  , )M &c x'zoX"l4g R39KI - #H 'c x)zoZ!q0p P49JM - C U(d v)yo\!u,o M68IO.  = P )e u*yo]!z(p J 77HP)/ #7 I*e u+xo]!}  H 96FQ#0 %1 A+f s+xo\!  G <6ER!0 *+ 8!,gs,wn[!b F>5DS / %& +-g r-xn[" bR[ EC4BT .' R|.hr.wnZ#  fM\ED4@U  - ( Xy/h q.wmY#  iHSEE3>W  , -  mv0ip/wlX$! nDTFE2< X  * 0   Ts1i o0wlW%! q?UFF1: Z (   )  M q2jo1wkV&" v:U FG08 \ %   8Dn3jo1wjV'#z9V FH07^  "   2=k3km2xjU($.% FH/5`    +i4km3yiU($,( GI.3b    % f5lm3yhT)$!*++GJ-2d     d6lj3zgT)$!'-+GK-1 G     a7lR3{eT*%&0*GK,/ G     ^8mQ4|dU*%$2*HK+.O    #  [9mQ5}cU*%"5*IK*-O    "" X:mP7~bU*% #*IK*,O     V;nP BaU)%%*KJ)+O      SnPN]X'%,+O ,')*!    !$  J?nPN\X&%+.+Q -&))   (#/ G@nONZY%%(0+R .%()   %%0DAnNOYZ%%U3'3+U /%( );   "(0 AAnMOXZ$%T3%4*V 0$'  );   *1 @BoLPV[#%S3"6+X   $'  ) : ,1<CnKQU]#%S* 9+Z  #&   ):   /29DnLRT^"%R+;+\ N  ) 7 ! 126EnKSS_!%R*;+]L! '5 ! 23 FnJS'! R_!%P+\+`L! &2. E4 6 GnIT'!!Q`!%P+],aK"$1. D66 HnHU'!"O` &P3],c  J""/- C9 5InGV'!#Nb &N4],d   J#!.- A94JmFW'!$Mb &N,f H#- @94KmEY'!%Lb&M+h H#   +  >:1LmEZ  Kb&L*i G$   *  =:/MlD[    Jc&0*~j Fh)  <:.E/lC]Hc&0*}j Eg(::"E/kC^Gd&'*|iEf&  9; E/kC`Fd&&)|iDe$ 7;M/jCaFe&!'){gCd# 6;M/i Bb Ee& ')zg   Cb4< M/h Cc  Ee&A&*~f  Ca !2>  h Bd   De&A'*J*C` ".>    g CeCf&@&j,* K*B` %#>  f Bf Cg&@&j,* KB  '#>  d Cg Ch&@&i, ) KB  )  $> c Ch Ah%@&i-* LB +  ">  b CjAiD ?&i-* K  B3 5  !>  ` DjAjB ?&i#+ #A 1     ? 4 ^ DkAj? @&i$+  >   EA 1    ?  /  \Dm    Ak> ?/h$, <  EA     @ + ZCm  @ Z= @.<*%, <!   A      @ ' WDo@ W< A.<*,  <)   A        A   # TDp@V; Bl* ,  <*  A     M   OEq@V; Ck* -  <)     @     L     HFs@ V: Ek  -       !A    K pFHt@ U: 2k ,     !A      *  nEJu@  ; )k!!,  A     (   m  DLu@ ; )j #-   A       %    " l DOu@; )i & -   A        "     8XCQuA< )9 -   @             5XBUuA= )9 -  @            $ XBUvA? )9  -    A           ! XA UvB? )?  .    A         X@ RwC? 1?  .     A          X? PxC ? 2>#.     A (     !   X> OyC@ R   &.:#A  &   %   = MzD @ Q    )-;# A    #  ?  < L}D @ Q ,-/# B?        @; KD @ P--0# B>       A$ : IE @ Q.-0# B>     C" 9 HEA Q .-  3 $ C=      C 8 HFAP  /-5& C<     5E 7 FF  AP  .-c  D9   5 G6 DF AQ  A-cD8      4J5 BG[BP A.dMEI      4 M3 ?GZBP  A. &MEG  3R 2 2GZBO  A. &MGG 3wp0 ,GY BP  A-&MGF 3 wo~.)GX CP B-BMG  3  xn},!&HT CO B- AMH 2  xm~*.!FT CO C- ALH    2  zm~(40cDO    D, LI    3  zk$9 ,cDO   G,   MI   3   zk> +bDZ, MI      3    |iB n*bD ^,NH       ;    |hG w*bD b,OH     <    | gK u*bDu, OG      ^  }fNT)aCy, PF #    _  ~ eQ Q*aD^*   QF&     _   cU O)bD_*   RE *    `   cZM(bDb/y*   SD:    a   a b K  (bCf+y*   TC=   b   ` g I (cCj(1E)   TB?   b   ^i G 'cBn%/F)   TAB  d   \ j ,E 'cBr".G)   T D  e    Z m' W  C 'dBv,H)   T G   f    *%q q) X   B 'dA *I(  TI  g   #"p  x/ X  ? &dA(f ( ?(    T K _   p  y/ W  > %eA)f 'A'   S  M  `   n   y/ W  <%fA+d %"& ?S  N  c     "n  z/ W   9$f@.c # "& ?T O     f   Bm  {/  # 7$g@0b ! # ?U Q       i   Bm  |/   ! 5#h@2` " ?T S     k   @m  }/! 1"h@5^ # >T T    n   . l }/  ! .i@7]  # <T U    n    '  l ~0 # *j@%[  #  ;U  U    ^ !    j 0  % #j@Z #  ^U "U  <     O  0  &k@ %X #  ^T$U    5%     L   0  (m@+W $  ]T &V   -.   . L   0   )m?.W  #   [S     %9  /K    0  + m?0j  $   ZR   %A   0 K   0    n?2h "$ YR     j  1 L   0   n?5g#$XQ   l  1 K   0"  n?7>$ #$WP  ;n  3 L&   /  n?,8( %$ VO  ==,  3 K&   / (n@ 53,&$ TO :55  5 L  /- #n@=-0'$ TM   ;->  6K   .   - "n?kR'$ TM8K    :&H 6L  -  -  o?hT)$<K9K   1 #O 8J  ". o?eV*$   :JBS   / u   :C   %/   o>aX+$8JDS      v   ;">  )/ $n>^@,$ 7IES   ( u   >&9 ,0$+ o>^r# 6HFT   + u B*3 %0"4o>su#4GH  0   . t L)/)   1 7o>py$ 3FI  .   0 s Q))) '19o>m|# 2FJ. !  3 sS-$) (2; o=j# 1F1.  " 4 sR'* M!'3=o=g# 0F0.  # 6 rQ ' )% M"(3= n=d+} 0D"/ .  $ 9 q R&* * M"'< m=a+x/@. /  % ; p Q% ) . L#':l=`v$/@.  /  $ = pQ$  *1 L#( )j=r (/A -  /  % ? oP!# )7K#' "& h=p ,.7- /  & @ n P%" *9 ("$$ g=n 0.4- .  & B n N++) :    &%&" f<i 3,3, .  'D m N+**: $' ( g<b5,3,- & Em M- * 9 ") *f<]8 3 ,- 'Gk L.* 9  , -f<rY92/,, 'HA( L. + : ./  Y<krV:3/,,(  IA( K/+ 8   10W=jOQ;20,  ,(  IA' K/ + 8     32V= bON H20,  *(  IA& I0- 8      5JU> aOJ J11'  J=$  I0I 7  8J T> `O G K03'  J4!  H1H 6    - S? _O  C M04 &   J4  H1G 5    5-  R? ./O !@ M/5  &   K5  F2G 3   3-  Q@ ,0O "< O/6 %   K7  E3E 2   0+ PA,0P  "9 O.7 $   L 8 E4D 1   .+ OB *2O  #6 P 9~ $  L 8  )D5C /   ,+ NB ()O  #3 Q:~#  L 9 ,JIC5B .    * MC ')O  $0 !R;}#  N# ,JJB6A - ( LC  *P  #- $R<}#  N# +J JA6@ ,4R  & KB ,O  G+ 'T=) 9"  O" *I R@7? ,6Q ! $JA O  G) )TS) 8!  P*I R?8> .**R ! ! IA P  G& ,TT' 8!  P   *I R>8= .*+Q"  G@  P G$ /VT' 8!    )H >=9= ! -*+Q" E?   O G1VT& 7!     *H  <<9< " 5), Q#  C@   O F44W T%7!  $  )G <;:; # 3*-T"  A?   P F27X U%&    2  )F ;::; $ )#  ??  #) E)9Y V# $   2  (F <8;; $   o*#  !=?   %' D?Y W#$     2   )E <7;; #   m+)  ";?  2($Df[Y!$ !     (E  <6<; " n+ })#9? 1+" Cg[Z $ !      (D =4=< ! m- z*& $7A&- Ch\[ $ !      (C =3==  | w*%"%5B # / Bi\]$       (C >2=>  | v,#& C 3Bj\]%!    (B  ?1<?    |t, $'"D " Ak]^  % !      (A  @/<A   |s-0%("E "Al]_&!     9 (A @/:C   o7s / )#F;& @m]a &  !     9 )@ B-9D   p7q  0 , G=I@n] b ' 1    8 (@ B-8G    p7q   / /H H@\?o\ b '  1    7 (? D+8H    q7q    "I ID_(?q\ c ( 2    ? (>  F,8K  q7p    "KI Fa.>r]e ) 3    ? (> HgN  q 6p)  "MJ Ic">s\f )4  =)fP  r7o)   "NJKf<t\f  )4 = (eQ  r 6n )  "PJMh;v]g)6 @)dQ   s7m )  "QINi:w\hs7 A)eR    s7m ) "S IPl8x] ir 9  A)dS 7k ) "T ISn5 {^ iq :  @)dS 7k )  !VIT0 |_ ip < 0+J*dT 7j ) !XIV~~bjp > 0,I*cU8h )   ZIX}  )c jo ? /,^*cT  9g)   [JY|  (e jo @/,^*"E=cU:f )  [J [ y $g ln @.,^*  B=cV :e )  [J\e g mn A ,.< *A>cV<c [K ^b  hmI  A */<)@>cW =b    ZK _f   hnF A _<* ?>cW>a  !  ZL ae  ho  - A  _;* ?>cX ?_ #  ZMbdgo ) A  + :*  0cXA \  '$  ZNbegp&  A   , 9)  -aY B [  '&   ZOdN fq"  A   , 8)+UZD X &'  ZPeHfr    A  - 6)+S[ E V# &   [Pf2 &fs   A  - 4))R[G U%  &  \Og2: e t  A  . 2)(S_ IU (":  ]N i; du   A  0(  'RkLT*"; ^M j<cv# A   /(  &Sk LT*"< `L k=cw(A  -(  &SlMS#< aK l?+cx3A  ,(%Tl MR / bK m$+cy 4A   +'1TlMC   0 dKo$ + D y 6A  " *'1Uk M? & fJp , D y!7A  # )(  %VkM<  ' fHqb D y#9A  % '( #VkM7  ( hGtc Ty$:A   & '' #WkM4" < iEufTy& <A  ' &'$Wk5,M/)  q  " i/viTy(>A   ( %'   %Xk5, L+/m      k"$w m  y+@A   ) $&!  &Xj5 ,M'Si  j&!x r   yoA  * #&Yj5P L"4e  j y uyoA  , " &Yj5PM 5_   k { yyo A , ! &Yj6P L!6[   l|}zo @  . ! &Yj6w K"7V     k "  zp @   0  %Yi6   uL &7R      l!  zp @ 3 !%Xi6t K%$ N      l#   zp@ | !%Xj7 sK#+ J    l$   yqA } "%W:e  s K!OF     m&    yqA~ #"%V;e   s J VB    m&     yq A G%V;e   rJ"^>    n(     xq A F%T<e   r Jf8   m* xq A  E&Tl8   r Ht2  m,wq A  D&Sm9 r Fy!, n/ =wp  A  C&Sm9  r C~$%       mxxo A c B&Ro9  r @'     ny    xn A ` @&P o: r =+ " mz   ]m @ !8  @&N q: s ;2  !  n{a  Zl @ 3  ?'L r : s 72   n|a Yj@' ?'K t; t 31  . " n|bXh@ #?'H u ;     u /9 :4n~b Xh@ >'F w< w +2 75na WfA >'C z` (- 4 6na  e A  ='B|a %& 1"8nb    cB      'A} a ! .$8nb b B  (  "(?b$$$" -&9oc c  B  * #(> a      )':nd c  D,#(<`     S -nd   c  E 0#(9 _   R ,nd  c E 3 )7  Q :md  c  G  8  )5 3 P 9md    c I ^  (1 O 7nd   e Jb ) % N5n e     f Ld  (  % "&4ne     f Me  )   $ ! 2ne   g Mf  ( #  (!0ne   h M !g   )  ! " '$/ne  i K 2h )   ! ! (&-of  j K 2j*" ')oe     k J 2l *  "" &,p+ ?f  l  I 4n + #% %.p ' ?gzl  I  4s +$'     %0p &>fzm H   4y ,  $)      Y p %>f{m G 5| , %+!  ! $  Yp # >fzn F 6| ,j 1 %,K  Wq~ " >fzoD 6| .i /&. J  Uq~ !   f{oB 7| .f-&/ J    :  Rq~ !  e{oA 8{!.d  + %'0 H    8  P q~ e{o@:{"/b (}#'1 G7 M q~f|o? ;{"/a ' y !(2 F6 K r|e{o><{#0^ % v (3 E6H s|$e| G=?{$1\" q(4 D 6F s| "d| G=Gz$1[!  o(5 C   5C" s|  d{ G<Gz52X n)6 B   4 '%s{ d| W;Hz52Vm )7 B    4 "(s{c{W;Hz53Tk (8 @  4 #*sz c|W:Hy-5Qj '9 ?    4 !,sy c{:Hy+5O#h &9 >    4 /sw  c{   :Iy+6M%g  %: = 3 1sr  c{ 9Jy+6J(g $: = 42 Eslb{ 9Jy+8 E*e #; ; 43 Csgb| 8Ky+9 >.d  "; ; 53.sd    ^{  8Kw*::0 :'  !< :    53,s 4{ "  ]|  3Lx (= 83 8% < 9  73(s 4y '\|   .Lw %A 654"9 =  !&s 4y,\{    * Mv"F48 / ; =  !%s 4x.]| & MvG2; .= > !=s 4x1]| 3$N:H/= -? > $ !<s 4x1]}  4 !O 7I.@ $+ A ?!!     ;s  i1[|   # #P 6I,B (* D ?      %s   g2Z|   %Q 5J*E*) F?     &s f2X {    &S  4K)G)' H@) %r e2V{  (V 4L'K &% K@*  & r e3Tz    *Z  M%N&$ NA*  & r  e3R z    +^     N#P&" PA, 5 ' ^  d3P y\  B-b O!S'  P A- !5 ' ^   d2N y\  D  .c   PW(  P B-$& ' ^   e3L x\   F0d   QY*  Q B &" ( ^  e3J x\   I1f   R Z,R B  ) ( _  e3G w[    M 3f    T \/ k C ,  (  _  e3E vY    P7f   U#]1 kC  1 (   f3B vX  f     T&\5kC !  8         g3? ul  e *R[;lC"V  g3< uk wf ,Q ZAl C !-W h38 s^ vf  Q ZD mD ! -Y    i25 !s^ vf  O#ZFoD   ,[ 2! k21 %r]  tf O%YD%+] 5 ]2. )p\ tf  N(ZD_*`D \2* ,o\ rf M+[E _)bE  [1' 0m\%    (f   K,[E^g Z2# 4l['     &g    (J.] E]  n  Z2  8j\(  $fk+H/^ E]   Y3 ;i[)  $gk.G/`E ]     X2 ?h\)  #fj/D0bF \    X3 Bf\+  -fj1C0eF [ 0  W4 Ff\,   +fk3A1j  F [ V3 Id]-  &fj4@1o e  F Z      U4  Lc\.   $ek6?2q%c GZ    T5  Pb]/ "fk8>2s(b G Y sT6 Sa^1   !ek9 )1u+b G U  sU6 V`]2    fk:  '2v b G RsU5Y_^4  fl;$1y "a'H QrV5 \^^5 ek<"1{ %a&H O$rW5 _^Z7 fl=!2}(a%H L"rW4c\T C  ek? 1+aH H rW4d\TD   !dj@ 2-a0H FqW4e[RE"c_B 1 0b- I  Cq>3eZQH7Td]C13c,IB"q82fYQR6Tc\E17f+I ? q5 2gYPT)Tc\I 1z* I? q3 2_ .hWNV(Tc\n0y) J &  r1 2X*iVNX'Sd[q0y(  J  &   s0  1T#"jTMZ) TdZu1y(  J  %  s/ 1S/lQM\*VeYx1z&J % s- 1Q  mOM^eX{ 10eK % t+2P  nLM_gV21eK $  w*2O oE La rgV22eK $  w)"2O-qC Mb oiT14e  K G x($2O5s@ K cmiT3$  L .  x&%2M8u= J dmkS2$ L + y%&4M; x: K e kmR2#L* z#&4M>|8 K g kmR2$ L' #; %8z"' 4L5 I j    oQ2# L$ "; $8{!( 5L3G l   pQ1#  M ! ; $9| )6K0 o  qQ}0 # M  ; #9})7J-"  p  sS{/ #M ; #:}* 7J,& p  tTz0d $M   ; `~+ 9J  * s  uVy1`$   N   -  :H    t   wUx2\ '  ~N      . ;H v   xUw3Z N/ =H# x    yTv3WN0 >G  '{  zSv3TO  1BF ,~   {Sv42 N@RO  2^E  L   }Sv42 NAN O  4^E  M   }Qu42 NCKO      5_D N  Q f43 NEI   O       6_CO  I f43NFF  P    9`BO H e44NHB   P     ;`B P    E e35  0?   P       ?aAQ  4 d45    0=   P    Cb@rw2 c3609  Q     Gc?rt0#   4716  Q    K  d=qr/      5732 Q   P f<qUo-   47 5/  Q!        T r;q R j-  57  6.  R!    Y4r:pQ g,  58    7-  R"  } ^ r9(\Bol e+"  68    9,   S  { cr8' ZBo oc( $   77  :+  T  zjr7'XBn rB' &    87  ;, g xr6'm    @% )   97  <+ hws5' l   ?$+   97=* itt5& k =!.    :6?* j s`t4'    5j  < /   ;6 @* k  r]t4'     3j ;0<5 B* l q*Zv3'2i   91>4    C* l p+Wv3&2i     83>4  F) m  o  Ux2&2i    74@h*m n  Rx2&  <i    6 5  @h)m l$Pz1&   :i   5 6   B\)n kN{0%   6h    4 8gB[*n  kK|/%   4h    3 9gC[)n  jJ}/%   2g   1 ;gD] ) n   jH.%     2g  /<fD_* n   hF.$     1h .=fE)n   gD.% 1h  , >dE #n  gB-$ 1i    !)@aF "n  fAg-%1j  "&A_F !(n  e?h,&2k"# (}C ]G (n  d>i+'     3n$ % {E\G (n   c=j**     5q% #zGYH'm  c<k)r' "yIXI'm   b=l(r)  yKWI 'm   a<  (r*  xLUI 'm    a<  'r,   !MTJ"$ &m     `<&r/   NSJ ,$ &l  `;%r1 ORK5# &l  `; %r4 PQL@" &l  LV_:!$r6POLI"  &l  IR_9!$r8)ONMT!  &k   E$M_:"  #r: (PKNY}  &k    A.G_9#  #r~;  $P7O")y %k   ?>_8#"ry =    "Q4P'v )%j  <:_8$"sw ?!  P2P(%s +!%j 8 "8_7"sv B"   !P1T3 r0'%j 5 +7_6"su E$    Q1g <H# ;%i   /86_6"stt  Q/h EF"@%i  +?5_5"tsv  P.hKD!B&i  (C4_4"tsw!Q.h P C F&h& G4_3    "trx"Q,iU B H'h   # K3_2#   "upz    #R,iW@ K (g! O2_1G 4"xmz %R*iX? O)g  S1_1G4"k|NVQ*iY> fW0_0H4#j~NWR)iZ=e Z_/I 4#iAXR(iZ<e \ _-H4#hAXS'jZ;d ^ ^-E5$h@XS&i[:d ` )\,G6$gB YT%j !9!c  c Z*$fC\S$i 8 b  e Y*$fT#j7 b h  C($dT#j6  a $l A)$dU"j5 (a%p,@( %cU"j5 &` #>)%_U!k4 $_  9+%\ V!j3 !_  ,,% {X  V k% ^ *I+J-% y9 W j   "] )I)K.%x 4Y k &] (H)L/$ /[k#+ \ 'H1L0# -_k$'/[ &G1M0! ,fiN2Z &G1N1 1 DpiLZ %G .0    / Drh JY  $F   -0 /D}th   ;X  $F-0.D|vg   &W #E./ - E{xf %% W O "|$D/-  , Eyy< p V #P "}$D:-  , ,xz  9 U  *Q "}#C9,   , *v{7 T 3Q #C6+      *+u| 5 T @P !C  6*  **t| 3  S  AO  B5)WO  *+s} ; R  <M  N B  6(SK  *+s}6 Q  8K    LA  7'O? +,r}1 P  2IOA 8'J$:  ,,r| - O  )! FQA 9'F  6  -  -q|* N  !, DU@ 9(B 2?.p|  * L  7 A X@ :(> -     @ .p|  ( K   E > Z@   ;(9!(  @ /p| (  J   L <  ]?='5(#jF@ /p| '  J   O 9   c c'LB.. kEA /o|  ' I   R 6 c_'C<*6 j@/o|  '  H V 4 b \'?8'>  j% A0n|   ( G Y 1 b Z(:&5$C  j ; B  0n} ) F\ .b W(6+4" I j ;!E  /n}c E _ ,cT)2/2  Lj !"j}c Ec *cR)-32  Ot! (e}c D f (c*)63   R CZ`}d D  i &   d+%2  U   4?\ ]} d C   l$ f-!3 X 4< ]$Z} d##C o/5  [ 57 _(W~ e   B   q 0  5  ] 3 a+T f   B t 1 6  `O0 c.R)OgA  )  u"1 5  bR, g P& O l A  Wx#2 4 fj) i O%O1   A Yy%2 2 jk% l M% P1   A [|'2 2 ml" n K$ Q 0   A ^~)2  0 on p J% P %/   @  4+2/ rn s  J% . %.  @1 {Z,1  up u   H% , %- @ - wW/ xq w   H&,   @ '% s U0 zs y G'+  @!L o S1%   }u  | G( +  @M lP4K   w ~ F* +  AN iN5I     x  F-+  AQ fL5G     zE1+ AT cJ5G !  | E4 +  AW ` H7E    D5+   A Z ]!7 %   D( +      B X [ 7  D( +    6 >W X8  B( + !! 6 > U U8   ">B) + } 6 > S S 9   ; B*+  | 6  Q >  <  ! :B++ | 6  O /$  =  & 7 A,  + { 6  N &,  @   *3 A/ + {6   W L 0B  =/A        6    V JD  > + @       6 W!H0# G ? ' ?]  6 W#G)*H ~&    # ?\ 6X#D!,<J ~    ?[ 6  b%C 0;M }   >Z  6     a&BQ<O }  >Z   6     ]&@R;Q !|  =Z   6    ['?Q; S #{   =Y    6    "R; U  ${    ;}Y  6     "R:V  %{    :}X   6     !R;Y   &z  )8}W   6  !S;\  (z 3   $ 8}V 6 Y,<R< `  'z 3     6~V 6 Y-;S 'z 3   6~U 6 Z,;S    &x<  4  T 6      [-:R   'x< 4   S    6   ^-:S  'x<  2 S .9R  'x  2  R.:R  'x    0  Q "!"/9S (x    /    P    08S   )x    .     O    08R   *w   ,     N  17Q +2w     +   N 27Q , 2w    *   LK369|O_  - 2v   (   LK376 zN[  -  3v     %   L K465zNY  .  3u   #   J K465 yM W   .  3u       ' K554 yK T  .  u       $ K554 xJ S /    v       K644 VG!Q . v +"    ! K644 TE !O.v %'   K735SC !N/w      K825 RB "M /y       J826 QA"K! / y        J:18 Q@"J# 0  z  !     J:0;P@#I$ 0   {  % $#" J;.> O?#G%  / |) J<+@ O?#F' / | -~ J= )AN@$E(  /"} 03w I? %+ M@$D*0" 63s IB!' LA$B+ 0#  </p ID& LB%A- 0# E(n IH& LC%A. .# I&l HK &LC%?0 .$   N"k HO &'KD&>0.%  Yi HT%(  KD'=2-~cg HW$+ KF '=3-}j f GY$F (;5,} m d GY#G):6 +}  od GZ"G*:7+|p b F[!I-98 *{ ra F\ J379*{ s _ F]J8(:){   u^E_K8 ;)z  *w]E`L8!<(z+y\ EaM8+ = 'zKy[ DcK?M8 *?  &z*& zY Dd  H@O7$?  %y) $zY C e F@O7@   $x*"y W Cg  E@P) i7%E  $x *z% B h  C@Q* j6z  #x   )4 z    A j  Q) j6{  "v  .{    @ k  %S* k6| !v   %{ > m  ! T*l6| u  ={  = p  U*l4} t =;~|  = q X+ +4~ s ==}| < r[+   )4~ q  =>|} ; r]+(4 o  >?|~ : s  `,'3  n    >@|~  : u   a,'3 k  =@z 9 v a- '3   h=Az 9wc-  &3   d>By  8x!c-  &1   a&=By 8x c-    '1  ^%=Ay  7y!  d-  '1  \=By 7y  d-  '1  Z  =Ay  6z! d,  '0  Y =Ax   6{"e,'0  W  =Ax !6{$   e,(0  V >AwO5|' e,(0 T  @AwN5|e,)0(aSXA3<N4}e+  *.&`R XA2 8N4|f+   -.% ]PWA1 2 M4|f.% \OXA/!L3|f.$Z)M WB.'L3|f. #Y' L   WA,&K 3|f- "W&K   WA, #K2|f- "V&J   VA*  ; 2|g-  T% I   VA*   82{g-  D% F U@(5 1|g-  A%   6<UA(41|f,  >&   57TA'1 1{f, ;%56TB$/ 1|f, 9&64SB!  + 0|g+  )$ 5'A2RD %& 0|;+ )$2(  D2 RE  0} ;+  *$  0)  D0QG#  0} ;+  +%  .*   E/ PH(  /} ;+  J% *++   F- OK- /u ;+  J%   - %,  G, NM ;/t ;*    " 0".   H* LP8/t   +    #4 -   I( KR 4.s    +   %: , J&JU /.s+  ' ? - L$IW!'.r +   ) E-M!GX+.r +   , H.O E[5.q ,     /I/    Q!  D[<.r  ,      1M4  T  $   B\j /4   ,    %(   ?]l  1  4    -   #+  =_m <4  .    .  :`o  <4 .    1 9aq= 5 /   J 7b r = 5 / K 5ct  \=   /L 4du     Y =   1 M 2fuY=1     M 1gvW =    2 N 0hwW=  2  O 0hw V = h2  Q .jw   V= h3   R .kx   U = g3    T .lx     U <  h5   V-mx  T < )7Fh5  Y-me  T!<  '-Dh6 [,oa  S !;  $' Ch6_,o_S"; #!Ai7f,q^R "; !  @i7p+]R#:  >E8v,]Q #:  = B8+K   : $9      <A:, I   5 $9   !  :@:+ 6 %8t ( 9 ? ;  *6&%7 s 0 8 ? <  * 6'&7t 8  5   ~<   )  6)&6 t <  3  |=     )  6 )'5 t A {=   (  7 *'4 t h(y>      )   (3 u l( x?     )       (2 v  p' v@     )  )2 v  u   tA     *  *1 ,     sA       *   K0 ,    rB      + M/  , qB      ,) N. ! F  #oC       -  , O. " E $nD      .  - O- " F   mD      00 P, #  kF~    %l    1 0Q+ $    kF~      %m#    3 1 Q+ %  iG}    %m! 63R* &     hH|   %n    74R) &     gH|    $n  74S) '  eIf    $o 76S( (   eId $ ) 7   7S' (  cJc  $  ( 87T' )  cK  b#(   99T& *  bK` #' 99T% +   aL `  "( 98T% +   `M ^  "(99U$ , _M^!)99U# -  _N  N!  )99U# -  _N L    *::U" .   ~^N I  * ::U" .     {^OH   *!::U! /   x]PG  +; u;U!Y& v]k G  +!;s:# gU  Y% s]lF  ,%=r: fU Z%o]l F  ,'> "l;eU[%k]m F ,*?  a:dU Z$ i\n E   - x- A _;cUY% h\F  ,-f{ _;cU X& g\F @V{ `:bUf[F RK{._;bT e[F  0H{0_;bTB[F  +G{ 4_;aT d@ZF   =D|9_: `T0^?ZG  IB}=_9 !`T5Z">ZG  L@|=` 7"_T9W<ZH  N>|>` 4$  ETS=T ;XI ZP:}@e/((:S>S9W~I  \Q8|@h/ +6S>S 9W~I]S6}@lc 3SQ#8X}J  ^T4~Ao c 0S&R&6X}J  _V1@s  /RN R(4X|J  gV0Aw  .RQ R* 1YzJ   >X-@z-RR S, /YyK    <Y+@},RT R0 ,[yK ;[(A+RUS: 3 )\xK ;]%@+QU R: 5 &[xJ ;^ A+QVR: 8YzI F_ @*QWR:< X|H Da A*QWR:?#X~G  @c  B)QWR:D#WG  >e   B)QWR:_OVF <g  C)QWR:   ]]UE  <i  C(QWR:[e RE  <j  D'QWR:[i OD <l  E'QVR:Zm LD <n4_E&RVR:dqJB  <o2 ^E$ RVS:bsGB = 0+ 1^E# RUS: ^uEB   ?  ,. 1 eC" ST R:  \vDB  A+31 eB TTS;[wBEEB *31 eA TS S; [yAFFA *31  +@4UR T; Zz?GFA )21   )?3VQ T; Zz>HFB "2)?LA2WP U; [{<HEA   3)>K@0XO U; [|<IEA  4 )>J?.ZO T<\|;IDA  6 3=K>-[M T<   ]|:JDA    90>L= ]L T=`}:JCB   < ,>M< `K Ub~9IAA ?  *?~O;J Ud}9H@B   @(?}O9I Vd~8G=C  2  (?|P7G Wd~9F: E 2  &@{Q6F Xc9F7 G  2 &AzR5D Xa~9E2 H    3 &BxR3BY`:D $J    3&CxR1 @Z:CM   3&CwS- >[~;@P  4    'DwS* <];>T  7 )FvS&:^;< X     FvS#7`;; \  GvS!0a;8aHvS-c;7  eHxR+e;5  iIxS*g:4mJyS )i:2 pIyR(k:1  s I{R 'n90  u I{Q &r8. uI|Q & z8.  uJ}P  % {7-  t '!I}Q  %|6,  t  '!JP $ |6*  t  '!KP $}4*  t   '!JO # }4)  t  '!K M #~3)  t  d '!K J" 1(  &; _  KF"0'  "7 Z   KB "/'   4VL;!-'  %2 Q#L4!,&  )0M) L(!+&  -. I.  , !!*'  1,E4  - # *'   ) A9  -& (%   '='     - (%   & 9%  - ($   # 5%    . ("    !   1%     -'!    %  .$#  .'   )   *#(- S@'     ,  &$- .  "T@'    /     "#2. &T@'   3   #6    - (U@'    5     #:      - +UA'     8 # "?~   - -VA'    ;  ( "C~-" /WA'     =  .  "G~,%1WA(    A  0"K~*)3XA(     C  5 !P (, 6XA(     E  8!T~ '/ 8YA)     G     X~ %3~ :YA)    J    \ }#} </YA*   L  )a}     "`  > ,ZA*   N&f |#  ! W (ZA)   Q #u|,Va S-( \%ZA*     S#  y |,Ta # %/"Q!:B*    U% ~ z.Ta '  1 +E5B*    W & z  Tc ) 26; 3B*   Z &  y  Sc , 2?4#1B*   \ &  x Od . 4Q NE. /B*   _ & x Pf 0 !R NJ* ,B)  b % w   3 $ S NP$  *" B)  d %  v   5 '  { N 7  )$ B' x$  t!   7   ~ N / * B& z%  i!  9    N () )  C& {%  ^"  ;  !   3#)  C%- }+&  V##  <     :  )  C$, ~(( T%$  ? @ !*  C#+ $*% S%$    A F $ +  C"+ !,+  R$& #  C J), D!) .0 P$( &  E!  N ) .  D (18 O.    H &   S#+/  D'5M N9    J +   / V W+1  D& <w M C   N   ,T [- 3  E$r LH    +S _- 5  E"j KI    )R b/ 6  E_ KK   'R g/ 7  FS JLy &Q k 1 8  F!D IMs  $Q  o2 :  F!#2 HNp! #P  ; G"% GPn  $ !P   ;  G!( FRl# &    O  < G!* <Ti'| )#  N  =  H . :Vf y +   N   =  H 2  8Yd w -   ;  >  H 8  7b cu 0  6  ?  C @  6gar 2  !3 A  BC  5g_p 4  $0 A  AE  3h^ n 8  &. B  @ G 2h] l <   (+ B> I 1g\ ! j P  (* B <  J 0 h\ $ h Q   )(  A;" K -i\ ' g T    &  @ 9' M ,s[ ) d U!  6$  ?.5N *tZ + b V"  :"  =% $O (sZ , _ X"  >   < PsY . [ Z#  A 9 " QsY .W [$ D 7 % RrY 0Q]$ F 4 ) SsX 2N _% H 1 -   SsX 4Ja& J . 0 "TrX 6Fb& L ) # 'V r E 8Cd' N. %*  sB;;f( O,!#" r> >5h( Q(#  r=B1i) S$ $ t$;E -l* V #% %9H *n* X  '& '7J 'p+[ !* ' (5L %s,_ #-( 4N "v,S #(  2O }-T "  1P .V "  /Q.W " -R/Y " &S0 Z ! #T0 [  !  T1 [  !U2 ] !V2 ^ !V3 _ "V 4 a#W 4 b%  W 5 b'  W6 d)  W6 e+  X:7f- X<7g /X>8h 1&Y?9k3c$ZA:n6 `]C~_gE}fj G| emJ| e { {    {zzzz z    z   z{ l{  j| i| h} h~  h      g    g   g  g   g   g g h h i     j   l#    l    jjiii i  i  ii i i i i ii   i  hYIV FUDTDT CS CS BS   S  T    TU V X   \`b  c  RRR   S S T//8;    ++47  ))26 ))25%))25$))25-c))2-%5",b))2- 5&+a))2. 5B+a))2. /5D+a))2. &5G(+a))2.&5I;+a))2.&5K8+a) )2.&5N6+a) )2?&5P4+a) )2@&5R1+a) )2B%5U/+a) )2B#5W-+a))2C"5+ a))2$ 5+ a))2)&5+ a))2)5+ a))2(5+ a) )2(5+a) )2'5+a) )2& 5+a) )2&!5+a) )2%#5+a))"!2%$5+   a))   2$& 5+    2 I))   2#' 5+   .  F))2#  5+  - D))2 & 5*[+   ,D))2:5[+ +  C))2;5[+ *  C))2 <5[+ * B))2 < 5Z+)      ^))2 =!5Z+)  \) )2=#5Z+ )     [) )2&$5Z+ ([) )2'%5Y+ ( Z) )2(%5Y+ ( Z) )2 K5Y+(   Z))2.5X+ ( Z))   2' 5X+    ( Z))   2 5J +     (   Z))$#215I + )   Z))205J + ) Z) )2//5B +)  Z) )2/ ,5B +*     Z) )2. *5A +*   Z) )2- '5A ++  Z) )2)%5B +,Z))2("5A + -      Z))2& 5A + .   Z))2&5B+ 1   Z))2% 5B+ a))2$!35A+ a))2$"25B+a))2##15%+a))2"$15#+a))2"05*+a))2! 05( +a) )2  .5 E"+a) )2 ".5Q#+.#H4I) )24-5P%+, #HI) )25-5O +*#II) )26,5N +)MII))28+5L + ) MII))2855K + ( LJI))"%295J + (   I))   2:5H "+     '       I))   2 -5G #+   ' I) )2 ,5F $+ ' I) .3 ; H.D ' 4 5  ' I)  .0 ; J .C ( 1 5 '   I) .0 < J.B ) 1 6 '    I) . / <J .A 7 0 6  (     I) d / <5  dM8 0 6   (    I) c. =3 cK9/ 7   (   I)c. =!0cJ;/ 7   ) I)       =$/  I<       7   )I)    =&-  G=  7   *I)              >)    F?          8 ,     I)  >,F?  8 .    I) >. 8 Yo)    >0 8   Op)          ?9         9    Op)   !!     ?:        9 Op)     ?9      9P q)      @7     :Rt)       @5      :a)     @4    :a)    @2    : a)         A0          ; a)   A.    ; a)   A-   .V ; a)   A+"  /V ; a)           B '%)    /V      <a)      B"()  0U    </8)           B*(   18       <, 4) PB,(P(6A+1) C B/(C ( 5A*1)CB 1'C) 3A * 0)CB E&C*3A ) 0)D B C&D * 1A ) /)E B.%E  0A )   )GB,$ U(. .A ) ))2($  R(. ,+*     ))2&9 Q(.,+*))2%9 P(.*++ ))2=8   O(. )+,  ))%?2<8   N(. '+.    ) )  2;7   N(.  &+ 2  !.'F )   2%7        .  $+   6  -'F ) 2&6  . #+  8  ,'F V'gU'p%6         .  " U'% 9  ,'F  S'g R'p&#.    R'%(  ,'FR'gQ'p&!.   Q'% (  ,'FQ'gP'p'.  ( P'% (      ,'F P'g O'p'      . !'  O'%  )         F O'g N'p'        . "%  N'%  )    F O'g N'p(     . !$  N'%  *       F      g     p( *    . "#       %  +     F  g p(  (    . #! %  ,    F        g       p( &    . E         %  /  F gp $     . N% a     F gp#        .L % a     Fg  p!  .L %   a  F    g       p .K      %    a   F     g!       p .g      %    a ! F   gj   p         .g    %  a  F   g   p!     .g    % a   F   g   p"3        .g    %a        F   g   p#,p    %a  F   g   p#,,o     %( 'vH4  F      g      p$+,p        %(&lH F g p%*,  %(%jI       F gp&), %( %jI      F  gp (, %( $jI      F       g      p'+'[        %( $jJ)    g   p)&5&\     %(      )    g    p5       %(        )aa5 ( )aa5 ()aa5 ()aa5 (    )aa6 (       +bb7(        /dd;(      (    (( ( (     )     uJ(.3$ !USUS.,  Q@8N:\9951\995118\PUERTO~1.TIFN:\9951\995118\Puerto Rico eval map_2.tifh ]&/j uh     ^ WPC5 w 513+%.v 8ll6Body Text &&&S\  `&Times New RomanSS\  `&Times New RomanS$35;?CGKOS11)11111118z6Heading 1   XXXS\  `&Times New RomanS     S\  `&Times New RomanS H:\MURAWSKI\LATESTMO\1CPOSTAG.TIFWPC   !!!"""###$$$%%%&&&'''((()))***+++,,,---...///000111222333444555666777888999:::;;;<<<===>>>???@@@AAABBBCCCDDDEEEFFFGGGHHHIIIJJJKKKLLLMMMNNNOOOPPPQQQRRRSSSTTTUUUVVVWWWXXXYYYZZZ[[[\\\]]]^^^___```aaabbbcccdddeeefffggghhhiiijjjkkklllmmmnnnooopppqqqrrrssstttuuuvvvwwwxxxyyyzzz{{{|||}}}~~~o}sϏO/??oL߯O? ?O??O???̅{3OD_/_3߬.7_/o.ߓ3o/_2;)ߜ?A?>2_?_O/+.? ?5_/o+_?1oo//_7) O:+?AO=?0/=?$o-+?._ O??4+0?/"4?)$_8+o@o=??O/;?'?.+?. ?3_,/?/$3?O*&_6+@=?OO. /? ?: O_/?.?*?. 2_ _o/ ,.o Oo? o0&_2O*/&6+@<O- O_?8_  _ .O*?.o1_? ,??- O 0&_1*O'5*? ?<￟? ߿_. ?7/ ??0Ͽ? ߂0o __2/ _-߿/ ?Ͽ. 2 ￿O 1￟? ߿_.Ͽ? OO 6 ς?_ <￟? ߿_ ??0??6/ ?2 o3 /3/O0 0o4? _ 3 ??2  7? ?> o? ?? ?O/__5/ /2 3 3?0 /0o/4? ? ?3 ?O2 / _7? ?> ? ?_ _0O5O _?2 3 20 ?/?4 _ 2 _2 / 6 > > O /4 _?2 3 ?3?/?0 ??/_o4 ? _2 3  _6 = O>  /?/3 ?2 ᅬO?3? 2_1 ??/o4  2 3  5 ??=_>  .?3/ 2 Q? ?21 ?./4 _ 2 3 ? 5 Z>  ?.2 ?/2 Q????2?߿1 o.o￯4  2 ?3  _5 Z> ??.oM o$3 Qo??2?M .?Q  O2?4  /5 Z/?? =???.?N [ Q??1?N .?Q /?2??4 ? 5 Y O=????.?M \ QO??1?N .Q ??2??4 O 5 Y_ <????.?L \ Q/ ??1/N . Q ??2??4  4 X__ <????.?L/ o] Q? ??1 M . P ?O2??4  4 X <????.?/K ] Q?? o??1 M . oP ?2??4  4 X?// ;????.O J O^ Q? ??2 M .O 2??4 o 5 W O;????. ?J/ ^ Q? ??2 L .? oO  2??4 ? 5 Wo :????. H ^ Q?/ ??2_ K . N O3??4 /?5 W__ :????/ G ?_ Q? ??2 J . M _3??4  o5 V :????/ Fo _ Q? /??3 I /? L /4??4  5 V? 9????/ _D/ _ Q? ??3 H / K o4??4 _6 U _9????0 C ` Q? ??4/ OF 0O ?I o5??4 _6 U 8????1/ o@ ?` Q?o ???4 E 0 H /6??4  6 UO _ 8????1 ? _` Q? ??5?C 1F //6??4 _7 T  8????2= ` Q? ??6__A 2?D /7??4 O7 TO  7????3?; ` Q?O O??7_? 3oB __8??4 _ 8 So  _7????49O ` 8? ??8o> 4A ߿/:??4 _ _9 :  6????5/8? a!8?  ??9?< 5/?_;??4 / ?:!:? O 6????6_?6? a!8? ? o ??:/: 6?_=_=??4 ? O:!9  /6????85? a!8?  ??;o9 8<????4 ? o<!9_ 5????9_3? a!8?   ??=/O7 9??:o<??4=!9o _5????;/2? a!8? /  ???6 ;9:??4o>!9 4????=?0? a ߃9?  ??@_5 <_7 O/8??4o@ σ9/O 4????>/? a Q?  / ??B?_3 >O/6 o O6??4B P /4????@O.? a Q?  ??D/2 @?/5 _ 5??4?B P_ 3????B/- a Q?  ??F_2 B/4 ? 4??4  A O_o _3????D /, ` Q?o ???G_1 C_4  3??4 o @ O 2????Eo o, ` Q? ??I/ 0 E? 3 / 2??4  ?@ O/? 2????G + ` Q? ??K ?0 G 3 / O2??4  ? N ?2????H/ _+ O` Q?O O??L / H 2  1??4 ? > No 1????I_ +` Q? ??M O/ I/ 2  1??4  ?> N(o1????J/ +O _ Q? ??N . J 1 O 0??4 o = M)1????K O+ _ Q?? o??O . K 1  _0??4  < M?*0????L + O_ Q? ??P? o. L_ ?1 /0??4  O< L+?0????M + ^ Q? ??P ?. L 1  /??4 ? ; Lo,/??OM +_ ^ Q?/ ??Q./MO 1  /O4  : L?? o/_oM + /^ Q? ??Qo .?M 1  /4 _ O: K /o?N , ] Q? /??Q .OOM 1  /?4  9 KO? .??N, ?] Q? ??Q .o?O 1  /?4  8 Jo ?./ ON?, \ Q? ??Q.?O 1  / O4 / O8 J - OO?- \ Q?o ???Q?.OO1  05  7 J/o ./OOO. [ Q??Q_/N?1 / 0OO5 _ 6 I .OO_._?/ Z Po/?1o/Oo.ooo1  0_5  O6 I ? -OO.0/ X 1?O?1?O///??o1  /1O4  5 )_! ?- O/O/_0 /W _?1??1?/0/?2  2/O5 / 4 O?(?" -/O_/_?2 /#1 1??11_?/?2 O 2_5  /4 '# ?-_O?0?_3_ / ?1 1? ?12 o02  _4O?6 _ 3 '?o# -O? 0?o?4/ 1 1 ?1O3_ 0o3o  4 6  2o ?&$O O- ? o1?_5/ o1 o1 ?0_?413? O 6? o7  1? ?&?/% -? O _1?7/ 1 /1/ ?0?_5 oO24?  _ ?7 _7 / O1? %& _- _  ?2 O _9/ ߏ/-Ͽo ? O-_? ?0 ? 7 ?/2 ? ? 1߿ Ͽ_ /8 ?4￟/ o ?(ϯ_ ?/ "/_߿/ o+ ?  ? 3 o_ _;_/oᅬ_ -?,?,o ?0 /? 9_ ?ߏ2 O 2(/: ? 5?o_(-"O o+ ?  OO/ 4?? >?/-/,?,_ ?0/_o? ; /_O 3Oo? 3'o= OO/ 6?O(-"? ?, O_/  /5!@O$/-?,? ?0!O=?4!/3%?/7/?'-" /-/ o6oC? 0-?,__?0@o65#?Co7 '-O"/o _9ϏO_G__2-,??1o?C_o9?6/_F_9'-?!o0__/?ϟo?/Lo/?5﮿,ϐ?6O/_HOO?_/O9ߝN_/;'߭!ߒ3_/ϟO?/?_G߿??/?ORo????_Ƈ;o???_OϏ????oHϯo???OϟO?/?_lϟO?/?_AJPO?[?_o/Oo?P/[_O Po[??/   $.O]  TO)F 0ooo/?_No%?c o  O&/-] _ TO+G O/?/L??$c  &/.] OU*OG .?Jo$c /'o._oWO,I0Ooϯ/H$c O(.O/`/_YO-I?0/ _G$Od ?(.a_o o?Z?-J0??O F%d ?(o /Z-??JO0o/ /)??O [oo.oJ/0O_?)? /\?O/o??-J/0_O?o(O] /o-I_0o__O ?/o _?߃?/o//__?/o? ߏ?/ _?o?? /o/?oO?? ?ߏ?O?O o_ o?? ߂o?__O?_ _o//?/O//o?ߏ?__/Oo? O?o _?_/O _?o___/O/_o o /??_ ?  ?_/  ?? ??__    OO_O__?/ _ O  o? ? ?_?/ ? ??? ??? _?O_ O /_o_? O? _ o _ // o  /  O?_/ oO   ?/ ??/  / ? ???? oo/ oo/ o_? __/?/ _ߟ/_? ?_?oO   O_/ o/ o o/o/  o _ OOo?? //_ _?߯_/o _/o __? _ ? _o /  ?oO  o / o_ ?/? ? /o ? ? ?o_ //? __ _//? _oO /o_? /? /oo/??  ? ?O/ _ /  oO ? O/  O o/ _  _/ o  _/? o//_? _ o??oo_? _ / Oo/_? /?O? ? /_O //? ?/ O o /?     _ ? _ ?OO_o   ?// ?_o_ /o_   ?/߿/?/_  / O??/? O  / /o _ o_O/ O//  ?? O_   !_/ / _ Oo/o   _O ?/ ? _O _ o/ ??// O _/ O?/_   o    /_?? O߿? /_ _ o/ ?_? O o" O ? ?/_? /? O/ o O/  /?   //O/  // O? __ o /  ?ooO _  ??#/O _ ? /o  _ /? ?_ O_   ?O_Oo_ ?  / _ ? O ?_O/?  /?O /O  #  ??? /? ?   _o   oo O OoO_? /O? O_O/ _/ o _o ?_ _ # / ?o O?o?O _  ?/OOo_ ?/??  _ _?o?/??__  ??_? ?? ? Oo _O? ?/  // / #o O  ?o   O?O_O//  _  //__ ? OO_o/_/_  ?? /_?_/o _ oo  ?/ O$   ?O? _o ? ?/  /?  /  _// _/ o/ oo  _ ooo/  ?/ _  _  ?$   o O  ?_ OO   _? OO _?ߏ _/ O_ o _ _/o ?? _ _oO  _? /? ? /O o$? O/ ?/ O_O  o_??   o  o OO?o _?_/o  ?o?? / /? O  /o /o   o  O ?$? ? O__??/O  ?/O? _"_  ?O   _  /O   ??_ _ ?// o /o o ???o? ?    _ # o _?oo o O/O%/ ?  _  ?? _ ?_O O_??oO/  /  ?? o?O o /  ? o$  /o?O?_  /+/   /?  _ _ /? _O/o/?/  O  o ?? ? _ _ _/O?$o  _?oo_? ?O ?+_ O    O  _/? oO   _ o o _ //  /__O?o$/  / ?Oo_?//  ?+ O _   _ O  _o/O?? ?/?  _ //__o   _  ?_$? ? O O///_ ? o_  /O    _  /OOoO??//o??_ O_ / /? o/ / /  ??  o ?#_  o /__O ?_ O?/  o/   _ O  ? O  ?/_?/ ? oo_??o  ?  /?O O/  _?? o /  // ?O$ / o?/ ? ?/ __o O O/  o  /? o o O   O  o / _? ?/   O /O _ ??  ? _ ? ?O/O/$? _O/ o O O ?_/  _?? /  _ /  o O?? ?/ OO/?o? oo? o ?o _ O/    _oo/_$ / ? ߿  ?_/? OOOߏ/ O ? _ oO  ? oOO_?ߟ?o ?/?O/oO// _O / ?_ _ ??????O?   /!o O_ߟ/O  oO/oO? _o/??? o/Ϗo / _ oO? /o?o????/o??__oo ? ?OO/      ? ?  _!O / ? ?O ?_  o _  ?  /  o /?_ _??/_   ?  /?? / _   _ o_?/ Oo  ? oo O? _?  o ? /?/ ? O  ? ? //? o  O  ?  o  _   //_ ?O/?߄  O?/!ߊOO/oτ?o ?OO?_  _? o?/_ ߄  OO?o?oO _?O  //o ?? 4߿%_V _@aD\߿m߿`Ͽ*Ͽ)Ͽ@\bi\Ooj_\_Poj?\?Q /jo[oQ_? j[Qoko[oQ??l/[/Sn?Z?S_ /noZX߯oq???o?????/??_O??/?__????????_??o????o?/???/???????_/???o??__???????/OO?o??_????/o??o???/??O_????_????//??_???????__?/??OO??????OO??_o__??_o_????O???o߿/??__????/?????/_??/??O????_????o??/?__???O/????????o????o_????_????/O??o??o_????/??/????o??????߿???__O/??oϿ/O??????/???_O/oO??/????O????/?/_???_????/???_/???_o_????/?o???__??o????oo???/?/???/?????????/O???????/_O?OO?????o????_???O/???o????/O???O??o????O??o??_???????O????o_?/??O????????????o??O_?/??/OO??o_o/???o?_Oo??/??OO?O???????o??o?/O?????O/OO??o????O/o/OO??_?/OO_OO__?o/?oOoooo_O?OO/?O??O/??o/O_?O/O_/_????/?/O/O??/O__?/??_??O_/?_O??__/???o_O?_?oO??o?/?O_ooo?OO?o?_/oo?_??O?o???/?O_?///??_oO?_?_/O?__?O_/ߏ/Ͽo?????????????????O_????/??߿Ͽ_/?￟/o?ϯ_????????????????//_߿/o??o___/oᅬ_??o?/?_?ߏO/??o_Oo?OO/??????//?_?/_o?/_OOo?oOO/?O??O_//O???O?///?//oo??__?o?oOo_ϏO___??o?_o?/__?o__/ϟo?/o/?￿Ͽ?O/_OO_/O߿_/￿߿￿߿_/ϟO?/?_߿??/?Oo????_o???_Ϗ????oϯo???OϟO?/?_ϟO?/?_O??????????_o/Oo?????/_Oo??/OOooo/?_o?oO/_OO?/??/OO?o/ooOOoϯ/OO//_O?/_O?_oo????O?o/??Oo//??Oooo/O_??/?O/o??/_O?oO/o_o__O????/o_????????/o//__?/o?ߏ?/_????o?????/o/?oO?????ߏ?O???Oo_o??o????__O???__o//?/O//o?ߏ?__/Oo????O?o_????_/O_???o___/O/_oo/??_??_/????__OO_O__?/_Oo???_?/???????_?O_O/_o_?O?_o_//o/O?_/oO?/??//?????oo/oo/o_?__/?/_ߟ/_??_?oOO_/o/oo/o/o_OOo??//__?߯_/o_/o__?_?_o/?oOo/o_?/??/o???o_//?___//?_oO/o_?/?/oo/????O/_/oO?O/Oo/__/o_/?o//_?_o??oo_?_/Oo/_?/?O??/_O//??/Oo/?_?_?OO_o?//?_o_/o_?/߿/?/_/O??/?O//o_o_O/O//??O__//_Oo/o_O?/?_O_o/??//O_/O?/_o/_??O߿?/__o/?_?OoO??/_?/?O/oO//?//O///O?__o/?ooO_??/O_?/o_/??_O_?O_Oo_?/_?O?_O/?/?O/O???/??_oooOOoO_?/O?O_O/_/o_o?__/?oO?o?O_?/OOo_?/??__?o?/??__??_????Oo_O??////oO?oO?O_O//_//__?OO_o/_/_??/_?_/o_oo?/O?O?_o??//?/_//_/o/oo_ooo/?/__?oO?_OO_?OO_?ߏ_/O_o__/o??__oO_?/??/Oo?O/?/O_Oo_??ooOO?o_?_/o?o??//?O/o/ooO???O__??/O?/O?__?O_/O??__?//o/oo???o??_o_?oooO/O/?_??_?_OO_??oO//??o?Oo/?o/o?O?_///?__/?_O/o/?/Oo???___/O?o_?oo_??O?_OO_/?oO_oo_///__O?o//?Oo_?//?O__O_o/O???/?_//__o_?_??OO///_?o_/O_/OOoO??//o??_O_//?o///??o?_o/__O?_O?/o/_O?O?/_?/?oo_??o?/?OO/_??o///?O/o?/??/__oOO/o/?ooOOo/_??/O/O_???_??O/O/?_O/oOO?_/_??/_/oO???/OO/?o?oo?o?o_O/_oo/_/?߿?_/?OOOߏ/O?_oO?oOO_?ߟ?o?/?O/oO//_O/?__????????O?/oO_ߟ/OoO/oO?_o/???o/Ϗo/_oO???/o???o????/o????__oo??OO/??_O/??O?_o_?/o/?__??/_?/??/__o_?/Oo?ooO?_?o?/?/?O??//?oO?o_//_?O/?O?/OO/o?????o?OO????__?o?/_OO?????o?oO_?O//o??߿__߿߿ϿϿϿo__o??/oo_?ooo?????//??_/o߯o@DH:\MURAWSKI\LATESTMO\1CPOSTAG.TIFH:\Murawski\Latest Models\1cpostag.tifT4b̤"ͤͤnJ' ']&I{s u& !USUS.,  _XɂXXXEH*0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(##XɂXXXɂ=#XɂXXXɂ   \XXɂ_Census_Ԁ2000_Evaluation_Ԁ_A_.8(#(# ?)' xdEx? : 0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(#July17,2001I(#(# # \ \%# \ \#XɂX \P#XXɂ_Puerto_Ԁ_Rico_Ԁ_Focus_Ԁ_Groups_Ԁ  1 _on_Ԁ_Why_Ԁ_Households_   _Did_#R#Ԁ_Not_#-#Ԁ_Mail_Ԁ_Back_Ԁ_the_Ԁ E  _Census_Ԁ2000_Questionnaire_#XɂX월# \XXɂ G  # \ \# \ \# \ \ ##XɂX \# \XXɂ3 ] \??US.,FINALREPORT#3X7X3 ]o#Ԛ#XɂXX3X7Ȏ#?X7XXXɂUS.,??., 3  #XɂXX?X7#XɂXXXɂThisevaluationstudyreportstheresultsofresearchandanalysisundertakenbytheU.S.Census  Y  Bureau.Itispartofabroadprogram,theCensus2000Testing,Experimentation,andEvaluation E (_TXE_)Program,designedtoassessCensus2000andtoinform2010Censusplanning.Findings 1 fromtheCensus2000_TXE_ԀProgramreportsareintegratedintotopicreportsthatprovidecontext  andbackgroundforbroaderinterpretationofresults.#XɂXXXɂ#3X7XXXɂԀ#XɂXX3X7 #3X7XXXɂ3 ]X3X7   # \3 ]L ##XɂX \k #XɂXXXɂ \XXɂ   `     h     0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(#Dr.Susan_Berkowitz_,S!(#(#    `     h     # \ \ #  \ \_Westat_# \ \ # \ \ " ?)' )xdE#x?   `     h    # 0  0` (#(#0 ` (#` (#0 (# (#0h(#(#0h(#h(#0(#(#Linda_Brudvig_,ProjectManager #& Planning,Research,and %`  EvaluationDivision x J&!(#(# # \ \0# \ \#XɂX \ #  ZXXɂ#XɂXZ##XɂXXXɂ#  nA:*&`z0S-&< `(*E?*<J<J*n (#(# (#(# (#(# (#(# (#(# (#(# (#(# (#(# (#(#(#(# - )" H* H  H  _____________________________________________________________________________ T,'+ IntentionallyBlank/XXɂ 3i/  @-(, E E  X8ɂXXdd8 E    # Xj X 3i# }  X Xj#   }#   CONTENTS               @*$(#X$#XɂX #EXECUTIVESUMMARY""H(#.H H iii & 1.  BACKGROUND""J(#. 1  2.  METHODS""J(#. 2     2.1  Developingasurveyandprotocol""J(#.RR02 r    2.2  Trainingdatacollectors""J(#...(4 ^    2.3  Collectingthedata""J(#. #4 J   0  2.4  Applyingqualityassuranceprocedures""J(#.58#XɂXXXɂ3#XɂXXXɂԈ6 (#(# 3.  LIMITS""J(#.8 ^  4.  RESULTS""J(#.p p 9 6    4.1  Motivationalandprocessrelatedreasonsformail_nonresponse_`"`"I(#.\\M10 "   4.2  Practicalandlogisticalreasonsformail_nonresponse_`"`"I(#.22E13    4.3  Culturalandpoliticalattitudinalfactorsformail_nonresponse_`"`"I(#.O14    4.4  Reasonsrelatedtoquestionnairecontentanddesignformail_nonresponse_`"`"I(#.X17    4.5  Summary`"`"I(#. 21#XɂXXXɂ#XɂXXXɂԈ    5.  RECOMMENDATIONS`"`"I(#. 23 Z   5.1  Recommendationsgrowingfromreasonsformail_nonresponse_`"`"I(#.ffI23 F   5.2  Overarchingrecommendations`"`"I(#.hh+25 2 References`"`"I(#.$$26  Z  (                  (5h832! !AppendixA1:PuertoRicoEvaluation!EnglishVersion`"`"I(#.RR>27 2 AppendixA2:PuertoRicoEvaluation!SpanishVersion`"`"I(#.jj>29  AppendixB1:PuertoRicoEvaluationFocusGroupProtocol!EnglishVersion`"`"I(#.\\S31   AppendixB2:PuertoRicoEvaluationFocusGroupProtocol!SpanishVersion#XɂXXXɂ#XɂXXXɂ`"`"I(#.T33    (          AppendixC:PuertoRicoEvaluationObservationSummaryforFocusGroups`"`"I(#.BBR35 !                "(         z.)- @*(#(#K(#________________________________________________________________________________ @-(, IntentionallyBlank ,.|)-  XXɂ   EXECUTIVESUMMARY   #XɂX T$#v$FiftythreepercentofthehouseholdsinPuertoRicoreturnedtheirCensus2000questionnaires  bymail,alowresponseratewhencomparedwiththenationalrateof65percent.ButCensus  2000wasthefirsttimethatresidentsofPuertoRicowereaskedtocompleteandreturntheir  questionnairesbymail.(Statesidehadbeenrespondingbymailsince1970.)In1990, t  enumeratorshadgonedoortodoortocollecttheinformationfromallidentifiedhousingunits, `  andhadbroughtthequestionnairesbackwiththem.In2000,the#XɂXXXɂg!#XɂXXXɂupdate/leaveprocedurewas L  used.GiventhatCensus2000wasthefirsttimehouseholdsinPuertoRicowereaskedtofollow 8  newprocedures,a53percentmailresponseratewasrespectable.Still,thereisroomfor $ t  improvement. `  Towardthatend,thisevaluationexploredthereasonsresidentsofPuertoRicohadn'tmailedback 8  theirCensus2000questionnaires.WeconductedfocusgroupsinninesitesacrosstheIsland $  with41householdheadswhohadn'treturnedtheirquestionnairesbymail.Siteswereselected   forgeographicandsocioeconomicdiversityfromamongmunicipalities(_municipios_)withlower   thanaverage(under50percent)_mailback_Ԁresponserates.Althoughinterestingandsuggestive,  theseresultsarebasedonasmall,purposivesampleandcannotbegeneralizedtothePuerto  Ricanpopulationasawhole.However,theydoprovideausefuljumpingoffpointforfurther p thinkingandresearch. \ Participants'reasonsfornothavingreturnedtheirCensus2000questionnairesbymailfallinto 4 fourclusters:  p K1` hp x (#(#K =456789:;<(y8#XɂXXXɂx'# XɂXXXɂ  0  #XɂXX Xɂ-#XɂXXXɂMotivationalandprocessrelatedreasons.Severalparticipantswereunclearaboutor H misunderstoodthecensus'purpose,includingthinkingithadtodowithtaxationor 4 assignmentofwelfarebenefits.Considerableconfusionexistedovertheprocessby   whichthequestionnairesweredistributed,therulesforreturningthemandespeciallythe   roleofenumerators.(#(#  (5h8y=456789:;<=-#XɂXXXɂE.# XɂXXXɂ  0  #XɂXX Xɂ0#XɂXXXɂPracticalandlogisticalreasons.Lackoftimefiguredasareason,especiallyforworking   mothers,asdiddifficultiesofmailingandgettingtothepostoffice,especiallyfor l! residentsofinteriorcommunities.X" (#(# #XɂXXXɂM1# XɂXXXɂ  0  #XɂXX Xɂ2#XɂXXXɂCulturalandpoliticalattitudinalreasons.Theseincludedfearsthattheinformation 0$" wouldn'tbekeptconfidential,whichmightresultinlossofgovernmentbenefits,aswell %l # asthebeliefthatanyfundsthatwouldbeallocatedwouldonlyendupenrichingdishonest &X!$ politicians.Participantsalsoexpressedastrongpreferenceforamorepersonalapproach &D"% tocollectingtheinformationasbeingmoreappropriatetoPuertoRicanculture.'0#&(#(# #XɂXXXɂ3# XɂXXXɂ    0  #XɂXX Xɂ5#XɂXXXɂReasonsrelatedtoquestionnairecontentanddesign.Someparticipantswereaffrontedby )%( theraceandethnicityquestions,whichwereseenasdivisiveaswellasinappropriateto *%) therealitiesofPuertoRicansociety.Thesequestionselicitedthestrongestnegative +&* reactionsofanyofthequestionsfromparticipantsincoastalcommunities.Participants |,'+ _acrosstheIslandalsocomplainedthatthefinancialquestionsonthelongformweretoo h-(, intrusiveanddifficulttoanswer.Overall,thelongformwasseenasexcessivelylong, T.)- overlycomplex,andhardtounderstand,especially(butnotonly)forpersonswithlittle  formalschooling.(#(# AlmosteveryonehadheardsomethingaboutCensus2000fromtelevisionandradioads, t newspapers,schools,orinformalsourcessuchasrelativesandneighbors.Butinmanycases, ` advertisingeffortshadfallenflat.Somecomplainedthattheadvertisingwastoomuchlike L  politicalcampaignhype,whichmadethemleeryofitstruepurpose.Othersfeltthatthe 8  advertisinghadoveremphasizedtheimportanceofreturningthequestionnaireandfailedto $ t explainsatisfactorilythecensuspurpose.Ofthe41nonrespondinghouseholdheads,virtually  ` everyoneurgedareturntothesystemofcollectingdatadoortodooraspracticedin1990.  L  Fromthosefindingscomeourrecommendationsforimprovementsandforfurtherresearchand $  exploration.However,therecommendationsareonlytentativeandsuggestive,pendingfurther   researchwithastatisticallyrepresentativesample.Keyrecommendations:   #XɂXXXɂ5# XɂXXXɂ  0  #XɂXX Xɂ=#XɂXXXɂProvidemorecomprehensiveinformation,indifferentforms,onthepurposeand   usesofthecensus.Thisinformationshouldbepresentedinawaythatallays p misplacedfearsanddirectlyaddressescommonmisconceptions(suchasthatcensus \ informationwillbeusedfortaxationpurposes).Disseminatethisinformationin H differentvenuesandthroughavarietyofcommunitychannels(suchasschools, 4 churchgroups,neighborhoodassociations). p(#(# #XɂXXXɂ$># XɂXXXɂ  0  #XɂXX Xɂ@#XɂXXXɂConductfurtherresearchinPuertoRicoonviewsandperceptionsoftheCensus H 2000questionsonraceandethnicity,whichdrewsuchstrongnegativereactions 4 fromparticipantsinmoreurban,coastalcommunities.   1      ׀Comparethistosimilar   relevantresearchconductedstatesidetotrytoestablishcommonaltiesand   differencesbetweenthePuertoRicancaseandothers.(#(# #XɂXXXɂA# XɂXXXɂ  0  #XɂXX XɂC#XɂXXXɂUsethefindingsandrecommendationsfromthisstudy,aswellasothersupporting  testingandresearch,todevelopadvertisingappealsforcensusparticipationmore l attunedtothePuertoRicanpopulace.X (#(# #XɂXXXɂC# XɂXXXɂ  0  #XɂXX Xɂ@E#XɂXXXɂConsiderusingtheresultsofthisstudytocreateacloseendedsurveytobe 0"  administeredtoaprobabilitysampleofresidentsoftheIsland.Thesurveycould #l! seektherespondents'viewsofdifferentapproachestodatacollectionforthecensus $X" andtheirreactionstothecontentofanynewmaterialsoradvertisementsdeveloped $D # onthebasisofthespecificrecommendationsofferedabove. %0!$(#(#  XXɂ  (#'    >/V1.BACKGROUND   #XɂX G#HFiftythreepercentofthehouseholdsinPuertoRicoreturnedtheirCensus2000formsbymail,a  lowresponseratewhencomparedwiththenationalrateof65percent.ButCensus2000wasthe  firstcensusinPuertoRicotoincludeamailbackcomponent.Indeed,procedureschangedgreatly  betweenthe1990and2000censuses. t  In1990,eachofthemorethan1.1millionhousingunitsthenidentifiedinPuertoRicowas L  visitedbyanenumerator,whobroughtbackaquestionnaireforthatunit.In2000,thePuerto 8  Ricangovernmentchosetousethesamequestionnairecontentaswasusedstateside.The $ t  update/leaveprocedurewasusedfordatacollection.Morespecifically,theofficialprocedures `  wereasfollows: L  #XɂXXXɂE# XɂXXXɂ  0  #XɂXX Xɂ+L#XɂXXXɂBetweenFebruary28andMarch2,2000,theU.S.PostalServicedeliveredanadvance $  letteraddressedto"ResidentialCustomer"toallhousingunitsinPuertoRicowithmail   delivery.OnesideoftheadvanceletterwasinEnglish,theotherinSpanish.The   advanceletteralertedhouseholdsthattheCensus2000questionnairewouldbedelivered  soon.(#(# #XɂXXXɂL# XɂXXXɂ  0  #XɂXX XɂN#XɂXXXɂBetweenMarch3andMarch30,2000,censusenumeratorsdeliveredamailingpackage \ addressedtothehousingunitorcontaininggeocodeinformation(assignmentarea,block H number,andmapspotnumber).Iftherewasnoaddress,adescriptionofthehousingunit 4 (suchas"thewhitehousewiththeredtileroofnexttotheDairyQueen")wasavailable  p ontheenumeratorlistingpage,butwasnotfoundonthemailingpackages.The  \ questionnaireswereinSpanishandincludedan800numbertocallforhelp,ifneeded. H PersonswishingEnglishquestionnaires(slightlydifferentfromthestatesideversion) 4 couldgetthembycallingthehelpnumber.Asonthemainland,about83percentof   householdsinPuertoRicoreceivedtheshortform,andabout17percent,thelongform. (#(# #XɂXXXɂN# XɂXXXɂ  0  #XɂXX XɂS#XɂXXXɂBetweenMarch27andMarch30,2000,theU.S.PostalServicedeliveredareminder  postcardto"ResidentialCustomer."Thiswasalargepostcard,halfinEnglishandhalfin   Spanish,thatservedasathankyoutothosewhohadmailedbacktheirquestionnairesand l! aremindertothosewhohadn'#XɂXXXɂbS#XɂXXXɂt.X" (#(# SinceCensus2000wasthefirsttimerespondentsinPuertoRicowereaskedtoreturntheir 0$" questionnairesbymail,theremaybereasonspeculiartoPuertoRicoforamailbackresponserate %l # lowerthanthestatesiderate.Thepurposeofthisevaluationistoexplorethereasonsthatmore &X!$ respondentsinPuertoRicodidn'treturntheirCensus2000questionnairesbymailandtoseehow &D"% thesereasonsmayvaryacrossdifferentpartsoftheIslandandamongdifferentdemographic '0#& groups.Byprovidinganindepthunderstandingofthereasonsformailbacknonresponsein ($' PuertoRico,thisevaluationwillhelptoinformandimprovefutureCensuseffortsontheIsland.L   2       )%( ЇThisreportpresentsfindingsfromtheevaluationandrecommendationsforfuturepracticeand  furtherresearch.However,giventhattheyarebasedonfindingsthatcannotbegeneralizedto  thewiderpopulationofhouseholdheadsinPuertoRico,theserecommendationsareonly  tentativeandsuggestive,pendingbroadercorroboration. t      `     h  XXɂ   2.METHODS  8  #XɂX Z#ZTheevaluationusedaprimarilyqualitativemethod.Weconductedfocusgroupsbetweenlate 8  JulyandearlyOctober2000,withapurposivesampleofhouseholdheadsinnine-@   3      ׀communities#XɂXXXɂU#XɂXXXɂ $ t  ЀacrosstheIsland,toexplorethereasonstheyhadn'tmailedbacktheirCensus2000question `  naires.Eachparticipantreceived$20fortakingpartinagroup. L  Focusgroupsarewellsuitedtoachievingthepurposesofthisevaluationfortwomainreasons: $  #XɂXXXɂy\# XɂXXXɂ  0  #XɂXX Xɂ^#XɂXXXɂFirst,asaformofqualitativeresearch,focusgroupsallowindepthprobingofthe   respondents'viewsintheirownterms,ratherthanhavingthetermsassumedorimposed  onthem.Whilethesebenefitsapplytoanygroup,thisopenendedapproachis  particularlyappropriatetogroups"whoseassumptionsmaydifferfromthoseofthe p mainstreamculture,andwho,therefore,haveaparticularneedtospeak,andbeheard,'in \ theirownvoices'"(Berkowitz,1996:54).Becauseoftheirdistinctivestatusascitizens H livinginaUnitedStatescommonwealth,residentsofPuertoRicomaywellhavea 4 perspectiveonCensus2000thatisdistinctfromthatofhouseholdheadsinthemainland  p UnitedStates. \(#(# #XɂXXXɂn^# XɂXXXɂ  0  #XɂXX Xɂ-b#XɂXXXɂSecond,focusgroupsbringtogetherasmallgroupofpersonswithcertaincommon 4 characteristics,makingthemparticularlysuitablefordiscussingagiventopic.Focus   groupsdifferfromintensiveinterviewsandothertypesofgroupinterviewsintheir   emphasisoninteractionandinterchangewithinthegroup."Whatemergesfromafocus  groupsessionisagroupgeneratedresponse!presumablysomethingdifferentthanthe  sumofwhatparticipantswouldhavesaidifeachhadbeeninterviewedseparately"   (Berkowitz:60).Thetopicofthisevaluation!reasonsfornotrespondingtoCensus2000 l! bymail!isverysuitableforgroupdiscussion.X" (#(#  XXɂ2.1Developingasurveyandprotocol  0$" #XɂXe#WedevelopedEnglishandSpanishversionsoftwoinstruments:1)abriefsurvey,usedtoscreen &j!$ forpotentialparticipantsand2)aprotocol,usedinconductingthefocusgroups.Inaddition,we 'V"% designedanobservationandsummaryformfordescribingthecontextanddynamicsofthefocus 'B#& groupandforsummarizingthemainthemesofthediscussion. (.$' >/V  >XX >  XXɂ2.1.1Surveytoidentifyfocusgroupparticipants  #XɂX]h#Thescreenersurveyidentifiedpeoplewhometoureligibilitycriteriaandwerewillingandable  toparticipateinthefocusgroups.Italsocollectedbasicdemographicdataaboutthesepeopleto  useinselectingabalancedmixoffocusgroupparticipants.Copiesofboththesurvey'sEnglish t andSpanishversionsappearinAppendixA. `  Afteranintroductionexplainingthepurposeofthestudy,thesurveyaskedtheindividualsifthey 8  hadmailedbacktheirCensus2000questionnaires.Thosereasonablycertaintheyhadn'treturned $ t theCensus2000questionnairebymailweredeemedeligibletocontinue.Theywereaskedafew  `  questionsaboutthemselves(lengthoftimeinresidence,householdsize,education,occupation,  L  andwhethertheyreceivedthelongformorshortform)andwererequestedtocompleteabrief 8  checklistofreasonstheyhadnotreturnedtheircensusquestionnairebymail.Thefinalsection $  ofthesurveyprovidedfurtherinformationaboutthefocusgroups,askediftherespondentwas   willingtoparticipate,andcollectedcontactinformationfromthoseindicatingtheywere   interestedintakingpart.   XXɂ2.1.2Protocolforguidingfocusgroupdiscussions p #XɂX^n#Thefocusgroupprotocolhelpedguidefocusgroupdiscussions.Itaskedaseriesofopenended \ questionsaboutreasonsfornotrespondingtoCensus2000bymail.Thequestionsbuiltonone H anotherchronologicallyandthematically: 4 #XɂXXXɂb# XɂXXXɂ  0  #XɂXX Xɂ7p#XɂXXXɂThefirstthreequestionsaskedparticipantstothinkbackseveralmonthstothetimewhen  \ theyfirstheardaboutCensus2000andreceivedtheforms.QuestionIfocusedon H participants'recollectionsof,andreactionsto,theproceduresfollowedindistributingthe 4 Census2000advancelettersandquestionnaires.Thiswasanicebreaker,alsoimportant   ingaugingreactionstotheproceduralchangesthatoccurredbetweenthe1990and2000   censuses.QuestionIIaskedparticipantstodiscussthesocialcontextssurrounding,and  sourcesofinformationabout,Census2000beforereceivingtheformsandafterwards.  QuestionIIIprobedhowfarintheprocesstheparticipantshadgonebeforenotmailing   backtheirquestionnaires.l!(#(# #XɂXXXɂp# XɂXXXɂ  0  #XɂXX Xɂut#XɂXXXɂThosethreequestionsleduptoQuestionIV,theevaluation'sfocalquestion:"Allinall, D#! whatwouldyousayisthesinglemostimportantreasonyoudidnotrespondtoCensus 0$" 2000(bymail)?"Bynow,participantshadampleopportunitytorefreshtheirmemories %l # andfocustheirthoughtsonthesubject.Finally,QuestionVaskedparticipantstoreflect &X!$ onwhatmighthavebeendonedifferentlytoresultintheircompletingandmailingback &D"% theirCensus2000questionnaires.'0#&(#(# Theprotocolhelpedfacilitatorstoguidediscussionsandcoverallrelevantareas.Recognizing )%( thatthediscussionwouldalmostcertainlyflowdifferentlyindifferentgroups,theprotocolwasn't *%) meanttobefollowedrigidly.Facilitatorshadroomtorearrangetheorderofthequestions, +&* reformulatequestions,orforegoaskingaquestioniftheparticipantshadalreadydiscussedthe |,'+ issueinenoughdepth.Theimportantpointwastocoverthefullrangeofissuesrelatedtothe h-(, centraltopic.SpanishandEnglishversionsoftheprotocolappearinAppendixB. T.)- ЇXXɂ2.1.3Focusgroupobservationandsummaryform  #XɂXz#Thefocusgroupobservationandsummaryformservedtwomainpurposes:  #XɂXXXɂt# XɂXXXɂ  0  #XɂXX Xɂ{#XɂXXXɂFirst,itprovidedtheanalystimportantcontextualdataabouteachfocusgroupsession t thatcouldn'tbeobtainedfromjustlisteningtothetapeorreadingthetranscript.The `  form,filledoutbyanobserverduringthesession,focusedoncollectinginformation L  aboutthephysicalsettingandaboutobservedverbalandnonverbalbehaviors(patterns 8  ofexchange,bodylanguage,facialexpressions,toneofvoice)amongparticipants.Such $ t information,absentfromaverbatimtranscript,canbecrucialforinterpretingtheverbal  `  statements. L (#(# #XɂXXXɂr{# XɂXXXɂ  0  #XɂXX Xɂk~#XɂXXXɂSecond,inasectiondesignedtobecompletedaftertheirpostsessiondebriefing,data $  collectionteammemberscouldsummarizemajorthemesthatseemedtoemergeandany   methodologicalorprocedurallessonslearned.Thoughtfulcompletionofthispartofthe   formallowedtheteamssomeinputintotheinitialanalysisofthedata.Italsoprovideda   usefulwaytorefinemethodsandproceduresduringthenearly3monthsofdata  collection.p(#(# AcopyofthisobservationandsummaryformappearsinAppendixC. H      `     h      p   XXɂ 2.2Trainingdatacollectors   p #XɂX#Beforedatacollectionbegan,seniorandjuniordatacollectorsattendedacomprehensiveoneday  Z trainingsessioninSanJuanledbyDr.SusanBerkowitzandMr.MervinRuizofWestat.The F trainerssummarizedtheobjectivesofthestudyandwentoveralldatacollectionandreporting 2 formsandprocedures.Dr.Berkowitzprovidedanoverviewoffocusgroupresearchand  facilitationtechniques.ThewholegroupreviewedtheSpanishversionsofthescreenersurvey   andfocusgroupprotocolindetailandrecommendedminorchanges.Datacollectionteamswere  formedandinitialsiteassignmentsmade.  Mr.RuizstayedinPuertoRicofor2weeksafterthetrainingtoprovidelogisticaland j! methodologicalsupportingettingtheteamsstartedontheirfirstassignments. V"  XXɂ 2.3Collectingthedata  .$~" #XɂX.#Datacollectionhadthreemaincomponents:1)selectingsitesandcreatingmaps,2)identifying &h!$ andrecruitingfocusgroupparticipants,and3)conductingthefocusgroups.Eachcomponentis 'T"% discussedbelow. '@#& (#(#K(#2.3.1Selectingsitesandcreatingmaps )%(     Selectingthesitesforthefocusgroupsoccurredinseveralsteps: +&* 0, XX0#XɂXXXɂ~# XɂXXXɂ  0  #XɂXX Xɂψ#XɂXXXɂUsingamapthatindicatedresponseratesforallmunicipalities(municipios)inPuerto x-(, Rico,wefirstidentified12sitesacrosstheIslandthatmettwotests:1)belowaverage d.)- mailbackresponseratesforCensus2000(under50percent)and2)arangeofgeographic  andsocioeconomiccharacteristics.Withintheconstraintsofchoosingsiteswithlow  responserates,weselectedurbancoastalaswellasruralmountainousinteriorsitesinthe  SanJuanareaandthewestern,southern,easternandnorthwesternpartsoftheIsland.t(#(# #XɂXXXɂ-# XɂXXXɂ  0  04(#(##XɂXX Xɂ#XɂXXXɂTheseselectionswerethensenttoDr.WalterDiazattheCenterforAppliedSocial L  ResearchattheUniversityofPuertoRicoatMayaguz.Workingwith1990census 8  data,Dr.DiazusedGeographicInformationSystems(GIS)softwaretoproducemaps $ t ofthespecifiedcensustracts.Inafewcases,hewasunabletocreatemapsforthe  ` originallyselectedsitesandchosealternatecensustractsthatmetthesamecriteriain  L  geographicproximitytotheoriginalsites.Themapsproducedforeachtractshowed  8  theboundariesofthetractandgavecoordinatesforlandmarksandotherinformation $  (suchasstreetnames).Theseorientedfieldresearcherswhocanvassedareasto   recruitfocusgroupparticipants. 4(#4(# Overall,themapsprovidedatleastaroughguidefortherecruitmentprocess.Inafewcases,   though,theinformationonthemapswasoutdatedorinaccurate!notsurprisinggiventhatthe p datawere10yearsold.Forexample,inonemetropolitanSanJuansite,amajorroadwayhad \ beenconstructedandamasstransitsystemextendedintothetractinrecentyears.Theresultwas H adeclineintheportionofthetractincludingresidentialneighborhoods,asawellasa 4 pronouncedphysicaldivisionbetweentheremainingresidentialareas.Initialrecruitmentefforts  p suggestedthatitwouldbeextremelylaboriousandtimeconsumingtocontinueinthissite,sowe  \ replaceditwithanothertractmeetingsimilarcriteria. H Figure1presentsamapofPuertoRicoshowingthe12municipioswithtractsthatwerefinally   selected.Themapalsoindicateswhichofthesiteswereintheoriginalpool,whichwere   replacements,whichwerecompleted,andwhichwerenot.  XXɂ2.3.2Identifyingandrecruitingfocusgroupparticipants  #XɂXƔ#Thenextmajorchallengewastofindpersonsintheselectedtractswhomettheeligibilitycriteria l  andwerewillingtoparticipateinthefocusgroups.Ineachtract,researcherssoughttoobtainthe X! namesandcontactinformationfor1015suchindividuals,withthegoalofgettingfiveorsix D"  whowouldcometothefocusgroupattheappointedtimeandplace.Theprimarycriterionwas 0#! thattheindividualbeaheadofahousehold(thepersonwhoassumedresponsibilityforfilling $l" outthequestionnaire)whohadn'treturnedthequestionnairebymail.Alsoeligibletoparticipate %X # werehouseholdheadswhohadlaterfilledouttheirquestionnaireswiththehelpofan %D!$ enumerator.Infact,atleasthalfoftheparticipantsdidfallintothiscategory. &0"% Withnonamesoraddressliststoworkfrom,ourapproachwastocanvassresidentialportionsof ($' thedesignatedsitesdoortodoortoscreenforpersonswhometthecriteriaforparticipation. )$( Researchersadministeredthescreenersurveytoasmanywillingpersonsastheycouldfindat *%) homeinthedesignatedareas.However,thiswasrarelyaneasyprocess,forseveralreasons: |+&* #XɂXXXɂz# XɂXXXɂ  0  #XɂXX Xɂ#XɂXXXɂEvenwiththemaps,itoftentookalotoftimetophysicallylocateanddelineatetheareas T-(, tocanvass.Forexample,insomeplaces,bothruralandurban,therewerenostreetsigns@.)-(#(# #XɂXXXɂI# XɂXXXɂ  TRO'3 Letter LandscapeX3' Letter'3Letter Landscape3'LetterTpAQ<,(`~0* `O.2E**j*p ..                           ..  TRX3' LetterO'3 Letter Landscape3'Letter'3Letter LandscapeTY*#XɂXX Xɂv#  XɂXXXɂ0  0(#(#orstreetnames,orresidentsdidnotrecognizethenamesasgivenonthemap.Inseveral  ofthemoreurbantracts,commercialandgovernmentalbuildingsratherthanresidences  occupiedmuchofthearea.(#(# #XɂXXXɂ# XɂXXXɂ  0  #XɂXX Xɂ#XɂXXXɂGainingphysicalaccesstohouseholdswasaprobleminwealthierurbanneighborhoods, ` wheremanyresidentsliveinhighsecurity,gatedbuildings.Attheoppositeendofthe L  economicspectrum,someofthepoorneighborhoodsposedpotentialdangerstothe 8  researchers.Intheseareas,theresearchersalwaysworkedinteamsandmadeapointof $ t leavingwellbeforenightfall. `(#(#        #XɂXXXɂ# XɂXXXɂ  @a"0   Eventhoughallthecensustractshadlowerthenaveragemailbackresponserates,  8  researchershadadifficulttimefindingtherequisitenumberofpersonswhoidentified $  themselvesasnothavingreturnedthequestionnairebymail.Insomeplaces,asmanyas   100householdshadtobeapproachedtoobtain5or6prospectiveparticipants.C   4       &%X Xɂ (#(#  J(48# XɂX% &#Theresultofthesedifficultieswasthatrecruitmentofparticipantstookmoretimeandrequired p  morevisitstothesitesthanwehadoriginallyestimated.Also,sincethepoolofeligibleand \ willingparticipantswasquitesmallinmostcommunities,wecouldrarelybeveryselectivein H choosingthemixofpersonstoinvitetoparticipateinthefocusgroup. 4 #XɂXX XɂN#XɂXXXɂ  XXɂRG1OY2.3.3Handlinglogistics  \ #XɂXy#Besidesrecruitingeligible,willingparticipants,theteamsalsohadtoarrangeforrefreshments, H findandscheduleasuitableplacestoholdthefocusgroup,and,insomecases,arrangefor 4 transportationandforbabysittingforparticipants#XɂXXXɂN#Xz"XXXɂ'#XɂX"XXzO#XɂXXXɂԀchildren.   Inmanycommunities,gettingasuitableplaceforafocusgroupwasnomeanfeat.Theidealwas  acool,comfortable,quietplaceclosetotheparticipants'homeswithaslittleextraneousnoiseas  possibleandaseparatespaceforthechildrenandbabysitter.Insomesites,theresearcherswere  abletoarrangetouseschoolsorotherpublicbuildingsthathadmostofthesefeatures. l Inothers,theyhadtoimprovise.Forexample,inonecommunity,theonlyplaceavailableonthe D! dayalltheparticipantscouldattendwasthelocalMcDonald's.(Asitturnedout,thesituation 0"  workedoutperfectly;thefocusgroupwasheldinthepartyroom,whiletheclownentertainedthe #l! childrenontheadjoiningplayground.)Groupswereheldinaroofed,openstructureonabeach $X" andinabandshellinapark.Inanothercommunity,despiteconsiderableeffort,theresearchers $D # couldn'tlocateanysuitablefacility(onereasonwedecidedtoforegoholdingafocusgroupat %0!$ thatsite). &"% Theneedtoconductsomefocusgroupsinlessthanidealconditionsmayhaveaffectedthe (#' qualityofthedata(asaddressedinsection3,Limits).Butthesecommunityrealitiescanhelpus )$( tobetterunderstandtheparticipants'responses.Inanyevent,thedatacollectorsdeserve |*%) Y* Y  Y  considerablecreditfortheircreativeimprovisationsinlocatingvenuesforthesegroups.  &  XXɂ2.3.4Conductingthefocusgroups  #XɂX#Therewerethreeprimarydatacollectionteams.Theseniormembersofeachteamservedasthe t facilitatorsofthefocusgroupdiscussions.Thejuniormembersactedasobserversandnote `  takers.Theyalsosawtotherefreshmentsandmadesurethattheroomwassetupadequatelyand L  thattaperecordersandmicrophoneswereworking.Inafewcases,whenotherarrangementsfell 8  through,juniormemberslentahandwiththebabysitting.' $ t Thefocusgroupsvariedinsizefromfourtotenparticipants;mosthadfiveorsix.Agesvaried  L  widely,from18yearoldstopersonsintheirlate60sandearly70s.Mostparticipantswerein 8  their30sand40s.Morethantwothirdsofallparticipantswerewomen;twoofthegroups $  consistedentirelyoffemaleparticipants.Thesessionslastedabout6090minutes,notcounting   thetimeforbreaksandrefreshments.   Thefocusgroupsessionsweretaperecorded.Teammembersmetassoonaspossibleafterthe  sessionstodebriefonbothcontentandprocess,collaboratingtofinalizetheobservation p summaryforms,whichtheythensenttoWestat,alongwiththetapes. \     XXɂ2.4Applyingqualityassuranceprocedures #XɂXȻ##XɂXXXɂ#XɂXXXɂ 4  XXɂ#XɂX ##XɂXXXɂY#Qualityassuranceprocedureswereappliedtothedesign,implementation,analysis,and D preparationofthisreport.Theproceduresencompassedmethodology,specificationofproject 0 proceduresandsoftware,computersystemdesignandreview,developmentofclericaland l computerprocedures,anddataanalysisandreportwriting.Adescriptionoftheproceduresused X isprovidedinthe Census2000EvaluationProgramQualityAssuranceProcess. D  XXɂ     3.LIMITS  . ]#XɂX #Whenconsideringtheresultsoftheevaluation,keepinmindseverallimits: !. #XɂXXXɂ:# XɂXXXɂ  @a"0   #XɂXX XɂF#XɂXXXɂTheseresultsaren'tgeneralizabletoanylargerpopulation.Theresultsreportedhere #! derivefromfocusgroupscarriedoutwith41householdheads(28womenand13men)in $" ninepurposivelyselectedsitesacrossPuertoRico.Whileeveryeffortwasmadetoselect % # sitesrepresentingarangeofgeographicanddemographiccharacteristics,theresultsof z&!$ thesegroupsareonlysuggestive.Theyprovideausefuljumpingoffpointforadditional f'"% thinkingandfurtherresearch.R(#&(#(#      4  >)$' RG RXX  R  #XɂXXXɂ# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂFordifferentreasons,                   5      ׀focusgroupswerenotconductedasplannedinthreeofthe12  selectedsites.AsseenonFigure1,oneofthesesiteswasaninteriorcommunityinthe  westernpartoftheIsland,anotherwasonthenorthwesterncoast,andthethirdwasinthe  northeasternpartoftheIsland.Thus,therewasnoapparentgeographicordemographic t "bias"towardexcludingonetypeofsiteoveranother.Moreover,inallcases,we ` conductedatleastoneothergroupinasitewithsimilarcharacteristics.Still,althoughthe L  ninesitesdidpresentagoodbalanceofgeographicanddemographiccharacteristics,it 8  wouldhavebeenpreferabletoholdfocusgroupsinall12ofthesites.$ t(#(# #XɂXXXɂq# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂAtseveralofthesites,asmentionedabove,thefocusgroupswereconductedinlessthan  L  idealconditions.Onegroupwasheldinanopenairbandshellinapublicpark,which  8  madeitdifficulttoscreenoutextraneousnoiseandtokeeptheparticipants'childrenfrom $  occasionallyburstingintothesession.Inanothergroup,conductedinanopenair   structureonabeachduringtheearlyeveninghours,liberaluseofcitronellacandles   couldn'tkeepthemosquitoesatbay.However,inbothcases,groupdiscussionswere   lively,soitisdifficulttotelliftheconditionsreallyhadmucheffectonthedataquality. (#(# #XɂXXXɂT# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂTranscriptscouldn'tbeproduced fortwoofthe ninefocusgroupsessions,becausethe \ tapeswereunusable.ThetapeforOldSanJuanwasinaudible(duetopoorplacementof L themicrophone);theoneforLoizaturnedouttobeblank(probablybecausethe"record" 8 buttononthetaperecorderhadnotbeendepressed).Thismeantthattheanalysthadto $t relyontheobservationsummaryformsfordataonthesetwosites.Becausethesummary ` formswerewelldone,thelackofverbatimtranscriptsdidn'tposeamajorproblemforthe L analysis.Butitdidmakeforalossofrichnessandtexture,includingtheabilitytoquote 8 directlyfromparticipantsinthesetwogroups.$(#(#      4  `     h   &  @cc%  XXɂ4.RESULTS   #XɂX #ThereasonsgivenbythefocusgroupparticipantsfornothavingmailedbacktheirCensus2000  questionnairesrangedfromthesimpleandmundanetothesubtleandcomplex.Theyfallinto   fourpartiallyoverlappingclusters,asdescribedbelow.' * p! Ї XXɂ4.1Motivationalandprocessrelatedreasonsformailnonresponse   4.1.1Lackofclarityaboutthepurposeofthecensus  #XɂX#Arangeofparticipantsinnearlyallthecommunitiesanddemographicgroupssaidtheyweren't  highlymotivatedtorespondtothequestionnairebecausetheydidn'treallyunderstandor   sympathizewithwhattheytooktobetheultimatepurposeofthecensus. r  Afterbeingtoldhehadtofilloutthequestionnaire,oneparticipantinaninteriorcommunity J  asked,"ButwhyshouldIfillthatout?"Whenhedidn'tgetasatisfactoryresponse,heputit 6   awayandforgotaboutit.Anotherparticipantinthesamegroupquestionedthereasonsthe "r  governmentneedstoknowwholivesinhishousehold.Afterbeingtoldthatthepurposewasto ^  findouthowmanypeopleliveinPuertoRico,hetoldhiswifethatshecouldfillitout,buthe J  "wasnotinterested"becausehedidn'tseethepoint."Whyaretheyinterestedinknowinghow 6  manyweare?" "  Aparticipantinaworkingclassurbancommunitycommented,"Theyshouldhavedoneabetter  jobexplainingthemissionofthecensusandwhattheyexpecttoobtainwiththecensus."Others  inthesamegroupechoedthissentiment,suggestingthattheadvertisingcampaignhadmadea  bigpointofemphasizingtheimportanceofreturningthequestionnaire,buthaddonelittleto n explainwhy.Onemaninthisgroupsaidthattheintensityoftheadvertisingsurroundingthe Z censushadmadethe"censuspeople"seem"desperate"tohim,andsohadarousedhissuspicions F aboutthecensus'struepurpose. 2 Aparticipantinaninteriorcommunityfeltthatthecensusshouldhavebegunanaggressive  Z advertisingcampaignwellbefore1999,toexplain"whatisthecensusandwhatitwillbeused F for."Inhisview,alotofpeoplewereconfused.TheythoughtthecensuswasliketheInternal 2 RevenueService,"forthepurposeofmakingmonetarycontributions,"andwouldhavebeen  reassuredtoknowthat"itwasonlytofindouthowmanypeoplethereare."Indeed,participants   inseveralofthegroupswereconfusedinjustthisway.  Afemaleparticipantinanotherinteriorcommunitysummeditupasfollows: ~!   8  "Tenyearsago,thecensuswasdonehousetohouseandthatgaveusconfidence V#! becauseweweregiventhewholeexplanationabouttheobjectiveofthecensus B$" andwhattoexpect.Butthisyearthecensuswasverydifferent.Andwhenone .%~ # receivesalongquestionnaireatthegateofyourhome,youbecomeintimidatedby &j!$ it."'V"%   Participantsinwealthierneighborhoodsagreedontheimportanceofeducatingthepublicabout (.$' thecensus'smission:the"firstthingthatshouldappearonthecensuscoveristhemissionofthe )%( census!itsmainobjective."However,inaninterestingtwist,inbothgroupsconductedwith *&) welleducatedmiddleclassparticipants,severalpeoplealsotookissuewithadvertisingthathad +&* presentedthemainmotivationforcompletingthequestionnaireintermsofgainingfederalhelp. ,'+   f.)- OnemaninawelltodoSanJuanneighborhoodwasoffendedbythisappealasbeingtoo  "commercial"andtoomercenary.Hebelieveditwasmoreappropriatetostressthegovernment's  needforgooddemographicinformation.Aparticipantinanothermajormetropolitansitewas  similarlyaffrontedbytheideathatheshouldfilloutthecensusquestionnairetogainfinancial t help: `   8  "SomewhereitsaysthatthiscanhelpPuertoRico.Thatisaninsulttome.Ido 8  notwantanyhelp.Iwantjobs.IworkhardandforthatreasonIwenttoschool."$ t   Theseparticipants'viewsarepartofalargersetofmisperceptionsofadvertisingmessagesthat  L  appealedtopeopletocompletetheirCensus2000questionnairessotheircommunitieswould  8  receiveresourcesinproportiontotheirnumbers.Asreportedabove,somepeopleapparently $  understoodanyreferenceto"funds"or"help"ascodewordsfortaxation.Onewoman,for   example,was"surprisedthatthishadnothingtodowithtaxes."Anotherparticipantinan   interiorcommunitywastoldbyherneighborthatit(thecensus)"wastopaymonetary   contributions."Thisimpressionwasreinforcedbywhatwasperceivedasintimidatinglanguage   statingit"wasmandatory"tofilloutthequestionnaire. p      4  `     h      p Othersfearedthatthe"wrong"responseonthequestionnairecouldmeanthelossofgovernment H assistance,suchasSocialSecurity.Asshowninsection4.3(Culturalandpoliticalattitudinal 4 factors),fearsoflossofbenefitswerecloselytiedtoconcernsthatthedatawouldn'tremain  p confidential,aswellasmistrustofthegovernment.Herethelargerpointisthatformanyin  \ thesefocusgroups,advertisingappealsaboutthecensus'smissioninfairlyallocatingresources H fellwideofthemark,evenfrighteningsomepeopleawayfromresponding. 4 &  XXɂ4.1.2Confusionoverdistributionofformsandtheroleofenumerators   #XɂX&#Afairnumberofparticipants,especiallyinthemoreruralcommunities,saidtheywereconfused  byhowtheCensus2000questionnairesweredistributedanddidn'tunderstandjustwhattodo  oncetheyreceivedtheform.'  Someclaimedtheyneverreceivedanadvanceletter.Afewsaidthatanadvanceletterhad X! reachedthembutnoquestionnairehadfollowed.Afewsaidtheydidn'tknowtheywere D"  supposedtomailbackthequestionnaireandbelievedthatanenumeratorwassupposedtocome 0#! byandpickitup.Someparticipantsininteriorcommunitiessaidtheydidn'tknowiftheywould $l" needtousestampsinmailingbackthequestionnaire. %X # Severalparticipantsindifferentgroupscomplainedaboutwhattheysawastheinconsistentand &0"% unpredictablemannerinwhichthequestionnairesweredistributed.Theyperceivedthatsome '#& householdsgotquestionnairesbymail,whileothershadthemdroppedoffatthegate,andstill ($' othersreceivedtheminperson. 4.1             !   6      ׀Whythedifference?Insomecases,thiscritiqueextendedto )$( theissueofwhysomehouseholdsgottheshortform,whileothersreceivedthelongform.The *%) processappearedcapriciousandrandomtothem. |+&* ЇManyparticipantswereperplexedbytheroleoftheenumeratorinCensus2000,especiallyin  comparisontotheenumerator'srolein1990.Wastheenumeratorsupposedtohelpfilloutthe  formsormerelypickupthecompletedforms?Ifanenumeratorwasgoingtostopbyanyway,  whatwasthesenseinmailingbackthequestionnaires? t   8  "IwastoldthatifIdidnotmailit[thequestionnaire],someonewouldcometo L  visitme.Thatvisitneverhappened,oriftheycame,theydidnotfindme.AndI 8  wasalwaysthinkingthatIhadtomailit,butneverdid."(Maleparticipant, $ t interiorcommunity) `     8  "Inmycase,Ihadit(thequestionnaire)for2weeksanddidnotknowhowtofill  8  itout...Itjusthappensthatacensusladycamebyandshetoldmeshewasnot $  supposedtohelpinfillingouttheformbutthatshewouldhelpme."(Female   participant,anotherinteriorcommunity)      8  "Iendedupnotmailingminebackbecausetheinterviewercamebyandfilledit   outwithme."(Malerespondent,poorcoastalcommunity)p   0  0(#(# (#(# Afewparticipantsfeltitwasonlyrightthattheenumeratorshelpthemfillouttheirquestion H naires,sincetheCensusBureauwaspayingthemtodoit.Onewomaninaworkingclassurban 4 community,whohadherselfbeenpassedoverforajobwiththecensus,toldtheenumerator,  p "Look,youareworkingforthecensusinmysector.SinceyouaregoingtogetpaidandIam  \ not,cometomyhouseandhelpmefillmineout." 4.1             "   7       H Participantsindifferentcommunitiescomplainedabouthavingreceivedmultiplevisitsfrom   differentenumerators,eachofwhomaskedthemtofilloutthequestionnairealloveragain.One   womaninaworkingclasscoastalcommunityfilledouttheCensus2000questionnairethree  differenttimeswiththreedifferentenumerators.Aparticipantfromacoastalmetropolitanarea  notedhavinghadtocompletethequestionnairetwice,afterasecondenumeratortoldhimthe  firstquestionnairehadbeenlost."Ifthisisconfidential,"heasked,"howwasthecensusform l losttheoneIfilledoutthefirsttime?"AwomaninmetropolitanSanJuantoldofhaving X  finallyputherfootdownonthethirdvisitfromanenumerator: <4.1             #   8      ׀ D!   8  "Someonebroughtit(thequestionnaire)tomyhouse.Themanwhogaveittome #l! saidthatsomeonewouldcomelatertoexplaintomehowtofillitout,butnoone $X" evercametomyhome.Finally,someonedidcomebyandhelpedmefillitout, $D # andlater,ontwodifferentoccasions,twootherpeoplecamebymyhousetohelp %0!$ mefillitout.Isatdownasecondtimetofillitoutbecausetheydidnotseemto  understandorcarethatIhadalreadydonethesameinterviewwithaprevious  person.Butthethirdtimeaninterviewercametomyhousewiththesame  mission,ItoldhimIwouldnotfillitoutanymoretimes."t         U4.1      XXɂ 4.2Practicalandlogisticalreasons formailnonresponse  L  #XɂX#Practicalandlogisticalconsiderationsformanotherclusterofreasonsgivenbyparticipantsfor <  nothavingreturnedthequestionnairesbymail.Whilemanyofthesemightseemquiteprosaic, ( x insomecasestheyarelinkedtothelargerissueofwhethertheparticipantsunderstoodand  d  sympathizedwiththecensus'smission,asdiscussedinsection4.1.1,Lackofclarityaboutthe P  purposeofthecensus. <  XXɂ4.2.1Lackoftime   #XɂXg#Manyparticipantssaidtheyweresimplytoobusy,theirlivestooharried,totakethetimetofill  outthequestionnaireandreturnitbymail.Whilethisviewwasexpressedacrosscommunities  anddemographicgroups,itwasparticularlysalienttoworkingmothers,whethersingleor  married.Itappearedthatmostofthehusbandsinthesefamiliesdelegatedtheresponsibilityfor t fillingoutthequestionnairetotheirwives. ` SaidoneyoungmotherofDominicandescentinapoor,urbanneighborhood,whoworks 8 cleaninghouses:"IopeneditandfilledoutthefirstpageandsinceIhadsomuchtodoaround $t thehouseandthechildren,IthrewitawaybecauseIwassobusy."Ayoungmarriedwomanin ` aninteriorcommunityalsotalkedaboutherhusband'sroleintheprocess:"Ireceiveditbymail. L MyhusbandwouldsaywehadtofillitoutandIwouldsay,'AssoonasIhavethetime.'ButI 8 workandhavechildrenandIknewIhadtodothis,butcouldnotfindthetime."Shedidendup $ fillingoutthequestionnairebutonlybecauseanenumeratorcamebyandhelpedhercompleteit  inonlyafewminutes.  Anotherbusymotherinanurbancoastalcommunityinsistedthatinthelittlefreetimethatshe   has,"Iwanttositdownandwatchthesoapoperas.Iamnotgoingtomissthesoapoperas p! becauseIhavetofilloutthecensus.Becauseinreality,Ideservesometimeformyself." \"  Aworkingmotherinanurbancommunitylinkedheransweraboutnothavingthetimeto 4$" properlyanswerthequestionstoapreferencefordoortodoordatacollectionbyanenumerator:  %p #   8  "Willthepeoplewhoreceivethiscensusknowhowtointerpretthequestions,like &H"% thoseofuswhoworkanddonothavetimetoreadsomuchpaperwork?Ileave '4#& forworkwhenitisdarkandreturnatdark,everyday.Ihavetwochildren.Itis ( $' easierforaninterviewertogotoeachhomeandatthatmomentcollectthecensus ) %( data."*%)   XXɂ  ,'+ 4.2.2Problemswithmailingtheform  #XɂXO#Forsomeparticipants,especiallyresidentsofinteriorcommunities,gettingtothepostofficeto  mailtheformswasjusttoohard,particularlywhentheyassumedtheycouldcountonthe  enumeratorasafallback.Saidoneparticipantinaninteriorcommunity,"Ihaveonlyonefree t dayaweek.Thereisonlyonecarathome.ThereisnomailboxnearbysothatIcanwalktoit." `  Anotherparticipantinaninteriorcommunityjudgedtheideaofaskingrespondentstomailthe L  questionnaire"adisaster."Manypeople,heclaimed,especiallytheelderly,areunabletogoout 8  insearchofapostoffice,andmaynotwanttorelyonotherpeopletodothemthefavorof $ t mailingthingsforthem.  `  Alongrelatedlines,participantsinanotherinteriorcommunitysuggestedthatthemailsystem 8  doesn'tworkaswellasthedoortodoorapproachbecause"peoplearenotusedtothemailas $  much."Aparticipantfromanurbancommunitywhohadfilledoutthequestionnaireinits   entirety,butnevermailedit,heldthepostalsystematleastpartlytoblame.Shehadlivedin   NewYorkCityformanyyearsandwasverysurprisedthatinPuertoRicothelettercarrier   wouldn'ttakeheroutgoingmail,sothatshehadtogotothepostofficeherself.  &  XXɂ 4.3Culturalandpoliticalattitudinalfactors formailnonresponse  \ 4.3.1Fearoflackofconfidentialityandattendantconsequences ` #XɂX#Inmanyfocusgroups,participantsquestionedwhetherthecensusdataaretrulyconfidential.For L most,thiswaslinkedtofearthatgovernmentassistanceorscholarshipsmightbelost,that 8 punitivemeasuresmightbetaken,orthatothernegativeconsequencesmightensueforthemand $t theirfamilies.'\ ` Aparticipantinapoorinteriorcommunitynoted,"Eventhoughconfidentialityisguaranteed,one 8 isafraidthatthismaynotbetrue,"addingthathehadn'tfilledoutthequestionnaireforfearof $ beingaskedtopaymoremoney(presumably,intaxes).Participantsintwourban,workingclass  neighborhoodsechoedtheseviews.Onemanreasonedthatthesheernumberofquestions(on   thelongform)madeitunlikelythattheanswerswerereallykeptconfidential. ! Severalparticipantsfeltthatdetailedquestionsontheirfinanceswereunwarranted,sincethey p#! didn'treceivegovernmentassistance.Theybelieved,inthewordsofoneparticipant,thatthe \$" censuswas"reallyafterotherthings."Likeseveralothers,onewomancouldseeonlyone H% # possibleulteriormotivebehindalltheincomerelatedquestions: 4&!$   8  "Isaid,ifthisisapopulationcensus,whydotheywanttoknowhowmuchmoney  (\#& Ispend,howmuchIearn?IthoughtthatwhattheyreallywantedtoknowwasifI (H$' receivegovernmentbenefitsifIshouldnot,becauseIwasworking.")4%(   Anothermanworriedthatfillingoutthequestionnairemightjeopardizehisfamily'sprecarious + '* financialsituation: ,'+   8  .)-   0  0(#(#"Wewhoworkhard,donotreceiveanykindofgovernmenthelpbecause,byasmall  amount,Iearntoomuch.Wearefiveathome.Idon'thavemoneyinthebank.Mywife  doesnotwork.IgotcouponsbecausemycompanyreducedpersonnelwhereIworkand,  thankGod,thatwasalltheycouldgiveme.Butthen,ifIfilloutthisform,Iwon't t qualifybecauseiftheyseewhatIsupposedlyearninayear,theywillsaythispersoncan ` surviveonwhatheearns,whichisaliebecauseinthiscountrywecannotsurviveon L  whatweearn."8 (#(# Awomaninthesamegroupwasconcernedthatherfillingoutthecensusquestionnairewould  ` affecthermother'sabilitytovote,sincetheenumeratorhadremovedhermotherfromthehouse  L  holdcount.Amanreportedhisbrotherhadbeentoldifhedidn'tcompletethequestionnaire,he  8  wouldlosehisgovernmentscholarship. $  &  Onemansummarizedtheviewsofmanyofhiscoparticipantsasfollows:   '"  8  "Ithinktherewasaproblemofconfidentiality.Thefearthatanyinformation   givenoutwouldfallrightintothehandsofthePuertoRicangovernment,which, p inturn,wouldaffectemploymentsearch,financialhelp,scholarships,schools,and \ manyotherthings.Becauseonedoesnotknowhowfarthisinformationcan H reachandinwhathandsitmayendup.[Thereis]alotoflackoftrust."4   XXɂ4.3.2Mistrustofgovernmentandpoliticians  \ #XɂX%#Likethemanquotedjustabove,manyparticipantsexpressedadeepseatedmistrustofthe H government.Asoneparticipantfromaninteriorcommunitysaid,"Thosewhohavethemost 4 moneyinthiscountryarethepoliticians,andsomepoliticiansdon'tevenpaywhattheyowe.   Andwe,whoarepoor,feelafraid.Iamindoubt,andbecauseofthedoubtsIhad,Iwasafraidto   fillouttheform."  QuiteafewparticipantsbelievedthatanyfundsthatwouldcometotheIslandthroughthecensus  wouldonlybeusedbythepoliticianstofeathertheirownnests.Intheend,thepeoplewho l  reallyneedthehelpwouldnotgetitanyway.Oneteacherinamiddleclassurbancommunity X! putitthisway:"Iamgoingtosaythetruthonwhypeopledidnottakethecensusseriously. D"  Say,forexample,themothersofthestudentsinmyschool.Theythoughtthatthiscensuswould 0#! servetoaskformorefederalfundsandthenrobthose."Saidanotherparticipantinthesame $l" group,"onehearsstoriesthatifwefilloutaquestionnaire,thenwemaybedeniedcertainfederal %X # helpsuchasSection8.Itislikeacampaignofterrorforus." %D!$ Participantsinamiddleclassurbanneighborhoodextendedthis"guiltbyassociation"argument '#& evenfurther.Severalsuggestedthatitwasunfortunatethatthecensuswasheldinanelection ($' year,sincethemayoroftheirtownhadcomeoutverystronglyagainstthecensus.Moreover,as )$( farastheywereconcerned,theadvertisingforthecensusseemedtoomuchlikepolitical *%) campaignhype.Remarkedoneparticipant:"Itallseemedsopolitical."Commentedanother: |+&*   8  "Thepublicitygiventothecensus,aboutfillingitout,wastoomuch,especially T-(, onTV.Thentheyalsogaveoutfreepromotionalitemsinvariousplaces:hats, @.)- coolers,pens,andsoon,atthepark.Itsoundedsopoliticaltome.Somuch  publicityscaredme.Theothertimesinthepast,thecensushadnotbeengivenso  muchnoise.Somuchpublicityofthiskindactuallyscaredthepopulation,  becausewethoughtitwasapoliticalfestival.Thisconfusedusandmadeus t suspicious,too."`   XXɂ4.3.3Culturalpreferenceforapersonalapproach 8  #XɂXf0#&  Acrosstheboard,participantsexpressedastrongpreferenceforthemorepersonal,doortodoor $ t approachtakeninthe1990census.Theyfoundtheideaofdroppingoffthequestionnaireatthe  `  gatetooimpersonalandbureaucraticfortheirtaste.Indeed,morethanhalfoftheparticipants  L  didenduprespondingthroughanenumeratorduringthenonresponsefollowupprogram.'$ 0 8  Tosomeparticipants,theimpersonalityseemedtobesayingthatthecensuscouldn'treallybe   veryimportant.Asoneparticipantinamiddleclassurbancommunitynoted:     8  "Thefactthatthecensusformwasjustlefttheresomewhereoutsideourhomefor  ustopickupdidnotgivethecensusitsimportanceorevencredibility.Ifa0@totake0@(#(# p personwouldhavegivenittousandwouldexplainitsmission,onewouldsit \ downandfillitoutquicklyandpainlessly."H   Participantsinseveralgroupssuggestediftheyhadtoinvestthetimeinansweringcensusques  p tions,theywouldratherdosointhecontextofafriendlyconversation.Someofthemusedthe  \ recruitmentprocessforthefocusgroupsasanexampleofthemorepersonalapproachthey H preferred.Saidonewoman, 4   8  "Wearerealclose.Wearelikethat.Thoserelationshipswithpeoplelikewhen   you[therecruiters]came.See,wetalktothewholeworld.Andifanyonegoes  by,wesayhelloasifwehadknownthemfor10years.Weareaccustomedto  peoplecomingtoourhousesandinvitingtheminandsayingwellsitrighthere  andwe'llfillitoutandwe'lleatsomething."l    Herneighboradded,"LikeagoodPuertoRican!doyouwantsomecoffee,doyouwantarefresh D"  ment,doyouwantajuice?Weareusedtosomethingmorepersonal,"addedanotherparticipant. 0#! "Americansaremoredistant,moreindependent,we[PuertoRicans]arenotlikethat." $l" ParticipantsinseveralgroupsemphasizedthatpeopleinPuertoRicowouldbemorelikelyto %D!$ respondtoaninterviewerinhumanterms,whichwouldcommitthemtofillingouttheform.As &0"% onewomaninaninteriorcommunityputit,"Ithinkthatwhenaninterviewervisitseachhometo '#& collecttheinformation,itcommitstherespondenttoanswer,nomatterwhatkindsofquestions ($' arebeingasked."Moreover,suggestedamaninanothergroup,peopletendtofeelsympathyfor )$( aninterviewerworkinginthehotsun."Herewewouldthink,poorthing,thispoorboy,slaving *%) away."Awomanaddedthat,asamother,shewouldempathizewithayoungpersongoingdoor |+&* todoorandwouldbeinclinedtoleavewhatevershewasdoingtohelpthatperson.Ineffect, h,'+ respondingtothequestionnairewouldbecomeasocialinteractionratherthananimpersonal T-(, transaction. @.)- ЇAfewparticipantsextendedthisculturalargumenttotheentireideaofcollectingquantitative  information.TheysuggestedthatPuertoRicans,"bynature,"aren'taspreciseorasoriented  towardsstatisticsandrecordkeepingasAmericans.Thus,theydon'tthinkabouttheworldinthe  termsinwhichthecensusasksthequestions.Otherculturallybasedreasonsfornotresponding t tothequestionnairearediscussedinsection4.4,Reasonsrelatedtoquestionnairecontentand ` design. L  XXɂ& r 4.4Reasonsrelatedtoquestionnairecontentanddesignformailnonresponse  8  4.4.1Objectionstotherace/ethnicityquestions 6   #XɂX@#Whentheissuecameup,asitdidspontaneouslyinfourofthecoastal,urbansites,the "r  race/ethnicityquestionselicitedthestrongestnegativereactionsfromparticipantsofanyofthe ^  questionsintheCensus2000questionnaire.Onemantoldtherecruitershisprimaryreasonfor J  agreeingtoparticipateinthestudywasthathefeltsostronglyonthetopicthathewantedtohave 6  anoutletforhisviews.Asseenbelow,severalparticipantsindicatedthattheystoppedfillingout " theirquestionnaireoncetheycametothequestiononrace.'r 8 @  Tworelatedthemesemergedinparticipants'oftenstronglyfeltresponses:thatthequestions  were"discriminatory"anddivisivetothePuertoRicanpopulation,andthatthequestionsand  responsecategoriesasprovidedwereinappropriatetotheCreoleor"mixed"realitiesofPuerto n Ricansociety. Z Saidoneparticipantinamiddleclassurbancommunity: 2   8  "#XɂXXXɂ#XɂXXXɂIhavebeenworkinginHumanResourcesforabout26years.Ihavereceived  Z trainingonequalemployment.Iunderstandthatabouttheraces.WhenIsawthe F censusformandreadtheracequestionIthoughtIamnotWhiteorBlackor 2 anythingelsebecauseIamHispanicandsoIwasupsetanddecidednottofillit  out.ThatquestionisagainstallthatIhavelearnedabouttheequalitylaw.Ifelt    0  0(#(#offendedandupsetwhenIreadalltheresponsecategoriesfortheracequestionbecause   noneofthoseweremine."!(#(# Amaninaworkingclasscoastaltownfeltthat"withthisracequestion,thecensuspeoplewere j#! discriminatingagainstusandthatmademefeelbad."Hetoldhiswife:"Whatiswrongwith V$" thesepeople?Whodotheythinktheyare?"Anothermaninthesamefocusgroupreported,like B% # severalothers,thathehadstoppedfillingoutthequestionnaireoncehecametotheracequestion .&~!$ because: 'j"%   8  "Irealizedwewerebeingdiscriminatedagainstbyrace.Ididnotfindan (B$' alternativeanswerformyracebecauseweareneitherAfricanBlacksnor ).%( AmericanIndians.Thecensusdidnothavetheoptionalanswerof'#XɂXXXɂF#XɂXXXɂPuertoRican,'#XɂXXXɂL#XɂXXXɂ *&) ourrace.ThequestionupsetmebecauseIthoughtwhydowehavetobedivided +'* asarace,ifwehaveallkindsofraceslivinghere:Chinese,Arabs,Dominicans, ,'+ Cubans.ItoccurredtomethatthisquestionwassomewhatracistandIdidnot -(, wanttofillouttheformandsoIdidnot."z.)-   ЇOneparticipantinanothercoastalcommunitysaidhehadanticipatedthatmanyofthequestions  wouldn'tbeculturallyappropriateoncehefoundoutthatthesamequestionnairewasbeingused  inPuertoRicoasintheUnitedStates.Thesamequestionswereboundnottoworkinboth  places,hefelt,because"weareanIslandandacompactsociety."Sureenough,whenhesawthe t racequestion,he"banged"hisheadandsaid,"WheredoIgo?I'mnotBlack,butI'mnot ` White!questionsthatwerenotintunewithoursociety." L  Severalparticipantspointedtothecomplexitiesofrespondingtotheracequestionformembers $ t oftheirfamilies.Oneman,claimingtobeneitherWhite,Black,Indian,nor"other,"mentioned  ` thathehasablond,blueeyedsisterwhoclassifiedherselfas"White"onherquestionnaire.A  L  femaleparticipantreportedtotheenumeratorthatshewasunabletocompletethequestionnaire  8  becausehersonisofmixedrace,andshedidn'tknowinwhichcategoryhebelonged.Inone $  group,alivelydiscussionensuedoverhowtheyshouldclassifythemselves:White?Black?   Latino?Indian?Other?Theonlycategorythatmadesensetomost!PuertoRican!wasn'tthere.   OnemaleparticipantsawtheracequestionasanegationofPuertoRicanculturebythosewho   hadcreatedthequestionnaire: p 0  0(#(#"TherewasnooptionforLatino,orPuertoRican,orHispanic.Thisbadlydesigned H questiondemonstratedthatourculturedoesnotexist.IfeltoffendedandsaidIwouldnot 4 fillitout.MywifetoldmeIhadtofillitout,accordingtolaw.Isaidletthemcomeand  p getmeandhavethemputmeinjail!" \(#(# &  XXɂ4.4.2Problemswithotherquestions 4 #XɂXV#Thetwoothertypesofquestionsthatelicitedthemostcommentsfromparticipantswerethe   incomeandotherfinancialquestions,andthemaritalstatusandhouseholdcomposition   questions.  'VSomeparticipantsfeltquestionsabouttheirincomeandfinancialresourcesweretoopersonal!  "#XɂXXXɂL#XɂXXXɂaninvasionofprivacy"!aswellasverycomplicatedand"tricky"toanswer.Peoplewerescared l  toanswerquestionsaboutincome,especiallywhentheythoughttheiranswerscouldbelinked X! withtheirsocialsecuritynumbers.Asexpressedabove,someworriedthattheinformation D"  wouldnotbekeptconfidentialandthereforeproblemsmightarise,forexample,if 0#! inconsistencieswerediscoveredbetweenwhattheyreportedinoneplaceandanother. $l" Saidoneparticipantinaninteriorcommunity: %D!$ 0     (#(#   8  "IdonotliketoanswerprivatequestionsbecauseIamafraid.Forexample, '#& questionslikehowmanyliveinmyhouseholdandwhotheyare,whatismy ($' income.Idon'tliketosayhowmuchIpayformyhome,andsoon.Sometimes )$( onedoesnotfilloutthetaxformsaccuratelyandmaybethegovernmentcould *%) findoutthroughthisform."|+&*     T-(, Aparticipantinanurban,coastalcommunityexpressedsimilarconcernsthatdisparitiesin  reportingincometodifferentsources,evenifinnocentorunintentional,couldcreateproblems,  "especiallywhenitisaboutsomethingfederal."  Anotherparticipantinaninteriorcommunitydidn'tmailbackthequestionnairebecauseof ` difficultiesansweringthequestiononincome.Hehadstoppedworking6monthsintotheyear, L  anddidn'tknowhowtoreportthat.Hereceivednohelpfulguidancewhenhecalledthe800 8  numberbutdidfinallyclarifythesituationwiththehelpoftheenumeratorwhocametohis $ t home.Likesomanyothers,heusedhisexperienceinthisregardasanargumentforaninperson  ` doortodoorapproachtocollectingcensusinformation.  L  Anumberofparticipantswhowerelivingwithpartnerstowhomtheywerenotofficiallymarried $  didn'tknowhowtorespondtoquestionsabouttheirmaritalstatus.Forexample,oneolder   womanwhohadbeenwidowedforquitesometime,andnowlivedwithapartnerwhomshe   consideredadefactohusband,wasuncertainofhowtoanswer."Ilivewiththismanformany   yearsnow.Idonotseemyselfasawidow,butIdonotconsidermyselfmarriedeither."The   samewastrueofyoungerpersonsinliveinorcommonlawrelationships. p Householdcompositionquestionswereseenastricky,too,particularlywherehouseholdboun H darieswerefluid.Also,afewparticipantshadahardtimeseparatingculturalnotionsof 4 "family"(insomecases,extendedfamily)fromquestionsthataskedabouthouseholdcomposi  p tion.Onewoman,forexample,wasunsureofwhethertoincludeherbrotherswholivedinthe  \ UnitedStates.Likesomeothers,shewasclearlythinkingoffamilycompositionratherthan H followingastrictdefinitionofcommonhouseholdresidence. 4 &  XXɂ4.4.3Problemswithlengthofthequestionnaire,questioncomplexity,wording,format   #XɂXvf#Mostparticipantswhohadreceivedthelongformcomplainedthatitwaswaytoolong.Didit  reallyneedtobe39pages?Severalfeltthatthelongformwasn'treallyacensusatallbuta  disguisedsocioeconomicstudythatreallyshouldhavebeenseparate.Thenumberandtypeof  questionsfedtheirsuspicionsthatthegovernmentactuallyhadanulteriorpurposeinmind.Said l  onemanfromanurban,coastalcommunity:'jf X!   8  "Ifthisisconfidentialandalsoforpopulationreasons,itwasnotnecessarytoask 0#! forthenameandsocialsecurity.[Note:TheCensus2000questionnairedidn'task $l" forarespondent'sSocialSecuritynumber.]Whyaskquestionssuchashomes %X # thatweownandsoon.Thelongversionofthecensusdidnothavetobe39 %D!$ pageslong.Maybethiswasnotonlyapopulationeffortbuthadotherobjectives &0"% ofwhichwearenotaware.Maybetheywantedtoknowifpeopleanswerthe '#& censusquestionsinthesamewaytheyanswerothergovernmentagency ($' questions.")$(   Anumberofparticipantscomplainedthatthequestionsweretoocomplexandthelanguagehard |+&* tounderstand.Insomecases,thebasicissuewasliteracy.Somepeoplewithlittleformal h,'+ educationadmittedthattheysimplycouldn'treadthequestionswellenoughtoreallyunderstand T-(, whattheywerebeingasked.Theywaitedfortheenumeratorstocomeandhelpthemout.One @.)- womaninapoorinteriorcommunityhadcalledateachertohelpher,buttheteachercouldn't  answerthequestionsandinsteadputherintouchwiththecensusoffice.Anotherwomaninthe  samecommunityreportedthathermotherhadhadahardtimefillingoutthequestionnaire  becauseshecouldn'tunderstandit. t Participantsinthepoorercommunitiesintheinteriorrecognizedthatmanyoftheirneighbors, L  friends,andfamilylackedthebasicliteracyskillstoreadandrespondtothequestionsontheir 8  own."HereinPuertoRicotherearemanypeoplewhoneitherreadnorwrite.Howarethey $ t goingtobeabletofilloutaformlikethis?"Anotherparticipantreportedthat"thebrothersof  ` mychurchpreachbeautifully,buttheydonotreadorwrite.Yousee,intheruralareas,various  L  thingsandlackoftransportationmakeitdifficultforpeopletogotoschool."  8  Someoftheolderparticipantsinurbanneighborhoodsalsohadlittleformalschooling,suchas   onewomanwhohadgoneonlyuptothefirstgradeinschool:"Itriedtoreadtheform,"shesaid,   "Ididnotunderstandanything!"Somepeopleexpressedsimilarconcernsforolderresidentsof   theircommunities.Saidoneyoungerpersoninanurban,workingclasscommunity:"Ifwe,who   areeducated,arehavingproblemsanswering,imaginehowharditisfortheelderly?"Butit p wasn'tjustparticipantsinruralcommunitiesandtheelderlywhoreporteddifficulties \ understandingandcompletingthequestionnaires.Onewomaninanurbanneighborhoodfeltthe H languagewassometimesconfusingevenforprofessionals. 4 Severalofthosewhoreceivedthelongformprotestednotonlythelength,butalsowhatthey  \ regardedastheonerousrequirementsofcollectingdatatoanswerthefinancialquestions.Said H oneparticipant:"Itwasevennecessarytolookforoldreceiptsandbillstoanswerthecensus!" 4 Severalobjectedtotheformatofthequestionnaire,especiallytheneedtoanswerthesamesetof   questionsforeachindividualinthehousehold.Theycomplainedthatitwastoocumbersometo   keepflippingbackandforth,andhardtokeeptrackofwhowasPerson1andwhowasPerson2,  andsoon.Severalfoundthequestionsrepetitive;onewomannotedthatseveralofthequestions  atthebeginningandtheendofthequestionnaireseemedidenticaltoher.Oneparticipantfroma  middleclassneighborhoodjudgedthelayoutaestheticallyunattractive. l Oneinterestingthemethataroseforthosewhofoundthequestionnairehardtocompletewasfear D! ofmakingamistake.Severaloftheseparticipantssaidthattheyrealizedtheimportanceof 0"  providingaccurateinformation,andhadthusdecidednottofilloutthequestionnaireatallrather #l! thanriskmakingamistakethroughinterpretingaquestionincorrectly.Onewomaninanurban $X" communitywhoeventuallyfilledoutthequestionnairewiththehelpofanenumerator,saidthis: $D #   8  "WhenIsawsomanypagesandsomuchwording,IthoughtIwouldnotbeable &"% todoagoodjobwhenfillingitout,andIliketodothingsright.Iwasconscious '#& thatthiswasveryimportant,butIdidnotwanttodoabadjobatfillingitout."(#'   Similarly,aparticipantinaninteriorcommunityhadkeptquestionnairefor2weeksanddone |*%) nothingwithit.Shesaid."IdidnotwanttofillitoutalonebecauseIdidnotknowifIwasgoing h+&* todoagoodjob.Ididnotwanttolivewiththatworry."Shefinallyprevaileduponthe T,'+ enumeratortohelpher. @-(,  ,.|)- Othersstoppedfillingoutthequestionnaireoncetheyrealizedtheyhadeithermadeamistakeor  hadgottentheformdirty.Onewomanleftoffwhenshecouldn'tfindabottleofcorrectionfluid  tocorrecthererror.Anotherparticipantremarked,"ImadeamistakeandIdidn'tsendit,because  Iamnotgoingtosenditwithamarkthroughorthey'lltalkaboutmeafterwards."Apparently, t thereisastrongvalueplacedonhandinginformsthatareneatandclean.Asoneparticipantin ` anurbancommunitynoted,ifachildspillssomethingonaschoolproject,hismotherwillsay: L  "Thatisnogood.Yourteacherwillsayyou'reapig." 8  Mostofthosewhohadmademistakesorsoiledtheirquestionnairesmadenoactiveeffortsto  ` seekoutanothercopy.Onewomangotanewformwhenshejusthappenedtonoticeastackof  L  cleanquestionnairesforthetakingwhileshoppingatWalMart.  8  & J XXɂ 4.5  Summary    #XɂXX#Theabovediscussionencompassesallbutthemostidiosyncraticreasonsgivenbyparticipants   fornothavingreturnedtheirCensus2000questionnairesbymail.Themainreasons,grouped   intofourclusters,canbesummarizedasfollows:  #XɂXXXɂX# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂMotivationalandprocessrelatedreasons.Lackofclarityaboutthepurposeofthe Z census,includingthinkingithadtodowithtaxationorassignmentofwelfarebenefits; F confusionabouttheprocessbywhichthequestionnairesweredistributedandrequire 2 mentsforresponding;anduncertaintyaboutthe"correct"roleoftheenumerator.'J Ln(#(# #XɂXXXɂ# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂPracticalandlogisticalreasons.Lackoftimeanddifficultiesofmailingthe F questionnaire.2(#(# #XɂXXXɂ# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂCulturalandpoliticalattitudinalreasons.Fearthattheinformationwouldn'tbekept   confidential,whichmightresultinlossofgovernmentbenefits;beliefthatthemoney  wouldenduponlyliningthepocketsofthepoliticians;andassociationofthecensuswith  apoliticalcampaign,reinforcingsuspicionsastoits"truepurpose."Also,astrong ~ culturalpreferenceforamorepersonalapproachtodistributing,administering,and j  returningthequestionnaires.V!(#(# #XɂXXXɂk# XɂXXXɂ  @a"0   #XɂXX Xɂ #XɂXXXɂReasonsrelatedtoquestionnairecontentanddesign.Verystrongobjectionstothe .#~! race/ethnicityquestionsasdivisiveandinsensitivetothe"mixed"realitiesofPuerto $j" Ricansociety.Objectionstootherquestions,especiallythoseaboutincomeandfinances, %V # asintrusiveaswellasdifficultanddemandingtoanswer.Complaintsthatthelongform %B!$ askedtoomanyquestions,manyofwhichseemed"outofscope"foracensus,andthat &."% thequestionnairewasdifficulttoreadandunderstand,especiallyforthosewithlittleor '#& noformaleducation.($'(#(# Althoughtheresponseswerereasonablywellspread,thereweresomeinterestingdifferences *%) acrosscommunitiesandgroupsfornotrespondingbymail.Participantsininteriorcommunities z+&* weremorelikelytogivelogisticreasons,especiallydifficultieswithmailingbacktheform,as f,'+ wellasproblemsreadingandunderstandingthequestionnaire,andconfusionabouttheroleof R-(, theenumerator.Bycontrast,whileparticipantsinallgroupsexpressedconcernsthatsome >.)- questionsweretooprivate,therace/ethnicityquestionsemergedasamajorissueonlyinthemore  urbancoastalcommunities.Inthosecommunities,therace/ethnicityquestionsinspiredthemost  strenuousnegativereactionsofanyquestionsontheCensus2000questionnaire.  Thetwinthemesofmistrustofgovernmentandpoliticiansandsuspicionsofan"ulteriormotive" ` forthecensusranthroughvirtuallyallthegroups.However,thesesentimentswereframed L  differentlydependingonthegroup.Inworkingclassandpoorercommunities,bothcoastaland 8  interior,concernscenteredonlosinggovernmentbenefitsorfearsthatthegovernmentwasreally $ t checkinguponwhethertheywerereceivingbenefitsforwhichtheyreallydidn'tqualify.  ` Participantsinthetwomiddleclassneighborhoodsweremorelikelytoexpressthesuspicionthat  L  additionalmoneyreceivedwouldonlybenefitcorruptpoliticians.Moreover,asseen,several  8  peopleinthesesiteswereaffrontedbytheimplicationtheywouldbemotivatedtoreplytothe $  censusinordertogaingovernmentassistance.   AlmosteveryonehadheardsomethingaboutCensus2000fromtelevisionandradioads,   newspapers,schools,orfrominformalsourcessuchasrelatives,neighbors,and"brothers"or   "sisters"intheirchurches.Mosthadalsodiscussedsomeaspectoftheprocesswithsomeone p else.Manyparticipantsindicatedtheyhadconsultedwithfamilymembersorneighborswhile \ tryingtocompletetheirquestionnaires,sometimesinanefforttoreachaconsensusastowhat H wasbeingaskedorhowtheyshouldanswer.Forthevastmajorityofthosewhoparticipatedin 4 theninefocusgroups,then,thiswasasociallygroundedprocess.  p WhileagreeingthatCensus2000wasbetteradvertisedthanpreviouscensuses,mostparticipants H believedtheadvertisingwasn'tverysuccessfulatcommunicatingkeymessages.Severalpeople 4 seemedtorememberbitsandpiecesofslogansorisolatedphrasessuchas"Don'tleaveyour   futureblank"!withouthavinggottentheoverallmessage.Asseen,somefelttheadvertisingwas   "overkill"andtooreminiscentofpoliticalcampaigns.Othersbelievedtheadsplacedundue  emphasisontheimportanceofreturningthequestionnaireswithouteducatingthepublicastothe  census'smissionandpurpose.  Severalthoughtthatamoreeducationallyorientedadvertisingcampaignshouldhavebeen X  initiatedsooner,tobetterpreparepeopleforthechangesinstoreanddispelsomeoftheanxieties D! andmisconceptionsabouttheprocess.Asonemansaid,echoingthesentimentsofmanyofthe 0"  participantsfromalltypesofcommunities: #l! 0  0(#(# (#(#   8  "Thecensussystemshouldbemoreflexible.Alotofpeopledonotknowhowto $D # fillitoutbecauseoflackofeducation.Thistypeofquestionnaireisathreatto %0!$ manypeoplehereinPuertoRico.IdonotknowwhatIdonotknow.Weneedto &"% beeducatedaboutthecensusforalongperiodoftimebeforetheactualcensusso '#& thatweunderstandthecensus'smissionandhowtofillitout."(#'   Critiquesoftheadcampaignandtherequirementsofmailingbackthequestionnairedovetailed |*%) withtheparticipants'clearpreferenceforthe"oldsystem"asconductedin1990.Participantsin h+&* allcommunitiesandacrossalldemographicandeconomicgroupsexpressedastrong,unqualified T,'+ supportforinpersondatacollectionasthemeansofgatheringthenecessaryinformation.Not  @-(, onlyisthisapproachmoreculturallyappropriate,theyfelt,butitisalsomorecosteffectiveand  lesssubjecttoerrorsofinterpretationthatcanoccurwhenquestionnairesarereturnedbymail.  Barringareturntoinpersondatacollection,participantssuggestedsettingupcommunitybased t helpcenterstoaidthosehavingdifficultyansweringthequestionsorneedingspecialassistance ` infillingouttheirquestionnaires,orestablishingothercommunitybasedmechanismsfor L  distributingandcollectingthequestionnaires. {Cens             $   9      ׀ 8  & t @! XXɂ 5.RECOMMENDATIONS   L  #XɂX #ThefocusgroupswithhouseholdheadsinninecommunitiesacrossPuertoRicorevealedfour L  interrelatedclustersofreasonswhytheyhadn'tmailedbacktheirCensus2000questionnaires. 8  AlthoughnotgeneralizabletothelargerpopulationofPuertoRicanhouseholdheads,these $  resultsmaystillhavepotentialimplicationsforchangesthatmightbemadetoimproveresponse   ratesinfuturecensusesontheIsland.Theyalsosuggestareasforfurtherresearchand   exploration.Therecommendationspresentedbelowarethusintendedasonlysuggestive;further  researchandexplorationisnecessarytoputthemonfirmerfooting.'tɥ  XXɂ 5.1Recommendationsarisingfromreasonsformailnonresponse  \ #XɂXl#Thefollowingrecommendationsgrowfromthefourmainclustersofreasonsformailback F nonresponse. 2 #XɂXXXɂ# XɂXXXɂ X Xɂ5.1.1M# #otivationalandprocessrelatedreasons#XɂX֪#Ԁ  Z #XɂXXXɂ"# XɂXXXɂ  @a"0   #XɂXX Xɂɫ#XɂXXXɂProvidemorecomprehensiveinformation,indifferentforms,onthemission,purpose, F andusesofthecensus.Thisinformationshouldbepresentedinamannerthatwillallay 2 misplacedfearsanddirectlyaddresscommonmisconceptions(suchasthatcensus  informationwillbeusedfortaxationpurposes).Disseminatethisinformationindifferent   venuesandthroughavarietyofcommunitychannels(suchasschools,churchgroups,   neighborhoodassociations).!(#(# #XɂXXXɂB# XɂXXXɂ  @a"0   #XɂXX XɂӮ#XɂXXXɂEspeciallyforthosewhodoreceivethelongform,explaintherationaleforhavingbotha j#! longformandashortformversionofthequestionnaireaswellasthereasonsfor V$" includingtheadditionalquestionsandneedforthedetailedinformationtheyrequest.B% #(#(# #XɂXXXɂL# XɂXXXɂ  @a"0   #XɂXX Xɂ۰#XɂXXXɂProvideacomprehensiveandcleardescriptionofthechangedroleoftheenumeratorin 'j"% thedatacollectionprocess.Thisshouldbedisseminated,alongwithinformationonthe (V#& missionandpurposeofthecensus,beforetheenumeratorsdropoffthequestionnaires.(B$'(#(#  ).%( #XɂXXXɂT# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂSupplyveryclear,simple,stepbystepinstructionsontheproceduresthattherespondent  shouldfollowincompletingandmailingbackthequestionnaireincludingsuch  seeminglyminordetailsaswhetherpostageisrequired.Apartfromthe800number,  informpeopleofthelocationsandhoursofoperationoftheAssistanceCentersaswellas t theservicesprovidedthere.`(#(# 5.1.2Practicalandlogisticreasons 8  #XɂXXXɂq# XɂXXXɂ  @a"0   #XɂXX Xɂڵ#XɂXXXɂAlthoughthereiscertainlynowaytogivepeoplemoretimeintheirbusylives,improv  ` ingmotivationbyprovidingaclearerunderstandingofthepurposeandimportanceofthe  L  census,assuggestedabove,mightgivecompletingthecensusquestionnairehigher  8  priorityamongcompetingdemands.$ (#(# #XɂXXXɂS# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂInruralareas,wherepeoplehavetotravelsubstantialdistancestoreachapostoffice,it   mighthelptoestablishspeciallydesignateddropoffpointsforthecensusquestionnaires. (#(# & ` #XɂXXXɂ# XɂXXXɂ X Xɂ5.1.3Cultural# ʹ#Ԁandpoliticalattitudinalreasons#XɂX# p #XɂXXXɂ=# XɂXXXɂ  @a"0   #XɂXX Xɂߺ#XɂXXXɂTheseareprobablythehardestreasonstodealwithdirectly,astheyrelatetobroadlyheld \ viewsandattitudes.However,culturalandattitudinalbarriersmayalsobeaddressed,to H someextent,bybetterinformation.Forexample,ifgeneralizedsuspicionofpoliticians 4 makespeoplemoreinclinedtodoubttheconfidentialityoftheiranswers,theseconcerns  p mightbedirectlyaddressedasfactuallyincorrect.However,thetoneaswellasthe  \ contentofanysuchcommunicationwillbeimportant,becauseseemingto"protesttoo H much"mightmakepeoplemoresuspicious'`p.4(#(# #XɂXXXɂX# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂBarringareturntothemorepersonaldoortodoorapproachtakenin1990,anyattemptto   personalizetheprocesswouldprobablymeetwithapositiveresponse.(#(# #XɂXXXɂ#XɂXXXɂXXɂ5.1.4Questionnairedesignandcontent#XɂX4#   #XɂXXXɂ# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂConductfurtherresearchinPuertoRicoonviewsandperceptionsoftheCensus2000 l! questionsonraceandethnicity,whichdrewsuchstrongnegativereactionsfrom X"  participantsinmoreurban,coastalcommunities. %Cens      %   10      ׀Comparethistosimilarrelevant D#! researchconductedstatesidetotrytoestablishcommonaltiesanddifferencesbetweenthe 0$" PuertoRicancaseandothers.%l #(#(# #XɂXXXɂX# XɂXXXɂ  @a"0   #XɂXX Xɂ #XɂXXXɂIncludePuertoRicoinanyadditionalcognitivetestingoreffortstofieldtestdifferent &D"% versionsandformatsofquestionsandquestionnairesforfuturecensuses.'0#&(#(#   ($' &   XXɂ 5.2Overarchingrecommendations   #XɂX#Inadditiontothosepresentedabove,weoffertwoadditional,overarchingrecommendations:  #XɂXXXɂ# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂUsetheresultsandrecommendationsfromthisstudy,aswellasothersupportingtesting r andresearch,todevelopadvertisingappealsforcensusparticipationmoreattunedtothe ^  PuertoRicanpopulation.'J (#(# #XɂXXXɂ=# XɂXXXɂ  @a"0   #XɂXX Xɂ#XɂXXXɂConsiderusingtheresultsofthisstudytocreateacloseendedsurveytobeadministered " r toaprobabilitysampleofresidentsoftheIsland.Thesurveycouldseektherespondents'  ^  viewsofdifferentapproachestodatacollectionforthecensus,aswellastheirreactions  J  tothecontentofanynewmaterialsoradvertisementsdevelopedfromthespecific 6  recommendationsofferedhere." (#(#  XXɂ     1OY  1 1  @@% References   #XɂX 0#OBerkowitz,SusanG.(1996). UsingQualitativeandMixedMethodApproaches.InReviere,  R.,Berkowitz,S.,Carter,C.andGravesFerguson,C(Eds.),NeedsAssessment:ACreativeand  PracticalGuideforSocialScientists,(Washington,D.C.:Taylor&Francis),pp.5370.  #XɂXXXɂ#@*  L    XɂXXXɂ  X Xɂ    AppendixA1# XɂX  #     &%X XɂPUERTORICOEVALUATION!ENGLISHVERSION    (ScreenerforFocusGroupParticipation)  ` ~  e &%% & &%% & &%% & &%% &&M%%% &&M%%%%&M&M%%%%&M&A%%%&M  #&%%&A# &%%&eK  Hello.Mynameis()andIworkforWestat,aresearchcompanylocatedoutside  ` Washington,D.C.WestatisdoingastudyfortheUSCensusBureautofindoutmoreaboutwhypeople  8 inPuertoRicomaynothavereturnedtheirCensus2000forms.eK݌   Ќ &%% & &%% & &%% & &%% & &%% & &%% & &%% & &%% &  First,canIaskwhetherornotyoumailedbackyourCensus2000formthatwouldhavebeenseveral p   monthsago,inMarchorAprilsometime?(Ifindividualdoesnotremember,facilitatorwillshowcopies H  oftheformtojogtheirmemory.Iftheindividualsayshe/shereturnedtheformorcannotremember,  p  thankhim/herfortheirtimeandproceedtothenextdwelling.Ifisreasonablysurehe/shedidnot H  answer,thencontinue).   Tostartwith,willyouanswerafewshortquestionsforme?YoucanfilloutthisformyourselforIwill   behappytotakedowntheanswersforyou. X 1)Howlonghaveyoulivedatthisaddress?__________mos/yrs X 2)Howmanypeople,includingyourself,normallyresidehere?_______________  3)Howoldareyou? h  f(44J E% <DL!, XE 2   1  )3   1825 h <% <DL!  X<2   2  )3   2635 @ <% <DL!  X<2   3  )3   3645  <% <DL!  X<2   4  )3   4655  <% <DL!  X<2   5  )3   5665 x <% <DL!  X<2   6  )3   6675 P <% <DL!  X<2   7  )3   7685 (x <% <DL!  X<2   8  )3   85+  P    B+ 4 <DL!  XB4)Whatisthehighestlevelofeducationthatyouhavecompleted? !" / / 9% <DL!X9 2   1  )3   noformalschooling `#$ <% <DL!  X<2   2  )3   elementaryschool(6ththgradeorless) 8$% <% <DL!  X<2   3  )3   middleschool(7th9thgrade) %` & <% <DL!  X<2   4  )3   somehighschool %8!' <% <DL!  X<2   5  )3   highschoolgraduate &"( <% <DL!  X<2   6  )3   somecollege '") <% <DL!  X<2   7  )3   Associatesdegree p(#* <% <DL!  X<2   8  )3   Bachelorsdegree H)$+ <% <DL!  X<2   9  )3   Postgraduatedegree h      p      x   *p%,  *H&-   B+ 4 <DL!  XB   `    # XɂX% &#  \X Xɂ    -(0   # XɂX \# &%X Xɂ?+ 4 <DL!X?5)Whatisyouroccupation?(includesstudent,housewife,unemployed,occasionallyemployed)  ________________________________________ ` 6)Doyourememberwhichcensusformyoureceived?   / / 9% <DL!X9 2   1  )3   Ireceivedthelongform p  <% <DL!  X<2   2  )3   Ireceivedtheshortform H   <% <DL!  X<2   3  )3   Imnotsure/Dontremember  p    B+ 4 <DL!  XB7)Herearesomereasonswhysomeonemightnothavereturnedtheircensusforms.Pleasecheckoffall   thereasonsthatapplytoyou:     / / 9% <DL!X9 2   1  )3   Iaccidentallythrewouttheform X  <% <DL!  X<2   2  )3   Iforgotaboutormisplacedtheform 0  <% <DL!  X<2   3  )3   Theformwastoolong X <% <DL!  X<2   4  )3   Icouldntreadtheform 0 <% <DL!  X<2   5  )3   Theinstructionswereconfusingtofollow  <% <DL!  X<2   6  )3   Someofthequestionsweretoopersonal  <% <DL!  X<2   7  )3   Someofthequestionswerehardtounderstand h <% <DL!  X<2   8  )3   Ididnotwantthegovernmenttoknowmybusiness @ <% <DL!  X<2   9  )3   Ididnotbelievethattheinformationwouldbekeptconfidential h <% <DL!  X<2   10  )3   Ididnotseewhatgooditwoulddoformeormyfamily @ <% <DL!  X<2   11  )3   Iwasnotsurehowtheinformationwouldbeused  <% <DL!  X<2   12  )3   Iwastoobusywithotherthings  <% <DL!  X<2   13  )3   Other(specify) x   B+ 4 <DL!  XBThankyouforrespondingtothesequestions.Wouldyoubeinterestedinparticipatinginagroupdiscussion (x withaboutsixtoeightotherpeopletotalkmoreaboutthissubject?Theotherparticipantswouldalsobe P personsfromthisareawhodidnotrespondtothecensus.Itwillbeanopenendeddiscussioninwhichyou ( willbeabletoexpressandshareyourviewsfreely.Thegroupwilllastabout2hoursandwillbeheld   somewherecloseby.Ifyouweretobeinvitedtoparticipate,youwouldalsobepaid$20andyour  ! transportationcostswouldbecovered.Babysittingwillalsobeprovidedifyouwouldneedtobringyour `!" childrenalong,andfoodanddrinkswillbeserved. 8"# Doyouthinkyouwouldwanttoparticipate(Ifanswersyes,)CanIhave yourname, aswellasan address #8%  and telephonenumber whereImayreachyouinthenextfewweeks?Also,whatwouldbeagooddayof $ & theweekandtimeofthedayoreveningforyou?(Determineweekdayorweekend,daytimeorevening). % ' Thankyousomuch,andyoumaybehearingbackfromusverysoon. x&!(   ((x#* # XɂX% &#   X Xɂ  AppendixA2# XɂX  #     &%X XɂPUERTORICOEVALUATION!SPANISHVERSION  " # XɂX% &.##XɂXX Xɂ#&%XXɂ &%%&e XɂX% & XɂXX Xɂ XɂXX Xɂ XɂXX XɂX&(XX XɂX&(X(XX&X&(X(XX&X7X(XX&  #XɂXXX7# XɂXXXɂ# XɂXX Xɂ# &%X Xɂe$  Buenosdas/tardes/noches.Minombrees(_____________)yestoytrabajandoparaWestat,staesuna 8  compaaenelreadeWashingtonD.C.quehaceestudiosparadiferentesorganizacionesyagenciasde  ` gobierno.Enestosmomentos,WestatesthaciendounestudioparaelCensoconelprop;sitode  8 conocerunpocomslaopini;ndelaspersonassobreelprocesodellenarydevolverloscuestionarios..e$݌   Ќ &%% & &%% & &%% & &%% &  Djemepreguntarle,envi;ustedporcorreoelcuestionariodelCenso?Recuerdasidevolvi;el p   formulario?Esotuvoquehabersidoenalgunmomentoentremarzoyabril.(Encasodenorecordar,el H  facilitadorpuedemostrarleloscuestionariosporaquelloderefrescarleslamemoria.Silapersonadice  p  quedevolvi;elcuestionarioonorecuerdahaberlodevuelto,dleentonceslasgraciasypaseala H  pr;ximavivienda.Continueconlaencuestasilapersonaestarazonablementeseguradequenolo   devolvi;).   Podrahacerlealgunaspreguntas? X  ,?+ 4 <DL!X? 1.  Cuntotiempollevaviviendoenestadirecci;n/rea?____________aos/meses X   ,B+ 4 <DL!4XB ,?+ 4 <DL!X? 2.  Cuntaspersonas,incluyndoseausted,vivenenlacasa?    ,B+ 4 <DL!4XB ,?+ 4 <DL!X? 3.  Cuntosaostiene? h   ,B+ 4 <DL!4XB J(4 4 f/ / 9% <DL!X9 2   1  )3   ` 1825 h 9% <DL!  X92   2  )3   ` 2635 @ 9% <DL!  X92   3  )3   ` 3645  9% <DL!  X92   4  )3   ` 4655  9% <DL!  X92   5  )3   ` 5665 x 9% <DL!  X92   6  )3   ` 6675 P 9% <DL!  X92   7  )3   ` 7685 (x 9% <DL!  X92   8  )3   ` 85+  P    ?+ 4 <DL!  X? f(44J ,?+ 4 <DL!X? 4.  Culfueelnivelmsaltoquelleg;enlaescuela? !"   ,B+ 4 <DL!4XB J(44f/ / 9% <DL!X9 2   1  )3   ` Nuncafuealaescuela `#$ 9% <DL!  X92   2  )3   ` Escuelaelemental(hastaelsextogrado) 8$% 9% <DL!  X92   3  )3   ` Escuelaintermedia(delsptimoalnovenogrado) %` & 9% <DL!  X92   4  )3   ` Algunosaosdeescuelasuperiorperonotermin; %8!' 9% <DL!  X92   5  )3   ` Segradu;deescuelasuperior &"( 9% <DL!  X92   6  )3   ` Algunoscursosuniversitarios '") 9% <DL!  X92   7  )3   ` GradoAsociado p(#* 9% <DL!  X92   8  )3   ` Bachillerato H)$+ 9% <DL!  X92   9  )3   ` EstudiosGraduados  *p%,   ?+ 4 <DL!  X? f(4 4 J ,?+ 4 <DL!X? 5.  Enqutrabajausted?(incluyecategoriascomoestudiante,amadecasa,desempleado,empleado + '. ocasionalmenteochiripas) ,'/   ,B+ 4 <DL!4XB________________________________________ X.)1 Ї6.  Recuerdaustedquetipodecuestionariodelcensorecibiousted?  ?+ 4 <DL!X? J(4 4 f/ / <(` ` <DL!X< 2   1  )3   4 Recibelcuestionariolargo ` ?(` ` <DL!` ` X?2   2  )3   4 Recibelcuestionariocorto 8 ?(` ` <DL!` ` X?2   3  )3   4 Noestoyseguro(a)/Norecuerdo `   B+ 4 <DL!` ` XB f(44J ,?+ 4 <DL!X? 7.  Acontinuaci;nhayunlistadoderazonesporlasqueunapersonapudohaberdecididonodevolvero   enviarporcorreoelcuestionariodelcenso.Porfavor,marquetodaslasrazonesqueapliquen:     ,B+ 4 <DL!4XB J(44f/ / <(` ` <DL!X< 2   1  )3   4 Accidentalmentebotelcuestionario H   ?(` ` <DL!` ` X?2   2  )3   4 Meolvidolopuseenalgnsitioquenorecuerdo  p  ?(` ` <DL!` ` X?2   3  )3   4 Elcuestionarioerademasiadolargo  H  ?(` ` <DL!` ` X?2   4  )3   4 Nopodaleerelcuestionario   ?(` ` <DL!` ` X?2   5  )3   4 Lasinstruccioneseranconfusas   ?(` ` <DL!` ` X?2   6  )3   4 Algunaspreguntaseranmuypersonales   ?(` ` <DL!` ` X?2   7  )3   4 Algunaspreguntaserandifcilesdeentender X  ?(` ` <DL!` ` X?2   8  )3   4 Noqueraqueelgobiernosupierademisasuntos 0  ?(` ` <DL!` ` X?2   9  )3   4 Nocrequelainformaci;nfueraconfidencial X ?(` ` <DL!` ` X?2   10  )3   4 Nosquebeneficiospuedatenerparamomifamilia 0 ?(` ` <DL!` ` X?2   11  )3   4 Noestabasegurodecomousaranlainformaci;n  ?(` ` <DL!` ` X?2   12  )3   4 Estabademasiadoocupado  ?(` ` <DL!` ` X?2   13  )3   4 Otra(especifique):_________________________ h   B+ 4 <DL!` ` XBMuchsimasgraciasporcontestarestaspreguntas.Estarainteresadoenparticiparenunareuni;ncon h otras68personasparadiscutirestetemaconmsprofundidad?Aestareuni;nestariamosinvitandoa @ otraspersonasdeestacomunidad/reaquenodevolvieronelcuestionariodelcenso.Lareuni;ntomara  alrededorde2horasylaestaramoshaciendoenunlugarcercadeestarea.Departicipar,usted  recibira$20msloscostosdetransportaci;n.Tambintendremoscomidayunanieraencasodeque x necesitetraerasuhijo(a).. P Leinteresaraparticipar?(Delapersonacontestarenlaafirmatima,entoncespdalelasiguiente P informaci;n:)Podradarmesu nombre, direcci;n y nmerodetelfono parahacerlellegarla ( invitaci;nenlaspr;ximassemanas?Culseraelmejordaylamejorhoraparausted?(Distingaentre   dadelasemanayfindesemana;horasdeldiaodelanoche;mejormomentoparareunirseymejor  ! momentoparahablarle).Muchsimasgraciasporsucooperaci;nypodramosestarlellamando/dando d!" msinformaci;nenlospr;ximosdas. <"#   #<% # XɂX% &#    X Xɂ    AppendixB1# XɂX  r/#  /#XɂXX Xɂ]# XɂXXXɂ e/   &%X XɂPUERTORICOEVALUATION  FOCUSGROUPPROTOCOL       0 @ 0@` (#(#0@ ` (#` (#0@ (# (#0@h(#(#0@h(#h(# ENGLISHVERSION  ` 0INTRODUCTIONThankyouforcomingheretoday/thisevening.Mynameis()andI  ` willbeleadingthediscussion.Thisismycolleague,___________________.S/hewillbehelpingby  8 takingnotesandmakingsureeverythingisfunctioningproperly.WebothworkforWestat,aprivate   companythatisdoingthisstudyfortheU.S.CensusBureau.    WeareheretofindoutmoreaboutwhypeopleinPuertoRicodidnotreturntheirCensus2000forms. H  WewanttolearnyourreasonsfornotrespondingtotheCensussothatwecandobetternexttime.We  p  areheretolearnfromyou.Youaretheexperts;therearenorightorwronganswers.Pleasefeelfreeto H  speakyourmind.   Ialsowanttoassureyouthatyouranswerswillbekeptstrictlyconfidential.Theresearchersworkingon   thisprojectaretheonlypeoplewhowillknowwhosaidwhat.Thereportthatwillbewrittenwillbring X togethertheviewsexpressedbyallthepeopleparticipatinginthesediscussionsacrossPuertoRico,and 0 noonewillbeidentifiedbyname.Wewillbetaperecordingthesessionsowecanbesuretogetthe X mostaccurateinformation.ArethereanyfurtherquestionsaboutthestudybeforeIstarttoexplainthe 0 rulesfortodays/tonightssession.  Hasanyoneparticipatedinafocusgroupbefore?Therulesarequitesimple.Everyonehasanamecard h infrontofyou,soIcancallonyoubyname.First,wewillgoaroundtheroomandeveryonewill @ introducethemselvesandsaywheretheylive.ThenIwillstartbyaskingaquestion.Whoeverwantsto h canbefirsttoanswer.Oncethatpersonhasfinished,someoneelsecanspeak.Ifyouhavesomethingto @ say,butsomeoneelseisstilltalking,pleaseraiseyourhand,andwaituntilIcallonyou.Everyonewill  haveaturn.  ̀LETSFIRSTGOAROUNDTHETABLE.CANEACHPERSONGIVETHEIRNAMEAND (x WHERETHEYLIVE?  P  I.IDLIKETOSTARTBYASKINGYOUTOTHINKBACKAFEWMONTHSTOWHENYOU !" FIRSTGOTALETTERTELLINGYOUTHECENSUSFORMWOULDBEDELIVEREDSOON, "# ANDTHEN,WHENYOURECEIVEDTHEACTUALFORMWITHTHEQUESTIONS.WHAT `#$ WASYOURREACTION?(Probeonwhethertheprocessworkedasintended,whethertheadvance 8$% letterwasread,whethertheinstructionsaboutproceduresandmailbackwereclear). %` & II.BYTHETIMEYOURECEIVEDYOURFORMS,HADYOUALREADYHEARDABOUTTHE &"( CENSUSFROMANYOTHERSOURCES?(Probeonsourcessuchastelevisionorradioads, '") billboards,neighbors,newspapers,religious/churchgatherings,fromschoolagedchildren)?WHAT p(#* HADYOUHEARD?AFTERYOUGOTTHEFORM,DIDYOUTALKTOANYONE"A H)$+ RELATIVE,FRIENDORANEIGHBORABOUTTHECENSUS?IFSO,HOWDIDTHOSE  *p%, DISCUSSIONSINFLUENCEYOURIDEASABOUTWHETHERTORESPOND? *H&- III.THEREAREDIFFERENTPOINTSATWHICHAPERSONMIGHTDECIDENOTTO ,'/ RESPONDTOTHECENSUS"FOREXAMPLE,ONEPERSONMIGHTNOTEVENOPENTHE -(0 ENVELOPE,WHILEANOTHERMIGHTGETPARTWAYTHROUGHTHEFORMBEFORE X.)1 DECIDINGNOTTOCONTINUE.HOWFARINTOTHEPROCESSDIDYOUGET?(Probeon  whethertherewereliteracyissues,problemswithunderstandabilityofquestionsorinstructions,  objectionstocontentofquestions,etc) ` IV.ALLINALL,WHATWOULDYOUSAYISTHESINGLEMOSTIMPORTANTREASONYOU ` DIDNOTRESPONDTOCENSUS2000? 8 V.WHAT,IFANYTHING,COULDHAVEBEENDONEDIFFERENTLYTHATWOULDHAVE   MADEYOUCOMPLETEANDRETURNYOURCENSUSFORM? p  # XɂX% &_0#  &%X Xɂ  4    # XɂX% &B#  X Xɂ  AppendixB2# XɂX  B#  #XɂXX Xɂ 0# XɂXXXɂ &%X XɂPUERTORICOEVALUATION  FOCUSGROUPPROTOCOL  SPANISHVERSION  ` Introducci;n:  `   Graciasporacompaarnoseneldadehoy.Minombrees(____________)yestardirigiendola   conversaci;nquetendremosenesta(maana,tarde,noche).Este(a)esmicompaero(a)(___________)y    l(ella)estartomandonotasypendienteaquelagrabadoraestfuncionandoperfectamente.Ambos(as) p   trabajamosparaWestat.WestatesunacompaaprivadalocalizadaenMarylandquesededicaahacer H  estudiosparadiferentesorganizaciones.  p  EstamosaquparaaprenderoconocerunpocomslasrazonesquetuvieronlaspersonasenPuertoRicopara   nodevolverporcorreoloscuestionariosdelCenso2000.Estainformaci;nnosayudaramejorarelproceso   deenviaryrecibirloscuestionariosenelpr;ximoCenso.Enestetipodeentrevistagrupalnoexisten   respuestascorrectas(buenas)oincorrectas(malas)porloquepuedensentirseenlalibertaddehablar X abiertamentesobreeltema. 0 Esimportanteenfatizarquesusrespuestassonestrictamenteconfidenciales.Solamentelosencargadosde 0 esteestudiotendrnaccesoalainformaci;n.Elinformefinalincluirlostemasdiscutidosenlas12  entrevistasgrupalesqueharemosportodalaislaporloqueningnparticipanteseridentificadoporel  nombre.Comolesinformamosanteriormente,estaentrevistagrupalsergrabadaparaasegurarnosdetener h lainformaci;ncompleta.Hayalgunapreguntasobreelestudioantesdecomenzar?(Losfacilitadores @ debenleery/odiscutirlacartadeconfidencialidadypedirlesalosparticipantesquelafirmen). h Hayalguienquehayaparticipadoanteriormenteenunaentrevistagrupal?Lasreglassonbastantesimples.  Cadapersonatieneenfrenteunatarjetaconsunombre,estoesparaquesemehagamsfcilelrecordarsus  nombres.Primerolesvoyapedirquecadaunodigasunombreycualquierotrainformaci;nqueustedes x quierandarnos.Despusharalgunaspreguntasycualquieradeustedespuedecomenzarconladiscusi;n. P Cuandoesapersonaterminedehablar,otrapuedeseguiryassucesivamente.Siustedquieredeciroaadir (x algocuandohayaalguienhablando,entonceslevantesumanoparaentoncescederleelturno.Algunaotra  P  pregunta?  (! PRIMEROLESVOYAPEDIRQUECADAPERSONADIGASUNOMBREYCUALQUIEROTRA "# INFORMACIONPERSONALQUEQUIERANDARNOS.QUIENQUIEREEMPEZAR? `#$ I:  PARACOMENZAR,MEGUSTARIAPEDIRLESQUEPIENSENCUANDOLESLLEGO,POR %` & PRIMERAVEZ,LACARTAQUELESDECIAQUERECIBIRIANELCUESTIONARIODELCENSO %8!' YENELMOMENTOENQUERECIBIERONELCUESTIONARIO.CUALFUESUREACCION? &"( (Preguntarsielprocesoresult;sercomosepretenda,sileyeronlacartaysilasinstruccionessobrelos '") procedimientosdellenarydevolverloscuestionariosestabanclaros). p(#*  f(4 4 J/ / X<(4 4 <DL!X< 2   2  .3    HABIANESCUCHADOOVISTOALGUNAINFORMACIONSOBREEL  *p%,   X?+ 4 <DL!44X?CENSOPARAELMOMENTOENQUELESLLEGOELCUESTIONARIO?(Preguntarsobrelasfuentes *H&- deinformaci;n;porejemplo,anunciosderadiootelevisi;n,reportajes,peri;dicos;tablonesdeanuncios, + '. aficheso posters,vecinos,informaci;nprovistaenlaiglesia/reunionesecumnicasoporniosqueestn ,'/ enlaescuela)QUEFUELOQUEESCUCHARON?DESPUESDEHABERRECIBIDOEL -(0 CUESTIONARIODELCENSO,USTEDESHABLARONCONALGUNFAMILIAR,AMIGOOVECINO X.)1 SOBREELCENSO?DEQUEMANERAINFLUYERONESASCONVERSACIONESENSU  DECISIONDEENVIARLOONO?   X<(4 4 <DL!X< 2   3  .3    HAYVARIOSPUNTOSENELPROCESOENQUEUNAPERSONAPUDO 8   X?+ 4 <DL!44X?HABERDECIDIDONOCONTESTARODEVOLVERELCENSO"POREJEMPLO,UNAPERSONA ` PUDOHABERDECIDIDONOABRIRELSOBREMIENTRASQUEOTRAPUDOHABER 8 COMENZADOACONTESTARLOYLUEGODEHABERLEIDOVARIASPREGUNTASDECIDIONO   CONTINUAR.CUANLEJOSLLEGARONUSTEDESENESTEPROCESO?(Versiestono   relacionadoconnivelesdeescolaridad,problemasentendiendolaspreguntasy/oinstrucciones,alguna p  objeci;nalcontenidodelaspreguntas,etc.) H    X<(4 4 <DL!X< 2   4  .3    CUALSERIAPARAUSTEDESLARAZONMASIMPORTANTEPARA  H    X?+ 4 <DL!44X?QUEUSTEDESDECIDIERANNORESPONDER/DEVOLVERELCUESTIONARIODELCENSO?   V.  QUECOSASELCENSOHUBIESEHECHODIFERENTE,SIALGUNA,PARAQUEUSTEDES   COMPLETARANYDEVOLVIERANELCUESTIONARIO? X    X # XɂX% &C#   X Xɂ  AppendixC# XɂX  \#  |] &%X Xɂ  PUERTORICOEVALUATIONOBSERVATIONSUMMARYFORFOCUSGROUPS# XɂX% &1]##XɂXX XɂC# XɂXXXɂ &%X Xɂ   P] NameofObserver/comoderator: 8  NameofModerator:  8  Dateandtimeoffocusgroup:     Location :( ** Ifthereisanythingremarkableaboutthemeetinglocation(e.g.,particularsectionoftown, H  individualshome,orneighborhoodcharacteristics)orthearrangementsthatwentintothegroup,please $t  commentbriefly.) L   1.PhysicalSetting: Briefdescriptionofsettinginwhichmeetingistakingplace(e.g.,typeof   building,,sizeandshapeofroom,arrangementoffurniture,conditionofthefacilities,distractingnoises,  etc) l   <$% 2.Participants ` Listnamesofallparticipants.  *TU ddd Xdd Xdd X(#(#,jbZ,jbb+  6))'`` 6g   &%% & &%% &&M%%% &&M%%%%&M&M%%%%&M&A%%%&M    #&%%&A]# &%%&gb  Namegbc .cԌ ?))),!h )) ?Ќ   &%% & &%% & &%% & &%% & &%% & &%% &  g   &%% & &%% &&M%%% &&M%%%%&M&M%%%%&M&A%%%&M    #&%%&Ac# &%%&gHe  HomeAddress gHe{f FO!fԌ s))d,h    )))  ?1.?sЌ   &%% & &%% &  ̀1. U)))B7 p  ?1. ?)) U j))[#H   )))  @2.@j̀2. U)))B7 (   @2. @)) U J));# P    ))) J̀3. 6)))#  )) 6 J));#     ))) J̀4. 6)))#H )) 6 J));#p    ))) J̀5. 6)))#P )) 6 j))[#(x    )))  @6.@j̀6. U)))B7   @6. @)) U J));#0    ))) J̀7. 6)))#p )) 6 J));#    ))) J̀8. 6)))#(x)) 6 J));#P   ))) J̀9. 6)))#0)) 6 J));#X   ))) J 6)))# )) 6 J));#!   ))) J 6)))#")) 6 J));##   ))) J 6)))#$)) 6 J));#%   ))) J 6)))#`&)) 6 J));#`'   ))) J 6)))#@()) 6 L)));#@)   ))) L 6))))# p*))) 63)' p+    )))) 3  - 3.SeatingArrangement/Sociogram h Pleasedrawtheseatingarrangementandlabelwhoissitting  where.   9% <DL!X9 a. ` Placeacheckmarknexttothepersonsnameeachtimes/hespeaks. 8 9% <DL!  X9b. ` (Ifnottoodistracting)Drawarrowsshowingwhoisaddressingremarkstowhom. `   X<(4 4 <DL!  X<S]hXT ~0 4 p5 @ X 5 E] 4 4 a *! X?+ 4 <DL!44X?  `!" 4.Generalobservations  Asyouobservetheinteractionsamongtheparticipants,payattentionto  thefollowingissues(N.B.theremaybeother,relevantmattersthatarenotlistedbelow).   X<(4 4 <DL!X</ / X9% <DL!44X9 2   1  .3   Facilitatorsstyleandgroupsresponsetoit; 8 <% <DL!  X<2   2  .3   Expressionofviews!opennessofthegrouptovoicingandhearingdiverse | opinions;   <% <DL!  X<2   3  .3   Nonverbalsignals(e.g.,bodylanguage);  T  <% <DL!  X<2   4  .3   Degreetowhichonepersonorsubgroupisdominatingthediscussion; H   <% <DL!  X<2   5  .3   Indicationsthattherearedivisionsortensionsinthegroupandhowthesebreak    down.     B+ 4 <DL!  XB X<(4 4 <DL!X< &%% & &%% &&M%%% &&M%%%%&M&M%%%%&M&A%%%&M  #&%%&A\f# &%%&y  (Observationsshouldcontainmoreinformationthansimplyyourperspective.Forexample,do <  notwrite, Juanbecameangry,butrather Juanseemedtogetangry,asheraisedhisvoiceand   poundedhisfistonthetablewhenhespoke.Thiswillallowthereadertodrawhis/herown   conclusionsaboutthebehaviorandenhanceourabilitytointerpretthefindings.)y\{݌ t Ќ X X44X &%% & &%% & &%% & &%% & &%% & &%% &  X  ,%| * 5.OverallObservations:Brieflysummarizethetoneandfeelofthegroup,majorthemesthat  seemedtoemergefromthesession,andanyadditionalcommentsthatyoubelievewillhelpusto  interpretthetranscript.Pleasealsoincludeany lessonslearnedastowhattodoornottodoin ` thenextgroupbasedonhowthisgroupwent. 8 #&%% &={##XɂX%&]# XɂXXXɂ