In 1870, over 6,500 marshals and assistants counted the U.S. population, which had grown to over 38 million. It wasn't until 1880 that specially trained enumerators carried out the census.