http://www.census.gov/population/www/censusdata/cencounts.html
County Population Census Counts 1900-90
These are decennial counts.

00-90doc.txt -- docuemntation

1900-90.txt  -- has data in one easy to use flat format, rather than
                one file per state and multiple records per file.