A framework to access handwritten information within large digitized paper collections

Liana Diesendruck, Luigi Marini, Rob Kooper, Mayank Kejriwal, Kenton Guadron McHenry

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

We describe our efforts with the National Archives and Records Administration (NARA) to provide a form of automated search of handwritten content within large digitized document archives. With a growing push towards the digitization of paper archives there is an imminent need to develop tools capable of searching the resulting unstructured image data as data from such collections offer valuable historical records that can be mined for information pertinent to a number of fields from the geosciences to the humanities. To carry out the search, we use a Computer Vision technique called Word Spotting. A form of content based image retrieval, it avoids the still difficult task of directly recognizing the text by allowing a user to search using a query image containing handwritten text and ranking a database of images in terms of those that contain more similar looking content. In order to make this search capability available on an archive, three computationally expensive pre-processing steps are required. We describe these steps, the open source framework we have developed, and how it can be used not only on the recently released 1940 Census data containing nearly 4 million high resolution scanned forms, but also on other collections of forms. With a growing demand to digitize our wealth of paper archives we see this type of automated search as a low cost scalable alternative to the costly manual transcription that would otherwise be required.

Original languageEnglish (US)
Title of host publication2012 IEEE 8th International Conference on E-Science, e-Science 2012
DOIs
StatePublished - Dec 1 2012
Event2012 IEEE 8th International Conference on E-Science, e-Science 2012 - Chicago, IL, United States
Duration: Oct 8 2012Oct 12 2012

Publication series

Name2012 IEEE 8th International Conference on E-Science, e-Science 2012

Other

Other2012 IEEE 8th International Conference on E-Science, e-Science 2012
CountryUnited States
CityChicago, IL
Period10/8/1210/12/12

    Fingerprint

ASJC Scopus subject areas

  • Computer Science (miscellaneous)

Cite this

Diesendruck, L., Marini, L., Kooper, R., Kejriwal, M., & McHenry, K. G. (2012). A framework to access handwritten information within large digitized paper collections. In 2012 IEEE 8th International Conference on E-Science, e-Science 2012 [6404434] (2012 IEEE 8th International Conference on E-Science, e-Science 2012). https://doi.org/10.1109/eScience.2012.6404434