Extracting noun phrases for all of MEDLINE.

N. A. Bennett, Q. He, K. Powell, B. R. Schatz

Research output: Contribution to journalArticlepeer-review

Abstract

A natural language parser that could extract noun phrases for all medical texts would be of great utility in analyzing content for information retrieval. We discuss the extraction of noun phrases from MEDLINE, using a general parser not tuned specifically for any medical domain. The noun phrase extractor is made up of three modules: tokenization; part-of-speech tagging; noun phrase identification. Using our program, we extracted noun phrases from the entire MEDLINE collection, encompassing 9.3 million abstracts. Over 270 million noun phrases were generated, of which 45 million were unique. The quality of these phrases was evaluated by examining all phrases from a sample collection of abstracts. The precision and recall of the phrases from our general parser compared favorably with those from three other parsers we had previously evaluated. We are continuing to improve our parser and evaluate our claim that a generic parser can effectively extract all the different phrases across the entire medical literature.

Original languageEnglish (US)
Pages (from-to)671-675
Number of pages5
JournalProceedings / AMIA ... Annual Symposium. AMIA Symposium
StatePublished - 1999

ASJC Scopus subject areas

  • Medicine(all)

Fingerprint Dive into the research topics of 'Extracting noun phrases for all of MEDLINE.'. Together they form a unique fingerprint.

Cite this