Targeting precision: A hybrid scientific relation extraction pipeline for improved scholarly knowledge organization

Ming Jiang, Jennifer D'Souza, Sören Auer, J. Stephen Downie

Research output: Contribution to journalArticlepeer-review


Knowledge graphs have been successfully built from unstructured texts in general domains such as newswire by leveraging distant supervision relation signals from linked data repositories such as DBpedia. In contrast, the lack of a comprehensive ontology of scholarly relations makes it difficult to similarly adopt distant supervision to create knowledge graphs over scholarly articles. In light of this difficulty, we propose a hybrid approach to extract scientific concept relations from scholarly publications by: (a) utilizing syntactic rules as a form of distant supervision to link related scientific term pairs; and (b) training a classifier to further identify the relation type per pair. Our system targets a high-precision performance objective as opposed to high recall, aiming to reduce the noisy results albeit at the cost of extracting fewer relations when building scholarly knowledge graphs over massive-scale publications. Results on two benchmark datasets show that our hybrid system surpasses the state-of-the-art with an overall 60% F1 score led by the nearly 15% precision boost in identifying related scientific concepts. We further achieved an overall F1 in the range 34.1% to 51.2%, on relation classification, per experimental dataset.

Original languageEnglish (US)
Article numbere303
JournalProceedings of the Association for Information Science and Technology
Issue number1
StatePublished - 2020


  • information extraction
  • knowledge graphs
  • relation extraction
  • scholarly knowledge organization
  • scholarly text mining

ASJC Scopus subject areas

  • General Computer Science
  • Library and Information Sciences


Dive into the research topics of 'Targeting precision: A hybrid scientific relation extraction pipeline for improved scholarly knowledge organization'. Together they form a unique fingerprint.

Cite this