Investigating the impact of weakly supervised data on text mining models of publication transparency: a case study on randomized controlled trials

Linh Hoanga, Lan Jiang, Halil Kilicoglu

Research output: Contribution to journalArticlepeer-review

Abstract

Lack of large quantities of annotated data is a major barrier in developing effective text mining models of biomedical literature. In this study, we explored weak supervision to improve the accuracy of text classification models for assessing methodological transparency of randomized controlled trial (RCT) publications. Specifically, we used Snorkel, a framework to programmatically build training sets, and UMLS-EDA, a data augmentation method that leverages a small number of labeled examples to generate new training instances, and assessed their effect on a BioBERT-based text classification model proposed for the task in previous work. Performance improvements due to weak supervision were limited and were surpassed by gains from hyperparameter tuning. Our analysis suggests that refinements to the weak supervision strategies to better deal with multi-label case could be beneficial. Our code and data are available at https://github.com/kilicogluh/CONSORT-TM/tree/master/weakSupervision.

Original languageEnglish (US)
Pages (from-to)254-263
Number of pages10
JournalAMIA Annual Symposium Proceedings
Volume2022
StatePublished - 2022

ASJC Scopus subject areas

  • General Medicine

Fingerprint

Dive into the research topics of 'Investigating the impact of weakly supervised data on text mining models of publication transparency: a case study on randomized controlled trials'. Together they form a unique fingerprint.

Cite this