CoVA: Context-aware Visual Attention for Webpage Information Extraction

Anurendra Kumar, Keval Morabia, Jingjin Wang, Kevin Chen Chuan Chang, Alexander Schwing

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Webpage information extraction (WIE) is an important step to create knowledge bases. For this, classical WIE methods leverage the Document Object Model (DOM) tree of a website. However, use of the DOM tree poses significant challenges as context and appearance are encoded in an abstract manner. To address this challenge we propose to reformulate WIE as a context-aware Webpage Object Detection task. Specifically, we develop a Context-aware Visual Attention-based (CoVA) detection pipeline which combines appearance features with syntactical structure from the DOM tree. To study the approach we collect a new large-scale dataset1 of e-commerce websites for which we manually annotate every web element with four labels: product price, product title, product image and others. On this dataset we show that the proposed CoVA approach is a new challenging baseline which improves upon prior state-of-the-art methods.

Original languageEnglish (US)
Title of host publicationECNLP 2022 - 5th Workshop on e-Commerce and NLP, Proceedings of the Workshop
EditorsShervin Malmasi, Oleg Rokhlenko, Nicola Ueffing, Ido Guy, Eugene Agichtein, Surya Kallumadi
PublisherAssociation for Computational Linguistics (ACL)
Pages80-90
Number of pages11
ISBN (Electronic)9781955917353
DOIs
StatePublished - 2022
Event5th Workshop on e-Commerce and NLP, ECNLP 2022 - Dublin, Ireland
Duration: May 26 2022 → …

Publication series

NameECNLP 2022 - 5th Workshop on e-Commerce and NLP, Proceedings of the Workshop

Conference

Conference5th Workshop on e-Commerce and NLP, ECNLP 2022
Country/TerritoryIreland
CityDublin
Period5/26/22 → …

ASJC Scopus subject areas

  • Computational Theory and Mathematics
  • Computer Science Applications
  • Information Systems

Fingerprint

Dive into the research topics of 'CoVA: Context-aware Visual Attention for Webpage Information Extraction'. Together they form a unique fingerprint.

Cite this