GAIA: A fine-grained multimedia knowledge extraction system

Manling Li; Alireza Zareian; Ying Lin; Xiaoman Pan; Spencer Whitehead; Brian Chen; Bo Wu; Heng Ji; Shih Fu Chang; Clare Voss; Daniel Napierski; Marjorie Freedman

GAIA: A fine-grained multimedia knowledge extraction system

Manling Li, Alireza Zareian, Ying Lin, Xiaoman Pan, Spencer Whitehead, Brian Chen, Bo Wu, Heng Ji, Shih Fu Chang, Clare Voss, Daniel Napierski, Marjorie Freedman

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

We present the first comprehensive, open source multimedia knowledge extraction system that takes a massive stream of unstructured, heterogeneous multimedia data from various sources and languages as input, and creates a coherent, structured knowledge base, indexing entities, relations, and events, following a rich, fine-grained ontology. Our system, GAIA ¹, enables seamless search of complex graph queries, and retrieves multimedia evidence including text, images and videos. GAIA achieves top performance at the recent NIST TAC SM-KBP2019 evaluation².

Original language	English (US)
Title of host publication	ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the System Demonstrations
Publisher	Association for Computational Linguistics (ACL)
Pages	77-86
Number of pages	10
ISBN (Electronic)	9781952148040
State	Published - 2020
Event	58th Annual Meeting of the Association for Computational Linguistics, ACL 2020 - Virtual, Online, United States Duration: Jul 5 2020 → Jul 10 2020

Publication series

Name	Proceedings of the Annual Meeting of the Association for Computational Linguistics
ISSN (Print)	0736-587X

Conference

Conference	58th Annual Meeting of the Association for Computational Linguistics, ACL 2020
Country/Territory	United States
City	Virtual, Online
Period	7/5/20 → 7/10/20

ASJC Scopus subject areas

Computer Science Applications
Linguistics and Language
Language and Linguistics

Library availability

Discover UIUC Full Text

Cite this

Li, M., Zareian, A., Lin, Y., Pan, X., Whitehead, S., Chen, B., Wu, B., Ji, H., Chang, S. F., Voss, C., Napierski, D., & Freedman, M. (2020). GAIA: A fine-grained multimedia knowledge extraction system. In ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the System Demonstrations (pp. 77-86). (Proceedings of the Annual Meeting of the Association for Computational Linguistics). Association for Computational Linguistics (ACL).

GAIA: A fine-grained multimedia knowledge extraction system. / Li, Manling; Zareian, Alireza; Lin, Ying et al.
ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the System Demonstrations. Association for Computational Linguistics (ACL), 2020. p. 77-86 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Li, M, Zareian, A, Lin, Y, Pan, X, Whitehead, S, Chen, B, Wu, B, Ji, H, Chang, SF, Voss, C, Napierski, D & Freedman, M 2020, GAIA: A fine-grained multimedia knowledge extraction system. in ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the System Demonstrations. Proceedings of the Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics (ACL), pp. 77-86, 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Virtual, Online, United States, 7/5/20.

Li M, Zareian A, Lin Y, Pan X, Whitehead S, Chen B et al. GAIA: A fine-grained multimedia knowledge extraction system. In ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the System Demonstrations. Association for Computational Linguistics (ACL). 2020. p. 77-86. (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

Li, Manling ; Zareian, Alireza ; Lin, Ying et al. / GAIA : A fine-grained multimedia knowledge extraction system. ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the System Demonstrations. Association for Computational Linguistics (ACL), 2020. pp. 77-86 (Proceedings of the Annual Meeting of the Association for Computational Linguistics).

@inproceedings{4840112964d24d7f834c3f0df00f8afc,

title = "GAIA: A fine-grained multimedia knowledge extraction system",

abstract = "We present the first comprehensive, open source multimedia knowledge extraction system that takes a massive stream of unstructured, heterogeneous multimedia data from various sources and languages as input, and creates a coherent, structured knowledge base, indexing entities, relations, and events, following a rich, fine-grained ontology. Our system, GAIA 1, enables seamless search of complex graph queries, and retrieves multimedia evidence including text, images and videos. GAIA achieves top performance at the recent NIST TAC SM-KBP2019 evaluation2.",

author = "Manling Li and Alireza Zareian and Ying Lin and Xiaoman Pan and Spencer Whitehead and Brian Chen and Bo Wu and Heng Ji and Chang, {Shih Fu} and Clare Voss and Daniel Napierski and Marjorie Freedman",

note = "Publisher Copyright: {\textcopyright} 2020 Association for Computational Linguistics; 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020 ; Conference date: 05-07-2020 Through 10-07-2020",

year = "2020",

language = "English (US)",

series = "Proceedings of the Annual Meeting of the Association for Computational Linguistics",

publisher = "Association for Computational Linguistics (ACL)",

pages = "77--86",

booktitle = "ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the System Demonstrations",

}

TY - GEN

T1 - GAIA

T2 - 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020

AU - Li, Manling

AU - Zareian, Alireza

AU - Lin, Ying

AU - Pan, Xiaoman

AU - Whitehead, Spencer

AU - Chen, Brian

AU - Wu, Bo

AU - Ji, Heng

AU - Chang, Shih Fu

AU - Voss, Clare

AU - Napierski, Daniel

AU - Freedman, Marjorie

PY - 2020

Y1 - 2020

N2 - We present the first comprehensive, open source multimedia knowledge extraction system that takes a massive stream of unstructured, heterogeneous multimedia data from various sources and languages as input, and creates a coherent, structured knowledge base, indexing entities, relations, and events, following a rich, fine-grained ontology. Our system, GAIA 1, enables seamless search of complex graph queries, and retrieves multimedia evidence including text, images and videos. GAIA achieves top performance at the recent NIST TAC SM-KBP2019 evaluation2.

AB - We present the first comprehensive, open source multimedia knowledge extraction system that takes a massive stream of unstructured, heterogeneous multimedia data from various sources and languages as input, and creates a coherent, structured knowledge base, indexing entities, relations, and events, following a rich, fine-grained ontology. Our system, GAIA 1, enables seamless search of complex graph queries, and retrieves multimedia evidence including text, images and videos. GAIA achieves top performance at the recent NIST TAC SM-KBP2019 evaluation2.

UR - http://www.scopus.com/inward/record.url?scp=85095293902&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85095293902&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85095293902

T3 - Proceedings of the Annual Meeting of the Association for Computational Linguistics

SP - 77

EP - 86

BT - ACL 2020 - 58th Annual Meeting of the Association for Computational Linguistics, Proceedings of the System Demonstrations

PB - Association for Computational Linguistics (ACL)

Y2 - 5 July 2020 through 10 July 2020

ER -

GAIA: A fine-grained multimedia knowledge extraction system

Abstract

Publication series

Conference

ASJC Scopus subject areas

Library availability

Related links

Fingerprint

Cite this