TY - GEN
T1 - Extractive Summarization via Fine-grained Semantic Tuple Extraction
AU - Ge, Yubin
AU - Jeoung, Sullam
AU - Diesner, Jana
N1 - Publisher Copyright:
© 2024 Association for Computational Linguistics.
PY - 2024
Y1 - 2024
N2 - Traditional extractive summarization treats the task as sentence-level classification and requires a fixed number of sentences for extraction. However, this rigid constraint on the number of sentences to extract may hinder model generalization due to varied summary lengths across datasets. In this work, we leverage the interrelation between information extraction (IE) and text summarization, and introduce a fine-grained autoregressive method for extractive summarization through semantic tuple extraction. Specifically, we represent each sentence as a set of semantic tuples, where tuples are predicate-argument structures derived from conducting IE. Then we adopt a Transformer-based autoregressive model to extract the tuples corresponding to the target summary given a source document. In inference, a greedy approach is proposed to select source sentences to cover extracted tuples, eliminating the need for a fixed number. Our experiments on CNN/DM and NYT demonstrate the method's superiority over strong baselines. Through the zero-shot setting for testing the generalization of models to diverse summary lengths across datasets, we further show our method outperforms baselines, including ChatGPT.
AB - Traditional extractive summarization treats the task as sentence-level classification and requires a fixed number of sentences for extraction. However, this rigid constraint on the number of sentences to extract may hinder model generalization due to varied summary lengths across datasets. In this work, we leverage the interrelation between information extraction (IE) and text summarization, and introduce a fine-grained autoregressive method for extractive summarization through semantic tuple extraction. Specifically, we represent each sentence as a set of semantic tuples, where tuples are predicate-argument structures derived from conducting IE. Then we adopt a Transformer-based autoregressive model to extract the tuples corresponding to the target summary given a source document. In inference, a greedy approach is proposed to select source sentences to cover extracted tuples, eliminating the need for a fixed number. Our experiments on CNN/DM and NYT demonstrate the method's superiority over strong baselines. Through the zero-shot setting for testing the generalization of models to diverse summary lengths across datasets, we further show our method outperforms baselines, including ChatGPT.
UR - https://www.scopus.com/pages/publications/105016538389
UR - https://www.scopus.com/pages/publications/105016538389#tab=citedBy
U2 - 10.18653/v1/2024.inlg-main.10
DO - 10.18653/v1/2024.inlg-main.10
M3 - Conference contribution
AN - SCOPUS:105016538389
T3 - INLG 2024 - 17th International Natural Language Generation Conference, Proceedings of the Conference
SP - 121
EP - 133
BT - INLG 2024 - 17th International Natural Language Generation Conference, Proceedings of the Conference
A2 - Mahamood, Saad
A2 - Minh, Nguyen Le
A2 - Ippolito, Daphne
PB - Association for Computational Linguistics (ACL)
T2 - 17th International Natural Language Generation Conference, INLG 2024
Y2 - 23 September 2024 through 27 September 2024
ER -