TY - GEN
T1 - Keep meeting summaries on topic
T2 - 57th Annual Meeting of the Association for Computational Linguistics, ACL 2019
AU - Li, Manling
AU - Zhang, Lingyu
AU - Ji, Heng
AU - Radke, Richard J.
N1 - Publisher Copyright:
© 2019 Association for Computational Linguistics.
PY - 2020
Y1 - 2020
N2 - Transcripts of natural, multi-person meetings differ significantly from documents like news articles, which can make Natural Language Generation models generate unfocused summaries. We develop an abstractive meeting summarizer from both videos and audios of meeting recordings. Specifically, we propose a multi-modal hierarchical attention mechanism across three levels: topic segment, utterance and word. To narrow down the focus into topically-relevant segments, we jointly model topic segmentation and summarization. In addition to traditional textual features, we introduce new multi-modal features derived from visual focus of attention, based on the assumption that an utterance is more important if its speaker receives more attention. Experiments show that our model significantly outperforms the state-of-the-art with both BLEU and ROUGE measures.
AB - Transcripts of natural, multi-person meetings differ significantly from documents like news articles, which can make Natural Language Generation models generate unfocused summaries. We develop an abstractive meeting summarizer from both videos and audios of meeting recordings. Specifically, we propose a multi-modal hierarchical attention mechanism across three levels: topic segment, utterance and word. To narrow down the focus into topically-relevant segments, we jointly model topic segmentation and summarization. In addition to traditional textual features, we introduce new multi-modal features derived from visual focus of attention, based on the assumption that an utterance is more important if its speaker receives more attention. Experiments show that our model significantly outperforms the state-of-the-art with both BLEU and ROUGE measures.
UR - http://www.scopus.com/inward/record.url?scp=85077146094&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85077146094&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85077146094
T3 - ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference
SP - 2190
EP - 2196
BT - ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference
PB - Association for Computational Linguistics (ACL)
Y2 - 28 July 2019 through 2 August 2019
ER -