Video summarization based on user log enhanced link analysis

Bin Yu, Wei Ying Ma, Klara Nahrstedt, Hong Jiang Zhang

Research output: Contribution to conferencePaper

Abstract

Efficient video data management calls for intelligent video summarization tools that automatically generate concise video summaries for fast skimming and browsing. Traditional video summarization techniques are based on low-level feature analysis, which generally fails to capture the semantics of video content. Our vision is that users unintentionally embed their understanding of the video content in their interaction with computers. This valuable knowledge, which is difficult for computers to learn autonomously, can be utilized for video summarization process. In this paper, we present an intelligent video browsing and summarization system that utilizes previous viewers' browsing log to facilitate future viewers. Specifically, a novel ShotRank notion is proposed as a measure of the subjective interestingness and importance of each video shot. A ShotRank computation framework is constructed to seamlessly unify low-level video analysis and user browsing log mining. The resulting ShotRank is used to organize the presentation of video shots and generate video skims. Experimental results from user studies have strongly confirmed that ShotRank indeed represents the subjective notion of interestingness and importance of each video shot, and it significantly improves future viewers' browsing experience.

Original languageEnglish (US)
Pages382-391
Number of pages10
StatePublished - Dec 1 2003
Event2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03 - Berkeley, CA., United States
Duration: Nov 4 2003Nov 6 2003

Other

Other2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03
CountryUnited States
CityBerkeley, CA.
Period11/4/0311/6/03

Keywords

  • Link analysis
  • Log mining
  • Skimming
  • User behavior
  • Video content analysis
  • Video summarization

ASJC Scopus subject areas

  • Computer Science(all)

Fingerprint Dive into the research topics of 'Video summarization based on user log enhanced link analysis'. Together they form a unique fingerprint.

  • Cite this

    Yu, B., Ma, W. Y., Nahrstedt, K., & Zhang, H. J. (2003). Video summarization based on user log enhanced link analysis. 382-391. Paper presented at 2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03, Berkeley, CA., United States.