Video summarization based on user log enhanced link analysis

Bin Yu, Wei Ying Ma, Klara Nahrstedt, Hong Jiang Zhang

Research output: Contribution to conferencePaper

Abstract

Efficient video data management calls for intelligent video summarization tools that automatically generate concise video summaries for fast skimming and browsing. Traditional video summarization techniques are based on low-level feature analysis, which generally fails to capture the semantics of video content. Our vision is that users unintentionally embed their understanding of the video content in their interaction with computers. This valuable knowledge, which is difficult for computers to learn autonomously, can be utilized for video summarization process. In this paper, we present an intelligent video browsing and summarization system that utilizes previous viewers' browsing log to facilitate future viewers. Specifically, a novel ShotRank notion is proposed as a measure of the subjective interestingness and importance of each video shot. A ShotRank computation framework is constructed to seamlessly unify low-level video analysis and user browsing log mining. The resulting ShotRank is used to organize the presentation of video shots and generate video skims. Experimental results from user studies have strongly confirmed that ShotRank indeed represents the subjective notion of interestingness and importance of each video shot, and it significantly improves future viewers' browsing experience.

Original languageEnglish (US)
Pages382-391
Number of pages10
StatePublished - Dec 1 2003
Event2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03 - Berkeley, CA., United States
Duration: Nov 4 2003Nov 6 2003

Other

Other2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03
CountryUnited States
CityBerkeley, CA.
Period11/4/0311/6/03

Fingerprint

Information management
Semantics

Keywords

  • Link analysis
  • Log mining
  • Skimming
  • User behavior
  • Video content analysis
  • Video summarization

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Yu, B., Ma, W. Y., Nahrstedt, K., & Zhang, H. J. (2003). Video summarization based on user log enhanced link analysis. 382-391. Paper presented at 2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03, Berkeley, CA., United States.

Video summarization based on user log enhanced link analysis. / Yu, Bin; Ma, Wei Ying; Nahrstedt, Klara; Zhang, Hong Jiang.

2003. 382-391 Paper presented at 2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03, Berkeley, CA., United States.

Research output: Contribution to conferencePaper

Yu, B, Ma, WY, Nahrstedt, K & Zhang, HJ 2003, 'Video summarization based on user log enhanced link analysis', Paper presented at 2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03, Berkeley, CA., United States, 11/4/03 - 11/6/03 pp. 382-391.
Yu B, Ma WY, Nahrstedt K, Zhang HJ. Video summarization based on user log enhanced link analysis. 2003. Paper presented at 2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03, Berkeley, CA., United States.
Yu, Bin ; Ma, Wei Ying ; Nahrstedt, Klara ; Zhang, Hong Jiang. / Video summarization based on user log enhanced link analysis. Paper presented at 2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03, Berkeley, CA., United States.10 p.
@conference{7ddb425bd6c243268dfee1f00c48f1ee,
title = "Video summarization based on user log enhanced link analysis",
abstract = "Efficient video data management calls for intelligent video summarization tools that automatically generate concise video summaries for fast skimming and browsing. Traditional video summarization techniques are based on low-level feature analysis, which generally fails to capture the semantics of video content. Our vision is that users unintentionally embed their understanding of the video content in their interaction with computers. This valuable knowledge, which is difficult for computers to learn autonomously, can be utilized for video summarization process. In this paper, we present an intelligent video browsing and summarization system that utilizes previous viewers' browsing log to facilitate future viewers. Specifically, a novel ShotRank notion is proposed as a measure of the subjective interestingness and importance of each video shot. A ShotRank computation framework is constructed to seamlessly unify low-level video analysis and user browsing log mining. The resulting ShotRank is used to organize the presentation of video shots and generate video skims. Experimental results from user studies have strongly confirmed that ShotRank indeed represents the subjective notion of interestingness and importance of each video shot, and it significantly improves future viewers' browsing experience.",
keywords = "Link analysis, Log mining, Skimming, User behavior, Video content analysis, Video summarization",
author = "Bin Yu and Ma, {Wei Ying} and Klara Nahrstedt and Zhang, {Hong Jiang}",
year = "2003",
month = "12",
day = "1",
language = "English (US)",
pages = "382--391",
note = "2003 Multimedia Conference - Proceedings of the 11th ACM International Conference on Multimedia, MM'03 ; Conference date: 04-11-2003 Through 06-11-2003",

}

TY - CONF

T1 - Video summarization based on user log enhanced link analysis

AU - Yu, Bin

AU - Ma, Wei Ying

AU - Nahrstedt, Klara

AU - Zhang, Hong Jiang

PY - 2003/12/1

Y1 - 2003/12/1

N2 - Efficient video data management calls for intelligent video summarization tools that automatically generate concise video summaries for fast skimming and browsing. Traditional video summarization techniques are based on low-level feature analysis, which generally fails to capture the semantics of video content. Our vision is that users unintentionally embed their understanding of the video content in their interaction with computers. This valuable knowledge, which is difficult for computers to learn autonomously, can be utilized for video summarization process. In this paper, we present an intelligent video browsing and summarization system that utilizes previous viewers' browsing log to facilitate future viewers. Specifically, a novel ShotRank notion is proposed as a measure of the subjective interestingness and importance of each video shot. A ShotRank computation framework is constructed to seamlessly unify low-level video analysis and user browsing log mining. The resulting ShotRank is used to organize the presentation of video shots and generate video skims. Experimental results from user studies have strongly confirmed that ShotRank indeed represents the subjective notion of interestingness and importance of each video shot, and it significantly improves future viewers' browsing experience.

AB - Efficient video data management calls for intelligent video summarization tools that automatically generate concise video summaries for fast skimming and browsing. Traditional video summarization techniques are based on low-level feature analysis, which generally fails to capture the semantics of video content. Our vision is that users unintentionally embed their understanding of the video content in their interaction with computers. This valuable knowledge, which is difficult for computers to learn autonomously, can be utilized for video summarization process. In this paper, we present an intelligent video browsing and summarization system that utilizes previous viewers' browsing log to facilitate future viewers. Specifically, a novel ShotRank notion is proposed as a measure of the subjective interestingness and importance of each video shot. A ShotRank computation framework is constructed to seamlessly unify low-level video analysis and user browsing log mining. The resulting ShotRank is used to organize the presentation of video shots and generate video skims. Experimental results from user studies have strongly confirmed that ShotRank indeed represents the subjective notion of interestingness and importance of each video shot, and it significantly improves future viewers' browsing experience.

KW - Link analysis

KW - Log mining

KW - Skimming

KW - User behavior

KW - Video content analysis

KW - Video summarization

UR - http://www.scopus.com/inward/record.url?scp=2342476454&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=2342476454&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:2342476454

SP - 382

EP - 391

ER -