The excitement of sports: Automatic highlights using audio/visual cues

Michele Merler, Dhiraj Joshi, Khoi Nguyen C. Mac, Quoc Bao Nguyen, John Kent, Stephen Hammer, Jinjun Xiong, Minh N. Do, John R. Smith, Rogerio S. Feris

Research output: Contribution to journalConference articlepeer-review

Abstract

The production of sports highlight packages summarizing a game’s most exciting moments is an essential task for broadcast media. Yet, it requires labor-intensive video editing. We propose a novel approach for auto-curating sports highlights, and demonstrate it to create a first of a kind, real-world system for the editorial aid of golf and tennis highlight reels. Our method fuses information from the players’ reactions (action recognition such as high-fives and fist pumps), players’ expressions (aggressive, tense, smiling and neutral), spectators (crowd cheering), commentator (tone of the voice and word analysis) and game analytics to determine the most interesting moments of a game.

Original languageEnglish (US)
Pages (from-to)2520-2523
Number of pages4
JournalIEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Volume2018-January
StatePublished - 2018
Event31st Meeting of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2018 - Salt Lake City, United States
Duration: Jun 18 2018Jun 22 2018

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'The excitement of sports: Automatic highlights using audio/visual cues'. Together they form a unique fingerprint.

Cite this