TY - GEN
T1 - Constrained utility maximization for generating visual skims
AU - Sundaram, H.
AU - Chang, Shih Fu
N1 - Publisher Copyright:
© 2001 IEEE.
PY - 2001
Y1 - 2001
N2 - We present a novel algorithm to generate visual skims that do not contain audio, from computable scenes. Visual skims are useful for browsing digital libraries, and for on-demand summaries in set-top boxes. A computable scene is a chunk of data that exhibits consistencies with respect to chromaticity, lighting and sound. First, we define the visual complexity of a shot to be its Kolmogorov complexity. Then, we conduct experiments that help us map the complexity of a shot into the minimum time required for its comprehension. Second, we analyze the grammar of the film language, since it makes the shot sequence meaningful. We achieve a target skim time by minimizing a sequence utility function. It is subject to shot duration constraints, and penalty functions based on sequence rhythm and information loss. This helps us determine individual shot durations as well as the shots to drop. Our user studies show good results on skims with compression rates up to 80%.
AB - We present a novel algorithm to generate visual skims that do not contain audio, from computable scenes. Visual skims are useful for browsing digital libraries, and for on-demand summaries in set-top boxes. A computable scene is a chunk of data that exhibits consistencies with respect to chromaticity, lighting and sound. First, we define the visual complexity of a shot to be its Kolmogorov complexity. Then, we conduct experiments that help us map the complexity of a shot into the minimum time required for its comprehension. Second, we analyze the grammar of the film language, since it makes the shot sequence meaningful. We achieve a target skim time by minimizing a sequence utility function. It is subject to shot duration constraints, and penalty functions based on sequence rhythm and information loss. This helps us determine individual shot durations as well as the shots to drop. Our user studies show good results on skims with compression rates up to 80%.
UR - http://www.scopus.com/inward/record.url?scp=43949123413&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=43949123413&partnerID=8YFLogxK
U2 - 10.1109/IVL.2001.990866
DO - 10.1109/IVL.2001.990866
M3 - Conference contribution
AN - SCOPUS:43949123413
T3 - Proceedings - IEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2001
SP - 124
EP - 131
BT - Proceedings - IEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2001
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - IEEE Workshop on Content-Based Access of Image and Video Libraries, CBAIVL 2001
Y2 - 14 December 2001
ER -