Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

NON-UNIFORM VIDEO TIME-LAPSE METHOD BASED ON MOTION SCENARIO AND STABILIZATION CONSTRAINT

Abstract: 

Time-lapse of user captured video becomes popular in many applications recently, non-uniform sampling and digital video stabilization (VS) are usually two independent steps to keep meaningful contents and provide stabilized output. However, non-uniform sampling may produce large sampling interval and then result in larger motion, this would beyond the stabilization ability of VS and produce unpleasant output. To address this problem, we propose a new auto time-lapse framework, which selects frames not only based on camera motion scenarios, but also refer to the smoothed camera trajectory and considering VS ability according to Field of View (FOV) loss constraint. More specific, we introduce an advanced Markov chain (MC) model, in which smoothed camera trajectory, FOV loss constraint of VS, camera motion scenario, and sampling interval similarity between consecutive frames are encoded as potential functions. Finally, dynamic programming (DP) is employed to find the best non-uniform sampling. Experimental results demonstrate that the proposed method not only achieves pleasant and meaningful non-uniform sampling, but also provides satisfactory stabilization performance. The whole algorithm can work in real time during video recording on mobile device.

up
0 users have voted:

Paper Details

Authors:
Nakhoon Kim, Duckchan Seo, Irina Kim, Soonkeun Chang, Dong-ki Min, Sukhwan Lim
Submitted On:
14 May 2020 - 11:34am
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Kai Guo
Paper Code:
1639
Document Year:
2020
Cite

Document Files

Hyperlapse_presentation.pdf

(36)

Subscribe

[1] Nakhoon Kim, Duckchan Seo, Irina Kim, Soonkeun Chang, Dong-ki Min, Sukhwan Lim, "NON-UNIFORM VIDEO TIME-LAPSE METHOD BASED ON MOTION SCENARIO AND STABILIZATION CONSTRAINT", IEEE SigPort, 2020. [Online]. Available: http://sigport.org/5307. Accessed: Sep. 26, 2020.
@article{5307-20,
url = {http://sigport.org/5307},
author = {Nakhoon Kim; Duckchan Seo; Irina Kim; Soonkeun Chang; Dong-ki Min; Sukhwan Lim },
publisher = {IEEE SigPort},
title = {NON-UNIFORM VIDEO TIME-LAPSE METHOD BASED ON MOTION SCENARIO AND STABILIZATION CONSTRAINT},
year = {2020} }
TY - EJOUR
T1 - NON-UNIFORM VIDEO TIME-LAPSE METHOD BASED ON MOTION SCENARIO AND STABILIZATION CONSTRAINT
AU - Nakhoon Kim; Duckchan Seo; Irina Kim; Soonkeun Chang; Dong-ki Min; Sukhwan Lim
PY - 2020
PB - IEEE SigPort
UR - http://sigport.org/5307
ER -
Nakhoon Kim, Duckchan Seo, Irina Kim, Soonkeun Chang, Dong-ki Min, Sukhwan Lim. (2020). NON-UNIFORM VIDEO TIME-LAPSE METHOD BASED ON MOTION SCENARIO AND STABILIZATION CONSTRAINT. IEEE SigPort. http://sigport.org/5307
Nakhoon Kim, Duckchan Seo, Irina Kim, Soonkeun Chang, Dong-ki Min, Sukhwan Lim, 2020. NON-UNIFORM VIDEO TIME-LAPSE METHOD BASED ON MOTION SCENARIO AND STABILIZATION CONSTRAINT. Available at: http://sigport.org/5307.
Nakhoon Kim, Duckchan Seo, Irina Kim, Soonkeun Chang, Dong-ki Min, Sukhwan Lim. (2020). "NON-UNIFORM VIDEO TIME-LAPSE METHOD BASED ON MOTION SCENARIO AND STABILIZATION CONSTRAINT." Web.
1. Nakhoon Kim, Duckchan Seo, Irina Kim, Soonkeun Chang, Dong-ki Min, Sukhwan Lim. NON-UNIFORM VIDEO TIME-LAPSE METHOD BASED ON MOTION SCENARIO AND STABILIZATION CONSTRAINT [Internet]. IEEE SigPort; 2020. Available from : http://sigport.org/5307