Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Multi-View Frame Reconstruction with Conditional GAN

Abstract: 

Multi-view frame reconstruction is an important problem particularly when multiple frames are missing and past and future frames within the camera are far apart from the missing ones. Realistic coherent frames can still be reconstructed using corresponding frames from other overlapping cameras. We propose an adversarial approach to learn the
spatio-temporal representation of the missing frame using conditional Generative Adversarial Network (cGAN). The conditional input to each cGAN is the preceding or following
frames within the camera or the corresponding frames in other overlapping cameras, all of which are merged together using a weighted average. Representations learned
from frames within the camera are given more weight compared to the ones learned from other cameras when they are close to the missing frames and vice versa. Experiments
on two challenging datasets demonstrate that our framework produces comparable results with the state-of-the-art reconstruction method in a single camera and achieves promising performance in multi-camera scenario.

up
0 users have voted:

Paper Details

Authors:
Tahmida Mahmud, Mohammad Billah, Amit K. Roy-Chowdhury
Submitted On:
23 November 2018 - 3:53pm
Short Link:
Type:
Poster
Event:
Presenter's Name:
Tahmida Mahmud
Paper Code:
AML-P.1.1
Document Year:
2018
Cite

Document Files

GlobalSIP.pdf

(60)

Subscribe

[1] Tahmida Mahmud, Mohammad Billah, Amit K. Roy-Chowdhury, "Multi-View Frame Reconstruction with Conditional GAN", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/3756. Accessed: Jul. 21, 2019.
@article{3756-18,
url = {http://sigport.org/3756},
author = {Tahmida Mahmud; Mohammad Billah; Amit K. Roy-Chowdhury },
publisher = {IEEE SigPort},
title = {Multi-View Frame Reconstruction with Conditional GAN},
year = {2018} }
TY - EJOUR
T1 - Multi-View Frame Reconstruction with Conditional GAN
AU - Tahmida Mahmud; Mohammad Billah; Amit K. Roy-Chowdhury
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/3756
ER -
Tahmida Mahmud, Mohammad Billah, Amit K. Roy-Chowdhury. (2018). Multi-View Frame Reconstruction with Conditional GAN. IEEE SigPort. http://sigport.org/3756
Tahmida Mahmud, Mohammad Billah, Amit K. Roy-Chowdhury, 2018. Multi-View Frame Reconstruction with Conditional GAN. Available at: http://sigport.org/3756.
Tahmida Mahmud, Mohammad Billah, Amit K. Roy-Chowdhury. (2018). "Multi-View Frame Reconstruction with Conditional GAN." Web.
1. Tahmida Mahmud, Mohammad Billah, Amit K. Roy-Chowdhury. Multi-View Frame Reconstruction with Conditional GAN [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/3756