Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

VIEW-DEPENDENT VIRTUAL REALITY CONTENT FROM RGB-D IMAGES

Abstract: 

High-fidelity virtual content is essential for the creation of compelling and effective virtual reality (VR) experiences.
However, creating photorealistic content is not easy, and handcrafting detailed 3D models can be time and labor intensive. Structured camera arrays, such as light-stages, can scan and reconstruct high-fidelity virtual models, but the expense makes this technology impractical for most users. In this paper, we present a complete end-to-end pipeline for the capture, processing, and rendering of view-dependent 3D models in virtual reality from a single consumer-grade depth camera. The geometry model and the camera trajectories are automatically reconstructed and optimized from a RGB-D image sequence captured offline. Based on the head-mounted display (HMD) position, the three closest images are selected for real-time rendering and fused together to smooth the transition between viewpoints. The specular reflections and light-burst effects can also be preserved and reproduced. We confirmed that our method does not require technical background knowledge by testing our system with data captured by non-expert operators.

up
0 users have voted:

Paper Details

Authors:
Chih-Fan Chen, Mark Bolas, Evan Suma Rosenberg
Submitted On:
7 September 2017 - 8:43pm
Short Link:
Type:
Poster
Event:
Presenter's Name:
Chih-Fan Chen
Paper Code:
ICIP1701

Document Files

ICIP_Poster_ver1.pdf

(5 downloads)

Subscribe

[1] Chih-Fan Chen, Mark Bolas, Evan Suma Rosenberg, "VIEW-DEPENDENT VIRTUAL REALITY CONTENT FROM RGB-D IMAGES", IEEE SigPort, 2017. [Online]. Available: http://sigport.org/1856. Accessed: Sep. 24, 2017.
@article{1856-17,
url = {http://sigport.org/1856},
author = {Chih-Fan Chen; Mark Bolas; Evan Suma Rosenberg },
publisher = {IEEE SigPort},
title = {VIEW-DEPENDENT VIRTUAL REALITY CONTENT FROM RGB-D IMAGES},
year = {2017} }
TY - EJOUR
T1 - VIEW-DEPENDENT VIRTUAL REALITY CONTENT FROM RGB-D IMAGES
AU - Chih-Fan Chen; Mark Bolas; Evan Suma Rosenberg
PY - 2017
PB - IEEE SigPort
UR - http://sigport.org/1856
ER -
Chih-Fan Chen, Mark Bolas, Evan Suma Rosenberg. (2017). VIEW-DEPENDENT VIRTUAL REALITY CONTENT FROM RGB-D IMAGES. IEEE SigPort. http://sigport.org/1856
Chih-Fan Chen, Mark Bolas, Evan Suma Rosenberg, 2017. VIEW-DEPENDENT VIRTUAL REALITY CONTENT FROM RGB-D IMAGES. Available at: http://sigport.org/1856.
Chih-Fan Chen, Mark Bolas, Evan Suma Rosenberg. (2017). "VIEW-DEPENDENT VIRTUAL REALITY CONTENT FROM RGB-D IMAGES." Web.
1. Chih-Fan Chen, Mark Bolas, Evan Suma Rosenberg. VIEW-DEPENDENT VIRTUAL REALITY CONTENT FROM RGB-D IMAGES [Internet]. IEEE SigPort; 2017. Available from : http://sigport.org/1856