Sorry, you need to enable JavaScript to visit this website.

NOVEL VIEW SYNTHESIS WITH SKIP CONNECTIONS

Citation Author(s):
Juhyeon Kim, Young Min Kim
Submitted by:
Juhyeon Kim
Last updated:
3 November 2020 - 3:58am
Document Type:
Presentation Slides
Document Year:
2020
Event:
Presenters:
Juhyeon Kim
 

Novel view synthesis is the task of synthesizing an image of an object at an arbitrary viewpoint given one or a few views of the object. The output image of novel view synthesis exhibits a significant structural change from the input. Because of the large change, the skip connections or U-Net architecture, which can sustain the multi-level characteristics of the input images, cannot be directly utilized for the novel view synthesis. In this paper, we investigate several variations of skip connection on two widely used novel view synthesis modules, pixel generation and flow prediction. For pixel generation, we find that the combination of the skip connections with flow-based hard attention is helpful. On the other hand, flow prediction enjoys marginal benefit from skip connections in deeper layers. Our pipeline suggests how to make use of skip connections on tasks that involve large geometric changes.

up
0 users have voted: