Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Video denoising for the hierarchical coding structure in video coding

Abstract: 

In modern video codecs, video frames are coded out-of-order following a hierarchical coding structure. The naive uniform video denoising, where denoising is applied indifferently to each frame, does not improve the compression performance. In our work, we only apply denoising to frames at layer 0 and 1. The denoising leads to a significant reduction of bit rates while maintaining temporal correlation. PSNR scores of the filtered frames decrease but PSNR scores of the unfiltered frames remain or even improve. As an example, a 150 frame video is encoded and the PSNR values of the first GOP is displayed in the figure. The PSNR value of the filtered key frame has dropped about 2dB as compared with the unfiltered one, while PSNR values of following frames in this GOP increase. The reason is that the denoising of the key frame reduces the noise and improves its quality in terms of temporal correlation and thus serves as a better reference for the following frames. Meanwhile the reduction of bit rate is achieved on filtered frames. Therefore the overall compression performance is significantly improved.

In this work, a non-local mean algorithm is used for denoising. We divide the current frame to M × M (M = 32) blocks. A total of N (N = 7) candidate patches are found through motion search and combined to generate the filtered block. The proposed method is implemented in AV1 (libaom). We evaluated the compression performance on various video benchmark test sets, which cover a wide range of videos of different types: slow and fast motion, zooming, rotation, screen content and etc. The experiment is evaluated at speed 1 (–cpu-used=1 ), on the constant quality mode (–end-usage=q), with the maximum frame number of 150. The compression efficiency improvements in PSNR, SSIM and VMAF are significant across different test sets.

up
0 users have voted:

Paper Details

Authors:
Jingning Han, Yaowu Xu
Submitted On:
25 March 2020 - 12:36am
Short Link:
Type:
Poster
Event:
Presenter's Name:
Cheng Chen
Session:
Posters
Document Year:
2020
Cite

Document Files

dcc2020_poster.pdf

(26)

Subscribe

[1] Jingning Han, Yaowu Xu, "Video denoising for the hierarchical coding structure in video coding", IEEE SigPort, 2020. [Online]. Available: http://sigport.org/5027. Accessed: Jun. 02, 2020.
@article{5027-20,
url = {http://sigport.org/5027},
author = {Jingning Han; Yaowu Xu },
publisher = {IEEE SigPort},
title = {Video denoising for the hierarchical coding structure in video coding},
year = {2020} }
TY - EJOUR
T1 - Video denoising for the hierarchical coding structure in video coding
AU - Jingning Han; Yaowu Xu
PY - 2020
PB - IEEE SigPort
UR - http://sigport.org/5027
ER -
Jingning Han, Yaowu Xu. (2020). Video denoising for the hierarchical coding structure in video coding. IEEE SigPort. http://sigport.org/5027
Jingning Han, Yaowu Xu, 2020. Video denoising for the hierarchical coding structure in video coding. Available at: http://sigport.org/5027.
Jingning Han, Yaowu Xu. (2020). "Video denoising for the hierarchical coding structure in video coding." Web.
1. Jingning Han, Yaowu Xu. Video denoising for the hierarchical coding structure in video coding [Internet]. IEEE SigPort; 2020. Available from : http://sigport.org/5027