Sorry, you need to enable JavaScript to visit this website.

A PRACTICAL CONVOLUTIONAL NEURAL NETWORK AS LOOP FILTER FOR INTRA FRAME

Citation Author(s):
Xiaodan Song, Lulu Zhou, Li Wang, Xiaoyang Wu, Di Xie, Shiliang Pu
Submitted by:
Jiabao Yao
Last updated:
5 October 2018 - 4:52pm
Document Type:
Poster
Document Year:
2018
Event:
Presenters:
Jiabao Yao
Paper Code:
ICIP18001
 

Loop filters are used in video coding to remove artifacts or improve performance. Recent advances in deploying convolutional neural network (CNN) to replace traditional loop filters show large gains but with problems for practical application.First, different model is used for frames encoded with different quantization parameter (QP), respectively. It is expensive for hardware. Second, float points operation in CNN leads to inconsistency between encoding and decoding across different platforms. Third, redundancy within CNN model consumes precious computational resources.
This paper proposes a CNN as the loop filter for intra frames and proposes a scheme to solve the above problems. It aims to design a single CNN model with low redundancy to adapt to decoded frames with different qualities and ensure consistency. To adapt to reconstructions with different qualities, both reconstruction and QP are taken as inputs. After training, the obtained model is compressed to reduce redundancy. To ensure consistency, dynamic fixed points (DFP) are adopted in testing CNN. Parameters in the compressed model are first quantized to DFP and then used for inference of CNN. Outputs of each layer in CNN are computed by DFP operations. Experimental results on JEM 7.0 report 3.14%, 5.21%, 6.28% BD-rate savings for luma and two chroma components with all intra configuration when replacing all traditional filters.

up
1 user has voted: Jiabao Yao