Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

DO DEEP-LEARNING SALIENCY MODELS REALLY MODEL SALIENCY?

Abstract: 

Visual attention allows the human visual system to effectively deal with the huge flow of visual information acquired by the retina. Since the years 2000, the human visual system began to be modelled in computer vision to predict abnormal, rare and surprising data. Attention is a product of the continuous interaction between bottom-up (mainly feature-based) and top-down (mainly learning-based) information. Deep-learning (DNN) is now well established in visual attention modelling with very effective models. The goal of this paper is to investigate the importance of bottom-up versus top-down attention. First, we enrich with top-down information classical bottom-up models of attention. Then, the results are compared with DNN-based models. Our provocative question is: “do deep-learning saliency models really predict saliency or they simply detect interesting objects?”. We found that if DNN saliency models very accurately detect top-down features, they neglect a lot of bottom-up information which is surprising and rare, thus by definition difficult to learn.

up
0 users have voted:

Paper Details

Authors:
Phutphalla Kong, Matei Mancas, Nimol Thuon, Seng Kheang, Bernard Gosselin
Submitted On:
4 October 2018 - 9:19am
Short Link:
Type:
Poster
Event:
Presenter's Name:
Kong Phutphalla
Paper Code:
1811
Document Year:
2018
Cite

Document Files

poster_ICIP2018.pdf

(157)

Subscribe

[1] Phutphalla Kong, Matei Mancas, Nimol Thuon, Seng Kheang, Bernard Gosselin, "DO DEEP-LEARNING SALIENCY MODELS REALLY MODEL SALIENCY?", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/3392. Accessed: Jun. 20, 2019.
@article{3392-18,
url = {http://sigport.org/3392},
author = {Phutphalla Kong; Matei Mancas; Nimol Thuon; Seng Kheang; Bernard Gosselin },
publisher = {IEEE SigPort},
title = {DO DEEP-LEARNING SALIENCY MODELS REALLY MODEL SALIENCY?},
year = {2018} }
TY - EJOUR
T1 - DO DEEP-LEARNING SALIENCY MODELS REALLY MODEL SALIENCY?
AU - Phutphalla Kong; Matei Mancas; Nimol Thuon; Seng Kheang; Bernard Gosselin
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/3392
ER -
Phutphalla Kong, Matei Mancas, Nimol Thuon, Seng Kheang, Bernard Gosselin. (2018). DO DEEP-LEARNING SALIENCY MODELS REALLY MODEL SALIENCY?. IEEE SigPort. http://sigport.org/3392
Phutphalla Kong, Matei Mancas, Nimol Thuon, Seng Kheang, Bernard Gosselin, 2018. DO DEEP-LEARNING SALIENCY MODELS REALLY MODEL SALIENCY?. Available at: http://sigport.org/3392.
Phutphalla Kong, Matei Mancas, Nimol Thuon, Seng Kheang, Bernard Gosselin. (2018). "DO DEEP-LEARNING SALIENCY MODELS REALLY MODEL SALIENCY?." Web.
1. Phutphalla Kong, Matei Mancas, Nimol Thuon, Seng Kheang, Bernard Gosselin. DO DEEP-LEARNING SALIENCY MODELS REALLY MODEL SALIENCY? [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/3392