Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

ENSEMBLE NETWORK FOR RANKING IMAGES BASED ON VISUAL APPEAL

Abstract: 

We propose a computational framework for ranking images (group photos in particular) taken at the same event within a short time span. The ranking is expected to correspond with human perception of overall appeal of the images. We hypothesize and provide evidence through subjective analysis that the factors that appeal to humans are its emotional content, aesthetics and image quality. We propose a network which is an ensemble of three information channels, each predicting a score corresponding to one of the three visual appeal factors. For group emotion estimation, we propose a convolutional neural network (CNN) based architecture for predicting group emotion from images. This new architecture enforces the network to put emphasis on the important regions in the images, and achieves comparable results to the state-of-the-art. Next, we develop a network for the image ranking task that combines group emotion, aesthetics and image quality scores. Owing to the unavailability of suitable databases, we created a new database of manually annotated group photos taken during various social events. We present experimental results on this database and other benchmark databases whenever available. Overall, our experiments show that the proposed framework can reliably predict the overall appeal of images with results closely corresponding to human ranking.

up
0 users have voted:

Paper Details

Authors:
Submitted On:
14 May 2020 - 4:31am
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Sachin Singh
Paper Code:
1870
Document Year:
2020
Cite

Document Files

ICASSP_2020_compressed.pdf

(13)

Subscribe

[1] , "ENSEMBLE NETWORK FOR RANKING IMAGES BASED ON VISUAL APPEAL", IEEE SigPort, 2020. [Online]. Available: http://sigport.org/5264. Accessed: Jul. 13, 2020.
@article{5264-20,
url = {http://sigport.org/5264},
author = { },
publisher = {IEEE SigPort},
title = {ENSEMBLE NETWORK FOR RANKING IMAGES BASED ON VISUAL APPEAL},
year = {2020} }
TY - EJOUR
T1 - ENSEMBLE NETWORK FOR RANKING IMAGES BASED ON VISUAL APPEAL
AU -
PY - 2020
PB - IEEE SigPort
UR - http://sigport.org/5264
ER -
. (2020). ENSEMBLE NETWORK FOR RANKING IMAGES BASED ON VISUAL APPEAL. IEEE SigPort. http://sigport.org/5264
, 2020. ENSEMBLE NETWORK FOR RANKING IMAGES BASED ON VISUAL APPEAL. Available at: http://sigport.org/5264.
. (2020). "ENSEMBLE NETWORK FOR RANKING IMAGES BASED ON VISUAL APPEAL." Web.
1. . ENSEMBLE NETWORK FOR RANKING IMAGES BASED ON VISUAL APPEAL [Internet]. IEEE SigPort; 2020. Available from : http://sigport.org/5264