Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Learning a Cross-Modal Hashing Network for Multimedia Search

Abstract: 

In this paper, we propose a cross-modal hashing network (CMHN) method to learn compact binary codes for cross-modality multimedia search. Unlike most existing cross-modal hashing methods which learn a single pair of projections to map each example into a binary vector, we design a deep neural network to learn multiple pairs of hierarchical non-linear transformations, under which the nonlinear characteristics of samples can be well exploited and the modality gap is well reduced. Our model is trained under an iterative optimization procedure which learns a (1) unified binary code discretely and discriminatively through a classification-based hinge-loss criterion, and (2) cross-modal hashing network, one deep network for each modality, through minimizing the quantization loss between real-valued neural code and binary code, and maximizing the variance of the learned neural codes. Experimental results on two benchmark datasets show the efficacy of the proposed approach.

up
0 users have voted:

Paper Details

Authors:
Venice Erin Liong, Jiwen Lu, Yap-Peng Tan
Submitted On:
11 September 2017 - 5:44am
Short Link:
Type:
Poster
Event:
Presenter's Name:
Venice Erin Liong
Paper Code:
2555
Document Year:
2017
Cite

Document Files

icip2017_poster_2555.pdf

(9 downloads)

Subscribe

[1] Venice Erin Liong, Jiwen Lu, Yap-Peng Tan, "Learning a Cross-Modal Hashing Network for Multimedia Search", IEEE SigPort, 2017. [Online]. Available: http://sigport.org/1901. Accessed: Sep. 21, 2017.
@article{1901-17,
url = {http://sigport.org/1901},
author = {Venice Erin Liong; Jiwen Lu; Yap-Peng Tan },
publisher = {IEEE SigPort},
title = {Learning a Cross-Modal Hashing Network for Multimedia Search},
year = {2017} }
TY - EJOUR
T1 - Learning a Cross-Modal Hashing Network for Multimedia Search
AU - Venice Erin Liong; Jiwen Lu; Yap-Peng Tan
PY - 2017
PB - IEEE SigPort
UR - http://sigport.org/1901
ER -
Venice Erin Liong, Jiwen Lu, Yap-Peng Tan. (2017). Learning a Cross-Modal Hashing Network for Multimedia Search. IEEE SigPort. http://sigport.org/1901
Venice Erin Liong, Jiwen Lu, Yap-Peng Tan, 2017. Learning a Cross-Modal Hashing Network for Multimedia Search. Available at: http://sigport.org/1901.
Venice Erin Liong, Jiwen Lu, Yap-Peng Tan. (2017). "Learning a Cross-Modal Hashing Network for Multimedia Search." Web.
1. Venice Erin Liong, Jiwen Lu, Yap-Peng Tan. Learning a Cross-Modal Hashing Network for Multimedia Search [Internet]. IEEE SigPort; 2017. Available from : http://sigport.org/1901