Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network

Abstract: 

In this paper, we aim to find exactly the same shoes given a daily shoe photo (street scenario) that matches the online shop shoe photo (shop scenario). There are large visual differences between the street and shop scenario shoe images. To handle the discrepancy of different scenarios, we learn a feature embedding for shoes via a viewpoint-invariant triplet network, the feature activations of which reflect the inherent similarity between any two shoe images. Specifically, we propose a new loss function that minimizes the distances between images of the same shoes captured from different viewpoints. Moreover, we train the proposed triplet network at two different scales so that the representation of shoes incorporates different levels of invariance at different scales. To support training the multi-scale triplet networks, we collect a large dataset with shoe images from the daily life and online shopping websites. Experiments on the dataset show excellence over state-of-the-art approaches, which demonstrate the effectiveness of our proposed method.

up
0 users have voted:

Paper Details

Authors:
Huijing Zhan, Boxin Shi, Alex C. Kot
Submitted On:
15 September 2017 - 1:04am
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Boxin Shi
Paper Code:
TP-L6.2
Document Year:
2017
Cite

Document Files

ICIP2017_V6.pptx

(39 downloads)

Subscribe

[1] Huijing Zhan, Boxin Shi, Alex C. Kot, "Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network", IEEE SigPort, 2017. [Online]. Available: http://sigport.org/2082. Accessed: Jan. 22, 2018.
@article{2082-17,
url = {http://sigport.org/2082},
author = {Huijing Zhan; Boxin Shi; Alex C. Kot },
publisher = {IEEE SigPort},
title = {Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network},
year = {2017} }
TY - EJOUR
T1 - Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network
AU - Huijing Zhan; Boxin Shi; Alex C. Kot
PY - 2017
PB - IEEE SigPort
UR - http://sigport.org/2082
ER -
Huijing Zhan, Boxin Shi, Alex C. Kot. (2017). Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network. IEEE SigPort. http://sigport.org/2082
Huijing Zhan, Boxin Shi, Alex C. Kot, 2017. Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network. Available at: http://sigport.org/2082.
Huijing Zhan, Boxin Shi, Alex C. Kot. (2017). "Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network." Web.
1. Huijing Zhan, Boxin Shi, Alex C. Kot. Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network [Internet]. IEEE SigPort; 2017. Available from : http://sigport.org/2082