Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network

Abstract: 

In this paper we aim to find exactly the same shoes given a daily shoe photo (street scenario) that matches the online shop shoe photo (shop scenario). There are large visual differences between the street and shop scenario shoe images. To handle the discrepancy of different scenarios, we learn a feature embedding for shoes via a viewpoint-invariant triplet network, the feature activations of which reflect the inherent similarity between any two shoe images. Specifically, we propose a new loss function that minimizes the distances between images of the same shoes captured from different viewpoints. Moreover, we train the proposed triplet network at two different scales so that the representation of shoes incorporates different levels of invariance at different scales. To support training the multi-scale triplet networks, we collect a large dataset with shoe images from the daily life and online shopping websites. Experiments on the dataset show excellence over state-of-the-art approaches, which demonstrate the effectiveness of our proposed method.

up
1 user has voted: huijing zhan

Paper Details

Authors:
Huijing Zhan, Boxin Shi, Alex C. Kot
Submitted On:
15 September 2017 - 12:50am
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Boxin Shi
Paper Code:
ICIP1701
Document Year:
2017
Cite

Document Files

ICIP2017_V6.pptx

(195)

Subscribe

[1] Huijing Zhan, Boxin Shi, Alex C. Kot, "Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network", IEEE SigPort, 2017. [Online]. Available: http://sigport.org/2081. Accessed: Apr. 25, 2019.
@article{2081-17,
url = {http://sigport.org/2081},
author = {Huijing Zhan; Boxin Shi; Alex C. Kot },
publisher = {IEEE SigPort},
title = {Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network},
year = {2017} }
TY - EJOUR
T1 - Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network
AU - Huijing Zhan; Boxin Shi; Alex C. Kot
PY - 2017
PB - IEEE SigPort
UR - http://sigport.org/2081
ER -
Huijing Zhan, Boxin Shi, Alex C. Kot. (2017). Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network. IEEE SigPort. http://sigport.org/2081
Huijing Zhan, Boxin Shi, Alex C. Kot, 2017. Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network. Available at: http://sigport.org/2081.
Huijing Zhan, Boxin Shi, Alex C. Kot. (2017). "Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network." Web.
1. Huijing Zhan, Boxin Shi, Alex C. Kot. Street-to-Shop Shoe Retrieval with Multi-Scale Viewpoint Invariant Triplet Network [Internet]. IEEE SigPort; 2017. Available from : http://sigport.org/2081