Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

TRAINING SAMPLE SELECTION FOR DEEP LEARNING OF DISTRIBUTED DATA

Abstract: 

The success of deep learning—in the form of multi-layer neural networks — depends critically on the volume and variety of training data. Its potential is greatly compromised when training data originate in a geographically distributed manner and are subject to bandwidth constraints. This paper presents a data sampling approach to deep learning, by carefully discriminating locally available training samples based on their relative importance. Towards this end, we propose two metrics for prioritizing candidate training samples as functions of their test trial outcome: correctness and confidence. Bandwidth-constrained simulations show significant performance gain of our proposed training sample selection schemes over convention uniform sampling: up to 15 bandwidth reduction for the MNIST dataset and 25% reduction in learning time for the CIFAR-10 dataset.

up
0 users have voted:

Paper Details

Authors:
Zheng Jiang, Xiaoqing Zhu, Wai-tian Tan, and Rob Liston
Submitted On:
15 September 2017 - 3:49pm
Short Link:
Type:
Poster
Event:
Presenter's Name:
Xiaoqing Zhu
Paper Code:
MA-PC.6
Document Year:
2017
Cite

Document Files

Poster presentation for Paper #2847

(202)

Subscribe

[1] Zheng Jiang, Xiaoqing Zhu, Wai-tian Tan, and Rob Liston, "TRAINING SAMPLE SELECTION FOR DEEP LEARNING OF DISTRIBUTED DATA", IEEE SigPort, 2017. [Online]. Available: http://sigport.org/2159. Accessed: Jul. 20, 2019.
@article{2159-17,
url = {http://sigport.org/2159},
author = {Zheng Jiang; Xiaoqing Zhu; Wai-tian Tan; and Rob Liston },
publisher = {IEEE SigPort},
title = {TRAINING SAMPLE SELECTION FOR DEEP LEARNING OF DISTRIBUTED DATA},
year = {2017} }
TY - EJOUR
T1 - TRAINING SAMPLE SELECTION FOR DEEP LEARNING OF DISTRIBUTED DATA
AU - Zheng Jiang; Xiaoqing Zhu; Wai-tian Tan; and Rob Liston
PY - 2017
PB - IEEE SigPort
UR - http://sigport.org/2159
ER -
Zheng Jiang, Xiaoqing Zhu, Wai-tian Tan, and Rob Liston. (2017). TRAINING SAMPLE SELECTION FOR DEEP LEARNING OF DISTRIBUTED DATA. IEEE SigPort. http://sigport.org/2159
Zheng Jiang, Xiaoqing Zhu, Wai-tian Tan, and Rob Liston, 2017. TRAINING SAMPLE SELECTION FOR DEEP LEARNING OF DISTRIBUTED DATA. Available at: http://sigport.org/2159.
Zheng Jiang, Xiaoqing Zhu, Wai-tian Tan, and Rob Liston. (2017). "TRAINING SAMPLE SELECTION FOR DEEP LEARNING OF DISTRIBUTED DATA." Web.
1. Zheng Jiang, Xiaoqing Zhu, Wai-tian Tan, and Rob Liston. TRAINING SAMPLE SELECTION FOR DEEP LEARNING OF DISTRIBUTED DATA [Internet]. IEEE SigPort; 2017. Available from : http://sigport.org/2159