Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE

Abstract: 

With the advent of Big Data application domains, several Machine Learning (ML) signal-processing algorithms such as Convolutional Neural Networks (CNNs) are required to process progressively larger datasets at a great cost in terms of both compute power and memory bandwidth. Although dedicated accelerators have been developed targeting this issue, they usually require moving massive amounts of data across the memory hierarchy to the processing cores and low-level knowledge of how data is stored in the memory devices to enable in-/near-memory processing solutions. In this paper, we propose and assess a novel mechanism that operates at cache level, leveraging both data-proximity and parallel processing capabilities enabled by dedicated fully-digital vector Functional Units (FUs). We also demonstrate the integration of the mechanism with a conventional Central Processing Unit (CPU). The obtained results show that our engine provides performance improvements on CNNs ranging from 3.92× to 16.6×.

up
0 users have voted:

Paper Details

Authors:
Joao Vieira, Nuno Roma, Gabriel Falcao, and Pedro Tomas
Submitted On:
14 May 2020 - 4:32am
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Joao Vieira
Paper Code:
DIS-P2.7
Document Year:
2020
Cite

Document Files

[2020_04_08].presentation_icassp_2020.pdf

(23)

Subscribe

[1] Joao Vieira, Nuno Roma, Gabriel Falcao, and Pedro Tomas, "PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE", IEEE SigPort, 2020. [Online]. Available: http://sigport.org/5265. Accessed: Aug. 13, 2020.
@article{5265-20,
url = {http://sigport.org/5265},
author = {Joao Vieira; Nuno Roma; Gabriel Falcao; and Pedro Tomas },
publisher = {IEEE SigPort},
title = {PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE},
year = {2020} }
TY - EJOUR
T1 - PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE
AU - Joao Vieira; Nuno Roma; Gabriel Falcao; and Pedro Tomas
PY - 2020
PB - IEEE SigPort
UR - http://sigport.org/5265
ER -
Joao Vieira, Nuno Roma, Gabriel Falcao, and Pedro Tomas. (2020). PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE. IEEE SigPort. http://sigport.org/5265
Joao Vieira, Nuno Roma, Gabriel Falcao, and Pedro Tomas, 2020. PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE. Available at: http://sigport.org/5265.
Joao Vieira, Nuno Roma, Gabriel Falcao, and Pedro Tomas. (2020). "PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE." Web.
1. Joao Vieira, Nuno Roma, Gabriel Falcao, and Pedro Tomas. PROCESSING CONVOLUTIONAL NEURAL NETWORKS ON CACHE [Internet]. IEEE SigPort; 2020. Available from : http://sigport.org/5265