Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

When Harmonic Analysis Meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks

Abstract: 

Deep neural networks have led to dramatic improvements in performance for many machine learning tasks, yet the mathematical reasons for this success remain largely unclear. In this talk we present recent developments in the mathematical framework of convolutive neural networks (CNN). In particular we discuss the scattering network of Mallat and how it relates to another problem in harmonic analysis, namely the phase retrieval problem. Then we discuss the general convolutive neural network from a theoretician point of view. We present Lipschitz analysis results using two analytical methods: the chain rule (or backpropagation) and the storage function method inspired by Mallat's scattering network analysis. Towards the end of the talk we discuss how these theoretical results can be applied in practice, and in particular we mention various design methods that incorporate Lipschitz bounds as penalty terms into optimization problems.

Prof. Balan is a professor of applied mathematics at the University of Maryland. His research interests include topics in harmonic analysis and applications to engineering and computer science, particularly to statistical signal processing, and machine learning.

Please refer to IEEE events LINK below for more information:
https://events.vtools.ieee.org/m/47297

up
0 users have voted:

Paper Details

Authors:
Radu Balan
Submitted On:
19 October 2017 - 11:56am
Short Link:
Type:
Presentation Slides
Document Year:
2017
Cite

Document Files

Presentation slides (pdf version)

(38 downloads)

Subscribe

[1] Radu Balan, "When Harmonic Analysis Meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks", IEEE SigPort, 2017. [Online]. Available: http://sigport.org/2263. Accessed: Nov. 21, 2017.
@article{2263-17,
url = {http://sigport.org/2263},
author = {Radu Balan },
publisher = {IEEE SigPort},
title = {When Harmonic Analysis Meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks},
year = {2017} }
TY - EJOUR
T1 - When Harmonic Analysis Meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks
AU - Radu Balan
PY - 2017
PB - IEEE SigPort
UR - http://sigport.org/2263
ER -
Radu Balan. (2017). When Harmonic Analysis Meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks. IEEE SigPort. http://sigport.org/2263
Radu Balan, 2017. When Harmonic Analysis Meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks. Available at: http://sigport.org/2263.
Radu Balan. (2017). "When Harmonic Analysis Meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks." Web.
1. Radu Balan. When Harmonic Analysis Meets Machine Learning: Lipschitz Analysis of Deep Convolution Networks [Internet]. IEEE SigPort; 2017. Available from : http://sigport.org/2263