Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu)

Abstract: 

We reveal an interesting link between tensors and multivariate statistics. The rank of a multivariate probability tensor can be interpreted as a nonlinear measure of statistical dependence of the associated random variables. Rank equals one when the random variables are independent, and complete statistical dependence corresponds to full rank; but we show that rank as low as two can already model strong statistical dependence. In practice we usually work with random variables that are neither independent nor fully dependent -- partial dependence is typical, and can be modeled using a low-rank multivariate probability tensor. Directly estimating such a tensor from sample averages is impossible even for as few as ten random variables taking ten values each --yielding a billion unknowns; but we often have enough data to estimate lower-order marginalized distributions. We prove that it is possible to identify the higher-order joint probabilities from lower order ones, provided that the higher-order probability tensor has low-enough rank, i.e., the random variables are only partially dependent. We also provide a computational identification algorithm that is shown to work well on both simulated and real data. The insights and results have numerous applications in estimation, hypothesis testing, completion, machine learning, and system identification. Low-rank tensor modeling thus provides a `universal' non-parametric (model-free) alternative to probabilistic graphical models.

up
0 users have voted:

Paper Details

Authors:
N.D. Sidiropoulos, N. Kargas, X. Fu
Submitted On:
24 December 2018 - 8:25pm
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
N.D. Sidiropoulos
Paper Code:
DL-TM.1
Document Year:
2018
Cite

Document Files

GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu)

(148)

Subscribe

[1] N.D. Sidiropoulos, N. Kargas, X. Fu, "GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu)", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/3842. Accessed: Nov. 12, 2019.
@article{3842-18,
url = {http://sigport.org/3842},
author = {N.D. Sidiropoulos; N. Kargas; X. Fu },
publisher = {IEEE SigPort},
title = {GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu)},
year = {2018} }
TY - EJOUR
T1 - GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu)
AU - N.D. Sidiropoulos; N. Kargas; X. Fu
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/3842
ER -
N.D. Sidiropoulos, N. Kargas, X. Fu. (2018). GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu). IEEE SigPort. http://sigport.org/3842
N.D. Sidiropoulos, N. Kargas, X. Fu, 2018. GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu). Available at: http://sigport.org/3842.
N.D. Sidiropoulos, N. Kargas, X. Fu. (2018). "GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu)." Web.
1. N.D. Sidiropoulos, N. Kargas, X. Fu. GlobalSIP 2018 Keynote: Tensors and Probability: An Intriguing Union (N. Sidiropoulos, N. Kargas, X. Fu) [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/3842