Documents
Poster
Poster
Generic Bounds on the Maximum Deviations in Sequential/Sequence Prediction (and the Implications in Recursive Algorithms and Learning/Generalization)
- Citation Author(s):
- Submitted by:
- Song Fang
- Last updated:
- 24 October 2019 - 4:45pm
- Document Type:
- Poster
- Document Year:
- 2019
- Event:
- Presenters:
- Song Fang
- Paper Code:
- MLSP-137
- Categories:
- Log in to post comments
In this paper, we derive generic bounds on the maximum deviations in prediction errors for sequential prediction via an information-theoretic approach. The fundamental bounds are shown to depend only on the conditional entropy of the data point to be predicted given the previous data points. In the asymptotic case, the bounds are achieved if and only if the prediction error is white and uniformly distributed.