Sorry, you need to enable JavaScript to visit this website.

Decentralized Optimization with Non-Identical Sampling in Presence of Stragglers

Citation Author(s):
Tharindu Adikari, Stark C. Draper
Submitted by:
Tharindu Adikari
Last updated:
14 May 2020 - 10:40am
Document Type:
Presentation Slides
Document Year:
2020
Event:
Presenters:
Tharindu Adikari
Paper Code:
MLSP-P6.3
 

We consider decentralized consensus optimization when workers sample data from non-identical distributions and perform variable amounts of work due to slow nodes known as stragglers. The problem of non-identical distributions and the problem of variable amount of work have been previously studied separately. In our work we analyse them together under a unified system model. We propose to combine worker outputs weighted by the amount of work completed by each. We prove convergence of the proposed method under perfect consensus, assuming straggler statistics are independent and identical across all workers for all iterations. Our numerical results show that under approximate consensus the proposed method outperforms the non-weighted scheme for both convex and non-convex objective functions.

up
0 users have voted: