Sorry, you need to enable JavaScript to visit this website.

Graph Regularization Network with Semantic Affinity for Weakly-supervised Temporal Action Localization

Citation Author(s):
Jungin Park, Jiyoung Lee, Sangryul Jeon, Seungryong Kim, Kwanghoon Sohn
Submitted by:
Jungin Park
Last updated:
20 September 2019 - 7:59pm
Document Type:
Presentation Slides
Jungin Park
Paper Code:


This paper presents a novel deep architecture for weakly-supervised temporal action localization that predicts temporal boundaries with graph regularization. Our model not only generates segment-level action responses but also propagates segment-level responses to
neighborhood in a form of graph Laplacian regularization. Specifically, our approach consists of two sub-modules; a class activation
module to estimate the action score map over time through the action classifiers, and a graph regularization module to refine the
estimated action score map by solving a quadratic programming problem with the predicted segment-level semantic affinities. Since
these two modules are integrated with fully differentiable layers, the proposed network can be jointly trained in an end-to-end manner. Experimental results on Thumos14 and ActivityNet1.2 demonstrate that the proposed method provides outstanding performances in
weakly-supervised temporal action localization.

0 users have voted: