Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

A Sequence Matching Network for Polyphonic Sound Event Localization and Detection

Abstract: 

Polyphonic sound event detection and direction-of-arrival estimation require different input features from audio signals. While sound event detection mainly relies on time-frequency patterns, direction-of-arrival estimation relies on magnitude or phase differences between microphones. Previous approaches use the same input features for sound event detection and direction-of-arrival estimation, and train the two tasks jointly or in a two-stage transfer-learning manner. We propose a two-step approach that decouples the learning of the sound event detection and directional-of-arrival estimation systems. In the first step, we detect the sound events and estimate the directions-of-arrival separately to optimize the performance of each system. In the second step, we train a deep neural network to match the two output sequences of the event detector and the direction-of-arrival estimator. This modular and hierarchical approach allows the flexibility in the system design, and increase the performance of the whole sound event localization and detection system. The experimental results using the DCASE 2019 sound event localization and detection dataset show an improved performance compared to the previous state-of-the-art solutions.

up
0 users have voted:

Paper Details

Authors:
T. N. T. Nguyen, D. L. Jones, W. S. Gan
Submitted On:
23 April 2020 - 4:54am
Short Link:
Type:
Presentation Slides
Event:
Presenter's Name:
Tho Nguyen
Paper Code:
AUD-L3
Document Year:
2020
Cite

Document Files

ICASSP2020 - Tho Nguyen - NTU - Sequence Matching - Sigpost.pdf

(32)

Subscribe

[1] T. N. T. Nguyen, D. L. Jones, W. S. Gan, "A Sequence Matching Network for Polyphonic Sound Event Localization and Detection", IEEE SigPort, 2020. [Online]. Available: http://sigport.org/5096. Accessed: Jul. 13, 2020.
@article{5096-20,
url = {http://sigport.org/5096},
author = {T. N. T. Nguyen; D. L. Jones; W. S. Gan },
publisher = {IEEE SigPort},
title = {A Sequence Matching Network for Polyphonic Sound Event Localization and Detection},
year = {2020} }
TY - EJOUR
T1 - A Sequence Matching Network for Polyphonic Sound Event Localization and Detection
AU - T. N. T. Nguyen; D. L. Jones; W. S. Gan
PY - 2020
PB - IEEE SigPort
UR - http://sigport.org/5096
ER -
T. N. T. Nguyen, D. L. Jones, W. S. Gan. (2020). A Sequence Matching Network for Polyphonic Sound Event Localization and Detection. IEEE SigPort. http://sigport.org/5096
T. N. T. Nguyen, D. L. Jones, W. S. Gan, 2020. A Sequence Matching Network for Polyphonic Sound Event Localization and Detection. Available at: http://sigport.org/5096.
T. N. T. Nguyen, D. L. Jones, W. S. Gan. (2020). "A Sequence Matching Network for Polyphonic Sound Event Localization and Detection." Web.
1. T. N. T. Nguyen, D. L. Jones, W. S. Gan. A Sequence Matching Network for Polyphonic Sound Event Localization and Detection [Internet]. IEEE SigPort; 2020. Available from : http://sigport.org/5096