Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

Investigating the Effect of Sound-Event Loudness on Crowdsourced Audio Annotations

Abstract: 

Audio annotation is an important step in developing machine-listening systems. It is also a time consuming process, which has motivated investigators to crowdsource audio annotations. However, there are many factors that affect annotations, many of which have not been adequately investigated. In previous work, we investigated the effects of visualization aids and sound scene complexity on the quality of crowdsourced sound-event annotations. In this paper, we extend that work by investigating the effect of sound-event loudness on both sound-event source annotations and sound-event proximity annotations. We find that the sound class, loudness, and annotator bias affect how listeners annotate proximity. We also find that loudness affects recall more than precision and that the strengths of these effects are strongly influenced by the sound class. These findings are not only important for designing effective audio annotation processes, but also for effectively training and evaluating machine-listening systems.

up
0 users have voted:

Paper Details

Authors:
Mark Cartwright, Justin Salamon, Ayanna Seals, Oded Nov, Juan Pablo Bello
Submitted On:
14 April 2018 - 5:17pm
Short Link:
Type:
Poster
Event:
Presenter's Name:
Mark Cartwright
Paper Code:
AASP-P3.7
Document Year:
2018
Cite

Document Files

cartwright_icassp_2018_poster.pdf

(80 downloads)

Subscribe

[1] Mark Cartwright, Justin Salamon, Ayanna Seals, Oded Nov, Juan Pablo Bello, "Investigating the Effect of Sound-Event Loudness on Crowdsourced Audio Annotations", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/2853. Accessed: Sep. 20, 2018.
@article{2853-18,
url = {http://sigport.org/2853},
author = {Mark Cartwright; Justin Salamon; Ayanna Seals; Oded Nov; Juan Pablo Bello },
publisher = {IEEE SigPort},
title = {Investigating the Effect of Sound-Event Loudness on Crowdsourced Audio Annotations},
year = {2018} }
TY - EJOUR
T1 - Investigating the Effect of Sound-Event Loudness on Crowdsourced Audio Annotations
AU - Mark Cartwright; Justin Salamon; Ayanna Seals; Oded Nov; Juan Pablo Bello
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/2853
ER -
Mark Cartwright, Justin Salamon, Ayanna Seals, Oded Nov, Juan Pablo Bello. (2018). Investigating the Effect of Sound-Event Loudness on Crowdsourced Audio Annotations. IEEE SigPort. http://sigport.org/2853
Mark Cartwright, Justin Salamon, Ayanna Seals, Oded Nov, Juan Pablo Bello, 2018. Investigating the Effect of Sound-Event Loudness on Crowdsourced Audio Annotations. Available at: http://sigport.org/2853.
Mark Cartwright, Justin Salamon, Ayanna Seals, Oded Nov, Juan Pablo Bello. (2018). "Investigating the Effect of Sound-Event Loudness on Crowdsourced Audio Annotations." Web.
1. Mark Cartwright, Justin Salamon, Ayanna Seals, Oded Nov, Juan Pablo Bello. Investigating the Effect of Sound-Event Loudness on Crowdsourced Audio Annotations [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/2853