Sorry, you need to enable JavaScript to visit this website.

Making Likelihood Ratios Digestible for Cross-Application Performance Assessment

Citation Author(s):
Andreas Nautsch, Didier Meuwly, Daniel Ramos, Jonas Lindh, Christoph Busch
Submitted by:
Andreas Nautsch
Last updated:
12 April 2018 - 1:11pm
Document Type:
Poster
Document Year:
2018
Event:
Presenters:
Andreas Nautsch
Paper Code:
4717
 

Performance estimation is crucial to the assessment of novel algorithms and systems. In detection error trade-off (DET) diagrams, discrimination performance is solely assessed targeting one application, where cross-application performance considers risks resulting from decisions, depending on application constraints. For the purpose of interchangeability of research results across different application constraints, we propose to augment DET curves by depicting systems regarding their support of security and convenience levels. Therefore, application policies are aggregated into levels based on verbal likelihood ratio scales, providing an easy to use concept for business-to-business (B2B) communication to denote operative thresholds. We supply a reference implementation in Python, an exemplary performance assessment on synthetic score distributions, and a fine-tuning scheme for Bayes decision thresholds, when decision policies are bounded rather than fix.

up
0 users have voted: