Alternative implementations of the Auxiliary Duplicating Permutation Invariant Training
Gulin, Jens; Åström, Kalle (2024). Alternative implementations of the Auxiliary Duplicating Permutation Invariant Training CEUR Workshop Proceedings, 3919,
Conference Proceeding/Paper
|
Published
|
English
Authors:
Gulin, Jens
;
Åström, Kalle
Department:
Computer Vision and Machine Learning
Integrated Electronic Systems
LU Profile Area: Natural and Artificial Cognition
LTH Profile Area: AI and Digitalization
ELLIIT: the Linköping-Lund initiative on IT and mobile communication
eSSENCE: The e-Science Collaboration
Mathematical Imaging Group
Research Group:
Computer Vision and Machine Learning
Mathematical Imaging Group
Abstract:
Simultaneous sound event localization and detection (SELD) for multi-source sound events is an open research field. The Multi-ACCDOA format is a popular way to handle activity-coupled sound events where the same class occurs at multiple locations at the same time. An important part is the Auxiliary Duplicating Permutation Invariant Training (ADPIT) paradigm that calculates the loss for order-agnosic output. The baseline system for the DCASE SELD challenge 2024 has an implementation of ADPIT. In this paper we discuss alternative ways to implement
ADPIT with the goal to reduce multiplications, to make the equivalent calculations faster. ADPIT duplicates output when there are fewer events than tracks. A brief discussion how this differs from permutation invariant training without duplicated output is also included. The loss calculations are likely not the execution bottleneck in the current challenge setup, but ADPIT scales poorly for an increased number of tracks and improved efficiency is thus of general interest for audio localization.
Cite this