Title Investigation of the Lombard effect based on a machine learning approach /
Authors Korvel, Gražina ; Treigys, Povilas ; Kąkol, Krzysztof ; Kostek, Bozena
DOI 10.34768/amcs-2023-0035
Full Text Download
Is Part of International journal of applied mathematics and computer science.. Warsaw : Sciendo. 2023, vol. 33, no. 3, p. 479-492.. ISSN 1641-876X. eISSN 2083-8492
Keywords [eng] Lombard effect ; speech detection ; noise signal ; self-similarity matrix ; convolutional neural network
Abstract [eng] The Lombard effect is an involuntary increase in the speaker’s pitch, intensity, and duration in the presence of noise. It makes it possible to communicate in noisy environments more effectively. This study aims to investigate an efficient method for detecting the Lombard effect in uttered speech. The influence of interfering noise, room type, and the gender of the person on the detection process is examined. First, acoustic parameters related to speech changes produced by the Lombard effect are extracted. Mid-term statistics are built upon the parameters and used for the self-similarity matrix construction. They constitute input data for a convolutional neural network (CNN). The self-similarity-based approach is then compared with two other methods, i.e., spectrograms used as input to the CNN and speech acoustic parameters combined with the k-nearest neighbors algorithm. The experimental investigations show the superiority of the self-similarity approach applied to Lombard effect detection over the other two methods utilized. Moreover, small standard deviation values for the self-similarity approach prove the resulting high accuracies.
Published Warsaw : Sciendo
Type Journal article
Language English
Publication date 2023
CC license CC license description