Unsupervised spoken word retrieval using gaussian-bernoulli restricted Boltzmann machines

Reddy, P R and Nayak, S and Kodukula, Sri Rama Murty (2014) Unsupervised spoken word retrieval using gaussian-bernoulli restricted Boltzmann machines. In: 15th Annual Conference of the International Speech Communication Association: Celebrating the Diversity of Spoken Languages, 14-18 September, 2014, Max Atria at Singapore ExpoSingapore; Singapore.

Full text not available from this repository. (Request a copy)


The objective of this work is to explore a novel unsupervised framework, using Restricted Boltzmann machines, for Spoken Word Retrieval (SWR). In the absence of labelled speech data, SWR is typically performed by matching sequence of feature vectors of query and test utterances using dynamic time warping (DTW). In such a scenario, performance of SWR system critically depends on representation of the speech signal. Typical features, like mel-frequency cepstral coefficients (MFCC), carry significant speaker-specific information, and hence may not be used directly in SWR system. To overcome this issue, we propose to capture the joint density of the acoustic space spanned by MFCCs using Gaussian-Bernoulli restricted Boltzmann machine (GBRBM). In this work, we have used hidden activations of the GBRBM as features for SWR system. Since the GBRBM is trained with speech data collected from large number of speakers, the hidden activations are more robust to the speaker-variability compared to MFCCs. The performance of the proposed features is evaluated on Telugu broadcast news data, and an absolute improvement of 12% was observed compared to MFCCs.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Kodukula, Sri Rama Murtyhttps://orcid.org/0000-0002-6355-5287
Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: DTW; GBRBM; Joint density estimation; Representation learning; Subsequence matching
Subjects: Others > Electricity
Physics > Electricity and electronics
Divisions: Department of Electrical Engineering
Depositing User: Team Library
Date Deposited: 02 Dec 2014 05:01
Last Modified: 05 Dec 2017 04:06
URI: http://raiith.iith.ac.in/id/eprint/1100
Publisher URL:
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 1100 Statistics for this ePrint Item