“Flow-based Speech Analysis”版本间的差异

来自cslt Wiki
跳转至: 导航搜索
Flow-based Speech Analysis
Flow-based Speech Analysis
第1行: 第1行:
=Flow-based Speech Analysis=
+
=Preliminary Investigation of Flow-based Speech Analysis=
  
 
* Members: Dong Wang, Haoran Sun, Yunqi Cai, Lantian Li
 
* Members: Dong Wang, Haoran Sun, Yunqi Cai, Lantian Li

2019年10月29日 (二) 06:53的版本

Preliminary Investigation of Flow-based Speech Analysis

  • Members: Dong Wang, Haoran Sun, Yunqi Cai, Lantian Li
  • Paper: Haoran Sun, Yunqi Cai, Lantian Li, Dong Wang, "On Investigation of Unsupervised Speech Factorization Based in Normalization Flow", 2019. link
  • original codes we used: the pytorch version of glow model by Yuki-Chai. glow-pytorch

Introduction

  • We present a preliminary investigation on unsupervised speech factorization based on the normalization flow model. This model constructs a complex invertible transform, by which we can project speech segments into a latent code space where the distribution is a simple diagonal Gaussian.
  • Our preliminary investigation on the TIMIT database shows that this code space exhibits favorable properties such as denseness and pseudo linearity, and perceptually important factors such as phonetic content and speaker trait can be represented as particular directions within the code space.
  • Index Terms: speech factorization, normalization flow, deep learning

Experimental Results

  • Right click "figs" or "wavs" and select "save as" to save the spectrogram figures or related audio files.

Fig3 flow.jpg

Fig4 flow.jpg

Fig5 flow.jpg

Future Work

  • To conduct more thorough studies on large databases and continuous speech.
  • To investigate discriminative flow models which take class information into consideration.