“ASR:2015-07-13”版本间的差异

来自cslt Wiki
跳转至: 导航搜索
(以“==Speech Processing == === AM development === ==== Environment ====* * the GPU of grid-14 does not work ==== RNN AM==== *hold *morpheme RNN --zhiyuan *train using...”为内容创建页面)
 
Text Processing
第62行: 第62行:
 
====Order representation ====
 
====Order representation ====
 
* Nested Dropout
 
* Nested Dropout
 +
:*semi-linear --> neural based auto-encoder.
 
* modify the objective function(hold)
 
* modify the objective function(hold)
 
====Balance Representation====
 
====Balance Representation====
第68行: 第69行:
 
====Recommendation====
 
====Recommendation====
 
* Reproduce baseline.
 
* Reproduce baseline.
 +
:*LDA matrix dissovle.
 +
:* LDA (Text classification & Recommendation System) --> AAAI
  
 
====DSSM based QA====
 
====DSSM based QA====
:*Pre-processing java class.
+
* Demo Release.
* Reproduce baseline.
+
 
====Seq to Seq(09-15)====
 
====Seq to Seq(09-15)====
:* Review papers
+
:* Review papers.(Reported in 07-08)
 
* Reproduce baseline.
 
* Reproduce baseline.
  
第84行: 第86行:
 
(hold)
 
(hold)
 
====Image Baseline====
 
====Image Baseline====
 +
:*Demo Release.
 +
:*Paper Report.
 +
 +
====UV Matrix Decomposition====
 
(hold)
 
(hold)

2015年7月13日 (一) 01:51的版本

Speech Processing

AM development

==== Environment ====*

  • the GPU of grid-14 does not work

RNN AM

  • hold
  • morpheme RNN --zhiyuan
  • train using large dataset--mengyuan

Mic-Array

  • hold
  • compute EER with kaldi

====Data selection unsupervised learning

  • acoustic feature based submodular using Pinan dataset --zhiyong


RNN-DAE(Deep based Auto-Encode-RNN)

  • hold
  • deliver to mengyuan

Speaker ID

  • DNN-based sid --Lantian


Ivector&Dvector based ASR

  • hold --Tian Lan
  • Cluster the speakers to speaker-classes, then using the distance or the posterior-probability as the metric
  • dark-konowlege using i-vector
  • train on wsj(testbase dev93+evl92)
  • --hold

Dark knowledge

  • test random last output layer when train MPE --zhiyuan


language vector

  • train using language vector with the dataset of 1400h_CN + 100h_EN--mengyuan
  • write a paper--zhiyuan

rectifier

  • WER performs worse using auraro4 --zhiyuan
  • train using other dataset
  • rectifier RNN

audio embedding=

  • audio ebedding --Wei Xu

Text Processing

RNN LM

  • character-lm rnn(hold)
  • lstm+rnn
  • check the lstm-rnnlm code about how to Initialize and update learning rate.(hold)

Neural Based Document Classification

  • (hold)

Order representation

  • Nested Dropout
  • semi-linear --> neural based auto-encoder.
  • modify the objective function(hold)

Balance Representation

  • Find error signal

Recommendation

  • Reproduce baseline.
  • LDA matrix dissovle.
  • LDA (Text classification & Recommendation System) --> AAAI

DSSM based QA

  • Demo Release.

Seq to Seq(09-15)

  • Review papers.(Reported in 07-08)
  • Reproduce baseline.

Text Group Intern Project

  • ====Buddhist Process====

(hold)

RNN Poem Process

(hold)

RNN Document Vector

(hold)

Image Baseline

  • Demo Release.
  • Paper Report.

UV Matrix Decomposition

(hold)