“ASR:2015-04-13”版本间的差异
来自cslt Wiki
(→Text Processing) |
(→Speech Processing) |
||
第4行: | 第4行: | ||
==== Environment ==== | ==== Environment ==== | ||
* grid-11 often shut down automatically, too slow computation speed. | * grid-11 often shut down automatically, too slow computation speed. | ||
− | + | * add a server | |
==== RNN AM==== | ==== RNN AM==== | ||
第19行: | 第19行: | ||
====Convolutive network==== | ====Convolutive network==== | ||
* HOLD | * HOLD | ||
− | + | * CNN + DNN feature fusion | |
====RNN-DAE(Deep based Auto-Encode-RNN)==== | ====RNN-DAE(Deep based Auto-Encode-RNN)==== |
2015年4月15日 (三) 06:41的版本
Speech Processing
AM development
Environment
- grid-11 often shut down automatically, too slow computation speed.
- add a server
RNN AM
- details at http://liuc.cslt.org/pages/rnnam.html
- tuning parameters on monophone NN
- run using wsj,MPE
Mic-Array
- investigate alpha parameter in time domian and frquency domain
- ALPHA>=0
Convolutive network
- HOLD
- CNN + DNN feature fusion
RNN-DAE(Deep based Auto-Encode-RNN)
- HOLD -Zhiyong
- http://cslt.riit.tsinghua.edu.cn/cgi-bin/cvss/cvss_request.pl?account=zhangzy&step=view_request&cvssid=261
Speaker ID
- DNN-based sid --Yiye
- Decode --Yiye
- http://cslt.riit.tsinghua.edu.cn/cgi-bin/cvss/cvss_request.pl?account=zhangzy&step=view_request&cvssid=327
Ivector based ASR
- http://cslt.riit.tsinghua.edu.cn/cgi-bin/cvss/cvss_request.pl?step=view_request&cvssid=340
- Ivector dimention is smaller, performance is better
- Augument to hidden layer is better than input layer
- train on wsj(testbase dev93+evl92)
Text Processing
tag LM
- similar word extension in FST
- will check the formula using Bayes and experiment
- fixed the bug using the big-lm.
- will add more test data
- will test the baseline(no weight) and different weight method
RNN LM
- rnn
- code the character-lm using Theano
- lstm+rnn
- check the lstm-rnnlm code about how to Initialize and update learning rate.(hold)
W2V based document classification
- some result about VMF model [1]
- will try max-method
Translation
- v5.0 demo released
- cut the dict and use new segment-tool
Sparse NN in NLP
- test the drop-out model and the performance gets a little improvement, need some result:
- test the order feature
online learning
- data is ready.prepare the ACL paper
- modified the listNet SGD
- finish some test.
- test the result on different time.
relation classifier
- modified the drop-out method