“ASR:2015-01-05”版本间的差异

2015年1月5日 (一) 02:48的版本

Text Processing

LM development

Domain specific LM

• LM2.0

• mix the sougou2T-lm,kn-discount continue
• train a large lm using 25w-dict.(hanzhenglong/wxx)
• prun history lm(wxx)

• new dict.

• dongxu help zhenglong with large dictionary.

tag LM

• need to do

• tag Probability should test add the weight(hanzhenglong) and handover to hanzhenglong (hold)

paper

• paper submit this week.

RNN LM

• rnn

• test wer RNNLM on Chinese data from jietong-data
• generate the ngram model from rnnlm and test the ppl with different size txt.

• lstm+rnn

• check the lstm-rnnlm code about how to Initialize and update learning rate.(hold)

Word2Vector

W2V based doc classification

• Initial results variable Bayesian GMM obtained. Performance is not as good as the conventional GMM.(hold)
• Non-linear inter-language transform: English-Spanish-Czch: wv model training done, transform model on investigation

Knowledge vector

• Knowledge vector

• Make a proper test set.
• Modify the object function and training process.

relation

Character to word

• Character to word conversion(hold)

Translation

• v5.0 demo released

• cut the dict and use new segment-tool

QA

improve fuzzy match

• add Synonyms similarity using MERT-4 method(hold)

improve lucene search

• add more feature to improve search.

• POS, NER ,tf ,idf ..

XiaoI framework

• context in xiaoI
• make a report

query normalization

• using NER to normalize the word

• new inter will install SEMPRE