“Nlp-progress 2016/12”版本间的差异

来自cslt Wiki
跳转至： 导航、 搜索
（以“===Daily Report=== {|class="wikitable" ! Date !! Person !! start!! leave !! hours ||status |- | rowspan="3"|2016/12/1 |Andy Zhang|| 9:30||18:30 ||8 || *read sourc...”为内容创建页面）
（没有差异）

2017年1月9日 (一) 08:36的版本

Daily Report

Date Person start leave hours status
2016/12/1 Andy Zhang 9:30 18:30 8
  • read source code
  • thought about ways to store encoder output
Shiyue Zhang 9:10 19:00 8+
  • draw tsne pictures
Guli 9:10 9:50 12+
  • prepare data and run code
  • prepare for Thesis Report
2016/12/2 Andy Zhang 9:30 18:30 8
  • finish the code to output encoder output but have not tested yet
  • prepared a small data set for testing
Shiyue Zhang
Guli 9:05 18:05 8
  • read code and check data
  • think about how to improve bleu score
Peilun Xiao 10:00 12:30 2+
  • learn basic things of work
2016/12/5 Andy Zhang 9:30 19:00 8+
  • group meeting
  • prepare the same data set as in Theano for Tensorflow
Shiyue Zhang 9:30 19:00 8+
  • discuss with teachers about the tsne pictures
  • group meeting
Guli 9:00 22:35 13+
  • install moses
  • weekly report
Peilun Xiao 9:30 18:30 8
  • learn how to use weka
2016/12/6 Andy Zhang 9:30 19:00 8+
  • run fr-en (single encoder)
  • prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
Shiyue Zhang
Guli 9:05 22;30 12+
  • run moses
  • write Thesis Report
Peilun Xiao 9:40 18:30 8
  • read a paper
  • use weka
2016/12/7 Andy Zhang 9:30 19:00 8+
  • prepare paraphrase data set, enumerate them, excluding 呀啊哈, etc.
  • met with some problems, used too much memory, had to restrict enumerate nums to 15000
Shiyue Zhang 9:30 19:00 8+
  • change mem to 28-dim states
  • retry previous experiments
Guli 9:15 22;00 12+
  • run moses
  • write Thesis Report
Peilun Xiao
2016/12/8 Andy Zhang 9:30 19:00 8+
  • finished preparing the data set
  • start working on bidirectional model
Shiyue Zhang 9:30 19:00 8+
  • try more experiments, but all are not good, always converge to baseline
  • draw the tsne picture of test data
  • discuss with Teacher Wang
Guli 9:15 21;15 12
  • run moses
  • write Thesis Report
Peilun Xiao 9:30 17:30 7
  • learn GibbsLda++
2016/12/9 Andy Zhang 9:30 19:00 8+
  • finished coding, added masks for encoder inputs
  • had a some breakthrough with Jiyuan's help, but still meet nan problem
Shiyue Zhang 9:30 19:00 8+
  • return to 384-dim mem, which has 0.07 improvement than baseline
  • replace cos with a one-layer neural network, which is also slightly better than baseline
  • discuss with teachers, and find the problem of scale
Guli 9:15 21;30 12 +
  • prepared Thesis Report
Peilun Xiao
2016/12/12 Andy Zhang
Shiyue Zhang
Guli 10:00 19;00 9
  • read paper to solve oov
Peilun Xiao 9:30 19:00 8+
  • use lda to generate document vector
2016/12/13 Andy Zhang 9:30 18:30 8
  • tried to modify the wrong softmax
Shiyue Zhang 9:30 19:00 8+
  • change mem scale to (0, -10000.0...)
  • try previous experiments
Guli 09:30 21;00 11+
  • read papers
Peilun Xiao 9:50 19:00 8
  • use lda to generate document vector
2016/12/14 Andy Zhang 9:30 18:30 8
  • tried to modify the wrong softmax
  • decided to abandon it for now
Shiyue Zhang
Guli 09:20 20;30 11+
  • read papers
  • writing a survey
Peilun Xiao
2016/12/15 Andy Zhang 9:30 18:30 8
  • tried to add bleu scoring into the code, but met with out of memory problem
Shiyue Zhang 9:30 19:00 8+
  • changed scale didn't lead to better results
  • try 1-dim gate, but converge to baseline
Guli 09:20 20;30 11+
  • read papers
  • writing a survey
Peilun Xiao 13:30 19:00 5+
  • use lda to generate document vector
2016/12/16 Andy Zhang 9:20 18:20 8
  • finished adding bleu scoring into the code
Shiyue Zhang 14:00 19:00 5
  • try to only train gate
  • try model similar to attention
Guli 09:30 20;30 11
  • Check the data, modify the error
  • writing a survey
Peilun Xiao
2016/12/19 Andy Zhang 9:30 18:30 8
  • group meeting
  • made some revises on bleu scoring
Shiyue Zhang 9:00 19:00 9
  • review last week work
  • write the report and talk with teachers
  • decide what to do next and meeting
  • try to train gate with true action info
Guli 9:15 20:00 10+
  • weekly meeting
  • conduct comparative test
Peilun Xiao 9:30 19:00 8+
  • weekly meeting
  • code on tf-idf
2016/12/20 Andy Zhang 9:30 19:00 8+
  • dealt with some bugs on bidirectional model
  • coding on getting encoder outputs
Shiyue Zhang 9:30 19:00 8+
  • try to train gate with true actions, which gets the results better than no true action, but still not very good.
  • try to change cos to inner product, which gets better performance than cos.
Guli 9:00 21:50 12+
  • voice tagging
  • write survey
Peilun Xiao 9:50 18:30 8
  • debug the code
  • prepare a small test set
2016/12/21 Andy Zhang 9:20 18:30 8+
  • finishing testing on getting encoder outputs
  • coded to output corresponding source and target sentences, but have not tested yet
Shiyue Zhang
Guli 9:10 21:10 12
  • voice tagging
  • write survey
Peilun Xiao
2016/12/22 Andy Zhang 9:20 18:30 8+
  • decided to make some revises on bleu scoring part
Shiyue Zhang 9:30 19:00 8+
  • try to change the scales of one-hot vec, and find >=-5000 is good
Guli 9:20 21:10 11+
  • voice tagging
  • write survey
Peilun Xiao 9:20 19:00 9
  • read paper
  • try to solve the bug
2016/12/23 Andy Zhang 9:30 18:10 7+
  • finished bleu scoring part
  • made it process by batches & testing several checkpoints and save the best one
Shiyue Zhang 14:30 19:00 5.5
  • review the work of the whole week and discuss with teachers
  • try joint training
Guli 9:20 21:30 12+
  • voice tagging
  • write survey
Peilun Xiao
2016/12/26 Andy Zhang
Shiyue Zhang 9:30 19:00 8+
  • weekly report
Guli 9:10 21:30 12+
  • weekly report
  • read pepar
Peilun Xiao 9:20 19:00 8+
  • debug code
  • read sklearn source code
2016/12/27 Andy Zhang 9:30 18:30 8
  • modified the BLEU script to compare translation result with original sentences
Shiyue Zhang 9:20 14:00 5.5
Guli 9:05 18:40 7+
  • read paper
  • prepare data
Peilun Xiao 9:20 19:00 9
  • debug code
  • write a code about elm
2016/12/28 Andy Zhang 9:30 18:30 8
  • modified BLEU script, now it is auto called while training
Shiyue Zhang 9:20 19:00 8+
  • modify mem to the states before dropout
  • update progress on CVSS
Guli 9:30 15:30 6
  • bleu computation
Peilun Xiao
2016/12/29 Andy Zhang 9:30 18:30 8
  • transferred to help Jiyuan with his work
  • gathered 70+ poems for trainning
Shiyue Zhang 9:10 17:10 7.5
  • pause the rnng work
  • start to help Teacher Feng with NMT
Guli 9:30 9:00 11+
  • prepare and run data
Peilun Xiao 9:30 18:00 7+
  • prepare data
  • run data
2016/12/30 Andy Zhang
Shiyue Zhang 9:30 19:10 8+
  • run the theano NMT code successfully
Guli 9:30 21;30 12
Peilun Xiao
取自“http://index.cslt.org/mediawiki/index.php?title=Nlp-progress_2016/12&oldid=25745”