2017-3-6

来自cslt Wiki
2017年3月6日 (一) 03:02Zhangsy（讨论 | 贡献）的版本

(差异) ←上一版本 | 最后版本 (差异) | 下一版本→ (差异)
跳转至： 导航、 搜索
Date People Last Week This Week
2017/1/3 Yang Feng
Jiyuan Zhang
Andi Zhang
Shiyue Zhang
  • figured out the problem of attention: the initial value of V should be around 0
  • tested different modification, such as add mask, init b with 0. Compared the results, and concluded only change the initial value of V is the best.
  • try to get right attention on memory
Peilun Xiao
取自“http://index.cslt.org/mediawiki/index.php?title=2017-3-6&oldid=26358”