“2017-3-6”版本间的差异
来自cslt Wiki
(以“{| class="wikitable" !Date !! People !! Last Week !! This Week |- | rowspan="6"|2017/1/3 |Yang Feng || || |- |Jiyuan Zhang || || |- |Andi Zhang || || |- |Shiyue...”为内容创建页面) |
|||
第12行: | 第12行: | ||
|- | |- | ||
|Andi Zhang || | |Andi Zhang || | ||
− | + | * added source masks in attention_decoder where calculates attention and in gru_cell where calculates new states. | |
+ | * found the attribute sentence_length, perhaps it works better than my code | ||
|| | || | ||
第18行: | 第19行: | ||
|Shiyue Zhang || | |Shiyue Zhang || | ||
* figured out the problem of attention: the initial value of V should be around 0 | * figured out the problem of attention: the initial value of V should be around 0 | ||
− | * tested different modification, such as add mask, init b with 0. Compared the results, and concluded only change the initial value of V is the best. | + | * tested different modification, such as add mask, init b with 0. |
+ | * Compared the results, and concluded only change the initial value of V is the best. | ||
|| | || | ||
* try to get right attention on memory | * try to get right attention on memory |
2017年3月6日 (一) 03:03的版本
Date | People | Last Week | This Week |
---|---|---|---|
2017/1/3 | Yang Feng | ||
Jiyuan Zhang | |||
Andi Zhang |
|
||
Shiyue Zhang |
|
| |
Peilun Xiao |