“2017-3-6”版本间的差异
来自cslt Wiki
(以“{| class="wikitable" !Date !! People !! Last Week !! This Week |- | rowspan="6"|2017/1/3 |Yang Feng || || |- |Jiyuan Zhang || || |- |Andi Zhang || || |- |Shiyue...”为内容创建页面) |
|||
| 第12行: | 第12行: | ||
|- | |- | ||
|Andi Zhang || | |Andi Zhang || | ||
| − | + | * added source masks in attention_decoder where calculates attention and in gru_cell where calculates new states. | |
| + | * found the attribute sentence_length, perhaps it works better than my code | ||
|| | || | ||
| 第18行: | 第19行: | ||
|Shiyue Zhang || | |Shiyue Zhang || | ||
* figured out the problem of attention: the initial value of V should be around 0 | * figured out the problem of attention: the initial value of V should be around 0 | ||
| − | * tested different modification, such as add mask, init b with 0. Compared the results, and concluded only change the initial value of V is the best. | + | * tested different modification, such as add mask, init b with 0. |
| + | * Compared the results, and concluded only change the initial value of V is the best. | ||
|| | || | ||
* try to get right attention on memory | * try to get right attention on memory | ||
2017年3月6日 (一) 03:03的版本
| Date | People | Last Week | This Week |
|---|---|---|---|
| 2017/1/3 | Yang Feng | ||
| Jiyuan Zhang | |||
| Andi Zhang |
|
||
| Shiyue Zhang |
|
| |
| Peilun Xiao |