Xiangyu Zeng 2016-04-25

来自cslt Wiki
2016年4月25日 (一) 01:41Zengxy讨论 | 贡献的版本

(差异) ←上一版本 | 最后版本 (差异) | 下一版本→ (差异)
跳转至: 导航搜索

Last week:

1.debug the code of natural gradient and made it converged, and the result of NG seems good.


  model                          |     clean     |   airport  |  babble   |  restaurant  |  street

 adam-max-lr-0.008-c             |    8.13       |   29.86    |  29.23    |  31.04       |  30.35 

 adam-max-lr-0.008-c-a           |    7.46       |   12.19    |  16.47    |  18.34       |  21.44   

 adam-max-lr-0.008-c-a-b         |    7.79       |   14.58    |  10.36    |  15.37       |  18.62

 adam-max-lr-0.008-c-a-b-r       |    7.33       |   12.20    |  11.27    |  9.77        |  14.93

 adam-max-lr-0.008-c-a-b-r-s     |    7.48       |   13.46    |  12.34    |  13.65       |  10.49

 sgd-lr-0.008-c                  |    8.47       |   36.06    |  35.28    |  37.83       |  35.95

 sgd-lr-0.008-c-a                |    8.02       |   13.88    |  18.28    |  20.16       |  23.17

 sgd-lr-0.008-c-a-b              |    8.09       |   15.77    |  11.56    |  15.96       |  19.88

 sgd-lr-0.008-c-a-b-r            |    6.82       |   11.84    |  10.70    |  10.22       |  15.78

 sgd-lr-0.008-c-a-b-r-s          |    7.33       |   15.12    |  12.97    |  13.65       |  10.53

 ng-lr-0.008-c                   |    7.58       |   34.22    |  33.23    |  35.26       |  34.73

 ng-lr-0.008-c-a                 |    7.56       |   11.86    |  15.78    |  17.73       |  21.59

 ng-lr-0.008-c-a-b               |    7.29       |   14.01    |  9.98     |  14.09       |  18.07

 ng-lr-0.008-c-a-b-r             |    6.70       |   11.46    |  10.05    |  9.50        |  14.93

 ng-lr-0.008-c-a-b-r-s           |    6.91       |   14.09    |  12.38    |  13.33       |  9.88


Next week:

1.Add the experiments of NG into the technical report