“第十七章 深度学习”版本间的差异

来自cslt Wiki
跳转至: 导航搜索
高级读者
 
(相同用户的14个中间修订版本未显示)
第3行: 第3行:
 
*[[教学参考-17|教学参考]]
 
*[[教学参考-17|教学参考]]
 
*[http://aigraph.cslt.org/courses/17/course-17.pptx 课件]
 
*[http://aigraph.cslt.org/courses/17/course-17.pptx 课件]
*小清爱提问:什么是深度学习(上)?[https://mp.weixin.qq.com/s?__biz=Mzk0NjIzMzI2MQ==&mid=2247487252&idx=1&sn=b3dac3e2afbe2b7ebff901ba358ee3e0&chksm=c30805d6f47f8cc02d8a284fb416c7767f815861f3656a605378bbf6caf718f11191637b81de&scene=178#rd
+
*小清爱提问:什么是深度学习(上)?[https://mp.weixin.qq.com/s?__biz=Mzk0NjIzMzI2MQ==&mid=2247487252&idx=1&sn=b3dac3e2afbe2b7ebff901ba358ee3e0&chksm=c30805d6f47f8cc02d8a284fb416c7767f815861f3656a605378bbf6caf718f11191637b81de&scene=178#rd]
]
+
*小清爱提问:什么是深度学习(下)?[https://mp.weixin.qq.com/s?__biz=Mzk0NjIzMzI2MQ==&mid=2247487260&idx=1&sn=c6ee1b8e09fcec9d9dfc96ddd06d874f&chksm=c30805def47f8cc8498b5c77c0ad720b45f02e78126fe9ed06e0a4465d3a970874b229692f29&scene=178#rd]
*小清爱提问:什么是深度学习(下)?[https://mp.weixin.qq.com/s?__biz=Mzk0NjIzMzI2MQ==&mid=2247487260&idx=1&sn=c6ee1b8e09fcec9d9dfc96ddd06d874f&chksm=c30805def47f8cc8498b5c77c0ad720b45f02e78126fe9ed06e0a4465d3a970874b229692f29&scene=178#rd
+
]
+
  
 
==扩展阅读==
 
==扩展阅读==
  
 
+
*AI100问:什么是深度学习?[http://aigraph.cslt.org/ai100/AI-100-48-什么是深度学习.pdf]
 +
*维基百科:深度学习 [http://aigraph.cslt.org/courses/17/深度学习.pdf][http://aigraph.cslt.org/courses/17/Deep_learning.pdf]
 +
*维基百科:杰弗里·辛顿 [http://aigraph.cslt.org/courses/17/杰弗里·辛顿.pdf][http://aigraph.cslt.org/courses/17/Geoffrey_Hinton.pdf]
 +
*维基百科:约书亚·本希奥 [http://aigraph.cslt.org/courses/17/约书亚·本希奥.pdf][http://aigraph.cslt.org/courses/17/Yoshua_Bengio.pdf]
 +
*维基百科:杨立昆 [http://aigraph.cslt.org/courses/17/杨立昆.pdf][http://aigraph.cslt.org/courses/17/Yann_LeCun.pdf]
 +
*维基百科:通用近似定理[http://aigraph.cslt.org/courses/17/Universal_approximation_theorem.pdf][http://aigraph.cslt.org/courses/17/通用近似定理.pdf]
  
 
==视频展示==
 
==视频展示==
 +
 +
*VGG Net visualization [http://aigraph.cslt.org/courses/17/VGG16.mp4]
 +
*Disclaimer CNN 展示 [http://aigraph.cslt.org/courses/16/CNN_visulization.mp4]
  
 
==演示链接==
 
==演示链接==
 +
 
* ConvNetJS 深度神经网络演示 [https://cs.stanford.edu/people/karpathy/convnetjs/]
 
* ConvNetJS 深度神经网络演示 [https://cs.stanford.edu/people/karpathy/convnetjs/]
* ConvNetJS 代码 [https://github.com/karpathy/convnetjs]
 
 
* Leiden  Demo for image classification [http://destiny.liacs.nl/]
 
* Leiden  Demo for image classification [http://destiny.liacs.nl/]
 
* CNN explainer[https://poloclub.github.io/cnn-explainer/]
 
* CNN explainer[https://poloclub.github.io/cnn-explainer/]
* 可解释机器学习 [https://poloclub.github.io/]
 
 
 
* Quick style transfer [https://tenso.rs/demos/fast-neural-style/]
 
* Quick style transfer [https://tenso.rs/demos/fast-neural-style/]
 
* Pix2Pix[https://affinelayer.com/pixsrv/]
 
* Pix2Pix[https://affinelayer.com/pixsrv/]
 
* AutoWriter[https://cyborg.tenso.rs/]
 
* AutoWriter[https://cyborg.tenso.rs/]
 
+
* HoggingFace 演示[https://www.kdnuggets.com/2022/05/top-10-machine-learning-demos-hugging-face-spaces-edition.html]
 +
* CNN visualization [https://distill.pub/2017/feature-visualization/]
  
 
==开发者资源==
 
==开发者资源==
  
*Google developer courses [https://developers.google.com/machine-learning/crash-course?hl=zh-cn]
+
*Georgia Tech, Polo Club (可解释机器学习) [https://poloclub.github.io/]
 +
*Google developer courses [*][https://developers.google.com/machine-learning/crash-course?hl=zh-cn]
 +
*ConvNetJS 代码 [https://github.com/karpathy/convnetjs]
  
 
==高级读者==
 
==高级读者==
  
* Fukushima, Kunihiko (1980). "Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position" [https://www.cs.princeton.edu/courses/archive/spr08/cos598B/Readings/Fukushima1980.pdf]
+
* LeCun Y, Bengio Y, Hinton G. Deep learning[J]. nature, 2015, 521(7553): 436-444.[https://s3.us-east-2.amazonaws.com/hkg-website-assets/static/pages/files/DeepLearning.pdf]
* Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, L. D. Jackel, Backpropagation Applied to Handwritten Zip Code Recognition; AT&T Bell Laboratories [http://yann.lecun.com/exdb/publis/pdf/lecun-89e.pdf]
+
* Krizhevsky A, Sutskever I, Hinton G E. Imagenet classification with deep convolutional neural networks[J]. Advances in neural information processing systems, 2012, 25. [https://proceedings.neurips.cc/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf]
* Hopfield, J. J. (1982). "Neural networks and physical systems with emergent collective computational abilities". Proceedings of the National Academy of Sciences. 79 (8): 2554–2558. [https://www.ncbi.nlm.nih.gov/pmc/articles/PMC346238]
+
* Hinton G E, Salakhutdinov R R. Reducing the dimensionality of data with neural networks[J]. science, 2006, 313(5786): 504-507. [https://asset-pdf.scinapse.io/prod/2100495367/2100495367.pdf]
* Elman, Jeffrey L. (1990). "Finding Structure in Time". Cognitive Science. 14 (2): 179–211. [https://doi.org/10.1016%2F0364-0213%2890%2990002-E]
+
* Hinton G E, Osindero S, Teh Y W. A fast learning algorithm for deep belief nets[J]. Neural computation, 2006, 18(7): 1527-1554. [https://www.cs.utoronto.ca/~hinton/absps/ncfast.pdf]
* Jordan, Michael I. (1997-01-01). "Serial Order: A Parallel Distributed Processing Approach". Neural-Network Models of Cognition - Biobehavioral Foundations. Advances in Psychology. Neural-Network Models of Cognition. Vol. 121. pp. 471–495.  [https://doi.org/10.1016%2Fs0166-4115%2897%2980111-2]
+
* Universal approximation theorem [*][https://medium.com/analytics-vidhya/neural-networks-and-the-universal-approximation-theorem-e5c387982eed]
* Hinton, G. E., & Zemel, R. S. (1994). Autoencoders, minimum description length and Helmholtz free energy. In Advances in neural information processing systems 6 (pp. 3-10). [https://proceedings.neurips.cc/paper/1993/file/9e3cfc48eccf81a0d57663e129aef3cb-Paper.pdf]
+
 
* 王东,机器学习导论,第三章,神经模型,2021,清华大学出版社 [http://mlbook.cslt.org]
 
* 王东,机器学习导论,第三章,神经模型,2021,清华大学出版社 [http://mlbook.cslt.org]
* Christopher M. Bishop, Neural Networks for Pattern Recognition [https://www.amazon.com/Networks-Recognition-Advanced-Econometrics-Paperback/dp/0198538642]
+
* Ian Goodfellow and Yoshua Bengio and Aaron Courville, Deep Learning [https://www.deeplearningbook.org/]
* Christopher M. Bishop, Pattern Recognition and Machine Learning [https://www.amazon.com/-/es/Christopher-M-Bishop/dp/0387310738/ref=d_pd_sbs_sccl_3_3/143-3751675-4420139?pd_rd_w=2LB2s&content-id=amzn1.sym.3676f086-9496-4fd7-8490-77cf7f43f846&pf_rd_p=3676f086-9496-4fd7-8490-77cf7f43f846&pf_rd_r=XM3AJDN6MSM89CR1ZFV7&pd_rd_wg=QjVJC&pd_rd_r=10293f3a-8b44-4f6d-b6ee-9595387e2f18&pd_rd_i=0387310738&psc=1]
+

2023年8月13日 (日) 01:43的最后版本

教学资料

  • 教学参考
  • 课件
  • 小清爱提问:什么是深度学习(上)?[1]
  • 小清爱提问:什么是深度学习(下)?[2]

扩展阅读

  • AI100问:什么是深度学习?[3]
  • 维基百科:深度学习 [4][5]
  • 维基百科:杰弗里·辛顿 [6][7]
  • 维基百科:约书亚·本希奥 [8][9]
  • 维基百科:杨立昆 [10][11]
  • 维基百科:通用近似定理[12][13]

视频展示

  • VGG Net visualization [14]
  • Disclaimer CNN 展示 [15]

演示链接

  • ConvNetJS 深度神经网络演示 [16]
  • Leiden Demo for image classification [17]
  • CNN explainer[18]
  • Quick style transfer [19]
  • Pix2Pix[20]
  • AutoWriter[21]
  • HoggingFace 演示[22]
  • CNN visualization [23]

开发者资源

  • Georgia Tech, Polo Club (可解释机器学习) [24]
  • Google developer courses [*][25]
  • ConvNetJS 代码 [26]

高级读者

  • LeCun Y, Bengio Y, Hinton G. Deep learning[J]. nature, 2015, 521(7553): 436-444.[27]
  • Krizhevsky A, Sutskever I, Hinton G E. Imagenet classification with deep convolutional neural networks[J]. Advances in neural information processing systems, 2012, 25. [28]
  • Hinton G E, Salakhutdinov R R. Reducing the dimensionality of data with neural networks[J]. science, 2006, 313(5786): 504-507. [29]
  • Hinton G E, Osindero S, Teh Y W. A fast learning algorithm for deep belief nets[J]. Neural computation, 2006, 18(7): 1527-1554. [30]
  • Universal approximation theorem [*][31]
  • 王东,机器学习导论,第三章,神经模型,2021,清华大学出版社 [32]
  • Ian Goodfellow and Yoshua Bengio and Aaron Courville, Deep Learning [33]