第十六章 典型网络结构

教学资料

• 教学参考
• 课件
• 小清爱提问：什么是卷积神经网络？[1]
• 小清爱提问：什么是循环神经网络？[2]

扩展阅读

• AI100问：什么是卷积神经网络？[3]
• AI100问：什么是循环神经网络？[4]
• AI100问：什么是自编码器？[5]
• 维基百科：多层感知器[6][7]
• 维基百科：卷积神经网络[8][9]
• 维基百科：循环神经网络[10][11]
• 维基百科：自编码器[12][13]
• 机器之心：卷积神经网络 [14]
• 机器之心：一文简述循环神经网络[15]
• 量子位：什么是自编码器 [16]

视频展示

• 全连接网络展示 [17]
• 全连接层展示 [18]
• Disclaimer CNN 展示 [19]
• CNN_Otavio_Good 的CNN展示 [20]
• 知多少：什么是循环神经网络[21]
• 知多少：什么是卷积神经网络[22]

演示链接

• Andrej Karpathy's CNN demo [23]
• Neural Net demo [24]
• Neural Net training demo [25]
• Quick draw, and let NN guess [26]

开发者资源

• Python package for neural nets: PyTorch [27] TensorFlow[28] NeuralLab[29]

高级读者

• Fukushima, Kunihiko (1980). "Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position" [30]
• Y. LeCun, B. Boser, J. S. Denker, D. Henderson, R. E. Howard, W. Hubbard, L. D. Jackel, Backpropagation Applied to Handwritten Zip Code Recognition; AT&T Bell Laboratories [31]
• Hopfield, J. J. (1982). "Neural networks and physical systems with emergent collective computational abilities". Proceedings of the National Academy of Sciences. 79 (8): 2554–2558. [32]
• Elman, Jeffrey L. (1990). "Finding Structure in Time". Cognitive Science. 14 (2): 179–211. [33]
• Jordan, Michael I. (1997-01-01). "Serial Order: A Parallel Distributed Processing Approach". Neural-Network Models of Cognition - Biobehavioral Foundations. Advances in Psychology. Neural-Network Models of Cognition. Vol. 121. pp. 471–495. [34]
• Hinton, G. E., & Zemel, R. S. (1994). Autoencoders, minimum description length and Helmholtz free energy. In Advances in neural information processing systems 6 (pp. 3-10). [35]
• 王东，机器学习导论,第三章，神经模型，2021,清华大学出版社 [36]
• Christopher M. Bishop, Neural Networks for Pattern Recognition [37]
• Christopher M. Bishop, Pattern Recognition and Machine Learning [38]