8.6 New types of neural network models and learning (e.g., new variants of DNN, CNN)

Ying Zhang et al. Towards End-to-End Speech Recognition with Deep Convolutional Neural Networks

ICLR2017: OUTRAGEOUSLY LARGE NEURAL NETWORKS: THE SPARSELY-GATED MIXTURE-OF-EXPERTS LAYER

lightRNN from microsoft