Sequence Model References(feat. Coursera Andrew Ng)

 

W​eek 1:

• Minimal character-level language model with a Vanilla Recurrent Neural Network, in Python/numpy (GitHub: karpathy)
• The Unreasonable Effectiveness of Recurrent Neural Networks (Andrej Karpathy blog, 2015)
• d​eepjazz (GitHub: jisungk)
• Learning Jazz Grammars (Gillick, Tang & Keller, 2010)
• A Grammatical Approach to Automatic Improvisation (Keller & Morrison, 2007)
• Surprising Harmonies (Pachet, 1999)

W​eek 2:

• Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings (Bolukbasi, Chang, Zou, Saligrama​ & Kalai, 2016)
• GloVe: Global Vectors for Word Representation (Pennington, Socher & Manning, 2014)
• W​oebot.

W​eek 4:

• Natural Language Processing Specialization (by DeepLearning.AI)
• Attention Is All You Need (Vaswani, Shazeer, Parmar, Uszkoreit, Jones, Gomez, Kaiser​ & Polosukhin, 2017)