Schedule
| Date |
Topics |
Readings |
| M Aug 26 |
Introduction |
none |
|
Words, Context and Meaning (and Fundamentals of Machine Learning) |
|
| W Aug 28 |
Distributional Semantics |
SLP3 6.2-6.5 |
| M Sep 2 |
No class (Labor Day) |
|
| W Sep 4 |
Word Sense Disambiguation |
SLP3 19.1-19.4,19.6.1 |
| M Sep 9 |
The Perceptron Classifier |
CIML 4 |
| W Sep 11 |
Logistic Regression |
SLP3 5 |
| M Sep 16 |
Neural Networks |
NMT 13.2 |
| W Sep 18 |
Computation Graphs and Backpropagation |
NMT 13.3 |
| M Sep 23 |
N-gram Language Models |
SLP3 |
| W Sep 25 |
Neural Language Models |
NMT 13.4-13.4.2 |
| M Sep 30 |
Review and Q&A |
|
| W Oct 2 |
Dense Word Embeddings |
SLP3 6.8-6.11 |
| M Oct 7 |
Midterm Exam |
|
|
Neural Machine Translation |
|
| W Oct 9 |
Machine Translation and its Evaluation |
BLEU paper |
| M Oct 14 |
Recurrent Language Models |
NMT 13.4.4-13.4.6,SLP3 9 |
| W Oct 16 |
Encoder-Decoder Models, Beam Search |
NMT 13.5.1,13.5.4 |
| M Oct 21 |
Attention Models |
NMT 13.5.2,13.5.3 |
| W Oct 23 |
Refinements: Subwords |
NMT 13.6.1-13.6.4 SLP3 2.4.3 |
| M Oct 28 |
Refinements: Multilingual and Multi-Task Learning |
NMT 13.6.9 |
| W Oct 30 |
No lecture; Exam Solution Review |
|
| M Nov 4 |
Refinements: Semi-supervised and Unsupervised Learning |
|
| W Nov 6 |
Other research topics in NMT |
|
|
Linguistic Structure Prediction |
|
| M Nov 11 |
Sequence Labeling, POS Tagging |
SLP3 8.1-8.3 |
| W Nov 13 |
Structured Perceptron, Viterbi Algorithm |
CIML 17.2,17.3,17.7 |
| M Nov 18 |
More Sequence Labeling and Intro to Syntax |
CIML 17.6, SLP3 12-12.1 |
| W Nov 20 |
Transition-Based Dependency Parsing |
SLP3 15-15.4.1 |
| M Nov 25 |
Transition-Based and Graph-Based Dependency Parsing |
SLP3 15.4.2-15.5 |
| W Nov 27 |
No class (Thanksgiving) |
|
| M Dec 2 |
Graph-based Dependency Parsing and Constituency Parsing |
SLP3 13-13.2 |
| W Dec 4 |
Review and Perspectives |
|
| M Dec 9 |
Final Exam Prep Q&A |
|
| F Dec 13 |
Final Exam (1:30–3:30pm) |
|
Slides are linked after each lecture.