Schedule and Slides
| Date |
Topics |
Readings |
| Tu Aug 28 |
Introduction to Computational Linguistics |
|
| Word Meaning and Machine Learning Fundamentals |
| Tu Aug 30 |
Distributional Semantics |
SLP3 6.2-6.5 |
| Tu Sep 4 |
Word Sense Disambiguation |
SLP3 19.1-19.4,19.6.1 |
| Th Sep 6 |
Linear Models, Naive Bayes |
NLP 2-2.1.3 |
| Tu Sep 11 |
Perceptron |
NLP 2.2 |
Th Sep 13 |
Logistic Regression |
NLP 2.3 (up to 2.3.1 header) - 2.4 |
| Tu Sep 18 |
Logistic regression, Loss Functions, Neural Networks |
NLP 2.3 (up to 2.3.1 header) - 2.4 |
Th Sep 20 |
Neural Networks: Computation Graphs, Backpropagation |
NLP 3.1-3.3 |
Tu Sep 25 |
Review |
|
| Th Sep 27 |
Midterm 1 |
|
| Sequence Models |
| Tu Oct 2 |
N-gram Language Models |
SLP3 Ch. 3 |
Th Oct 4 |
Feedforward Neural Language Models |
SLP3 7.5 |
| Tu Oct 9 |
Word Embeddings |
SLP3 6.8-6.9 |
Th Oct 11 |
P1 lab |
|
| Tu Oct 16 |
Recurrent Neural Language Models |
SLP3 9 |
Th Oct 18 |
POS tagging and Sequence Labeling |
SLP3 8.1-8.3 |
| Tu Oct 23 |
Structured Perceptron, Viterbi |
CIML 17.2,17.3,17.7 |
Th Oct 25 |
Loss-augmented Structured Prediction |
CIML 17.4-17.6 |
| Tu Oct 30 |
Catch-up and Review |
|
Th Nov 1 |
Midterm 2 |
|
Machine Translation |
| Tu Nov 6 |
History and Evaluation |
|
| Th Nov 8 |
No class |
|
| Tu Nov 13 |
Encoder-decoder models, beam search |
Neubig (Section 7-7.3.1) |
| Th Nov 15 |
Attention Models |
Neubig (Section 8) |
| Tu Nov 20 |
Multilingual Models and Open Research Questions |
|
| Th Nov 22 |
Thanksgiving |
|
| Trees |
| Tu Nov 27 |
Syntax, Trees, Parsing |
SLP3 13-13.3 |
| Th Nov 29 |
Transition-based Dependency Parsing |
SLP3 13.4 |
| Tu Dec 4 |
Graph-based Dependency Parsing |
SLP3 13.5 |
| Th Dec 6 |
Review and Perspectives |
|
| Sa Dec 15 |
Final Exam (10:30am-12:30pm) |
|