Lectures
Subject to change.
| Date |
Topics |
Readings |
Optional Advanced Readings |
| Fundamentals of supervised and unsupervised learning |
| Tu Aug 30 |
Introduction to Computational Linguistics |
|
| Th Sep 1 |
Text classification, Bag of words, Naive Bayes |
|
| Tu Sep 6 |
Supervised classification continued: perceptron |
SLP sections 7.1 and 7.4 (Optional: CIML Chap 3) |
| Th Sep 8 |
Supervised classification: Logistic Regression |
|
| Tu Sep 13 |
Word Sense Disambiguation |
|
WSD Survey (Navigli 2009) |
| Th Sep 15 |
Unsupervised Learning, Expectation Maximization |
|
Collins' notes |
| Sequences |
| Tu Sep 20 |
Language Modeling, n-grams |
SLP chap 4 |
(Chen and Goodman 1998), esp. Kneser-Ney smoothing section |
| Th Sep 22 |
Neural Language Models |
Kyunghung Cho's lecture notes Sections 5.4-5.6 |
| Th Sep 29 |
FSTs and Morphology |
Bender Ch2, David Chiang notes on FSA/FSTs5.7 and 6.3 |
| Tu Oct 4 |
POS tagging and HMMs |
SLP 3, Ch8 and Ch9 (9.1-9.4) |
| Th Oct 6 |
HMMs and structured perceptron |
|
(Collins 2002) |
| Tu Oct 11 |
Exam 1 |
|
| Trees |
Th Oct 13 |
Syntax and Grammars |
|
Bender Ch7 |
| Tu Oct 18 |
PCFGs |
Collins' notes |
|
| Th Oct 20 |
Dependency Parsing |
Kuebler et al. Ch2 |
McDonald and Nivre 2007 |
| Tu Oct 25 |
More Dependency Parsing |
Kuebler et al. Ch3 |
Goldberg and Nivre 2012 |
| Meaning |
| Th Oct 27 |
Computational Semantics, Compositionality |
Levy's notes |
|
| Tu Nov 1 |
Marine at EMNLP; work on P2! |
|
| Th Nov 3 |
More Compositional Semantics and Semantic Role Labeling |
SLP3 ch22 |
|
| Tu Nov 8 |
Lexical Semantics, Distributional Semantics |
SLP3 ch15 |
Turney and Pantel 2010 |
| Th Nov 10 |
Lexical Semantics, Dense Word Representations, Review (see Nov 8 for slides) |
SLP3 ch16 |
Levy and Goldberg 2014 |
| Tu Nov 15 |
Exam 2 |
|
| Application: Semantic Textual Similarity / Textual Inference |
| Th Nov 17 |
Alignment in Machine Translation |
|
Collins's notes |
| Tu Nov 22 |
Semantic Textual Similarity, more alignment |
|
STS16 |
| Th Nov 24 |
Happy Thanksgiving! |
|
|
| Tu Nov 29 |
Neural seq2seq models, attention (NMT tutorial parts 2 & 3) |
|
BahdanauEtAl2014,Cho (Chap 6) |
| Th Dec 1 |
Lexical and Textual Entailment |
|
|
| Tu Dec 6 |
Perspectives and Social Impact |
|
Levesque13,Halevy09,Hovy16 |
| Th Dec 8 |
P3 office hour in AVW3126 during lecture time |
|
|
Web Accessibility