These abbreviations are used in the following assignments:
| Date | Lecture Topics | Assigned Readings |
|---|---|---|
| 9/2 |
How the Brain Computes (Lecture Slides) |
G. Fischbach: Mind and Brain, Scientific American, Sept 1992, 48 - 57 (pdf) |
| 9/4 |
Learning
(Lecture Slides) Neural Computation (Slides) |
Mehrotra, Chap. 1 Demuth, Chap. 1 and 2 |
| 9/9 |
Logical Neurons Perceptron Basics (Lecture Slides) Matlab Assignments |
Griffith J, Mathematical Neurobiology, 1971, 29-32
(pdf) Mehrotra, Sects. 2.1, 2.2 (see Useful Links off class page) |
| 9/11 |
Neural Network Toolbox Perceptron Properties |
Demuth, Chap. 3 (Assignment 1 out; due 11 AM 9/25) |
| 9/16 |
Perceptron Properties Perceptron Learning |
Mehrotra, Sects. 2.3-2.5.1 |
| 9/18 |
Perceptrons: Practical Issues Linear Associative Memory (Lecture Slides) LMS Learning Preliminaries |
Mehrotra Sect. 2.5.2-2.6 |
| 9/23 |
LMS Rule Hebb's Rule |
Demuth 4.1-8, 4.13-19 Mehrotra pp. 217-222 (Assignment 2 out; due 11 AM 10/2) |
| 9/25 |
Linear Nets (concluded) Error Backpropagation (Lecture Slides) |
Mehrotra Sects. 3.1-3.3 Rumelhart et al: Learning Representations by BackPropagating Errors, Nature, 329, 1986, 533-6 (pdf) |
| 9/30 |
Review Assignment 1 EBP Derivation Representation (Lecture Slides) |
Mehrotra, Sects. 3.4 - 3.5 (omit 3.5.3) |
| 10/2 |
EBP in Practice EBP Learning Variations |
Demuth, 5.1-5.22 Reidmiller, RPROP Algorithm, Proc. ICNN, 1993, 586 - 591 (pdf) (Assignment 3 out; due 10/16 and 10/19) |
| 10/7 |
Review Assignment 2 EBP Issues and Variations |
Mehrotra, Sects. 4.3.2, 4.5, 4.6 |
| 10/9 |
Data Separation, Regularization EBP Applications (Lecture Slides) |
Mehrotra, Sects. 3.7, 3.8 Pazzani M & Dyer M, Concept Identification, Proc. 10th IJCAI, 1987, 147-150 (pdf) |
| 10/14 |
Hidden Layer Analysis (Lecture Slides) Dynamic Architectures (Lecture Slides) RBF Networks |
Mehrotra, Sects. 4.2-4.2.2, 4.2.5 Mehrotra, Sect. 4.4 |
| 10/16 | RBF Networks | see above |
| 10/21 |
Review Assignment 3 - end of midterm topics - Recurrent Networks Neurobiological Circuits Associative Networks (Lecture Slides) |
- end of midterm readings - Douglas R & Martin K. Recurrent Neuronal Circuits in the Neocortex, Current Biology, 17, 2007, 496-500. (pdf) Rumelhart D et al. Perceptual Completion, Parallel Distrib. Process., 1986, 20-25. (pdf) McClelland J & Rogers T. PDP Approach to Semantic Cognition, Nature Reviews Neurosci., 4, 2003, 310-315 only, plus Fig. 4. (pdf) |
| 10/23 | MIDTERM EXAM | ---- |
| 10/28 |
Review Midterm Exam Dynamics |
Dynamical Systems: Attractors (html) |
| 10/30 |
Review Assignment 3, Part 2 Dynamical Systems (cont.) (Lecture Slides) Diffeq. Activation Rules Random Logical Neuron Nets (Lecture Slides) |
Randomly Connected Networks, in J. Griffith, Mathematical Neurobiology, Academic Press, 1971, pp. 67-69, 74-75, 82-83. (pdf) |
| 11/4 |
Assignment 4 Discussion Random Logical Neuron Nets Recurrent Linear Networks (Lecture Slides) |
Huberman B and Hogg T. Phase Transitions in AI Systems AI Journal, 33, 1987, 155-171 (omit Sect. 2 and Sect. 3.3) (pdf) (Assignment 4 out; due 11 AM, 11/13) |
| 11/6 |
Role/Types Inhibition Unsupervised Learning (Lecture Slides) Oja's Rule Competitive Learning |
Mehrotra, 157-164 Hertz, One Linear Unit, Intro. to Theory of Neural Computation, 1991, 199-202 (pdf) |
| 11/11 |
Competitive Learning (Lecture Slides) |
Mehrotra, 164-170 |
| 11/13 |
SOM: biol. inspiration (Lecture Slides) Iterative, Multi-Winner SOM (Lecture Slides) One Step, Single Winner SOM |
von der Malsburg C: Self-Organization of Orientation Sensitive Cells ..., Kybernetik, 14, 1973, 85-100 (pdf) |
| 11/18 |
Review Assignment 4 Assignment 5 Discussion One Step, Single Winner SOM SOM: Theory and Practice (Lecture Slides) |
Mehrotra, 188-197 Demuth, 9.9-9.29 (Assignment 5 out; due 11 AM, 12/2) |
| 11/20 |
Dynamic Network Construction (Lecture Slides: see last class) Other Competitive Learning (Lecture Slides) Energy-Minimizing Networks (Lecture Slides) |
Mehrotra, Sects. 5.2, 5.6 Carpenter G & Grossberg S: Massively Parallel Architecture ..., Computer Vision, Graphics and Image Processing, 37, 1987, 54-75 only. (pdf) |
| 11/25 |
Hopfield Networks |
Mehrotra, pp. 227-241 Hopfield J. Neural Networks ... with Collective Computational Abilities, PNAS, 79, 1982, 2554-2558. (pdf) (Assignment 6 out; due 11 AM, 12/9) |
| 11/27 | No Class (University Closed) | ------- |
| 12/2 |
Hopfield Networks (cont.) Stochastic Versions |
Mehrotra, Sect. 7.3 |
| 12/4 |
Review Assignment 5 (Lecture Slides) Stochastic Hopfield Nets (Lecture Slides) Simulated Annealing Continuous-Valued Networks |
Kirkpatrick S et al: Optimization by Simulated Annealing, Science, 220, 1983, 671-680 (pdf) The next paper is a reference (not assigned): Hopfield J and Tank D: Neural ... Optimization, Biological Cybernetics, 52, 1985, 141-152. (pdf) |
| 12/9 |
SOM's for Optimization (Lecture Slides) Recurrent EBP (Lecture Slides) Echo State Networks (Lecture Slides) |
Angeniol B et al: SOM's and TSP,
Neural Networks, 1, 1988, 289-293
(pdf) Jaeger H & Haas H, Harnessing Nonlinearity, Science, 304, 2004, 78-80 (pdf) Tong M et al, Learning Grammatical Structure ..., Neural Networks, 20, 2007, 424-432 (pdf) |
| 12/11 |
Review Assignment 5 (Lecture Slides) Neural Oscillators (Lecture Slides) Phase-Coupled Oscillators Wrap-Up |
Kimura H et al, Dynamic Walking ... Using Neural Oscillators, Autonomous Robots, 7, 1999, 247-258 (pdf) The next paper is a reference (not assigned): Wang D, Emergent Synchrony ..., IEEE Trans. Neural Networks, 6, 1995, 941-948 (pdf) |
| 12/15 | 8 AM: FINAL EXAM | ------- |