Syllabus for CS/EECE 547

1. Aug 20
   intro.
   Three paths to Neural Networks:
   • biology / neuroscience
   • psychology / cognitive science
   • engineering / statistics
   Neuroscience:
   • Real neurons are very slow but the brain is fast.
   • Other interesting properties of the nervous system.
   • Neurons come in many shapes but share many common features.
2. Aug 22
   batch and online linear regression. input space, weight space.
3. Aug 27
   linear discrimination, discrimination surface, perceptron learning rule (assignment one)
4. Aug 29
5. generalization: cross validation
6. backpropagation
7. Q: when will linear decision surface be optimal? A: requires probabilistic framework and Bayes rule.
8. gaussian mixture models
9. Asymptotic analysis of deterministic simple gradient descent
10. convolutional networks
11. weight sharing
13. competitive learning
15. Boltzmann machines
16. Helmholtz machines