Class Schedule and Reading List

ComS 401: Projects in Computing
Instructor: Alexander Stoytchev


NOTE: This schedule may change depending on various factors.

INTRODUCTION (1 week)

Overview of the class

Intro to Computational Perception

• Deb Roy, Rupal Patel, Philip DeCamp, Rony Kubat, Michael Fleischman, Brandon Roy, Nikolaos Mavridis, Stefanie Tellex, Alexia Salata, Jethran Guinness, Michael Levit, Peter Gorniak. (2006). The Human Speechome Project. To appear in the Proceedings of the 28th Annual Cognitive Science Conference.
• Kidd, Cory D., Robert J. Orr, Gregory D. Abowd, Christopher G. Atkeson, Irfan A. Essa, Blair MacIntyre, Elizabeth Mynatt, Thad E. Starner and Wendy Newstetter (1999). "The Aware Home: A Living Laboratory for Ubiquitous Computing Research," In the Proceedings of the Second International Workshop on Cooperative Buildings.


TUTORIALS AND BACKGROUND MATERIAL (1 week)

Alex's Matlab Tutorial

OpenCV Tutorial

Review of Probability and Linear Algebra


BASIC IMAGE PROCESSING (2 weeks)

Mathematical Morphology

• Jain, Kasturi, and Schunck (1995). Machine Vision, ``Chapter 2: Binary Image Processing,'' McGraw-Hill, pp. 25-72.
• Haralick and Shapiro (1993). Computer and Robot Vision, "Chapter 5: Mathematical Morphology," Addison-Wesley.

Image Filtering

• Jain, Kasturi, and Schunck (1995). Machine Vision, ``Chapter 4: Image Filtering,'' McGraw-Hill, pp. 112-139.
• Burt and Adelson (1983). ``The Laplacian Pyramid as a Compact Image Code,'' IEEE Transactions on Communications, vol. 31(4), pp. 532-540.


COLOR AND MOVEMENT (1 week)

Color and Skin detection

• Yang, Lu, and Waibel (1997). ``Skin-color modeling and adaptation'', CMU-CS-97-146, May 1997.

Motion Energy and Motion History

• A. F. Bobick and J.W. Davis. ``An apearance-based representation of action''. In Proceedings of IEEE International Conference on Pattern Recognition 1996, August 1996, pp. 307-312.
• Davis, J. and A. Bobick (1997). ``The Representation and Recognition of Action Using Temporal Templates'', In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, June 1997, pp. 928-934.


OVERVIEW OF DIFFERENT SENSORS (1 week)

TBD


IMMERSIVE VR ENVIRONMENTS (1 week)

TBD


FACE DETECTION AND RECOGNITION (1 week)

Cascades

• Paul Viola and Michael Jones (2001). ``Robust Real-time Object Detection'', Second International Workshop on Statistical and Computational Theories of Vision Modeling, Learning, Computing, and Sampling, Vancouver, Canada, July 13, 2001.

Eigenfaces

• M. Turk and A. Pentland (1991). ``Eigenfaces for recognition''. Journal of Cognitive Neuroscience, 3(1).
• Dana H. Ballard (1999). ``An Introduction to Natural Computation (Complex Adaptive Systems)'', Chapter 4, pp 70-94, MIT Press.


PRELIMINARY PROJECT PRESENTATIONS (1 week)

No readings


SPEECH RECOGNITION (1 week)

• Rabiner, Lawrence, and Juang (1993). ``Theory and Implementation of Hidden Markov Models'', Chapter 6 in Fundamentals of Speech Recognition, Prentice-Hall, pp. 321-389.
• (Optional reading) Rabiner, L. R. (1989). ``A tutorial on hidden Markov models and selected applications in speech recognition''. Proceedings of the IEEE, 77(2):257-- 286.
• (Optional reading) L. R. Rabiner and B. H. Juang. ``An introduction to hidden Markov models''. IEEE ASSP Magazine, 3(1):4--16, January 1986.


TOPIC TO BE DETERMINED (1 week)






TRACKING TECHNIQUES (1 week)

Kalman Filter

• Maybeck, Peter S. (1979). Chapter 1 in ``Stochastic models, estimation, and control'',Mathematics in Science and Engineering Series, Academic Press.
• Greg Welch and Gary Bishop (2001). SIGGRAPH 2001 Course: ``An Introduction to the Kalman Filter''.

Particle Filters

• F. Dellaert, D. Fox, W. Burgard, and S. Thrun (1999). "Monte Carlo Localization for Mobile Robots", IEEE International Conference on Robotics and Automation (ICRA99), May, 1999.
• Ioannis Rekleitis (2004). A Particle Filter Tutorial for Mobile Robot Localization. Technical Report TR-CIM-04-02, Centre for Intelligent Machines, McGill University, Montreal, Quebec, Canada.


GESTURE RECOGNITION (1 lecture)

• Stefan Waldherr, Roseli Romero, Sebastian Thrun (2000). ``A Gesture Based Interface for Human-Robot Interaction'', Autonomous Robots, Volume 9, Issue 2, September 2000, pp. 151 - 173.
• Thad Starner and Alex Pentland (1996) "Real-Time American Sign Language Recognition from Video Using Hidden Markov Models" PAMI July 1997.
• Tanawongsuwan, R., Stoytchev, A., and Essa, I. (1999). "Robust Tracking of People by a Mobile Robotic Agent", Technical Report GIT-GVU-99-19.


HANDWRITING RECOGNITION (1 lecture)

• Larry Yaeger, Brandyn Webb, and Richard Lyon (1998). "Combining Neural Networks and Context-Driven Search for On-Line, Printed Handwriting Recognition in the Newton", Spring 1998 issue of AAAI's AI Magazine.
• Larry Yaeger, Richard Lyon, and Brandyn Webb (1996). "Effective Training of a Neural Network Character Classifier for Word Recognition", NIPS 1996.
• MacKenzie and Zhang (1997). "The Immediate Usability of Graffiti", Graphics Interface 1997, pp. 29-137.


TOPIC TO BE DETERMINED (1 week)






THANKSGIVING BREAK (1 week)






AFFECTIVE COMPUTING (1 week)

• Rosalind W. Picard (1997). ``Affective Computing'', MIT Press.
• Rosalind W. Picard (1995). ``Affective Computing'', MIT Media Lab TR-321, November 1995 (abbreviated version of the book).
• A. R. Demasio (1994). ``Descartes' Error: Emotion, Reason and the Human Brain'',New York: Gosset/Putnam Press (excerpt).


FINAL PROJECT PRESENTATIONS (1 week)


TOTAL: 16 weeks