HCI 575 X (ComS 575 X): Computational Perception

Class Schedule and Reading List

HCI 575 X (ComS 575 X): Computational Perception
Instructor: Alexander Stoytchev

NOTE: This schedule may change depending on various factors.

INTRODUCTION (1 week)

Overview of the class

Intro to Computational Perception

``2001: HAL's Legacy'', PBS Show. The documentary was produced by David Kennard and Michael O'Connell (InCA Productions) and funded by the Alfred P. Sloan Foundation.
Rosenfeld, A. (1997). ``Eyes for Computers: How HAL could see?'', Chapter 10 in ``HAL's Legacy, 2001's Computer as Dream and Reality'', Stork, D. (Editor), MIT Press.
Irfan A. Essa (1999). ``Computers Seeing People'', AI Magazine 20(2): pp. 69-82.
(Optional reading) David Stork (1998). ``HAL's Legacy: 2001's computer as dream and reality'', MIT Press.

here.

TUTORIALS AND BACKGROUND MATERIAL (1 week)

Alex's Matlab Tutorial

OpenCV Tutorial

Speech Recognition Packages Tutorial

Review of Probability and Linear Algebra

BASIC IMAGE PROCESSING (2 weeks)

Mathematical Morphology

Jain, Kasturi, and Schunck (1995). Machine Vision, ``Chapter 2: Binary Image Processing,'' McGraw-Hill, pp. 25-72.
Haralick and Shapiro (1993). Computer and Robot Vision, "Chapter 5: Mathematical Morphology," Addison-Wesley.

Image Filtering

Jain, Kasturi, and Schunck (1995). Machine Vision, ``Chapter 4: Image Filtering,'' McGraw-Hill, pp. 112-139.
Burt and Adelson (1983). ``The Laplacian Pyramid as a Compact Image Code,'' IEEE Transactions on Communications, vol. 31(4), pp. 532-540.

COLOR AND MOVEMENT (1 week)

Color and Skin detection

Yang, Lu, and Waibel (1997). ``Skin-color modeling and adaptation'', CMU-CS-97-146, May 1997.

Motion Energy and Motion History

A. F. Bobick and J.W. Davis. ``An apearance-based representation of action''. In Proceedings of IEEE International Conference on Pattern Recognition 1996, August 1996, pp. 307-312.
Davis, J. and A. Bobick (1997). ``The Representation and Recognition of Action Using Temporal Templates'', In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, June 1997, pp. 928-934.

Applications

J. Yang, W. Lu, and A. Waibel (1998). ``A real time face tracker''. In Proceedings of Asian Conference on Computer Vision (ACCV), volume 2, pp. 687-694.
A. Bobick, S. Intille, J. Davis, F. Baird, C. Pinhanez, L. Campbell, Y. Ivanov, A. Schutte, and A. Wilson (1999). ``The Kidsroom: A Perceptually-Based Interactive and Immersive Story Environment", Presence: Teleoperators and Virtual Environments, Vol. 8, No. 4, 1999, pp. 367-391.
J. Davis and A. Bobick (1998). ``Virtual PAT: A Virtual Personal Aerobics Trainer'', Workshop on Perceptual User Interfaces, November 1998, pp. 13-18.

FACE DETECTION AND RECOGNITION (1 week)

Eigenfaces

M. Turk and A. Pentland (1991). ``Eigenfaces for recognition''. Journal of Cognitive Neuroscience, 3(1).
Dana H. Ballard (1999). ``An Introduction to Natural Computation (Complex Adaptive Systems)'', Chapter 4, pp 70-94, MIT Press.

Neural Network-Based Approaches

Henry A. Rowley, Shumeet Baluja and Takeo Kanade (1997). ``Rotation Invariant Neural Network-Based Face Detection,'' Carnegie Mellon Technical Report, CMU-CS-97-201.

Cascades

Paul Viola and Michael Jones (2001). ``Robust Real-time Object Detection'', Second International Workshop on Statistical and Computational Theories of Vision Modeling, Learning, Computing, and Sampling, Vancouver, Canada, July 13, 2001.

TRACKING TECHNIQUES (1.5 weeks)

Kalman Filter

Maybeck, Peter S. (1979). Chapter 1 in ``Stochastic models, estimation, and control'',Mathematics in Science and Engineering Series, Academic Press.
Greg Welch and Gary Bishop (2001). SIGGRAPH 2001 Course: ``An Introduction to the Kalman Filter''.

Particle Filters

F. Dellaert, D. Fox, W. Burgard, and S. Thrun (1999). "Monte Carlo Localization for Mobile Robots", IEEE International Conference on Robotics and Automation (ICRA99), May, 1999.
Ioannis Rekleitis (2004). A Particle Filter Tutorial for Mobile Robot Localization. Technical Report TR-CIM-04-02, Centre for Intelligent Machines, McGill University, Montreal, Quebec, Canada.
Michael Isard and Andrew Blake (1998). ``CONDENSATION -- conditional density propagation for visual tracking'', International Journal of Computer Vision, 29, 1, 5--28.

SPRING BREAK (1 week)

GAZE TRACKING (1 week)

Guest lecture(s) by Derrick Parkhurst

Duchowski, A. T., ``A Breadth-First Survey of Eye Tracking Applications'', Behavior Research Methods, Instruments, & Computers (BRMIC), 34(4), November 2002, pp.455-470.
Li, D., Babcock, J., Parkhurst, D. J. (2006). "openEyes: A low-cost head- mounted eye-tracking solution" Proceedings of the ACM Eye Tracking Research and Applications Symposium.
Li, D., Winfield, D., Parkhurst, D. J. (2005). "Starburst: A hybrid algorithm for video-based eye tracking combining feature-based and model-based approaches". Proceedings of the Vision for Human-Computer Interaction Workshop, IEEE Computer Vision and Pattern Recognition Conference.

SENSING AND SENSORY ORGANIZATION (1 week)

Vision

J. K. O'Regan and A. Noe, (2001). ``A sensorimotor account of vision and visual consciousness'', Behavioral and Brain Sciences, 24(5), 939- 1011.

Sensory Substitution

Andy Clark, (2003). "Who are we?", Ch. 5 in Natural-Born Cyborgs: Minds, Technologies, and the Future of Human Intelligence, Oxford University Press.
P. Bach-y-Rita, C. C. Collins, F. Sauders, B. White, and L. Scadden, (1969), ``Vision substitution by tactile image projection''. Nature, 221, pp. 963-964.
Paul Bach-y-Rita and Stephen W. Kercel (2003). ``Sensory substitution and the human-machine interface'', Trends Cogn Sci, Dec;7(12):541-6.

HIDDEN MARKOV MODELS (1 week)

Rabiner, Lawrence, and Juang (1993). ``Theory and Implementation of Hidden Markov Models'', Chapter 6 in Fundamentals of Speech Recognition, Prentice-Hall, pp. 321-389.
(Optional reading) Rabiner, L. R. (1989). ``A tutorial on hidden Markov models and selected applications in speech recognition''. Proceedings of the IEEE, 77(2):257-- 286.
(Optional reading) L. R. Rabiner and B. H. Juang. ``An introduction to hidden Markov models''. IEEE ASSP Magazine, 3(1):4--16, January 1986.

GESTURE RECOGNITION (1 lecture)

Stefan Waldherr, Roseli Romero, Sebastian Thrun (2000). ``A Gesture Based Interface for Human-Robot Interaction'', Autonomous Robots, Volume 9, Issue 2, September 2000, pp. 151 - 173.
Thad Starner and Alex Pentland (1996) "Real-Time American Sign Language Recognition from Video Using Hidden Markov Models" PAMI July 1997.
Tanawongsuwan, R., Stoytchev, A., and Essa, I. (1999). "Robust Tracking of People by a Mobile Robotic Agent", Technical Report GIT-GVU-99-19.

HANDWRITING RECOGNITION (1 lecture)

Larry Yaeger, Brandyn Webb, and Richard Lyon (1998). "Combining Neural Networks and Context-Driven Search for On-Line, Printed Handwriting Recognition in the Newton", Spring 1998 issue of AAAI's AI Magazine.
Larry Yaeger, Richard Lyon, and Brandyn Webb (1996). "Effective Training of a Neural Network Character Classifier for Word Recognition", NIPS 1996.
MacKenzie and Zhang (1997). "The Immediate Usability of Graffiti", Graphics Interface 1997, pp. 29-137.

TOPIC TO BE DETERMINED (1 week)

AFFECTIVE COMPUTING (1 week)

Rosalind W. Picard (1997). ``Affective Computing'', MIT Press.
Rosalind W. Picard (1995). ``Affective Computing'', MIT Media Lab TR-321, November 1995 (abbreviated version of the book).
A. R. Demasio (1994). ``Descartes' Error: Emotion, Reason and the Human Brain'',New York: Gosset/Putnam Press (excerpt).

FINAL PROJECT PRESENTATIONS (1 week)

TOTAL: 16 weeks