Prof. Corso moved to the Electrical Engineering and Computer Science department at the University of Michigan in the 8/2014. He continues his work and research group in high-level computer vision at the intersection of perception, semantics/language, and robotics. Unless you are looking for something specific, historically, here, you probably would rather go to his new page.
Navigation

News
Calendar
 
Main Course Material
Course Outline
Course Work
Course Evaluation
Additional Information
General Notes
Academic Integrity
 
Full Teaching List

CSE 455/555 Introduction to Pattern Recognition
SUNY at Buffalo
Course Webpage for Spring 2011


A Note On Contacting The Instructor:
Instructor: Jason Corso (UBIT: jcorso)
Course Webpage: http://www.cse.buffalo.edu/~jcorso/t/CSE555
Syllabus: http://www.cse.buffalo.edu/~jcorso/t/CSE555/files/syllabus.pdf
Meeting Times:MWF 11-12
Location: 205 NSC
Teaching Assistant: Wenyuan Yin (UBIT: wyin4) and Yingbo Zhou (UBIT: yingbozh)
Office Hours: Instructor: Wednesday 12-2 in Bell 246
TA Yingbo: Monday 3-6 in Bell 232
TA Wenyuan: Tuesday 3-5 and Friday 9-10 in Bell 232
Newsgroup: sunyab.cse.555
You are encouraged to contact the instructor or TA via the newsgroup. If you choose email, then you must 1) send the email from a buffalo.edu address and 2) include [CSE555] at the beginning of the command-line. Email that does not follow these conventions will not be read.

News

  • April 6 -- The videos from the lecture for the whole semester are available for you to help with the project execution and in preparation for the final exam. You can find the link on the course newsgroup.
  • Mar. 30 -- Wenyuan is sick this week and will be out. Yingbo will be filling in for her.
  • Mar. 28 -- Link to the project data is here.
  • Mar. 21 -- Due to a change in schedule. We will not cover kernel density estimation before HW 3 is due. So, turn in Question 3 for HW 3 on the same due-date, which is 28 March. Then, HW3 Question 1 and 2 will be extra-credit that can be turned in any time on or before 2 May.
  • Mar. 21 -- Project posted. Due 2 May.
  • Mar. 8 -- Scanned notes from lecture 5 on discriminants are available.
  • Mar. 7 -- Solutions for homework1 are available.
  • Mar. 3 -- Midterms from 2009 and 2010 are available for your reference. However, please note three important changes: (1) 455 was never offered in the past, (2) the order of topics may have been different (you are responsible for everything we've covered in the class and assigned readings, and (3) the midterm will have less mathematical derivation and more working of actual problems to ensure you've absorbed the material.
  • Mar. 3 -- Homework 3 posted (due 3/28 in class).
  • Feb. 21 -- Class cancelled because Dr. Corso is sick.
  • Feb. 18 -- It was announced in class that cheating has been discovered on the homework 1. Those who have cheated have until Tuesday to come forward (and receive a zero on this assignment). After this time, those who have cheated will receive an F in the course.
  • Feb. 16 -- Intro to matlab notes from the Yingbo recitation section are here.
  • Feb. 9 -- Homework 2 posted (due 3/4 in class).
  • Feb. 2 -- Class cancelled due to University closure.
  • Jan 24 -- Homework 1 posted (due 2/14 in class).
  • Jan 19 -- First Class.

Calendar

The calendar will be populated as the semester proceeds based on the above course outline and our progress.
Slides are linked off of the week number on the left column. These will be updated as the semester proceeds. Note, for each of the sections outlined in the course outline there will be only a single set of slides.

  Week Monday Wednesday Friday Read Assignments
0 1/19   Introduction PR Application in Robotics Ch. 1
1 1/24 Bayesian Decision Theory Bayesian Decision Theory MLE Ch. 2,3 HW 1 Out
2 1/31 Bayesian Parameter Estimation MLE, BPE Class Cancelled from snow Curse of Dimensionality Ch. 3 Trunk  
3 2/7 PCA FLD Faces Case Study Ch. 3
Turk and Pentland
Belhumeur et al.
Martinez and Kak
HW 2 Out
4 2/14 Faces Case Study, IMPCA, MDA IMPCA, MDA
[matlab]
Nonlinear Methods (LLE) Ch. 3
Yang and Yang
Saul and Roweis
HW 1 Due
5 2/21 Mixtures and EMClass cancelled, Dr. Corso sick. Non-Linear Methods (Dr. Raymond Fu) Mixture Distributions and Computational Finance Applications Saul and Roweis
 
6 2/28 Discriminant Functions HMMs (Guest: Platt) Discriminant Functions/Perceptron Ch. 5 HW 2 Due
HW 3 out
7 3/7 Discriminants Discriminants in Matlab Mid-Term Exam In Class Ch. 5  
  3/14 Spring Recess - No Classes
8 3/21 SVM HMM HMM / DBN Ch 3.10
Ghahramani HMM/BN Tutorial
Rabiner HMM Tutorial
DBNs (from K. Murphy)
DBN Chapter (from K. Murphy)
Project Assigned
HW 3 Due
9 3/28 HMM Clustering Clustering Ch. 10  
10 4/4 Non-parametric Density Estimation Non-parametric Density Estimation Non-parametric Density Estimation Ch. 4
Zhao and Davis
 
11 4/11 Decision Trees / Syntactical Decision Trees / Syntactical Class Cancelled for CSE GSA Conference (Department Policy) Ch. 8  
12 4/18 Decision Trees / Syntactical Boosting/AdaBoost Boosting/AdaBoost Schapire
Viola and Jones
 
13 4/25 Bias and Variance Resampling Methods Cross-Validation and Bagging Ch. 9  
14 5/2 Review and Project Discussion Reading Day Reading Day   Projects Due (5/2)
Final Exam: TBD

Main Course Material

Course Catalog Description: Foundations of pattern recognition algorithms and machines, including statistical and structural methods. Data structures for pattern representation, feature discovery and selection, classification vs. description, parametric and non-parametric classification, supervised and unsupervised learning, use of contextual evidence, clustering, recognition with strings, and small sample-size problems.

Prerequisites: It is assumed the students have a working knowledge of calculus, linear algebra, and probability theory.

Course Goals: After taking the course, the student should have a clear understanding of 1) the design and construction and a pattern recognition system and 2) the major approaches in statistical and syntactic pattern recognition. The student should also have some exposure to the theoretical issues involved in pattern recognition system design such as the curse of dimensionality. These goals are evaluated through the course project, homeworks, and exams.

Textbooks: The main (required) textbook for the course is

  • Duda, R.O., Hart, P.E., and Stork, D.G. Pattern Classification. Wiley-Interscience. 2nd Edition. 2001.

The textbook has a website: http://www.rii.ricoh.com/~stork/DHS.html.

Recommended supplemental textbooks are

  • Bishop, C. M. Pattern Recognition and Machine Learning. Springer. 2007.

  • Theodoridis, S. and Koutroumbas, K. Pattern Recognition. Edition 4. Academic Press, 2008.

  • Russell, S. and Norvig, N. Artificial Intelligence: A Modern Approach. Prentice Hall Series in Artificial Intelligence. 2003.

  • Bishop, C. M. Neural Networks for Pattern Recognition. Oxford University Press. 1995.

  • Hastie, T., Tibshirani, R. and Friedman, J. The Elements of Statistical Learning. Springer. 2001.

Course Outline

The following is the list of topics we will cover this semester. The selection of topics has been made to provide the student with both a fair sampling and an indepth, useful know-how of the big field of pattern recognition. This has required that we drop some topics completely (e.g., Neural Networks) to allow for more indepth discussion of other topics (e.g., Dimension Reduction).

  1. Introduction
  2. Bayesian Decision Theory
  3. Parametric Techniques
    1. Maximum Likelihood Estimation
    2. Bayesian Parameter Estimation
    3. Sufficient Statistics
  4. Component Analysis and Dimension Reduction
    1. The Curse of Dimensionality
    2. Principal Component Analysis
    3. Fisher Linear Discriminant
    4. Locally Linear Embedding
  5. Linear Discriminants and Support Vector Machines
  6. Non-Parametric Techniques
    1. Kernel Density Estimators
    2. Parzen Window
    3. Nearest Neighbor Methods
  7. Boosting / AdaBoost
  8. Clustering
    1. K-Means
    2. Expectation Maximization
    3. Mean Shift
  9. Non-Metric Methods
    1. Decision Trees
    2. Syntactic Methods
  10. Sequential Models
    1. State-Space Models
    2. Hidden Markov Models
    3. Dynamic Bayesian Networks
  11. Algorithm Independent Topics
    1. No Free Lunch Theorem
    2. Ugly Duckling Theorem
    3. Bias-Variance Dilemma
    4. Jacknife and Bootstrap Methods
    5. Boosting Revisited

Course Work

Homeworks: There will be three homeworks, equally weighted. They will cover both theoretical and practical (implementation) aspects of the material. Students may collectively discuss the homework problems, but they must write them independently.

No sharing any of source code or written/typed materials is permitted. No stealing of any source code or written/typed materials off of the internet is permitted. No utilization of any third-party libraries, other than those explicitly mentioned in the assignment description, is permitted. Refer to the Academic Integrity statement at the end of the syllabus for more information; a zero tolerance policy on cheating will be adopted in this course. This means simply if you cheat once you will get an F.

Course Project: Each student will be required to implement a course project during the second half of the semester. Projects are not in groups, but again, discussion is permitted--however, actual working must be done alone (programming and writing). A report and five-minute demonstration of the project (to the instructor and TA) is required at the end of the semester. The project will be officially assigned immediately following spring break, and the instructor will provide 3 possible course projects including example data to work with. For example, one possible project may be to implement an AdaBoost face detector. However, students, especially those involved in or interested in pursuing research, are encouraged to pursue projects of their own design. Such a project must be discussed in person with the instructor during the first half of the semester to ensure the project is suitable.

No sharing any of source code or written/typed materials is permitted. No stealing of any source code or written/typed materials off of the internet is permitted. No utilization of any third-party libraries, other than those explicitly mentioned in the project description, is permitted. Refer to the Academic Integrity statement at the end of the syllabus for more information; a zero tolerance policy on cheating will be adopted in this course. This means simply if you cheat once you will get an F.

Programming Language and Source Code: For some homeworks and for the course project, programming will be required. Students must independently complete all programming assignments and turn in compilable/executable code. Students may choose the language from the following: Matlab 7+, Java 1.5+, and C/C++. However, your code must both compile and run on the CSE linux network (e.g., nickelback.cse.buffalo.edu).

Course Evaluation

The following is a description of how students will be evaluated in the course. The instructor reserves the right to make minor adjustments as necessary.

A final percentage score will be calculated as a weighted average of the course work according to the following table:

  • Mid-Term Exam (20%)
  • Final Exam (30%)
  • Homeworks (8% each for 24%)
  • Project (26%)

Letter grades will be given in the range of F to A (with minuses and pluses). Mapping of raw percentage scores to letter grades will be based on the following rubric: Letter grade A is given for raw percentage scores of 87.5 and higher for 555 and 85 and higher for 455. Remaining letter scores are graded based on a clustering of the students output with each cluster mean mapped to a letter grade in decreasing order (essentially, this means graded on a curve); this is based on overall class performance.

Distinctions 455 and 555 grading: 455 and 555 will be graded on separate curves and the mapping to grade A is different. In addition, 455 students will be required to solve fewer problems on the exams, the specified amount will be determined per exam.

Late Work and Missed Exam Policy: No late work will be accepted. Ample time will be given to complete both the homeworks and the project; use it wisely. Similarly, the date of the exams will be known far in advance. Do not miss the exam. No make-up exams will be given other than for those University approved reasons. This is a firm policy. Do not expect special treatment.

Regrading: If you have a question about the grading of any piece of work, first consult with the teaching assistant who graded your work. If you cannot resolve your questions with the teaching assistant, you should consult with the instructor of the course.

Any questions about the grading of a piece of work must be raised within one week of the date that the work was returned by the teaching assistant or the instructor. In other words, if you do not pick up your work in a timely fashion, you may forfeit your right to question the grading of your work.

Incomplete ("I") Grades: Generally, incomplete ("I") grades are not given. However, very rarely, circumstances truly beyond a studentÕs control prevents him or her from completing work in the course. In such cases the instructor can give a grade of "I." The student will be given instructions and a deadline for completing the work, usually no more than 30 days past the end of the semester. University and department policy dictate that "I" grades can be given only if the following conditions are met:

  • An Incomplete will only be given for missing a small part of the course.

  • An Incomplete will only be given when the student misses work due to circumstances beyond his/her control.

  • An Incomplete will only be given when the student is passing the course except for the missed material.

  • An Incomplete is to be made up with the original course instructor within the time speciŽed by the appropriate University regulation (see appropriate document above), and usually within the following semester.

  • An Incomplete will not be given to allow the student to informally retake the entire course, and have that grade count as the grade of the original course.

Incompletes can not be given as a shelter from poor grades. It is your responsibility to make a timely resignation from the course if you are doing poorly for any reason. The last day to resign the course is Friday, March 27 2009.

Additional Information

Newsgroup: There is a newsgroup, sunyab.cse.555, for this course. You must learn how to read news and subscribe to this newsgroup. You are expected to read the newsgroup on a daily basis. There will often be important material posted there, such as supplementary course notes, homework and sample exam questions, and occasionally late breaking news. You may post general course related articles to the newsgroup. Use discretion in posting articles related to homework assignments and the project: when in doubt, e-mail the TA or instructor first.

The news (nntp) server you need to connect to is news.buffalo.edu. Note that you must authenticate using your UBIT name and password to use this news server, and you must be connecting from a UB IP address (i.e. if you are not using a university machine, you need to use VPN). For further information on accessing the newsgroup, refer to http://ubit.buffalo.edu/newsgroups/index.php.

Similar Courses at This and Other Institutions: (incomplete and in no important order)

General Notes

If you don't understand something covered in class, ask about it right away. The only silly question is the one which is not asked. If you get a poor mark on an assignment or exam, find out why right away. Don't wait a month before asking. The instructor and teaching assistant are available to answer your questions. Don't be afraid to ask questions, or to approach the instructor or TA in class, during office hours, through the newsgroup or through e-mail. This course is intended to be hard work, but it is also intended to be interesting and fun. We think pattern recognition is interesting and exciting, and we want to convince you of this.

Disabilities

If you have a diagnosed disability (physical, learning, or psychological) that will make it difficult for you to carry out the course work as outlined, or that requires accommodations such as recruiting note-takers, readers, or extended time on exams or assignments, you must consult with the Office of Disability Services (25 Capen Hall, Tel: 645-2608, TTY: 645-2616, Fax: 645-3116, http://www.student-affairs.buffalo.edu/ods/). You must advise your instructor during the Žrst two weeks of the course so that we may review possible arrangements for reasonable accommodations.

Counseling Center

Your attention is called to the Counseling Center (645-2720), 120 Richmond Quad. The Counseling Center staff are trained to help you deal with a wide range of issues, including how to study effectively and how to deal with exam-related stress. Services are free and conŽdential. Their web site is http://www.student-affairs.buffalo.edu/shs/ccenter/.

Distractions In The Classroom - Behavioral Expectations

The following is the text of a policy adopted by the Faculty Senate on 5/2/2000. You are expected to know and adhere to this policy.

OBSTRUCTION OR DISRUPTION IN THE CLASSROOM - POLICIES
UNIVERSITY AT BUFFALO

To prevent and respond to distracting behavior faculty should clarify standards for the conduct of class, either in the syllabus, or by referencing the expectations cited in the Student Conduct Regulations. Classroom ``etiquette'' expectations should include:

  • Attending classes and paying attention. Do not ask an instructor in class to go over material you missed by skipping a class or not concentrating.

  • Not coming to class late or leaving early. If you must enter a class late, do so quietly and do not disrupt the class by walking between the class and the instructor. Do not leave class unless it is an absolute necessity.

  • Not talking with other classmates while the instructor or another student is speaking. If you have a question or a comment, please raise your hand, rather than starting a conversation about it with your neighbor.

  • Showing respect and concern for others by not monopolizing class discussion. Allow others time to give their input and ask questions. Do not stray from the topic of class discussion.

  • Not eating and drinking during class time.

  • Turning off the electronics: cell phones, pagers, and beeper watches.

  • Avoiding audible and visible signs of restlessness. These are both rude and disruptive to the rest of the class.

  • Focusing on class material during class time. Sleeping, talking to others, doing work for another class, reading the newspaper, checking email, and exploring the internet are unacceptable and can be disruptive.

  • Not packing bookbags or backpacks to leave until the instructor has dismissed class.

Academic Integrity

A zero-tolerance policy on cheating will be adopted in this course. The following is the formal statement of academic integrity. Source: http://www.cse.buffalo.edu/graduate/policies_acad_integrity.php

The academic degrees and the research findings produced by our Department are worth no more than the integrity of the process by which they are gained. If we do not maintain reliably high standards of ethics and integrity in our work and our relationships, we have nothing of value to offer one another or to offer the larger community outside this Department, whether potential employers or fellow scholars.

For this reason, the principles of Academic Integrity have priority over every other consideration in every aspect of our departmental life, and we will defend these principles vigorously. It is essential that every student be fully aware of these principles, what the procedures are by which possible violations are investigated and adjudicated, and what the punishments for these violations are. Wherever they are suspected, potential violations will be investigated and determinations of fact sought. In short, breaches of Academic Integrity will not be tolerated.

University Statements on Academic Integrity

The University at Buffalo Department of Computer Science and Engineering endorses and adheres to the University policy on Academic Integrity. Students should be familiar with that policy, as expressed in the following documents.:

Departmental Statement on Academic Integrity in Coding Assignments and Projects

The following statement further describes the specific application of these general principles to a common context in the CSE Department environment, the production of source code for project and homework assignments. It should be thoroughly understood before undertaking any cooperative activities or using any other sources in such contexts.

All academic work must be your own. Plagiarism, defined as copying or receiving materials from a source or sources and submitting this material as one's own without acknowledging the particular debts to the source (quotations, paraphrases, basic ideas), or otherwise representing the work of another as one's own, is never allowed. Collaboration, usually evidenced by unjustifiable similarity, is never permitted in individual assignments. Any submitted academic work may be subject to screening by software programs designed to detect evidence of plagiarism or collaboration.

It is your responsibility to maintain the security of your computer accounts and your written work. Do not share passwords with anyone, nor write your password down where it may be seen by others. Do not change permissions to allow others to read your course directories and files. Do not walk away from a workstation without logging out. These are your responsibilities. In groups that collaborate inappropriately, it may be impossible to determine who has offered work to others in the group, who has received work, and who may have inadvertently made their work available to the others by failure to maintain adequate personal security. In such cases, all will be held equally liable.

These policies and interpretations may be augmented by individual instructors for their courses. Always check the handouts and web pages of your course and section for additional guidelines.

Departmental Policy on Violations of Academic Integrity

Any student accused of a violation of academic integrity will be so notified by the course director. An informal review will be conducted, including a meeting between these parties. After this review and upon determination that a violation has occurred, the following sanctions will be imposed. It is the policy of this department that, in general, any violation of academic integrity will result in an F for the course, that all departmental financial support including teaching assistantship, research assistantship or scholarships be terminated, that notification of this action be placed in the student's confidential departmental record, and that the student be permanently ineligible for future departmental financial support. A second violation of academic integrity will cause the department to seek permanent dismissal from the major and bar from enrollment in any departmental courses. Especially flagrant violations will be considered under formal review proceedings, which may in addition to the above sanctions result in expulsion from the University.


last updated: Sat Jun 21 07:38:45 2014; copyright jcorso