Sp22 - Introduction to Computer Vision

Course title
EE 379K: Introduction to Computer Vision

Term
Spring 2022

Meeting times and location
TR 2:00-3:30pm (EER 1.518)

After-class platform
Slack (link sent to registered students)

Video recording
Available on Canvas

Course Description and Prerequisites

Computer vision (CV) is the discipline of “teaching machines how to see”: it makes sense of photographs, video, and other imagery. Applications include analysis of medical images, automated quality inspection, entertainment, vehicle safety, security, and HCI, among many others. This course offers a gentle introduction to computer vision, including image formation, camera imaging geometry, feature detection and matching, stereo, motion estimation and tracking, image classification and scene understanding. Both classical and the latest deep learning approaches will be covered.

The students will digest and practice their knowledge and skills by both homework and a midterm exam. They will also obtain in-depth experience with a particular topic through a final project. There will be no final exam.

Students should have taken the following courses or equivalent: Algorithms (EE 360C or CS 314/314H), Linear Systems and Signals (EE313 or BME 343), Probability and Random Processes (EE 351K or BME 335 or MATH 362K). Solid Knowledge of Linear Algebra will be instrumental to this course.

Coding experiences with Python are assumed. Previous knowledge of C/C++, MATLAB, or PyTorch/Tensorflow is very helpful, but not necessary.

Instructor Information

Name
Dr. Zhangyang (Atlas) Wang

Telephone number
512-471-1866

Email address

Office hour time
Wednesday 10:30am - noon

Office hour location
EER 6.886 (instructor office)

TA Information

TA 1 Name

Email address

Office hour time
Friday 10-11am

Office hour location
outside EER O’s Campus Café, outdoor seating area

TA 2 Name

Email address

Office hour time
Monday 4:30-5:30pm

Office hour location
outside EER O’s Campus Café, outdoor seating area

Textbook and/or Resource Material

This course does not follow any textbook closely. Among many recommended readings are:

Grading Policies

Grading will be based on homework (20%; there will be 5 assignments), one mid-term exam (30% - voted to take place REMOTELY, off-class time), and one final project (50%) (proposal 10% + presentation 10% + final report 20% + code review 10%).

  • One project to receive the Best Project Award, voted by all class members. (+5%)
  • Projects in the novel, interdisciplinary domains (some examples: 5G/6G telecommunication, brain-computer interface, economics & markets, COVID-19, etc.), judged by the instructor. (+2%)
  • For late submission, each additional late day will incur a 10% penalty.
  • Request for re-grading an assignment must be made in writing within one (1) week of the graded assignment being made available to the class.
Course Topics

1/18 Tuesday
Class Logistics, and Fundemental Vision Theory [Slides 1/18]
(Extended Materials: MIT lecture on "Marr’s Level’s of Analysis")


1/20 Thursday
Image Representation (1): From Our Brain to the Digital World

1/25 Tuesday
Image Representation (2): Gaussian and Laplacian Image Pyramids

1/27 Thursday
Image Representation (3): Taking A Frequency Domain View [Slides 1/20 + 1/25 + 1/27]
(Extended Materials: Review of Sampling, Aliasing, and Fourier Analysis Methods)


2/01 Tuesday
Image Filtering (1): Pointwise, Convolution, and Beyond [Slides 2/01]

2/03 Thursday
Image Filtering (2): Edge Detection, from Sober to Canny [Slides 2/03]

2/08 Tuesday
Cross-Image Matching (1): Detecting Key Points

2/10 Thursday
Cross-Image Matching (2): Extracting Feature Descriptors from Key Points

2/15 Tuesday
Cross-Image Matching (3): Robust Matching of Descriptors [Slides 2/08 + 2/10 + 2/15]
(Extended Materials: Review of Linear Algebra, especially EVD, SVD and PCA)


2/17 Thursday
Mapping 3D World to Image (1): Pinhole and Lens Cameras

2/22 Tuesday
Mapping 3D World to Image (2): Developing the Pinhole Camera Model

2/24 Thursday
Mapping 3D World to Image (3): Geometric Camera Calibration [Slides 2/17 + 2/22 + 2/24]
(Extended Materials i: Solving Least Sqaures using SVD)
(Extended Materials ii: Geometric Camera Calibration in Action: An OpenCV Example)


3/01 Tuesday
Stereo Vision (1): Two-Camera Models, and Triangulation

3/03 Thursday
Stereo Vision (2): Epipolar Geometry

3/08 Tuesday
Stereo Vision (3): Essential and Fundemental Matrices

3/10 Thursday
Stereo Vision (4): Depth Estimation [Slides 3/01 + 3/03 + 3/08 + 3/10]

3/15 Tuesday
- No Class (Spring Break) -

3/17 Thursday
- No Class (Spring Break) -

3/22 Tuesday
Video and Optical Flow (1)

3/24 Thursday
Video and Optical Flow (2) [Slides 3/22 + 3/24]

3/29 Tuesday
Classical Machine Learning (1)

3/31 Thursday
Classical Machine Learning (2) [Slides 3/29 + 3/31]

4/05 Tuesday
Image Classification: Bag-of-Words Model [Slides 4/05]

4/07 Thursday
Object Detection [Slides 4/07]
(Extended Materials: The Viola-Jones Algorithm Explained in Details)


4/12 Tuesday
Segmentation and Grouping [Slides 4/12]

4/14 Thursday
Image Enhancement and Restoration [Slides 4/14]
(Extended Materials: Overview of Image Super-Resolution)


4/19 Tuesday
Deep Learning in Computer Vision (1)

4/21 Thursday
Deep Learning in Computer Vision (2)

4/26 Tuesday
Deep Learning in Computer Vision (3)

4/28 Thursday
Deep Learning in Computer Vision (4) [Slides 4/19 + 4/21 + 4/26 + 4/28]

5/03 Tuesday
Class Project Presentation (1)

5/05 Thursday
Class Project Presentation (2)

Acknowledgement

Many materials included in this course are adapted from the existing teaching or tutorial slides, created by colleagues in CMU, Stanford, UIUC, UC Berkeley, GaTech, Brown, and more. The instructor owes many thanks for their generosity of sharing those materials publicly.