CS331 Class Notes
Fall 2024 Semester

Michael Eckmann
Skidmore College

Monday, November 25, 2024
Last comments on training CNNs, start SVMs
Thursday, November 21, 2024
Fashion mnist with mixup
fashionmixupcombination.txt
Tuesday, November 19, 2024
Recap from yesterday's work, more keras/tensorflow
Monday, November 18, 2024
In class work w/ tensorflow and keras to train MNIST
Thursday, November 14, 2024
finish Optimizers, CNN architectures
Tuesday, November 12, 2024
Cutout, mixUp, Learning rate Schedules, Optimizers
Monday, November 11, 2024
Softmax, Dropout, Dataset Augmentation, other regularization
Thursday, November 07, 2024
Introduction to keras, tensorflow
nn1.py (implementation of homework but using tensorflow/keras)
nn-for-google-colab.py
Tuesday, November 05, 2024
Normalization, Batch Normalization, Stochastic Gradient Descent (SGD), Xavier Weight Initialization, Data Shuffling before each epoch
Monday, November 04, 2024
finish looking at pseudocode and numpy tips, discuss problems like overfitting, underfitting, vanishing gradients, and ways to combat these problems, different activation functions
Thursday, October 31, 2024
continue Convolutional Neural Networks, look at NN online, revisit psuedocode for learning in a NN
psuedocode for learning in a NN (no bias)
psuedocode for learning in a NN with bias units and numpy hints
Tuesday, October 29, 2024
continue Convolutional Neural Networks
Monday, October 28, 2024
finish discussion of learning in a fully connected NN, start Convolutional Neural Networks
Thursday, October 24, 2024
continue NNs, complete learning algorithm (forward prop, backprop, gradient descent, weight updates)
Tuesday, October 22, 2024
continue NNs, Gradient Descent
Monday, October 21, 2024
last comments on Regularization, why Neural Networks, start Neural Networks
Thursday, October 17, 2024
continue Logistic Regression, introduce Regularization
Tuesday, October 15, 2024
start Logistic Regression
Monday, October 14, 2024
recap Linear Regression, more numpy and look at code for homework 2 for Linear Regression / Gradient Descent
Thursday, October 10, 2024
finish Linear Regression example, extending to learn higher order polynomials
Spreadsheet with Linear Regression
Tuesday, October 08, 2024
more Linear Regression, Gradient Descent algorithm
Thursday, October 03, 2024
More numpy useful for assignment
Machine Learning introduction, start Linear Regression
Tuesday, October 01, 2024
More about the assignment
in-class exercises (with my answers)
Monday, September 30, 2024
K-nearest-neighbors
Thursday, September 26, 2024
more openCV and numpy, write code for YCbCr conversion
ycbcrprogram.py.txt
classwork20240926.ipynb
info about tutorial on openCV
Info about tutorial on numpy
Tuesday, September 24, 2024
Introduction to openCV and numpy
List of functionality presented
Jupyter notebook 1
Jupyter notebook 2
Monday, September 23, 2024
In-class exercises on recent material
solutions
Thursday, September 19, 2024
some Region properties, histograms, distance measures
Tuesday, September 17, 2024
Connected Components, Morphology examples
Morphology java code and Lincoln images
Monday, September 16, 2024
revisit in-class exercises, Binary Image Morpholgy and uses, start Connected Components
Thursday, September 12, 2024
more with 2nd Derivative masks, Determining angle/magnitude of edges using prewitt, example edge detection on an image, in-class exercises
Tuesday, September 10, 2024
another example of HSV usage, start Cross-correlation (with blurring, 1st derivative (edge), 2nd derivative masks)
Monday, September 9, 2024
problems in digital images, HSV color space, HSV usage
Thursday, September 5, 2024
Introduction, start course content