Project Description

This project aims to train a deep neural network in PyTorch for image classification on CIFAR-10.

Project Steps

1. Step1: Train a model with only a single fully connected layer.
2. Step2: Train a model with multiple fully connected layers. - use ReLU
3. Step3: Train a model with multiple fully connected layers. - not use ReLU
4. Step4: Add two convolutional layers along with maxpooling layers before the fully connected layers.
5. Step5: Try multiple batch sizes (1, 4, 1000) to see the effect.
6. Step6: Try multiple learning rates (10, 0.1, 0.01, and 0.001) to see the effect.
7. Step7: Add some data augmentation to avoid overfitting.
8. Step8: Change the loss function from Cross Entropy to Mean Squared Error and see the effect.