ImageProcessing with MNIST and ORL dataset

This includes code for 5 different classifiers; nearest centroid, nearest neighbor, nearest sub-class classifier, perceptron using batch and perceptron using mse. To test the classifiers the MNIST and ORL dataset has been used. The MNIST DATABASE need to be downloaded and put in the MNIST folder since they were too large to be uploaded on GITHUB.

THE MNIST DATABASE of handwritten digits

Yann LeCun, Courant Institute, NYU
Corinna Cortes, Google Labs, New York
Christopher J.C. Burges, Microsoft Research, Redmond

Dataset can be downloaded at http://yann.lecun.com/exdb/mnist/

Before you can use the codes:

Download the MNIST DATASET and put them in the folder MNIST.

The main files:

• main_nearestClassifier.m
• main_nearestNeighbor.m
• main_nearestsubClassifier.m
• main_Perceptron_batch.m
• main_Perceptron_MSE.m

Helper functions

• calculateAccuracy.m
• divideRandExtended.m
• dividerandSeperate.m

The files for loading the MNIST and ORL data sets.

• load_MNIST.m
• loaddata.m
• loaddataFunc.m
• loadMNISTImages.m
• loadMNISTLabels.m

The ORL DATASET.

• orl_data.mat
• orl_lbls.mat

The MNIST DATASET HAVE TO BE DOWNLOADED FROM THE LINK ABOVE.

• t10k-images.idx3-ubyte
• t10k-labels.idx1-ubyte
• train-images.idx3-ubyte
• train-labels.idx1-ubyte

Nearest Centroid Classifier

The main file for the nearest centroid classifier are

main_nearestClassifier.m

Which has the following files for training and testing:

• trainingNCC.m / trainingNCC2.m - training the data set.
• testNCC.m - testing the data set.

Nearest Neighbor Classifier

The main file for the nearest neighbor classifier are

main_nearestNeighbor.m

Which has the following file for testing:

• testNCC.m

Nearest Sub-class Classifier

The main file for the nearest sub-class classifier are

main_nearestsubClassifier.m

Which has the following file for training:

• trainingNSC.m

Perceptron trained using Backpropagation

The main file for the perceptron trained using Backpropagation are

main_Perceptron_batch.m

Which has the follwoing files for training and testing:

• trainingPBP.m
• testPBP.m

Perceptron using Mean Square Error

The main file for the perceptron using mean square error are:

main_Perceptron_MSE.m

Which has the follwoing file for training:

• trainingMSE.m