What exactly is the distinction between classification and regression? Supervised machine learning includes classification and regression. To predict the outcome on test or new datasets, both regression and classification use a training data set. Classification attempts to predict the category of a new observation. However, the goal of regression is to estimate or predict a response or quantity.