Fine-tuning of DistilBERT model for down-stream task as sentiment classification. Look at the notebook or here for more details.