The evaluation metric for this competition is Mean F1-Score. If you will write a notebook, please mention F1-Scores for each class. Also I want to say that distribution of test set is this: 2 98.987625 1 0.802046 0 0.210330 I want you to know it, because, from the one hand, main metric of contest is F1-Score and because of it you should correctly predict all classes, and from the other hand, I just want to achieve the highest F1-Score possible, and when you know real-life distribution, you will create more accurate models.