Since this competition is a binary classification problem, we will use F1 score for evaluation. F1 = 2 * (precision * recall) / (precision + recall) Positive: has_under_extrusion=1 Negative: has_under_extrusion=0