Submissions are evaluated on Area under the ROC curve between the predicted probability and the observed label. For each MachineIdentifier in the test set, you must predict a probability for the HasDetections column.