We follow a similar metric to the classification tasks of the ILSVRC. For each image, an algorithm will produce 3 labels. For this competition each image has one ground truth label. For a given image, if the ground truth label is found among the 3 predicted labels, then the error for that image is 0, otherwise it is 1. The final score is the error averaged across all images.
Submission Format
For each image in the test set, you must predict 3 class labels. The csv file should contain a header and have the following format:
id,predicted
12345, 6 27 88
67890, 0 100 17
The id column corresponds to the test image id. The predicted column corresponds to 3 category ids, separated by spaces. You should have one row for each test image. Please sort your predictions from most confident to least, from left to right, this will allow us to study top-1, top-2, and top-3 accuracy.