Submissions are evaluated based on the mean (top-1) accuracy metric on the test predictions. We assume that a prediction is correct if the top prediction is the ground-truth label. Please see our Github page for more details.
Submission File Format
image_name, label

test_0001.jpg,0

test_0002.jpg,1

test_0003.jpg,3

Please include the header as shown above for correct parsing. Each line will correspond to one test image and will be identified by the id (e.g test0001.jpg refers to image test0001.jpg) for computing accuracy.