Training datasets and the testing dataset (without annotation released) are from iMiGUE. We deploy a cross-subject evaluation protocol by dividing the 72 subjects into a training group of 37 subjects and a testing group of 35 subjects. For the MG classification track, 13,936 and 3,692 MG clips from iMiGUE, and the remaining 4,563 MG clips from iMiGUE will be used for testing.

MG classification track: We evaluate participants' methods based on **Top-1 accuracy** in the challenge, but we encourage participants to report their results when submitting papers to our MiGA workshop, on the following subsets of the test set: 1) Overall: All segments in the test split; 2) Tail Classes: Due to the long-tailed nature of the datasets, among a total 33 classes in iMiGUE dataset, 28 classes are tail classes (approx. 57.8 % of the data).  <!--Since there is considerable overlap between consecutive fine-grained MG segments, we use Top-5 accuracy instead of the standard Top-1. -->

Submission format for classification track. Participants must submit their predictions following **the sample format below**. The results will be evaluated on the server and displayed on the ranking list in real-time. The organization team has the right to examine the participants' source code to ensure the reproducibility of the algorithms. The final results and ranking will be confirmed and announced by organizers.


## Submission File
Participants must submit their predictions in the a single .csv file. Instructions and sample submission files will be released with the data.

 For each 'Id' in the validation set, you must predict a probability for the 'Target' variable. The file should contain a header  (Id,Target) with  and have the following format:

    Id , Target
    0004_0,30
    0004_1,30
    etc.


**The phase 2 sample submission for the final testing phase (May 2nd to May 12th) can be found [here](https://drive.google.com/file/d/1CdJAtN4r8HvEz0D6oaxYeE1o2wXGzqmx/view?usp=sharing).**

The old phase1 sample submission for the evaluation phase (April 8th to May 2nd) can be found [here](https://drive.google.com/file/d/1PHBwudikSqjgxoXAW6n94A1-HgiRb1Jx/view?usp=drive_link).

The old leaderboard from phase1 is displayed below. Please submit your final results on the testing data to get your ranking on the final phase2 leaderboard.

![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F6355562%2Fda5dc2d1279660ee40f4fa809c24aacc%2FScreenshot%20from%202024-05-02%2016-04-57.png?generation=1714656107502546&alt=media)