The evaluation metric for this competition is the samples-averaged \\(F\_1\\)-score, which measures an overlap between the predicted and actual set of species present at a given location and time.  
Each test PA sample \\( i \\) is associated with a set of ground-truth labels \\( Y\_i \\), i.e., the set of plant species (=speciesId). For each sample, the submission must provide a list of labels, i.e., the set of species predicted present \\( \\widehat{Y}\_{i,1}, \\widehat{Y}\_{i,2}, \\dots, {\\widehat{Y}}\_{i,R\_i} \\).  
The micro \\(F\_1\\)-score is then computed using

\\\[ F\_1 = \\frac{1}{N} \\sum\_{i=1}^N \\frac{\\text{TP}\_i}{\\text{TP}\_i+(\\text{FP}\_i+\\text{FN}\_i)/2} \\\\ \\quad \\text{Where} \\begin{cases} \\text{TP}\_i =\\text{ Number of predicted species truly present, i.e. }|\\widehat{Y}\_i \\cap Y\_i |\\\\ \\text{FP}\_i =\\text{ Number of species predicted but absent, i.e. } |\\widehat{Y}\_i \\setminus Y\_i | \\\\ \\text{FN}\_i =\\text{ Number of species not predicted but present, i.e. } | Y\_i \\setminus \\widehat{Y}\_i |\\\\ \\end{cases} \\\]

Submission Format
=================

For each id in the test set, you must predict a set of species that occur at the given location. The file should contain a header and have the following format:
```
surveyId,predictions
1,1 52 10231
2,78 201 1243 1333 2310 4841
...
```
The submission format is a CSV file containing two columns for each sample (row):
*   `surveyId` column containing integers corresponding to the test sample ids, corresponding to unique combinations of patchID and dayOfYear column values.
*   `predictions` column containing space-delimited lists of the predicted species identifiers (column spId in trainingdatasets)

**For each sample (row), the predicted species identifiers must be ordered by increasing the value from left to right. No test sample is empty, and the test set only contains species from the train set.**