Submissions will be evaluated based on their mean F-1 score. The F score, commonly used in information retrieval, measures accuracy using the precision p and recall r. Precision is the ratio of true positives (tp) to all predicted positives (tp + fp). Recall is the ratio of true positives to all actual positives (tp + fn). The F-1 score is given by

$$ \frac{pr}{p+r}  where  p=\frac{tp}{tp+fp},  r=\frac{tp}{tp+fn}$$

Note that the F-1 score weights recall higher than precision. The mean F-1 score is formed by averaging the individual F-1 scores for each row in the test set.

### Submission File

You need to submit your predictions in the format as below:

```
ID,CORE RELATIONS
0,rel1 rel2
1,rel1
2,rel3
3,re1 rel3 rel4
etc.
```