Submissions are evaluated on the `mean column-wise ROC AUC`. In other words, the score is the average of the individual AUCs of each predicted column.

## Submission Format

**For every patient in the dataset**, submission files should contain two columns: `member_id` and columns with diseases: `hcc_9`,`hcc_10`,`hcc_11`,`hcc_12`,`hcc_18`,`hcc_19`,`hcc_21`,`hcc_22`,`hcc_23`,`hcc_40`,`hcc_47`,`hcc_48`,`hcc_51`,`hcc_52`,`hcc_55`,`hcc_59`,`hcc_75`,`hcc_79`,`hcc_84`,`hcc_85`,`hcc_88`,`hcc_96`,`hcc_103`,`hcc_108`,`hcc_111`,`hcc_112`,`hcc_124`,`hcc_137`,`hcc_138`,`hcc_161`. 

The file should contain a header and have the following format:
```
member_id,hcc_9,hcc_10,hcc_11,hcc_12,hcc_18,hcc_19,hcc_21,hcc_22,hcc_23,hcc_40,hcc_47,hcc_48,hcc_51,hcc_52,hcc_55,hcc_59,hcc_75,hcc_79,hcc_84,hcc_85,hcc_88,hcc_96,hcc_103,hcc_108,hcc_111,hcc_112,hcc_124,hcc_137,hcc_138,hcc_161

1,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0
```