The evaluation metric for this competition is a Mean Average Precision at cutoff K. In our case K=1.
average precision
\[ ap@n = \sum_{k=1}^{n}P(k)/ min(m,n) \]
mean average precision
\[ MAP@n = \sum_{i = 1}^{N} ap@n_i/N \]
Submission Format
One row should correspond to every protein in the dataset. Protein name comes first, separated with comma sign from it's ligands. All of the ligands in the list should be separated by spaces from each other.
The file should contain a header and have the following format:
Id,Prediction
P27158,L4318 L7825 L7859 L29531 L19463 L30570 L7109 L5317
P8841,L30357 L10900 L29805 L23864 L11980 L2484 L14284 L4135 L4864
P8840,L9193 L10588 L30590 L14513 L19725 L25892 L3481 L27267 L19194
P12340,L3387 L18759 L14519 L451 L9513