Submissions will be evaluated based on their row-wise micro averaged [F1 score](https://en.wikipedia.org/wiki/F1_score).

For each `row_id`/time window, you need to provide a space separated list of the set of unique `birds` that made a call beginning or ending in that time window. If there are no bird calls in a time window, use the code `nocall`.

There are three sites in the test set. Sites 1 and 2 are labeled in 5 second increments, while site 3 was labeled per audio file due to the time consuming nature of the labeling process.

The submission file must have a header and should look like the following:

## Submission File
```
row_id,birds
site_1_0a997dff022e3ad9744d4e7bbf923288_5,amecro
site_1_0a997dff022e3ad9744d4e7bbf923288_10,amecro amerob
site_1_0a997dff022e3ad9744d4e7bbf923288_15,nocall
```