Submissions are evaluated by the **Geometric Mean of the [BLEU](https://aclanthology.org/P02-1040.pdf) and the [chrF++](https://statmt.org/wmt17/pdf/WMT70.pdf) scores**, with each score's sufficient statistics being aggregated across the entire corpus (that is, each score is a *micro-average*).

You may refer to the [SacreBLEU](https://github.com/mjpost/sacrebleu/) library for implementation details. A notebook implementing the metric on Kaggle may be found here: [Geometric Mean of BLEU and chrF++](https://www.kaggle.com/code/metric/dpi-bleu-chrf).

## Submission File
For each `id` in the test set, you must predict an English translation of the associated Akkadian transliteration. Each translation should comprise a single sentence. The file should contain a header and have the following format:

    id,translation
    0,Thus Kanesh, say to the -payers, our messenger, every single colony, and the...
    1,In the letter of the City (it is written): From this day on, whoever buys meteoric...
    2,As soon as you have heard our letter, who(ever) over there has either sold it to...
    3,Send a copy of (this) letter of ours to every single colony and to all the trading...
    ...