{
  "id": 666260,
  "title": "Extra data set from Akkadian AI translation",
  "url": "/competitions/deep-past-initiative-machine-translation/discussion/666260",
  "author_name": "MJeremy",
  "post_date": "2026-01-06T05:06:26.499000",
  "votes": 11,
  "comment_count": 7,
  "views": 0,
  "content": "<p>From the published texts there's a link to the AI translation, where the competition mentioned it to be \"poorly translated\", but I believe it might still have some use.</p>\n<p>Here's the link to the notebook and processing to get those data:</p>\n<p><a href=\"https://www.kaggle.com/code/zhangyue199/dpc-ai-translation-dataset/output?scriptVersionId=290276456\" target=\"_blank\">https://www.kaggle.com/code/zhangyue199/dpc-ai-translation-dataset/output?scriptVersionId=290276456</a></p>\n<p>I do have some confusion on the data, the AI translation page includes multiple sides of the tablet, e.g. obverse, reverse.</p>\n<p>But the Akkadian there does not exactly match with the <code>transliteration</code> in the <code>publised_texts</code>, for which I am not sure how to match the <code>transliteration</code> to the <code>AI english</code>.</p>\n<p>Appreciate if anyone can shed some lights.</p>",
  "messages": [
    {
      "id": 3386931,
      "postDate": "2026-01-06T05:06:26.500Z",
      "content": "<p>From the published texts there's a link to the AI translation, where the competition mentioned it to be \"poorly translated\", but I believe it might still have some use.</p>\n<p>Here's the link to the notebook and processing to get those data:</p>\n<p><a href=\"https://www.kaggle.com/code/zhangyue199/dpc-ai-translation-dataset/output?scriptVersionId=290276456\" target=\"_blank\">https://www.kaggle.com/code/zhangyue199/dpc-ai-translation-dataset/output?scriptVersionId=290276456</a></p>\n<p>I do have some confusion on the data, the AI translation page includes multiple sides of the tablet, e.g. obverse, reverse.</p>\n<p>But the Akkadian there does not exactly match with the <code>transliteration</code> in the <code>publised_texts</code>, for which I am not sure how to match the <code>transliteration</code> to the <code>AI english</code>.</p>\n<p>Appreciate if anyone can shed some lights.</p>",
      "rawMarkdown": "From the published texts there's a link to the AI translation, where the competition mentioned it to be \"poorly translated\", but I believe it might still have some use.\n\nHere's the link to the notebook and processing to get those data:\n\nhttps://www.kaggle.com/code/zhangyue199/dpc-ai-translation-dataset/output?scriptVersionId=290276456\n\nI do have some confusion on the data, the AI translation page includes multiple sides of the tablet, e.g. obverse, reverse.\n\nBut the Akkadian there does not exactly match with the `transliteration` in the `publised_texts`, for which I am not sure how to match the `transliteration` to the `AI english`.\n\nAppreciate if anyone can shed some lights.",
      "votes": 11
    },
    {
      "id": 3387129,
      "postDate": "2026-01-06T12:34:25.143Z",
      "content": "<p>Just map them via the <strong>cdli_id</strong>. Although your current notebook doesn’t have a separate column for cdli_id, the cdli_id is included in <strong>url_org</strong> — you can extract it. Alternatively, you can rewrite the notebook to add a cdli_id column, which will allow matching with the content in published_texts.csv.\nAdditional Notes:</p>\n<ol>\n<li>The Akkadian content and AI-translated content on the original website have <strong>multiple sides</strong>, but this notebook only scrapes the \"Obverse\" side. For reference, the following oare_ids are the only ones from <strong>train.csv that appear on the website</strong>:</li>\n</ol>\n<pre><code>aefa478d-c47d-42d2-a3b5-3f150603ccee\n55b115ac-6a6d-48e6-86df-ff449b4b346b\n99923b12-2acd-4eb4-9e1a-56b85c475a76\n3e87aad8-cd8c-4f8d-96e9-c68e062d4a1a\n4beda101-a827-47e2-b47a-799fd8f68c07\n8f46f357-9971-427f-ac9a-7de23c9ce3a5\n</code></pre>\n<ol>\n<li>The transliteration on this website uses the <strong>CDLI notation</strong>, which differs from that of the competition. For example, this website uses \"a2\" instead of \"á\", along with other variations in capitalization and determiners — normalization is required.</li>\n</ol>",
      "rawMarkdown": "Just map them via the **cdli_id**. Although your current notebook doesn’t have a separate column for cdli_id, the cdli_id is included in **url_org** — you can extract it. Alternatively, you can rewrite the notebook to add a cdli_id column, which will allow matching with the content in published_texts.csv.\nAdditional Notes:\n1. The Akkadian content and AI-translated content on the original website have **multiple sides**, but this notebook only scrapes the \"Obverse\" side. For reference, the following oare_ids are the only ones from **train.csv that appear on the website**:\n```python\naefa478d-c47d-42d2-a3b5-3f150603ccee\n55b115ac-6a6d-48e6-86df-ff449b4b346b\n99923b12-2acd-4eb4-9e1a-56b85c475a76\n3e87aad8-cd8c-4f8d-96e9-c68e062d4a1a\n4beda101-a827-47e2-b47a-799fd8f68c07\n8f46f357-9971-427f-ac9a-7de23c9ce3a5\n```\n2. The transliteration on this website uses the **CDLI notation**, which differs from that of the competition. For example, this website uses \"a2\" instead of \"á\", along with other variations in capitalization and determiners — normalization is required.",
      "votes": 1,
      "replies": [
        {
          "id": 3387425,
          "postDate": "2026-01-07T01:09:11.780Z",
          "content": "<p>hi, even with the CDLI_ID, how would that help matching tranliteration to the AI translation?</p>",
          "rawMarkdown": "hi, even with the CDLI_ID, how would that help matching tranliteration to the AI translation?",
          "replies": [
            {
              "id": 3387474,
              "postDate": "2026-01-07T05:06:44.123Z",
              "content": "<p>The only viable method might be to use \n<code>obverse_akkadian obverse_english\nreverse_akkadian reverse_english</code></p>\n<p>and then standardize the Akkadian text back to the format specified for this competition.</p>",
              "rawMarkdown": "The only viable method might be to use \n`obverse_akkadian obverse_english\nreverse_akkadian reverse_english`\n\nand then standardize the Akkadian text back to the format specified for this competition."
            }
          ]
        }
      ]
    },
    {
      "id": 3386994,
      "postDate": "2026-01-06T07:22:07.413Z",
      "content": "<p>I think the transliteration_org column is similar to that in the train.csv. And the English translation is in obverse_english and reserve_english columns. Unfortunately, these two columns contain only part of the translation, and you may deduce the corresponding transliteration extract from the two akkadian columns (these are another form of expressing akkadian I believe, possibly CDLI).</p>\n<p>For instance, in the first row,</p>\n<ul>\n<li>KIŠIB a-šùr-ma-lik DUMU i-na-a a-na a-šùr-na-da DUMU … ù en-um-a-šùr DUMU … a-pu-tum a-na a-wa-at ṭup-pì-im iḫ-da … ša ú-…</li>\n</ul>\n<p>=&gt;\nSeal of Ashur-malik, son of Ina, to Ashur-nada, son of … and Enum-assur, son of …, Aputum, in accordance with the wording of the tablet …, who .</p>\n<ul>\n<li>ḫa-sí-sú …</li>\n</ul>\n<p>=&gt;\n. . . a scepter .</p>\n<p>In the second row, only the reserve_english part is valid:</p>\n<ul>\n<li>iš-tù ḫa-mu-uš-tim ša šu-be-lim DUMU a-na-lí a-na 8 ḫa-am-ša-tim i-ša-qal</li>\n</ul>\n<p>=&gt;\nFrom the mushtu-tree of Shubelum and to the 8 mushtu-trees he shall weigh out. That is what at that time</p>\n<p>(this translation is terrible. It probably should be: From the week of Šū-bēlum, son of Anali, he shall pay in 8 weeks.)</p>",
      "rawMarkdown": "I think the transliteration_org column is similar to that in the train.csv. And the English translation is in obverse_english and reserve_english columns. Unfortunately, these two columns contain only part of the translation, and you may deduce the corresponding transliteration extract from the two akkadian columns (these are another form of expressing akkadian I believe, possibly CDLI).\n\nFor instance, in the first row,\n\n- KIŠIB a-šùr-ma-lik DUMU i-na-a a-na a-šùr-na-da DUMU … ù en-um-a-šùr DUMU … a-pu-tum a-na a-wa-at ṭup-pì-im iḫ-da … ša ú-…\n\n=>\nSeal of Ashur-malik, son of Ina, to Ashur-nada, son of ... and Enum-assur, son of ..., Aputum, in accordance with the wording of the tablet ..., who .\n\n- ḫa-sí-sú …\n\n=>\n. . . a scepter .\n\nIn the second row, only the reserve_english part is valid:\n\n- iš-tù ḫa-mu-uš-tim ša šu-be-lim DUMU a-na-lí a-na 8 ḫa-am-ša-tim i-ša-qal\n\n=>\nFrom the mushtu-tree of Shubelum and to the 8 mushtu-trees he shall weigh out. That is what at that time\n\n(this translation is terrible. It probably should be: From the week of Šū-bēlum, son of Anali, he shall pay in 8 weeks.)",
      "votes": 2,
      "replies": [
        {
          "id": 3387117,
          "postDate": "2026-01-06T12:07:09.733Z",
          "content": "<p>yeah, but the Akkadian from the link seems to be a different Akkadian from the training example, I think using these are training would deteriorite the model.</p>\n<p>My guess is it would work only if we can find the AI translations that matches the <code>transliteration_org</code>  in the dataset.</p>",
          "rawMarkdown": "yeah, but the Akkadian from the link seems to be a different Akkadian from the training example, I think using these are training would deteriorite the model.\n\nMy guess is it would work only if we can find the AI translations that matches the `transliteration_org`  in the dataset.",
          "replies": [
            {
              "id": 3387134,
              "postDate": "2026-01-06T12:43:31.983Z",
              "content": "<p>Yes, it's not the form this competition expects. As I mentioned, the two columns could only serve to locate their counterparts in the transliteration_org column. </p>\n<p>That said, the Akkadian columns are far from good splits of the transliteration_org documents. If time permits, you may build the aligned database through more advanced LLMs which could both split the sentences and better translate them.</p>",
              "rawMarkdown": "Yes, it's not the form this competition expects. As I mentioned, the two columns could only serve to locate their counterparts in the transliteration_org column. \n\nThat said, the Akkadian columns are far from good splits of the transliteration_org documents. If time permits, you may build the aligned database through more advanced LLMs which could both split the sentences and better translate them.",
              "votes": 1
            }
          ]
        }
      ]
    },
    {
      "id": 3387127,
      "postDate": "2026-01-06T12:33:04.193Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 3387129,
      "author_name": "耶✌",
      "author_url": "",
      "post_date": "2026-01-06T12:34:25.143000",
      "content": "<p>Just map them via the <strong>cdli_id</strong>. Although your current notebook doesn’t have a separate column for cdli_id, the cdli_id is included in <strong>url_org</strong> — you can extract it. Alternatively, you can rewrite the notebook to add a cdli_id column, which will allow matching with the content in published_texts.csv.\nAdditional Notes:</p>\n<ol>\n<li>The Akkadian content and AI-translated content on the original website have <strong>multiple sides</strong>, but this notebook only scrapes the \"Obverse\" side. For reference, the following oare_ids are the only ones from <strong>train.csv that appear on the website</strong>:</li>\n</ol>\n<pre><code>aefa478d-c47d-42d2-a3b5-3f150603ccee\n55b115ac-6a6d-48e6-86df-ff449b4b346b\n99923b12-2acd-4eb4-9e1a-56b85c475a76\n3e87aad8-cd8c-4f8d-96e9-c68e062d4a1a\n4beda101-a827-47e2-b47a-799fd8f68c07\n8f46f357-9971-427f-ac9a-7de23c9ce3a5\n</code></pre>\n<ol>\n<li>The transliteration on this website uses the <strong>CDLI notation</strong>, which differs from that of the competition. For example, this website uses \"a2\" instead of \"á\", along with other variations in capitalization and determiners — normalization is required.</li>\n</ol>",
      "votes": 1,
      "replies": [
        {
          "id": 3387425,
          "author_name": "MJeremy",
          "author_url": "",
          "post_date": "2026-01-07T01:09:11.780000",
          "content": "<p>hi, even with the CDLI_ID, how would that help matching tranliteration to the AI translation?</p>",
          "votes": 0,
          "replies": [
            {
              "id": 3387474,
              "author_name": "耶✌",
              "author_url": "",
              "post_date": "2026-01-07T05:06:44.123000",
              "content": "<p>The only viable method might be to use \n<code>obverse_akkadian obverse_english\nreverse_akkadian reverse_english</code></p>\n<p>and then standardize the Akkadian text back to the format specified for this competition.</p>",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3386994,
      "author_name": "Tomorin",
      "author_url": "",
      "post_date": "2026-01-06T07:22:07.413000",
      "content": "<p>I think the transliteration_org column is similar to that in the train.csv. And the English translation is in obverse_english and reserve_english columns. Unfortunately, these two columns contain only part of the translation, and you may deduce the corresponding transliteration extract from the two akkadian columns (these are another form of expressing akkadian I believe, possibly CDLI).</p>\n<p>For instance, in the first row,</p>\n<ul>\n<li>KIŠIB a-šùr-ma-lik DUMU i-na-a a-na a-šùr-na-da DUMU … ù en-um-a-šùr DUMU … a-pu-tum a-na a-wa-at ṭup-pì-im iḫ-da … ša ú-…</li>\n</ul>\n<p>=&gt;\nSeal of Ashur-malik, son of Ina, to Ashur-nada, son of … and Enum-assur, son of …, Aputum, in accordance with the wording of the tablet …, who .</p>\n<ul>\n<li>ḫa-sí-sú …</li>\n</ul>\n<p>=&gt;\n. . . a scepter .</p>\n<p>In the second row, only the reserve_english part is valid:</p>\n<ul>\n<li>iš-tù ḫa-mu-uš-tim ša šu-be-lim DUMU a-na-lí a-na 8 ḫa-am-ša-tim i-ša-qal</li>\n</ul>\n<p>=&gt;\nFrom the mushtu-tree of Shubelum and to the 8 mushtu-trees he shall weigh out. That is what at that time</p>\n<p>(this translation is terrible. It probably should be: From the week of Šū-bēlum, son of Anali, he shall pay in 8 weeks.)</p>",
      "votes": 2,
      "replies": [
        {
          "id": 3387117,
          "author_name": "MJeremy",
          "author_url": "",
          "post_date": "2026-01-06T12:07:09.733000",
          "content": "<p>yeah, but the Akkadian from the link seems to be a different Akkadian from the training example, I think using these are training would deteriorite the model.</p>\n<p>My guess is it would work only if we can find the AI translations that matches the <code>transliteration_org</code>  in the dataset.</p>",
          "votes": 0,
          "replies": [
            {
              "id": 3387134,
              "author_name": "Tomorin",
              "author_url": "",
              "post_date": "2026-01-06T12:43:31.983000",
              "content": "<p>Yes, it's not the form this competition expects. As I mentioned, the two columns could only serve to locate their counterparts in the transliteration_org column. </p>\n<p>That said, the Akkadian columns are far from good splits of the transliteration_org documents. If time permits, you may build the aligned database through more advanced LLMs which could both split the sentences and better translate them.</p>",
              "votes": 1,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3387127,
      "author_name": "",
      "author_url": "",
      "post_date": "2026-01-06T12:33:04.193000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3386931": "From the published texts there's a link to the AI translation, where the competition mentioned it to be \"poorly translated\", but I believe it might still have some use.\n\nHere's the link to the notebook and processing to get those data:\n\nhttps://www.kaggle.com/code/zhangyue199/dpc-ai-translation-dataset/output?scriptVersionId=290276456\n\nI do have some confusion on the data, the AI translation page includes multiple sides of the tablet, e.g. obverse, reverse.\n\nBut the Akkadian there does not exactly match with the `transliteration` in the `publised_texts`, for which I am not sure how to match the `transliteration` to the `AI english`.\n\nAppreciate if anyone can shed some lights.",
    "3387129": "Just map them via the **cdli_id**. Although your current notebook doesn’t have a separate column for cdli_id, the cdli_id is included in **url_org** — you can extract it. Alternatively, you can rewrite the notebook to add a cdli_id column, which will allow matching with the content in published_texts.csv.\nAdditional Notes:\n1. The Akkadian content and AI-translated content on the original website have **multiple sides**, but this notebook only scrapes the \"Obverse\" side. For reference, the following oare_ids are the only ones from **train.csv that appear on the website**:\n```python\naefa478d-c47d-42d2-a3b5-3f150603ccee\n55b115ac-6a6d-48e6-86df-ff449b4b346b\n99923b12-2acd-4eb4-9e1a-56b85c475a76\n3e87aad8-cd8c-4f8d-96e9-c68e062d4a1a\n4beda101-a827-47e2-b47a-799fd8f68c07\n8f46f357-9971-427f-ac9a-7de23c9ce3a5\n```\n2. The transliteration on this website uses the **CDLI notation**, which differs from that of the competition. For example, this website uses \"a2\" instead of \"á\", along with other variations in capitalization and determiners — normalization is required.",
    "3386994": "I think the transliteration_org column is similar to that in the train.csv. And the English translation is in obverse_english and reserve_english columns. Unfortunately, these two columns contain only part of the translation, and you may deduce the corresponding transliteration extract from the two akkadian columns (these are another form of expressing akkadian I believe, possibly CDLI).\n\nFor instance, in the first row,\n\n- KIŠIB a-šùr-ma-lik DUMU i-na-a a-na a-šùr-na-da DUMU … ù en-um-a-šùr DUMU … a-pu-tum a-na a-wa-at ṭup-pì-im iḫ-da … ša ú-…\n\n=>\nSeal of Ashur-malik, son of Ina, to Ashur-nada, son of ... and Enum-assur, son of ..., Aputum, in accordance with the wording of the tablet ..., who .\n\n- ḫa-sí-sú …\n\n=>\n. . . a scepter .\n\nIn the second row, only the reserve_english part is valid:\n\n- iš-tù ḫa-mu-uš-tim ša šu-be-lim DUMU a-na-lí a-na 8 ḫa-am-ša-tim i-ša-qal\n\n=>\nFrom the mushtu-tree of Shubelum and to the 8 mushtu-trees he shall weigh out. That is what at that time\n\n(this translation is terrible. It probably should be: From the week of Šū-bēlum, son of Anali, he shall pay in 8 weeks.)",
    "3387127": ""
  }
}