{
  "id": 679878,
  "title": "Question about Score Discrepancies",
  "url": "/competitions/deep-past-initiative-machine-translation/discussion/679878",
  "author_name": "",
  "post_date": "2026-03-04T10:42:02.378292500Z",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi everyone—thank you for running this competition. I have a quick question about scoring.\nI recently joined this competition and noticed that the following three scores do not match:</p>\n<p><em>・the score shown in the list on the competition page’s Code tab</em></p>\n<p><em>・the score shown on the notebook’s individual page</em></p>\n<p><em>・the score I actually receive when I submit the notebook</em></p>\n<p>Is this discrepancy due to a dataset update from a few weeks ago, or is it expected behavior specific to this competition?\nI’m seeing a similar situation in the currently running Stanford RNA competition as well.</p>\n<p>If this has already been answered elsewhere, I’d be grateful if you could point me to the relevant discussion. Thank you!</p>",
  "messages": [
    {
      "id": "3417019",
      "postDate": "03/04/2026 10:42:02",
      "content": "<p>Hi everyone—thank you for running this competition. I have a quick question about scoring.\nI recently joined this competition and noticed that the following three scores do not match:</p>\n<p><em>・the score shown in the list on the competition page’s Code tab</em></p>\n<p><em>・the score shown on the notebook’s individual page</em></p>\n<p><em>・the score I actually receive when I submit the notebook</em></p>\n<p>Is this discrepancy due to a dataset update from a few weeks ago, or is it expected behavior specific to this competition?\nI’m seeing a similar situation in the currently running Stanford RNA competition as well.</p>\n<p>If this has already been answered elsewhere, I’d be grateful if you could point me to the relevant discussion. Thank you!</p>",
      "rawMarkdown": "Hi everyone—thank you for running this competition. I have a quick question about scoring.\nI recently joined this competition and noticed that the following three scores do not match:\n\n\n*・the score shown in the list on the competition page’s Code tab*\n\n*・the score shown on the notebook’s individual page*\n\n*・the score I actually receive when I submit the notebook*\n\n\nIs this discrepancy due to a dataset update from a few weeks ago, or is it expected behavior specific to this competition?\nI’m seeing a similar situation in the currently running Stanford RNA competition as well.\n\nIf this has already been answered elsewhere, I’d be grateful if you could point me to the relevant discussion. Thank you!",
      "votes": null
    },
    {
      "id": "3417074",
      "postDate": "03/04/2026 14:46:28",
      "content": "<p>・the score shown on the notebook’s individual page</p>\n<p>・the score I actually receive when I submit the notebook</p>\n<p>Probably due to the rescore, but these two should match tho</p>",
      "rawMarkdown": "・the score shown on the notebook’s individual page\n\n・the score I actually receive when I submit the notebook\n\nProbably due to the rescore, but these two should match tho",
      "votes": null
    },
    {
      "id": "3417951",
      "postDate": "03/06/2026 17:55:23",
      "content": "<p>Thanks for your reply.\nFor some reason these two scores also didn't match, but I hope that will be resolved.</p>",
      "rawMarkdown": "Thanks for your reply.\nFor some reason these two scores also didn't match, but I hope that will be resolved.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3417074,
      "author_name": "honganzhu",
      "author_url": "",
      "post_date": "03/04/2026 14:46:28",
      "content": "<p>・the score shown on the notebook’s individual page</p>\n<p>・the score I actually receive when I submit the notebook</p>\n<p>Probably due to the rescore, but these two should match tho</p>",
      "votes": null,
      "replies": [
        {
          "id": 3417951,
          "author_name": "keisukeyokota0428",
          "author_url": "",
          "post_date": "03/06/2026 17:55:23",
          "content": "<p>Thanks for your reply.\nFor some reason these two scores also didn't match, but I hope that will be resolved.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3417019": "Hi everyone—thank you for running this competition. I have a quick question about scoring.\nI recently joined this competition and noticed that the following three scores do not match:\n\n\n*・the score shown in the list on the competition page’s Code tab*\n\n*・the score shown on the notebook’s individual page*\n\n*・the score I actually receive when I submit the notebook*\n\n\nIs this discrepancy due to a dataset update from a few weeks ago, or is it expected behavior specific to this competition?\nI’m seeing a similar situation in the currently running Stanford RNA competition as well.\n\nIf this has already been answered elsewhere, I’d be grateful if you could point me to the relevant discussion. Thank you!",
    "3417074": "・the score shown on the notebook’s individual page\n\n・the score I actually receive when I submit the notebook\n\nProbably due to the rescore, but these two should match tho",
    "3417951": "Thanks for your reply.\nFor some reason these two scores also didn't match, but I hope that will be resolved."
  },
  "source": "meta"
}