{
  "id": 685532,
  "title": "Update, Thursday 9 April: the leaderboard rescore is now complete",
  "url": "/competitions/cafa-6-protein-function-prediction/discussion/685532",
  "author_name": "MartynaPlomecka",
  "post_date": "2026-03-28T13:11:03.316000",
  "votes": 11,
  "comment_count": 21,
  "views": 0,
  "content": "<p><strong>Update, Thursday 9 April: the leaderboard rescore is now complete.</strong></p>\n<p>Hi everyone,</p>\n<p>We are rescoring the leaderboard. During this time, the leaderboard may look unstable or partially updated. We expect things to be a bit fluctuating for the next couple of days, and we'll post another update once rescoring is complete.</p>",
  "messages": [
    {
      "id": 3430442,
      "postDate": "2026-03-28T13:11:03.317Z",
      "content": "<p><strong>Update, Thursday 9 April: the leaderboard rescore is now complete.</strong></p>\n<p>Hi everyone,</p>\n<p>We are rescoring the leaderboard. During this time, the leaderboard may look unstable or partially updated. We expect things to be a bit fluctuating for the next couple of days, and we'll post another update once rescoring is complete.</p>",
      "rawMarkdown": "**Update, Thursday 9 April: the leaderboard rescore is now complete.**\n\nHi everyone,\n\nWe are rescoring the leaderboard. During this time, the leaderboard may look unstable or partially updated. We expect things to be a bit fluctuating for the next couple of days, and we'll post another update once rescoring is complete.\n\n\n",
      "votes": 11
    },
    {
      "id": 3432383,
      "postDate": "2026-03-31T14:26:43.300Z",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/martynaplomecka\" target=\"_blank\">@martynaplomecka</a>, is the rescoring still in progress? I’m not appearing on the leaderboard yet and wanted to check. Thanks!</p>",
      "rawMarkdown": "Hi @martynaplomecka, is the rescoring still in progress? I’m not appearing on the leaderboard yet and wanted to check. Thanks!",
      "votes": 1,
      "replies": [
        {
          "id": 3433620,
          "postDate": "2026-04-01T21:45:48.197Z",
          "content": "<p>It is still in progress</p>",
          "rawMarkdown": "It is still in progress",
          "votes": 1,
          "replies": [
            {
              "id": 3434838,
              "postDate": "2026-04-03T09:58:46.480Z",
              "content": "<p>till when can we see the rescoring completed.</p>",
              "rawMarkdown": "till when can we see the rescoring completed.",
              "votes": 1
            }
          ]
        }
      ]
    },
    {
      "id": 3446744,
      "postDate": "2026-04-22T03:46:56.083Z",
      "content": "<p>Awesome. Waiting for it. </p>",
      "rawMarkdown": "Awesome. Waiting for it. "
    },
    {
      "id": 3430564,
      "postDate": "2026-03-28T16:27:55.810Z",
      "content": "<p>Excuse me, does the updated leaderboard still use the original test set, or has it introduced some new test data?</p>",
      "rawMarkdown": "Excuse me, does the updated leaderboard still use the original test set, or has it introduced some new test data?",
      "replies": [
        {
          "id": 3430568,
          "postDate": "2026-03-28T16:33:10.870Z",
          "content": "<p>The updated leaderboard is a combination of the original test set and new data.</p>",
          "rawMarkdown": "The updated leaderboard is a combination of the original test set and new data.",
          "votes": 1,
          "replies": [
            {
              "id": 3430569,
              "postDate": "2026-03-28T16:35:02.957Z",
              "content": "<p>Thank you for your prompt reply!</p>",
              "rawMarkdown": "Thank you for your prompt reply!"
            },
            {
              "id": 3431175,
              "postDate": "2026-03-29T16:09:29.010Z",
              "content": "<p>But submission of direct csv was allowed, that doesnt should mean no new data?</p>",
              "rawMarkdown": "But submission of direct csv was allowed, that doesnt should mean no new data?"
            },
            {
              "id": 3431217,
              "postDate": "2026-03-29T17:20:02.887Z",
              "content": "<p>New data only contains GO terms that were accumulated after submissions closed. Original test set (that was used for the leaderboard during Oct to Feb) was also not released to the public. So, the updated leaderboard is calculated based on both new data and original test set.</p>",
              "rawMarkdown": "New data only contains GO terms that were accumulated after submissions closed. Original test set (that was used for the leaderboard during Oct to Feb) was also not released to the public. So, the updated leaderboard is calculated based on both new data and original test set.",
              "votes": 1
            },
            {
              "id": 3431219,
              "postDate": "2026-03-29T17:23:15.703Z",
              "content": "<p>Thanks for the fast clarification. Makes sense. Then all errors I'm seeing are just because rescore hasn't finished yet right?</p>",
              "rawMarkdown": "Thanks for the fast clarification. Makes sense. Then all errors I'm seeing are just because rescore hasn't finished yet right?"
            },
            {
              "id": 3431229,
              "postDate": "2026-03-29T17:39:57.907Z",
              "content": "<p>Yes, I believe so. Please wait for the next post from Kaggle Team once rescoring is complete.</p>",
              "rawMarkdown": "Yes, I believe so. Please wait for the next post from Kaggle Team once rescoring is complete.",
              "votes": 2
            },
            {
              "id": 3431909,
              "postDate": "2026-03-30T20:44:48.900Z",
              "content": "<p>In the final evaluation, the leaderboard will be based only on the test set after Feb right? </p>",
              "rawMarkdown": "In the final evaluation, the leaderboard will be based only on the test set after Feb right? "
            },
            {
              "id": 3433622,
              "postDate": "2026-04-01T21:46:37.287Z",
              "content": "<p>Since the original test set is still not visible to the public, the final evaluation will include those as well (in addition to the new test set after February)</p>",
              "rawMarkdown": "Since the original test set is still not visible to the public, the final evaluation will include those as well (in addition to the new test set after February)"
            },
            {
              "id": 3433633,
              "postDate": "2026-04-01T22:19:59.343Z",
              "content": "<p>I heard that only the test set after Feb will be included. Is data leakage a concern? During the competition, people were able to obtain a higher score using the public data (GOA). </p>",
              "rawMarkdown": "I heard that only the test set after Feb will be included. Is data leakage a concern? During the competition, people were able to obtain a higher score using the public data (GOA). "
            },
            {
              "id": 3433776,
              "postDate": "2026-04-02T05:51:04.767Z",
              "content": "<p>Totally agree, original public was \"visible\" via public score.</p>",
              "rawMarkdown": "Totally agree, original public was \"visible\" via public score."
            },
            {
              "id": 3438809,
              "postDate": "2026-04-09T18:24:03.383Z",
              "content": "<p>Furthermore, even if there is no data leakage, it encourages the model to overfit the data. Since this is a competition involving future data, it doesn't make much sense to include the original dataset. </p>",
              "rawMarkdown": "Furthermore, even if there is no data leakage, it encourages the model to overfit the data. Since this is a competition involving future data, it doesn't make much sense to include the original dataset. ",
              "votes": 1
            }
          ]
        }
      ]
    },
    {
      "id": 3448000,
      "postDate": "2026-04-24T12:28:34.787Z",
      "rawMarkdown": "",
      "votes": -1,
      "isDeleted": true
    },
    {
      "id": 3438587,
      "postDate": "2026-04-09T11:58:54.980Z",
      "rawMarkdown": "",
      "votes": -3,
      "isDeleted": true,
      "replies": [
        {
          "id": 3438607,
          "postDate": "2026-04-09T12:37:12.230Z",
          "rawMarkdown": "",
          "votes": -1,
          "isDeleted": true,
          "replies": [
            {
              "id": 3438962,
              "postDate": "2026-04-10T03:02:28.540Z",
              "rawMarkdown": "",
              "isDeleted": true
            }
          ]
        }
      ]
    },
    {
      "id": 3436987,
      "postDate": "2026-04-07T00:36:32.300Z",
      "rawMarkdown": "",
      "votes": 1,
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 3432383,
      "author_name": "Lonnie",
      "author_url": "",
      "post_date": "2026-03-31T14:26:43.300000",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/martynaplomecka\" target=\"_blank\">@martynaplomecka</a>, is the rescoring still in progress? I’m not appearing on the leaderboard yet and wanted to check. Thanks!</p>",
      "votes": 1,
      "replies": [
        {
          "id": 3433620,
          "author_name": "An Phan",
          "author_url": "",
          "post_date": "2026-04-01T21:45:48.197000",
          "content": "<p>It is still in progress</p>",
          "votes": 1,
          "replies": [
            {
              "id": 3434838,
              "author_name": "OverfitOracle",
              "author_url": "",
              "post_date": "2026-04-03T09:58:46.480000",
              "content": "<p>till when can we see the rescoring completed.</p>",
              "votes": 1,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3446744,
      "author_name": "Nihal Vellaramkallingal Sulaiman",
      "author_url": "",
      "post_date": "2026-04-22T03:46:56.083000",
      "content": "<p>Awesome. Waiting for it. </p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 3430564,
      "author_name": "轨迹",
      "author_url": "",
      "post_date": "2026-03-28T16:27:55.810000",
      "content": "<p>Excuse me, does the updated leaderboard still use the original test set, or has it introduced some new test data?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 3430568,
          "author_name": "An Phan",
          "author_url": "",
          "post_date": "2026-03-28T16:33:10.870000",
          "content": "<p>The updated leaderboard is a combination of the original test set and new data.</p>",
          "votes": 1,
          "replies": [
            {
              "id": 3430569,
              "author_name": "轨迹",
              "author_url": "",
              "post_date": "2026-03-28T16:35:02.957000",
              "content": "<p>Thank you for your prompt reply!</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3431175,
              "author_name": "Ángel Jacinto Sánchez Ruiz",
              "author_url": "",
              "post_date": "2026-03-29T16:09:29.010000",
              "content": "<p>But submission of direct csv was allowed, that doesnt should mean no new data?</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3431217,
              "author_name": "An Phan",
              "author_url": "",
              "post_date": "2026-03-29T17:20:02.887000",
              "content": "<p>New data only contains GO terms that were accumulated after submissions closed. Original test set (that was used for the leaderboard during Oct to Feb) was also not released to the public. So, the updated leaderboard is calculated based on both new data and original test set.</p>",
              "votes": 1,
              "replies": []
            },
            {
              "id": 3431219,
              "author_name": "Ángel Jacinto Sánchez Ruiz",
              "author_url": "",
              "post_date": "2026-03-29T17:23:15.703000",
              "content": "<p>Thanks for the fast clarification. Makes sense. Then all errors I'm seeing are just because rescore hasn't finished yet right?</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3431229,
              "author_name": "An Phan",
              "author_url": "",
              "post_date": "2026-03-29T17:39:57.907000",
              "content": "<p>Yes, I believe so. Please wait for the next post from Kaggle Team once rescoring is complete.</p>",
              "votes": 2,
              "replies": []
            },
            {
              "id": 3431909,
              "author_name": "Guojun1",
              "author_url": "",
              "post_date": "2026-03-30T20:44:48.900000",
              "content": "<p>In the final evaluation, the leaderboard will be based only on the test set after Feb right? </p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3433622,
              "author_name": "An Phan",
              "author_url": "",
              "post_date": "2026-04-01T21:46:37.287000",
              "content": "<p>Since the original test set is still not visible to the public, the final evaluation will include those as well (in addition to the new test set after February)</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3433633,
              "author_name": "Guojun1",
              "author_url": "",
              "post_date": "2026-04-01T22:19:59.343000",
              "content": "<p>I heard that only the test set after Feb will be included. Is data leakage a concern? During the competition, people were able to obtain a higher score using the public data (GOA). </p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3433776,
              "author_name": "Ángel Jacinto Sánchez Ruiz",
              "author_url": "",
              "post_date": "2026-04-02T05:51:04.767000",
              "content": "<p>Totally agree, original public was \"visible\" via public score.</p>",
              "votes": 0,
              "replies": []
            },
            {
              "id": 3438809,
              "author_name": "Guojun1",
              "author_url": "",
              "post_date": "2026-04-09T18:24:03.383000",
              "content": "<p>Furthermore, even if there is no data leakage, it encourages the model to overfit the data. Since this is a competition involving future data, it doesn't make much sense to include the original dataset. </p>",
              "votes": 1,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3448000,
      "author_name": "",
      "author_url": "",
      "post_date": "2026-04-24T12:28:34.787000",
      "content": "",
      "votes": -1,
      "replies": []
    },
    {
      "id": 3438587,
      "author_name": "",
      "author_url": "",
      "post_date": "2026-04-09T11:58:54.980000",
      "content": "",
      "votes": -3,
      "replies": [
        {
          "id": 3438607,
          "author_name": "",
          "author_url": "",
          "post_date": "2026-04-09T12:37:12.230000",
          "content": "",
          "votes": -1,
          "replies": [
            {
              "id": 3438962,
              "author_name": "",
              "author_url": "",
              "post_date": "2026-04-10T03:02:28.540000",
              "content": "",
              "votes": 0,
              "replies": []
            }
          ]
        }
      ]
    },
    {
      "id": 3436987,
      "author_name": "",
      "author_url": "",
      "post_date": "2026-04-07T00:36:32.300000",
      "content": "",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3430442": "**Update, Thursday 9 April: the leaderboard rescore is now complete.**\n\nHi everyone,\n\nWe are rescoring the leaderboard. During this time, the leaderboard may look unstable or partially updated. We expect things to be a bit fluctuating for the next couple of days, and we'll post another update once rescoring is complete.\n\n\n",
    "3432383": "Hi @martynaplomecka, is the rescoring still in progress? I’m not appearing on the leaderboard yet and wanted to check. Thanks!",
    "3446744": "Awesome. Waiting for it. ",
    "3430564": "Excuse me, does the updated leaderboard still use the original test set, or has it introduced some new test data?",
    "3448000": "",
    "3438587": "",
    "3436987": ""
  }
}