{
  "id": 349461,
  "title": "First Leaderboard Update",
  "url": "/competitions/AI4Code/discussion/349461",
  "author_name": "Ryan Holbrook",
  "post_date": "2022-09-01T12:36:07.993000",
  "votes": 10,
  "comment_count": 11,
  "views": 0,
  "content": "<p> New leaderboard is up!</p>\n<p>Also, you may have seen an earlier rerun of a submission that failed due to being <code>Cancelled</code>. This was just an initial test that we didn't run to completion.</p>",
  "messages": [
    {
      "id": 1922355,
      "postDate": "2022-09-01T12:36:07.993Z",
      "content": "<p> New leaderboard is up!</p>\n<p>Also, you may have seen an earlier rerun of a submission that failed due to being <code>Cancelled</code>. This was just an initial test that we didn't run to completion.</p>",
      "rawMarkdown": "~~We're in the process of the first leaderboard update on new data. The leaderboard may be in a strange state for a bit, but we'll have everything up to date shortly.~~ New leaderboard is up!\n\nAlso, you may have seen an earlier rerun of a submission that failed due to being `Cancelled`. This was just an initial test that we didn't run to completion.",
      "votes": 10
    },
    {
      "id": 1922459,
      "postDate": "2022-09-01T13:54:44.620Z",
      "content": "<p>Is this round of evaluation completely finalized? Could we get a rough figure on how many notebooks were used in this first round of evaluation? We see some participants disappearing from the leaderboard, is there any particular reason? </p>",
      "rawMarkdown": "Is this round of evaluation completely finalized? Could we get a rough figure on how many notebooks were used in this first round of evaluation? We see some participants disappearing from the leaderboard, is there any particular reason? ",
      "votes": 1,
      "replies": [
        {
          "id": 1922487,
          "postDate": "2022-09-01T14:20:40.943Z",
          "content": "<p>Yes, the current leaderboard reflects the first update, which consisted of several thousand notebooks.</p>\n<p>A team may have disappeared from the leaderboard if their submission failed to run on the new data. The failures seem to have been forks of a couple popular public notebooks that failed the rerun due to missing external datasets.</p>",
          "rawMarkdown": "Yes, the current leaderboard reflects the first update, which consisted of several thousand notebooks.\n\nA team may have disappeared from the leaderboard if their submission failed to run on the new data. The failures seem to have been forks of a couple popular public notebooks that failed the rerun due to missing external datasets.",
          "votes": 4
        },
        {
          "id": 1922504,
          "postDate": "2022-09-01T14:29:46.050Z",
          "content": "<p>Sadly I've been removed from the leaderboard. Can you please at least post what causes the failure?</p>",
          "rawMarkdown": "Sadly I've been removed from the leaderboard. Can you please at least post what causes the failure?",
          "votes": 1
        },
        {
          "id": 1925968,
          "postDate": "2022-09-04T13:06:38.657Z",
          "content": "<p><a href=\"https://www.kaggle.com/snaker\" target=\"_blank\">@snaker</a> This is unfortunate. Did you find out why?</p>",
          "rawMarkdown": "@snaker This is unfortunate. Did you find out why?"
        },
        {
          "id": 1926022,
          "postDate": "2022-09-04T13:53:11.807Z",
          "content": "<p>Not yet, still no reply from official </p>",
          "rawMarkdown": "Not yet, still no reply from official "
        }
      ]
    },
    {
      "id": 1925977,
      "postDate": "2022-09-04T13:17:21.497Z",
      "content": "<p>Can you tell me the plan for when the next updates are coming?</p>",
      "rawMarkdown": "Can you tell me the plan for when the next updates are coming?",
      "replies": [
        {
          "id": 1926203,
          "postDate": "2022-09-04T16:21:02.403Z",
          "content": "<p>The official has said the update will occur about every 2 weeks.</p>",
          "rawMarkdown": "The official has said the update will occur about every 2 weeks.",
          "votes": 1
        },
        {
          "id": 1940407,
          "postDate": "2022-09-15T10:44:34.827Z",
          "content": "<p>It has been 2 weeks :) </p>",
          "rawMarkdown": "It has been 2 weeks :) "
        },
        {
          "id": 1940516,
          "postDate": "2022-09-15T12:12:29.103Z",
          "content": "<p>Maybe still need some days to see the 2nd update after some new contests launch.</p>",
          "rawMarkdown": "Maybe still need some days to see the 2nd update after some new contests launch.",
          "votes": 1
        },
        {
          "id": 1940916,
          "postDate": "2022-09-15T16:25:46.067Z",
          "content": "<p>Is it a manual or automatic rerun?</p>",
          "rawMarkdown": "Is it a manual or automatic rerun?",
          "votes": 1
        }
      ]
    },
    {
      "id": 1922471,
      "postDate": "2022-09-01T14:07:02.640Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1922459,
      "author_name": "ShinSiang",
      "author_url": "",
      "post_date": "2022-09-01T13:54:44.620000",
      "content": "<p>Is this round of evaluation completely finalized? Could we get a rough figure on how many notebooks were used in this first round of evaluation? We see some participants disappearing from the leaderboard, is there any particular reason? </p>",
      "votes": 1,
      "replies": [
        {
          "id": 1922487,
          "author_name": "Ryan Holbrook",
          "author_url": "",
          "post_date": "2022-09-01T14:20:40.943000",
          "content": "<p>Yes, the current leaderboard reflects the first update, which consisted of several thousand notebooks.</p>\n<p>A team may have disappeared from the leaderboard if their submission failed to run on the new data. The failures seem to have been forks of a couple popular public notebooks that failed the rerun due to missing external datasets.</p>",
          "votes": 4,
          "replies": []
        },
        {
          "id": 1922504,
          "author_name": "Chenglu",
          "author_url": "",
          "post_date": "2022-09-01T14:29:46.050000",
          "content": "<p>Sadly I've been removed from the leaderboard. Can you please at least post what causes the failure?</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1925968,
          "author_name": "Allohvk",
          "author_url": "",
          "post_date": "2022-09-04T13:06:38.657000",
          "content": "<p><a href=\"https://www.kaggle.com/snaker\" target=\"_blank\">@snaker</a> This is unfortunate. Did you find out why?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1926022,
          "author_name": "Chenglu",
          "author_url": "",
          "post_date": "2022-09-04T13:53:11.807000",
          "content": "<p>Not yet, still no reply from official </p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 1925977,
      "author_name": "Mark Baushenko",
      "author_url": "",
      "post_date": "2022-09-04T13:17:21.497000",
      "content": "<p>Can you tell me the plan for when the next updates are coming?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 1926203,
          "author_name": "gezi",
          "author_url": "",
          "post_date": "2022-09-04T16:21:02.403000",
          "content": "<p>The official has said the update will occur about every 2 weeks.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1940407,
          "author_name": "ShinSiang",
          "author_url": "",
          "post_date": "2022-09-15T10:44:34.827000",
          "content": "<p>It has been 2 weeks :) </p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 1940516,
          "author_name": "gezi",
          "author_url": "",
          "post_date": "2022-09-15T12:12:29.103000",
          "content": "<p>Maybe still need some days to see the 2nd update after some new contests launch.</p>",
          "votes": 1,
          "replies": []
        },
        {
          "id": 1940916,
          "author_name": "CroDoc",
          "author_url": "",
          "post_date": "2022-09-15T16:25:46.067000",
          "content": "<p>Is it a manual or automatic rerun?</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1922471,
      "author_name": "",
      "author_url": "",
      "post_date": "2022-09-01T14:07:02.640000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1922355": "~~We're in the process of the first leaderboard update on new data. The leaderboard may be in a strange state for a bit, but we'll have everything up to date shortly.~~ New leaderboard is up!\n\nAlso, you may have seen an earlier rerun of a submission that failed due to being `Cancelled`. This was just an initial test that we didn't run to completion.",
    "1922459": "Is this round of evaluation completely finalized? Could we get a rough figure on how many notebooks were used in this first round of evaluation? We see some participants disappearing from the leaderboard, is there any particular reason? ",
    "1925977": "Can you tell me the plan for when the next updates are coming?",
    "1922471": ""
  }
}