{
  "id": 459796,
  "title": "Leaderboard Shakeup",
  "url": "/competitions/child-mind-institute-detect-sleep-states/discussion/459796",
  "author_name": "",
  "post_date": "2023-12-06T16:39:39.623391Z",
  "votes": 5,
  "comment_count": 3,
  "views": 0,
  "content": "<p>I just generated interactive shakeup plots for this competition. You can view them and some other stats here:<br>\n<a href=\"https://www.kaggle.com/code/fritzcremer/cmidss-leaderboard-shakeup\" target=\"_blank\">https://www.kaggle.com/code/fritzcremer/cmidss-leaderboard-shakeup</a></p>\n<p>I am happy to see that the shakeup was rather mild in this competition, though there were a few larger jumps:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6735218%2Ff62e237164199ebdc0b1cc1d09287500%2Fshakeup_cmidss.PNG?generation=1701880547012070&amp;alt=media\" alt=\"\"></p>\n<p>Here is also the score shakeup for the Public scores &gt; 0.707:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6735218%2F15a4519ca049c6deb7e85da95079a1df%2Fshakeup_cmidss_score.PNG?generation=1701880744280237&amp;alt=media\" alt=\"\"></p>",
  "messages": [
    {
      "id": "2551343",
      "postDate": "12/06/2023 16:39:39",
      "content": "<p>I just generated interactive shakeup plots for this competition. You can view them and some other stats here:<br>\n<a href=\"https://www.kaggle.com/code/fritzcremer/cmidss-leaderboard-shakeup\" target=\"_blank\">https://www.kaggle.com/code/fritzcremer/cmidss-leaderboard-shakeup</a></p>\n<p>I am happy to see that the shakeup was rather mild in this competition, though there were a few larger jumps:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6735218%2Ff62e237164199ebdc0b1cc1d09287500%2Fshakeup_cmidss.PNG?generation=1701880547012070&amp;alt=media\" alt=\"\"></p>\n<p>Here is also the score shakeup for the Public scores &gt; 0.707:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6735218%2F15a4519ca049c6deb7e85da95079a1df%2Fshakeup_cmidss_score.PNG?generation=1701880744280237&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "I just generated interactive shakeup plots for this competition. You can view them and some other stats here:\nhttps://www.kaggle.com/code/fritzcremer/cmidss-leaderboard-shakeup\n\nI am happy to see that the shakeup was rather mild in this competition, though there were a few larger jumps:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6735218%2Ff62e237164199ebdc0b1cc1d09287500%2Fshakeup_cmidss.PNG?generation=1701880547012070&alt=media)\n\nHere is also the score shakeup for the Public scores > 0.707:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6735218%2F15a4519ca049c6deb7e85da95079a1df%2Fshakeup_cmidss_score.PNG?generation=1701880744280237&alt=media)",
      "votes": null
    },
    {
      "id": "2551360",
      "postDate": "12/06/2023 16:52:14",
      "content": "<p>Very interesting rectangle on the first graph! I suppose that's probably an artifact of the high-scoring public notebook? … interesting! Do you have any other insight into what caused that strange shape?</p>",
      "rawMarkdown": "Very interesting rectangle on the first graph! I suppose that's probably an artifact of the high-scoring public notebook? ... interesting! Do you have any other insight into what caused that strange shape?",
      "votes": null
    },
    {
      "id": "2551383",
      "postDate": "12/06/2023 17:02:11",
      "content": "<p>Interesting indeed. The \"iso line\" extends from about rank 400 to rank 800. This is the diagonal of the rectangle and these are participants who submitted the public notebook <strong>as is</strong> without any changes. (Their rank is order by <strong>time</strong> of submission).</p>\n<p>Next, if you made <strong>any change at all</strong> then then you jump to either rank 400 or rank 800. This is the rectangle.</p>",
      "rawMarkdown": "Interesting indeed. The \"iso line\" extends from about rank 400 to rank 800. This is the diagonal of the rectangle and these are participants who submitted the public notebook **as is** without any changes. (Their rank is order by **time** of submission).\n\nNext, if you made **any change at all** then then you jump to either rank 400 or rank 800. This is the rectangle.",
      "votes": null
    },
    {
      "id": "2551413",
      "postDate": "12/06/2023 17:24:02",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3293834%2F87bb9bcfbba342a503790a730af341de%2Fuppershake.png?generation=1701882057534948&amp;alt=media\" alt=\"\"></p>\n<p>Additional plot of Rank Shakeup for relatively high scores (~274 Public Rank)</p>\n<p>Thanks for your information!</p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3293834%2F87bb9bcfbba342a503790a730af341de%2Fuppershake.png?generation=1701882057534948&alt=media)\n\n Additional plot of Rank Shakeup for relatively high scores (~274 Public Rank)\n\nThanks for your information!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2551360,
      "author_name": "chris62",
      "author_url": "",
      "post_date": "12/06/2023 16:52:14",
      "content": "<p>Very interesting rectangle on the first graph! I suppose that's probably an artifact of the high-scoring public notebook? … interesting! Do you have any other insight into what caused that strange shape?</p>",
      "votes": null,
      "replies": [
        {
          "id": 2551383,
          "author_name": "cdeotte",
          "author_url": "",
          "post_date": "12/06/2023 17:02:11",
          "content": "<p>Interesting indeed. The \"iso line\" extends from about rank 400 to rank 800. This is the diagonal of the rectangle and these are participants who submitted the public notebook <strong>as is</strong> without any changes. (Their rank is order by <strong>time</strong> of submission).</p>\n<p>Next, if you made <strong>any change at all</strong> then then you jump to either rank 400 or rank 800. This is the rectangle.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2551413,
      "author_name": "danielchae",
      "author_url": "",
      "post_date": "12/06/2023 17:24:02",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3293834%2F87bb9bcfbba342a503790a730af341de%2Fuppershake.png?generation=1701882057534948&amp;alt=media\" alt=\"\"></p>\n<p>Additional plot of Rank Shakeup for relatively high scores (~274 Public Rank)</p>\n<p>Thanks for your information!</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2551343": "I just generated interactive shakeup plots for this competition. You can view them and some other stats here:\nhttps://www.kaggle.com/code/fritzcremer/cmidss-leaderboard-shakeup\n\nI am happy to see that the shakeup was rather mild in this competition, though there were a few larger jumps:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6735218%2Ff62e237164199ebdc0b1cc1d09287500%2Fshakeup_cmidss.PNG?generation=1701880547012070&alt=media)\n\nHere is also the score shakeup for the Public scores > 0.707:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6735218%2F15a4519ca049c6deb7e85da95079a1df%2Fshakeup_cmidss_score.PNG?generation=1701880744280237&alt=media)",
    "2551360": "Very interesting rectangle on the first graph! I suppose that's probably an artifact of the high-scoring public notebook? ... interesting! Do you have any other insight into what caused that strange shape?",
    "2551383": "Interesting indeed. The \"iso line\" extends from about rank 400 to rank 800. This is the diagonal of the rectangle and these are participants who submitted the public notebook **as is** without any changes. (Their rank is order by **time** of submission).\n\nNext, if you made **any change at all** then then you jump to either rank 400 or rank 800. This is the rectangle.",
    "2551413": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3293834%2F87bb9bcfbba342a503790a730af341de%2Fuppershake.png?generation=1701882057534948&alt=media)\n\n Additional plot of Rank Shakeup for relatively high scores (~274 Public Rank)\n\nThanks for your information!"
  },
  "source": "meta"
}