{
  "id": 245126,
  "title": "Private update underway",
  "url": "/competitions/coleridgeinitiative-show-us-the-data/discussion/245126",
  "author_name": "",
  "post_date": "2021-06-09T19:14:16.599605900Z",
  "votes": 13,
  "comment_count": 5,
  "views": 0,
  "content": "<p>Hi all!</p>\n<p>As we noted when we updated the public test set, the private test set will also be receiving an update. That update is now complete, and we will be re-running all notebooks against the new private label set. Only the labels have changed - the actual documents remain the same.</p>\n<p>Please let us know if you have any questions.</p>",
  "messages": [
    {
      "id": "1342855",
      "postDate": "06/09/2021 19:14:16",
      "content": "<p>Hi all!</p>\n<p>As we noted when we updated the public test set, the private test set will also be receiving an update. That update is now complete, and we will be re-running all notebooks against the new private label set. Only the labels have changed - the actual documents remain the same.</p>\n<p>Please let us know if you have any questions.</p>",
      "rawMarkdown": "Hi all!\n\nAs we noted when we updated the public test set, the private test set will also be receiving an update. That update is now complete, and we will be re-running all notebooks against the new private label set. Only the labels have changed - the actual documents remain the same.\n\nPlease let us know if you have any questions.",
      "votes": null
    },
    {
      "id": "1343144",
      "postDate": "06/10/2021 04:35:21",
      "content": "<p><a href=\"https://www.kaggle.com/philculliton\" target=\"_blank\">@philculliton</a> <br>\nThanks for posting!</p>\n<p>When will the kernel re-running be executed?<br>\nThe re-runninng for public test took about a week.</p>\n<p>I'd like to know the results of this competition immediately after the Final Submission Deadline, if possible.</p>",
      "rawMarkdown": "philculliton \nThanks for posting!\n\nWhen will the kernel re-running be executed?\nThe re-runninng for public test took about a week.\n\nI'd like to know the results of this competition immediately after the Final Submission Deadline, if possible.",
      "votes": null
    },
    {
      "id": "1343476",
      "postDate": "06/10/2021 08:22:29",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/philculliton\" target=\"_blank\">@philculliton</a>, thanks for posting!</p>\n<p>I have a doubt about how the running of notebooks and scoring actually works for this competition (and, more generally, in Kaggle). I'm pretty sure others have the same doubt too, it would be great if you can provide us with a clear answer.</p>\n<p>The main question is the following:</p>\n<ul>\n<li>When computing the public and private score, are you running once the notebook on the full test (hidden and public) or twice (once in hidden and once in public)? In the first case, for computing the public and private scores, I assume you would select just the rows (and then compute the score) that corresponds to the hidden and public dataset respectively.</li>\n</ul>\n<p>Thanks!</p>",
      "rawMarkdown": "Hi @philculliton, thanks for posting!\n\nI have a doubt about how the running of notebooks and scoring actually works for this competition (and, more generally, in Kaggle). I'm pretty sure others have the same doubt too, it would be great if you can provide us with a clear answer.\n\nThe main question is the following:\n - When computing the public and private score, are you running once the notebook on the full test (hidden and public) or twice (once in hidden and once in public)? In the first case, for computing the public and private scores, I assume you would select just the rows (and then compute the score) that corresponds to the hidden and public dataset respectively.\n\nThanks!",
      "votes": null
    },
    {
      "id": "1343657",
      "postDate": "06/10/2021 10:59:12",
      "content": "<p><a href=\"https://www.kaggle.com/Jonathan\" target=\"_blank\">@Jonathan</a> Besomi As I know from the info of  disscussion before, just the private test set will be re-runned, because the public one have done this before.</p>",
      "rawMarkdown": "Jonathan Besomi As I know from the info of  disscussion before, just the private test set will be re-runned, because the public one have done this before.",
      "votes": null
    },
    {
      "id": "1344404",
      "postDate": "06/10/2021 22:41:36",
      "content": "<p>Thanks for notice. Do you mean added more labels for the test data? And from then the new submission score baded on new labels？when will the rurunning finish?</p>",
      "rawMarkdown": "Thanks for notice. Do you mean added more labels for the test data? And from then the new submission score baded on new labels？when will the rurunning finish?",
      "votes": null
    },
    {
      "id": "1345203",
      "postDate": "06/11/2021 11:53:35",
      "content": "<p>i think they are not running notebooks again. they are just running the scoring script on the submission file.</p>",
      "rawMarkdown": "i think they are not running notebooks again. they are just running the scoring script on the submission file.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1343144,
      "author_name": "spshota",
      "author_url": "",
      "post_date": "06/10/2021 04:35:21",
      "content": "<p><a href=\"https://www.kaggle.com/philculliton\" target=\"_blank\">@philculliton</a> <br>\nThanks for posting!</p>\n<p>When will the kernel re-running be executed?<br>\nThe re-runninng for public test took about a week.</p>\n<p>I'd like to know the results of this competition immediately after the Final Submission Deadline, if possible.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1343476,
      "author_name": "jonathanbesomi",
      "author_url": "",
      "post_date": "06/10/2021 08:22:29",
      "content": "<p>Hi <a href=\"https://www.kaggle.com/philculliton\" target=\"_blank\">@philculliton</a>, thanks for posting!</p>\n<p>I have a doubt about how the running of notebooks and scoring actually works for this competition (and, more generally, in Kaggle). I'm pretty sure others have the same doubt too, it would be great if you can provide us with a clear answer.</p>\n<p>The main question is the following:</p>\n<ul>\n<li>When computing the public and private score, are you running once the notebook on the full test (hidden and public) or twice (once in hidden and once in public)? In the first case, for computing the public and private scores, I assume you would select just the rows (and then compute the score) that corresponds to the hidden and public dataset respectively.</li>\n</ul>\n<p>Thanks!</p>",
      "votes": null,
      "replies": [
        {
          "id": 1343657,
          "author_name": "vanle73",
          "author_url": "",
          "post_date": "06/10/2021 10:59:12",
          "content": "<p><a href=\"https://www.kaggle.com/Jonathan\" target=\"_blank\">@Jonathan</a> Besomi As I know from the info of  disscussion before, just the private test set will be re-runned, because the public one have done this before.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1345203,
          "author_name": "udaygurugubelli",
          "author_url": "",
          "post_date": "06/11/2021 11:53:35",
          "content": "<p>i think they are not running notebooks again. they are just running the scoring script on the submission file.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1344404,
      "author_name": "youzi2016",
      "author_url": "",
      "post_date": "06/10/2021 22:41:36",
      "content": "<p>Thanks for notice. Do you mean added more labels for the test data? And from then the new submission score baded on new labels？when will the rurunning finish?</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1342855": "Hi all!\n\nAs we noted when we updated the public test set, the private test set will also be receiving an update. That update is now complete, and we will be re-running all notebooks against the new private label set. Only the labels have changed - the actual documents remain the same.\n\nPlease let us know if you have any questions.",
    "1343144": "philculliton \nThanks for posting!\n\nWhen will the kernel re-running be executed?\nThe re-runninng for public test took about a week.\n\nI'd like to know the results of this competition immediately after the Final Submission Deadline, if possible.",
    "1343476": "Hi @philculliton, thanks for posting!\n\nI have a doubt about how the running of notebooks and scoring actually works for this competition (and, more generally, in Kaggle). I'm pretty sure others have the same doubt too, it would be great if you can provide us with a clear answer.\n\nThe main question is the following:\n - When computing the public and private score, are you running once the notebook on the full test (hidden and public) or twice (once in hidden and once in public)? In the first case, for computing the public and private scores, I assume you would select just the rows (and then compute the score) that corresponds to the hidden and public dataset respectively.\n\nThanks!",
    "1343657": "Jonathan Besomi As I know from the info of  disscussion before, just the private test set will be re-runned, because the public one have done this before.",
    "1344404": "Thanks for notice. Do you mean added more labels for the test data? And from then the new submission score baded on new labels？when will the rurunning finish?",
    "1345203": "i think they are not running notebooks again. they are just running the scoring script on the submission file."
  },
  "source": "meta"
}