{
  "id": 245830,
  "title": "1st time submission Notebook has been running for 5 hours",
  "url": "/competitions/coleridgeinitiative-show-us-the-data/discussion/245830",
  "author_name": "",
  "post_date": "2021-06-12T14:34:07.440052600Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Hi, I saved and committed my notebook by just 2 minutes and it gave out the result, but after I submitted it, it has been spending 5 hours on running, and does not show me the score. Something is not right here. I know that the hidden test set is about 9000 rows, but I wonder \"is it normal to take more than 5 hours in general to get a score after submitting?\" Thanks!</p>",
  "messages": [
    {
      "id": "1346668",
      "postDate": "06/12/2021 14:34:07",
      "content": "<p>Hi, I saved and committed my notebook by just 2 minutes and it gave out the result, but after I submitted it, it has been spending 5 hours on running, and does not show me the score. Something is not right here. I know that the hidden test set is about 9000 rows, but I wonder \"is it normal to take more than 5 hours in general to get a score after submitting?\" Thanks!</p>",
      "rawMarkdown": "Hi, I saved and committed my notebook by just 2 minutes and it gave out the result, but after I submitted it, it has been spending 5 hours on running, and does not show me the score. Something is not right here. I know that the hidden test set is about 9000 rows, but I wonder \"is it normal to take more than 5 hours in general to get a score after submitting?\" Thanks!",
      "votes": null
    },
    {
      "id": "1346705",
      "postDate": "06/12/2021 14:55:12",
      "content": "<p>Same thing happens to me, running the kernel by hand only on the public test is quite fast, once you submit it and it runs on the whole private test it takes much longer</p>",
      "rawMarkdown": "Same thing happens to me, running the kernel by hand only on the public test is quite fast, once you submit it and it runs on the whole private test it takes much longer",
      "votes": null
    },
    {
      "id": "1346730",
      "postDate": "06/12/2021 15:19:52",
      "content": "<p>I see. Thanks!</p>",
      "rawMarkdown": "I see. Thanks!",
      "votes": null
    },
    {
      "id": "1346905",
      "postDate": "06/12/2021 18:35:11",
      "content": "<p>When you click “run all” in the notebook it only processes 4 files. When you hit “submit” it goes through several thousand.  Multiply the time it took for your code to run with 4 files by 2,000 or so and you should be able to get a rough estimate of how long your submission should take. </p>\n<p>This isn’t quite right because I’m assuming a lot of the time spent when you run it on 4 files is on setting up your models and you wouldn’t need to set up your models 2000 times. So maybe subtract how much time you think it takes to set up your models and then multiply by 2,000. </p>\n<p>Another factor is that the file lengths are all different so who is to say if these 4 files are representative of the average length?</p>\n<p>Completing within the allotted time and estimating the speed of your approach is part of the challenge. </p>",
      "rawMarkdown": "When you click “run all” in the notebook it only processes 4 files. When you hit “submit” it goes through several thousand.  Multiply the time it took for your code to run with 4 files by 2,000 or so and you should be able to get a rough estimate of how long your submission should take. \n\nThis isn’t quite right because I’m assuming a lot of the time spent when you run it on 4 files is on setting up your models and you wouldn’t need to set up your models 2000 times. So maybe subtract how much time you think it takes to set up your models and then multiply by 2,000. \n\nAnother factor is that the file lengths are all different so who is to say if these 4 files are representative of the average length?\n\nCompleting within the allotted time and estimating the speed of your approach is part of the challenge.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1346705,
      "author_name": "victorasso",
      "author_url": "",
      "post_date": "06/12/2021 14:55:12",
      "content": "<p>Same thing happens to me, running the kernel by hand only on the public test is quite fast, once you submit it and it runs on the whole private test it takes much longer</p>",
      "votes": null,
      "replies": [
        {
          "id": 1346730,
          "author_name": "yus002",
          "author_url": "",
          "post_date": "06/12/2021 15:19:52",
          "content": "<p>I see. Thanks!</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1346905,
          "author_name": "nbroad",
          "author_url": "",
          "post_date": "06/12/2021 18:35:11",
          "content": "<p>When you click “run all” in the notebook it only processes 4 files. When you hit “submit” it goes through several thousand.  Multiply the time it took for your code to run with 4 files by 2,000 or so and you should be able to get a rough estimate of how long your submission should take. </p>\n<p>This isn’t quite right because I’m assuming a lot of the time spent when you run it on 4 files is on setting up your models and you wouldn’t need to set up your models 2000 times. So maybe subtract how much time you think it takes to set up your models and then multiply by 2,000. </p>\n<p>Another factor is that the file lengths are all different so who is to say if these 4 files are representative of the average length?</p>\n<p>Completing within the allotted time and estimating the speed of your approach is part of the challenge. </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1346668": "Hi, I saved and committed my notebook by just 2 minutes and it gave out the result, but after I submitted it, it has been spending 5 hours on running, and does not show me the score. Something is not right here. I know that the hidden test set is about 9000 rows, but I wonder \"is it normal to take more than 5 hours in general to get a score after submitting?\" Thanks!",
    "1346705": "Same thing happens to me, running the kernel by hand only on the public test is quite fast, once you submit it and it runs on the whole private test it takes much longer",
    "1346730": "I see. Thanks!",
    "1346905": "When you click “run all” in the notebook it only processes 4 files. When you hit “submit” it goes through several thousand.  Multiply the time it took for your code to run with 4 files by 2,000 or so and you should be able to get a rough estimate of how long your submission should take. \n\nThis isn’t quite right because I’m assuming a lot of the time spent when you run it on 4 files is on setting up your models and you wouldn’t need to set up your models 2000 times. So maybe subtract how much time you think it takes to set up your models and then multiply by 2,000. \n\nAnother factor is that the file lengths are all different so who is to say if these 4 files are representative of the average length?\n\nCompleting within the allotted time and estimating the speed of your approach is part of the challenge."
  },
  "source": "meta"
}