{
  "id": 241480,
  "title": "Submission takes forever even though code runs quick. ",
  "url": "/competitions/coleridgeinitiative-show-us-the-data/discussion/241480",
  "author_name": "",
  "post_date": "2021-05-24T17:49:25.796154900Z",
  "votes": 2,
  "comment_count": 4,
  "views": 0,
  "content": "<p>Hey, although my code runs quickly and properly executes in the notebook once I submit it the notebook seems to run forever and eventually leads to a notebook timeout error. Is anyone else facing this issue, or has anyone solved this before?</p>\n<p>I am using external (public) datasets in my code if that's a clarification necessary.</p>",
  "messages": [
    {
      "id": "1321480",
      "postDate": "05/24/2021 17:49:25",
      "content": "<p>Hey, although my code runs quickly and properly executes in the notebook once I submit it the notebook seems to run forever and eventually leads to a notebook timeout error. Is anyone else facing this issue, or has anyone solved this before?</p>\n<p>I am using external (public) datasets in my code if that's a clarification necessary.</p>",
      "rawMarkdown": "Hey, although my code runs quickly and properly executes in the notebook once I submit it the notebook seems to run forever and eventually leads to a notebook timeout error. Is anyone else facing this issue, or has anyone solved this before?\n\nI am using external (public) datasets in my code if that's a clarification necessary.",
      "votes": null
    },
    {
      "id": "1321736",
      "postDate": "05/24/2021 22:47:52",
      "content": "<p>There are about 8000 papers in the test set - so you should calculate how long it takes to run 100 papers in training and multiply that by 80 - that time needs to be under 9 hrs or it will time out.  Also try running GPU if you aren't.</p>",
      "rawMarkdown": "There are about 8000 papers in the test set - so you should calculate how long it takes to run 100 papers in training and multiply that by 80 - that time needs to be under 9 hrs or it will time out.  Also try running GPU if you aren't.",
      "votes": null
    },
    {
      "id": "1322332",
      "postDate": "05/25/2021 11:29:47",
      "content": "<p>my entire notebook takes about 5 minutes to run so it shouldn't be a problem</p>",
      "rawMarkdown": "my entire notebook takes about 5 minutes to run so it shouldn't be a problem",
      "votes": null
    },
    {
      "id": "1322971",
      "postDate": "05/25/2021 20:45:39",
      "content": "<p>Kaggle n00b here. Is it fair to assume that if your submission does not time-out on the public leaderboard test-set, then it will likely also not time-out on the private leaderboard test-set?</p>\n<p>I realize a lot can go wrong, but wondering if there could be an order of magnitude type difference between public and private test-sets.  I thought I saw something like that mentioned, but I might have been misunderstanding the lingo at that time.</p>",
      "rawMarkdown": "Kaggle n00b here. Is it fair to assume that if your submission does not time-out on the public leaderboard test-set, then it will likely also not time-out on the private leaderboard test-set?\n\nI realize a lot can go wrong, but wondering if there could be an order of magnitude type difference between public and private test-sets.  I thought I saw something like that mentioned, but I might have been misunderstanding the lingo at that time.",
      "votes": null
    },
    {
      "id": "1325155",
      "postDate": "05/27/2021 14:33:59",
      "content": "<p>actually, 5min is too much. 2min need 6h to get the public score</p>",
      "rawMarkdown": "actually, 5min is too much. 2min need 6h to get the public score",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1321736,
      "author_name": "mlconsult",
      "author_url": "",
      "post_date": "05/24/2021 22:47:52",
      "content": "<p>There are about 8000 papers in the test set - so you should calculate how long it takes to run 100 papers in training and multiply that by 80 - that time needs to be under 9 hrs or it will time out.  Also try running GPU if you aren't.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1322332,
          "author_name": "blinglegend",
          "author_url": "",
          "post_date": "05/25/2021 11:29:47",
          "content": "<p>my entire notebook takes about 5 minutes to run so it shouldn't be a problem</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1325155,
          "author_name": "httpwwwfszyc",
          "author_url": "",
          "post_date": "05/27/2021 14:33:59",
          "content": "<p>actually, 5min is too much. 2min need 6h to get the public score</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1322971,
      "author_name": "micmylin",
      "author_url": "",
      "post_date": "05/25/2021 20:45:39",
      "content": "<p>Kaggle n00b here. Is it fair to assume that if your submission does not time-out on the public leaderboard test-set, then it will likely also not time-out on the private leaderboard test-set?</p>\n<p>I realize a lot can go wrong, but wondering if there could be an order of magnitude type difference between public and private test-sets.  I thought I saw something like that mentioned, but I might have been misunderstanding the lingo at that time.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1321480": "Hey, although my code runs quickly and properly executes in the notebook once I submit it the notebook seems to run forever and eventually leads to a notebook timeout error. Is anyone else facing this issue, or has anyone solved this before?\n\nI am using external (public) datasets in my code if that's a clarification necessary.",
    "1321736": "There are about 8000 papers in the test set - so you should calculate how long it takes to run 100 papers in training and multiply that by 80 - that time needs to be under 9 hrs or it will time out.  Also try running GPU if you aren't.",
    "1322332": "my entire notebook takes about 5 minutes to run so it shouldn't be a problem",
    "1322971": "Kaggle n00b here. Is it fair to assume that if your submission does not time-out on the public leaderboard test-set, then it will likely also not time-out on the private leaderboard test-set?\n\nI realize a lot can go wrong, but wondering if there could be an order of magnitude type difference between public and private test-sets.  I thought I saw something like that mentioned, but I might have been misunderstanding the lingo at that time.",
    "1325155": "actually, 5min is too much. 2min need 6h to get the public score"
  },
  "source": "meta"
}