{
  "id": 302330,
  "title": "submission success guarantees to run on real test dataset?",
  "url": "/competitions/g-research-crypto-forecasting/discussion/302330",
  "author_name": "",
  "post_date": "2022-01-21T23:53:36.269625400Z",
  "votes": 1,
  "comment_count": 7,
  "views": 0,
  "content": "<p>I have submitted the same code multiple times. Sometimes it succeeded while it failed in the other times. I wonder my code will run successfully on the real data set if I select the successful one for the final use.</p>",
  "messages": [
    {
      "id": "1659561",
      "postDate": "01/21/2022 23:53:36",
      "content": "<p>I have submitted the same code multiple times. Sometimes it succeeded while it failed in the other times. I wonder my code will run successfully on the real data set if I select the successful one for the final use.</p>",
      "rawMarkdown": "I have submitted the same code multiple times. Sometimes it succeeded while it failed in the other times. I wonder my code will run successfully on the real data set if I select the successful one for the final use.",
      "votes": null
    },
    {
      "id": "1659637",
      "postDate": "01/22/2022 02:52:29",
      "content": "<p>There will be more data in the supplemental training set on the real dataset, so if you are using it which you should then ensure that this will not lead to memory errors.</p>",
      "rawMarkdown": "There will be more data in the supplemental training set on the real dataset, so if you are using it which you should then ensure that this will not lead to memory errors.",
      "votes": null
    },
    {
      "id": "1659696",
      "postDate": "01/22/2022 03:55:19",
      "content": "<p>Hello, <a href=\"https://www.kaggle.com/sirano1004\" target=\"_blank\">@sirano1004</a>. Have you narow down what part of the code is failing based on the log records of the notebook execution? This probably can help what's going on</p>",
      "rawMarkdown": "Hello, @sirano1004. Have you narow down what part of the code is failing based on the log records of the notebook execution? This probably can help what's going on",
      "votes": null
    },
    {
      "id": "1659848",
      "postDate": "01/22/2022 06:35:15",
      "content": "<p>Hello that's the problem actually. I don't know which part caused the failure. I simply submitted the same file multiple times. Sometimes it worked, sometimes it failed.</p>",
      "rawMarkdown": "Hello that's the problem actually. I don't know which part caused the failure. I simply submitted the same file multiple times. Sometimes it worked, sometimes it failed.",
      "votes": null
    },
    {
      "id": "1659849",
      "postDate": "01/22/2022 06:36:07",
      "content": "<p>Yeah for sure. I took that into account. but the submission succeeded sometimes and failed sometimes. </p>",
      "rawMarkdown": "Yeah for sure. I took that into account. but the submission succeeded sometimes and failed sometimes.",
      "votes": null
    },
    {
      "id": "1659875",
      "postDate": "01/22/2022 07:03:46",
      "content": "<p>of course not, and it's risky training online when you have too many features.</p>",
      "rawMarkdown": "of course not, and it's risky training online when you have too many features.",
      "votes": null
    },
    {
      "id": "1660662",
      "postDate": "01/22/2022 20:49:35",
      "content": "<p>Hi, I have the same problem - I have only minor changes in my  and sometimes it suceeds and sometimes not.<br>\nHowever when it fails, I always get a \"Timeout\"-error so I guess, I'm on the limit. </p>\n<p>If you also have timeouts, make sure that you don't forget turning on GPU and if possible reduce your prediction time (generate less features, etc…)</p>",
      "rawMarkdown": "Hi, I have the same problem - I have only minor changes in my  and sometimes it suceeds and sometimes not.\nHowever when it fails, I always get a \"Timeout\"-error so I guess, I'm on the limit. \n\nIf you also have timeouts, make sure that you don't forget turning on GPU and if possible reduce your prediction time (generate less features, etc...)",
      "votes": null
    },
    {
      "id": "1660922",
      "postDate": "01/23/2022 05:12:07",
      "content": "<p>I understand <a href=\"https://www.kaggle.com/sirano1004\" target=\"_blank\">@sirano1004</a>, so basically not even logs from the execution?</p>",
      "rawMarkdown": "I understand @sirano1004, so basically not even logs from the execution?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1659637,
      "author_name": "petersk20",
      "author_url": "",
      "post_date": "01/22/2022 02:52:29",
      "content": "<p>There will be more data in the supplemental training set on the real dataset, so if you are using it which you should then ensure that this will not lead to memory errors.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1659849,
          "author_name": "sirano1004",
          "author_url": "",
          "post_date": "01/22/2022 06:36:07",
          "content": "<p>Yeah for sure. I took that into account. but the submission succeeded sometimes and failed sometimes. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1659696,
      "author_name": "cv13j0",
      "author_url": "",
      "post_date": "01/22/2022 03:55:19",
      "content": "<p>Hello, <a href=\"https://www.kaggle.com/sirano1004\" target=\"_blank\">@sirano1004</a>. Have you narow down what part of the code is failing based on the log records of the notebook execution? This probably can help what's going on</p>",
      "votes": null,
      "replies": [
        {
          "id": 1659848,
          "author_name": "sirano1004",
          "author_url": "",
          "post_date": "01/22/2022 06:35:15",
          "content": "<p>Hello that's the problem actually. I don't know which part caused the failure. I simply submitted the same file multiple times. Sometimes it worked, sometimes it failed.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1660922,
          "author_name": "cv13j0",
          "author_url": "",
          "post_date": "01/23/2022 05:12:07",
          "content": "<p>I understand <a href=\"https://www.kaggle.com/sirano1004\" target=\"_blank\">@sirano1004</a>, so basically not even logs from the execution?</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1659875,
      "author_name": "yuanzhezhou",
      "author_url": "",
      "post_date": "01/22/2022 07:03:46",
      "content": "<p>of course not, and it's risky training online when you have too many features.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1660662,
      "author_name": "steamfire",
      "author_url": "",
      "post_date": "01/22/2022 20:49:35",
      "content": "<p>Hi, I have the same problem - I have only minor changes in my  and sometimes it suceeds and sometimes not.<br>\nHowever when it fails, I always get a \"Timeout\"-error so I guess, I'm on the limit. </p>\n<p>If you also have timeouts, make sure that you don't forget turning on GPU and if possible reduce your prediction time (generate less features, etc…)</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1659561": "I have submitted the same code multiple times. Sometimes it succeeded while it failed in the other times. I wonder my code will run successfully on the real data set if I select the successful one for the final use.",
    "1659637": "There will be more data in the supplemental training set on the real dataset, so if you are using it which you should then ensure that this will not lead to memory errors.",
    "1659696": "Hello, @sirano1004. Have you narow down what part of the code is failing based on the log records of the notebook execution? This probably can help what's going on",
    "1659848": "Hello that's the problem actually. I don't know which part caused the failure. I simply submitted the same file multiple times. Sometimes it worked, sometimes it failed.",
    "1659849": "Yeah for sure. I took that into account. but the submission succeeded sometimes and failed sometimes.",
    "1659875": "of course not, and it's risky training online when you have too many features.",
    "1660662": "Hi, I have the same problem - I have only minor changes in my  and sometimes it suceeds and sometimes not.\nHowever when it fails, I always get a \"Timeout\"-error so I guess, I'm on the limit. \n\nIf you also have timeouts, make sure that you don't forget turning on GPU and if possible reduce your prediction time (generate less features, etc...)",
    "1660922": "I understand @sirano1004, so basically not even logs from the execution?"
  },
  "source": "meta"
}