{
  "id": 418500,
  "title": "Sporadic submission scoring error",
  "url": "/competitions/cafa-5-protein-function-prediction/discussion/418500",
  "author_name": "",
  "post_date": "2023-06-21T02:02:35.951999800Z",
  "votes": 4,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Some of my submissions failed with \"Submission scoring error\". When I resubmitted the same notebook version again they passed. </p>\n<p>Example:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F692339%2Fc4f023a9b5180b7d677b8d9de56d3d82%2FScreenshot%20from%202023-06-20%2019-00-40.png?generation=1687312903685131&amp;alt=media\" alt=\"\"></p>\n<p>Does anybody else have this happen? Is there an explanation for this from the organizers or kaggle staff?</p>\n<p>It would be very annoying if it happens towards the end of the competitions, since submissions are wasted if the have to be submitted twice.</p>",
  "messages": [
    {
      "id": "2311185",
      "postDate": "06/21/2023 02:02:35",
      "content": "<p>Some of my submissions failed with \"Submission scoring error\". When I resubmitted the same notebook version again they passed. </p>\n<p>Example:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F692339%2Fc4f023a9b5180b7d677b8d9de56d3d82%2FScreenshot%20from%202023-06-20%2019-00-40.png?generation=1687312903685131&amp;alt=media\" alt=\"\"></p>\n<p>Does anybody else have this happen? Is there an explanation for this from the organizers or kaggle staff?</p>\n<p>It would be very annoying if it happens towards the end of the competitions, since submissions are wasted if the have to be submitted twice.</p>",
      "rawMarkdown": "Some of my submissions failed with \"Submission scoring error\". When I resubmitted the same notebook version again they passed. \n\nExample:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F692339%2Fc4f023a9b5180b7d677b8d9de56d3d82%2FScreenshot%20from%202023-06-20%2019-00-40.png?generation=1687312903685131&alt=media)\n\nDoes anybody else have this happen? Is there an explanation for this from the organizers or kaggle staff?\n\nIt would be very annoying if it happens towards the end of the competitions, since submissions are wasted if the have to be submitted twice.",
      "votes": null
    },
    {
      "id": "2311322",
      "postDate": "06/21/2023 05:25:03",
      "content": "<p>It might be that submit does not contain all the test proteins. Such things  were discussed on forum: <a href=\"https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/403258\" target=\"_blank\">https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/403258</a></p>\n<p>You can try to add some proteins with GO term of weight zero - to get full list of proteins in submit. That does not change score, but sometimes helps to avoid crash.</p>\n<p>If the reason is different it would be valuable if you can report on that, thanks in advance…</p>",
      "rawMarkdown": "It might be that submit does not contain all the test proteins. Such things  were discussed on forum: https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/403258\n\nYou can try to add some proteins with GO term of weight zero - to get full list of proteins in submit. That does not change score, but sometimes helps to avoid crash.\n\nIf the reason is different it would be valuable if you can report on that, thanks in advance...",
      "votes": null
    },
    {
      "id": "2311938",
      "postDate": "06/21/2023 14:46:48",
      "content": "<p>Thanks for the reply. I think that is not the cause. My submissions have at least one prediction for each test protein, as per the discussion you cited.</p>",
      "rawMarkdown": "Thanks for the reply. I think that is not the cause. My submissions have at least one prediction for each test protein, as per the discussion you cited.",
      "votes": null
    },
    {
      "id": "2312124",
      "postDate": "06/21/2023 17:24:02",
      "content": "<p>I don't think you should question your submissions, especially when the same notebook works later. In a different competition there were submission problems yesterday. I think sometimes Kaggle servers simply glitch or are overloaded.</p>",
      "rawMarkdown": "I don't think you should question your submissions, especially when the same notebook works later. In a different competition there were submission problems yesterday. I think sometimes Kaggle servers simply glitch or are overloaded.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2311322,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "06/21/2023 05:25:03",
      "content": "<p>It might be that submit does not contain all the test proteins. Such things  were discussed on forum: <a href=\"https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/403258\" target=\"_blank\">https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/403258</a></p>\n<p>You can try to add some proteins with GO term of weight zero - to get full list of proteins in submit. That does not change score, but sometimes helps to avoid crash.</p>\n<p>If the reason is different it would be valuable if you can report on that, thanks in advance…</p>",
      "votes": null,
      "replies": [
        {
          "id": 2311938,
          "author_name": "rluethy",
          "author_url": "",
          "post_date": "06/21/2023 14:46:48",
          "content": "<p>Thanks for the reply. I think that is not the cause. My submissions have at least one prediction for each test protein, as per the discussion you cited.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 2312124,
      "author_name": "tilii7",
      "author_url": "",
      "post_date": "06/21/2023 17:24:02",
      "content": "<p>I don't think you should question your submissions, especially when the same notebook works later. In a different competition there were submission problems yesterday. I think sometimes Kaggle servers simply glitch or are overloaded.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2311185": "Some of my submissions failed with \"Submission scoring error\". When I resubmitted the same notebook version again they passed. \n\nExample:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F692339%2Fc4f023a9b5180b7d677b8d9de56d3d82%2FScreenshot%20from%202023-06-20%2019-00-40.png?generation=1687312903685131&alt=media)\n\nDoes anybody else have this happen? Is there an explanation for this from the organizers or kaggle staff?\n\nIt would be very annoying if it happens towards the end of the competitions, since submissions are wasted if the have to be submitted twice.",
    "2311322": "It might be that submit does not contain all the test proteins. Such things  were discussed on forum: https://www.kaggle.com/competitions/cafa-5-protein-function-prediction/discussion/403258\n\nYou can try to add some proteins with GO term of weight zero - to get full list of proteins in submit. That does not change score, but sometimes helps to avoid crash.\n\nIf the reason is different it would be valuable if you can report on that, thanks in advance...",
    "2311938": "Thanks for the reply. I think that is not the cause. My submissions have at least one prediction for each test protein, as per the discussion you cited.",
    "2312124": "I don't think you should question your submissions, especially when the same notebook works later. In a different competition there were submission problems yesterday. I think sometimes Kaggle servers simply glitch or are overloaded."
  },
  "source": "meta"
}