{
  "id": 664937,
  "title": "Stuck with successful submission but then a scoring failure - throws an exception",
  "url": "/competitions/csiro-biomass/discussion/664937",
  "author_name": "",
  "post_date": "2025-12-29T03:25:50.615732900Z",
  "votes": 1,
  "comment_count": 3,
  "views": 0,
  "content": "<p>It wuld be great if I could get some help here.  Maybe I am doing this wrong.  I run the commit.  It says I am successful on the test submission.  I suppose I am supposed to do this.  I go down the right side bar, find submit to competition and click submit.  Then the code runs again in the activity box.  It says scoring in one part and runs the submission again in another part.  The scoring eventually says failed.  Presumably it is working on the larger test set. Wen I examine the submission part it says it threw an exception.</p>\n<ol>\n<li>Am i doing this right?</li>\n<li>How can I figure out the exception - the log file seems of little help.\nI tried to get AI to help - it provided suggestions but same thing happens.\nI am pretty happy with the model - uses effficient net and the 5 row submission seems perfect.\nCan any body guide me here?  This is my first kind of this type of competition.</li>\n</ol>",
  "messages": [
    {
      "id": "3382985",
      "postDate": "12/29/2025 03:25:50",
      "content": "<p>It wuld be great if I could get some help here.  Maybe I am doing this wrong.  I run the commit.  It says I am successful on the test submission.  I suppose I am supposed to do this.  I go down the right side bar, find submit to competition and click submit.  Then the code runs again in the activity box.  It says scoring in one part and runs the submission again in another part.  The scoring eventually says failed.  Presumably it is working on the larger test set. Wen I examine the submission part it says it threw an exception.</p>\n<ol>\n<li>Am i doing this right?</li>\n<li>How can I figure out the exception - the log file seems of little help.\nI tried to get AI to help - it provided suggestions but same thing happens.\nI am pretty happy with the model - uses effficient net and the 5 row submission seems perfect.\nCan any body guide me here?  This is my first kind of this type of competition.</li>\n</ol>",
      "rawMarkdown": "It wuld be great if I could get some help here.  Maybe I am doing this wrong.  I run the commit.  It says I am successful on the test submission.  I suppose I am supposed to do this.  I go down the right side bar, find submit to competition and click submit.  Then the code runs again in the activity box.  It says scoring in one part and runs the submission again in another part.  The scoring eventually says failed.  Presumably it is working on the larger test set. Wen I examine the submission part it says it threw an exception.\n1.  Am i doing this right?\n2.  How can I figure out the exception - the log file seems of little help.\nI tried to get AI to help - it provided suggestions but same thing happens.\nI am pretty happy with the model - uses effficient net and the 5 row submission seems perfect.\nCan any body guide me here?  This is my first kind of this type of competition.",
      "votes": null
    },
    {
      "id": "3383147",
      "postDate": "12/29/2025 13:39:07",
      "content": "<p>I had the same issue and the problem was the batch_size for evaluation in my case. It was too big and throwed CUDA memory error. \nTry replace in your submission notebook the test_csv with the train_csv to see if your code runs with a larger dataset (before the submission).</p>",
      "rawMarkdown": "I had the same issue and the problem was the batch_size for evaluation in my case. It was too big and throwed CUDA memory error. \nTry replace in your submission notebook the test_csv with the train_csv to see if your code runs with a larger dataset (before the submission).",
      "votes": null
    },
    {
      "id": "3383230",
      "postDate": "12/29/2025 17:02:06",
      "content": "<p>The log file is pretty much useless as it's only the log of the notebook running the single example test image.  There is no log file for the actual private test image run.</p>\n<p>When your notebook has success on the single test image on Save/Run but fails on the submission you can have a number of common mistakes.  Most often on this one your code did not handle memory right.  That's the error that Panagiota was getting.</p>\n<p>Make sure your code is not using the sample_submission.cvs file - for some odd reason it exists in the public test but they failed to include it in the test folder used by them when they score your notebook.</p>\n<p>The easiest way to find your error is to predict on the train file rather then the test - run the notebook and it will fail with a reasonable error message in the failing cell.  For this competition pretty easy - just change test.csv to train.csv or if your using folder /test goes to /train.</p>\n<p>If you cannot get it, make your notebook public and put a link here.  </p>",
      "rawMarkdown": "The log file is pretty much useless as it's only the log of the notebook running the single example test image.  There is no log file for the actual private test image run.\n\nWhen your notebook has success on the single test image on Save/Run but fails on the submission you can have a number of common mistakes.  Most often on this one your code did not handle memory right.  That's the error that Panagiota was getting.\n\nMake sure your code is not using the sample_submission.cvs file - for some odd reason it exists in the public test but they failed to include it in the test folder used by them when they score your notebook.\n\nThe easiest way to find your error is to predict on the train file rather then the test - run the notebook and it will fail with a reasonable error message in the failing cell.  For this competition pretty easy - just change test.csv to train.csv or if your using folder /test goes to /train.\n\nIf you cannot get it, make your notebook public and put a link here.",
      "votes": null
    },
    {
      "id": "3383249",
      "postDate": "12/29/2025 17:26:44",
      "content": "<p>Lived in the Springs for a few years while at Fort Carson half a century ago.  Was back not long ago - in the early 70's my house on the very edge of town.  Now it looks to be pretty much in the middle.  </p>",
      "rawMarkdown": "Lived in the Springs for a few years while at Fort Carson half a century ago.  Was back not long ago - in the early 70's my house on the very edge of town.  Now it looks to be pretty much in the middle.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3383147,
      "author_name": "giotamoraiti",
      "author_url": "",
      "post_date": "12/29/2025 13:39:07",
      "content": "<p>I had the same issue and the problem was the batch_size for evaluation in my case. It was too big and throwed CUDA memory error. \nTry replace in your submission notebook the test_csv with the train_csv to see if your code runs with a larger dataset (before the submission).</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 3383230,
      "author_name": "pcjimmmy",
      "author_url": "",
      "post_date": "12/29/2025 17:02:06",
      "content": "<p>The log file is pretty much useless as it's only the log of the notebook running the single example test image.  There is no log file for the actual private test image run.</p>\n<p>When your notebook has success on the single test image on Save/Run but fails on the submission you can have a number of common mistakes.  Most often on this one your code did not handle memory right.  That's the error that Panagiota was getting.</p>\n<p>Make sure your code is not using the sample_submission.cvs file - for some odd reason it exists in the public test but they failed to include it in the test folder used by them when they score your notebook.</p>\n<p>The easiest way to find your error is to predict on the train file rather then the test - run the notebook and it will fail with a reasonable error message in the failing cell.  For this competition pretty easy - just change test.csv to train.csv or if your using folder /test goes to /train.</p>\n<p>If you cannot get it, make your notebook public and put a link here.  </p>",
      "votes": null,
      "replies": [
        {
          "id": 3383249,
          "author_name": "pcjimmmy",
          "author_url": "",
          "post_date": "12/29/2025 17:26:44",
          "content": "<p>Lived in the Springs for a few years while at Fort Carson half a century ago.  Was back not long ago - in the early 70's my house on the very edge of town.  Now it looks to be pretty much in the middle.  </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3382985": "It wuld be great if I could get some help here.  Maybe I am doing this wrong.  I run the commit.  It says I am successful on the test submission.  I suppose I am supposed to do this.  I go down the right side bar, find submit to competition and click submit.  Then the code runs again in the activity box.  It says scoring in one part and runs the submission again in another part.  The scoring eventually says failed.  Presumably it is working on the larger test set. Wen I examine the submission part it says it threw an exception.\n1.  Am i doing this right?\n2.  How can I figure out the exception - the log file seems of little help.\nI tried to get AI to help - it provided suggestions but same thing happens.\nI am pretty happy with the model - uses effficient net and the 5 row submission seems perfect.\nCan any body guide me here?  This is my first kind of this type of competition.",
    "3383147": "I had the same issue and the problem was the batch_size for evaluation in my case. It was too big and throwed CUDA memory error. \nTry replace in your submission notebook the test_csv with the train_csv to see if your code runs with a larger dataset (before the submission).",
    "3383230": "The log file is pretty much useless as it's only the log of the notebook running the single example test image.  There is no log file for the actual private test image run.\n\nWhen your notebook has success on the single test image on Save/Run but fails on the submission you can have a number of common mistakes.  Most often on this one your code did not handle memory right.  That's the error that Panagiota was getting.\n\nMake sure your code is not using the sample_submission.cvs file - for some odd reason it exists in the public test but they failed to include it in the test folder used by them when they score your notebook.\n\nThe easiest way to find your error is to predict on the train file rather then the test - run the notebook and it will fail with a reasonable error message in the failing cell.  For this competition pretty easy - just change test.csv to train.csv or if your using folder /test goes to /train.\n\nIf you cannot get it, make your notebook public and put a link here.",
    "3383249": "Lived in the Springs for a few years while at Fort Carson half a century ago.  Was back not long ago - in the early 70's my house on the very edge of town.  Now it looks to be pretty much in the middle."
  },
  "source": "meta"
}