I am currently experiencing a \"submission scoring error\" when attempting to submit my code. I have thoroughly reviewed my code and the competition guidelines, but I am unable to identify the exact cause of the error.
\nI kindly request your assistance in resolving this issue as it is crucial for me to submit my work within the stipulated time frame. If there are any specific steps or recommendations you can provide to address this problem, I would greatly appreciate it.
\nPlease let me know how I can proceed to ensure a successful submission. Your prompt attention to this matter would be highly valued.
", "messages": [ { "id": 2535111, "postDate": "2023-11-23T05:35:20.213Z", "content": "I am currently experiencing a \"submission scoring error\" when attempting to submit my code. I have thoroughly reviewed my code and the competition guidelines, but I am unable to identify the exact cause of the error.
\nI kindly request your assistance in resolving this issue as it is crucial for me to submit my work within the stipulated time frame. If there are any specific steps or recommendations you can provide to address this problem, I would greatly appreciate it.
\nPlease let me know how I can proceed to ensure a successful submission. Your prompt attention to this matter would be highly valued.
", "rawMarkdown": "I am currently experiencing a \"submission scoring error\" when attempting to submit my code. I have thoroughly reviewed my code and the competition guidelines, but I am unable to identify the exact cause of the error.\n\nI kindly request your assistance in resolving this issue as it is crucial for me to submit my work within the stipulated time frame. If there are any specific steps or recommendations you can provide to address this problem, I would greatly appreciate it.\n\nPlease let me know how I can proceed to ensure a successful submission. Your prompt attention to this matter would be highly valued.", "votes": 1 }, { "id": 2546149, "postDate": "2023-12-02T06:27:01.577Z", "content": "score should be integer format or float with one decimal point??
", "rawMarkdown": "score should be integer format or float with one decimal point??" }, { "id": 2546147, "postDate": "2023-12-02T06:24:35.447Z", "content": "I am encountering scoring errors when submitting the submission.csv file, even though it adheres to the specified format, with \"row_id\" as an integer, \"series_id\" as a string, \"step\" as an integer, \"event\" as a string, and \"score\" as an integer - this problem is not yet solved. I used train_series for getting submission.csv file. how to solve this.
", "rawMarkdown": "\nI am encountering scoring errors when submitting the submission.csv file, even though it adheres to the specified format, with \"row_id\" as an integer, \"series_id\" as a string, \"step\" as an integer, \"event\" as a string, and \"score\" as an integer - this problem is not yet solved. I used train_series for getting submission.csv file. how to solve this." }, { "id": 2536254, "postDate": "2023-11-24T04:28:51.093Z", "content": "I have encountered same issue, Keep hitting submission scoring error yet when I use the scoring metric it works fine. It has been more than two weeks and I have zero idea what actually happened.
\nBut then i copied public notebook and test submit and it somehow works? Tried to copy the way notebook arrange submission.csv and still encounter the issue
", "rawMarkdown": "I have encountered same issue, Keep hitting submission scoring error yet when I use the scoring metric it works fine. It has been more than two weeks and I have zero idea what actually happened.\n\nBut then i copied public notebook and test submit and it somehow works? Tried to copy the way notebook arrange submission.csv and still encounter the issue", "replies": [ { "id": 2536256, "postDate": "2023-11-24T04:30:39.343Z", "rawMarkdown": "", "isDeleted": true } ] }, { "id": 2535245, "postDate": "2023-11-23T07:35:14.737Z", "content": "In this competition you may face scoring error if your submission contains to many predictions (like hundreds of thousands or more). Try to find out how many predictions your model makes on the train set and find settings which decrease this value like twice. Then make submission with these settings.
\nSecond reason of error is presence in the output directory of any files that are not submission.csv. Remove all files except this one and try to submit again.
", "rawMarkdown": "In this competition you may face scoring error if your submission contains to many predictions (like hundreds of thousands or more). Try to find out how many predictions your model makes on the train set and find settings which decrease this value like twice. Then make submission with these settings.\n\nSecond reason of error is presence in the output directory of any files that are not submission.csv. Remove all files except this one and try to submit again.", "replies": [ { "id": 2538856, "postDate": "2023-11-26T14:00:08.240Z", "content": "Is this something you have tested or has happened to you before? Just wondering if this could be a cause for private test set failure.
", "rawMarkdown": "Is this something you have tested or has happened to you before? Just wondering if this could be a cause for private test set failure." } ] }, { "id": 2535152, "postDate": "2023-11-23T06:03:12.867Z", "content": "I suggest running your submission code in interactive notebook mode. Instead of loading test_series.parquet, load train_series.parquet instead. Make sure that your inference code can infer all 277 train series_id without memory error.
I've been working on a project in Jupyter Notebook where both train_series.parquet and test_series.parquet files are available. I'm curious about the best practices in this context. Specifically, I'm wondering why one might opt to use train_series.parquet for testing the submission code, even when test_series.parquet is readily available.
\nAdditionally, I've noticed that my output submission file consists of 450 rows. I'm seeking guidance on whether this is the standard approach or if using the test data directly would be more appropriate, especially considering the available test data.
\nAny insights or experiences you could share on this matter would be greatly appreciated!
The test_series.parquet is a dummy file with significantly reduced actual data where it will be replaced with the actual file when you submit your notebook. Testing with the test_series.parquet is futile as that could only test your code on a very restricted dataset (look at file size).
\nIn Kaggle competitions, the actual test set is usually hidden to avoid problems such as manual labelling of images. So it would be better to test your pipeline on the training series (much larger dataset) to see where the problem/bug is.
", "rawMarkdown": "The test_series.parquet is a dummy file with significantly reduced actual data where it will be replaced with the actual file when you submit your notebook. Testing with the test_series.parquet is futile as that could only test your code on a very restricted dataset (look at file size).\n\nIn Kaggle competitions, the actual test set is usually hidden to avoid problems such as manual labelling of images. So it would be better to test your pipeline on the training series (much larger dataset) to see where the problem/bug is.", "votes": 1 } ] } ] } ], "comments": [ { "id": 2546149, "author_name": "Thangaprabhu", "author_url": "", "post_date": "2023-12-02T06:27:01.577000", "content": "score should be integer format or float with one decimal point??
", "votes": 0, "replies": [] }, { "id": 2546147, "author_name": "Thangaprabhu", "author_url": "", "post_date": "2023-12-02T06:24:35.447000", "content": "I am encountering scoring errors when submitting the submission.csv file, even though it adheres to the specified format, with \"row_id\" as an integer, \"series_id\" as a string, \"step\" as an integer, \"event\" as a string, and \"score\" as an integer - this problem is not yet solved. I used train_series for getting submission.csv file. how to solve this.
", "votes": 0, "replies": [] }, { "id": 2536254, "author_name": "Ruby Hartono", "author_url": "", "post_date": "2023-11-24T04:28:51.093000", "content": "I have encountered same issue, Keep hitting submission scoring error yet when I use the scoring metric it works fine. It has been more than two weeks and I have zero idea what actually happened.
\nBut then i copied public notebook and test submit and it somehow works? Tried to copy the way notebook arrange submission.csv and still encounter the issue
", "votes": 0, "replies": [ { "id": 2536256, "author_name": "", "author_url": "", "post_date": "2023-11-24T04:30:39.343000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2535245, "author_name": "Alex N.", "author_url": "", "post_date": "2023-11-23T07:35:14.737000", "content": "In this competition you may face scoring error if your submission contains to many predictions (like hundreds of thousands or more). Try to find out how many predictions your model makes on the train set and find settings which decrease this value like twice. Then make submission with these settings.
\nSecond reason of error is presence in the output directory of any files that are not submission.csv. Remove all files except this one and try to submit again.
", "votes": 0, "replies": [ { "id": 2538856, "author_name": "Fritz Cremer", "author_url": "", "post_date": "2023-11-26T14:00:08.240000", "content": "Is this something you have tested or has happened to you before? Just wondering if this could be a cause for private test set failure.
", "votes": 0, "replies": [] } ] }, { "id": 2535152, "author_name": "Chris Deotte", "author_url": "", "post_date": "2023-11-23T06:03:12.867000", "content": "I suggest running your submission code in interactive notebook mode. Instead of loading test_series.parquet, load train_series.parquet instead. Make sure that your inference code can infer all 277 train series_id without memory error.
I've been working on a project in Jupyter Notebook where both train_series.parquet and test_series.parquet files are available. I'm curious about the best practices in this context. Specifically, I'm wondering why one might opt to use train_series.parquet for testing the submission code, even when test_series.parquet is readily available.
\nAdditionally, I've noticed that my output submission file consists of 450 rows. I'm seeking guidance on whether this is the standard approach or if using the test data directly would be more appropriate, especially considering the available test data.
\nAny insights or experiences you could share on this matter would be greatly appreciated!
The test_series.parquet is a dummy file with significantly reduced actual data where it will be replaced with the actual file when you submit your notebook. Testing with the test_series.parquet is futile as that could only test your code on a very restricted dataset (look at file size).
\nIn Kaggle competitions, the actual test set is usually hidden to avoid problems such as manual labelling of images. So it would be better to test your pipeline on the training series (much larger dataset) to see where the problem/bug is.
", "votes": 1, "replies": [] } ] } ] } ], "raw_markdown_by_id": { "2535111": "I am currently experiencing a \"submission scoring error\" when attempting to submit my code. I have thoroughly reviewed my code and the competition guidelines, but I am unable to identify the exact cause of the error.\n\nI kindly request your assistance in resolving this issue as it is crucial for me to submit my work within the stipulated time frame. If there are any specific steps or recommendations you can provide to address this problem, I would greatly appreciate it.\n\nPlease let me know how I can proceed to ensure a successful submission. Your prompt attention to this matter would be highly valued.", "2546149": "score should be integer format or float with one decimal point??", "2546147": "\nI am encountering scoring errors when submitting the submission.csv file, even though it adheres to the specified format, with \"row_id\" as an integer, \"series_id\" as a string, \"step\" as an integer, \"event\" as a string, and \"score\" as an integer - this problem is not yet solved. I used train_series for getting submission.csv file. how to solve this.", "2536254": "I have encountered same issue, Keep hitting submission scoring error yet when I use the scoring metric it works fine. It has been more than two weeks and I have zero idea what actually happened.\n\nBut then i copied public notebook and test submit and it somehow works? Tried to copy the way notebook arrange submission.csv and still encounter the issue", "2535245": "In this competition you may face scoring error if your submission contains to many predictions (like hundreds of thousands or more). Try to find out how many predictions your model makes on the train set and find settings which decrease this value like twice. Then make submission with these settings.\n\nSecond reason of error is presence in the output directory of any files that are not submission.csv. Remove all files except this one and try to submit again.", "2535152": "I suggest running your submission code in interactive notebook mode. Instead of loading `test_series.parquet`, load `train_series.parquet` instead. Make sure that your inference code can infer all 277 train series_id without memory error." } }