{
  "id": 413489,
  "title": "Evaluation metric raised an unexpected error",
  "url": "/competitions/2023-kaggle-ai-report/discussion/413489",
  "author_name": "",
  "post_date": "2023-05-28T22:39:48.438219800Z",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>What should one do about the following error when submitting the .csv file?<br>\n\"Evaluation metric raised an unexpected error\"</p>\n<p>The submission.csv file format is very simple and I believe that I have followed the formatting instructions.<br>\nI included the first (header) line,<br>\n type,value<br>\nas indicated by the instruction, \"Your submission should be a CSV file with 5 rows and a header.\"<br>\nI tried including the URLs and topic in quotes and without quotes, and I made sure my notebook is public in case that is necessary to have a submission.csv file be accepted.</p>\n<p>Any suggestions?</p>\n<hr>\n<p>In addition, this may be of use to others:</p>\n<p>The entries are essays that, unlike most Kaggle competitions, should not necessarily need to use any data sources. However, it seems that you may still need to link to the data source for the 2023 Kaggle AI Report competition.</p>\n<p>When you click, \"Submit Predictions,\" you get a popup window with two tabs, \"Submissions,\" and \"Notebook.\"<br>\nOn the Notebook tab, you get a dropdown field called, \"Select Notebook.\"<br>\nI believe you can start a new notebook from here, and it will automatically be associated with the competition.<br>\nIf, however, you start a notebook independently, it seems that you you need to link it to the competition for it to show up.<br>\nTo do that, go to the notebook, and use the \"Add Data\" panel to select \"Competition Datasets,\" and from there, click on the + sign to select \"2023 Kaggle AI Report.\"<br>\nThen, when you go to the \"Submit Predictions\" panel, your notebook will become available in the dropdown to select for a submission entry.  You can tell this because when you navigate your browser to the top level URL for the notebook, the subtitle title will now say, \"Python * 2023 Kaggle AI Report\".</p>\n<p>Note that this explanation may be incomplete or partially incorrect, as it still does not overcome the \"Evaluation metric raised an unexpected error\".</p>",
  "messages": [
    {
      "id": "2278699",
      "postDate": "05/28/2023 22:39:48",
      "content": "<p>What should one do about the following error when submitting the .csv file?<br>\n\"Evaluation metric raised an unexpected error\"</p>\n<p>The submission.csv file format is very simple and I believe that I have followed the formatting instructions.<br>\nI included the first (header) line,<br>\n type,value<br>\nas indicated by the instruction, \"Your submission should be a CSV file with 5 rows and a header.\"<br>\nI tried including the URLs and topic in quotes and without quotes, and I made sure my notebook is public in case that is necessary to have a submission.csv file be accepted.</p>\n<p>Any suggestions?</p>\n<hr>\n<p>In addition, this may be of use to others:</p>\n<p>The entries are essays that, unlike most Kaggle competitions, should not necessarily need to use any data sources. However, it seems that you may still need to link to the data source for the 2023 Kaggle AI Report competition.</p>\n<p>When you click, \"Submit Predictions,\" you get a popup window with two tabs, \"Submissions,\" and \"Notebook.\"<br>\nOn the Notebook tab, you get a dropdown field called, \"Select Notebook.\"<br>\nI believe you can start a new notebook from here, and it will automatically be associated with the competition.<br>\nIf, however, you start a notebook independently, it seems that you you need to link it to the competition for it to show up.<br>\nTo do that, go to the notebook, and use the \"Add Data\" panel to select \"Competition Datasets,\" and from there, click on the + sign to select \"2023 Kaggle AI Report.\"<br>\nThen, when you go to the \"Submit Predictions\" panel, your notebook will become available in the dropdown to select for a submission entry.  You can tell this because when you navigate your browser to the top level URL for the notebook, the subtitle title will now say, \"Python * 2023 Kaggle AI Report\".</p>\n<p>Note that this explanation may be incomplete or partially incorrect, as it still does not overcome the \"Evaluation metric raised an unexpected error\".</p>",
      "rawMarkdown": "What should one do about the following error when submitting the .csv file?\n\"Evaluation metric raised an unexpected error\"\n\nThe submission.csv file format is very simple and I believe that I have followed the formatting instructions.\nI included the first (header) line,\n type,value\nas indicated by the instruction, \"Your submission should be a CSV file with 5 rows and a header.\"\nI tried including the URLs and topic in quotes and without quotes, and I made sure my notebook is public in case that is necessary to have a submission.csv file be accepted.\n\nAny suggestions?\n\n-----\nIn addition, this may be of use to others:\n\nThe entries are essays that, unlike most Kaggle competitions, should not necessarily need to use any data sources. However, it seems that you may still need to link to the data source for the 2023 Kaggle AI Report competition.\n\nWhen you click, \"Submit Predictions,\" you get a popup window with two tabs, \"Submissions,\" and \"Notebook.\"\nOn the Notebook tab, you get a dropdown field called, \"Select Notebook.\"\nI believe you can start a new notebook from here, and it will automatically be associated with the competition.\nIf, however, you start a notebook independently, it seems that you you need to link it to the competition for it to show up.\nTo do that, go to the notebook, and use the \"Add Data\" panel to select \"Competition Datasets,\" and from there, click on the + sign to select \"2023 Kaggle AI Report.\"\nThen, when you go to the \"Submit Predictions\" panel, your notebook will become available in the dropdown to select for a submission entry.  You can tell this because when you navigate your browser to the top level URL for the notebook, the subtitle title will now say, \"Python * 2023 Kaggle AI Report\".\n\nNote that this explanation may be incomplete or partially incorrect, as it still does not overcome the \"Evaluation metric raised an unexpected error\".",
      "votes": null
    },
    {
      "id": "2283990",
      "postDate": "06/01/2023 16:42:03",
      "content": "<p>Can you paste the contents of your submission.csv file as a new comment in this thread? That will be very helpful for troubleshooting. It should look similar to <a href=\"https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions\" target=\"_blank\">this</a>:</p>\n<pre><code>,value\nessay_category,\nessay_url,\nfeedback1_url,\nfeedback2_url,\nfeedback3_url,\n</code></pre>\n<p>The most straightforward workflow to get the competition submission to work is likely going to be as follows: (1) replace the URLs in the sample_submission.csv file with your actual URLs; (2) save and rename the file as submission.csv; and then (3) submit your submission.csv file to this competition.</p>",
      "rawMarkdown": "Can you paste the contents of your submission.csv file as a new comment in this thread? That will be very helpful for troubleshooting. It should look similar to [this](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions):\n\n```python\ntype,value\nessay_category,'copy/paste the exact category that you are submitting to'\nessay_url,'http://www.kaggle.com/your_username/your_notebook'\nfeedback1_url,'http://www.kaggle.com/.../your_1st_peer_feedback'\nfeedback2_url,'http://www.kaggle.com/.../your_2nd_peer_feedback'\nfeedback3_url,'http://www.kaggle.com/.../your_3rd_peer_feedback'\n```\n\nThe most straightforward workflow to get the competition submission to work is likely going to be as follows: (1) replace the URLs in the sample_submission.csv file with your actual URLs; (2) save and rename the file as submission.csv; and then (3) submit your submission.csv file to this competition.",
      "votes": null
    },
    {
      "id": "2284172",
      "postDate": "06/01/2023 19:15:08",
      "content": "<p>Thank you for this suggestion. Problem solved, I was able to get a submission.csv file to be accepted.<br>\nHere is what I learned.</p>\n<ol>\n<li>I had copied and pasted the template submission.csv file directly from the text field in the URL,<br>\n<a href=\"https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions\" target=\"_blank\">https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions</a><br>\nThis template .csv contains leading spaces in each line.<br>\nIf the csv file has leading spaces, the error is:<br>\n\"Evaluation metric raised an unexpected error\"</li>\n</ol>\n<p>The correct sample_submission.csv file without leading spaces is obtained by navigating on the page,<br>\n<a href=\"https://www.kaggle.com/competitions/2023-kaggle-ai-report/data?select=sample_submission.csv\" target=\"_blank\">https://www.kaggle.com/competitions/2023-kaggle-ai-report/data?select=sample_submission.csv</a></p>\n<ol>\n<li>BTW, if a field name is misspelled, you get a different error:<br>\n\"Solution and submission values for type do not match\"</li>\n</ol>\n<p>Again, it is puzzling that a search for this error turns up nothing.  I cannot have been the first person to include a misspelled field name while testing or otherwise.</p>\n<ol>\n<li><p>It is okay to have a newline at the end of the csv file.</p></li>\n<li><p>The field values can be in quotes or not.  It works either way.</p></li>\n</ol>",
      "rawMarkdown": "Thank you for this suggestion. Problem solved, I was able to get a submission.csv file to be accepted.\nHere is what I learned.\n\n1. I had copied and pasted the template submission.csv file directly from the text field in the URL,\nhttps://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions\nThis template .csv contains leading spaces in each line.\nIf the csv file has leading spaces, the error is:\n\"Evaluation metric raised an unexpected error\"\n\nThe correct sample_submission.csv file without leading spaces is obtained by navigating on the page,\nhttps://www.kaggle.com/competitions/2023-kaggle-ai-report/data?select=sample_submission.csv\n\n2. BTW, if a field name is misspelled, you get a different error:\n\"Solution and submission values for type do not match\"\n\nAgain, it is puzzling that a search for this error turns up nothing.  I cannot have been the first person to include a misspelled field name while testing or otherwise.\n\n3. It is okay to have a newline at the end of the csv file.\n\n4. The field values can be in quotes or not.  It works either way.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2283990,
      "author_name": "paultimothymooney",
      "author_url": "",
      "post_date": "06/01/2023 16:42:03",
      "content": "<p>Can you paste the contents of your submission.csv file as a new comment in this thread? That will be very helpful for troubleshooting. It should look similar to <a href=\"https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions\" target=\"_blank\">this</a>:</p>\n<pre><code>,value\nessay_category,\nessay_url,\nfeedback1_url,\nfeedback2_url,\nfeedback3_url,\n</code></pre>\n<p>The most straightforward workflow to get the competition submission to work is likely going to be as follows: (1) replace the URLs in the sample_submission.csv file with your actual URLs; (2) save and rename the file as submission.csv; and then (3) submit your submission.csv file to this competition.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2284172,
          "author_name": "esaund",
          "author_url": "",
          "post_date": "06/01/2023 19:15:08",
          "content": "<p>Thank you for this suggestion. Problem solved, I was able to get a submission.csv file to be accepted.<br>\nHere is what I learned.</p>\n<ol>\n<li>I had copied and pasted the template submission.csv file directly from the text field in the URL,<br>\n<a href=\"https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions\" target=\"_blank\">https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions</a><br>\nThis template .csv contains leading spaces in each line.<br>\nIf the csv file has leading spaces, the error is:<br>\n\"Evaluation metric raised an unexpected error\"</li>\n</ol>\n<p>The correct sample_submission.csv file without leading spaces is obtained by navigating on the page,<br>\n<a href=\"https://www.kaggle.com/competitions/2023-kaggle-ai-report/data?select=sample_submission.csv\" target=\"_blank\">https://www.kaggle.com/competitions/2023-kaggle-ai-report/data?select=sample_submission.csv</a></p>\n<ol>\n<li>BTW, if a field name is misspelled, you get a different error:<br>\n\"Solution and submission values for type do not match\"</li>\n</ol>\n<p>Again, it is puzzling that a search for this error turns up nothing.  I cannot have been the first person to include a misspelled field name while testing or otherwise.</p>\n<ol>\n<li><p>It is okay to have a newline at the end of the csv file.</p></li>\n<li><p>The field values can be in quotes or not.  It works either way.</p></li>\n</ol>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2278699": "What should one do about the following error when submitting the .csv file?\n\"Evaluation metric raised an unexpected error\"\n\nThe submission.csv file format is very simple and I believe that I have followed the formatting instructions.\nI included the first (header) line,\n type,value\nas indicated by the instruction, \"Your submission should be a CSV file with 5 rows and a header.\"\nI tried including the URLs and topic in quotes and without quotes, and I made sure my notebook is public in case that is necessary to have a submission.csv file be accepted.\n\nAny suggestions?\n\n-----\nIn addition, this may be of use to others:\n\nThe entries are essays that, unlike most Kaggle competitions, should not necessarily need to use any data sources. However, it seems that you may still need to link to the data source for the 2023 Kaggle AI Report competition.\n\nWhen you click, \"Submit Predictions,\" you get a popup window with two tabs, \"Submissions,\" and \"Notebook.\"\nOn the Notebook tab, you get a dropdown field called, \"Select Notebook.\"\nI believe you can start a new notebook from here, and it will automatically be associated with the competition.\nIf, however, you start a notebook independently, it seems that you you need to link it to the competition for it to show up.\nTo do that, go to the notebook, and use the \"Add Data\" panel to select \"Competition Datasets,\" and from there, click on the + sign to select \"2023 Kaggle AI Report.\"\nThen, when you go to the \"Submit Predictions\" panel, your notebook will become available in the dropdown to select for a submission entry.  You can tell this because when you navigate your browser to the top level URL for the notebook, the subtitle title will now say, \"Python * 2023 Kaggle AI Report\".\n\nNote that this explanation may be incomplete or partially incorrect, as it still does not overcome the \"Evaluation metric raised an unexpected error\".",
    "2283990": "Can you paste the contents of your submission.csv file as a new comment in this thread? That will be very helpful for troubleshooting. It should look similar to [this](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions):\n\n```python\ntype,value\nessay_category,'copy/paste the exact category that you are submitting to'\nessay_url,'http://www.kaggle.com/your_username/your_notebook'\nfeedback1_url,'http://www.kaggle.com/.../your_1st_peer_feedback'\nfeedback2_url,'http://www.kaggle.com/.../your_2nd_peer_feedback'\nfeedback3_url,'http://www.kaggle.com/.../your_3rd_peer_feedback'\n```\n\nThe most straightforward workflow to get the competition submission to work is likely going to be as follows: (1) replace the URLs in the sample_submission.csv file with your actual URLs; (2) save and rename the file as submission.csv; and then (3) submit your submission.csv file to this competition.",
    "2284172": "Thank you for this suggestion. Problem solved, I was able to get a submission.csv file to be accepted.\nHere is what I learned.\n\n1. I had copied and pasted the template submission.csv file directly from the text field in the URL,\nhttps://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions\nThis template .csv contains leading spaces in each line.\nIf the csv file has leading spaces, the error is:\n\"Evaluation metric raised an unexpected error\"\n\nThe correct sample_submission.csv file without leading spaces is obtained by navigating on the page,\nhttps://www.kaggle.com/competitions/2023-kaggle-ai-report/data?select=sample_submission.csv\n\n2. BTW, if a field name is misspelled, you get a different error:\n\"Solution and submission values for type do not match\"\n\nAgain, it is puzzling that a search for this error turns up nothing.  I cannot have been the first person to include a misspelled field name while testing or otherwise.\n\n3. It is okay to have a newline at the end of the csv file.\n\n4. The field values can be in quotes or not.  It works either way."
  },
  "source": "meta"
}