{
  "id": 401494,
  "title": "Submission Scoring Error Occuring...",
  "url": "/competitions/benetech-making-graphs-accessible/discussion/401494",
  "author_name": "",
  "post_date": "2023-04-13T14:31:01.782302600Z",
  "votes": 9,
  "comment_count": 5,
  "views": 0,
  "content": "<p>I'm  trying to submit the notebook to inference using deplot(referenced by following url).<br>\n<a href=\"https://www.kaggle.com/competitions/benetech-making-graphs-accessible/discussion/400250\" target=\"_blank\">https://www.kaggle.com/competitions/benetech-making-graphs-accessible/discussion/400250</a></p>\n<p>I spent a lot of time to resolve submission scoring error and still not completed.<br>\nI've done following attempts.</p>\n<ul>\n<li>make sure column names and numbers are right</li>\n<li>make sure rows are two(x-axis and y-axis) per each images</li>\n<li>make sure data points in each data of \"data_series\" column are separated by \";\"</li>\n<li>make sure special chars(\";\", \",\", \"\\n\", \"\\t\") are not in data points.</li>\n</ul>\n<p>Does anyone come up with other problems?<br>\nI want host to publish calculation logic as source code…</p>\n<p>Now I suspect that following cases cause scoring error.</p>\n<ul>\n<li>numerical series including \"nan\" value cause error<br>\nex) 1.0;1.0;2.0;nan;3.0</li>\n<li>including hex string cause error<br>\nex) abc;def;&lt;0xE2&gt;;ghi</li>\n</ul>",
  "messages": [
    {
      "id": "2220599",
      "postDate": "04/13/2023 14:31:01",
      "content": "<p>I'm  trying to submit the notebook to inference using deplot(referenced by following url).<br>\n<a href=\"https://www.kaggle.com/competitions/benetech-making-graphs-accessible/discussion/400250\" target=\"_blank\">https://www.kaggle.com/competitions/benetech-making-graphs-accessible/discussion/400250</a></p>\n<p>I spent a lot of time to resolve submission scoring error and still not completed.<br>\nI've done following attempts.</p>\n<ul>\n<li>make sure column names and numbers are right</li>\n<li>make sure rows are two(x-axis and y-axis) per each images</li>\n<li>make sure data points in each data of \"data_series\" column are separated by \";\"</li>\n<li>make sure special chars(\";\", \",\", \"\\n\", \"\\t\") are not in data points.</li>\n</ul>\n<p>Does anyone come up with other problems?<br>\nI want host to publish calculation logic as source code…</p>\n<p>Now I suspect that following cases cause scoring error.</p>\n<ul>\n<li>numerical series including \"nan\" value cause error<br>\nex) 1.0;1.0;2.0;nan;3.0</li>\n<li>including hex string cause error<br>\nex) abc;def;&lt;0xE2&gt;;ghi</li>\n</ul>",
      "rawMarkdown": "I'm  trying to submit the notebook to inference using deplot(referenced by following url).\nhttps://www.kaggle.com/competitions/benetech-making-graphs-accessible/discussion/400250\n\nI spent a lot of time to resolve submission scoring error and still not completed.\nI've done following attempts.\n- make sure column names and numbers are right\n- make sure rows are two(x-axis and y-axis) per each images\n- make sure data points in each data of \"data_series\" column are separated by \";\"\n- make sure special chars(\";\", \",\", \"\\n\", \"\\t\") are not in data points.\n\nDoes anyone come up with other problems?\nI want host to publish calculation logic as source code...\n\nNow I suspect that following cases cause scoring error.\n- numerical series including \"nan\" value cause error\n  ex) 1.0;1.0;2.0;nan;3.0\n- including hex string cause error\n  ex) abc;def;<0xE2>;ghi",
      "votes": null
    },
    {
      "id": "2220664",
      "postDate": "04/13/2023 15:30:10",
      "content": "<p>Same here most of my new experiments are getting submission error. I ran out of submissions for today ! I am not sure yet what is the problem, I have a feeling that I am not validating all outputs ! But at the same time I was able to get 0.5 with a notebook that when I re-ran it fails 🙄🙄</p>",
      "rawMarkdown": "Same here most of my new experiments are getting submission error. I ran out of submissions for today ! I am not sure yet what is the problem, I have a feeling that I am not validating all outputs ! But at the same time I was able to get 0.5 with a notebook that when I re-ran it fails 🙄🙄",
      "votes": null
    },
    {
      "id": "2220889",
      "postDate": "04/13/2023 18:46:23",
      "content": "<p>That happens a lot to me because DePlot can generate anything which is really hard to clean. 🙄</p>",
      "rawMarkdown": "That happens a lot to me because DePlot can generate anything which is really hard to clean. 🙄",
      "votes": null
    },
    {
      "id": "2224615",
      "postDate": "04/17/2023 13:31:42",
      "content": "<p>Thank you guys.<br>\nI decided to use another solution but deplot.</p>",
      "rawMarkdown": "Thank you guys.\nI decided to use another solution but deplot.",
      "votes": null
    },
    {
      "id": "2240004",
      "postDate": "04/30/2023 06:14:57",
      "content": "<p>I'm still struggling now.<br>\nI'm exhausted.</p>\n<p>How evaluation code work in submission scoring?</p>\n<p>How can I debug without any stuck trace?<br>\nMay be a lot of people wastes a lot of time to this work.</p>\n<p>I really want organizer to publish evaluation source code.<br>\n(I think <a href=\"https://www.kaggle.com/code/ryanholbrook/competition-metric-benetech-mixed-match\" target=\"_blank\">this</a> is not used in submission scoring process by itself.)</p>",
      "rawMarkdown": "I'm still struggling now.\nI'm exhausted.\n\nHow evaluation code work in submission scoring?\n\nHow can I debug without any stuck trace?\nMay be a lot of people wastes a lot of time to this work.\n\nI really want organizer to publish evaluation source code.\n(I think [this](https://www.kaggle.com/code/ryanholbrook/competition-metric-benetech-mixed-match) is not used in submission scoring process by itself.)",
      "votes": null
    },
    {
      "id": "2240244",
      "postDate": "04/30/2023 11:19:41",
      "content": "<p>I resolved.<br>\nmy submission contained inf or -inf or nan.</p>",
      "rawMarkdown": "I resolved.\nmy submission contained inf or -inf or nan.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2220664,
      "author_name": "asalhi",
      "author_url": "",
      "post_date": "04/13/2023 15:30:10",
      "content": "<p>Same here most of my new experiments are getting submission error. I ran out of submissions for today ! I am not sure yet what is the problem, I have a feeling that I am not validating all outputs ! But at the same time I was able to get 0.5 with a notebook that when I re-ran it fails 🙄🙄</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2220889,
      "author_name": "zhugds",
      "author_url": "",
      "post_date": "04/13/2023 18:46:23",
      "content": "<p>That happens a lot to me because DePlot can generate anything which is really hard to clean. 🙄</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2224615,
      "author_name": "takafumifujii",
      "author_url": "",
      "post_date": "04/17/2023 13:31:42",
      "content": "<p>Thank you guys.<br>\nI decided to use another solution but deplot.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2240004,
      "author_name": "takafumifujii",
      "author_url": "",
      "post_date": "04/30/2023 06:14:57",
      "content": "<p>I'm still struggling now.<br>\nI'm exhausted.</p>\n<p>How evaluation code work in submission scoring?</p>\n<p>How can I debug without any stuck trace?<br>\nMay be a lot of people wastes a lot of time to this work.</p>\n<p>I really want organizer to publish evaluation source code.<br>\n(I think <a href=\"https://www.kaggle.com/code/ryanholbrook/competition-metric-benetech-mixed-match\" target=\"_blank\">this</a> is not used in submission scoring process by itself.)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2240244,
      "author_name": "takafumifujii",
      "author_url": "",
      "post_date": "04/30/2023 11:19:41",
      "content": "<p>I resolved.<br>\nmy submission contained inf or -inf or nan.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2220599": "I'm  trying to submit the notebook to inference using deplot(referenced by following url).\nhttps://www.kaggle.com/competitions/benetech-making-graphs-accessible/discussion/400250\n\nI spent a lot of time to resolve submission scoring error and still not completed.\nI've done following attempts.\n- make sure column names and numbers are right\n- make sure rows are two(x-axis and y-axis) per each images\n- make sure data points in each data of \"data_series\" column are separated by \";\"\n- make sure special chars(\";\", \",\", \"\\n\", \"\\t\") are not in data points.\n\nDoes anyone come up with other problems?\nI want host to publish calculation logic as source code...\n\nNow I suspect that following cases cause scoring error.\n- numerical series including \"nan\" value cause error\n  ex) 1.0;1.0;2.0;nan;3.0\n- including hex string cause error\n  ex) abc;def;<0xE2>;ghi",
    "2220664": "Same here most of my new experiments are getting submission error. I ran out of submissions for today ! I am not sure yet what is the problem, I have a feeling that I am not validating all outputs ! But at the same time I was able to get 0.5 with a notebook that when I re-ran it fails 🙄🙄",
    "2220889": "That happens a lot to me because DePlot can generate anything which is really hard to clean. 🙄",
    "2224615": "Thank you guys.\nI decided to use another solution but deplot.",
    "2240004": "I'm still struggling now.\nI'm exhausted.\n\nHow evaluation code work in submission scoring?\n\nHow can I debug without any stuck trace?\nMay be a lot of people wastes a lot of time to this work.\n\nI really want organizer to publish evaluation source code.\n(I think [this](https://www.kaggle.com/code/ryanholbrook/competition-metric-benetech-mixed-match) is not used in submission scoring process by itself.)",
    "2240244": "I resolved.\nmy submission contained inf or -inf or nan."
  },
  "source": "meta"
}