{
  "id": 402478,
  "title": "Question to organizers on data series exact match",
  "url": "/competitions/benetech-making-graphs-accessible/discussion/402478",
  "author_name": "",
  "post_date": "2023-04-18T15:09:03.501846700Z",
  "votes": 2,
  "comment_count": 1,
  "views": 0,
  "content": "<p>I have a question regarding the data series exact match. The evaluation page states:</p>\n<blockquote>\n  <p>We first check the number of values and type of chart predicted for a series. If either of these is different than that in the ground-truth, the score for that series is 0. </p>\n</blockquote>\n<p>What happens if a data series is predicted with different amount of points for each axis? For example:</p>\n<pre><code>exampleplot_x = \"a;b;c\" # &lt; --- Three predicted points on x-axis\nexampleplot_y = \"1;2;3;4;5;6;7\" # &lt; --- Seven predicted points on y-axis\n</code></pre>\n<p>Suppose the ground truth is 3 data series points and the chart type was predicted right, do both submission rows get scored 0 since they belong to the same plot or does the <code>x-axis</code> gets scored at least since the number of predicted points were right?</p>\n<p><a href=\"https://www.kaggle.com/ryanholbrook\" target=\"_blank\">@ryanholbrook</a> </p>",
  "messages": [
    {
      "id": "2225981",
      "postDate": "04/18/2023 15:09:03",
      "content": "<p>I have a question regarding the data series exact match. The evaluation page states:</p>\n<blockquote>\n  <p>We first check the number of values and type of chart predicted for a series. If either of these is different than that in the ground-truth, the score for that series is 0. </p>\n</blockquote>\n<p>What happens if a data series is predicted with different amount of points for each axis? For example:</p>\n<pre><code>exampleplot_x = \"a;b;c\" # &lt; --- Three predicted points on x-axis\nexampleplot_y = \"1;2;3;4;5;6;7\" # &lt; --- Seven predicted points on y-axis\n</code></pre>\n<p>Suppose the ground truth is 3 data series points and the chart type was predicted right, do both submission rows get scored 0 since they belong to the same plot or does the <code>x-axis</code> gets scored at least since the number of predicted points were right?</p>\n<p><a href=\"https://www.kaggle.com/ryanholbrook\" target=\"_blank\">@ryanholbrook</a> </p>",
      "rawMarkdown": "I have a question regarding the data series exact match. The evaluation page states:\n\n> We first check the number of values and type of chart predicted for a series. If either of these is different than that in the ground-truth, the score for that series is 0. \n\nWhat happens if a data series is predicted with different amount of points for each axis? For example:\n```\nexampleplot_x = \"a;b;c\" # < --- Three predicted points on x-axis\nexampleplot_y = \"1;2;3;4;5;6;7\" # < --- Seven predicted points on y-axis\n```\n\nSuppose the ground truth is 3 data series points and the chart type was predicted right, do both submission rows get scored 0 since they belong to the same plot or does the `x-axis` gets scored at least since the number of predicted points were right?\n\n@ryanholbrook",
      "votes": null
    },
    {
      "id": "2226056",
      "postDate": "04/18/2023 16:03:01",
      "content": "<p>All rows are scored independently. The exact match condition would only apply to the row with the incorrect number of predictions.</p>",
      "rawMarkdown": "All rows are scored independently. The exact match condition would only apply to the row with the incorrect number of predictions.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2226056,
      "author_name": "ryanholbrook",
      "author_url": "",
      "post_date": "04/18/2023 16:03:01",
      "content": "<p>All rows are scored independently. The exact match condition would only apply to the row with the incorrect number of predictions.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2225981": "I have a question regarding the data series exact match. The evaluation page states:\n\n> We first check the number of values and type of chart predicted for a series. If either of these is different than that in the ground-truth, the score for that series is 0. \n\nWhat happens if a data series is predicted with different amount of points for each axis? For example:\n```\nexampleplot_x = \"a;b;c\" # < --- Three predicted points on x-axis\nexampleplot_y = \"1;2;3;4;5;6;7\" # < --- Seven predicted points on y-axis\n```\n\nSuppose the ground truth is 3 data series points and the chart type was predicted right, do both submission rows get scored 0 since they belong to the same plot or does the `x-axis` gets scored at least since the number of predicted points were right?\n\n@ryanholbrook",
    "2226056": "All rows are scored independently. The exact match condition would only apply to the row with the incorrect number of predictions."
  },
  "source": "meta"
}