{
  "id": 399029,
  "title": "What's a good validation scheme for this competition?",
  "url": "/competitions/benetech-making-graphs-accessible/discussion/399029",
  "author_name": "Sadhaklal",
  "post_date": "2023-04-02T05:50:49.794000",
  "votes": 10,
  "comment_count": 1,
  "views": 0,
  "content": "<p>There are 2 sources: <code>'generated'</code> &amp; <code>'extracted'</code>.</p>\n<p>There are 5 types of charts: <code>'line'</code>, <code>'vertical_bar'</code>, <code>'scatter'</code>, <code>'dot'</code> and <code>'horizontal_bar'</code>.</p>\n<p>After doing some EDA, I found:</p>\n<ol>\n<li><code>'dot'</code> charts are only present in the <code>'generated'</code> source.</li>\n<li><code>'horizontal_bar'</code> charts are only present in the <code>'extracted'</code> source.</li>\n</ol>\n<p>The \"Data\" section states that the test set contains only <code>'extracted'</code> images.</p>\n<p>I was wondering what's a good validation scheme.</p>\n<p>To mimic the test set closely, it makes sense to put only <code>'extracted'</code> images in the validation set. But unfortunately, there are no <code>'dot'</code> plots in the <code>'extracted'</code> source.</p>\n<p>Any thoughts / opinions?</p>",
  "messages": [
    {
      "id": 2205941,
      "postDate": "2023-04-02T05:50:49.793Z",
      "content": "<p>There are 2 sources: <code>'generated'</code> &amp; <code>'extracted'</code>.</p>\n<p>There are 5 types of charts: <code>'line'</code>, <code>'vertical_bar'</code>, <code>'scatter'</code>, <code>'dot'</code> and <code>'horizontal_bar'</code>.</p>\n<p>After doing some EDA, I found:</p>\n<ol>\n<li><code>'dot'</code> charts are only present in the <code>'generated'</code> source.</li>\n<li><code>'horizontal_bar'</code> charts are only present in the <code>'extracted'</code> source.</li>\n</ol>\n<p>The \"Data\" section states that the test set contains only <code>'extracted'</code> images.</p>\n<p>I was wondering what's a good validation scheme.</p>\n<p>To mimic the test set closely, it makes sense to put only <code>'extracted'</code> images in the validation set. But unfortunately, there are no <code>'dot'</code> plots in the <code>'extracted'</code> source.</p>\n<p>Any thoughts / opinions?</p>",
      "rawMarkdown": "There are 2 sources: `'generated'` & `'extracted'`.\n\nThere are 5 types of charts: `'line'`, `'vertical_bar'`, `'scatter'`, `'dot'` and `'horizontal_bar'`.\n\nAfter doing some EDA, I found:\n\n1. `'dot'` charts are only present in the `'generated'` source.\n2. `'horizontal_bar'` charts are only present in the `'extracted'` source.\n\nThe \"Data\" section states that the test set contains only `'extracted'` images.\n\nI was wondering what's a good validation scheme.\n\nTo mimic the test set closely, it makes sense to put only `'extracted'` images in the validation set. But unfortunately, there are no `'dot'` plots in the `'extracted'` source.\n\nAny thoughts / opinions?",
      "votes": 9
    },
    {
      "id": 2216845,
      "postDate": "2023-04-10T11:56:36.817Z",
      "rawMarkdown": "",
      "votes": 1,
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 2216845,
      "author_name": "",
      "author_url": "",
      "post_date": "2023-04-10T11:56:36.817000",
      "content": "",
      "votes": 1,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2205941": "There are 2 sources: `'generated'` & `'extracted'`.\n\nThere are 5 types of charts: `'line'`, `'vertical_bar'`, `'scatter'`, `'dot'` and `'horizontal_bar'`.\n\nAfter doing some EDA, I found:\n\n1. `'dot'` charts are only present in the `'generated'` source.\n2. `'horizontal_bar'` charts are only present in the `'extracted'` source.\n\nThe \"Data\" section states that the test set contains only `'extracted'` images.\n\nI was wondering what's a good validation scheme.\n\nTo mimic the test set closely, it makes sense to put only `'extracted'` images in the validation set. But unfortunately, there are no `'dot'` plots in the `'extracted'` source.\n\nAny thoughts / opinions?",
    "2216845": ""
  }
}