{
  "id": 23969,
  "title": "date columns with no corresponding features",
  "url": "/competitions/bosch-production-line-performance/discussion/23969",
  "author_name": "",
  "post_date": "2016-09-29T08:54:35.470Z",
  "votes": 1,
  "comment_count": 3,
  "views": 701,
  "content": "<p>there seems to be 32 columns in the train_date file that does not have any corresponding features in numeric or categorical. and those date columns are not all NaNs.</p>\n\n<p>to the admin: what are these dates? can we ignore them?</p>\n\n<p>['L0_S7_D140', 'L0_S7_D141', 'L0_S8_D148', 'L0_S19_D457', 'L0_S19_D458', 'L0_S20_D465', 'L1_S24_D1826', 'L1_S24_D1833', 'L1_S25_D2235', 'L1_S25_D2236', 'L1_S25_D2445', 'L1_S25_D2446', 'L1_S25_D2453', 'L1_S25_D2502', 'L1_S25_D2503', 'L1_S25_D2728', 'L1_S25_D2729', 'L1_S25_D2736', 'L1_S25_D2785', 'L1_S25_D2786', 'L1_S25_D3011', 'L1_S25_D3012', 'L1_S25_D3019', 'L3_S34_D3875', 'L3_S37_D3942', 'L3_S37_D3943', 'L3_S41_D4010', 'L3_S41_D4013', 'L3_S41_D4022', 'L3_S41_D4025', 'L3_S48_D4195', 'L3_S51_D4255']</p>",
  "messages": [
    {
      "id": "137204",
      "postDate": "09/29/2016 08:54:35",
      "content": "<p>there seems to be 32 columns in the train_date file that does not have any corresponding features in numeric or categorical. and those date columns are not all NaNs.</p>\n\n<p>to the admin: what are these dates? can we ignore them?</p>\n\n<p>['L0_S7_D140', 'L0_S7_D141', 'L0_S8_D148', 'L0_S19_D457', 'L0_S19_D458', 'L0_S20_D465', 'L1_S24_D1826', 'L1_S24_D1833', 'L1_S25_D2235', 'L1_S25_D2236', 'L1_S25_D2445', 'L1_S25_D2446', 'L1_S25_D2453', 'L1_S25_D2502', 'L1_S25_D2503', 'L1_S25_D2728', 'L1_S25_D2729', 'L1_S25_D2736', 'L1_S25_D2785', 'L1_S25_D2786', 'L1_S25_D3011', 'L1_S25_D3012', 'L1_S25_D3019', 'L3_S34_D3875', 'L3_S37_D3942', 'L3_S37_D3943', 'L3_S41_D4010', 'L3_S41_D4013', 'L3_S41_D4022', 'L3_S41_D4025', 'L3_S48_D4195', 'L3_S51_D4255']</p>",
      "rawMarkdown": "there seems to be 32 columns in the train_date file that does not have any corresponding features in numeric or categorical. and those date columns are not all NaNs.\r\n\r\nto the admin: what are these dates? can we ignore them?\r\n\r\n['L0_S7_D140', 'L0_S7_D141', 'L0_S8_D148', 'L0_S19_D457', 'L0_S19_D458', 'L0_S20_D465', 'L1_S24_D1826', 'L1_S24_D1833', 'L1_S25_D2235', 'L1_S25_D2236', 'L1_S25_D2445', 'L1_S25_D2446', 'L1_S25_D2453', 'L1_S25_D2502', 'L1_S25_D2503', 'L1_S25_D2728', 'L1_S25_D2729', 'L1_S25_D2736', 'L1_S25_D2785', 'L1_S25_D2786', 'L1_S25_D3011', 'L1_S25_D3012', 'L1_S25_D3019', 'L3_S34_D3875', 'L3_S37_D3942', 'L3_S37_D3943', 'L3_S41_D4010', 'L3_S41_D4013', 'L3_S41_D4022', 'L3_S41_D4025', 'L3_S48_D4195', 'L3_S51_D4255']",
      "votes": null
    },
    {
      "id": "137234",
      "postDate": "09/29/2016 12:41:57",
      "content": "<p>If you are using xgb then as the information content of these columns is zero they will be ignored</p>",
      "rawMarkdown": "If you are using xgb then as the information content of these columns is zero they will be ignored",
      "votes": null
    },
    {
      "id": "137271",
      "postDate": "09/29/2016 20:13:09",
      "content": "<p>xgboost does not look at column names at all, so if there's any information in those wayward dates they'll get pulled in.</p>",
      "rawMarkdown": "xgboost does not look at column names at all, so if there's any information in those wayward dates they'll get pulled in.",
      "votes": null
    },
    {
      "id": "137322",
      "postDate": "09/30/2016 11:51:02",
      "content": "<p>[quote=happycube;137271]</p>\n\n<p>xgboost does not look at column names at all, so if there's any information in those wayward dates they'll get pulled in.</p>\n\n<p>[/quote]\nlol maybe I should read the posts more carefully before responding</p>",
      "rawMarkdown": "[quote=happycube;137271]\r\n\r\nxgboost does not look at column names at all, so if there's any information in those wayward dates they'll get pulled in.\r\n\r\n[/quote]\r\nlol maybe I should read the posts more carefully before responding",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 137234,
      "author_name": "scirpus",
      "author_url": "",
      "post_date": "09/29/2016 12:41:57",
      "content": "<p>If you are using xgb then as the information content of these columns is zero they will be ignored</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 137271,
      "author_name": "happycube",
      "author_url": "",
      "post_date": "09/29/2016 20:13:09",
      "content": "<p>xgboost does not look at column names at all, so if there's any information in those wayward dates they'll get pulled in.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 137322,
      "author_name": "scirpus",
      "author_url": "",
      "post_date": "09/30/2016 11:51:02",
      "content": "<p>[quote=happycube;137271]</p>\n\n<p>xgboost does not look at column names at all, so if there's any information in those wayward dates they'll get pulled in.</p>\n\n<p>[/quote]\nlol maybe I should read the posts more carefully before responding</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "137204": "there seems to be 32 columns in the train_date file that does not have any corresponding features in numeric or categorical. and those date columns are not all NaNs.\r\n\r\nto the admin: what are these dates? can we ignore them?\r\n\r\n['L0_S7_D140', 'L0_S7_D141', 'L0_S8_D148', 'L0_S19_D457', 'L0_S19_D458', 'L0_S20_D465', 'L1_S24_D1826', 'L1_S24_D1833', 'L1_S25_D2235', 'L1_S25_D2236', 'L1_S25_D2445', 'L1_S25_D2446', 'L1_S25_D2453', 'L1_S25_D2502', 'L1_S25_D2503', 'L1_S25_D2728', 'L1_S25_D2729', 'L1_S25_D2736', 'L1_S25_D2785', 'L1_S25_D2786', 'L1_S25_D3011', 'L1_S25_D3012', 'L1_S25_D3019', 'L3_S34_D3875', 'L3_S37_D3942', 'L3_S37_D3943', 'L3_S41_D4010', 'L3_S41_D4013', 'L3_S41_D4022', 'L3_S41_D4025', 'L3_S48_D4195', 'L3_S51_D4255']",
    "137234": "If you are using xgb then as the information content of these columns is zero they will be ignored",
    "137271": "xgboost does not look at column names at all, so if there's any information in those wayward dates they'll get pulled in.",
    "137322": "[quote=happycube;137271]\r\n\r\nxgboost does not look at column names at all, so if there's any information in those wayward dates they'll get pulled in.\r\n\r\n[/quote]\r\nlol maybe I should read the posts more carefully before responding"
  },
  "source": "meta"
}