{
  "id": 24258,
  "title": "Similar Feature Values, Different Response",
  "url": "/competitions/bosch-production-line-performance/discussion/24258",
  "author_name": "",
  "post_date": "2016-10-10T20:21:49.277Z",
  "votes": 2,
  "comment_count": 4,
  "views": 592,
  "content": "<p>While I was investigating similar instances I noticed that there are a lost of them. When all the features are the same, I expect to see the same response, however, this is not true! There are more than 1000 pairs of instances that have 1) exactly same value in all features, and 2) consecutive Ids. however, they have different responses. \nFew examples are:</p>\n\n<p>Id         Response</p>\n\n<p>1350    1 <br>\n1351    0   </p>\n\n<p>1793    1 <br>\n1794    0   </p>\n\n<p>5974    1 <br>\n5975    0   </p>\n\n<p>7018    1 <br>\n7019    0   </p>\n\n<p>7414    1 <br>\n7415    0   </p>\n\n<p>7944    1 <br>\n7945    0   </p>\n\n<p>11864   1 <br>\n11865   0   </p>\n\n<p>12280   1 <br>\n12281   0   </p>\n\n<p>12428   1 <br>\n12429   0   </p>\n\n<p>16676   1 <br>\n16677   0   </p>",
  "messages": [
    {
      "id": "138761",
      "postDate": "10/10/2016 20:21:49",
      "content": "<p>While I was investigating similar instances I noticed that there are a lost of them. When all the features are the same, I expect to see the same response, however, this is not true! There are more than 1000 pairs of instances that have 1) exactly same value in all features, and 2) consecutive Ids. however, they have different responses. \nFew examples are:</p>\n\n<p>Id         Response</p>\n\n<p>1350    1 <br>\n1351    0   </p>\n\n<p>1793    1 <br>\n1794    0   </p>\n\n<p>5974    1 <br>\n5975    0   </p>\n\n<p>7018    1 <br>\n7019    0   </p>\n\n<p>7414    1 <br>\n7415    0   </p>\n\n<p>7944    1 <br>\n7945    0   </p>\n\n<p>11864   1 <br>\n11865   0   </p>\n\n<p>12280   1 <br>\n12281   0   </p>\n\n<p>12428   1 <br>\n12429   0   </p>\n\n<p>16676   1 <br>\n16677   0   </p>",
      "rawMarkdown": "While I was investigating similar instances I noticed that there are a lost of them. When all the features are the same, I expect to see the same response, however, this is not true! There are more than 1000 pairs of instances that have 1) exactly same value in all features, and 2) consecutive Ids. however, they have different responses. \r\nFew examples are:\r\n\r\nId         Response\r\n\r\n1350\t1\t\r\n1351\t0\t\r\n\r\n1793\t1\t\r\n1794\t0\t\r\n\r\n5974\t1\t\r\n5975\t0\t\r\n\r\n7018\t1\t\r\n7019\t0\t\r\n\r\n7414\t1\t\r\n7415\t0\t\r\n\r\n7944\t1\t\r\n7945\t0\t\r\n\r\n11864\t1\t\r\n11865\t0\t\r\n\r\n12280\t1\t\r\n12281\t0\t\r\n\r\n12428\t1\t\r\n12429\t0\t\r\n\r\n16676\t1\t\r\n16677\t0",
      "votes": null
    },
    {
      "id": "138766",
      "postDate": "10/10/2016 20:45:22",
      "content": "<p>This is one of the leak in this dataset,</p>\n\n<p>if duplicated rows and first response ==1:</p>\n\n<pre><code>   the second response is 0\n</code></pre>\n\n<p>how can this be not a leak? a simple shuffling will make it impossible to decide which of the two rows is &quot;1&quot; </p>",
      "rawMarkdown": "This is one of the leak in this dataset,\r\n\r\nif duplicated rows and first response ==1:\r\n\r\n       the second response is 0\r\n\r\nhow can this be not a leak? a simple shuffling will make it impossible to decide which of the two rows is \"1\"",
      "votes": null
    },
    {
      "id": "138769",
      "postDate": "10/10/2016 20:49:16",
      "content": "<p>Well, it is not always like this. There are cases that the second response is one and the first response is zero. Also those the both are zero and both are one!</p>",
      "rawMarkdown": "Well, it is not always like this. There are cases that the second response is one and the first response is zero. Also those the both are zero and both are one!",
      "votes": null
    },
    {
      "id": "138770",
      "postDate": "10/10/2016 20:51:11",
      "content": "<p>[quote=Mojtaba;138769]</p>\n\n<p>Well, it is not always like this. There are cases that the second response is one and the first response is zero. Also those the both are zero and both are one!</p>\n\n<p>[/quote]</p>\n\n<p>Yes, but it is more than random.</p>",
      "rawMarkdown": "[quote=Mojtaba;138769]\r\n\r\nWell, it is not always like this. There are cases that the second response is one and the first response is zero. Also those the both are zero and both are one!\r\n\r\n[/quote]\r\n\r\nYes, but it is more than random.",
      "votes": null
    },
    {
      "id": "138774",
      "postDate": "10/10/2016 20:58:19",
      "content": "<p>My analysis shows the following statistics:</p>\n\n<p>[FirstResponse][SecondResponse]=Count</p>\n\n<p>PP=323</p>\n\n<p>FP=51</p>\n\n<p>PF=955</p>\n\n<p>FF=22389</p>",
      "rawMarkdown": "My analysis shows the following statistics:\r\n\r\n[FirstResponse][SecondResponse]=Count\r\n\r\nPP=323\r\n\r\nFP=51\r\n\r\nPF=955\r\n\r\nFF=22389",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 138766,
      "author_name": "jiweiliu",
      "author_url": "",
      "post_date": "10/10/2016 20:45:22",
      "content": "<p>This is one of the leak in this dataset,</p>\n\n<p>if duplicated rows and first response ==1:</p>\n\n<pre><code>   the second response is 0\n</code></pre>\n\n<p>how can this be not a leak? a simple shuffling will make it impossible to decide which of the two rows is &quot;1&quot; </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138769,
      "author_name": "mojtabaebrahimi85",
      "author_url": "",
      "post_date": "10/10/2016 20:49:16",
      "content": "<p>Well, it is not always like this. There are cases that the second response is one and the first response is zero. Also those the both are zero and both are one!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138770,
      "author_name": "jiweiliu",
      "author_url": "",
      "post_date": "10/10/2016 20:51:11",
      "content": "<p>[quote=Mojtaba;138769]</p>\n\n<p>Well, it is not always like this. There are cases that the second response is one and the first response is zero. Also those the both are zero and both are one!</p>\n\n<p>[/quote]</p>\n\n<p>Yes, but it is more than random.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138774,
      "author_name": "mojtabaebrahimi85",
      "author_url": "",
      "post_date": "10/10/2016 20:58:19",
      "content": "<p>My analysis shows the following statistics:</p>\n\n<p>[FirstResponse][SecondResponse]=Count</p>\n\n<p>PP=323</p>\n\n<p>FP=51</p>\n\n<p>PF=955</p>\n\n<p>FF=22389</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "138761": "While I was investigating similar instances I noticed that there are a lost of them. When all the features are the same, I expect to see the same response, however, this is not true! There are more than 1000 pairs of instances that have 1) exactly same value in all features, and 2) consecutive Ids. however, they have different responses. \r\nFew examples are:\r\n\r\nId         Response\r\n\r\n1350\t1\t\r\n1351\t0\t\r\n\r\n1793\t1\t\r\n1794\t0\t\r\n\r\n5974\t1\t\r\n5975\t0\t\r\n\r\n7018\t1\t\r\n7019\t0\t\r\n\r\n7414\t1\t\r\n7415\t0\t\r\n\r\n7944\t1\t\r\n7945\t0\t\r\n\r\n11864\t1\t\r\n11865\t0\t\r\n\r\n12280\t1\t\r\n12281\t0\t\r\n\r\n12428\t1\t\r\n12429\t0\t\r\n\r\n16676\t1\t\r\n16677\t0",
    "138766": "This is one of the leak in this dataset,\r\n\r\nif duplicated rows and first response ==1:\r\n\r\n       the second response is 0\r\n\r\nhow can this be not a leak? a simple shuffling will make it impossible to decide which of the two rows is \"1\"",
    "138769": "Well, it is not always like this. There are cases that the second response is one and the first response is zero. Also those the both are zero and both are one!",
    "138770": "[quote=Mojtaba;138769]\r\n\r\nWell, it is not always like this. There are cases that the second response is one and the first response is zero. Also those the both are zero and both are one!\r\n\r\n[/quote]\r\n\r\nYes, but it is more than random.",
    "138774": "My analysis shows the following statistics:\r\n\r\n[FirstResponse][SecondResponse]=Count\r\n\r\nPP=323\r\n\r\nFP=51\r\n\r\nPF=955\r\n\r\nFF=22389"
  },
  "source": "meta"
}