{
  "id": 24207,
  "title": "TO ADMIN: Will this contest be reset? ",
  "url": "/competitions/bosch-production-line-performance/discussion/24207",
  "author_name": "",
  "post_date": "2016-10-09T01:52:24.603Z",
  "votes": 3,
  "comment_count": 22,
  "views": 4339,
  "content": "<p>To Bosch and Kaggle Administrators,</p>\n\n<p>Will this competition be reset or will it continue as is? I don't mind either way, but it's probably better to know sooner versus later.</p>\n\n<p>Thanks,</p>\n\n<p>Mike</p>",
  "messages": [
    {
      "id": "138473",
      "postDate": "10/09/2016 01:52:24",
      "content": "<p>To Bosch and Kaggle Administrators,</p>\n\n<p>Will this competition be reset or will it continue as is? I don't mind either way, but it's probably better to know sooner versus later.</p>\n\n<p>Thanks,</p>\n\n<p>Mike</p>",
      "rawMarkdown": "To Bosch and Kaggle Administrators,\r\n\r\nWill this competition be reset or will it continue as is? I don't mind either way, but it's probably better to know sooner versus later.\r\n\r\nThanks,\r\n\r\nMike",
      "votes": null
    },
    {
      "id": "138476",
      "postDate": "10/09/2016 02:43:50",
      "content": "<p>I'd also like to know if it's acceptable to create features by using combined train+test data.  </p>\n\n<p>What Faron just posted appears to be <em>much</em> less effective if diffing Id's is performed on train and test separately. </p>",
      "rawMarkdown": "I'd also like to know if it's acceptable to create features by using combined train+test data.  \r\n\r\nWhat Faron just posted appears to be *much* less effective if diffing Id's is performed on train and test separately.",
      "votes": null
    },
    {
      "id": "138513",
      "postDate": "10/09/2016 09:43:03",
      "content": "<p>Mike. </p>\n\n<p>Why do you ask this now? </p>\n\n<p>You had found the leak quite some time ago if I can judge from your score.</p>\n\n<p>The fact that the leak just became known to the wider community, does not change the fact that the leak was there and some people had found it plus others had admitted it.</p>\n\n<p>On the contrary (and since the competition has not been already reset ) I think now it makes more sense to compete as a competitor ( because the client would not have received the value of an unleaky solution anyway) </p>\n\n<p>I don't think the competition will be reset based on what has happened in the past. </p>\n\n<p>Irrespective of this, I also think the competition should be reset. It is the timing of this post that surprises me a bit and the fact that it comes from someone that most probably had found the leak?  </p>",
      "rawMarkdown": "Mike. \r\n\r\nWhy do you ask this now? \r\n\r\nYou had found the leak quite some time ago if I can judge from your score.\r\n\r\nThe fact that the leak just became known to the wider community, does not change the fact that the leak was there and some people had found it plus others had admitted it.\r\n\r\nOn the contrary (and since the competition has not been already reset ) I think now it makes more sense to compete as a competitor ( because the client would not have received the value of an unleaky solution anyway) \r\n\r\n I don't think the competition will be reset based on what has happened in the past. \r\n\r\nIrrespective of this, I also think the competition should be reset. It is the timing of this post that surprises me a bit and the fact that it comes from someone that most probably had found the leak?",
      "votes": null
    },
    {
      "id": "138516",
      "postDate": "10/09/2016 09:47:44",
      "content": "<p>In the future, there should be something at the beginning of the competition that states whether IDs can be modelled on.</p>\n\n<p>@Marios, the leak can be modelled without using IDs or row orders at all, it's possible that Mike found it this route.</p>",
      "rawMarkdown": "In the future, there should be something at the beginning of the competition that states whether IDs can be modelled on.\r\n\r\n@Marios, the leak can be modelled without using IDs or row orders at all, it's possible that Mike found it this route.",
      "votes": null
    },
    {
      "id": "138519",
      "postDate": "10/09/2016 09:51:18",
      "content": "<p>I don't think an administrator exists for this competition as I received no answer to my rule clarification ages ago because I hated how train and test were split</p>",
      "rawMarkdown": "I don't think an administrator exists for this competition as I received no answer to my rule clarification ages ago because I hated how train and test were split",
      "votes": null
    },
    {
      "id": "138522",
      "postDate": "10/09/2016 09:58:43",
      "content": "<p>[quote=anokas;138516]</p>\n\n<p>@Marios, the leak can be modelled without using IDs or row orders at all, it's possible that Mike found it this route.</p>\n\n<p>[/quote]</p>\n\n<p>I know and you can get to a <a href=\"https://www.kaggle.com/c/bosch-production-line-performance/forums/t/24065/the-magical-feature-from-lb-0-3-to-0-4/138220#post138220\">0.4 model using a Raspberry Pi</a> </p>\n\n<p>I will not dwell more on this.</p>",
      "rawMarkdown": "[quote=anokas;138516]\r\n\r\n@Marios, the leak can be modelled without using IDs or row orders at all, it's possible that Mike found it this route.\r\n\r\n[/quote]\r\n\r\nI know and you can get to a [0.4 model using a Raspberry Pi][1] \r\n\r\nI will not dwell more on this.\r\n\r\n\r\n  [1]: https://www.kaggle.com/c/bosch-production-line-performance/forums/t/24065/the-magical-feature-from-lb-0-3-to-0-4/138220#post138220",
      "votes": null
    },
    {
      "id": "138541",
      "postDate": "10/09/2016 13:17:42",
      "content": "<p>Hi everyone,</p>\n\n<p>In this competition, there are strange features which improve our LB score.<br>\nI don't know it is leak or not. We need more information about dataset.</p>",
      "rawMarkdown": "Hi everyone,\r\n\r\nIn this competition, there are strange features which improve our LB score.<br>\r\nI don't know it is leak or not. We need more information about dataset.",
      "votes": null
    },
    {
      "id": "138547",
      "postDate": "10/09/2016 13:49:56",
      "content": "<p>When there is a mismatch between what the competition organizer wants and what we think they want, then that competition becomes a haunted one.  This is definitely hurting </p>",
      "rawMarkdown": "When there is a mismatch between what the competition organizer wants and what we think they want, then that competition becomes a haunted one.  This is definitely hurting",
      "votes": null
    },
    {
      "id": "138563",
      "postDate": "10/09/2016 15:39:58",
      "content": "<p>I am not using the &quot;leak&quot; found by Faron. You can get above 0.4 without using any Id based features. </p>\n\n<p>[quote=&#924;&#945;&#961;&#953;&#959;&#962; &#924;&#953;&#967;&#945;&#951;&#955;&#953;&#948;&#951;&#962; KazAnova;138513]</p>\n\n<p>Mike. </p>\n\n<p>Why do you ask this now? </p>\n\n<p>You had found the leak quite some time ago if I can judge from your score.</p>\n\n<p>The fact that the leak just became known to the wider community, does not change the fact that the leak was there and some people had found it plus others had admitted it.</p>\n\n<p>On the contrary (and since the competition has not been already reset ) I think now it makes more sense to compete as a competitor ( because the client would not have received the value of an unleaky solution anyway) </p>\n\n<p>I don't think the competition will be reset based on what has happened in the past. </p>\n\n<p>Irrespective of this, I also think the competition should be reset. It is the timing of this post that surprises me a bit and the fact that it comes from someone that most probably had found the leak?  </p>\n\n<p>[/quote]</p>",
      "rawMarkdown": "I am not using the \"leak\" found by Faron. You can get above 0.4 without using any Id based features. \r\n\r\n[quote=Μαριος Μιχαηλιδης KazAnova;138513]\r\n\r\nMike. \r\n\r\nWhy do you ask this now? \r\n\r\nYou had found the leak quite some time ago if I can judge from your score.\r\n\r\nThe fact that the leak just became known to the wider community, does not change the fact that the leak was there and some people had found it plus others had admitted it.\r\n\r\nOn the contrary (and since the competition has not been already reset ) I think now it makes more sense to compete as a competitor ( because the client would not have received the value of an unleaky solution anyway) \r\n\r\n I don't think the competition will be reset based on what has happened in the past. \r\n\r\nIrrespective of this, I also think the competition should be reset. It is the timing of this post that surprises me a bit and the fact that it comes from someone that most probably had found the leak?  \r\n\r\n[/quote]",
      "votes": null
    },
    {
      "id": "138564",
      "postDate": "10/09/2016 15:46:08",
      "content": "<p>@Mike, so that means you are using the leak in some indirect sense?</p>",
      "rawMarkdown": "Mike, so that means you are using the leak in some indirect sense?",
      "votes": null
    },
    {
      "id": "138580",
      "postDate": "10/09/2016 16:20:13",
      "content": "<p>[quote=&#924;&#945;&#961;&#953;&#959;&#962; &#924;&#953;&#967;&#945;&#951;&#955;&#953;&#948;&#951;&#962; KazAnova;138522]</p>\n\n<p>I know and you can get to a <a href=\"https://www.kaggle.com/c/bosch-production-line-performance/forums/t/24065/the-magical-feature-from-lb-0-3-to-0-4/138220#post138220\">0.4 model using a Raspberry Pi</a> </p>\n\n<p>[/quote]</p>\n\n<p>Nice One there !!! Raspberry Pi, Can't stop laughing...</p>",
      "rawMarkdown": "[quote=Μαριος Μιχαηλιδης KazAnova;138522]\r\n\r\n\r\nI know and you can get to a [0.4 model using a Raspberry Pi][1] \r\n\r\n\r\n  [1]: https://www.kaggle.com/c/bosch-production-line-performance/forums/t/24065/the-magical-feature-from-lb-0-3-to-0-4/138220#post138220\r\n\r\n[/quote]\r\n\r\nNice One there !!! Raspberry Pi, Can't stop laughing...",
      "votes": null
    },
    {
      "id": "138593",
      "postDate": "10/09/2016 17:25:14",
      "content": "<p>With all regards, but this seems a discussion about terms, not about the underlying data. The observations are related to objects that travel through a netwerk of stations with some 1700+ different routes. We are missing information about the nature of the parts that are being produced, but it is logical to assume that like parts will follow like routes. Some (type of) parts will probably be more difficult to produce than others:</p>\n\n<pre><code># -- Stations and lines      L1 L2\n#    |---------- L0 --------|**|-|*------- L3 ----------*\n#   &quot;0---------1---------2---------3-xxx-----4---------5-&quot;\n#   &quot;0123456789012345678901234567890123456789012345678901&quot;\n# 1: 0000000000000000000000001010011010001100000000000000 98 231 0.4242424\n# 2: 0000000000000000000000001010011010010100000000000000 85 194 0.4381443\n</code></pre>\n\n<p>A second observation is that stations can become more vulnerable to error over time, so it is completely logical to assume the existence of some dependency between the visitor of a station and its pre- or successor.  Hence near observations are (at least a bit) dependent and any real life numbering scheme for the id's (such as product serial numbers) will <em>consequently</em>  introduce id's that carry more information than a random unique number. </p>\n\n<p>That's not leakage, that's a characteristic of the problem.  </p>",
      "rawMarkdown": "With all regards, but this seems a discussion about terms, not about the underlying data. The observations are related to objects that travel through a netwerk of stations with some 1700+ different routes. We are missing information about the nature of the parts that are being produced, but it is logical to assume that like parts will follow like routes. Some (type of) parts will probably be more difficult to produce than others:\r\n\r\n\r\n    # -- Stations and lines      L1 L2\r\n    #    |---------- L0 --------|**|-|*------- L3 ----------*\r\n    #   \"0---------1---------2---------3-xxx-----4---------5-\"\r\n    #   \"0123456789012345678901234567890123456789012345678901\"\r\n    # 1: 0000000000000000000000001010011010001100000000000000 98 231 0.4242424\r\n    # 2: 0000000000000000000000001010011010010100000000000000 85 194 0.4381443\r\n\r\n\r\nA second observation is that stations can become more vulnerable to error over time, so it is completely logical to assume the existence of some dependency between the visitor of a station and its pre- or successor.  Hence near observations are (at least a bit) dependent and any real life numbering scheme for the id's (such as product serial numbers) will _consequently_  introduce id's that carry more information than a random unique number. \r\n\r\nThat's not leakage, that's a characteristic of the problem.",
      "votes": null
    },
    {
      "id": "138622",
      "postDate": "10/09/2016 21:03:53",
      "content": "<p>I had time to play with the data set only yesterday, and my current score of 0.17 is just a result of a couple of if-else clauses, with no ML models involved.</p>\n\n<p>I chose not to call it out, simply because I hadn't yet worked on it further to score 0.40+ to prove my point.</p>\n\n<p>Faron &amp; Kazanova saved me the trouble, I send them my thanks and respects.</p>\n\n<p>Please stop coming up with scenarios about how the &quot;magic features&quot; might indeed be helpful to Bosch. The data set is just poorly prepared.</p>\n\n<p>I don't care if the competition is reset or not, as long as the decision is made soon.</p>",
      "rawMarkdown": "I had time to play with the data set only yesterday, and my current score of 0.17 is just a result of a couple of if-else clauses, with no ML models involved.\r\n\r\nI chose not to call it out, simply because I hadn't yet worked on it further to score 0.40+ to prove my point.\r\n\r\nFaron & Kazanova saved me the trouble, I send them my thanks and respects.\r\n\r\nPlease stop coming up with scenarios about how the \"magic features\" might indeed be helpful to Bosch. The data set is just poorly prepared.\r\n\r\nI don't care if the competition is reset or not, as long as the decision is made soon.",
      "votes": null
    },
    {
      "id": "138649",
      "postDate": "10/10/2016 05:32:49",
      "content": "<p>PrakashSubedi - if Kazanova (or any Grandmaster for that matter) says they can get .4 on an rpi, I believe them.</p>\n\n<p>I could probably only get to about .34 with what I currently know, and with some time to write an efficient CSV parser so it wouldn't take too long to run ;)</p>",
      "rawMarkdown": "PrakashSubedi - if Kazanova (or any Grandmaster for that matter) says they can get .4 on an rpi, I believe them.\r\n\r\nI could probably only get to about .34 with what I currently know, and with some time to write an efficient CSV parser so it wouldn't take too long to run ;)",
      "votes": null
    },
    {
      "id": "138651",
      "postDate": "10/10/2016 05:36:06",
      "content": "<p>well i thought that was just a fun.. My bad !!! didn't read anokas post sayimg he actually intend to build a model to run on Pi.. would be interesting to see that..</p>",
      "rawMarkdown": "well i thought that was just a fun.. My bad !!! didn't read anokas post sayimg he actually intend to build a model to run on Pi.. would be interesting to see that..",
      "votes": null
    },
    {
      "id": "138735",
      "postDate": "10/10/2016 17:14:37",
      "content": "<p>[quote=PrakashSubedi;138651]</p>\n\n<p>well i thought that was just a fun.. My bad !!! didn't read anokas post sayimg he actually intend to build a model to run on Pi.. would be interesting to see that..</p>\n\n<p>[/quote]</p>\n\n<p>Yeah, I'm working on it right now :D</p>\n\n<p>Should be interesting to see if I can actually get a reasonable score, quite a fun little project.</p>",
      "rawMarkdown": "[quote=PrakashSubedi;138651]\r\n\r\nwell i thought that was just a fun.. My bad !!! didn't read anokas post sayimg he actually intend to build a model to run on Pi.. would be interesting to see that..\r\n\r\n[/quote]\r\n\r\nYeah, I'm working on it right now :D\r\n\r\nShould be interesting to see if I can actually get a reasonable score, quite a fun little project.",
      "votes": null
    },
    {
      "id": "138746",
      "postDate": "10/10/2016 18:24:27",
      "content": "<p>Keep calm and carry on. There are currently no plans to reset this competition.</p>",
      "rawMarkdown": "Keep calm and carry on. There are currently no plans to reset this competition.",
      "votes": null
    },
    {
      "id": "138773",
      "postDate": "10/10/2016 20:56:34",
      "content": "<p>Hi everbody,</p>\n\n<p>It has not been the first time this year. Neither the second. Problems related to data sets have been recurrent here on Kaggle.</p>\n\n<p>Sorry, I will not waste my time finding problems in data sets again. It is not only related to get points in the ranking. It is about our time. Either you contest trying to find problems or you do not have chance in the challenge. Am I right? It is discouraging. </p>\n\n<p>Good luck for you guys.</p>\n\n<p>Regards</p>",
      "rawMarkdown": "Hi everbody,\r\n\r\nIt has not been the first time this year. Neither the second. Problems related to data sets have been recurrent here on Kaggle.\r\n\r\nSorry, I will not waste my time finding problems in data sets again. It is not only related to get points in the ranking. It is about our time. Either you contest trying to find problems or you do not have chance in the challenge. Am I right? It is discouraging. \r\n\r\nGood luck for you guys.\r\n\r\nRegards",
      "votes": null
    },
    {
      "id": "138777",
      "postDate": "10/10/2016 21:09:00",
      "content": "<p>This was my first time participating in Kaggle competition and I find it total waste of time! Kaggle brings lots of smart people together to solve a stupid problem. Even after recognizing the problem, they are not willing to even simply apologize.</p>",
      "rawMarkdown": "This was my first time participating in Kaggle competition and I find it total waste of time! Kaggle brings lots of smart people together to solve a stupid problem. Even after recognizing the problem, they are not willing to even simply apologize.",
      "votes": null
    },
    {
      "id": "138924",
      "postDate": "10/11/2016 18:07:00",
      "content": "<p>Acoording to new kernels, it is not a leak. It is part of the problem.</p>\n\n<p>We need to be careful when using the word 'leak'.</p>\n\n<p>Then, let's work guys...</p>",
      "rawMarkdown": "Acoording to new kernels, it is not a leak. It is part of the problem.\r\n\r\nWe need to be careful when using the word 'leak'.\r\n\r\nThen, let's work guys...",
      "votes": null
    },
    {
      "id": "138928",
      "postDate": "10/11/2016 18:20:31",
      "content": "<p>[quote=Humberto Brand&#227;o;138924]</p>\n\n<p>Acoording to new kernels, it is not a leak. It is part of the problem.</p>\n\n<p>We need to be careful when using the word 'leak'.</p>\n\n<p>Then, let's work guys...</p>\n\n<p>[/quote]</p>\n\n<p>What do you mean by 'new kernels'?</p>",
      "rawMarkdown": "[quote=Humberto Brandão;138924]\r\n\r\nAcoording to new kernels, it is not a leak. It is part of the problem.\r\n\r\nWe need to be careful when using the word 'leak'.\r\n\r\nThen, let's work guys...\r\n\r\n[/quote]\r\n\r\nWhat do you mean by 'new kernels'?",
      "votes": null
    },
    {
      "id": "138932",
      "postDate": "10/11/2016 18:26:59",
      "content": "<p>@anokas - I'm curious - can you get to .9 AUC without processing train+test together?</p>\n\n<p>And I checked for new kernels, and I don't see anything rabbit-related not based on Faron's code.</p>",
      "rawMarkdown": "anokas - I'm curious - can you get to .9 AUC without processing train+test together?\r\n\r\nAnd I checked for new kernels, and I don't see anything rabbit-related not based on Faron's code.",
      "votes": null
    },
    {
      "id": "138935",
      "postDate": "10/11/2016 18:29:29",
      "content": "<p>[quote=happycube;138932]</p>\n\n<p>@anokas - I'm curious - can you get to .9 AUC without processing train+test together?</p>\n\n<p>And I checked for new kernels, and I don't see anything rabbit-related not based on Faron's code.</p>\n\n<p>[/quote]</p>\n\n<p>My response to that is &quot;I think so&quot;, but I'm not sure because I haven't tried running a model on it. But I'm relatively confident. Our super features actually had low AUC, but high MCC if I remember correctly.</p>",
      "rawMarkdown": "[quote=happycube;138932]\r\n\r\n@anokas - I'm curious - can you get to .9 AUC without processing train+test together?\r\n\r\nAnd I checked for new kernels, and I don't see anything rabbit-related not based on Faron's code.\r\n\r\n[/quote]\r\n\r\nMy response to that is \"I think so\", but I'm not sure because I haven't tried running a model on it. But I'm relatively confident. Our super features actually had low AUC, but high MCC if I remember correctly.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 138476,
      "author_name": "happycube",
      "author_url": "",
      "post_date": "10/09/2016 02:43:50",
      "content": "<p>I'd also like to know if it's acceptable to create features by using combined train+test data.  </p>\n\n<p>What Faron just posted appears to be <em>much</em> less effective if diffing Id's is performed on train and test separately. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138513,
      "author_name": "kazanova",
      "author_url": "",
      "post_date": "10/09/2016 09:43:03",
      "content": "<p>Mike. </p>\n\n<p>Why do you ask this now? </p>\n\n<p>You had found the leak quite some time ago if I can judge from your score.</p>\n\n<p>The fact that the leak just became known to the wider community, does not change the fact that the leak was there and some people had found it plus others had admitted it.</p>\n\n<p>On the contrary (and since the competition has not been already reset ) I think now it makes more sense to compete as a competitor ( because the client would not have received the value of an unleaky solution anyway) </p>\n\n<p>I don't think the competition will be reset based on what has happened in the past. </p>\n\n<p>Irrespective of this, I also think the competition should be reset. It is the timing of this post that surprises me a bit and the fact that it comes from someone that most probably had found the leak?  </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138516,
      "author_name": "anokas",
      "author_url": "",
      "post_date": "10/09/2016 09:47:44",
      "content": "<p>In the future, there should be something at the beginning of the competition that states whether IDs can be modelled on.</p>\n\n<p>@Marios, the leak can be modelled without using IDs or row orders at all, it's possible that Mike found it this route.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138519,
      "author_name": "scirpus",
      "author_url": "",
      "post_date": "10/09/2016 09:51:18",
      "content": "<p>I don't think an administrator exists for this competition as I received no answer to my rule clarification ages ago because I hated how train and test were split</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138522,
      "author_name": "kazanova",
      "author_url": "",
      "post_date": "10/09/2016 09:58:43",
      "content": "<p>[quote=anokas;138516]</p>\n\n<p>@Marios, the leak can be modelled without using IDs or row orders at all, it's possible that Mike found it this route.</p>\n\n<p>[/quote]</p>\n\n<p>I know and you can get to a <a href=\"https://www.kaggle.com/c/bosch-production-line-performance/forums/t/24065/the-magical-feature-from-lb-0-3-to-0-4/138220#post138220\">0.4 model using a Raspberry Pi</a> </p>\n\n<p>I will not dwell more on this.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138541,
      "author_name": "toshik",
      "author_url": "",
      "post_date": "10/09/2016 13:17:42",
      "content": "<p>Hi everyone,</p>\n\n<p>In this competition, there are strange features which improve our LB score.<br>\nI don't know it is leak or not. We need more information about dataset.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138547,
      "author_name": "ascending",
      "author_url": "",
      "post_date": "10/09/2016 13:49:56",
      "content": "<p>When there is a mismatch between what the competition organizer wants and what we think they want, then that competition becomes a haunted one.  This is definitely hurting </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138563,
      "author_name": "mikeskim",
      "author_url": "",
      "post_date": "10/09/2016 15:39:58",
      "content": "<p>I am not using the &quot;leak&quot; found by Faron. You can get above 0.4 without using any Id based features. </p>\n\n<p>[quote=&#924;&#945;&#961;&#953;&#959;&#962; &#924;&#953;&#967;&#945;&#951;&#955;&#953;&#948;&#951;&#962; KazAnova;138513]</p>\n\n<p>Mike. </p>\n\n<p>Why do you ask this now? </p>\n\n<p>You had found the leak quite some time ago if I can judge from your score.</p>\n\n<p>The fact that the leak just became known to the wider community, does not change the fact that the leak was there and some people had found it plus others had admitted it.</p>\n\n<p>On the contrary (and since the competition has not been already reset ) I think now it makes more sense to compete as a competitor ( because the client would not have received the value of an unleaky solution anyway) </p>\n\n<p>I don't think the competition will be reset based on what has happened in the past. </p>\n\n<p>Irrespective of this, I also think the competition should be reset. It is the timing of this post that surprises me a bit and the fact that it comes from someone that most probably had found the leak?  </p>\n\n<p>[/quote]</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138564,
      "author_name": "ascending",
      "author_url": "",
      "post_date": "10/09/2016 15:46:08",
      "content": "<p>@Mike, so that means you are using the leak in some indirect sense?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138580,
      "author_name": "gullu39",
      "author_url": "",
      "post_date": "10/09/2016 16:20:13",
      "content": "<p>[quote=&#924;&#945;&#961;&#953;&#959;&#962; &#924;&#953;&#967;&#945;&#951;&#955;&#953;&#948;&#951;&#962; KazAnova;138522]</p>\n\n<p>I know and you can get to a <a href=\"https://www.kaggle.com/c/bosch-production-line-performance/forums/t/24065/the-magical-feature-from-lb-0-3-to-0-4/138220#post138220\">0.4 model using a Raspberry Pi</a> </p>\n\n<p>[/quote]</p>\n\n<p>Nice One there !!! Raspberry Pi, Can't stop laughing...</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138593,
      "author_name": "mrooijer",
      "author_url": "",
      "post_date": "10/09/2016 17:25:14",
      "content": "<p>With all regards, but this seems a discussion about terms, not about the underlying data. The observations are related to objects that travel through a netwerk of stations with some 1700+ different routes. We are missing information about the nature of the parts that are being produced, but it is logical to assume that like parts will follow like routes. Some (type of) parts will probably be more difficult to produce than others:</p>\n\n<pre><code># -- Stations and lines      L1 L2\n#    |---------- L0 --------|**|-|*------- L3 ----------*\n#   &quot;0---------1---------2---------3-xxx-----4---------5-&quot;\n#   &quot;0123456789012345678901234567890123456789012345678901&quot;\n# 1: 0000000000000000000000001010011010001100000000000000 98 231 0.4242424\n# 2: 0000000000000000000000001010011010010100000000000000 85 194 0.4381443\n</code></pre>\n\n<p>A second observation is that stations can become more vulnerable to error over time, so it is completely logical to assume the existence of some dependency between the visitor of a station and its pre- or successor.  Hence near observations are (at least a bit) dependent and any real life numbering scheme for the id's (such as product serial numbers) will <em>consequently</em>  introduce id's that carry more information than a random unique number. </p>\n\n<p>That's not leakage, that's a characteristic of the problem.  </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138622,
      "author_name": "barisumog",
      "author_url": "",
      "post_date": "10/09/2016 21:03:53",
      "content": "<p>I had time to play with the data set only yesterday, and my current score of 0.17 is just a result of a couple of if-else clauses, with no ML models involved.</p>\n\n<p>I chose not to call it out, simply because I hadn't yet worked on it further to score 0.40+ to prove my point.</p>\n\n<p>Faron &amp; Kazanova saved me the trouble, I send them my thanks and respects.</p>\n\n<p>Please stop coming up with scenarios about how the &quot;magic features&quot; might indeed be helpful to Bosch. The data set is just poorly prepared.</p>\n\n<p>I don't care if the competition is reset or not, as long as the decision is made soon.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138649,
      "author_name": "happycube",
      "author_url": "",
      "post_date": "10/10/2016 05:32:49",
      "content": "<p>PrakashSubedi - if Kazanova (or any Grandmaster for that matter) says they can get .4 on an rpi, I believe them.</p>\n\n<p>I could probably only get to about .34 with what I currently know, and with some time to write an efficient CSV parser so it wouldn't take too long to run ;)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138651,
      "author_name": "gullu39",
      "author_url": "",
      "post_date": "10/10/2016 05:36:06",
      "content": "<p>well i thought that was just a fun.. My bad !!! didn't read anokas post sayimg he actually intend to build a model to run on Pi.. would be interesting to see that..</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138735,
      "author_name": "anokas",
      "author_url": "",
      "post_date": "10/10/2016 17:14:37",
      "content": "<p>[quote=PrakashSubedi;138651]</p>\n\n<p>well i thought that was just a fun.. My bad !!! didn't read anokas post sayimg he actually intend to build a model to run on Pi.. would be interesting to see that..</p>\n\n<p>[/quote]</p>\n\n<p>Yeah, I'm working on it right now :D</p>\n\n<p>Should be interesting to see if I can actually get a reasonable score, quite a fun little project.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138746,
      "author_name": "wcukierski",
      "author_url": "",
      "post_date": "10/10/2016 18:24:27",
      "content": "<p>Keep calm and carry on. There are currently no plans to reset this competition.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138773,
      "author_name": "brandao",
      "author_url": "",
      "post_date": "10/10/2016 20:56:34",
      "content": "<p>Hi everbody,</p>\n\n<p>It has not been the first time this year. Neither the second. Problems related to data sets have been recurrent here on Kaggle.</p>\n\n<p>Sorry, I will not waste my time finding problems in data sets again. It is not only related to get points in the ranking. It is about our time. Either you contest trying to find problems or you do not have chance in the challenge. Am I right? It is discouraging. </p>\n\n<p>Good luck for you guys.</p>\n\n<p>Regards</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138777,
      "author_name": "mojtabaebrahimi85",
      "author_url": "",
      "post_date": "10/10/2016 21:09:00",
      "content": "<p>This was my first time participating in Kaggle competition and I find it total waste of time! Kaggle brings lots of smart people together to solve a stupid problem. Even after recognizing the problem, they are not willing to even simply apologize.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138924,
      "author_name": "brandao",
      "author_url": "",
      "post_date": "10/11/2016 18:07:00",
      "content": "<p>Acoording to new kernels, it is not a leak. It is part of the problem.</p>\n\n<p>We need to be careful when using the word 'leak'.</p>\n\n<p>Then, let's work guys...</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138928,
      "author_name": "anokas",
      "author_url": "",
      "post_date": "10/11/2016 18:20:31",
      "content": "<p>[quote=Humberto Brand&#227;o;138924]</p>\n\n<p>Acoording to new kernels, it is not a leak. It is part of the problem.</p>\n\n<p>We need to be careful when using the word 'leak'.</p>\n\n<p>Then, let's work guys...</p>\n\n<p>[/quote]</p>\n\n<p>What do you mean by 'new kernels'?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138932,
      "author_name": "happycube",
      "author_url": "",
      "post_date": "10/11/2016 18:26:59",
      "content": "<p>@anokas - I'm curious - can you get to .9 AUC without processing train+test together?</p>\n\n<p>And I checked for new kernels, and I don't see anything rabbit-related not based on Faron's code.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 138935,
      "author_name": "anokas",
      "author_url": "",
      "post_date": "10/11/2016 18:29:29",
      "content": "<p>[quote=happycube;138932]</p>\n\n<p>@anokas - I'm curious - can you get to .9 AUC without processing train+test together?</p>\n\n<p>And I checked for new kernels, and I don't see anything rabbit-related not based on Faron's code.</p>\n\n<p>[/quote]</p>\n\n<p>My response to that is &quot;I think so&quot;, but I'm not sure because I haven't tried running a model on it. But I'm relatively confident. Our super features actually had low AUC, but high MCC if I remember correctly.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "138473": "To Bosch and Kaggle Administrators,\r\n\r\nWill this competition be reset or will it continue as is? I don't mind either way, but it's probably better to know sooner versus later.\r\n\r\nThanks,\r\n\r\nMike",
    "138476": "I'd also like to know if it's acceptable to create features by using combined train+test data.  \r\n\r\nWhat Faron just posted appears to be *much* less effective if diffing Id's is performed on train and test separately.",
    "138513": "Mike. \r\n\r\nWhy do you ask this now? \r\n\r\nYou had found the leak quite some time ago if I can judge from your score.\r\n\r\nThe fact that the leak just became known to the wider community, does not change the fact that the leak was there and some people had found it plus others had admitted it.\r\n\r\nOn the contrary (and since the competition has not been already reset ) I think now it makes more sense to compete as a competitor ( because the client would not have received the value of an unleaky solution anyway) \r\n\r\n I don't think the competition will be reset based on what has happened in the past. \r\n\r\nIrrespective of this, I also think the competition should be reset. It is the timing of this post that surprises me a bit and the fact that it comes from someone that most probably had found the leak?",
    "138516": "In the future, there should be something at the beginning of the competition that states whether IDs can be modelled on.\r\n\r\n@Marios, the leak can be modelled without using IDs or row orders at all, it's possible that Mike found it this route.",
    "138519": "I don't think an administrator exists for this competition as I received no answer to my rule clarification ages ago because I hated how train and test were split",
    "138522": "[quote=anokas;138516]\r\n\r\n@Marios, the leak can be modelled without using IDs or row orders at all, it's possible that Mike found it this route.\r\n\r\n[/quote]\r\n\r\nI know and you can get to a [0.4 model using a Raspberry Pi][1] \r\n\r\nI will not dwell more on this.\r\n\r\n\r\n  [1]: https://www.kaggle.com/c/bosch-production-line-performance/forums/t/24065/the-magical-feature-from-lb-0-3-to-0-4/138220#post138220",
    "138541": "Hi everyone,\r\n\r\nIn this competition, there are strange features which improve our LB score.<br>\r\nI don't know it is leak or not. We need more information about dataset.",
    "138547": "When there is a mismatch between what the competition organizer wants and what we think they want, then that competition becomes a haunted one.  This is definitely hurting",
    "138563": "I am not using the \"leak\" found by Faron. You can get above 0.4 without using any Id based features. \r\n\r\n[quote=Μαριος Μιχαηλιδης KazAnova;138513]\r\n\r\nMike. \r\n\r\nWhy do you ask this now? \r\n\r\nYou had found the leak quite some time ago if I can judge from your score.\r\n\r\nThe fact that the leak just became known to the wider community, does not change the fact that the leak was there and some people had found it plus others had admitted it.\r\n\r\nOn the contrary (and since the competition has not been already reset ) I think now it makes more sense to compete as a competitor ( because the client would not have received the value of an unleaky solution anyway) \r\n\r\n I don't think the competition will be reset based on what has happened in the past. \r\n\r\nIrrespective of this, I also think the competition should be reset. It is the timing of this post that surprises me a bit and the fact that it comes from someone that most probably had found the leak?  \r\n\r\n[/quote]",
    "138564": "Mike, so that means you are using the leak in some indirect sense?",
    "138580": "[quote=Μαριος Μιχαηλιδης KazAnova;138522]\r\n\r\n\r\nI know and you can get to a [0.4 model using a Raspberry Pi][1] \r\n\r\n\r\n  [1]: https://www.kaggle.com/c/bosch-production-line-performance/forums/t/24065/the-magical-feature-from-lb-0-3-to-0-4/138220#post138220\r\n\r\n[/quote]\r\n\r\nNice One there !!! Raspberry Pi, Can't stop laughing...",
    "138593": "With all regards, but this seems a discussion about terms, not about the underlying data. The observations are related to objects that travel through a netwerk of stations with some 1700+ different routes. We are missing information about the nature of the parts that are being produced, but it is logical to assume that like parts will follow like routes. Some (type of) parts will probably be more difficult to produce than others:\r\n\r\n\r\n    # -- Stations and lines      L1 L2\r\n    #    |---------- L0 --------|**|-|*------- L3 ----------*\r\n    #   \"0---------1---------2---------3-xxx-----4---------5-\"\r\n    #   \"0123456789012345678901234567890123456789012345678901\"\r\n    # 1: 0000000000000000000000001010011010001100000000000000 98 231 0.4242424\r\n    # 2: 0000000000000000000000001010011010010100000000000000 85 194 0.4381443\r\n\r\n\r\nA second observation is that stations can become more vulnerable to error over time, so it is completely logical to assume the existence of some dependency between the visitor of a station and its pre- or successor.  Hence near observations are (at least a bit) dependent and any real life numbering scheme for the id's (such as product serial numbers) will _consequently_  introduce id's that carry more information than a random unique number. \r\n\r\nThat's not leakage, that's a characteristic of the problem.",
    "138622": "I had time to play with the data set only yesterday, and my current score of 0.17 is just a result of a couple of if-else clauses, with no ML models involved.\r\n\r\nI chose not to call it out, simply because I hadn't yet worked on it further to score 0.40+ to prove my point.\r\n\r\nFaron & Kazanova saved me the trouble, I send them my thanks and respects.\r\n\r\nPlease stop coming up with scenarios about how the \"magic features\" might indeed be helpful to Bosch. The data set is just poorly prepared.\r\n\r\nI don't care if the competition is reset or not, as long as the decision is made soon.",
    "138649": "PrakashSubedi - if Kazanova (or any Grandmaster for that matter) says they can get .4 on an rpi, I believe them.\r\n\r\nI could probably only get to about .34 with what I currently know, and with some time to write an efficient CSV parser so it wouldn't take too long to run ;)",
    "138651": "well i thought that was just a fun.. My bad !!! didn't read anokas post sayimg he actually intend to build a model to run on Pi.. would be interesting to see that..",
    "138735": "[quote=PrakashSubedi;138651]\r\n\r\nwell i thought that was just a fun.. My bad !!! didn't read anokas post sayimg he actually intend to build a model to run on Pi.. would be interesting to see that..\r\n\r\n[/quote]\r\n\r\nYeah, I'm working on it right now :D\r\n\r\nShould be interesting to see if I can actually get a reasonable score, quite a fun little project.",
    "138746": "Keep calm and carry on. There are currently no plans to reset this competition.",
    "138773": "Hi everbody,\r\n\r\nIt has not been the first time this year. Neither the second. Problems related to data sets have been recurrent here on Kaggle.\r\n\r\nSorry, I will not waste my time finding problems in data sets again. It is not only related to get points in the ranking. It is about our time. Either you contest trying to find problems or you do not have chance in the challenge. Am I right? It is discouraging. \r\n\r\nGood luck for you guys.\r\n\r\nRegards",
    "138777": "This was my first time participating in Kaggle competition and I find it total waste of time! Kaggle brings lots of smart people together to solve a stupid problem. Even after recognizing the problem, they are not willing to even simply apologize.",
    "138924": "Acoording to new kernels, it is not a leak. It is part of the problem.\r\n\r\nWe need to be careful when using the word 'leak'.\r\n\r\nThen, let's work guys...",
    "138928": "[quote=Humberto Brandão;138924]\r\n\r\nAcoording to new kernels, it is not a leak. It is part of the problem.\r\n\r\nWe need to be careful when using the word 'leak'.\r\n\r\nThen, let's work guys...\r\n\r\n[/quote]\r\n\r\nWhat do you mean by 'new kernels'?",
    "138932": "anokas - I'm curious - can you get to .9 AUC without processing train+test together?\r\n\r\nAnd I checked for new kernels, and I don't see anything rabbit-related not based on Faron's code.",
    "138935": "[quote=happycube;138932]\r\n\r\n@anokas - I'm curious - can you get to .9 AUC without processing train+test together?\r\n\r\nAnd I checked for new kernels, and I don't see anything rabbit-related not based on Faron's code.\r\n\r\n[/quote]\r\n\r\nMy response to that is \"I think so\", but I'm not sure because I haven't tried running a model on it. But I'm relatively confident. Our super features actually had low AUC, but high MCC if I remember correctly."
  },
  "source": "meta"
}