{
  "id": 73887,
  "title": "Bad seeds (but no Nick Cave)",
  "url": "/competitions/elo-merchant-category-recommendation/discussion/73887",
  "author_name": "",
  "post_date": "2018-12-06T12:47:11.041591300Z",
  "votes": 17,
  "comment_count": 5,
  "views": 0,
  "content": "<p>I've been struggling to replicate the results of some of the high scoring kernels until it dawned on me that I was not using the same seed - turns out the variation from changing a seed can be around 0.003, which btw is roughly my current distance from top 10 :-) Did you guys have similar experience? I have seen bagging_seed = 11 mentioned elsewhere as a \"lucky\" one for lgbm - if that truly is the case, we are in for a lottery...</p>",
  "messages": [
    {
      "id": "434465",
      "postDate": "12/06/2018 12:47:11",
      "content": "<p>I've been struggling to replicate the results of some of the high scoring kernels until it dawned on me that I was not using the same seed - turns out the variation from changing a seed can be around 0.003, which btw is roughly my current distance from top 10 :-) Did you guys have similar experience? I have seen bagging_seed = 11 mentioned elsewhere as a \"lucky\" one for lgbm - if that truly is the case, we are in for a lottery...</p>",
      "rawMarkdown": "I've been struggling to replicate the results of some of the high scoring kernels until it dawned on me that I was not using the same seed - turns out the variation from changing a seed can be around 0.003, which btw is roughly my current distance from top 10 :-) Did you guys have similar experience? I have seen bagging_seed = 11 mentioned elsewhere as a \"lucky\" one for lgbm - if that truly is the case, we are in for a lottery...",
      "votes": null
    },
    {
      "id": "434506",
      "postDate": "12/06/2018 14:14:38",
      "content": "<p>\"we are in for a lottery\" I totally agree with you :) . CV and LB score confused me a lot . </p>",
      "rawMarkdown": "\"we are in for a lottery\" I totally agree with you :) . CV and LB score confused me a lot .",
      "votes": null
    },
    {
      "id": "434519",
      "postDate": "12/06/2018 14:29:13",
      "content": "<p>yep, seed is quite important.\nAnd adding/changing several variables inproved my score by 0.2</p>",
      "rawMarkdown": "yep, seed is quite important.\nAnd adding/changing several variables inproved my score by 0.2",
      "votes": null
    },
    {
      "id": "434562",
      "postDate": "12/06/2018 15:42:34",
      "content": "<p>Since the final Private LB is much larger, <em>hopefully</em> this will wash out the random luck from seed differences.</p>",
      "rawMarkdown": "Since the final Private LB is much larger, *hopefully* this will wash out the random luck from seed differences.",
      "votes": null
    },
    {
      "id": "434596",
      "postDate": "12/06/2018 16:56:31",
      "content": "<p>Yeah totally, '11' does seem to be the winning number right now. I've tried different seeds, and not even the answer to the ultimate question of life, the universe and everything (42) gets me a better RMSE. </p>",
      "rawMarkdown": "Yeah totally, '11' does seem to be the winning number right now. I've tried different seeds, and not even the answer to the ultimate question of life, the universe and everything (42) gets me a better RMSE.",
      "votes": null
    },
    {
      "id": "434671",
      "postDate": "12/06/2018 18:51:36",
      "content": "<p>Holy crap.</p>",
      "rawMarkdown": "Holy crap.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 434506,
      "author_name": "yentianbao",
      "author_url": "",
      "post_date": "12/06/2018 14:14:38",
      "content": "<p>\"we are in for a lottery\" I totally agree with you :) . CV and LB score confused me a lot . </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 434519,
      "author_name": "artgor",
      "author_url": "",
      "post_date": "12/06/2018 14:29:13",
      "content": "<p>yep, seed is quite important.\nAnd adding/changing several variables inproved my score by 0.2</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 434562,
      "author_name": "peterhurford",
      "author_url": "",
      "post_date": "12/06/2018 15:42:34",
      "content": "<p>Since the final Private LB is much larger, <em>hopefully</em> this will wash out the random luck from seed differences.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 434596,
      "author_name": "delayedkarma",
      "author_url": "",
      "post_date": "12/06/2018 16:56:31",
      "content": "<p>Yeah totally, '11' does seem to be the winning number right now. I've tried different seeds, and not even the answer to the ultimate question of life, the universe and everything (42) gets me a better RMSE. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 434671,
      "author_name": "itushro",
      "author_url": "",
      "post_date": "12/06/2018 18:51:36",
      "content": "<p>Holy crap.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "434465": "I've been struggling to replicate the results of some of the high scoring kernels until it dawned on me that I was not using the same seed - turns out the variation from changing a seed can be around 0.003, which btw is roughly my current distance from top 10 :-) Did you guys have similar experience? I have seen bagging_seed = 11 mentioned elsewhere as a \"lucky\" one for lgbm - if that truly is the case, we are in for a lottery...",
    "434506": "\"we are in for a lottery\" I totally agree with you :) . CV and LB score confused me a lot .",
    "434519": "yep, seed is quite important.\nAnd adding/changing several variables inproved my score by 0.2",
    "434562": "Since the final Private LB is much larger, *hopefully* this will wash out the random luck from seed differences.",
    "434596": "Yeah totally, '11' does seem to be the winning number right now. I've tried different seeds, and not even the answer to the ultimate question of life, the universe and everything (42) gets me a better RMSE.",
    "434671": "Holy crap."
  },
  "source": "meta"
}