{
  "id": 73149,
  "title": "Be sure to select submissions to use for final score",
  "url": "/competitions/ga-customer-revenue-prediction/discussion/73149",
  "author_name": "Yotam Perkal",
  "post_date": "2018-11-30T08:24:33.089000",
  "votes": 4,
  "comment_count": 0,
  "views": 0,
  "content": "<p>Since the default behaviour is:\n\"<strong><em>If 2 submissions are not selected, they will be automatically chosen based on your best submission scores on the public leaderboard</em></strong>\".\nThat is probably not desired in this specific competition due to the fact that the private leaderboard score will be based on a future looking timeframe.\nAs mentioned in <a href=\"https://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/70982\">this</a> discussion:</p>\n\n<p>\"As such, we recommend that you use caution when interpreting the results of the public leaderboard.\"</p>\n\n<p>and:</p>\n\n<p>\"Therefore, your submission that is intended for the public LB timeframe will be different from the private LB timeframe, which will be rescored/recalculated on the future timeframe.</p>\n\n<p>Knowing this, I expect that competitors will need to make explicit final submission selections for those submissions which represent what they expect those future-looking predictions to be. These final submission selections for which this competition permits 2, per the rules, can be made under \"My Submissions\" by the final submission deadline.\"</p>",
  "messages": [
    {
      "id": 430339,
      "postDate": "2018-11-30T08:24:33.090Z",
      "content": "<p>Since the default behaviour is:\n\"<strong><em>If 2 submissions are not selected, they will be automatically chosen based on your best submission scores on the public leaderboard</em></strong>\".\nThat is probably not desired in this specific competition due to the fact that the private leaderboard score will be based on a future looking timeframe.\nAs mentioned in <a href=\"https://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/70982\">this</a> discussion:</p>\n\n<p>\"As such, we recommend that you use caution when interpreting the results of the public leaderboard.\"</p>\n\n<p>and:</p>\n\n<p>\"Therefore, your submission that is intended for the public LB timeframe will be different from the private LB timeframe, which will be rescored/recalculated on the future timeframe.</p>\n\n<p>Knowing this, I expect that competitors will need to make explicit final submission selections for those submissions which represent what they expect those future-looking predictions to be. These final submission selections for which this competition permits 2, per the rules, can be made under \"My Submissions\" by the final submission deadline.\"</p>",
      "rawMarkdown": "Since the default behaviour is:\n\"***If 2 submissions are not selected, they will be automatically chosen based on your best submission scores on the public leaderboard***\".\nThat is probably not desired in this specific competition due to the fact that the private leaderboard score will be based on a future looking timeframe.\nAs mentioned in [this][1] discussion:\n\n\"As such, we recommend that you use caution when interpreting the results of the public leaderboard.\"\n\nand:\n\n\"Therefore, your submission that is intended for the public LB timeframe will be different from the private LB timeframe, which will be rescored/recalculated on the future timeframe.\n\nKnowing this, I expect that competitors will need to make explicit final submission selections for those submissions which represent what they expect those future-looking predictions to be. These final submission selections for which this competition permits 2, per the rules, can be made under \"My Submissions\" by the final submission deadline.\"\n\n\n  [1]: https://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/70982",
      "votes": 4
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "430339": "Since the default behaviour is:\n\"***If 2 submissions are not selected, they will be automatically chosen based on your best submission scores on the public leaderboard***\".\nThat is probably not desired in this specific competition due to the fact that the private leaderboard score will be based on a future looking timeframe.\nAs mentioned in [this][1] discussion:\n\n\"As such, we recommend that you use caution when interpreting the results of the public leaderboard.\"\n\nand:\n\n\"Therefore, your submission that is intended for the public LB timeframe will be different from the private LB timeframe, which will be rescored/recalculated on the future timeframe.\n\nKnowing this, I expect that competitors will need to make explicit final submission selections for those submissions which represent what they expect those future-looking predictions to be. These final submission selections for which this competition permits 2, per the rules, can be made under \"My Submissions\" by the final submission deadline.\"\n\n\n  [1]: https://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/70982"
  }
}