{
  "id": 297987,
  "title": "Where is the \"CV criteria\" for medal?",
  "url": "/competitions/g-research-crypto-forecasting/discussion/297987",
  "author_name": "",
  "post_date": "2021-12-31T00:32:25.826066500Z",
  "votes": null,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi, guys</p>\n<p>I want here your advise about the CV criteria for medal. </p>\n<p>When I registered this competition, I was surprised to see high LB score!<br>\nNow, I wondered where is the \"true LB criteria\" for medal with no leakage.</p>\n<p>I think we'll have to discuss it in CV score with no leakage.</p>\n<p>Now, I tried some tutorial notebooks, and CV score is about 0.010 to 0.020 in them.<br>\nDo you think how much can we grow this score?</p>",
  "messages": [
    {
      "id": "1633629",
      "postDate": "12/31/2021 00:32:25",
      "content": "<p>Hi, guys</p>\n<p>I want here your advise about the CV criteria for medal. </p>\n<p>When I registered this competition, I was surprised to see high LB score!<br>\nNow, I wondered where is the \"true LB criteria\" for medal with no leakage.</p>\n<p>I think we'll have to discuss it in CV score with no leakage.</p>\n<p>Now, I tried some tutorial notebooks, and CV score is about 0.010 to 0.020 in them.<br>\nDo you think how much can we grow this score?</p>",
      "rawMarkdown": "Hi, guys\n\nI want here your advise about the CV criteria for medal. \n\nWhen I registered this competition, I was surprised to see high LB score!\nNow, I wondered where is the \"true LB criteria\" for medal with no leakage.\n\nI think we'll have to discuss it in CV score with no leakage.\n\nNow, I tried some tutorial notebooks, and CV score is about 0.010 to 0.020 in them.\nDo you think how much can we grow this score?",
      "votes": null
    },
    {
      "id": "1634005",
      "postDate": "12/31/2021 08:52:23",
      "content": "<p>It's unclear for the moment. No one has shared a stable model yet. (stable trough fold, stable trough seeds, not using leakage). It's possible to get above 0.05 on specific folds, but it's difficult ot make it consistent.</p>",
      "rawMarkdown": "It's unclear for the moment. No one has shared a stable model yet. (stable trough fold, stable trough seeds, not using leakage). It's possible to get above 0.05 on specific folds, but it's difficult ot make it consistent.",
      "votes": null
    },
    {
      "id": "1634691",
      "postDate": "01/01/2022 03:03:52",
      "content": "<p>Thank you for your advise!<br>\nWe are not sure about the score goal to aim for, but it's real in a way.</p>",
      "rawMarkdown": "Thank you for your advise!\nWe are not sure about the score goal to aim for, but it's real in a way.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1634005,
      "author_name": "lucasmorin",
      "author_url": "",
      "post_date": "12/31/2021 08:52:23",
      "content": "<p>It's unclear for the moment. No one has shared a stable model yet. (stable trough fold, stable trough seeds, not using leakage). It's possible to get above 0.05 on specific folds, but it's difficult ot make it consistent.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1634691,
          "author_name": "tknakamu",
          "author_url": "",
          "post_date": "01/01/2022 03:03:52",
          "content": "<p>Thank you for your advise!<br>\nWe are not sure about the score goal to aim for, but it's real in a way.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1633629": "Hi, guys\n\nI want here your advise about the CV criteria for medal. \n\nWhen I registered this competition, I was surprised to see high LB score!\nNow, I wondered where is the \"true LB criteria\" for medal with no leakage.\n\nI think we'll have to discuss it in CV score with no leakage.\n\nNow, I tried some tutorial notebooks, and CV score is about 0.010 to 0.020 in them.\nDo you think how much can we grow this score?",
    "1634005": "It's unclear for the moment. No one has shared a stable model yet. (stable trough fold, stable trough seeds, not using leakage). It's possible to get above 0.05 on specific folds, but it's difficult ot make it consistent.",
    "1634691": "Thank you for your advise!\nWe are not sure about the score goal to aim for, but it's real in a way."
  },
  "source": "meta"
}