{
  "id": 286999,
  "title": "What is your best score without overlap?",
  "url": "/competitions/g-research-crypto-forecasting/discussion/286999",
  "author_name": "Ernesto Budia",
  "post_date": "2021-11-11T15:41:13.108000",
  "votes": 20,
  "comment_count": 7,
  "views": 0,
  "content": "<p>The train and the test overlap, that's why there are such high scores, but if if you only use Train until 2021-06-13, what is your best score?</p>\n<p>For now I am not full with the models I am with feature engineering , but some experiment without model like this <a href=\"https://www.kaggle.com/lucasmorin/minimal-fast-baseline\" target=\"_blank\">https://www.kaggle.com/lucasmorin/minimal-fast-baseline</a></p>\n<p>I got score 0.034</p>",
  "messages": [
    {
      "id": 1579160,
      "postDate": "2021-11-11T15:41:13.110Z",
      "content": "<p>The train and the test overlap, that's why there are such high scores, but if if you only use Train until 2021-06-13, what is your best score?</p>\n<p>For now I am not full with the models I am with feature engineering , but some experiment without model like this <a href=\"https://www.kaggle.com/lucasmorin/minimal-fast-baseline\" target=\"_blank\">https://www.kaggle.com/lucasmorin/minimal-fast-baseline</a></p>\n<p>I got score 0.034</p>",
      "rawMarkdown": "The train and the test overlap, that's why there are such high scores, but if if you only use Train until 2021-06-13, what is your best score?\n\nFor now I am not full with the models I am with feature engineering , but some experiment without model like this https://www.kaggle.com/lucasmorin/minimal-fast-baseline\n\nI got score 0.034",
      "votes": 20
    },
    {
      "id": 1579190,
      "postDate": "2021-11-11T16:07:38.280Z",
      "content": "<p>Well done - mine is 0.0195 = ridge regression with some feature engineering (vwap and volume-based). Would you mind sharing any details about yours?</p>",
      "rawMarkdown": "Well done - mine is 0.0195 = ridge regression with some feature engineering (vwap and volume-based). Would you mind sharing any details about yours?",
      "votes": 8
    },
    {
      "id": 1581720,
      "postDate": "2021-11-14T06:58:34.270Z",
      "content": "<p>mine is 0.0193 = lgbm regression with some feature engineering</p>",
      "rawMarkdown": "mine is 0.0193 = lgbm regression with some feature engineering",
      "votes": 3
    },
    {
      "id": 1582729,
      "postDate": "2021-11-15T07:55:49.527Z",
      "content": "<p>Mine is 0.024 , Ridge with feature engineering</p>",
      "rawMarkdown": "Mine is 0.024 , Ridge with feature engineering\n",
      "votes": 1
    },
    {
      "id": 1579366,
      "postDate": "2021-11-11T20:05:11.797Z",
      "content": "<p>Slightly above 3% on local CV.</p>",
      "rawMarkdown": "Slightly above 3% on local CV.",
      "votes": 2,
      "replies": [
        {
          "id": 1579377,
          "postDate": "2021-11-11T20:23:56.970Z",
          "content": "<p>CV can be misleading for time series because it intertwines the training/validation rows.  Instead, a better split would be a simple train test split where everything before a certain date is training and everything after is testing.  This is more realistic because when we are predicting cryptocurrency returns we will not have training instances of the future.</p>",
          "rawMarkdown": "CV can be misleading for time series because it intertwines the training/validation rows.  Instead, a better split would be a simple train test split where everything before a certain date is training and everything after is testing.  This is more realistic because when we are predicting cryptocurrency returns we will not have training instances of the future.",
          "votes": 2
        },
        {
          "id": 1579395,
          "postDate": "2021-11-11T20:46:58.943Z",
          "content": "<p>I use something like this:</p>\n<p>X - train_0 - X - test_0 - X - train_1 - X - test_1 - …. where X are 1 month embargos (also used for building lagged features). </p>",
          "rawMarkdown": "I use something like this:\n\nX - train_0 - X - test_0 - X - train_1 - X - test_1 - .... where X are 1 month embargos (also used for building lagged features). ",
          "votes": 1
        }
      ]
    },
    {
      "id": 1580800,
      "postDate": "2021-11-13T06:01:25.987Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 1579190,
      "author_name": "Konrad Banachewicz",
      "author_url": "",
      "post_date": "2021-11-11T16:07:38.280000",
      "content": "<p>Well done - mine is 0.0195 = ridge regression with some feature engineering (vwap and volume-based). Would you mind sharing any details about yours?</p>",
      "votes": 8,
      "replies": []
    },
    {
      "id": 1581720,
      "author_name": "Aleksandr  Larko",
      "author_url": "",
      "post_date": "2021-11-14T06:58:34.270000",
      "content": "<p>mine is 0.0193 = lgbm regression with some feature engineering</p>",
      "votes": 3,
      "replies": []
    },
    {
      "id": 1582729,
      "author_name": "Saumil Agrawal",
      "author_url": "",
      "post_date": "2021-11-15T07:55:49.527000",
      "content": "<p>Mine is 0.024 , Ridge with feature engineering</p>",
      "votes": 1,
      "replies": []
    },
    {
      "id": 1579366,
      "author_name": "Lucas Morin",
      "author_url": "",
      "post_date": "2021-11-11T20:05:11.797000",
      "content": "<p>Slightly above 3% on local CV.</p>",
      "votes": 2,
      "replies": [
        {
          "id": 1579377,
          "author_name": "Kyle Peters",
          "author_url": "",
          "post_date": "2021-11-11T20:23:56.970000",
          "content": "<p>CV can be misleading for time series because it intertwines the training/validation rows.  Instead, a better split would be a simple train test split where everything before a certain date is training and everything after is testing.  This is more realistic because when we are predicting cryptocurrency returns we will not have training instances of the future.</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 1579395,
          "author_name": "Lucas Morin",
          "author_url": "",
          "post_date": "2021-11-11T20:46:58.943000",
          "content": "<p>I use something like this:</p>\n<p>X - train_0 - X - test_0 - X - train_1 - X - test_1 - …. where X are 1 month embargos (also used for building lagged features). </p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1580800,
      "author_name": "",
      "author_url": "",
      "post_date": "2021-11-13T06:01:25.987000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1579160": "The train and the test overlap, that's why there are such high scores, but if if you only use Train until 2021-06-13, what is your best score?\n\nFor now I am not full with the models I am with feature engineering , but some experiment without model like this https://www.kaggle.com/lucasmorin/minimal-fast-baseline\n\nI got score 0.034",
    "1579190": "Well done - mine is 0.0195 = ridge regression with some feature engineering (vwap and volume-based). Would you mind sharing any details about yours?",
    "1581720": "mine is 0.0193 = lgbm regression with some feature engineering",
    "1582729": "Mine is 0.024 , Ridge with feature engineering\n",
    "1579366": "Slightly above 3% on local CV.",
    "1580800": ""
  }
}