{
  "id": 611555,
  "title": "Training and Evaluation",
  "url": "/competitions/alpha-radar-solana-sprint/discussion/611555",
  "author_name": "",
  "post_date": "2025-10-12T14:12:09.880538600Z",
  "votes": null,
  "comment_count": 2,
  "views": 0,
  "content": "<p>If we are supposed to use the big dataset for both training and evaluation won't there be data leakage like if i train on the big dataset and evaluate on it too my model will already know everything about it and if i split them into train and eval sets then on evaluation i will not have enough predictions to submit so how will i know how my model is doing i mean i can compare the predictions for eval set with original values for that set but what to submit on leaderboard submissions</p>",
  "messages": [
    {
      "id": "3301105",
      "postDate": "10/12/2025 14:12:09",
      "content": "<p>If we are supposed to use the big dataset for both training and evaluation won't there be data leakage like if i train on the big dataset and evaluate on it too my model will already know everything about it and if i split them into train and eval sets then on evaluation i will not have enough predictions to submit so how will i know how my model is doing i mean i can compare the predictions for eval set with original values for that set but what to submit on leaderboard submissions</p>",
      "rawMarkdown": "If we are supposed to use the big dataset for both training and evaluation won't there be data leakage like if i train on the big dataset and evaluate on it too my model will already know everything about it and if i split them into train and eval sets then on evaluation i will not have enough predictions to submit so how will i know how my model is doing i mean i can compare the predictions for eval set with original values for that set but what to submit on leaderboard submissions",
      "votes": null
    },
    {
      "id": "3301110",
      "postDate": "10/12/2025 14:17:15",
      "content": "<p>Thanks for this question. We have put together a separate evaluation dataset that we will be putting up in the data section to prevent that exact thing</p>",
      "rawMarkdown": "Thanks for this question. We have put together a separate evaluation dataset that we will be putting up in the data section to prevent that exact thing",
      "votes": null
    },
    {
      "id": "3301113",
      "postDate": "10/12/2025 14:20:51",
      "content": "<p>Thanks for clarification!</p>",
      "rawMarkdown": "Thanks for clarification!",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3301110,
      "author_name": "twainayar",
      "author_url": "",
      "post_date": "10/12/2025 14:17:15",
      "content": "<p>Thanks for this question. We have put together a separate evaluation dataset that we will be putting up in the data section to prevent that exact thing</p>",
      "votes": null,
      "replies": [
        {
          "id": 3301113,
          "author_name": "naqashdogar",
          "author_url": "",
          "post_date": "10/12/2025 14:20:51",
          "content": "<p>Thanks for clarification!</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3301105": "If we are supposed to use the big dataset for both training and evaluation won't there be data leakage like if i train on the big dataset and evaluate on it too my model will already know everything about it and if i split them into train and eval sets then on evaluation i will not have enough predictions to submit so how will i know how my model is doing i mean i can compare the predictions for eval set with original values for that set but what to submit on leaderboard submissions",
    "3301110": "Thanks for this question. We have put together a separate evaluation dataset that we will be putting up in the data section to prevent that exact thing",
    "3301113": "Thanks for clarification!"
  },
  "source": "meta"
}