{
  "id": 411300,
  "title": "Ideas for a good CV setting anyone?",
  "url": "/competitions/cafa-5-protein-function-prediction/discussion/411300",
  "author_name": "",
  "post_date": "2023-05-18T14:00:13.383687700Z",
  "votes": 6,
  "comment_count": 2,
  "views": 0,
  "content": "<p>So far I just explored the usual way of splitting and a stratified Multi-Label K fold.<br>\nI think we can do better in CV setup. Anyone better ideas to get a reliable CV SCORE?</p>",
  "messages": [
    {
      "id": "2264544",
      "postDate": "05/18/2023 14:00:13",
      "content": "<p>So far I just explored the usual way of splitting and a stratified Multi-Label K fold.<br>\nI think we can do better in CV setup. Anyone better ideas to get a reliable CV SCORE?</p>",
      "rawMarkdown": "So far I just explored the usual way of splitting and a stratified Multi-Label K fold.\nI think we can do better in CV setup. Anyone better ideas to get a reliable CV SCORE?",
      "votes": null
    },
    {
      "id": "2269492",
      "postDate": "05/22/2023 14:01:43",
      "content": "<p>I didn't try this here but I recall that on a simillar competition in the past the winners used KMeans on the sequences as groups for GroupedKFold</p>\n<p>The Devastator.</p>",
      "rawMarkdown": "I didn't try this here but I recall that on a simillar competition in the past the winners used KMeans on the sequences as groups for GroupedKFold\n\nThe Devastator.",
      "votes": null
    },
    {
      "id": "2269879",
      "postDate": "05/22/2023 19:11:42",
      "content": "<p>Could you point to the competition you have in mind? :)</p>",
      "rawMarkdown": "Could you point to the competition you have in mind? :)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2269492,
      "author_name": "thedevastator",
      "author_url": "",
      "post_date": "05/22/2023 14:01:43",
      "content": "<p>I didn't try this here but I recall that on a simillar competition in the past the winners used KMeans on the sequences as groups for GroupedKFold</p>\n<p>The Devastator.</p>",
      "votes": null,
      "replies": [
        {
          "id": 2269879,
          "author_name": "simonveitner",
          "author_url": "",
          "post_date": "05/22/2023 19:11:42",
          "content": "<p>Could you point to the competition you have in mind? :)</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "2264544": "So far I just explored the usual way of splitting and a stratified Multi-Label K fold.\nI think we can do better in CV setup. Anyone better ideas to get a reliable CV SCORE?",
    "2269492": "I didn't try this here but I recall that on a simillar competition in the past the winners used KMeans on the sequences as groups for GroupedKFold\n\nThe Devastator.",
    "2269879": "Could you point to the competition you have in mind? :)"
  },
  "source": "meta"
}