{
  "id": 656090,
  "title": "Regarding the mislabelled 25fps AdaptableSnail videos in the test set",
  "url": "/competitions/MABe-mouse-behavior-detection/discussion/656090",
  "author_name": "",
  "post_date": "2025-12-09T03:58:49.525934Z",
  "votes": 5,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Removing the 25fps videos from AdaptableSnail boosted my offline CV by 0.02-0.03. If the mislabeling is not result of a constant permutation, then it seems to me that one \"trick\" to get LB score is to probe the public LB with different permutations (for these particular videos) and see which permutation give the biggest boost. Can we get a clarification from the competition host before the end?</p>",
  "messages": [
    {
      "id": "3368199",
      "postDate": "12/09/2025 03:58:49",
      "content": "<p>Removing the 25fps videos from AdaptableSnail boosted my offline CV by 0.02-0.03. If the mislabeling is not result of a constant permutation, then it seems to me that one \"trick\" to get LB score is to probe the public LB with different permutations (for these particular videos) and see which permutation give the biggest boost. Can we get a clarification from the competition host before the end?</p>",
      "rawMarkdown": "Removing the 25fps videos from AdaptableSnail boosted my offline CV by 0.02-0.03. If the mislabeling is not result of a constant permutation, then it seems to me that one \"trick\" to get LB score is to probe the public LB with different permutations (for these particular videos) and see which permutation give the biggest boost. Can we get a clarification from the competition host before the end?",
      "votes": null
    },
    {
      "id": "3368655",
      "postDate": "12/09/2025 12:01:40",
      "content": "<p>Hi, can you give more detail on how to fix this? I see this is discussed in <a href=\"https://www.kaggle.com/competitions/MABe-mouse-behavior-detection/discussion/612531\" target=\"_blank\">https://www.kaggle.com/competitions/MABe-mouse-behavior-detection/discussion/612531</a> but they didn't give an exact answer on how to fix</p>",
      "rawMarkdown": "Hi, can you give more detail on how to fix this? I see this is discussed in https://www.kaggle.com/competitions/MABe-mouse-behavior-detection/discussion/612531 but they didn't give an exact answer on how to fix",
      "votes": null
    },
    {
      "id": "3368910",
      "postDate": "12/09/2025 15:47:29",
      "content": "<p>I simply removed them from training data.</p>",
      "rawMarkdown": "I simply removed them from training data.",
      "votes": null
    },
    {
      "id": "3373114",
      "postDate": "12/12/2025 10:35:51",
      "content": "<p>Thank you for bringing this to our attention. The clarification on the mislabeled 25fps AdaptableSnail videos and the practical workaround you applied is very helpful for understanding how this issue impacts model performance.</p>",
      "rawMarkdown": "Thank you for bringing this to our attention. The clarification on the mislabeled 25fps AdaptableSnail videos and the practical workaround you applied is very helpful for understanding how this issue impacts model performance.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3368655,
      "author_name": "menghaozhao",
      "author_url": "",
      "post_date": "12/09/2025 12:01:40",
      "content": "<p>Hi, can you give more detail on how to fix this? I see this is discussed in <a href=\"https://www.kaggle.com/competitions/MABe-mouse-behavior-detection/discussion/612531\" target=\"_blank\">https://www.kaggle.com/competitions/MABe-mouse-behavior-detection/discussion/612531</a> but they didn't give an exact answer on how to fix</p>",
      "votes": null,
      "replies": [
        {
          "id": 3368910,
          "author_name": "xiaoz259",
          "author_url": "",
          "post_date": "12/09/2025 15:47:29",
          "content": "<p>I simply removed them from training data.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 3373114,
      "author_name": "ladiposamson",
      "author_url": "",
      "post_date": "12/12/2025 10:35:51",
      "content": "<p>Thank you for bringing this to our attention. The clarification on the mislabeled 25fps AdaptableSnail videos and the practical workaround you applied is very helpful for understanding how this issue impacts model performance.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3368199": "Removing the 25fps videos from AdaptableSnail boosted my offline CV by 0.02-0.03. If the mislabeling is not result of a constant permutation, then it seems to me that one \"trick\" to get LB score is to probe the public LB with different permutations (for these particular videos) and see which permutation give the biggest boost. Can we get a clarification from the competition host before the end?",
    "3368655": "Hi, can you give more detail on how to fix this? I see this is discussed in https://www.kaggle.com/competitions/MABe-mouse-behavior-detection/discussion/612531 but they didn't give an exact answer on how to fix",
    "3368910": "I simply removed them from training data.",
    "3373114": "Thank you for bringing this to our attention. The clarification on the mislabeled 25fps AdaptableSnail videos and the practical workaround you applied is very helpful for understanding how this issue impacts model performance."
  },
  "source": "meta"
}