{
  "id": 344315,
  "title": "Question regarding high values in weight_carried feature",
  "url": "/competitions/big-data-derby-2022/discussion/344315",
  "author_name": "",
  "post_date": "2022-08-14T19:44:54.598102900Z",
  "votes": 14,
  "comment_count": 6,
  "views": 0,
  "content": "<p>During my <a href=\"https://www.kaggle.com/code/iamleonie/big-data-derby-step-by-step-analysis/notebook\" target=\"_blank\">initial EDA</a>, I saw that there are some jockeys that have an unusually high <code>weight_carried</code> value:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3823514%2F213419f978bd8070aa1236157779f507%2FScreen%20Shot%202022-08-14%20at%2021.33.20.png?generation=1660505624151017&amp;alt=media\" alt=\"\"></p>\n<p>According to Wikipedia</p>\n<blockquote>\n  <p>The Kentucky Derby, for example, has a weight limit of 126 lb (57 kg) including the jockey's equipment. </p>\n</blockquote>\n<p>I assume something similar applies to NYRA as well. That is why I am suspicious about the jockeys with an average <code>weight_carried</code> of over 126 lbs.</p>\n<p>Some of the \"heavier\" jockeys have an average <code>weight_carried</code> of over 150 lbs (e.g. Thomas Garner and Sean McDermott).</p>\n<p>My question to the competition host <a href=\"https://www.kaggle.com/nythanyra\" target=\"_blank\">@nythanyra</a> (or anyone with more domain knowledge) is:<br>\n<strong>Are the high <code>weight_carried</code> values something to be suspicious about? Can you please provide some context for these high values?</strong></p>",
  "messages": [
    {
      "id": "1898768",
      "postDate": "08/14/2022 19:44:54",
      "content": "<p>During my <a href=\"https://www.kaggle.com/code/iamleonie/big-data-derby-step-by-step-analysis/notebook\" target=\"_blank\">initial EDA</a>, I saw that there are some jockeys that have an unusually high <code>weight_carried</code> value:<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3823514%2F213419f978bd8070aa1236157779f507%2FScreen%20Shot%202022-08-14%20at%2021.33.20.png?generation=1660505624151017&amp;alt=media\" alt=\"\"></p>\n<p>According to Wikipedia</p>\n<blockquote>\n  <p>The Kentucky Derby, for example, has a weight limit of 126 lb (57 kg) including the jockey's equipment. </p>\n</blockquote>\n<p>I assume something similar applies to NYRA as well. That is why I am suspicious about the jockeys with an average <code>weight_carried</code> of over 126 lbs.</p>\n<p>Some of the \"heavier\" jockeys have an average <code>weight_carried</code> of over 150 lbs (e.g. Thomas Garner and Sean McDermott).</p>\n<p>My question to the competition host <a href=\"https://www.kaggle.com/nythanyra\" target=\"_blank\">@nythanyra</a> (or anyone with more domain knowledge) is:<br>\n<strong>Are the high <code>weight_carried</code> values something to be suspicious about? Can you please provide some context for these high values?</strong></p>",
      "rawMarkdown": "During my [initial EDA](https://www.kaggle.com/code/iamleonie/big-data-derby-step-by-step-analysis/notebook), I saw that there are some jockeys that have an unusually high `weight_carried` value:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3823514%2F213419f978bd8070aa1236157779f507%2FScreen%20Shot%202022-08-14%20at%2021.33.20.png?generation=1660505624151017&alt=media)\n\nAccording to Wikipedia\n> The Kentucky Derby, for example, has a weight limit of 126 lb (57 kg) including the jockey's equipment. \n\nI assume something similar applies to NYRA as well. That is why I am suspicious about the jockeys with an average `weight_carried` of over 126 lbs.\n\nSome of the \"heavier\" jockeys have an average `weight_carried` of over 150 lbs (e.g. Thomas Garner and Sean McDermott).\n\nMy question to the competition host @nythanyra (or anyone with more domain knowledge) is:\n**Are the high `weight_carried` values something to be suspicious about? Can you please provide some context for these high values?**",
      "votes": null
    },
    {
      "id": "1898856",
      "postDate": "08/14/2022 22:11:44",
      "content": "<p>This is an excellent question. Those high weights are in what are called steeplechase races, where horse and jockey jump over fences throughout the race. This is a very small subset of racing and it might be best more impactful to filter those races out.</p>",
      "rawMarkdown": "This is an excellent question. Those high weights are in what are called steeplechase races, where horse and jockey jump over fences throughout the race. This is a very small subset of racing and it might be best more impactful to filter those races out.",
      "votes": null
    },
    {
      "id": "1899270",
      "postDate": "08/15/2022 06:47:52",
      "content": "<p>Thank you for the quick reply. Both the information and the suggestion to filter those races out are very helpful!</p>\n<hr>\n<p>For everyone: Based on the assumption that all races with an average <code>weight_carried</code> over 126 lbs are steeplechase races, these are the ones I found:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3823514%2F24ef1f97522f81f1e3f4bb06fb584075%2FScreen%20Shot%202022-08-15%20at%2008.42.20.png?generation=1660545759082682&amp;alt=media\" alt=\"\"></p>\n<p>['BEL_2019-09-18_1' 'BEL_2019-09-19_1' 'SAR_2019-07-21_1'<br>\n 'SAR_2019-07-24_1' 'SAR_2019-07-25_1' 'SAR_2019-08-07_1'<br>\n 'SAR_2019-08-14_1' 'SAR_2019-08-22_1' 'SAR_2019-08-28_1']</p>\n<p>Details and code can be found <a href=\"https://www.kaggle.com/code/iamleonie/big-data-derby-step-by-step-analysis\" target=\"_blank\">in my Notebook</a></p>\n<p><strong>Update:</strong> You can easily filter these out by removing all races with <code>course_type</code>== M (Hurdle)</p>",
      "rawMarkdown": "Thank you for the quick reply. Both the information and the suggestion to filter those races out are very helpful!\n\n---\n\nFor everyone: Based on the assumption that all races with an average `weight_carried` over 126 lbs are steeplechase races, these are the ones I found:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3823514%2F24ef1f97522f81f1e3f4bb06fb584075%2FScreen%20Shot%202022-08-15%20at%2008.42.20.png?generation=1660545759082682&alt=media)\n\n['BEL_2019-09-18_1' 'BEL_2019-09-19_1' 'SAR_2019-07-21_1'\n 'SAR_2019-07-24_1' 'SAR_2019-07-25_1' 'SAR_2019-08-07_1'\n 'SAR_2019-08-14_1' 'SAR_2019-08-22_1' 'SAR_2019-08-28_1']\n\nDetails and code can be found [in my Notebook](https://www.kaggle.com/code/iamleonie/big-data-derby-step-by-step-analysis)\n\n**Update:** You can easily filter these out by removing all races with `course_type`== M (Hurdle)",
      "votes": null
    },
    {
      "id": "1900927",
      "postDate": "08/16/2022 11:11:31",
      "content": "<p>Hi Folks</p>\n<p>If I may make an observation to this.  I have seen that the higher weight outliers are mostly in two race types:</p>\n<p>Stakes and Allowance have these higher weight values, is this a form handicapping ?  I have read that in Allowance racing the horse has a weight assigned to it, how is this affected with Stakes racing ?</p>\n<p>Or am I barking up the wrong tree so to speak ?</p>",
      "rawMarkdown": "Hi Folks\n\nIf I may make an observation to this.  I have seen that the higher weight outliers are mostly in two race types:\n\nStakes and Allowance have these higher weight values, is this a form handicapping ?  I have read that in Allowance racing the horse has a weight assigned to it, how is this affected with Stakes racing ?\n\nOr am I barking up the wrong tree so to speak ?",
      "votes": null
    },
    {
      "id": "1900957",
      "postDate": "08/16/2022 11:30:58",
      "content": "<p>I want to say that I really appreciate all your work on this EDA!<br>\nYour notebook looks really great at the moment!</p>\n<p>The Devastator.</p>",
      "rawMarkdown": "I want to say that I really appreciate all your work on this EDA!\nYour notebook looks really great at the moment!\n\nThe Devastator.",
      "votes": null
    },
    {
      "id": "1906319",
      "postDate": "08/19/2022 19:00:24",
      "content": "<p>You are not barking up the wrong tree! In most races, horses are given what is called weight for age so that they have a standardized weight depending upon how old they are. Two-year old horses race exclusively against each other, while three year olds often race against older horses. Because they are a little less mature, they are often given a weight allowance early in the year. We also have a small set of races that are handicaps, where horses are given weight based upon perceived ability in an effort to create a competitive racing environment.</p>",
      "rawMarkdown": "You are not barking up the wrong tree! In most races, horses are given what is called weight for age so that they have a standardized weight depending upon how old they are. Two-year old horses race exclusively against each other, while three year olds often race against older horses. Because they are a little less mature, they are often given a weight allowance early in the year. We also have a small set of races that are handicaps, where horses are given weight based upon perceived ability in an effort to create a competitive racing environment.",
      "votes": null
    },
    {
      "id": "1906611",
      "postDate": "08/20/2022 04:29:30",
      "content": "<p>If the outliers you are referring to are 140 pounds or greater, then those are steeplechase races, which are run mostly as allowance and stakes races. I don’t think they want those races included in any analysis though.</p>",
      "rawMarkdown": "If the outliers you are referring to are 140 pounds or greater, then those are steeplechase races, which are run mostly as allowance and stakes races. I don’t think they want those races included in any analysis though.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1898856,
      "author_name": "nythanyra",
      "author_url": "",
      "post_date": "08/14/2022 22:11:44",
      "content": "<p>This is an excellent question. Those high weights are in what are called steeplechase races, where horse and jockey jump over fences throughout the race. This is a very small subset of racing and it might be best more impactful to filter those races out.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1899270,
          "author_name": "iamleonie",
          "author_url": "",
          "post_date": "08/15/2022 06:47:52",
          "content": "<p>Thank you for the quick reply. Both the information and the suggestion to filter those races out are very helpful!</p>\n<hr>\n<p>For everyone: Based on the assumption that all races with an average <code>weight_carried</code> over 126 lbs are steeplechase races, these are the ones I found:</p>\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3823514%2F24ef1f97522f81f1e3f4bb06fb584075%2FScreen%20Shot%202022-08-15%20at%2008.42.20.png?generation=1660545759082682&amp;alt=media\" alt=\"\"></p>\n<p>['BEL_2019-09-18_1' 'BEL_2019-09-19_1' 'SAR_2019-07-21_1'<br>\n 'SAR_2019-07-24_1' 'SAR_2019-07-25_1' 'SAR_2019-08-07_1'<br>\n 'SAR_2019-08-14_1' 'SAR_2019-08-22_1' 'SAR_2019-08-28_1']</p>\n<p>Details and code can be found <a href=\"https://www.kaggle.com/code/iamleonie/big-data-derby-step-by-step-analysis\" target=\"_blank\">in my Notebook</a></p>\n<p><strong>Update:</strong> You can easily filter these out by removing all races with <code>course_type</code>== M (Hurdle)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1900927,
      "author_name": "neilbh",
      "author_url": "",
      "post_date": "08/16/2022 11:11:31",
      "content": "<p>Hi Folks</p>\n<p>If I may make an observation to this.  I have seen that the higher weight outliers are mostly in two race types:</p>\n<p>Stakes and Allowance have these higher weight values, is this a form handicapping ?  I have read that in Allowance racing the horse has a weight assigned to it, how is this affected with Stakes racing ?</p>\n<p>Or am I barking up the wrong tree so to speak ?</p>",
      "votes": null,
      "replies": [
        {
          "id": 1906319,
          "author_name": "nythanyra",
          "author_url": "",
          "post_date": "08/19/2022 19:00:24",
          "content": "<p>You are not barking up the wrong tree! In most races, horses are given what is called weight for age so that they have a standardized weight depending upon how old they are. Two-year old horses race exclusively against each other, while three year olds often race against older horses. Because they are a little less mature, they are often given a weight allowance early in the year. We also have a small set of races that are handicaps, where horses are given weight based upon perceived ability in an effort to create a competitive racing environment.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1906611,
          "author_name": "stevenr59",
          "author_url": "",
          "post_date": "08/20/2022 04:29:30",
          "content": "<p>If the outliers you are referring to are 140 pounds or greater, then those are steeplechase races, which are run mostly as allowance and stakes races. I don’t think they want those races included in any analysis though.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1900957,
      "author_name": "thedevastator",
      "author_url": "",
      "post_date": "08/16/2022 11:30:58",
      "content": "<p>I want to say that I really appreciate all your work on this EDA!<br>\nYour notebook looks really great at the moment!</p>\n<p>The Devastator.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1898768": "During my [initial EDA](https://www.kaggle.com/code/iamleonie/big-data-derby-step-by-step-analysis/notebook), I saw that there are some jockeys that have an unusually high `weight_carried` value:\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3823514%2F213419f978bd8070aa1236157779f507%2FScreen%20Shot%202022-08-14%20at%2021.33.20.png?generation=1660505624151017&alt=media)\n\nAccording to Wikipedia\n> The Kentucky Derby, for example, has a weight limit of 126 lb (57 kg) including the jockey's equipment. \n\nI assume something similar applies to NYRA as well. That is why I am suspicious about the jockeys with an average `weight_carried` of over 126 lbs.\n\nSome of the \"heavier\" jockeys have an average `weight_carried` of over 150 lbs (e.g. Thomas Garner and Sean McDermott).\n\nMy question to the competition host @nythanyra (or anyone with more domain knowledge) is:\n**Are the high `weight_carried` values something to be suspicious about? Can you please provide some context for these high values?**",
    "1898856": "This is an excellent question. Those high weights are in what are called steeplechase races, where horse and jockey jump over fences throughout the race. This is a very small subset of racing and it might be best more impactful to filter those races out.",
    "1899270": "Thank you for the quick reply. Both the information and the suggestion to filter those races out are very helpful!\n\n---\n\nFor everyone: Based on the assumption that all races with an average `weight_carried` over 126 lbs are steeplechase races, these are the ones I found:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F3823514%2F24ef1f97522f81f1e3f4bb06fb584075%2FScreen%20Shot%202022-08-15%20at%2008.42.20.png?generation=1660545759082682&alt=media)\n\n['BEL_2019-09-18_1' 'BEL_2019-09-19_1' 'SAR_2019-07-21_1'\n 'SAR_2019-07-24_1' 'SAR_2019-07-25_1' 'SAR_2019-08-07_1'\n 'SAR_2019-08-14_1' 'SAR_2019-08-22_1' 'SAR_2019-08-28_1']\n\nDetails and code can be found [in my Notebook](https://www.kaggle.com/code/iamleonie/big-data-derby-step-by-step-analysis)\n\n**Update:** You can easily filter these out by removing all races with `course_type`== M (Hurdle)",
    "1900927": "Hi Folks\n\nIf I may make an observation to this.  I have seen that the higher weight outliers are mostly in two race types:\n\nStakes and Allowance have these higher weight values, is this a form handicapping ?  I have read that in Allowance racing the horse has a weight assigned to it, how is this affected with Stakes racing ?\n\nOr am I barking up the wrong tree so to speak ?",
    "1900957": "I want to say that I really appreciate all your work on this EDA!\nYour notebook looks really great at the moment!\n\nThe Devastator.",
    "1906319": "You are not barking up the wrong tree! In most races, horses are given what is called weight for age so that they have a standardized weight depending upon how old they are. Two-year old horses race exclusively against each other, while three year olds often race against older horses. Because they are a little less mature, they are often given a weight allowance early in the year. We also have a small set of races that are handicaps, where horses are given weight based upon perceived ability in an effort to create a competitive racing environment.",
    "1906611": "If the outliers you are referring to are 140 pounds or greater, then those are steeplechase races, which are run mostly as allowance and stakes races. I don’t think they want those races included in any analysis though."
  },
  "source": "meta"
}