{
  "id": 134622,
  "title": "KenPom Ratings and Data Leakage",
  "url": "/competitions/google-cloud-ncaa-march-madness-2020-division-1-mens-tournament/discussion/134622",
  "author_name": "",
  "post_date": "2020-03-09T10:01:43.890769100Z",
  "votes": 3,
  "comment_count": 3,
  "views": 0,
  "content": "<p>The kenpom rating for 2002 to 2019 season for each teams listed on <a href=\"https://kenpom.com/\">https://kenpom.com/</a> was calculated after the tournament completion. So, all the major leakage will be easily predicted as there will be big change in kenpom ratings for those low seed teams. This will be major source of data leakage. Are you using kenpom ratings and if yes, how are you handling this?</p>",
  "messages": [
    {
      "id": "767208",
      "postDate": "03/09/2020 10:01:43",
      "content": "<p>The kenpom rating for 2002 to 2019 season for each teams listed on <a href=\"https://kenpom.com/\">https://kenpom.com/</a> was calculated after the tournament completion. So, all the major leakage will be easily predicted as there will be big change in kenpom ratings for those low seed teams. This will be major source of data leakage. Are you using kenpom ratings and if yes, how are you handling this?</p>",
      "rawMarkdown": "The kenpom rating for 2002 to 2019 season for each teams listed on https://kenpom.com/ was calculated after the tournament completion. So, all the major leakage will be easily predicted as there will be big change in kenpom ratings for those low seed teams. This will be major source of data leakage. Are you using kenpom ratings and if yes, how are you handling this?",
      "votes": null
    },
    {
      "id": "767435",
      "postDate": "03/09/2020 16:17:43",
      "content": "<p>The Massey Ordinals file given in the data has a \"RankingDayNum\" column. Can't you choose to take the Kenpom data from a day before the tournament?</p>",
      "rawMarkdown": "The Massey Ordinals file given in the data has a \"RankingDayNum\" column. Can't you choose to take the Kenpom data from a day before the tournament?",
      "votes": null
    },
    {
      "id": "767667",
      "postDate": "03/10/2020 01:23:50",
      "content": "<p>These statistics will definitely have leakage as they are the summary at the end of the season and tournament. You can see yourself that if you buy the full package, there are the tables containing the statistics prior the tournament and the ones that are public that contain the statistics after the tournament. However, there was one participant in one of the previous years who used the public table with statistics with leakage anyways with ok results. \nKeep in mind though that you cannot use the premium data in your model because according to the rules all data needs to be public for everyone.</p>\n\n<p>C. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. However, you will (i) ensure the External Data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the External Data for the participants to the official competition forum prior to the Entry Deadline.</p>",
      "rawMarkdown": "These statistics will definitely have leakage as they are the summary at the end of the season and tournament. You can see yourself that if you buy the full package, there are the tables containing the statistics prior the tournament and the ones that are public that contain the statistics after the tournament. However, there was one participant in one of the previous years who used the public table with statistics with leakage anyways with ok results. \nKeep in mind though that you cannot use the premium data in your model because according to the rules all data needs to be public for everyone.\n\nC. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. However, you will (i) ensure the External Data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the External Data for the participants to the official competition forum prior to the Entry Deadline.",
      "votes": null
    },
    {
      "id": "767670",
      "postDate": "03/10/2020 01:26:09",
      "content": "<p>The nice thing about the public data in kenpom's website is that these are ratings not just rankings like it's the case with all the systems in the Massey Ordinal file.</p>",
      "rawMarkdown": "The nice thing about the public data in kenpom's website is that these are ratings not just rankings like it's the case with all the systems in the Massey Ordinal file.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 767435,
      "author_name": "blackbird71",
      "author_url": "",
      "post_date": "03/09/2020 16:17:43",
      "content": "<p>The Massey Ordinals file given in the data has a \"RankingDayNum\" column. Can't you choose to take the Kenpom data from a day before the tournament?</p>",
      "votes": null,
      "replies": [
        {
          "id": 767670,
          "author_name": "wacaxx",
          "author_url": "",
          "post_date": "03/10/2020 01:26:09",
          "content": "<p>The nice thing about the public data in kenpom's website is that these are ratings not just rankings like it's the case with all the systems in the Massey Ordinal file.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 767667,
      "author_name": "wacaxx",
      "author_url": "",
      "post_date": "03/10/2020 01:23:50",
      "content": "<p>These statistics will definitely have leakage as they are the summary at the end of the season and tournament. You can see yourself that if you buy the full package, there are the tables containing the statistics prior the tournament and the ones that are public that contain the statistics after the tournament. However, there was one participant in one of the previous years who used the public table with statistics with leakage anyways with ok results. \nKeep in mind though that you cannot use the premium data in your model because according to the rules all data needs to be public for everyone.</p>\n\n<p>C. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. However, you will (i) ensure the External Data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the External Data for the participants to the official competition forum prior to the Entry Deadline.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "767208": "The kenpom rating for 2002 to 2019 season for each teams listed on https://kenpom.com/ was calculated after the tournament completion. So, all the major leakage will be easily predicted as there will be big change in kenpom ratings for those low seed teams. This will be major source of data leakage. Are you using kenpom ratings and if yes, how are you handling this?",
    "767435": "The Massey Ordinals file given in the data has a \"RankingDayNum\" column. Can't you choose to take the Kenpom data from a day before the tournament?",
    "767667": "These statistics will definitely have leakage as they are the summary at the end of the season and tournament. You can see yourself that if you buy the full package, there are the tables containing the statistics prior the tournament and the ones that are public that contain the statistics after the tournament. However, there was one participant in one of the previous years who used the public table with statistics with leakage anyways with ok results. \nKeep in mind though that you cannot use the premium data in your model because according to the rules all data needs to be public for everyone.\n\nC. External Data. You may use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. However, you will (i) ensure the External Data is available to use by all participants of the competition for purposes of the competition at no cost to the other participants and (ii) post such access to the External Data for the participants to the official competition forum prior to the Entry Deadline.",
    "767670": "The nice thing about the public data in kenpom's website is that these are ratings not just rankings like it's the case with all the systems in the Massey Ordinal file."
  },
  "source": "meta"
}