{
  "id": 299797,
  "title": "Use of data after competition closes.",
  "url": "/competitions/g-research-crypto-forecasting/discussion/299797",
  "author_name": "",
  "post_date": "2022-01-10T01:34:14.987184100Z",
  "votes": 3,
  "comment_count": 8,
  "views": 0,
  "content": "<p>Hello, I was wondering if I'd be able to use the data and still make my own predictions on the crypto data even after the competition has ended. I'm looking to use other's work as guidance to help me get started and was wondering if I'll still be able to access the 'Code' tab and the data after the competition has ended as I'd like to take part in my spare time.</p>\n<p>I'm pretty sure I've read elsewhere on Kaggle that people can still use code and data after competitions close if they missed out the first time. I just wanted to ask to see if anyone is able to clarify my situation.</p>\n<p>Thanks, Henry :)</p>",
  "messages": [
    {
      "id": "1644030",
      "postDate": "01/10/2022 01:34:14",
      "content": "<p>Hello, I was wondering if I'd be able to use the data and still make my own predictions on the crypto data even after the competition has ended. I'm looking to use other's work as guidance to help me get started and was wondering if I'll still be able to access the 'Code' tab and the data after the competition has ended as I'd like to take part in my spare time.</p>\n<p>I'm pretty sure I've read elsewhere on Kaggle that people can still use code and data after competitions close if they missed out the first time. I just wanted to ask to see if anyone is able to clarify my situation.</p>\n<p>Thanks, Henry :)</p>",
      "rawMarkdown": "Hello, I was wondering if I'd be able to use the data and still make my own predictions on the crypto data even after the competition has ended. I'm looking to use other's work as guidance to help me get started and was wondering if I'll still be able to access the 'Code' tab and the data after the competition has ended as I'd like to take part in my spare time.\n\nI'm pretty sure I've read elsewhere on Kaggle that people can still use code and data after competitions close if they missed out the first time. I just wanted to ask to see if anyone is able to clarify my situation.\n\nThanks, Henry :)",
      "votes": null
    },
    {
      "id": "1644064",
      "postDate": "01/10/2022 03:00:01",
      "content": "<p><a href=\"https://www.kaggle.com/henryblundy\" target=\"_blank\">@henryblundy</a> I am not sure if this competition is different, re-read the over section.  Typically on Kaggle the data is still available.</p>",
      "rawMarkdown": "henryblundy I am not sure if this competition is different, re-read the over section.  Typically on Kaggle the data is still available.",
      "votes": null
    },
    {
      "id": "1644277",
      "postDate": "01/10/2022 07:22:53",
      "content": "<p>I've used it before, so I think it's usually ok!😄</p>",
      "rawMarkdown": "I've used it before, so I think it's usually ok!😄",
      "votes": null
    },
    {
      "id": "1645055",
      "postDate": "01/10/2022 16:43:00",
      "content": "<p>There has been some effort to build the dataset from scratch. I've shared a notebook to collect data from Binance: <a href=\"https://www.kaggle.com/lucasmorin/getting-all-1m-data-from-binance\" target=\"_blank\">https://www.kaggle.com/lucasmorin/getting-all-1m-data-from-binance</a> (code taken and adapted from: <a href=\"https://github.com/gosuto-ai/candlestick_retriever/blob/master/main.py\" target=\"_blank\">https://github.com/gosuto-ai/candlestick_retriever/blob/master/main.py</a> - used by <a href=\"https://www.kaggle.com/jorijnsmit\" target=\"_blank\">@jorijnsmit</a> to update this kaggle data set <a href=\"https://www.kaggle.com/jorijnsmit/binance-full-history\" target=\"_blank\">https://www.kaggle.com/jorijnsmit/binance-full-history</a>) and another <a href=\"https://www.kaggle.com/lucasmorin/transforming-1m-data-from-binance\" target=\"_blank\">https://www.kaggle.com/lucasmorin/transforming-1m-data-from-binance</a> to build the dataset based on discussion here. The main problem is not getting the VWAP. I suspect the usage of another source.</p>",
      "rawMarkdown": "There has been some effort to build the dataset from scratch. I've shared a notebook to collect data from Binance: https://www.kaggle.com/lucasmorin/getting-all-1m-data-from-binance (code taken and adapted from: https://github.com/gosuto-ai/candlestick_retriever/blob/master/main.py - used by @jorijnsmit to update this kaggle data set https://www.kaggle.com/jorijnsmit/binance-full-history) and another https://www.kaggle.com/lucasmorin/transforming-1m-data-from-binance to build the dataset based on discussion here. The main problem is not getting the VWAP. I suspect the usage of another source.",
      "votes": null
    },
    {
      "id": "1645932",
      "postDate": "01/11/2022 11:01:49",
      "content": "<p>My 2 cents since I've been considering having a go at recreating some data myself, and am looking to better understand what we already know.</p>\n<p>If the data source is Binance we could confirm by comparing the volume and trade count.<br>\nKeeping in mind that they could be using derivatives or spot for any market.<br>\nQuote currency could also be a list of possible USD stablecoins.<br>\nUSDT perpetual swaps probably have the highest trading volume.</p>\n<p>Most exchanges lack trade counts when fetching candlestick history except FTX and Binance.<br>\nSo Binance would be a good fit, but if they aggregate across exchanges, instruments or tick data then it gets more complicated.</p>\n<p>Do you know if the organisers made any mention of how the dataset was collected?</p>",
      "rawMarkdown": "My 2 cents since I've been considering having a go at recreating some data myself, and am looking to better understand what we already know.\n\nIf the data source is Binance we could confirm by comparing the volume and trade count.\nKeeping in mind that they could be using derivatives or spot for any market.\nQuote currency could also be a list of possible USD stablecoins.\nUSDT perpetual swaps probably have the highest trading volume.\n\nMost exchanges lack trade counts when fetching candlestick history except FTX and Binance.\nSo Binance would be a good fit, but if they aggregate across exchanges, instruments or tick data then it gets more complicated.\n\nDo you know if the organisers made any mention of how the dataset was collected?",
      "votes": null
    },
    {
      "id": "1646741",
      "postDate": "01/12/2022 01:59:35",
      "content": "<p>mark ！nnnnnnnnnnnn</p>",
      "rawMarkdown": "mark ！nnnnnnnnnnnn",
      "votes": null
    },
    {
      "id": "1646993",
      "postDate": "01/12/2022 08:27:19",
      "content": "<p>Thanks for your question Henry. In the rules in section 7 it states that the data can only be used for the purpose of the competition.  <a href=\"https://www.kaggle.com/c/g-research-crypto-forecasting/rules\" target=\"_blank\">https://www.kaggle.com/c/g-research-crypto-forecasting/rules</a> I hope that helps. Thanks. We have also created this bespoke dataset from a multitude of sources.</p>",
      "rawMarkdown": "Thanks for your question Henry. In the rules in section 7 it states that the data can only be used for the purpose of the competition.  https://www.kaggle.com/c/g-research-crypto-forecasting/rules I hope that helps. Thanks. We have also created this bespoke dataset from a multitude of sources.",
      "votes": null
    },
    {
      "id": "1647762",
      "postDate": "01/12/2022 22:11:36",
      "content": "<p>Hello Kieran, thanks for the response. Does this mean that I will not be able to practice with and utilise the data after the competition closes. For example, let's say I wanted to make my own prediction on the data you've provided, would I not be able to do this?</p>\n<p>In addition, will code for the competition that has been shared publicly by other users in the 'Code' tab no longer be accessible?</p>\n<p>Thanks, Henry</p>",
      "rawMarkdown": "Hello Kieran, thanks for the response. Does this mean that I will not be able to practice with and utilise the data after the competition closes. For example, let's say I wanted to make my own prediction on the data you've provided, would I not be able to do this?\n\nIn addition, will code for the competition that has been shared publicly by other users in the 'Code' tab no longer be accessible?\n\nThanks, Henry",
      "votes": null
    },
    {
      "id": "1648182",
      "postDate": "01/13/2022 08:24:51",
      "content": "<p>Usually, data remains available post-competition but if you wish to use it for Research purpose, pls check the terms and rules of the competition for data license.</p>",
      "rawMarkdown": "Usually, data remains available post-competition but if you wish to use it for Research purpose, pls check the terms and rules of the competition for data license.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1644064,
      "author_name": "yvonnef",
      "author_url": "",
      "post_date": "01/10/2022 03:00:01",
      "content": "<p><a href=\"https://www.kaggle.com/henryblundy\" target=\"_blank\">@henryblundy</a> I am not sure if this competition is different, re-read the over section.  Typically on Kaggle the data is still available.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1644277,
      "author_name": "",
      "author_url": "",
      "post_date": "01/10/2022 07:22:53",
      "content": "<p>I've used it before, so I think it's usually ok!😄</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 1645055,
      "author_name": "lucasmorin",
      "author_url": "",
      "post_date": "01/10/2022 16:43:00",
      "content": "<p>There has been some effort to build the dataset from scratch. I've shared a notebook to collect data from Binance: <a href=\"https://www.kaggle.com/lucasmorin/getting-all-1m-data-from-binance\" target=\"_blank\">https://www.kaggle.com/lucasmorin/getting-all-1m-data-from-binance</a> (code taken and adapted from: <a href=\"https://github.com/gosuto-ai/candlestick_retriever/blob/master/main.py\" target=\"_blank\">https://github.com/gosuto-ai/candlestick_retriever/blob/master/main.py</a> - used by <a href=\"https://www.kaggle.com/jorijnsmit\" target=\"_blank\">@jorijnsmit</a> to update this kaggle data set <a href=\"https://www.kaggle.com/jorijnsmit/binance-full-history\" target=\"_blank\">https://www.kaggle.com/jorijnsmit/binance-full-history</a>) and another <a href=\"https://www.kaggle.com/lucasmorin/transforming-1m-data-from-binance\" target=\"_blank\">https://www.kaggle.com/lucasmorin/transforming-1m-data-from-binance</a> to build the dataset based on discussion here. The main problem is not getting the VWAP. I suspect the usage of another source.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1645932,
          "author_name": "devcon",
          "author_url": "",
          "post_date": "01/11/2022 11:01:49",
          "content": "<p>My 2 cents since I've been considering having a go at recreating some data myself, and am looking to better understand what we already know.</p>\n<p>If the data source is Binance we could confirm by comparing the volume and trade count.<br>\nKeeping in mind that they could be using derivatives or spot for any market.<br>\nQuote currency could also be a list of possible USD stablecoins.<br>\nUSDT perpetual swaps probably have the highest trading volume.</p>\n<p>Most exchanges lack trade counts when fetching candlestick history except FTX and Binance.<br>\nSo Binance would be a good fit, but if they aggregate across exchanges, instruments or tick data then it gets more complicated.</p>\n<p>Do you know if the organisers made any mention of how the dataset was collected?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1646741,
          "author_name": "huangzchao",
          "author_url": "",
          "post_date": "01/12/2022 01:59:35",
          "content": "<p>mark ！nnnnnnnnnnnn</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1646993,
      "author_name": "kierangarvey",
      "author_url": "",
      "post_date": "01/12/2022 08:27:19",
      "content": "<p>Thanks for your question Henry. In the rules in section 7 it states that the data can only be used for the purpose of the competition.  <a href=\"https://www.kaggle.com/c/g-research-crypto-forecasting/rules\" target=\"_blank\">https://www.kaggle.com/c/g-research-crypto-forecasting/rules</a> I hope that helps. Thanks. We have also created this bespoke dataset from a multitude of sources.</p>",
      "votes": null,
      "replies": [
        {
          "id": 1647762,
          "author_name": "henryblundy",
          "author_url": "",
          "post_date": "01/12/2022 22:11:36",
          "content": "<p>Hello Kieran, thanks for the response. Does this mean that I will not be able to practice with and utilise the data after the competition closes. For example, let's say I wanted to make my own prediction on the data you've provided, would I not be able to do this?</p>\n<p>In addition, will code for the competition that has been shared publicly by other users in the 'Code' tab no longer be accessible?</p>\n<p>Thanks, Henry</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1648182,
      "author_name": "bajajra",
      "author_url": "",
      "post_date": "01/13/2022 08:24:51",
      "content": "<p>Usually, data remains available post-competition but if you wish to use it for Research purpose, pls check the terms and rules of the competition for data license.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1644030": "Hello, I was wondering if I'd be able to use the data and still make my own predictions on the crypto data even after the competition has ended. I'm looking to use other's work as guidance to help me get started and was wondering if I'll still be able to access the 'Code' tab and the data after the competition has ended as I'd like to take part in my spare time.\n\nI'm pretty sure I've read elsewhere on Kaggle that people can still use code and data after competitions close if they missed out the first time. I just wanted to ask to see if anyone is able to clarify my situation.\n\nThanks, Henry :)",
    "1644064": "henryblundy I am not sure if this competition is different, re-read the over section.  Typically on Kaggle the data is still available.",
    "1644277": "I've used it before, so I think it's usually ok!😄",
    "1645055": "There has been some effort to build the dataset from scratch. I've shared a notebook to collect data from Binance: https://www.kaggle.com/lucasmorin/getting-all-1m-data-from-binance (code taken and adapted from: https://github.com/gosuto-ai/candlestick_retriever/blob/master/main.py - used by @jorijnsmit to update this kaggle data set https://www.kaggle.com/jorijnsmit/binance-full-history) and another https://www.kaggle.com/lucasmorin/transforming-1m-data-from-binance to build the dataset based on discussion here. The main problem is not getting the VWAP. I suspect the usage of another source.",
    "1645932": "My 2 cents since I've been considering having a go at recreating some data myself, and am looking to better understand what we already know.\n\nIf the data source is Binance we could confirm by comparing the volume and trade count.\nKeeping in mind that they could be using derivatives or spot for any market.\nQuote currency could also be a list of possible USD stablecoins.\nUSDT perpetual swaps probably have the highest trading volume.\n\nMost exchanges lack trade counts when fetching candlestick history except FTX and Binance.\nSo Binance would be a good fit, but if they aggregate across exchanges, instruments or tick data then it gets more complicated.\n\nDo you know if the organisers made any mention of how the dataset was collected?",
    "1646741": "mark ！nnnnnnnnnnnn",
    "1646993": "Thanks for your question Henry. In the rules in section 7 it states that the data can only be used for the purpose of the competition.  https://www.kaggle.com/c/g-research-crypto-forecasting/rules I hope that helps. Thanks. We have also created this bespoke dataset from a multitude of sources.",
    "1647762": "Hello Kieran, thanks for the response. Does this mean that I will not be able to practice with and utilise the data after the competition closes. For example, let's say I wanted to make my own prediction on the data you've provided, would I not be able to do this?\n\nIn addition, will code for the competition that has been shared publicly by other users in the 'Code' tab no longer be accessible?\n\nThanks, Henry",
    "1648182": "Usually, data remains available post-competition but if you wish to use it for Research purpose, pls check the terms and rules of the competition for data license."
  },
  "source": "meta"
}