As an update to the competition's rules, the host has agreed to allow the use of publicly, freely available external data. The source of any external data must be posted to this thread prior to the Entry Deadline.
", "messages": [ { "id": 402056, "postDate": "2018-10-11T05:52:11.970Z", "content": "Google analytics Demo Account !!!!!!!!!
\n\nNothing in the rules prevent us from using the data available from Google analytics demo account itself, this is becoming a farce:
\n\nUseful links are :
\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68235
\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68164
\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68262
", "rawMarkdown": "Google analytics Demo Account !!!!!!!!!\n\nNothing in the rules prevent us from using the data available from Google analytics demo account itself, this is becoming a farce: \n\nUseful links are : \n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68235\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68164\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68262", "votes": 29, "replies": [ { "id": 402087, "postDate": "2018-10-11T07:03:52.667Z", "content": "This is almost like saying \"Can we use the answers\" unfortunately ;(
", "rawMarkdown": "This is almost like saying \"Can we use the answers\" unfortunately ;(", "votes": 16 }, { "id": 402102, "postDate": "2018-10-11T07:22:34.037Z", "content": "Found it while checking date outliers in about 1.5 weeks. Though, hey, Kaggle Orgs are professionals, they would not skip something so obvious, this data should be different, will not spend time checking it... Was so wrong...
", "rawMarkdown": "Found it while checking date outliers in about 1.5 weeks. Though, hey, Kaggle Orgs are professionals, they would not skip something so obvious, this data should be different, will not spend time checking it... Was so wrong...", "votes": 2 }, { "id": 402203, "postDate": "2018-10-11T10:08:11.707Z", "content": "maybe external data shouldn't be allowed in the first place and we just focus on what we have in hand :(
", "rawMarkdown": "maybe external data shouldn't be allowed in the first place and we just focus on what we have in hand :(", "votes": 2 }, { "id": 402986, "postDate": "2018-10-12T17:39:28.507Z", "content": "The 'kernels only' competition would solve the problem
", "rawMarkdown": "The 'kernels only' competition would solve the problem" }, { "id": 403111, "postDate": "2018-10-12T22:30:25.437Z", "content": "The hardware given by Kaggle isn't great. It's too difficult to use custom libs. I wouldn't have entered if that (kernels only) was required.
", "rawMarkdown": "The hardware given by Kaggle isn't great. It's too difficult to use custom libs. I wouldn't have entered if that (kernels only) was required." } ] }, { "id": 393711, "postDate": "2018-09-25T19:28:50.887Z", "content": "As an update to the competition's rules, the host has agreed to allow the use of publicly, freely available external data. The source of any external data must be posted to this thread prior to the Entry Deadline.
", "rawMarkdown": "As an update to the competition's rules, the host has agreed to allow the use of **publicly, freely available external data**. The source of any external data must be posted to this thread prior to the Entry Deadline.", "votes": 28 }, { "id": 394031, "postDate": "2018-09-26T08:20:59.367Z", "content": "I will use below
\n\nHow to use this for free? Says i need to make a biling account
", "rawMarkdown": "How to use this for free? Says i need to make a biling account" }, { "id": 397119, "postDate": "2018-10-01T22:51:39.930Z", "content": "Ok. If anyone wants a geocoding app they can instead use the service provided by Bing at https://www.bingmapsportal.com they give free API key with an email account then you can download R libraries to geocode your cities. See https://stackoverflow.com/questions/26075811/using-bing-option-with-tarifx-geo-in-r
", "rawMarkdown": "Ok. If anyone wants a geocoding app they can instead use the service provided by Bing at https://www.bingmapsportal.com they give free API key with an email account then you can download R libraries to geocode your cities. See https://stackoverflow.com/questions/26075811/using-bing-option-with-tarifx-geo-in-r", "votes": 6 } ] }, { "id": 400306, "postDate": "2018-10-08T04:49:09.973Z", "content": "I will use the following free APIs.
\n\nhttps://analytics.google.com/analytics/web/demoAccount
", "rawMarkdown": "https://analytics.google.com/analytics/web/demoAccount", "votes": 4, "replies": [ { "id": 396042, "postDate": "2018-09-29T22:53:05.387Z", "content": "Do you mean getting access to the data which was removed from the training and test data sets?
", "rawMarkdown": "Do you mean getting access to the data which was removed from the training and test data sets?", "votes": 3 }, { "id": 400718, "postDate": "2018-10-08T19:09:18.367Z", "content": "Is this legal? :)
", "rawMarkdown": "Is this legal? :)", "votes": 1 }, { "id": 401518, "postDate": "2018-10-10T07:56:20.880Z", "content": "This is an important question, especially considering the fact that Corey skyrocketed recently all the way to the #1 spot, now I'm really curious about this. Can you get access to the features that were removed by Kaggle using this Demo account?
\n\nIf so, what's next? Does Kaggle re-include the original data in our dataset to put everyone on equal footing? Or should we just all get demo accounts?
", "rawMarkdown": "This is an important question, especially considering the fact that Corey skyrocketed recently all the way to the #1 spot, now I'm really curious about this. Can you get access to the features that were removed by Kaggle using this Demo account?\n\nIf so, what's next? Does Kaggle re-include the original data in our dataset to put everyone on equal footing? Or should we just all get demo accounts?", "votes": 3 }, { "id": 401669, "postDate": "2018-10-10T13:14:22.390Z", "content": "No... I used this demo account to get ideas. If you look at this kernel https://www.kaggle.com/erikbruin/google-analytics-eda-lightgbm-screenshots it shows you screenshots of the website, so I used this website to learn more about how google analytics works. I dont know how to access \"Not available in demo dataset\" information.
", "rawMarkdown": "No... I used this demo account to get ideas. If you look at this kernel https://www.kaggle.com/erikbruin/google-analytics-eda-lightgbm-screenshots it shows you screenshots of the website, so I used this website to learn more about how google analytics works. I dont know how to access \"Not available in demo dataset\" information.", "votes": 2 }, { "id": 402409, "postDate": "2018-10-11T17:01:12.637Z", "content": "I knew it Corey ;-)! I also suspected something fishy, and actually thought you were on the same track when you asked a question in the comments. Apologies for sort of ignoring the question! I smelled something fishy too but just did not want to be the person to look into it and potentially kill the comp....
", "rawMarkdown": "I knew it Corey ;-)! I also suspected something fishy, and actually thought you were on the same track when you asked a question in the comments. Apologies for sort of ignoring the question! I smelled something fishy too but just did not want to be the person to look into it and potentially kill the comp....", "votes": 2 } ] }, { "id": 393730, "postDate": "2018-09-25T20:12:16.887Z", "content": "@juliaelliott Should external data be disclosed 1 week before the competition ends, or is it just prior to the competition ending? So, like, if I find a super awesome external data source can I post it 5 minutes before the competition ends?
", "rawMarkdown": "@juliaelliott Should external data be disclosed 1 week before the competition ends, or is it just prior to the competition ending? So, like, if I find a super awesome external data source can I post it 5 minutes before the competition ends?", "votes": 4, "replies": [ { "id": 393867, "postDate": "2018-09-26T01:50:19.123Z", "content": "It has to be posted prior to the entry deadline, which is one week before the end of the competition. That means we all get at least one week to share in your special data =D
", "rawMarkdown": "It has to be posted prior to the entry deadline, which is one week before the end of the competition. That means we all get at least one week to share in your special data =D", "votes": 3 } ] }, { "id": 396580, "postDate": "2018-10-01T03:05:57.180Z", "content": "I will use this (shorted link):\nhttp://bit.ly/2OVMqMd
\n\nThis is the data of The International Monetary Fund - GDP (PPP) per capita by country
", "rawMarkdown": "I will use this (shorted link):\nhttp://bit.ly/2OVMqMd\n\nThis is the data of The International Monetary Fund - GDP (PPP) per capita by country", "votes": 2 }, { "id": 402260, "postDate": "2018-10-11T12:30:43.807Z", "content": "I think \"Google analytics Demo Account\" should be added to list of prohibited external data sources.
", "rawMarkdown": "I think \"Google analytics Demo Account\" should be added to list of prohibited external data sources.", "votes": 1, "replies": [ { "id": 402265, "postDate": "2018-10-11T12:37:18.157Z", "content": "I agree, but how would they enforce it? I don't want the prize to go to the sneakiest cheater...
", "rawMarkdown": "I agree, but how would they enforce it? I don't want the prize to go to the sneakiest cheater...", "votes": 2 }, { "id": 402268, "postDate": "2018-10-11T12:43:42.930Z", "content": "I do not think that this is the solution from now on. Competitions are not just for prizes. You can not stop people to get cheap gold/silver medals by using even a few of the leak. That wouldn't be fair.
", "rawMarkdown": "I do not think that this is the solution from now on. Competitions are not just for prizes. You can not stop people to get cheap gold/silver medals by using even a few of the leak. That wouldn't be fair.", "votes": 5 }, { "id": 402273, "postDate": "2018-10-11T12:55:20.523Z", "content": "yes, I just thought about 'in money' positions, where people must confirm results by submitting sources to Kaggle team. what about ranking points - this question is open. may be they should completely change train/test sets and make sure such data not available on their Demo Account
", "rawMarkdown": "yes, I just thought about 'in money' positions, where people must confirm results by submitting sources to Kaggle team. what about ranking points - this question is open. may be they should completely change train/test sets and make sure such data not available on their Demo Account", "votes": 1 }, { "id": 402281, "postDate": "2018-10-11T13:01:56.687Z", "content": "But now you can use the extra data to test hypotheses - to get a good model from feature engineering - these features will be very difficult to detect whether they were obtained with the extra data or not.
", "rawMarkdown": "But now you can use the extra data to test hypotheses - to get a good model from feature engineering - these features will be very difficult to detect whether they were obtained with the extra data or not.", "votes": 11 } ] }, { "id": 401028, "postDate": "2018-10-09T10:01:25.967Z", "content": "I see people posting a note about the same external data source. Please confirm that it's fine if anybody mentions a particular source, as opposed to everybody who uses it must claim to use it.
", "rawMarkdown": "I see people posting a note about the same external data source. Please confirm that it's fine if anybody mentions a particular source, as opposed to everybody who uses it must claim to use it.", "votes": 1, "replies": [ { "id": 401041, "postDate": "2018-10-09T10:36:11.613Z", "content": "The usual way is: if the source is mentioned here it's no longer \"private\" and anyone can use it. (As long as comp. specific rules allow it)
", "rawMarkdown": "The usual way is: if the source is mentioned here it's no longer \"private\" and anyone can use it. (As long as comp. specific rules allow it)", "votes": 2 } ] }, { "id": 394524, "postDate": "2018-09-27T02:43:56.580Z", "content": "I will be using https://simplemaps.com/data/world-cities (the free basic list) and https://gist.github.com/stasius12/f95f2999fa351212991c43a5f067c78d
", "rawMarkdown": "I will be using https://simplemaps.com/data/world-cities (the free basic list) and https://gist.github.com/stasius12/f95f2999fa351212991c43a5f067c78d", "votes": 1 }, { "id": 394427, "postDate": "2018-09-26T20:09:15.757Z", "content": "I found this helpful post which shows how to use external data within a kernel.
\n\nhttps://www.kaggle.com/product-feedback/63544#latest-394426
", "rawMarkdown": "I found this helpful post which shows how to use external data within a kernel.\n\nhttps://www.kaggle.com/product-feedback/63544#latest-394426\n\n", "votes": 1 }, { "id": 393714, "postDate": "2018-09-25T19:31:23.030Z", "content": "Are there any restrictions on this? For example, around the date ranges?
", "rawMarkdown": "Are there any restrictions on this? For example, around the date ranges?", "votes": 1, "replies": [ { "id": 401338, "postDate": "2018-10-09T21:38:38.957Z", "content": "any news on this?
", "rawMarkdown": "any news on this?" } ] }, { "id": 405357, "postDate": "2018-10-17T10:20:15.127Z", "content": "I am using GDP external data from
\n\nhttp://statisticstimes.com/economy/countries-by-projected-gdp.php
\n\nhttp://statisticstimes.com/economy/countries-by-gdp-ppp.php
\n\nhttps://www.imf.org/external/datamapper/NGDPD@WEO/OEMDC/ADVEC/WEOWORLD
", "rawMarkdown": "I am using GDP external data from \n\nhttp://statisticstimes.com/economy/countries-by-projected-gdp.php\n\nhttp://statisticstimes.com/economy/countries-by-gdp-ppp.php\n\nhttps://www.imf.org/external/datamapper/NGDPD@WEO/OEMDC/ADVEC/WEOWORLD", "votes": 2 }, { "id": 401268, "postDate": "2018-10-09T18:06:54.723Z", "content": "Do we need to mention any external libraries that we are using (which could arguably be external sources of data)?
", "rawMarkdown": "Do we need to mention any external libraries that we are using (which could arguably be external sources of data)?", "votes": 2 }, { "id": 395557, "postDate": "2018-09-28T20:01:56.557Z", "content": "https://www.iana.org/time-zones
\n\n", "rawMarkdown": "https://www.iana.org/time-zones\n\nhttps://www.geonames.org/", "votes": 2 }, { "id": 393715, "postDate": "2018-09-25T19:36:58.613Z", "content": "Ah-ha! Fun little shake-up to add to the leaderboard revelation. Thanks for the clarification.
", "rawMarkdown": "Ah-ha! Fun little shake-up to add to the leaderboard revelation. Thanks for the clarification.", "votes": 2 }, { "id": 425980, "postDate": "2018-11-22T11:27:48.143Z", "content": "https://www.currency-iso.org/en/home/tables/table-a1.html\nhttps://finance.yahoo.com/\nhttp://export.rbc.ru/\nhttps://www.ofx.com/en-au/forex-news/\nhttp://statisticstimes.com/economy/countries-by-projected-gdp-capita.php
", "rawMarkdown": "https://www.currency-iso.org/en/home/tables/table-a1.html\nhttps://finance.yahoo.com/\nhttp://export.rbc.ru/\nhttps://www.ofx.com/en-au/forex-news/\nhttp://statisticstimes.com/economy/countries-by-projected-gdp-capita.php" }, { "id": 423057, "postDate": "2018-11-17T11:13:12.470Z", "content": "I will try Alexa Global Rank https://www.alexa.com/siteinfo
", "rawMarkdown": "I will try Alexa Global Rank https://www.alexa.com/siteinfo" }, { "id": 412014, "postDate": "2018-10-29T12:00:49.087Z", "content": "Will try to use http://web.archive.org and store itself https://shop.googlemerchandisestore.com/
", "rawMarkdown": "Will try to use http://web.archive.org and store itself https://shop.googlemerchandisestore.com/" }, { "id": 402642, "postDate": "2018-10-12T03:27:16.680Z", "content": "I'm using GDP data from here: https://data.worldbank.org/indicator/NY.GDP.PCAP.PP.CD\nMissing countries were filled up with GDP values from wikipedia.
", "rawMarkdown": "I'm using GDP data from here: https://data.worldbank.org/indicator/NY.GDP.PCAP.PP.CD\nMissing countries were filled up with GDP values from wikipedia." }, { "id": 401940, "postDate": "2018-10-10T22:23:07.273Z", "content": "", "rawMarkdown": "[Worldcities][1]\n\n\n [1]: https://simplemaps.com/data/world-cities" }, { "id": 401357, "postDate": "2018-10-09T23:21:47.327Z", "content": "\n\nhttp://www.mapdevelopers.com/batch_geocode_tool.php
", "rawMarkdown": "https://timezonedb.com/\n\nhttp://www.mapdevelopers.com/batch_geocode_tool.php" }, { "id": 397017, "postDate": "2018-10-01T19:03:05.850Z", "content": "https://www.sheffield.ac.uk/international/english-speaking-countries
", "rawMarkdown": "https://www.sheffield.ac.uk/international/english-speaking-countries", "replies": [ { "id": 397102, "postDate": "2018-10-01T22:21:52.203Z", "content": "https://en.wikipedia.org/wiki/List_of_territorial_entities_where_English_is_an_official_language
", "rawMarkdown": "https://en.wikipedia.org/wiki/List_of_territorial_entities_where_English_is_an_official_language", "votes": 2 } ] }, { "id": 394009, "postDate": "2018-09-26T07:44:54.503Z", "content": "In what format the sources of external data must be posted? Just links? Or some description of datasets should be provided?
", "rawMarkdown": "In what format the sources of external data must be posted? Just links? Or some description of datasets should be provided?", "replies": [ { "id": 398970, "postDate": "2018-10-04T21:52:36.590Z", "content": "Maybe it will be prettier if you add a clear title for the data. Like that :
\n\nExternal database used :
\n\n\"Geographical position of cities in the world\" : htt://...
\n\n\"Average income for European cities\" : htt://...
\n\nAll the point is to explain what you used and where you've got your data. The goal is to show you only used data any person can get access. I don't think it's necessary to add the title but it would be easier and more clear.
\n\n(It's how I see it)
", "rawMarkdown": "Maybe it will be prettier if you add a clear title for the data. Like that :\n\nExternal database used :\n\n\"Geographical position of cities in the world\" : htt://...\n\n\"Average income for European cities\" : htt://...\n\n\nAll the point is to explain what you used and where you've got your data. The goal is to show you only used data any person can get access. I don't think it's necessary to add the title but it would be easier and more clear.\n\n(It's how I see it)", "votes": 2 } ] }, { "id": 393719, "postDate": "2018-09-25T19:50:12.457Z", "content": "This is great. I hope future competitions will also use this rule!
", "rawMarkdown": "This is great. I hope future competitions will also use this rule!" }, { "id": 397556, "postDate": "2018-10-02T16:58:08.973Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 402056, "author_name": "olivier", "author_url": "", "post_date": "2018-10-11T05:52:11.970000", "content": "Google analytics Demo Account !!!!!!!!!
\n\nNothing in the rules prevent us from using the data available from Google analytics demo account itself, this is becoming a farce:
\n\nUseful links are :
\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68235
\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68164
\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68262
", "votes": 29, "replies": [ { "id": 402087, "author_name": "Scirpus", "author_url": "", "post_date": "2018-10-11T07:03:52.667000", "content": "This is almost like saying \"Can we use the answers\" unfortunately ;(
", "votes": 16, "replies": [] }, { "id": 402102, "author_name": "WispZero", "author_url": "", "post_date": "2018-10-11T07:22:34.037000", "content": "Found it while checking date outliers in about 1.5 weeks. Though, hey, Kaggle Orgs are professionals, they would not skip something so obvious, this data should be different, will not spend time checking it... Was so wrong...
", "votes": 2, "replies": [] }, { "id": 402203, "author_name": "Yao Zhongwei", "author_url": "", "post_date": "2018-10-11T10:08:11.707000", "content": "maybe external data shouldn't be allowed in the first place and we just focus on what we have in hand :(
", "votes": 2, "replies": [] }, { "id": 402986, "author_name": "Nikita Hismatov", "author_url": "", "post_date": "2018-10-12T17:39:28.507000", "content": "The 'kernels only' competition would solve the problem
", "votes": 0, "replies": [] }, { "id": 403111, "author_name": "LDMTWO", "author_url": "", "post_date": "2018-10-12T22:30:25.437000", "content": "The hardware given by Kaggle isn't great. It's too difficult to use custom libs. I wouldn't have entered if that (kernels only) was required.
", "votes": 0, "replies": [] } ] }, { "id": 394031, "author_name": "ONODERA", "author_url": "", "post_date": "2018-09-26T08:20:59.367000", "content": "I will use below
\n\nHow to use this for free? Says i need to make a biling account
", "votes": 0, "replies": [] }, { "id": 397119, "author_name": "CoreyJamesLevinson", "author_url": "", "post_date": "2018-10-01T22:51:39.930000", "content": "Ok. If anyone wants a geocoding app they can instead use the service provided by Bing at https://www.bingmapsportal.com they give free API key with an email account then you can download R libraries to geocode your cities. See https://stackoverflow.com/questions/26075811/using-bing-option-with-tarifx-geo-in-r
", "votes": 6, "replies": [] } ] }, { "id": 400306, "author_name": "Tak", "author_url": "", "post_date": "2018-10-08T04:49:09.973000", "content": "I will use the following free APIs.
\n\nhttps://analytics.google.com/analytics/web/demoAccount
", "votes": 4, "replies": [ { "id": 396042, "author_name": "Johann de Boer", "author_url": "", "post_date": "2018-09-29T22:53:05.387000", "content": "Do you mean getting access to the data which was removed from the training and test data sets?
", "votes": 3, "replies": [] }, { "id": 400718, "author_name": "Think", "author_url": "", "post_date": "2018-10-08T19:09:18.367000", "content": "Is this legal? :)
", "votes": 1, "replies": [] }, { "id": 401518, "author_name": "juliencs", "author_url": "", "post_date": "2018-10-10T07:56:20.880000", "content": "This is an important question, especially considering the fact that Corey skyrocketed recently all the way to the #1 spot, now I'm really curious about this. Can you get access to the features that were removed by Kaggle using this Demo account?
\n\nIf so, what's next? Does Kaggle re-include the original data in our dataset to put everyone on equal footing? Or should we just all get demo accounts?
", "votes": 3, "replies": [] }, { "id": 401669, "author_name": "CoreyJamesLevinson", "author_url": "", "post_date": "2018-10-10T13:14:22.390000", "content": "No... I used this demo account to get ideas. If you look at this kernel https://www.kaggle.com/erikbruin/google-analytics-eda-lightgbm-screenshots it shows you screenshots of the website, so I used this website to learn more about how google analytics works. I dont know how to access \"Not available in demo dataset\" information.
", "votes": 2, "replies": [] }, { "id": 402409, "author_name": "Erik Bruin", "author_url": "", "post_date": "2018-10-11T17:01:12.637000", "content": "I knew it Corey ;-)! I also suspected something fishy, and actually thought you were on the same track when you asked a question in the comments. Apologies for sort of ignoring the question! I smelled something fishy too but just did not want to be the person to look into it and potentially kill the comp....
", "votes": 2, "replies": [] } ] }, { "id": 393730, "author_name": "CoreyJamesLevinson", "author_url": "", "post_date": "2018-09-25T20:12:16.887000", "content": "@juliaelliott Should external data be disclosed 1 week before the competition ends, or is it just prior to the competition ending? So, like, if I find a super awesome external data source can I post it 5 minutes before the competition ends?
", "votes": 4, "replies": [ { "id": 393867, "author_name": "Allen", "author_url": "", "post_date": "2018-09-26T01:50:19.123000", "content": "It has to be posted prior to the entry deadline, which is one week before the end of the competition. That means we all get at least one week to share in your special data =D
", "votes": 3, "replies": [] } ] }, { "id": 396580, "author_name": "Artem Agaev", "author_url": "", "post_date": "2018-10-01T03:05:57.180000", "content": "I will use this (shorted link):\nhttp://bit.ly/2OVMqMd
\n\nThis is the data of The International Monetary Fund - GDP (PPP) per capita by country
", "votes": 2, "replies": [] }, { "id": 402260, "author_name": "Vadim Stolyarov", "author_url": "", "post_date": "2018-10-11T12:30:43.807000", "content": "I think \"Google analytics Demo Account\" should be added to list of prohibited external data sources.
", "votes": 1, "replies": [ { "id": 402265, "author_name": "Allen", "author_url": "", "post_date": "2018-10-11T12:37:18.157000", "content": "I agree, but how would they enforce it? I don't want the prize to go to the sneakiest cheater...
", "votes": 2, "replies": [] }, { "id": 402268, "author_name": "Fatih Öztürk", "author_url": "", "post_date": "2018-10-11T12:43:42.930000", "content": "I do not think that this is the solution from now on. Competitions are not just for prizes. You can not stop people to get cheap gold/silver medals by using even a few of the leak. That wouldn't be fair.
", "votes": 5, "replies": [] }, { "id": 402273, "author_name": "Vadim Stolyarov", "author_url": "", "post_date": "2018-10-11T12:55:20.523000", "content": "yes, I just thought about 'in money' positions, where people must confirm results by submitting sources to Kaggle team. what about ranking points - this question is open. may be they should completely change train/test sets and make sure such data not available on their Demo Account
", "votes": 1, "replies": [] }, { "id": 402281, "author_name": "Scirpus", "author_url": "", "post_date": "2018-10-11T13:01:56.687000", "content": "But now you can use the extra data to test hypotheses - to get a good model from feature engineering - these features will be very difficult to detect whether they were obtained with the extra data or not.
", "votes": 11, "replies": [] } ] }, { "id": 401028, "author_name": "Taavi", "author_url": "", "post_date": "2018-10-09T10:01:25.967000", "content": "I see people posting a note about the same external data source. Please confirm that it's fine if anybody mentions a particular source, as opposed to everybody who uses it must claim to use it.
", "votes": 1, "replies": [ { "id": 401041, "author_name": "miguel perez", "author_url": "", "post_date": "2018-10-09T10:36:11.613000", "content": "The usual way is: if the source is mentioned here it's no longer \"private\" and anyone can use it. (As long as comp. specific rules allow it)
", "votes": 2, "replies": [] } ] }, { "id": 394524, "author_name": "Kerenza Deo", "author_url": "", "post_date": "2018-09-27T02:43:56.580000", "content": "I will be using https://simplemaps.com/data/world-cities (the free basic list) and https://gist.github.com/stasius12/f95f2999fa351212991c43a5f067c78d
", "votes": 1, "replies": [] }, { "id": 394427, "author_name": "Allen", "author_url": "", "post_date": "2018-09-26T20:09:15.757000", "content": "I found this helpful post which shows how to use external data within a kernel.
\n\nhttps://www.kaggle.com/product-feedback/63544#latest-394426
", "votes": 1, "replies": [] }, { "id": 393714, "author_name": "MichaelP", "author_url": "", "post_date": "2018-09-25T19:31:23.030000", "content": "Are there any restrictions on this? For example, around the date ranges?
", "votes": 1, "replies": [ { "id": 401338, "author_name": "Pedro Reis", "author_url": "", "post_date": "2018-10-09T21:38:38.957000", "content": "any news on this?
", "votes": 0, "replies": [] } ] }, { "id": 405357, "author_name": "Thong Nguyen", "author_url": "", "post_date": "2018-10-17T10:20:15.127000", "content": "I am using GDP external data from
\n\nhttp://statisticstimes.com/economy/countries-by-projected-gdp.php
\n\nhttp://statisticstimes.com/economy/countries-by-gdp-ppp.php
\n\nhttps://www.imf.org/external/datamapper/NGDPD@WEO/OEMDC/ADVEC/WEOWORLD
", "votes": 2, "replies": [] }, { "id": 401268, "author_name": "jyorg", "author_url": "", "post_date": "2018-10-09T18:06:54.723000", "content": "Do we need to mention any external libraries that we are using (which could arguably be external sources of data)?
", "votes": 2, "replies": [] }, { "id": 395557, "author_name": "Alexander Firsov", "author_url": "", "post_date": "2018-09-28T20:01:56.557000", "content": "https://www.iana.org/time-zones
\n\n", "votes": 2, "replies": [] }, { "id": 393715, "author_name": "Nick", "author_url": "", "post_date": "2018-09-25T19:36:58.613000", "content": "Ah-ha! Fun little shake-up to add to the leaderboard revelation. Thanks for the clarification.
", "votes": 2, "replies": [] }, { "id": 425980, "author_name": "Valeriy Garipov", "author_url": "", "post_date": "2018-11-22T11:27:48.143000", "content": "https://www.currency-iso.org/en/home/tables/table-a1.html\nhttps://finance.yahoo.com/\nhttp://export.rbc.ru/\nhttps://www.ofx.com/en-au/forex-news/\nhttp://statisticstimes.com/economy/countries-by-projected-gdp-capita.php
", "votes": 0, "replies": [] }, { "id": 423057, "author_name": "Dmytro Maliarenko", "author_url": "", "post_date": "2018-11-17T11:13:12.470000", "content": "I will try Alexa Global Rank https://www.alexa.com/siteinfo
", "votes": 0, "replies": [] }, { "id": 412014, "author_name": "WispZero", "author_url": "", "post_date": "2018-10-29T12:00:49.087000", "content": "Will try to use http://web.archive.org and store itself https://shop.googlemerchandisestore.com/
", "votes": 0, "replies": [] }, { "id": 402642, "author_name": "Christian Blume", "author_url": "", "post_date": "2018-10-12T03:27:16.680000", "content": "I'm using GDP data from here: https://data.worldbank.org/indicator/NY.GDP.PCAP.PP.CD\nMissing countries were filled up with GDP values from wikipedia.
", "votes": 0, "replies": [] }, { "id": 401940, "author_name": "Arindam", "author_url": "", "post_date": "2018-10-10T22:23:07.273000", "content": "", "votes": 0, "replies": [] }, { "id": 401357, "author_name": "AmirH", "author_url": "", "post_date": "2018-10-09T23:21:47.327000", "content": "\n\nhttp://www.mapdevelopers.com/batch_geocode_tool.php
", "votes": 0, "replies": [] }, { "id": 397017, "author_name": "CoreyJamesLevinson", "author_url": "", "post_date": "2018-10-01T19:03:05.850000", "content": "https://www.sheffield.ac.uk/international/english-speaking-countries
", "votes": 0, "replies": [ { "id": 397102, "author_name": "CoreyJamesLevinson", "author_url": "", "post_date": "2018-10-01T22:21:52.203000", "content": "https://en.wikipedia.org/wiki/List_of_territorial_entities_where_English_is_an_official_language
", "votes": 2, "replies": [] } ] }, { "id": 394009, "author_name": "kss", "author_url": "", "post_date": "2018-09-26T07:44:54.503000", "content": "In what format the sources of external data must be posted? Just links? Or some description of datasets should be provided?
", "votes": 0, "replies": [ { "id": 398970, "author_name": "Xavier_DELPIERRE", "author_url": "", "post_date": "2018-10-04T21:52:36.590000", "content": "Maybe it will be prettier if you add a clear title for the data. Like that :
\n\nExternal database used :
\n\n\"Geographical position of cities in the world\" : htt://...
\n\n\"Average income for European cities\" : htt://...
\n\nAll the point is to explain what you used and where you've got your data. The goal is to show you only used data any person can get access. I don't think it's necessary to add the title but it would be easier and more clear.
\n\n(It's how I see it)
", "votes": 2, "replies": [] } ] }, { "id": 393719, "author_name": "Allen", "author_url": "", "post_date": "2018-09-25T19:50:12.457000", "content": "This is great. I hope future competitions will also use this rule!
", "votes": 0, "replies": [] }, { "id": 397556, "author_name": "", "author_url": "", "post_date": "2018-10-02T16:58:08.973000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "402056": "Google analytics Demo Account !!!!!!!!!\n\nNothing in the rules prevent us from using the data available from Google analytics demo account itself, this is becoming a farce: \n\nUseful links are : \n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68235\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68164\n\nhttps://www.kaggle.com/c/ga-customer-revenue-prediction/discussion/68262", "393711": "As an update to the competition's rules, the host has agreed to allow the use of **publicly, freely available external data**. The source of any external data must be posted to this thread prior to the Entry Deadline.", "394031": "I will use below\n\n- https://developers.google.com/maps/documentation/timezone/start\n- https://developers.google.com/maps/documentation/geocoding/start", "400306": " I will use the following free APIs.\n\n- [bing map](https://www.bingmapsportal.com/)\n- [timezonedb](https://timezonedb.com/references/get-time-zone)\n- [REST COUNTRIES](https://restcountries.eu/)", "396004": "https://analytics.google.com/analytics/web/demoAccount", "393730": "@juliaelliott Should external data be disclosed 1 week before the competition ends, or is it just prior to the competition ending? So, like, if I find a super awesome external data source can I post it 5 minutes before the competition ends?", "396580": "I will use this (shorted link):\nhttp://bit.ly/2OVMqMd\n\nThis is the data of The International Monetary Fund - GDP (PPP) per capita by country", "402260": "I think \"Google analytics Demo Account\" should be added to list of prohibited external data sources.", "401028": "I see people posting a note about the same external data source. Please confirm that it's fine if anybody mentions a particular source, as opposed to everybody who uses it must claim to use it.", "394524": "I will be using https://simplemaps.com/data/world-cities (the free basic list) and https://gist.github.com/stasius12/f95f2999fa351212991c43a5f067c78d", "394427": "I found this helpful post which shows how to use external data within a kernel.\n\nhttps://www.kaggle.com/product-feedback/63544#latest-394426\n\n", "393714": "Are there any restrictions on this? For example, around the date ranges?", "405357": "I am using GDP external data from \n\nhttp://statisticstimes.com/economy/countries-by-projected-gdp.php\n\nhttp://statisticstimes.com/economy/countries-by-gdp-ppp.php\n\nhttps://www.imf.org/external/datamapper/NGDPD@WEO/OEMDC/ADVEC/WEOWORLD", "401268": "Do we need to mention any external libraries that we are using (which could arguably be external sources of data)?", "395557": "https://www.iana.org/time-zones\n\nhttps://www.geonames.org/", "393715": "Ah-ha! Fun little shake-up to add to the leaderboard revelation. Thanks for the clarification.", "425980": "https://www.currency-iso.org/en/home/tables/table-a1.html\nhttps://finance.yahoo.com/\nhttp://export.rbc.ru/\nhttps://www.ofx.com/en-au/forex-news/\nhttp://statisticstimes.com/economy/countries-by-projected-gdp-capita.php", "423057": "I will try Alexa Global Rank https://www.alexa.com/siteinfo", "412014": "Will try to use http://web.archive.org and store itself https://shop.googlemerchandisestore.com/", "402642": "I'm using GDP data from here: https://data.worldbank.org/indicator/NY.GDP.PCAP.PP.CD\nMissing countries were filled up with GDP values from wikipedia.", "401940": "[Worldcities][1]\n\n\n [1]: https://simplemaps.com/data/world-cities", "401357": "https://timezonedb.com/\n\nhttp://www.mapdevelopers.com/batch_geocode_tool.php", "397017": "https://www.sheffield.ac.uk/international/english-speaking-countries", "394009": "In what format the sources of external data must be posted? Just links? Or some description of datasets should be provided?", "393719": "This is great. I hope future competitions will also use this rule!", "397556": "" } }