You have available the list of tweet IDs and a script that you can use to download the tweets. The script downloads the raw HTML data, you will still need to extract the tweet information from the downloaded data.
Copyright restrictions from Twitter does not allow us to distribute the contents of the tweets, that's why we are providing the IDs and a script to download the tweets. The script incorporates a "sleep" instruction to avoid sending all requests at once, so allow several hours to download the tweets. Alternatively you may want to register to Twitter Developers and use their API to download the tweets.
There is a training set and a test set. The training set contains 2000 tweets sorted in time, together with the location mentions. The format of this file is exactly the same as the format of the submission file. The test set contains just over 1000 tweets sorted in time, this time without the location mentions. Your task is to find the location mentions of this test set and submit the results to Kaggle in Class. The timestamp of the tweets of the test set are after those of the training set, to model a realistic scenario where we train on known tweets and we want to predict the location mentions in future tweets.
File descriptions