{
  "id": 8246,
  "title": "how to download big transactions.csv?",
  "url": "/competitions/acquire-valued-shoppers-challenge/discussion/8246",
  "author_name": "",
  "post_date": "2014-05-21T18:22:06.430Z",
  "votes": null,
  "comment_count": 5,
  "views": 2485,
  "content": "<p>All,</p>\n<p>I have tried three times, it downloads till ~2.5 GB, then breaks. I am not able to download. Any suggestions about how to go about this?</p>",
  "messages": [
    {
      "id": "46010",
      "postDate": "05/21/2014 18:22:06",
      "content": "<p>All,</p>\n<p>I have tried three times, it downloads till ~2.5 GB, then breaks. I am not able to download. Any suggestions about how to go about this?</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "46011",
      "postDate": "05/21/2014 18:25:40",
      "content": "<p>Are you using a modern browser? It should resume even if the download interrupts.</p>\n<p>This is an unofficial, unsupported hack if all else fails:&nbsp;https://www.kaggle.com/forums/t/6604/downloading-data-via-command-line</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "46014",
      "postDate": "05/21/2014 20:15:44",
      "content": "<p>See also:&nbsp;http://www.kaggle.com/c/decoding-the-human-brain/forums/t/7803/tips-for-downloading-the-data/42610</p>\n<p>[quote=Triskelion;42610]</p>\n<p>If you get network errors or have a slow/unreliable connection you can download (and resume for up to 3 days) the data with Firefox and the DownThemAll add-on.</p>\n<p>Download&nbsp;<a href=\"http://www.mozilla.org/\">Firefox</a><br>Download and install&nbsp;<a href=\"https://addons.mozilla.org/nl/firefox/addon/downthemall/\">DownThemAll</a><br>Go to the&nbsp;data page and click on &quot;random_submission&quot;. Accept the rules. Then right-click a link to a large file, select &quot;Save link with DownThemAll!&quot;.<br>In <a href=\"http://kaggle.com/c/yandex-personalized-web-search-challenge/forums/t/6060/download-data\">this thread</a>&nbsp;you'll find other methods such as exporting cookies and fetching data with wget.</p>\n<p>(Thanks to user Emilio G. Ortiz-Garc&#237;a&nbsp;and&nbsp;Parthiban Gowthaman).</p>\n<p>[/quote]</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "46020",
      "postDate": "05/21/2014 21:19:13",
      "content": "<p>That hack is old school. Try the following in Chrome:</p>\n<p>1. Nav to download page.</p>\n<p>2. Open up Developer Tools (Opt-Cmd-I on mac)</p>\n<p>3. Click &quot;Network&quot; Tab.</p>\n<p>4. Up on the kaggle download page, click on the link you want to download.</p>\n<p>5. In the Developer Console, R click on the row corresponding to the file you clicked in step 4. (at this point, you can cancel the download process in your browser if you want.</p>\n<p>6. choose &quot;Copy as cUrl&quot;.&nbsp;This will give you the curl command to get the file, complete with all necessary cookies for oAuth, etc.</p>\n<p>7. Paste to your Shell command prompt and hit enter.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "46034",
      "postDate": "05/22/2014 05:32:05",
      "content": "<p>All, I could download the file. Thanks for the responses.</p>\n<p>I ended up using another connection, I tried on IE 10.0.</p>\n<p>Thanks.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "116230",
      "postDate": "04/22/2016 15:53:20",
      "content": "<p>mark</p>",
      "rawMarkdown": "mark",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 46011,
      "author_name": "wcukierski",
      "author_url": "",
      "post_date": "05/21/2014 18:25:40",
      "content": "<p>Are you using a modern browser? It should resume even if the download interrupts.</p>\n<p>This is an unofficial, unsupported hack if all else fails:&nbsp;https://www.kaggle.com/forums/t/6604/downloading-data-via-command-line</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 46014,
      "author_name": "triskelion",
      "author_url": "",
      "post_date": "05/21/2014 20:15:44",
      "content": "<p>See also:&nbsp;http://www.kaggle.com/c/decoding-the-human-brain/forums/t/7803/tips-for-downloading-the-data/42610</p>\n<p>[quote=Triskelion;42610]</p>\n<p>If you get network errors or have a slow/unreliable connection you can download (and resume for up to 3 days) the data with Firefox and the DownThemAll add-on.</p>\n<p>Download&nbsp;<a href=\"http://www.mozilla.org/\">Firefox</a><br>Download and install&nbsp;<a href=\"https://addons.mozilla.org/nl/firefox/addon/downthemall/\">DownThemAll</a><br>Go to the&nbsp;data page and click on &quot;random_submission&quot;. Accept the rules. Then right-click a link to a large file, select &quot;Save link with DownThemAll!&quot;.<br>In <a href=\"http://kaggle.com/c/yandex-personalized-web-search-challenge/forums/t/6060/download-data\">this thread</a>&nbsp;you'll find other methods such as exporting cookies and fetching data with wget.</p>\n<p>(Thanks to user Emilio G. Ortiz-Garc&#237;a&nbsp;and&nbsp;Parthiban Gowthaman).</p>\n<p>[/quote]</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 46020,
      "author_name": "davidmsmith",
      "author_url": "",
      "post_date": "05/21/2014 21:19:13",
      "content": "<p>That hack is old school. Try the following in Chrome:</p>\n<p>1. Nav to download page.</p>\n<p>2. Open up Developer Tools (Opt-Cmd-I on mac)</p>\n<p>3. Click &quot;Network&quot; Tab.</p>\n<p>4. Up on the kaggle download page, click on the link you want to download.</p>\n<p>5. In the Developer Console, R click on the row corresponding to the file you clicked in step 4. (at this point, you can cancel the download process in your browser if you want.</p>\n<p>6. choose &quot;Copy as cUrl&quot;.&nbsp;This will give you the curl command to get the file, complete with all necessary cookies for oAuth, etc.</p>\n<p>7. Paste to your Shell command prompt and hit enter.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 46034,
      "author_name": "dataion",
      "author_url": "",
      "post_date": "05/22/2014 05:32:05",
      "content": "<p>All, I could download the file. Thanks for the responses.</p>\n<p>I ended up using another connection, I tried on IE 10.0.</p>\n<p>Thanks.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 116230,
      "author_name": "leyue260351",
      "author_url": "",
      "post_date": "04/22/2016 15:53:20",
      "content": "<p>mark</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "46010": "",
    "46011": "",
    "46014": "",
    "46020": "",
    "46034": "",
    "116230": "mark"
  },
  "source": "meta"
}