{
  "id": 6812,
  "title": "Submitting directly from remote server (AWS or similar)",
  "url": "/competitions/galaxy-zoo-the-galaxy-challenge/discussion/6812",
  "author_name": "",
  "post_date": "2014-01-11T15:58:29.183Z",
  "votes": null,
  "comment_count": 3,
  "views": 1821,
  "content": "<p>Wondering if anyone has figured out a way to upload submissions directly from a remote server, skipping the step of downloading to local machine, then uploading to kaggle.</p>\n<p>On a similar note, it would be nice to be able to download data directly to a compute server using wget or similar. Is there a way to pass your user credentials to kaggle so that you can download the data programatically?</p>",
  "messages": [
    {
      "id": "37283",
      "postDate": "01/11/2014 15:58:29",
      "content": "<p>Wondering if anyone has figured out a way to upload submissions directly from a remote server, skipping the step of downloading to local machine, then uploading to kaggle.</p>\n<p>On a similar note, it would be nice to be able to download data directly to a compute server using wget or similar. Is there a way to pass your user credentials to kaggle so that you can download the data programatically?</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "37284",
      "postDate": "01/11/2014 17:08:19",
      "content": "<p>Try with lynx, i did not try it, but probably this might work when you go to the static login site (the one you reach after failing the first login on a normal browser) and than you probaly need to use the direct url for the submission. I usualy zip the submission on the server and download it via ssh, thid is quite convient.</p>\n<p>For the second you start the download in chrome, than you get a redirect to and the file starts downloading. You can use this url on your server (at least for limited time) with wget. You probaly need to quote the url with &quot;.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "37367",
      "postDate": "01/14/2014 08:14:04",
      "content": "<p>you may have a micro instance setup with VNC and install Chrome/FF. Use this machine as your gateway to Kaggle web interface to download from / upload to Kaggle. You can scp files to/from the worker machines.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "37368",
      "postDate": "01/14/2014 09:09:26",
      "content": "<p>[quote=Corey Chivers;37283]</p>\n<p><span style=\"line-height: 1.4\">On a similar note, it would be nice to be able to download data directly to a compute server using wget or similar. Is there a way to pass your user credentials to kaggle so that you can download the data programatically?</span></p>\n<p>[/quote]</p>\n<p>I haven't tried it yet but I have found some tips to do it in another thread:</p>\n<p>http://www.kaggle.com/forums/t/6604/downloading-data-via-command-line</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 37284,
      "author_name": "leobuettiker",
      "author_url": "",
      "post_date": "01/11/2014 17:08:19",
      "content": "<p>Try with lynx, i did not try it, but probably this might work when you go to the static login site (the one you reach after failing the first login on a normal browser) and than you probaly need to use the direct url for the submission. I usualy zip the submission on the server and download it via ssh, thid is quite convient.</p>\n<p>For the second you start the download in chrome, than you get a redirect to and the file starts downloading. You can use this url on your server (at least for limited time) with wget. You probaly need to quote the url with &quot;.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 37367,
      "author_name": "naishe",
      "author_url": "",
      "post_date": "01/14/2014 08:14:04",
      "content": "<p>you may have a micro instance setup with VNC and install Chrome/FF. Use this machine as your gateway to Kaggle web interface to download from / upload to Kaggle. You can scp files to/from the worker machines.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 37368,
      "author_name": "gaborfodor",
      "author_url": "",
      "post_date": "01/14/2014 09:09:26",
      "content": "<p>[quote=Corey Chivers;37283]</p>\n<p><span style=\"line-height: 1.4\">On a similar note, it would be nice to be able to download data directly to a compute server using wget or similar. Is there a way to pass your user credentials to kaggle so that you can download the data programatically?</span></p>\n<p>[/quote]</p>\n<p>I haven't tried it yet but I have found some tips to do it in another thread:</p>\n<p>http://www.kaggle.com/forums/t/6604/downloading-data-via-command-line</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "37283": "",
    "37284": "",
    "37367": "",
    "37368": ""
  },
  "source": "meta"
}