{
  "id": 10958,
  "title": "Importing data into R/RStudio",
  "url": "/competitions/avazu-ctr-prediction/discussion/10958",
  "author_name": "",
  "post_date": "2014-11-18T23:18:26.730Z",
  "votes": null,
  "comment_count": 4,
  "views": 2009,
  "content": "<p>I'm a novice R user, and have never used a data set as big as this train set. I've attempted to import the train data into RStudio with no success. To the Kagglers- any solutions?</p>\n\n<p>Computer Specs</p>\n<p>MacBook Pro (Early&nbsp;2011)</p>\n<p>Intel i7 2.0 GHz</p>\n<p>4GB RAM</p>\n<p>1TB HDD @ 7200 rpm</p>",
  "messages": [
    {
      "id": "58354",
      "postDate": "11/18/2014 23:18:26",
      "content": "<p>I'm a novice R user, and have never used a data set as big as this train set. I've attempted to import the train data into RStudio with no success. To the Kagglers- any solutions?</p>\n\n<p>Computer Specs</p>\n<p>MacBook Pro (Early&nbsp;2011)</p>\n<p>Intel i7 2.0 GHz</p>\n<p>4GB RAM</p>\n<p>1TB HDD @ 7200 rpm</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "58356",
      "postDate": "11/18/2014 23:51:32",
      "content": "<p>4 GB is not enough as the file is bigger than that. I usually use library(data.table) and the function fread (I have 16GB mac)</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "58365",
      "postDate": "11/19/2014 03:49:47",
      "content": "<p>[quote=ACS69;58356]</p>\n<p>4 GB is not enough as the file is bigger than that. I usually use library(data.table) and the function fread (I have 16GB mac)</p>\n<p>[/quote]</p>\n<p>Thanks for the heads up!</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "58367",
      "postDate": "11/19/2014 03:57:16",
      "content": "<p>Data size is increasing, and the hardware requirement is increasing as well. 4GB memory is barely enough for most of the competitions.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "58382",
      "postDate": "11/19/2014 08:34:09",
      "content": "<p>[quote=gregchase;58354]</p>\n<p>To the Kagglers- any solutions?</p>\n<p>[/quote]</p>\n\n<p>You still have some options, either by using a subset of the data or working with it outside of RAM. See this thread:</p>\n<p><a href=\"http://www.kaggle.com/c/avazu-ctr-prediction/forums/t/10783/reading-training-data-in-r\">http://www.kaggle.com/c/avazu-ctr-prediction/forums/t/10783/reading-training-data-in-r</a></p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 58356,
      "author_name": "domcastro",
      "author_url": "",
      "post_date": "11/18/2014 23:51:32",
      "content": "<p>4 GB is not enough as the file is bigger than that. I usually use library(data.table) and the function fread (I have 16GB mac)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 58365,
      "author_name": "gregchase",
      "author_url": "",
      "post_date": "11/19/2014 03:49:47",
      "content": "<p>[quote=ACS69;58356]</p>\n<p>4 GB is not enough as the file is bigger than that. I usually use library(data.table) and the function fread (I have 16GB mac)</p>\n<p>[/quote]</p>\n<p>Thanks for the heads up!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 58367,
      "author_name": "simengy82",
      "author_url": "",
      "post_date": "11/19/2014 03:57:16",
      "content": "<p>Data size is increasing, and the hardware requirement is increasing as well. 4GB memory is barely enough for most of the competitions.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 58382,
      "author_name": "cartographic",
      "author_url": "",
      "post_date": "11/19/2014 08:34:09",
      "content": "<p>[quote=gregchase;58354]</p>\n<p>To the Kagglers- any solutions?</p>\n<p>[/quote]</p>\n\n<p>You still have some options, either by using a subset of the data or working with it outside of RAM. See this thread:</p>\n<p><a href=\"http://www.kaggle.com/c/avazu-ctr-prediction/forums/t/10783/reading-training-data-in-r\">http://www.kaggle.com/c/avazu-ctr-prediction/forums/t/10783/reading-training-data-in-r</a></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "58354": "",
    "58356": "",
    "58365": "",
    "58367": "",
    "58382": ""
  },
  "source": "meta"
}