{
  "id": 10986,
  "title": "Dealing with the data size",
  "url": "/competitions/ClaimPredictionChallenge/discussion/10986",
  "author_name": "",
  "post_date": "2014-11-20T08:48:25.467Z",
  "votes": null,
  "comment_count": 1,
  "views": 2260,
  "content": "<p>Hey guys</p>\n<p>I'm new to dealing with data of this size. When I try to run my code in R it ends and informs me there is insufficient RAM.</p>\n<p>How do you guys deal with this, besides the obvious of adding more RAM? Is there any technique that could get around this?</p>\n<p>I've tried breaking the data set into smaller sets and fitting models on each set, but R seems to store the data frames in its memory which takes me back to step 1.</p>\n<p>Thanks in advance.</p>",
  "messages": [
    {
      "id": "58500",
      "postDate": "11/20/2014 08:48:25",
      "content": "<p>Hey guys</p>\n<p>I'm new to dealing with data of this size. When I try to run my code in R it ends and informs me there is insufficient RAM.</p>\n<p>How do you guys deal with this, besides the obvious of adding more RAM? Is there any technique that could get around this?</p>\n<p>I've tried breaking the data set into smaller sets and fitting models on each set, but R seems to store the data frames in its memory which takes me back to step 1.</p>\n<p>Thanks in advance.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "225814",
      "postDate": "09/30/2017 02:48:25",
      "content": "<p>Try kaggle kernels. They provide you with 16 gb ram. It should be more than enough to start with.</p>",
      "rawMarkdown": "Try kaggle kernels. They provide you with 16 gb ram. It should be more than enough to start with.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 225814,
      "author_name": "vishnus",
      "author_url": "",
      "post_date": "09/30/2017 02:48:25",
      "content": "<p>Try kaggle kernels. They provide you with 16 gb ram. It should be more than enough to start with.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "58500": "",
    "225814": "Try kaggle kernels. They provide you with 16 gb ram. It should be more than enough to start with."
  },
  "source": "meta"
}