{
  "id": 302550,
  "title": "Memory Error",
  "url": "/competitions/g-research-crypto-forecasting/discussion/302550",
  "author_name": "",
  "post_date": "2022-01-23T04:28:04.861160700Z",
  "votes": 1,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi Kagglers.</p>\n<p>Every time I try to work on the datasets we are provided with in this competition, I get this message,** 'Your notebook tried to allocate more memory than is available. It has restarted'**. What should I do to fix this?</p>\n<p>Thanks.</p>",
  "messages": [
    {
      "id": "1660891",
      "postDate": "01/23/2022 04:28:04",
      "content": "<p>Hi Kagglers.</p>\n<p>Every time I try to work on the datasets we are provided with in this competition, I get this message,** 'Your notebook tried to allocate more memory than is available. It has restarted'**. What should I do to fix this?</p>\n<p>Thanks.</p>",
      "rawMarkdown": "Hi Kagglers.\n\nEvery time I try to work on the datasets we are provided with in this competition, I get this message,** 'Your notebook tried to allocate more memory than is available. It has restarted'**. What should I do to fix this?\n\nThanks.",
      "votes": null
    },
    {
      "id": "1661282",
      "postDate": "01/23/2022 10:53:34",
      "content": "<ul>\n<li>avoid copying your data. Only keep one variable with the data.</li>\n<li>use less memory intensive datatypes. like 32bit floats instead of double precision</li>\n</ul>",
      "rawMarkdown": "avoid copying your data. Only keep one variable with the data.\n- use less memory intensive datatypes. like 32bit floats instead of double precision",
      "votes": null
    },
    {
      "id": "1661581",
      "postDate": "01/23/2022 14:42:07",
      "content": "<p>Thanks. However, it seems I don't fully understand what you said.</p>\n<p>(1) What do you mean by keeping one variable with the data? I may want to carry out feature engineering on the data. This means I will need to SEE what is going on every step of the way. Is this what you mean when you say I should not copy the data?</p>\n<p>(2) How can I use 32 bits? I don't know how to go about this.</p>",
      "rawMarkdown": "Thanks. However, it seems I don't fully understand what you said.\n\n(1) What do you mean by keeping one variable with the data? I may want to carry out feature engineering on the data. This means I will need to SEE what is going on every step of the way. Is this what you mean when you say I should not copy the data?\n\n(2) How can I use 32 bits? I don't know how to go about this.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1661282,
      "author_name": "peterpapa",
      "author_url": "",
      "post_date": "01/23/2022 10:53:34",
      "content": "<ul>\n<li>avoid copying your data. Only keep one variable with the data.</li>\n<li>use less memory intensive datatypes. like 32bit floats instead of double precision</li>\n</ul>",
      "votes": null,
      "replies": [
        {
          "id": 1661581,
          "author_name": "zammie",
          "author_url": "",
          "post_date": "01/23/2022 14:42:07",
          "content": "<p>Thanks. However, it seems I don't fully understand what you said.</p>\n<p>(1) What do you mean by keeping one variable with the data? I may want to carry out feature engineering on the data. This means I will need to SEE what is going on every step of the way. Is this what you mean when you say I should not copy the data?</p>\n<p>(2) How can I use 32 bits? I don't know how to go about this.</p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "1660891": "Hi Kagglers.\n\nEvery time I try to work on the datasets we are provided with in this competition, I get this message,** 'Your notebook tried to allocate more memory than is available. It has restarted'**. What should I do to fix this?\n\nThanks.",
    "1661282": "avoid copying your data. Only keep one variable with the data.\n- use less memory intensive datatypes. like 32bit floats instead of double precision",
    "1661581": "Thanks. However, it seems I don't fully understand what you said.\n\n(1) What do you mean by keeping one variable with the data? I may want to carry out feature engineering on the data. This means I will need to SEE what is going on every step of the way. Is this what you mean when you say I should not copy the data?\n\n(2) How can I use 32 bits? I don't know how to go about this."
  },
  "source": "meta"
}