{
  "id": 23242,
  "title": "The dataset is so big that...",
  "url": "/competitions/bosch-production-line-performance/discussion/23242",
  "author_name": "",
  "post_date": "2016-09-01T06:57:15.027Z",
  "votes": 1,
  "comment_count": 3,
  "views": 1343,
  "content": "<pre><code>train[is.na(train)]    &lt;- 0 \n</code></pre>\n\n<p>doesn't work* but  double negation </p>\n\n<pre><code>train[!(!(is.na(train)))]    &lt;- 0\n</code></pre>\n\n<p>works fine</p>\n\n<p>*) error, Scientific Linux 7.2, R version 3.3.1, 160GB RAM, train=numeric+categorical</p>",
  "messages": [
    {
      "id": "133271",
      "postDate": "09/01/2016 06:57:15",
      "content": "<pre><code>train[is.na(train)]    &lt;- 0 \n</code></pre>\n\n<p>doesn't work* but  double negation </p>\n\n<pre><code>train[!(!(is.na(train)))]    &lt;- 0\n</code></pre>\n\n<p>works fine</p>\n\n<p>*) error, Scientific Linux 7.2, R version 3.3.1, 160GB RAM, train=numeric+categorical</p>",
      "rawMarkdown": "train[is.na(train)]    <- 0 \r\n\r\ndoesn't work* but  double negation \r\n\r\n    train[!(!(is.na(train)))]    <- 0\r\n\r\nworks fine\r\n\r\n*) error, Scientific Linux 7.2, R version 3.3.1, 160GB RAM, train=numeric+categorical",
      "votes": null
    },
    {
      "id": "133293",
      "postDate": "09/01/2016 11:11:26",
      "content": "<p>Hi Grzegorz Sionkowski,</p>\n\n<p>I can't understant why this occured.<br>\nDoes double negation have better characteristics ?</p>",
      "rawMarkdown": "Hi Grzegorz Sionkowski,\r\n\r\nI can't understant why this occured.<br>\r\nDoes double negation have better characteristics ?",
      "votes": null
    },
    {
      "id": "133307",
      "postDate": "09/01/2016 13:03:37",
      "content": "<p>There is an  error connected with the size of integer (size of list?) used in this operation. I suppose it is too small to determine the positions of all NA in the dataset but big enough to determine the positions of  available values (first negation) .  The second negation probably points to set 0 everywhere but the places where the values are available, not everywhere where the values are not available as in the first case. Of course, the same effect may be obtained in other ways (working with smaller datasets), but they are not so intriguing as the one described above.</p>",
      "rawMarkdown": "There is an  error connected with the size of integer (size of list?) used in this operation. I suppose it is too small to determine the positions of all NA in the dataset but big enough to determine the positions of  available values (first negation) .  The second negation probably points to set 0 everywhere but the places where the values are available, not everywhere where the values are not available as in the first case. Of course, the same effect may be obtained in other ways (working with smaller datasets), but they are not so intriguing as the one described above.",
      "votes": null
    },
    {
      "id": "133402",
      "postDate": "09/01/2016 21:57:33",
      "content": "<p>First of all, a list is a vector so it can contain at most 2^32-1 number i.e. 4,294,967,296.<a href=\"http://stackoverflow.com/questions/8594814/what-are-the-differences-between-r-vector-and-r-list-data-types\">A list is a vector</a></p>\n\n<p>the biggest table has less than 1,200,000 rows and also less than 2300 columns if all the cells are &quot;na&quot; the  size would be 1200000* 2300 = 2,760,000,000 at most so it is not the case.\nI also dont knnow the right answer but it may be the maximum RAM space available to R no the machine.</p>",
      "rawMarkdown": "First of all, a list is a vector so it can contain at most 2^32-1 number i.e. 4,294,967,296.[A list is a vector][1]\r\n\r\nthe biggest table has less than 1,200,000 rows and also less than 2300 columns if all the cells are \"na\" the  size would be 1200000* 2300 = 2,760,000,000 at most so it is not the case.\r\nI also dont knnow the right answer but it may be the maximum RAM space available to R no the machine.\r\n  [1]: http://stackoverflow.com/questions/8594814/what-are-the-differences-between-r-vector-and-r-list-data-types",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 133293,
      "author_name": "toshik",
      "author_url": "",
      "post_date": "09/01/2016 11:11:26",
      "content": "<p>Hi Grzegorz Sionkowski,</p>\n\n<p>I can't understant why this occured.<br>\nDoes double negation have better characteristics ?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 133307,
      "author_name": "sionek",
      "author_url": "",
      "post_date": "09/01/2016 13:03:37",
      "content": "<p>There is an  error connected with the size of integer (size of list?) used in this operation. I suppose it is too small to determine the positions of all NA in the dataset but big enough to determine the positions of  available values (first negation) .  The second negation probably points to set 0 everywhere but the places where the values are available, not everywhere where the values are not available as in the first case. Of course, the same effect may be obtained in other ways (working with smaller datasets), but they are not so intriguing as the one described above.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 133402,
      "author_name": "afshinamiri",
      "author_url": "",
      "post_date": "09/01/2016 21:57:33",
      "content": "<p>First of all, a list is a vector so it can contain at most 2^32-1 number i.e. 4,294,967,296.<a href=\"http://stackoverflow.com/questions/8594814/what-are-the-differences-between-r-vector-and-r-list-data-types\">A list is a vector</a></p>\n\n<p>the biggest table has less than 1,200,000 rows and also less than 2300 columns if all the cells are &quot;na&quot; the  size would be 1200000* 2300 = 2,760,000,000 at most so it is not the case.\nI also dont knnow the right answer but it may be the maximum RAM space available to R no the machine.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "133271": "train[is.na(train)]    <- 0 \r\n\r\ndoesn't work* but  double negation \r\n\r\n    train[!(!(is.na(train)))]    <- 0\r\n\r\nworks fine\r\n\r\n*) error, Scientific Linux 7.2, R version 3.3.1, 160GB RAM, train=numeric+categorical",
    "133293": "Hi Grzegorz Sionkowski,\r\n\r\nI can't understant why this occured.<br>\r\nDoes double negation have better characteristics ?",
    "133307": "There is an  error connected with the size of integer (size of list?) used in this operation. I suppose it is too small to determine the positions of all NA in the dataset but big enough to determine the positions of  available values (first negation) .  The second negation probably points to set 0 everywhere but the places where the values are available, not everywhere where the values are not available as in the first case. Of course, the same effect may be obtained in other ways (working with smaller datasets), but they are not so intriguing as the one described above.",
    "133402": "First of all, a list is a vector so it can contain at most 2^32-1 number i.e. 4,294,967,296.[A list is a vector][1]\r\n\r\nthe biggest table has less than 1,200,000 rows and also less than 2300 columns if all the cells are \"na\" the  size would be 1200000* 2300 = 2,760,000,000 at most so it is not the case.\r\nI also dont knnow the right answer but it may be the maximum RAM space available to R no the machine.\r\n  [1]: http://stackoverflow.com/questions/8594814/what-are-the-differences-between-r-vector-and-r-list-data-types"
  },
  "source": "meta"
}