How is it that my latest 13inch Macbook pro with 8gb of RAM is able to read and do manipulations like creating calculated columns on the 3.2gb train set flawlessly,\nbut,\nmy windows 64 bit machine (dell latitude 7440) with 12gb of ram \n1. cannot even read the train file using read.csv?\n2. reads the file using fread of data.table package in 2~3 minutes, yet cannot do calculations and hangs the system down causing me to force stop the process and thus losing the progress?
\n\nIs R for Win that different from R for Mac?
", "messages": [ { "id": "127036", "postDate": "07/13/2016 04:50:56", "content": "How is it that my latest 13inch Macbook pro with 8gb of RAM is able to read and do manipulations like creating calculated columns on the 3.2gb train set flawlessly,\nbut,\nmy windows 64 bit machine (dell latitude 7440) with 12gb of ram \n1. cannot even read the train file using read.csv?\n2. reads the file using fread of data.table package in 2~3 minutes, yet cannot do calculations and hangs the system down causing me to force stop the process and thus losing the progress?
\n\nIs R for Win that different from R for Mac?
", "rawMarkdown": "How is it that my latest 13inch Macbook pro with 8gb of RAM is able to read and do manipulations like creating calculated columns on the 3.2gb train set flawlessly,\r\nbut,\r\nmy windows 64 bit machine (dell latitude 7440) with 12gb of ram \r\n1. cannot even read the train file using read.csv?\r\n2. reads the file using fread of data.table package in 2~3 minutes, yet cannot do calculations and hangs the system down causing me to force stop the process and thus losing the progress?\r\n\r\nIs R for Win that different from R for Mac?", "votes": null }, { "id": "127099", "postDate": "07/13/2016 11:03:40", "content": "32 bit rather than 64 bit ?
", "rawMarkdown": "32 bit rather than 64 bit ?", "votes": null }, { "id": "127132", "postDate": "07/13/2016 12:59:01", "content": "Both Macbook Pro and Dell Latitude are 64 bit machines running latest R versions.
", "rawMarkdown": "Both Macbook Pro and Dell Latitude are 64 bit machines running latest R versions.", "votes": null }, { "id": "127138", "postDate": "07/13/2016 13:23:47", "content": "The only other thing I can think of is that the memory footprint of windows is much bigger than mac os
\n\nI know on the latest (worse?) versions of windows it can have a tendency to eat up the memory over time - do you have the problem after reboot?
\n\nAre you using data tables?
", "rawMarkdown": "The only other thing I can think of is that the memory footprint of windows is much bigger than mac os\r\n\r\nI know on the latest (worse?) versions of windows it can have a tendency to eat up the memory over time - do you have the problem after reboot?\r\n\r\nAre you using [data tables?][1]\r\n\r\n\r\n [1]: http://www.r-bloggers.com/reading-large-data-tables-in-r/", "votes": null }, { "id": "127142", "postDate": "07/13/2016 13:29:34", "content": "Yes, the problem stays after reboot.\nYes, I am using the data.tables.\nThis is more of a surprise than a hindrance as I am using macbook now for analysis.\nI asked this question out of curiosity and if the same issue is being seen by other users as well.\nDon't know why it has been down voted by someone.
", "rawMarkdown": "Yes, the problem stays after reboot.\r\nYes, I am using the data.tables.\r\nThis is more of a surprise than a hindrance as I am using macbook now for analysis.\r\nI asked this question out of curiosity and if the same issue is being seen by other users as well.\r\nDon't know why it has been down voted by someone.", "votes": null }, { "id": "127147", "postDate": "07/13/2016 13:52:11", "content": "It seems a reasonable question so I up voted you! Perhaps the brave soul who down voted you could actually explain why they have a problem with the question.
", "rawMarkdown": "It seems a reasonable question so I up voted you! Perhaps the brave soul who down voted you could actually explain why they have a problem with the question.", "votes": null }, { "id": "127565", "postDate": "07/14/2016 15:10:05", "content": "my laptop has 8 GB of ram (windows) but SSD drive and can do many things my desktop 16 GB of ram cannot. (using Python but if the mac has SSD that could be the difference). I also jacked up my page file (virtual memory) and it seems to help. (would only help if you are using SSD).
", "rawMarkdown": "my laptop has 8 GB of ram (windows) but SSD drive and can do many things my desktop 16 GB of ram cannot. (using Python but if the mac has SSD that could be the difference). I also jacked up my page file (virtual memory) and it seems to help. (would only help if you are using SSD).", "votes": null }, { "id": "127591", "postDate": "07/14/2016 16:30:30", "content": "Mac have really amazing memory management. I personally started noticing this difference around the time Mavericks came out. If I open "Activity Monitor" and look at RAM used, I've seen it get as high as 50GB with "Memory Pressure" still in the green zone.
\n\nYou can read more about the memory management stuff apple does here: http://arstechnica.com/apple/2013/10/os-x-10-9/17/
", "rawMarkdown": "Mac have really amazing memory management. I personally started noticing this difference around the time Mavericks came out. If I open \"Activity Monitor\" and look at RAM used, I've seen it get as high as 50GB with \"Memory Pressure\" still in the green zone.\r\n\r\nYou can read more about the memory management stuff apple does here: http://arstechnica.com/apple/2013/10/os-x-10-9/17/", "votes": null }, { "id": "127654", "postDate": "07/14/2016 20:15:28", "content": "From what I'm reading, the Macbook pro uses PCI-e flash storage which is at least 2x as fast as most external SSDs. You're likely using the whole 8GB of RAM and swapping a whole lot more but the local storage is fast enough to keep your system responsive regardless.
", "rawMarkdown": "From what I'm reading, the Macbook pro uses PCI-e flash storage which is at least 2x as fast as most external SSDs. You're likely using the whole 8GB of RAM and swapping a whole lot more but the local storage is fast enough to keep your system responsive regardless.", "votes": null }, { "id": "127791", "postDate": "07/15/2016 11:33:33", "content": "All very insightful points, I must say.\nI guess the below three factors make or break a machine so far as its data analyzing ability is concerned:\n1. Amount of RAM\n2. Speed of processor\n3. Read/ Write speeds or access speeds from disk.
\n\nWhile a lot of emphasis has been laid on the amount of RAM a system has (R loads the entire dump in memory, uses only 1 core), users tend to ignore how important access speed from HDD (or SSD) can be.
\n\nAn expert can build a good UNIX based system by himself/ herself by assembling the parts at much lesser price. MacBook Pro does that job of fantastic fusion of all three above and maybe many more such features for novices like me.
", "rawMarkdown": "All very insightful points, I must say.\r\nI guess the below three factors make or break a machine so far as its data analyzing ability is concerned:\r\n1. Amount of RAM\r\n2. Speed of processor\r\n3. Read/ Write speeds or access speeds from disk.\r\n\r\nWhile a lot of emphasis has been laid on the amount of RAM a system has (R loads the entire dump in memory, uses only 1 core), users tend to ignore how important access speed from HDD (or SSD) can be.\r\n\r\nAn expert can build a good UNIX based system by himself/ herself by assembling the parts at much lesser price. MacBook Pro does that job of fantastic fusion of all three above and maybe many more such features for novices like me.", "votes": null } ], "comments": [ { "id": 127099, "author_name": "scirpus", "author_url": "", "post_date": "07/13/2016 11:03:40", "content": "32 bit rather than 64 bit ?
", "votes": null, "replies": [] }, { "id": 127132, "author_name": "singhn9", "author_url": "", "post_date": "07/13/2016 12:59:01", "content": "Both Macbook Pro and Dell Latitude are 64 bit machines running latest R versions.
", "votes": null, "replies": [] }, { "id": 127138, "author_name": "scirpus", "author_url": "", "post_date": "07/13/2016 13:23:47", "content": "The only other thing I can think of is that the memory footprint of windows is much bigger than mac os
\n\nI know on the latest (worse?) versions of windows it can have a tendency to eat up the memory over time - do you have the problem after reboot?
\n\nAre you using data tables?
", "votes": null, "replies": [] }, { "id": 127142, "author_name": "singhn9", "author_url": "", "post_date": "07/13/2016 13:29:34", "content": "Yes, the problem stays after reboot.\nYes, I am using the data.tables.\nThis is more of a surprise than a hindrance as I am using macbook now for analysis.\nI asked this question out of curiosity and if the same issue is being seen by other users as well.\nDon't know why it has been down voted by someone.
", "votes": null, "replies": [] }, { "id": 127147, "author_name": "scirpus", "author_url": "", "post_date": "07/13/2016 13:52:11", "content": "It seems a reasonable question so I up voted you! Perhaps the brave soul who down voted you could actually explain why they have a problem with the question.
", "votes": null, "replies": [] }, { "id": 127565, "author_name": "bengalstro", "author_url": "", "post_date": "07/14/2016 15:10:05", "content": "my laptop has 8 GB of ram (windows) but SSD drive and can do many things my desktop 16 GB of ram cannot. (using Python but if the mac has SSD that could be the difference). I also jacked up my page file (virtual memory) and it seems to help. (would only help if you are using SSD).
", "votes": null, "replies": [] }, { "id": 127591, "author_name": "zachmayer", "author_url": "", "post_date": "07/14/2016 16:30:30", "content": "Mac have really amazing memory management. I personally started noticing this difference around the time Mavericks came out. If I open "Activity Monitor" and look at RAM used, I've seen it get as high as 50GB with "Memory Pressure" still in the green zone.
\n\nYou can read more about the memory management stuff apple does here: http://arstechnica.com/apple/2013/10/os-x-10-9/17/
", "votes": null, "replies": [] }, { "id": 127654, "author_name": "deltarho", "author_url": "", "post_date": "07/14/2016 20:15:28", "content": "From what I'm reading, the Macbook pro uses PCI-e flash storage which is at least 2x as fast as most external SSDs. You're likely using the whole 8GB of RAM and swapping a whole lot more but the local storage is fast enough to keep your system responsive regardless.
", "votes": null, "replies": [] }, { "id": 127791, "author_name": "singhn9", "author_url": "", "post_date": "07/15/2016 11:33:33", "content": "All very insightful points, I must say.\nI guess the below three factors make or break a machine so far as its data analyzing ability is concerned:\n1. Amount of RAM\n2. Speed of processor\n3. Read/ Write speeds or access speeds from disk.
\n\nWhile a lot of emphasis has been laid on the amount of RAM a system has (R loads the entire dump in memory, uses only 1 core), users tend to ignore how important access speed from HDD (or SSD) can be.
\n\nAn expert can build a good UNIX based system by himself/ herself by assembling the parts at much lesser price. MacBook Pro does that job of fantastic fusion of all three above and maybe many more such features for novices like me.
", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "127036": "How is it that my latest 13inch Macbook pro with 8gb of RAM is able to read and do manipulations like creating calculated columns on the 3.2gb train set flawlessly,\r\nbut,\r\nmy windows 64 bit machine (dell latitude 7440) with 12gb of ram \r\n1. cannot even read the train file using read.csv?\r\n2. reads the file using fread of data.table package in 2~3 minutes, yet cannot do calculations and hangs the system down causing me to force stop the process and thus losing the progress?\r\n\r\nIs R for Win that different from R for Mac?", "127099": "32 bit rather than 64 bit ?", "127132": "Both Macbook Pro and Dell Latitude are 64 bit machines running latest R versions.", "127138": "The only other thing I can think of is that the memory footprint of windows is much bigger than mac os\r\n\r\nI know on the latest (worse?) versions of windows it can have a tendency to eat up the memory over time - do you have the problem after reboot?\r\n\r\nAre you using [data tables?][1]\r\n\r\n\r\n [1]: http://www.r-bloggers.com/reading-large-data-tables-in-r/", "127142": "Yes, the problem stays after reboot.\r\nYes, I am using the data.tables.\r\nThis is more of a surprise than a hindrance as I am using macbook now for analysis.\r\nI asked this question out of curiosity and if the same issue is being seen by other users as well.\r\nDon't know why it has been down voted by someone.", "127147": "It seems a reasonable question so I up voted you! Perhaps the brave soul who down voted you could actually explain why they have a problem with the question.", "127565": "my laptop has 8 GB of ram (windows) but SSD drive and can do many things my desktop 16 GB of ram cannot. (using Python but if the mac has SSD that could be the difference). I also jacked up my page file (virtual memory) and it seems to help. (would only help if you are using SSD).", "127591": "Mac have really amazing memory management. I personally started noticing this difference around the time Mavericks came out. If I open \"Activity Monitor\" and look at RAM used, I've seen it get as high as 50GB with \"Memory Pressure\" still in the green zone.\r\n\r\nYou can read more about the memory management stuff apple does here: http://arstechnica.com/apple/2013/10/os-x-10-9/17/", "127654": "From what I'm reading, the Macbook pro uses PCI-e flash storage which is at least 2x as fast as most external SSDs. You're likely using the whole 8GB of RAM and swapping a whole lot more but the local storage is fast enough to keep your system responsive regardless.", "127791": "All very insightful points, I must say.\r\nI guess the below three factors make or break a machine so far as its data analyzing ability is concerned:\r\n1. Amount of RAM\r\n2. Speed of processor\r\n3. Read/ Write speeds or access speeds from disk.\r\n\r\nWhile a lot of emphasis has been laid on the amount of RAM a system has (R loads the entire dump in memory, uses only 1 core), users tend to ignore how important access speed from HDD (or SSD) can be.\r\n\r\nAn expert can build a good UNIX based system by himself/ herself by assembling the parts at much lesser price. MacBook Pro does that job of fantastic fusion of all three above and maybe many more such features for novices like me." }, "source": "meta" }