{
  "id": 23420,
  "title": "A few commands on the cli to merge the files",
  "url": "/competitions/bosch-production-line-performance/discussion/23420",
  "author_name": "James Jeffries",
  "post_date": "2016-09-06T20:39:56.957000",
  "votes": 5,
  "comment_count": 0,
  "views": 223,
  "content": "<p>My first attempt at joining the files using python led me to run out of memory so I though I'd try on the linux cli instead</p>\n\n<pre><code>cat train_categorical.csv | cut -d, -f2- &gt; catsNoIds\ncat train_date.csv | cut -d, -f2- &gt; datesNoIds\npaste -d, train_numeric.csv catsNoIds datesNoIds &gt; merged.csv\n</code></pre>\n\n<p>Thought this might help someone out who ran into the same problem as me. Now what to do with my 7.2GB merged file...</p>",
  "messages": [
    {
      "id": 134482,
      "postDate": "2016-09-06T20:39:56.957Z",
      "content": "<p>My first attempt at joining the files using python led me to run out of memory so I though I'd try on the linux cli instead</p>\n\n<pre><code>cat train_categorical.csv | cut -d, -f2- &gt; catsNoIds\ncat train_date.csv | cut -d, -f2- &gt; datesNoIds\npaste -d, train_numeric.csv catsNoIds datesNoIds &gt; merged.csv\n</code></pre>\n\n<p>Thought this might help someone out who ran into the same problem as me. Now what to do with my 7.2GB merged file...</p>",
      "rawMarkdown": "My first attempt at joining the files using python led me to run out of memory so I though I'd try on the linux cli instead\r\n\r\n    cat train_categorical.csv | cut -d, -f2- > catsNoIds\r\n    cat train_date.csv | cut -d, -f2- > datesNoIds\r\n    paste -d, train_numeric.csv catsNoIds datesNoIds > merged.csv\r\n\r\nThought this might help someone out who ran into the same problem as me. Now what to do with my 7.2GB merged file...",
      "votes": 5
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "134482": "My first attempt at joining the files using python led me to run out of memory so I though I'd try on the linux cli instead\r\n\r\n    cat train_categorical.csv | cut -d, -f2- > catsNoIds\r\n    cat train_date.csv | cut -d, -f2- > datesNoIds\r\n    paste -d, train_numeric.csv catsNoIds datesNoIds > merged.csv\r\n\r\nThought this might help someone out who ran into the same problem as me. Now what to do with my 7.2GB merged file..."
  }
}