{
  "id": 23291,
  "title": "Python: Using Pandas to Concatenate numerical and categorical data",
  "url": "/competitions/bosch-production-line-performance/discussion/23291",
  "author_name": "",
  "post_date": "2016-09-02T13:59:07.357Z",
  "votes": null,
  "comment_count": 3,
  "views": 851,
  "content": "<p>I am trying to Concatenate numerical and categorical data but It seems  that the size is too big for python. Error : Python int too large to convert to C long. Any work around for this. I am using pd.concat function.</p>\n\n<p>PS: If I do the same procedure for lets say first 10000 rows of data it works fine</p>",
  "messages": [
    {
      "id": "133483",
      "postDate": "09/02/2016 13:59:07",
      "content": "<p>I am trying to Concatenate numerical and categorical data but It seems  that the size is too big for python. Error : Python int too large to convert to C long. Any work around for this. I am using pd.concat function.</p>\n\n<p>PS: If I do the same procedure for lets say first 10000 rows of data it works fine</p>",
      "rawMarkdown": "I am trying to Concatenate numerical and categorical data but It seems  that the size is too big for python. Error : Python int too large to convert to C long. Any work around for this. I am using pd.concat function.\r\n\r\nPS: If I do the same procedure for lets say first 10000 rows of data it works fine",
      "votes": null
    },
    {
      "id": "133494",
      "postDate": "09/02/2016 14:53:05",
      "content": "<p>Check out CPMP's chunker here: <a href=\"https://www.kaggle.com/c/bosch-production-line-performance/forums/t/23287/reading-by-chunks-in-python\">https://www.kaggle.com/c/bosch-production-line-performance/forums/t/23287/reading-by-chunks-in-python</a></p>\n\n<p>Was helpful for me.</p>",
      "rawMarkdown": "Check out CPMP's chunker here: https://www.kaggle.com/c/bosch-production-line-performance/forums/t/23287/reading-by-chunks-in-python\r\n\r\nWas helpful for me.",
      "votes": null
    },
    {
      "id": "133510",
      "postDate": "09/02/2016 16:30:07",
      "content": "<p>Any idea if it works with python27 ?</p>",
      "rawMarkdown": "Any idea if it works with python27 ?",
      "votes": null
    },
    {
      "id": "134122",
      "postDate": "09/05/2016 07:32:01",
      "content": "<p>Hi,\nI tried the script to basically concat all the tables, without any condition check. It gives the following error: </p>\n\n<pre><code>for i in range(0, total_len, chunk_len):\nOverflowError: Python int too large to convert to C long\n</code></pre>\n\n<p>Can you please help me?</p>",
      "rawMarkdown": "Hi,\r\nI tried the script to basically concat all the tables, without any condition check. It gives the following error: \r\n\r\n    for i in range(0, total_len, chunk_len):\r\n    OverflowError: Python int too large to convert to C long\r\n\r\nCan you please help me?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 133494,
      "author_name": "colemaclean",
      "author_url": "",
      "post_date": "09/02/2016 14:53:05",
      "content": "<p>Check out CPMP's chunker here: <a href=\"https://www.kaggle.com/c/bosch-production-line-performance/forums/t/23287/reading-by-chunks-in-python\">https://www.kaggle.com/c/bosch-production-line-performance/forums/t/23287/reading-by-chunks-in-python</a></p>\n\n<p>Was helpful for me.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 133510,
      "author_name": "zohairzohair4",
      "author_url": "",
      "post_date": "09/02/2016 16:30:07",
      "content": "<p>Any idea if it works with python27 ?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 134122,
      "author_name": "zohairzohair4",
      "author_url": "",
      "post_date": "09/05/2016 07:32:01",
      "content": "<p>Hi,\nI tried the script to basically concat all the tables, without any condition check. It gives the following error: </p>\n\n<pre><code>for i in range(0, total_len, chunk_len):\nOverflowError: Python int too large to convert to C long\n</code></pre>\n\n<p>Can you please help me?</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "133483": "I am trying to Concatenate numerical and categorical data but It seems  that the size is too big for python. Error : Python int too large to convert to C long. Any work around for this. I am using pd.concat function.\r\n\r\nPS: If I do the same procedure for lets say first 10000 rows of data it works fine",
    "133494": "Check out CPMP's chunker here: https://www.kaggle.com/c/bosch-production-line-performance/forums/t/23287/reading-by-chunks-in-python\r\n\r\nWas helpful for me.",
    "133510": "Any idea if it works with python27 ?",
    "134122": "Hi,\r\nI tried the script to basically concat all the tables, without any condition check. It gives the following error: \r\n\r\n    for i in range(0, total_len, chunk_len):\r\n    OverflowError: Python int too large to convert to C long\r\n\r\nCan you please help me?"
  },
  "source": "meta"
}