{
  "id": 65993,
  "title": "Error when submitting",
  "url": "/competitions/ga-customer-revenue-prediction/discussion/65993",
  "author_name": "KenZo",
  "post_date": "2018-09-17T04:44:36.836000",
  "votes": 3,
  "comment_count": 14,
  "views": 0,
  "content": "<p>I can't submit with the following error.\nPlease tell me how to modify the following error.</p>\n\n<blockquote>\n  <p>ERROR: The value '1000035437777728789' in the key column 'fullVisitorId' has already been defined (Line 475703, Column 1)</p>\n  \n  <p>ERROR: The value '1000411008793922262' in the key column 'fullVisitorId' has already been defined (Line 475709, Column 1)</p>\n  \n  <p>ERROR: The value '1000803807207540047' in the key column 'fullVisitorId' has already been defined (Line 475715, Column 1)</p>\n  \n  <p>ERROR: The value '1000829672312727061' in the key column 'fullVisitorId' has already been defined (Line 475716, Column 1)</p>\n  \n  <p>ERROR: The value '100104898171048438' in the key column 'fullVisitorId' has already been defined (Line 475723, Column 1)</p>\n  \n  <p>ERROR: The value '100135695020255590' in the key column 'fullVisitorId' has already been defined (Line 475729, Column 1)</p>\n  \n  <p>ERROR: The value '1001412656277263218' in the key column 'fullVisitorId' has already been defined (Line 475730, Column 1)</p>\n  \n  <p>ERROR: The value '1002079863795050830' in the key column 'fullVisitorId' has already been defined (Line 475738, Column 1)</p>\n  \n  <p>ERROR: The value '1002099307474679812' in the key column 'fullVisitorId' has already been defined (Line 475740, Column 1)</p>\n  \n  <p>ERROR: The value '1002145056479546512' in the key column 'fullVisitorId' has already been defined (Line 475742, Column 1)</p>\n</blockquote>",
  "messages": [
    {
      "id": 388479,
      "postDate": "2018-09-17T04:44:36.837Z",
      "content": "<p>I can't submit with the following error.\nPlease tell me how to modify the following error.</p>\n\n<blockquote>\n  <p>ERROR: The value '1000035437777728789' in the key column 'fullVisitorId' has already been defined (Line 475703, Column 1)</p>\n  \n  <p>ERROR: The value '1000411008793922262' in the key column 'fullVisitorId' has already been defined (Line 475709, Column 1)</p>\n  \n  <p>ERROR: The value '1000803807207540047' in the key column 'fullVisitorId' has already been defined (Line 475715, Column 1)</p>\n  \n  <p>ERROR: The value '1000829672312727061' in the key column 'fullVisitorId' has already been defined (Line 475716, Column 1)</p>\n  \n  <p>ERROR: The value '100104898171048438' in the key column 'fullVisitorId' has already been defined (Line 475723, Column 1)</p>\n  \n  <p>ERROR: The value '100135695020255590' in the key column 'fullVisitorId' has already been defined (Line 475729, Column 1)</p>\n  \n  <p>ERROR: The value '1001412656277263218' in the key column 'fullVisitorId' has already been defined (Line 475730, Column 1)</p>\n  \n  <p>ERROR: The value '1002079863795050830' in the key column 'fullVisitorId' has already been defined (Line 475738, Column 1)</p>\n  \n  <p>ERROR: The value '1002099307474679812' in the key column 'fullVisitorId' has already been defined (Line 475740, Column 1)</p>\n  \n  <p>ERROR: The value '1002145056479546512' in the key column 'fullVisitorId' has already been defined (Line 475742, Column 1)</p>\n</blockquote>",
      "rawMarkdown": "I can't submit with the following error.\nPlease tell me how to modify the following error.\n\n\n&gt; ERROR: The value '1000035437777728789' in the key column 'fullVisitorId' has already been defined (Line 475703, Column 1)\n\n&gt; ERROR: The value '1000411008793922262' in the key column 'fullVisitorId' has already been defined (Line 475709, Column 1)\n\n&gt; ERROR: The value '1000803807207540047' in the key column 'fullVisitorId' has already been defined (Line 475715, Column 1)\n\n&gt; ERROR: The value '1000829672312727061' in the key column 'fullVisitorId' has already been defined (Line 475716, Column 1)\n\n&gt; ERROR: The value '100104898171048438' in the key column 'fullVisitorId' has already been defined (Line 475723, Column 1)\n\n&gt; ERROR: The value '100135695020255590' in the key column 'fullVisitorId' has already been defined (Line 475729, Column 1)\n\n&gt; ERROR: The value '1001412656277263218' in the key column 'fullVisitorId' has already been defined (Line 475730, Column 1)\n\n&gt;ERROR: The value '1002079863795050830' in the key column 'fullVisitorId' has already been defined (Line 475738, Column 1)\n\n&gt; ERROR: The value '1002099307474679812' in the key column 'fullVisitorId' has already been defined (Line 475740, Column 1)\n\n&gt; ERROR: The value '1002145056479546512' in the key column 'fullVisitorId' has already been defined (Line 475742, Column 1)\n\n",
      "votes": 3
    },
    {
      "id": 388852,
      "postDate": "2018-09-17T17:44:00.113Z",
      "content": "<p>This happened to me as well, and it was because I wasn't reading fullVisitorId as a string when loading the data, causing duplicates (the data page of the competition actually specifies that it needs to be read as a string).</p>\n\n<pre><code>pd.read_csv(DATA_PATH, dtype={'fullVisitorId': 'str'})\n</code></pre>",
      "rawMarkdown": "This happened to me as well, and it was because I wasn't reading fullVisitorId as a string when loading the data, causing duplicates (the data page of the competition actually specifies that it needs to be read as a string).\n\n    pd.read_csv(DATA_PATH, dtype={'fullVisitorId': 'str'})",
      "votes": 4,
      "replies": [
        {
          "id": 388980,
          "postDate": "2018-09-17T23:41:41.027Z",
          "content": "<p>your best answer !!  Thanks to you, everything has settled.</p>",
          "rawMarkdown": " your best answer !!  Thanks to you, everything has settled."
        }
      ]
    },
    {
      "id": 388490,
      "postDate": "2018-09-17T05:07:24.350Z",
      "content": "<p>Is it when creating submit data?\nalso, visitors = fullVisitorId ?</p>",
      "rawMarkdown": "\nIs it when creating submit data?\nalso, visitors = fullVisitorId ?",
      "replies": [
        {
          "id": 388492,
          "postDate": "2018-09-17T05:09:34.710Z",
          "content": "<p>Yes, in the submission file, by fullVisitorId.</p>\n\n<p>As per description: We are predicting the natural log of the sum of all transactions per user.</p>",
          "rawMarkdown": "Yes, in the submission file, by fullVisitorId.\n\nAs per description: We are predicting the natural log of the sum of all transactions per user."
        },
        {
          "id": 388498,
          "postDate": "2018-09-17T05:20:47.267Z",
          "rawMarkdown": "",
          "isDeleted": true
        },
        {
          "id": 388499,
          "postDate": "2018-09-17T05:21:59.340Z",
          "content": "<p>ok, \" sample.groupby('fullVisitorId')[\"PredictedLogRevenue\"].sum().reset_index()\" is ok?\nIs the length of submitdata 617242?</p>",
          "rawMarkdown": "\nok, \" sample.groupby('fullVisitorId')[\"PredictedLogRevenue\"].sum().reset_index()\" is ok?\nIs the length of submitdata 617242?"
        },
        {
          "id": 388506,
          "postDate": "2018-09-17T05:36:29.760Z",
          "content": "<p>yes, this code looks correct; the number of lines too.</p>",
          "rawMarkdown": "yes, this code looks correct; the number of lines too."
        },
        {
          "id": 388517,
          "postDate": "2018-09-17T05:56:20.227Z",
          "content": "<p>I noticed that the length of \"submitdata\" is not 617242.　Is \"submitdata\" before \"groupby\" the same as the length of the test data 804684?　</p>",
          "rawMarkdown": "\nI noticed that the length of \"submitdata\" is not 617242.　Is \"submitdata\" before \"groupby\" the same as the length of the test data 804684?　"
        },
        {
          "id": 388522,
          "postDate": "2018-09-17T06:03:31.350Z",
          "content": "<p>Submission length should be the same as sample submission.</p>",
          "rawMarkdown": "Submission length should be the same as sample submission."
        },
        {
          "id": 388528,
          "postDate": "2018-09-17T06:18:59.910Z",
          "content": "<p>Thank you , Fainaly Please tell me when the length of \"submitdata\" become 617242.  </p>",
          "rawMarkdown": "Thank you , Fainaly Please tell me when the length of \"submitdata\" become 617242.  "
        },
        {
          "id": 388529,
          "postDate": "2018-09-17T06:20:10.100Z",
          "content": "<p>It should become 617242 after grouping.</p>",
          "rawMarkdown": "It should become 617242 after grouping."
        },
        {
          "id": 388530,
          "postDate": "2018-09-17T06:24:53.117Z",
          "content": "<p>OK, Thank you! <br>\nI will do my best.</p>",
          "rawMarkdown": "OK, Thank you!  \nI will do my best.\n "
        }
      ]
    },
    {
      "id": 388482,
      "postDate": "2018-09-17T04:54:42.123Z",
      "content": "<p>Are you aggregating data by visitors?</p>",
      "rawMarkdown": "Are you aggregating data by visitors?"
    },
    {
      "id": 388497,
      "postDate": "2018-09-17T05:20:02.477Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 388852,
      "author_name": "Kjetil Åmdal-Sævik",
      "author_url": "",
      "post_date": "2018-09-17T17:44:00.113000",
      "content": "<p>This happened to me as well, and it was because I wasn't reading fullVisitorId as a string when loading the data, causing duplicates (the data page of the competition actually specifies that it needs to be read as a string).</p>\n\n<pre><code>pd.read_csv(DATA_PATH, dtype={'fullVisitorId': 'str'})\n</code></pre>",
      "votes": 4,
      "replies": [
        {
          "id": 388980,
          "author_name": "KenZo",
          "author_url": "",
          "post_date": "2018-09-17T23:41:41.027000",
          "content": "<p>your best answer !!  Thanks to you, everything has settled.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 388490,
      "author_name": "KenZo",
      "author_url": "",
      "post_date": "2018-09-17T05:07:24.350000",
      "content": "<p>Is it when creating submit data?\nalso, visitors = fullVisitorId ?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 388492,
          "author_name": "Andrey Lukyanenko",
          "author_url": "",
          "post_date": "2018-09-17T05:09:34.710000",
          "content": "<p>Yes, in the submission file, by fullVisitorId.</p>\n\n<p>As per description: We are predicting the natural log of the sum of all transactions per user.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 388498,
          "author_name": "",
          "author_url": "",
          "post_date": "2018-09-17T05:20:47.267000",
          "content": "",
          "votes": 0,
          "replies": []
        },
        {
          "id": 388499,
          "author_name": "KenZo",
          "author_url": "",
          "post_date": "2018-09-17T05:21:59.340000",
          "content": "<p>ok, \" sample.groupby('fullVisitorId')[\"PredictedLogRevenue\"].sum().reset_index()\" is ok?\nIs the length of submitdata 617242?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 388506,
          "author_name": "Andrey Lukyanenko",
          "author_url": "",
          "post_date": "2018-09-17T05:36:29.760000",
          "content": "<p>yes, this code looks correct; the number of lines too.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 388517,
          "author_name": "KenZo",
          "author_url": "",
          "post_date": "2018-09-17T05:56:20.227000",
          "content": "<p>I noticed that the length of \"submitdata\" is not 617242.　Is \"submitdata\" before \"groupby\" the same as the length of the test data 804684?　</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 388522,
          "author_name": "Andrey Lukyanenko",
          "author_url": "",
          "post_date": "2018-09-17T06:03:31.350000",
          "content": "<p>Submission length should be the same as sample submission.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 388528,
          "author_name": "KenZo",
          "author_url": "",
          "post_date": "2018-09-17T06:18:59.910000",
          "content": "<p>Thank you , Fainaly Please tell me when the length of \"submitdata\" become 617242.  </p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 388529,
          "author_name": "Andrey Lukyanenko",
          "author_url": "",
          "post_date": "2018-09-17T06:20:10.100000",
          "content": "<p>It should become 617242 after grouping.</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 388530,
          "author_name": "KenZo",
          "author_url": "",
          "post_date": "2018-09-17T06:24:53.117000",
          "content": "<p>OK, Thank you! <br>\nI will do my best.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 388482,
      "author_name": "Andrey Lukyanenko",
      "author_url": "",
      "post_date": "2018-09-17T04:54:42.123000",
      "content": "<p>Are you aggregating data by visitors?</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 388497,
      "author_name": "",
      "author_url": "",
      "post_date": "2018-09-17T05:20:02.477000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "388479": "I can't submit with the following error.\nPlease tell me how to modify the following error.\n\n\n&gt; ERROR: The value '1000035437777728789' in the key column 'fullVisitorId' has already been defined (Line 475703, Column 1)\n\n&gt; ERROR: The value '1000411008793922262' in the key column 'fullVisitorId' has already been defined (Line 475709, Column 1)\n\n&gt; ERROR: The value '1000803807207540047' in the key column 'fullVisitorId' has already been defined (Line 475715, Column 1)\n\n&gt; ERROR: The value '1000829672312727061' in the key column 'fullVisitorId' has already been defined (Line 475716, Column 1)\n\n&gt; ERROR: The value '100104898171048438' in the key column 'fullVisitorId' has already been defined (Line 475723, Column 1)\n\n&gt; ERROR: The value '100135695020255590' in the key column 'fullVisitorId' has already been defined (Line 475729, Column 1)\n\n&gt; ERROR: The value '1001412656277263218' in the key column 'fullVisitorId' has already been defined (Line 475730, Column 1)\n\n&gt;ERROR: The value '1002079863795050830' in the key column 'fullVisitorId' has already been defined (Line 475738, Column 1)\n\n&gt; ERROR: The value '1002099307474679812' in the key column 'fullVisitorId' has already been defined (Line 475740, Column 1)\n\n&gt; ERROR: The value '1002145056479546512' in the key column 'fullVisitorId' has already been defined (Line 475742, Column 1)\n\n",
    "388852": "This happened to me as well, and it was because I wasn't reading fullVisitorId as a string when loading the data, causing duplicates (the data page of the competition actually specifies that it needs to be read as a string).\n\n    pd.read_csv(DATA_PATH, dtype={'fullVisitorId': 'str'})",
    "388490": "\nIs it when creating submit data?\nalso, visitors = fullVisitorId ?",
    "388482": "Are you aggregating data by visitors?",
    "388497": ""
  }
}