{
  "id": 3724,
  "title": "Test data",
  "url": "/competitions/event-recommendation-engine-challenge/discussion/3724",
  "author_name": "",
  "post_date": "2013-01-30T01:04:31.010Z",
  "votes": null,
  "comment_count": 3,
  "views": 2033,
  "content": "<p>Excuse me if I am wrong but it seems to me that something happened with either the test data set or the evaluation procedure.</p>\r\n<p>1) public scores of the test submissions&nbsp;had been changed on the site,</p>\r\n<p>2) I&nbsp;think that the ratio of test data used for testing was 25% / 75% earlier and not 15% / 85% as it is right now (I am not sure about that),</p>\r\n<p>3) test.csv file (just 15Kb) on Data Files page is wrong right now (it contains just one column &quot;User&quot;).</p>\r\n<p>I am not drunk...</p>\r\n<p>&nbsp;</p>",
  "messages": [
    {
      "id": "19835",
      "postDate": "01/30/2013 01:04:31",
      "content": "<p>Excuse me if I am wrong but it seems to me that something happened with either the test data set or the evaluation procedure.</p>\r\n<p>1) public scores of the test submissions&nbsp;had been changed on the site,</p>\r\n<p>2) I&nbsp;think that the ratio of test data used for testing was 25% / 75% earlier and not 15% / 85% as it is right now (I am not sure about that),</p>\r\n<p>3) test.csv file (just 15Kb) on Data Files page is wrong right now (it contains just one column &quot;User&quot;).</p>\r\n<p>I am not drunk...</p>\r\n<p>&nbsp;</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19847",
      "postDate": "01/30/2013 14:21:33",
      "content": "<p>Let me put it in this way:</p>\r\n<p>How come that&nbsp;the public score of the same submission for the same test data set today (e.g. 0.55) is not the same as it was yesterday (e.g. 0.64)?</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19857",
      "postDate": "01/30/2013 18:22:19",
      "content": "<p>random order benchmark:</p>\r\n<p>about 0.42 -&gt; about 0.39</p>\r\n<p>???</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19862",
      "postDate": "01/30/2013 20:00:30",
      "content": "<p>https://www.kaggle.com/c/event-recommendation-engine-challenge/forums/t/3729/update-some-rows-in-the-test-set-no-longer-count-to-your-score</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 19847,
      "author_name": "abundrew",
      "author_url": "",
      "post_date": "01/30/2013 14:21:33",
      "content": "<p>Let me put it in this way:</p>\r\n<p>How come that&nbsp;the public score of the same submission for the same test data set today (e.g. 0.55) is not the same as it was yesterday (e.g. 0.64)?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19857,
      "author_name": "gaddawin",
      "author_url": "",
      "post_date": "01/30/2013 18:22:19",
      "content": "<p>random order benchmark:</p>\r\n<p>about 0.42 -&gt; about 0.39</p>\r\n<p>???</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19862,
      "author_name": "benhamner",
      "author_url": "",
      "post_date": "01/30/2013 20:00:30",
      "content": "<p>https://www.kaggle.com/c/event-recommendation-engine-challenge/forums/t/3729/update-some-rows-in-the-test-set-no-longer-count-to-your-score</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "19835": "",
    "19847": "",
    "19857": "",
    "19862": ""
  },
  "source": "meta"
}