{
  "id": 3575,
  "title": "Evaluation",
  "url": "/competitions/event-recommendation-engine-challenge/discussion/3575",
  "author_name": "",
  "post_date": "2013-01-11T02:23:45.423Z",
  "votes": null,
  "comment_count": 9,
  "views": 3190,
  "content": "<p>How are the submissions evaluated?</p>",
  "messages": [
    {
      "id": "19179",
      "postDate": "01/11/2013 02:23:45",
      "content": "<p>How are the submissions evaluated?</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19180",
      "postDate": "01/11/2013 02:36:34",
      "content": "<p>You may find details on&nbsp;<a title=\"evaluation page\" href=\"https://www.kaggle.com/c/event-recommendation-engine-challenge/details/evaluation\" target=\"_blank\">the evaluation page</a>. &nbsp;(We had forgotten to publish it -- thanks!)</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19187",
      "postDate": "01/11/2013 11:51:27",
      "content": "<p>Kaggle Wiki ............... &nbsp;Link Page Missing&nbsp;</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19190",
      "postDate": "01/11/2013 15:46:13",
      "content": "<p>Hello Yogesh,</p>\r\n<p>We've fixed the link. &nbsp;Cheers!</p>\r\n<p>Good luck,</p>\r\n<p>events4you</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19194",
      "postDate": "01/11/2013 16:36:21",
      "content": "<p>Hi,</p>\r\n<p>I wanna evaluate my result before submitting. Is there a tool to evaluate my submission file?</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19203",
      "postDate": "01/11/2013 20:43:57",
      "content": "<p>Hello Necati,</p>\r\n<p>I don't think we have such a tool, but I'm looking into this and I'll report back soon.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19204",
      "postDate": "01/11/2013 20:56:00",
      "content": "<p>Thanks. I will be waiting for your reply. </p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19206",
      "postDate": "01/11/2013 22:07:56",
      "content": "<p>[quote=Necati Demir;19194]</p>\r\n<p>Hi,</p>\r\n<p>I wanna evaluate my result before submitting. Is there a tool to evaluate my submission file?</p>\r\n<p>[/quote]You may use the MAP@K metric in the <a href=\"https://github.com/benhamner/Metrics\">\r\nMetrics package</a> (as is described on the MAP@K wiki page) to evaluate your result on an internal split of the training data, or through cross-validation.</p>\r\n<p>However, since you do not have answers for the public leaderboard set, it is not possible for you to evaluate that file prior to submitting.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19226",
      "postDate": "01/12/2013 09:02:28",
      "content": "<p>[quote=Ben Hamner;19206]</p>\r\n<p>However, since you do not have answers for the public leaderboard set, it is not possible for you to evaluate that file prior to submitting.[/quote]</p>\r\n<p>You're right. Thanks!</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "19795",
      "postDate": "01/29/2013 17:55:17",
      "content": "<p>Will the leaderboard data set and any other final evaulation data be released after the competition closes? &nbsp;I'm not sure I want to participate if I can't learn from the deficiencies in my final submission to see how I could do better in other competitions.\r\n &nbsp;<span style=\"font-size:14px; line-height:1.4em\">&nbsp;</span></p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 19180,
      "author_name": "events4you",
      "author_url": "",
      "post_date": "01/11/2013 02:36:34",
      "content": "<p>You may find details on&nbsp;<a title=\"evaluation page\" href=\"https://www.kaggle.com/c/event-recommendation-engine-challenge/details/evaluation\" target=\"_blank\">the evaluation page</a>. &nbsp;(We had forgotten to publish it -- thanks!)</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19187,
      "author_name": "ydhiman",
      "author_url": "",
      "post_date": "01/11/2013 11:51:27",
      "content": "<p>Kaggle Wiki ............... &nbsp;Link Page Missing&nbsp;</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19190,
      "author_name": "events4you",
      "author_url": "",
      "post_date": "01/11/2013 15:46:13",
      "content": "<p>Hello Yogesh,</p>\r\n<p>We've fixed the link. &nbsp;Cheers!</p>\r\n<p>Good luck,</p>\r\n<p>events4you</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19194,
      "author_name": "ndemir",
      "author_url": "",
      "post_date": "01/11/2013 16:36:21",
      "content": "<p>Hi,</p>\r\n<p>I wanna evaluate my result before submitting. Is there a tool to evaluate my submission file?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19203,
      "author_name": "events4you",
      "author_url": "",
      "post_date": "01/11/2013 20:43:57",
      "content": "<p>Hello Necati,</p>\r\n<p>I don't think we have such a tool, but I'm looking into this and I'll report back soon.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19204,
      "author_name": "ndemir",
      "author_url": "",
      "post_date": "01/11/2013 20:56:00",
      "content": "<p>Thanks. I will be waiting for your reply. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19206,
      "author_name": "benhamner",
      "author_url": "",
      "post_date": "01/11/2013 22:07:56",
      "content": "<p>[quote=Necati Demir;19194]</p>\r\n<p>Hi,</p>\r\n<p>I wanna evaluate my result before submitting. Is there a tool to evaluate my submission file?</p>\r\n<p>[/quote]You may use the MAP@K metric in the <a href=\"https://github.com/benhamner/Metrics\">\r\nMetrics package</a> (as is described on the MAP@K wiki page) to evaluate your result on an internal split of the training data, or through cross-validation.</p>\r\n<p>However, since you do not have answers for the public leaderboard set, it is not possible for you to evaluate that file prior to submitting.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19226,
      "author_name": "ndemir",
      "author_url": "",
      "post_date": "01/12/2013 09:02:28",
      "content": "<p>[quote=Ben Hamner;19206]</p>\r\n<p>However, since you do not have answers for the public leaderboard set, it is not possible for you to evaluate that file prior to submitting.[/quote]</p>\r\n<p>You're right. Thanks!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 19795,
      "author_name": "rcredburn",
      "author_url": "",
      "post_date": "01/29/2013 17:55:17",
      "content": "<p>Will the leaderboard data set and any other final evaulation data be released after the competition closes? &nbsp;I'm not sure I want to participate if I can't learn from the deficiencies in my final submission to see how I could do better in other competitions.\r\n &nbsp;<span style=\"font-size:14px; line-height:1.4em\">&nbsp;</span></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "19179": "",
    "19180": "",
    "19187": "",
    "19190": "",
    "19194": "",
    "19203": "",
    "19204": "",
    "19206": "",
    "19226": "",
    "19795": ""
  },
  "source": "meta"
}