{
  "id": 14137,
  "title": "Area under ROC curve of only positive class or average of both classes",
  "url": "/competitions/facebook-recruiting-iv-human-or-bot/discussion/14137",
  "author_name": "",
  "post_date": "2015-05-10T18:44:40.600Z",
  "votes": null,
  "comment_count": 2,
  "views": 808,
  "content": "<p>The evaluation criteria is not explicit about this:</p>\n<p>- Will the ROC metric be calculated only for positive class (ie bots) or the average of ROC scores for both classes?</p>\n<p>- Does it matter if we use one or the other (ie positive class or average) ?</p>",
  "messages": [
    {
      "id": "77787",
      "postDate": "05/10/2015 18:44:40",
      "content": "<p>The evaluation criteria is not explicit about this:</p>\n<p>- Will the ROC metric be calculated only for positive class (ie bots) or the average of ROC scores for both classes?</p>\n<p>- Does it matter if we use one or the other (ie positive class or average) ?</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "77794",
      "postDate": "05/10/2015 20:17:05",
      "content": "<p>You only care about AUC for the positive class in a task like this.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "77820",
      "postDate": "05/11/2015 00:28:23",
      "content": "<p>doesnt matter..... AUC will be the same.</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 77794,
      "author_name": "chotch",
      "author_url": "",
      "post_date": "05/10/2015 20:17:05",
      "content": "<p>You only care about AUC for the positive class in a task like this.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 77820,
      "author_name": "karansarao",
      "author_url": "",
      "post_date": "05/11/2015 00:28:23",
      "content": "<p>doesnt matter..... AUC will be the same.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "77787": "",
    "77794": "",
    "77820": ""
  },
  "source": "meta"
}