{
  "id": 4424,
  "title": "3 questions",
  "url": "/competitions/challenges-in-representation-learning-multi-modal-learning/discussion/4424",
  "author_name": "",
  "post_date": "2013-04-24T14:01:17.757Z",
  "votes": null,
  "comment_count": 1,
  "views": 1529,
  "content": "<p>1. Do the submissions need to be all 0's and 1's?&nbsp; Or is it valid to have a 0.6 meaning &quot;I think it is a 60% probability that the answer is 1 and a 40% probability that the answer is 0&quot;?</p>\r\n<p>2. Is the score based on&nbsp;AUC?&nbsp;</p>\r\n<p>3. The&nbsp;timeline says there is one week between&nbsp;when the final test set is released and&nbsp;&quot;Deadline to upload submission on the final test set&quot; (May 17 to May 24).&nbsp; The Evaluation page says 72 hours (&quot;we will not provide the final test inputs until 72 hours\r\n before the contest closes&quot;).&nbsp; Is it 1 week or 72 hours?&nbsp; I personally would prefer 1 week because of the amount of data processing involved.&nbsp;</p>\r\n<p>Thanks,</p>\r\n<p>Steve</p>",
  "messages": [
    {
      "id": "23410",
      "postDate": "04/24/2013 14:01:17",
      "content": "<p>1. Do the submissions need to be all 0's and 1's?&nbsp; Or is it valid to have a 0.6 meaning &quot;I think it is a 60% probability that the answer is 1 and a 40% probability that the answer is 0&quot;?</p>\r\n<p>2. Is the score based on&nbsp;AUC?&nbsp;</p>\r\n<p>3. The&nbsp;timeline says there is one week between&nbsp;when the final test set is released and&nbsp;&quot;Deadline to upload submission on the final test set&quot; (May 17 to May 24).&nbsp; The Evaluation page says 72 hours (&quot;we will not provide the final test inputs until 72 hours\r\n before the contest closes&quot;).&nbsp; Is it 1 week or 72 hours?&nbsp; I personally would prefer 1 week because of the amount of data processing involved.&nbsp;</p>\r\n<p>Thanks,</p>\r\n<p>Steve</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "23412",
      "postDate": "04/24/2013 14:10:58",
      "content": "<p>1. Probabilities are allowed. I think the demos I provided will only emit 0s or 1s though, so you'll need to write your own submission script to use probabilities.</p>\r\n<p>2. Yes, area under ROC curve.</p>\r\n<p>3. Sorry for the discrepancy between the timeline and the evaluation page. The timeline is correct, so you get your preference :)</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 23412,
      "author_name": "iangoodfellow",
      "author_url": "",
      "post_date": "04/24/2013 14:10:58",
      "content": "<p>1. Probabilities are allowed. I think the demos I provided will only emit 0s or 1s though, so you'll need to write your own submission script to use probabilities.</p>\r\n<p>2. Yes, area under ROC curve.</p>\r\n<p>3. Sorry for the discrepancy between the timeline and the evaluation page. The timeline is correct, so you get your preference :)</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "23410": "",
    "23412": ""
  },
  "source": "meta"
}