{
  "id": 8041,
  "title": "Challenge ended",
  "url": "/competitions/connectomics/discussion/8041",
  "author_name": "",
  "post_date": "2014-05-06T07:08:32.250Z",
  "votes": 4,
  "comment_count": 12,
  "views": 3708,
  "content": "<p>Dear challenge participants,</p>\n<p>Thank you for your participation in the challenge. The provisional winners are shown on this excerpt of the private leaderboard:</p>\n<p><img src=\"https://1601b3be-a-98cb7308-s-sites.googlegroups.com/a/chalearn.org/connectomics/home/winners.jpg?attachauth=ANoY7coMV0H89Wl7JEBtep2nw71MpOcq-8S4xF_kt3THCmD5561SKT3Yi2pRaeHd5VU0jxv1qF3x_5Y8Ch43RKCZKfG2S-DPDsMZ1PYdOd4wSi4Bd6dAAtkdO6QjEHTfZJFmjSZ6KLXj6n651IaVA6K6QPh3bmltzAxKNCHm2haH9yLqycJtFge2Sr_9A4ZeJabD7KXhQUAa6erP-S17bYwExsq52thw3Q%3D%3D&attredirects=0\" alt=\"Winners\" width=\"978\" height=\"159\"></p>\n<p>Before we finalize the results and reveal the full private leaderboard, as per the challenge rules:</p>\n<p>- The three provisional winners must make their identity known to the organizers (by contacting them by email at causality@chalearn.org) and they must make their code publicly available within 2 weeks so we can proceed to verifications.</p>\n<p>- All participants must turn in fact sheets (a brief survey on the methods used):&nbsp;https://docs.google.com/a/chalearn.org/spreadsheet/viewform?formkey=dFNtQWxsSjhvbEd5UGhNNGoyUmxPQmc6MA#gid=0</p>\n<p>Many thanks in advance.</p>\n<p>Best regards,</p>\n<p>The organizers</p>",
  "messages": [
    {
      "id": "43934",
      "postDate": "05/06/2014 07:08:32",
      "content": "<p>Dear challenge participants,</p>\n<p>Thank you for your participation in the challenge. The provisional winners are shown on this excerpt of the private leaderboard:</p>\n<p><img src=\"https://1601b3be-a-98cb7308-s-sites.googlegroups.com/a/chalearn.org/connectomics/home/winners.jpg?attachauth=ANoY7coMV0H89Wl7JEBtep2nw71MpOcq-8S4xF_kt3THCmD5561SKT3Yi2pRaeHd5VU0jxv1qF3x_5Y8Ch43RKCZKfG2S-DPDsMZ1PYdOd4wSi4Bd6dAAtkdO6QjEHTfZJFmjSZ6KLXj6n651IaVA6K6QPh3bmltzAxKNCHm2haH9yLqycJtFge2Sr_9A4ZeJabD7KXhQUAa6erP-S17bYwExsq52thw3Q%3D%3D&attredirects=0\" alt=\"Winners\" width=\"978\" height=\"159\"></p>\n<p>Before we finalize the results and reveal the full private leaderboard, as per the challenge rules:</p>\n<p>- The three provisional winners must make their identity known to the organizers (by contacting them by email at causality@chalearn.org) and they must make their code publicly available within 2 weeks so we can proceed to verifications.</p>\n<p>- All participants must turn in fact sheets (a brief survey on the methods used):&nbsp;https://docs.google.com/a/chalearn.org/spreadsheet/viewform?formkey=dFNtQWxsSjhvbEd5UGhNNGoyUmxPQmc6MA#gid=0</p>\n<p>Many thanks in advance.</p>\n<p>Best regards,</p>\n<p>The organizers</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "43937",
      "postDate": "05/06/2014 07:17:54",
      "content": "<p>Great! Thanks Isabelle for the&nbsp;excerpt of the final leaderboard. We will prepare fact sheets and our models as quickly as possible.</p>\n<p>Congratulations to everyone participating on the challenge. This last week was quite intense :-)&nbsp;</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "43972",
      "postDate": "05/06/2014 11:14:08",
      "content": "<p>Thanks for the information, and even more for organizing this great competition!</p>\n<p>Unfortunately, I cannot see the excerpt, there is only the word &quot;Winners&quot; in plain text ... or am I overlooking something?</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "43973",
      "postDate": "05/06/2014 11:18:51",
      "content": "<p>Matthias: See&nbsp;https://1601b3be-a-98cb7308-s-sites.googlegroups.com/a/chalearn.org/connectomics/home/winners.jpg</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "43985",
      "postDate": "05/06/2014 12:07:52",
      "content": "<p>Congratulations Matthias for your provisional second place!</p>\n<p>And BTW, did you receive my e-mail this morning? Otherwise, it might mean that I sent it to a different Matthias Ossadnik as a mistake!</p>\n<p>Demian: demian.battaglia@univ-amu.fr</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "43989",
      "postDate": "05/06/2014 12:36:44",
      "content": "<p>Congratulations to everyone!</p>\n<p>It's been wonderful to be involved in the challenge.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "43992",
      "postDate": "05/06/2014 12:40:26",
      "content": "<p>Why is the rest of private leaderboard not avaliable? Even if it is not official, it would be nice to know how big were the differences on the test set. Looking at top3 scores it seems they were even tighter than on the valid one, I must admit I'm quite curious.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "43999",
      "postDate": "05/06/2014 13:07:38",
      "content": "<p>I'd see no problem with that. I will check first that it doesn't break any Kaggle or challenge-specific rules.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "44023",
      "postDate": "05/06/2014 13:26:35",
      "content": "<p>Well, the reason is that when the private leaderboard is made public it is authoritative, so it cannot be made officially public before the validation for the top three participants (the ones that get prizes) is performed.</p>\n<p>Just as a (unbinding) teaser, here some extra ranks beyond the (provisionally) first three:</p>\n<p>1 AAAGV &nbsp;0.9416</p>\n<p>2 Matthias Ossadnik 0.9410</p>\n<p>3 Ildefons Magrans 0.9406</p>\n<p>4 Lukasz 8000 0.9396</p>\n<p>5 Lejlot &amp; Rafal 0.9383</p>\n<p>6 Sium &nbsp;0.9371</p>\n<p>7 Alexander N &amp; vopern 0.9367</p>\n<p>8 gaucho81 0.9338</p>\n<p>9 killertom 0.9301</p>\n<p>10 dhanson 0.9288</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "44277",
      "postDate": "05/08/2014 20:18:59",
      "content": "<p>hmm, just a quick question. does every participant in the competition has to submit the fact sheet before the official results will be published?&nbsp;just asking because&nbsp;I think some of the participants probably won't ever submit the fact sheet, and I'm a little curious what will happen to those participants that didn't submit the fact sheets? will they be removed from the final leaderboard standings?<br><br></p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "44487",
      "postDate": "05/13/2014 20:40:26",
      "content": "<p><a href=\"https://docs.google.com/a/chalearn.org/spreadsheet/viewform?formkey=dFNtQWxsSjhvbEd5UGhNNGoyUmxPQmc6MA#gid=0\">Please remember to fill out your fact sheet before May 20</a>. We encourage all the participants to fill out fact sheets. This will make the analysis much more interesting. <a href=\"https://docs.google.com/a/chalearn.org/viewer?a=v&pid=sites&srcid=Y2hhbGVhcm4ub3JnfGNvbm5lY3RvbWljc3xneDo2NzE4Njg5Mzk0NTY2MTFi\">Our rules indicate</a>&nbsp;(Section 4):</p>\n<p><em><strong>(b) Fact sheets: To be part of the final ranking the participants will be asked to fill out a</strong></em></p>\n<p><em><strong>survey (fact sheet) briefly describing their method. Publishing a more detailed paper in</strong></em></p>\n<p><em><strong>the proceedings of the workshop is optional.</strong></em></p>\n<p>You can take a look at the <a href=\"https://docs.google.com/a/chalearn.org/viewer?a=v&pid=sites&srcid=Y2hhbGVhcm4ub3JnfGNvbm5lY3RvbWljc3xneDo1OTkwMWM5MWJkN2NjYzZj&pli=1\">present summary</a>&nbsp;from 19 respondents.</p>\n<p>The final official ranking on which we will base further analyses and publications will include only the participants who do not turn in fact sheets, because it is virtually impossible to say anything interesting about a contribution for which nothing is known.</p>\n<p>Thank you in advance for putting in the effort!</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "44532",
      "postDate": "05/14/2014 14:05:26",
      "content": "<p>This information is hidden on an external site and I suspect that most participants are not aware of this rule. Disqualifying the 85% which did not fill out the fact sheets would rob them of their achieved rank and diminish the value for those who did. So please don't.</p>",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "44534",
      "postDate": "05/14/2014 14:25:10",
      "content": "<p>This information is written in the current topic which is 'Challenge ended', thus rather viewed by most of participants; no need to read the external site.</p>\n<p>But I guess just an email about it to all participants might be sufficient.</p>",
      "rawMarkdown": "",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 43937,
      "author_name": "glouppe",
      "author_url": "",
      "post_date": "05/06/2014 07:17:54",
      "content": "<p>Great! Thanks Isabelle for the&nbsp;excerpt of the final leaderboard. We will prepare fact sheets and our models as quickly as possible.</p>\n<p>Congratulations to everyone participating on the challenge. This last week was quite intense :-)&nbsp;</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 43972,
      "author_name": "mossadnik",
      "author_url": "",
      "post_date": "05/06/2014 11:14:08",
      "content": "<p>Thanks for the information, and even more for organizing this great competition!</p>\n<p>Unfortunately, I cannot see the excerpt, there is only the word &quot;Winners&quot; in plain text ... or am I overlooking something?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 43973,
      "author_name": "glouppe",
      "author_url": "",
      "post_date": "05/06/2014 11:18:51",
      "content": "<p>Matthias: See&nbsp;https://1601b3be-a-98cb7308-s-sites.googlegroups.com/a/chalearn.org/connectomics/home/winners.jpg</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 43985,
      "author_name": "sagredo",
      "author_url": "",
      "post_date": "05/06/2014 12:07:52",
      "content": "<p>Congratulations Matthias for your provisional second place!</p>\n<p>And BTW, did you receive my e-mail this morning? Otherwise, it might mean that I sent it to a different Matthias Ossadnik as a mistake!</p>\n<p>Demian: demian.battaglia@univ-amu.fr</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 43989,
      "author_name": "orlandi",
      "author_url": "",
      "post_date": "05/06/2014 12:36:44",
      "content": "<p>Congratulations to everyone!</p>\n<p>It's been wonderful to be involved in the challenge.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 43992,
      "author_name": "lejlot",
      "author_url": "",
      "post_date": "05/06/2014 12:40:26",
      "content": "<p>Why is the rest of private leaderboard not avaliable? Even if it is not official, it would be nice to know how big were the differences on the test set. Looking at top3 scores it seems they were even tighter than on the valid one, I must admit I'm quite curious.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 43999,
      "author_name": "orlandi",
      "author_url": "",
      "post_date": "05/06/2014 13:07:38",
      "content": "<p>I'd see no problem with that. I will check first that it doesn't break any Kaggle or challenge-specific rules.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 44023,
      "author_name": "sagredo",
      "author_url": "",
      "post_date": "05/06/2014 13:26:35",
      "content": "<p>Well, the reason is that when the private leaderboard is made public it is authoritative, so it cannot be made officially public before the validation for the top three participants (the ones that get prizes) is performed.</p>\n<p>Just as a (unbinding) teaser, here some extra ranks beyond the (provisionally) first three:</p>\n<p>1 AAAGV &nbsp;0.9416</p>\n<p>2 Matthias Ossadnik 0.9410</p>\n<p>3 Ildefons Magrans 0.9406</p>\n<p>4 Lukasz 8000 0.9396</p>\n<p>5 Lejlot &amp; Rafal 0.9383</p>\n<p>6 Sium &nbsp;0.9371</p>\n<p>7 Alexander N &amp; vopern 0.9367</p>\n<p>8 gaucho81 0.9338</p>\n<p>9 killertom 0.9301</p>\n<p>10 dhanson 0.9288</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 44277,
      "author_name": "selfishgene",
      "author_url": "",
      "post_date": "05/08/2014 20:18:59",
      "content": "<p>hmm, just a quick question. does every participant in the competition has to submit the fact sheet before the official results will be published?&nbsp;just asking because&nbsp;I think some of the participants probably won't ever submit the fact sheet, and I'm a little curious what will happen to those participants that didn't submit the fact sheets? will they be removed from the final leaderboard standings?<br><br></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 44487,
      "author_name": "iguyon",
      "author_url": "",
      "post_date": "05/13/2014 20:40:26",
      "content": "<p><a href=\"https://docs.google.com/a/chalearn.org/spreadsheet/viewform?formkey=dFNtQWxsSjhvbEd5UGhNNGoyUmxPQmc6MA#gid=0\">Please remember to fill out your fact sheet before May 20</a>. We encourage all the participants to fill out fact sheets. This will make the analysis much more interesting. <a href=\"https://docs.google.com/a/chalearn.org/viewer?a=v&pid=sites&srcid=Y2hhbGVhcm4ub3JnfGNvbm5lY3RvbWljc3xneDo2NzE4Njg5Mzk0NTY2MTFi\">Our rules indicate</a>&nbsp;(Section 4):</p>\n<p><em><strong>(b) Fact sheets: To be part of the final ranking the participants will be asked to fill out a</strong></em></p>\n<p><em><strong>survey (fact sheet) briefly describing their method. Publishing a more detailed paper in</strong></em></p>\n<p><em><strong>the proceedings of the workshop is optional.</strong></em></p>\n<p>You can take a look at the <a href=\"https://docs.google.com/a/chalearn.org/viewer?a=v&pid=sites&srcid=Y2hhbGVhcm4ub3JnfGNvbm5lY3RvbWljc3xneDo1OTkwMWM5MWJkN2NjYzZj&pli=1\">present summary</a>&nbsp;from 19 respondents.</p>\n<p>The final official ranking on which we will base further analyses and publications will include only the participants who do not turn in fact sheets, because it is virtually impossible to say anything interesting about a contribution for which nothing is known.</p>\n<p>Thank you in advance for putting in the effort!</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 44532,
      "author_name": "alexandern0",
      "author_url": "",
      "post_date": "05/14/2014 14:05:26",
      "content": "<p>This information is hidden on an external site and I suspect that most participants are not aware of this rule. Disqualifying the 85% which did not fill out the fact sheets would rob them of their achieved rank and diminish the value for those who did. So please don't.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 44534,
      "author_name": "lukasz8000",
      "author_url": "",
      "post_date": "05/14/2014 14:25:10",
      "content": "<p>This information is written in the current topic which is 'Challenge ended', thus rather viewed by most of participants; no need to read the external site.</p>\n<p>But I guess just an email about it to all participants might be sufficient.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "43934": "",
    "43937": "",
    "43972": "",
    "43973": "",
    "43985": "",
    "43989": "",
    "43992": "",
    "43999": "",
    "44023": "",
    "44277": "",
    "44487": "",
    "44532": "",
    "44534": ""
  },
  "source": "meta"
}