{ "id": 2925, "title": "Merck Challenge Final Results", "url": "/competitions/MerckActivity/discussion/2925", "author_name": "", "post_date": "2012-10-18T23:28:00.210Z", "votes": 17, "comment_count": 7, "views": 10263, "content": "

Thank you all for understanding as we have taken a couple extra days to verify the results of the Merck Molecular Activity Challenge.

\r\n

As suspected and discussed on the forums, there were rule violations in this competition. We have reviewed player actions and disqualified those who were found to be in violation of the rules. In addition to being disqualified from all current competitions,\r\n the affected parties are also stripped of all past accomplishments. They are, however, allowed to keep their Kaggle accounts, and allowed to compete in future competitions, provided they follow the rules.
\r\n
\r\nAlthough we understand the urge for more punitive actions (delete account, lifetime ban, public caning), we believe nullifying your Kaggle performance history to be sufficient punishment for a community that values reputation and skill demonstration. Our goal\r\n is to create a lively, competitive, and honest environment where data scientists test their mettle and explore new techniques. Moreover, we want to allow for redemption and in fact encourage past violators to come back and compete cleanly.
\r\n
\r\nCatching rule violators and preventing violations in the first place is important to us. We hate what it does to our community, the unfairness to honest participants, and the effect on the models created. We want to create valid, robust models through legitimate\r\n technical discovery. Puppet accounts and fitting to the leaderboard do not meet those standards. But the reality is that much of fraud detection is a reactive battle. We plan to introduce changes to reduce cheating and puppet account creation, and will continue\r\n to do so as needed.
\r\n
\r\nPlease continue to send your feedback on both on your \r\nideas as well as any suspicious behavior.
\r\n
\r\nThe Merck Activity Challenge private leaderboard is now revealed, and congratulations to all our participants for topping the Merck internal benchmark by over 16%. Well done!

", "messages": [ { "id": "15918", "postDate": "10/18/2012 23:28:00", "content": "

Thank you all for understanding as we have taken a couple extra days to verify the results of the Merck Molecular Activity Challenge.

\r\n

As suspected and discussed on the forums, there were rule violations in this competition. We have reviewed player actions and disqualified those who were found to be in violation of the rules. In addition to being disqualified from all current competitions,\r\n the affected parties are also stripped of all past accomplishments. They are, however, allowed to keep their Kaggle accounts, and allowed to compete in future competitions, provided they follow the rules.
\r\n
\r\nAlthough we understand the urge for more punitive actions (delete account, lifetime ban, public caning), we believe nullifying your Kaggle performance history to be sufficient punishment for a community that values reputation and skill demonstration. Our goal\r\n is to create a lively, competitive, and honest environment where data scientists test their mettle and explore new techniques. Moreover, we want to allow for redemption and in fact encourage past violators to come back and compete cleanly.
\r\n
\r\nCatching rule violators and preventing violations in the first place is important to us. We hate what it does to our community, the unfairness to honest participants, and the effect on the models created. We want to create valid, robust models through legitimate\r\n technical discovery. Puppet accounts and fitting to the leaderboard do not meet those standards. But the reality is that much of fraud detection is a reactive battle. We plan to introduce changes to reduce cheating and puppet account creation, and will continue\r\n to do so as needed.
\r\n
\r\nPlease continue to send your feedback on both on your \r\nideas as well as any suspicious behavior.
\r\n
\r\nThe Merck Activity Challenge private leaderboard is now revealed, and congratulations to all our participants for topping the Merck internal benchmark by over 16%. Well done!

", "rawMarkdown": "", "votes": null }, { "id": "15938", "postDate": "10/19/2012 04:51:58", "content": "

Thanks Kaggle for all your efforts, and it's a pity they were needed.

\r\n

Apologies for the noob question, but will winners be publishing papers? I can't see this in the competition description anywhere, yet would love to know what they did.

", "rawMarkdown": "", "votes": null }, { "id": "15945", "postDate": "10/19/2012 10:39:15", "content": "

[quote=s445203;15938]

\r\n

Apologies for the noob question, but will winners be publishing papers? I can't see this in the competition description anywhere, yet would love to know what they did.

\r\n

[/quote]

\r\n

Yes, we're planning a series of "How I Did It" blog posts from each of the winners so you will definitely get a chance to learn about their models and approaches. Coming soon is a "Winners" page as part of the comp pages, so stay tuned.

", "rawMarkdown": "", "votes": null }, { "id": "18642", "postDate": "12/26/2012 22:16:11", "content": "

The rules state that the winners have to submit code...is that publicly available, or is that only for Merck? Thanks

", "rawMarkdown": "", "votes": null }, { "id": "18683", "postDate": "12/27/2012 17:22:31", "content": "

There's no requirement that the code be made publicly available.

", "rawMarkdown": "", "votes": null }, { "id": "40561", "postDate": "03/18/2014 10:24:38", "content": "

Please, I have few questions:

\n

1- Can the sponsor make the information of the data available, e.g., numerical descriptors meaning, real proteins codes/names, etc.?

\n

2- Can someone make use from the available data in research purpose, e.g., making some advanced ML based scoring function for predicting the activity of the test set or it is exclusive for this competition,

\n

3- Where someone can find the papers, codes, models, resulting from this competition?

\n

4- Does every data set (of the 15 data set) contains the small molecules (ligands) of a specific protein for each data set (total is 15 proteins)

\n

Regards,

", "rawMarkdown": "", "votes": null }, { "id": "40571", "postDate": "03/18/2014 16:17:20", "content": "

Hi Mohamed,

\n

As stated in the Rules, the data may only be used for this competition. Please review the Rules for the answers to your other questions. The results of this competition is private to the competition host.

", "rawMarkdown": "", "votes": null }, { "id": "40611", "postDate": "03/19/2014 07:25:00", "content": "

Thanks a lot Miss Joycenv for your prompt reply!

\n\n

Regards,

\n

Mohamed,

", "rawMarkdown": "", "votes": null } ], "comments": [ { "id": 15938, "author_name": "s445203", "author_url": "", "post_date": "10/19/2012 04:51:58", "content": "

Thanks Kaggle for all your efforts, and it's a pity they were needed.

\r\n

Apologies for the noob question, but will winners be publishing papers? I can't see this in the competition description anywhere, yet would love to know what they did.

", "votes": null, "replies": [] }, { "id": 15945, "author_name": "joycenv", "author_url": "", "post_date": "10/19/2012 10:39:15", "content": "

[quote=s445203;15938]

\r\n

Apologies for the noob question, but will winners be publishing papers? I can't see this in the competition description anywhere, yet would love to know what they did.

\r\n

[/quote]

\r\n

Yes, we're planning a series of "How I Did It" blog posts from each of the winners so you will definitely get a chance to learn about their models and approaches. Coming soon is a "Winners" page as part of the comp pages, so stay tuned.

", "votes": null, "replies": [] }, { "id": 18642, "author_name": "sajidzaidi", "author_url": "", "post_date": "12/26/2012 22:16:11", "content": "

The rules state that the winners have to submit code...is that publicly available, or is that only for Merck? Thanks

", "votes": null, "replies": [] }, { "id": 18683, "author_name": "guycavet", "author_url": "", "post_date": "12/27/2012 17:22:31", "content": "

There's no requirement that the code be made publicly available.

", "votes": null, "replies": [] }, { "id": 40561, "author_name": "mohamedabdelazizkhamis", "author_url": "", "post_date": "03/18/2014 10:24:38", "content": "

Please, I have few questions:

\n

1- Can the sponsor make the information of the data available, e.g., numerical descriptors meaning, real proteins codes/names, etc.?

\n

2- Can someone make use from the available data in research purpose, e.g., making some advanced ML based scoring function for predicting the activity of the test set or it is exclusive for this competition,

\n

3- Where someone can find the papers, codes, models, resulting from this competition?

\n

4- Does every data set (of the 15 data set) contains the small molecules (ligands) of a specific protein for each data set (total is 15 proteins)

\n

Regards,

", "votes": null, "replies": [] }, { "id": 40571, "author_name": "joycenv", "author_url": "", "post_date": "03/18/2014 16:17:20", "content": "

Hi Mohamed,

\n

As stated in the Rules, the data may only be used for this competition. Please review the Rules for the answers to your other questions. The results of this competition is private to the competition host.

", "votes": null, "replies": [] }, { "id": 40611, "author_name": "mohamedabdelazizkhamis", "author_url": "", "post_date": "03/19/2014 07:25:00", "content": "

Thanks a lot Miss Joycenv for your prompt reply!

\n\n

Regards,

\n

Mohamed,

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "15918": "", "15938": "", "15945": "", "18642": "", "18683": "", "40561": "", "40571": "", "40611": "" }, "source": "meta" }