{ "id": 11237, "title": "The sockpuppets have arrived...", "url": "/competitions/avazu-ctr-prediction/discussion/11237", "author_name": "", "post_date": "2014-12-15T00:38:28.490Z", "votes": 5, "comment_count": 6, "views": 1667, "content": "

I see several large teams with inexperienced members. And I see new novice accounts getting good scores with few submissions. If you are new to kaggle, please be aware that at the end of the competition the submissions will be compared and if the admins can determine that someone has submitted from multiple accounts, including an account other than their team account, both the dummy account and the team account will be removed from the leaderboard. They won't care if it was an innocent mistake, or that it didn't make a difference in your final result.

", "messages": [ { "id": "60214", "postDate": "12/15/2014 00:38:28", "content": "

I see several large teams with inexperienced members. And I see new novice accounts getting good scores with few submissions. If you are new to kaggle, please be aware that at the end of the competition the submissions will be compared and if the admins can determine that someone has submitted from multiple accounts, including an account other than their team account, both the dummy account and the team account will be removed from the leaderboard. They won't care if it was an innocent mistake, or that it didn't make a difference in your final result.

", "rawMarkdown": "", "votes": null }, { "id": "60218", "postDate": "12/15/2014 02:47:39", "content": "

there are lots of cheaters in this competition! I  noticed

", "rawMarkdown": "", "votes": null }, { "id": "60219", "postDate": "12/15/2014 03:00:52", "content": "

There are people who cheat deliberately, but there are other situations where skilled competitors don't quite understand the rules and get disqualified. Our team originally finished 7th on KDD, but when the dust settled we were in 4th. None of those teams in the top six needed to cheat, but they were big teams and it only takes one person to decide to make one submission through another account and you're out of the competition. It was after KDD that kagel added SMS account verification, which has greatly reduced multiple account disqualifications.

", "rawMarkdown": "", "votes": null }, { "id": "60265", "postDate": "12/15/2014 19:49:52", "content": "

[quote=James King;60214]

\n

I see several large teams with inexperienced members. And I see new novice accounts getting good scores with few submissions. If you are new to kaggle, please be aware that at the end of the competition the submissions will be compared and if the admins can determine that someone has submitted from multiple accounts, including an account other than their team account, both the dummy account and the team account will be removed from the leaderboard. They won't care if it was an innocent mistake, or that it didn't make a difference in your final result.

\n

[/quote]

\n

Are you referring to something other than the MLCLASS teams? In a setting like that exchange of ideas outside of teams is pretty much inevitable...

", "rawMarkdown": "", "votes": null }, { "id": "60279", "postDate": "12/15/2014 20:57:50", "content": "

I did see that the MLCLASS teams have lots of novice members. I was just trying to warn new players about the multiple account submission rules, since it seems that in the past "you can only have one kaggle account" hasn't been clear enough.

\n

If they exchange ideas outside of teams that's against the rules too (unless they do it on the forum), but I suppose there's nothing I can do about that.

", "rawMarkdown": "", "votes": null }, { "id": "60334", "postDate": "12/16/2014 10:35:47", "content": "

How would anyone try to cheat in this competition if we've got ~5 mln test samples? It would take a looong time to fit LB with different submissions.

", "rawMarkdown": "", "votes": null }, { "id": "60336", "postDate": "12/16/2014 10:52:14", "content": "

It's a good reminder that submissions cannot be made from several accounts by the same user, but I don't think it's a good idea to find patterns of cheaters or discuss possible ways to cheat.

\n


I’m confident Kaggle is smart enough to deal with this issue and that there are less cheaters getting away with it in Kaggle competitions than in any other competition.

", "rawMarkdown": "", "votes": null } ], "comments": [ { "id": 60218, "author_name": "herimanitra", "author_url": "", "post_date": "12/15/2014 02:47:39", "content": "

there are lots of cheaters in this competition! I  noticed

", "votes": null, "replies": [] }, { "id": 60219, "author_name": "jfkingiii", "author_url": "", "post_date": "12/15/2014 03:00:52", "content": "

There are people who cheat deliberately, but there are other situations where skilled competitors don't quite understand the rules and get disqualified. Our team originally finished 7th on KDD, but when the dust settled we were in 4th. None of those teams in the top six needed to cheat, but they were big teams and it only takes one person to decide to make one submission through another account and you're out of the competition. It was after KDD that kagel added SMS account verification, which has greatly reduced multiple account disqualifications.

", "votes": null, "replies": [] }, { "id": 60265, "author_name": "adjgiulio", "author_url": "", "post_date": "12/15/2014 19:49:52", "content": "

[quote=James King;60214]

\n

I see several large teams with inexperienced members. And I see new novice accounts getting good scores with few submissions. If you are new to kaggle, please be aware that at the end of the competition the submissions will be compared and if the admins can determine that someone has submitted from multiple accounts, including an account other than their team account, both the dummy account and the team account will be removed from the leaderboard. They won't care if it was an innocent mistake, or that it didn't make a difference in your final result.

\n

[/quote]

\n

Are you referring to something other than the MLCLASS teams? In a setting like that exchange of ideas outside of teams is pretty much inevitable...

", "votes": null, "replies": [] }, { "id": 60279, "author_name": "jfkingiii", "author_url": "", "post_date": "12/15/2014 20:57:50", "content": "

I did see that the MLCLASS teams have lots of novice members. I was just trying to warn new players about the multiple account submission rules, since it seems that in the past "you can only have one kaggle account" hasn't been clear enough.

\n

If they exchange ideas outside of teams that's against the rules too (unless they do it on the forum), but I suppose there's nothing I can do about that.

", "votes": null, "replies": [] }, { "id": 60334, "author_name": "ivanlobov", "author_url": "", "post_date": "12/16/2014 10:35:47", "content": "

How would anyone try to cheat in this competition if we've got ~5 mln test samples? It would take a looong time to fit LB with different submissions.

", "votes": null, "replies": [] }, { "id": 60336, "author_name": "fernandoconstantino", "author_url": "", "post_date": "12/16/2014 10:52:14", "content": "

It's a good reminder that submissions cannot be made from several accounts by the same user, but I don't think it's a good idea to find patterns of cheaters or discuss possible ways to cheat.

\n


I’m confident Kaggle is smart enough to deal with this issue and that there are less cheaters getting away with it in Kaggle competitions than in any other competition.

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "60214": "", "60218": "", "60219": "", "60265": "", "60279": "", "60334": "", "60336": "" }, "source": "meta" }