{ "id": 10887, "title": "Competition put on hold", "url": "/competitions/avazu-ctr-prediction/discussion/10887", "author_name": "Will Cukierski", "post_date": "2014-11-10T14:41:07.203000", "votes": 3, "comment_count": 63, "views": 24359, "content": "

This competition is temporarily on hold while we investigate a potential issue with the data set. Apologies for the inconvenience.

", "messages": [ { "id": 58047, "postDate": "2014-11-14T02:10:27.613Z", "content": "

Hi all,

\n

Please don't associate lack of public commentary with not caring; we want to approach these issues in a calm, reasonable manner, particularly when there is uncertainty in timelines. It is not productive for us to flail around in the forums, make up idle deadlines, or promise you things that won't happen.

\n

The competition will resume early next week and yes, the deadline will be extended to compensate for lost time. Thank you for your continued professionalism and enthusiasm to get this back and running.

", "votes": 21 }, { "id": 57615, "postDate": "2014-11-10T16:18:07.770Z", "content": "

To the organizers: I am hoping this is not about the md5 columns. However, if you are considering using cryptographically stronger (khm, khm) anonymization, consider this. Most of the competitors already have the poorly anonymized data, so you cannot really hide these columns anymore. Changing the encoding scheme is only going to: (a) introduce a disadvantage for new competitors  (b) introduce a gray area within the rules <- even if reverse engineering using old data is forbidden, it is really impossible to decide whether or not it has been used for model selection or tuning of some parameters. 

\n

Marcin

", "votes": 21 }, { "id": 58042, "postDate": "2014-11-14T01:25:50.887Z", "content": "

There have been great competitions and really screwed up ones. Higgs, Yandex, Avito, and Tradeshift I thought were great. The Higgs admins responded promptly to questions and gave an exhaustive summary at the end of the competition. And then their were the train wrecks like the facebook leak and the "golden features" on denied/approved. The Walmart guys wanted to estimate the impact of discounts in a recruiting competition but neglected to give enough data to estimate those impacts.

\n

But there's been great stuff like what Triskelion taught about Vowpal Wabbit, the tinrtgu code with the unique decay rule for gradient descent, xgboost(!), the clever encoding of categorical features by SVC on tradeshift, you could go on. These make it worth it to me.

\n

Yes, being ignored when you put up a post that says "admins please response" is just not right. Nothing is more aggravating than being ignored, when it's our work that's being sold.

\n

But I can't worry about this now, I have five epileptic dogs running around the house ... oh, no wait, that's in my virtual world.

", "votes": 15 }, { "id": 57814, "postDate": "2014-11-11T16:23:09.323Z", "content": "

It takes time to pull and prepare new data, and the world is not on your time zone. Please be patient.

", "votes": 15 }, { "id": 58325, "postDate": "2014-11-18T18:07:41.890Z", "content": "

The new dataset and leaderboard is live.

", "votes": 13 }, { "id": 57893, "postDate": "2014-11-12T10:14:01.873Z", "content": "

[quote=laserwolf;57892]

\n

2) keep the contest fair to competitors who have not downloaded the old data.

\n

they can't do both.

\n

[/quote]

\n

I downloaded the old data and totally ignored all the decrypting. Sometimes that kind of knowledge is more distracting than worthwhile.

", "votes": 9 }, { "id": 58051, "postDate": "2014-11-14T02:41:09.777Z", "content": "

[quote=William Cukierski;58047]

\n

Hi all,

\n

Please don't associate lack of public commentary with not caring; we want to approach these issues in a calm, reasonable manner, particularly when there is uncertainty in timelines. It is not productive for us to flail around in the forums, make up idle deadlines, or promise you things that won't happen.

\n

The competition will resume early next week and yes, the deadline will be extended to compensate for lost time. Thank you for your continued professionalism and enthusiasm to get this back and running.

\n

[/quote]

\n\n

we totally have a need for rash chaotic lunicy with irrational statements and impossible promises. But fear not! We are a self fulfilling audience. Be sure that we'll take everything you say out of context and make lude grotesque unmeasured slanderous remarks to slate out viscous need. My arms are flailing right now!! I can hardly stand my own mockery of my self! Who the hell do I think I am! And lo it is glourious!!! Sincerely - the audiance.

", "votes": 8 }, { "id": 57832, "postDate": "2014-11-11T18:12:42.187Z", "content": "

Google translate for this thread! https://isc.sans.edu/tools/reversehash.html

", "votes": 5 }, { "id": 57820, "postDate": "2014-11-11T17:01:48.417Z", "content": "

Kaggle junkies need their next fix. lol

", "votes": 5 }, { "id": 57612, "postDate": "2014-11-10T15:54:21.413Z", "content": "

Salt them hashes. ;)

", "votes": 6 }, { "id": 58392, "postDate": "2014-11-19T11:58:25.557Z", "content": "

Dimitry:

\n

Variables device_os, device_make, device_geo_country, C22, C23 and C24 are out.

\n

C14-C18 seem to be now C17-C21. Dataset moves to end of month.

", "votes": 3 }, { "id": 58050, "postDate": "2014-11-14T02:22:17.417Z", "content": "

Take two more weeks if it's the difference between getting it right and getting it wrong. I think most of us understand the uncertainty in estimating how long something like this will take.

", "votes": 3 }, { "id": 58038, "postDate": "2014-11-14T00:30:59.667Z", "content": "

A bump to get this above the restart post on the forum page - at least one person other than me was confused.

", "votes": 3 }, { "id": 57963, "postDate": "2014-11-13T01:54:40.197Z", "content": "

Yes. When I've worked on projects like this inside large companies, you use all the salient features at your disposal. I understand that transparency around actual countries may be undesirable, but a client local time field (instead of a server time field) would be the better feature to use with this project.

In fact, if the contest continues to use a completely anonymized device_geo_country field (this time one that can't be easily reverse engineered), my next step would be to plot click rates per hour of the day split out by device_geo_country, and calculate the phase difference for each country.

Note that as long as server time is provided in UTC, this technique would enable any sufficiently-motivated competitor to roughly infer actual country values encoded by device_geo_country (or anyway, longitude), which will defeat the purpose of obfuscating it. If you don't want people to reverse engineer a feature such as country, then it shouldn't be provided at all, and instead provide a different, safer, salient feature (such as approximate client-local hour-of-day).

", "votes": 3 }, { "id": 57934, "postDate": "2014-11-12T17:43:05.393Z", "content": "

[quote=laserwolf;57892]

\n

forgive me for being skeptical about this contest. the organizers have a conundrum. how do they:

\n

1) protect their user data

\n

2) keep the contest fair to competitors who have not downloaded the old data.

\n

they can't do both.

\n

[/quote]

\n

The problem here is 99% a privacy problem and not a fairness problem. The privacy problem is not solvable now that the weakly anonymized data has been widely downloaded, but the organizers can at least attempt to mitigate it by releasing new data and hoping we forget about the problem. 

\n

In terms of fairness, there is hardly any useful information you could extract from the deanonymized data that you couldn't see with the anonymized data. You don't care if the string you're looking at is "facebook.com" or "2343ec78". 

\n

The only case I can imagine would be if you work at a Criteo-like company and have access to your own similar data: deanonymation would then allow you to leverage your own data for the contest. But that's not very likely to happen, and any such solution would not be eligible to win anyway.

", "votes": 3 }, { "id": 57933, "postDate": "2014-11-12T17:32:30.807Z", "content": "

@valera probably you haven't been through this before, but every time there is a contest where data is refreshed, someone asks if he can get the old data. The admins always say no and warn that rehosting data is against the rules. 

\n

Discussions then take place about whether the people who entered early and presumably have the old data have an advantage. Various arguments that they do or don't are presented.

\n

The outcome is always the same, which is that Kaggle does not give out the data that they previously took down.

\n

It was rather harsh to downvote valera so much when he/she was asking an innocent question. Probably the downvoters just don't want to go through the whole "give me the old data/no/it's unfair/no it isn't/" discussion they've seen previously.

", "votes": 3 }, { "id": 57848, "postDate": "2014-11-11T21:10:37.830Z", "content": "

[quote=ACS69;57830]

\n

[quote=James King;57826]

\n

Laserwolf is understandably skeptical about whether it is possible to go forward, but if new data is being pulled it sounds like the contest will proceed, which makes me very happy.

\n

755f85c2723bb39381c7379a604160d8 867c4235c7d5abbefd2b8abd92b57f8a

\n

ed881bac6397ede33c0a285c9f50bb83 !!

\n

[/quote]

\n

71d3e8b42792b5e476804f4f7fbddc58

\n

[/quote]

\n

For lazy guys:

\n

Good luck

\n

everyone !!

\n

Thanks

", "votes": 3 }, { "id": 57891, "postDate": "2014-11-12T09:46:42.967Z", "content": "

[quote=valera;57886]

\n

could somebody please share data on s3 or the like? 

\n

[/quote]

\n

You should not ask for that

\n

A) it is against the rules
B) eventually we will get new data anyway

Btw I also wait for the data release and competition restart but I also realize that the competition will only end in next January so we can give the sponsors/administrators a few days patience...

", "votes": 4 }, { "id": 57826, "postDate": "2014-11-11T17:51:36.960Z", "content": "

Laserwolf is understandably skeptical about whether it is possible to go forward, but if new data is being pulled it sounds like the contest will proceed, which makes me very happy.

\n

755f85c2723bb39381c7379a604160d8 867c4235c7d5abbefd2b8abd92b57f8a

\n

ed881bac6397ede33c0a285c9f50bb83 !!

", "votes": 4 }, { "id": 57606, "postDate": "2014-11-10T14:41:07.203Z", "content": "

This competition is temporarily on hold while we investigate a potential issue with the data set. Apologies for the inconvenience.

", "votes": 3 }, { "id": 58369, "postDate": "2014-11-19T05:11:56.160Z", "content": "

[quote=William Cukierski;58325]

\n

The new dataset and leaderboard is live.

\n

[/quote]

\n

We of course can research what differences between new and old dataset, but I think it would be great to share what was changed, if it is possible.

", "votes": 2 }, { "id": 58090, "postDate": "2014-11-14T21:21:47.880Z", "content": "

[quote=James King;58050]

\n

Take two more weeks if it's the difference between getting it right and getting it wrong. I think most of us understand the uncertainty in estimating how long something like this will take.

\n

[/quote]

\n

Exactly. For us participants, having the peace of mind of knowing that we can start working without having to worry about future problems is much more important than waiting a few days. Take your time, and make sure the new data files are the last we see. 

\n

Thank you.

", "votes": 2 }, { "id": 57827, "postDate": "2014-11-11T17:53:42.473Z", "content": "

9cdfb439c7876e703e307864c9167a15

", "votes": 2 }, { "id": 57940, "postDate": "2014-11-12T19:11:34.157Z", "content": "

[quote=Yellowduck;57938]

\n

... Not only are behaviors here incompatible with employment with a reputable organisation in any role, these actions have also wasted the time of hundreds of people who collectively have lost person years' of life.

\n

[/quote]

\n

'Kagglers shanghaied into Avazu competition. Lives lost.'

", "votes": 3 }, { "id": 57862, "postDate": "2014-11-11T23:47:06.467Z", "content": "

When can we expect the contest to resume?

", "votes": 1 }, { "id": 58230, "postDate": "2014-11-17T21:29:40.387Z", "content": "

[quote=Toby Cheese;58227]

\n

Ahhh, good. Now that the seizure prediction is practically over and this one is on hold, there is finally some time to rest. Lately, there were just too many interesting competitions with deadlines too close to each other.

\n

[/quote]

\n

I feel the same way. I've got two previous competitions I still need to finish writing up.

\n

I've also suddenly found the time to do some long-overdue tasks, such as upgrading the CPU fan on my rig which was noisy as heck. No way I'm going to do that mid-competition, for fear of screwing something up.

", "votes": 1 }, { "id": 58227, "postDate": "2014-11-17T20:52:42.457Z", "content": "

Ahhh, good. Now that the seizure prediction is practically over and this one is on hold, there is finally some time to rest. Lately, there were just too many interesting competitions with deadlines too close to each other.

\n

Please, take your time, this allows me to to some long-overdue reading. There's lots of splendid competition-winning code to learn from and lots of theory topics to read up on.

", "votes": 1 }, { "id": 58036, "postDate": "2014-11-14T00:27:06.777Z", "content": "

Is the deadline going to be extended due to all these restarts?

", "votes": 1 }, { "id": 57936, "postDate": "2014-11-12T18:22:21.903Z", "content": "

I mean, guys, seriously, stop being like you are the center of the world.

\n

Avazu is doing business that worth millions of dollars, and the grand prize of this tiny competition is just a couple of thousands. This is not even comparable.

\n

Face the truth: it's just a small competition that turns out to be a bite on their ass. They have every right to immediately cancel the competition and sue anyone who benefits improperly from the cracked data. Fairness of this competition is NOTHING compared to the risk they are taking now.

\n

If I were some guy in Avazu, I would let my business go on without any fancy data science prediction given the privacy issue is most slightly concerned.

", "votes": 1 }, { "id": 57618, "postDate": "2014-11-10T16:55:30.077Z", "content": "

Good point, Marcin, I was actually just thinking about this.  At this point you can't just re-anonymize the data.  I don't know what Kaggle and Avazu can do that is fair at this point, though.

", "votes": 1 }, { "id": 58039, "postDate": "2014-11-14T00:34:47.740Z", "content": "

[Edited, unnecessary pessimism]

" }, { "id": 58052, "postDate": "2014-11-14T02:58:17.230Z", "content": "

[quote=j_scheibel;58051]

\n

make lude grotesque unmeasured slanderous remarks to slate out viscous need. My arms are flailing right now!! I can hardly stand my own mockery of my self! 

\n

[/quote]

\n

They have a pill for that now...

\n\n

+1 - I'm still laughing...

", "votes": 2 }, { "id": 58041, "postDate": "2014-11-14T00:42:45.280Z", "content": "

[quote=fchollet;58039]

\n

Is there still anyone taking this competition seriously? Or Kaggle for that matter?

\n

[/quote]

\n

It is hard to say, Sadly Kaggle seems not to be able to present status updates. Things take time, no doubt, but updates seem like a basic professional courtesy for modelers working hard on one of their challenges.

", "votes": 2 }, { "id": 57941, "postDate": "2014-11-12T19:29:17.407Z", "content": "

[quote=laserwolf;57892]

\n

1) protect their user data

\n

[/quote]

\n

I don't think this about protecting user data. It's a competitive advantage for other advertisers/publishers to know what sites or apps have high CTRs.

\n

There's a whole industry devoted to spying on ads, trying to figure out who's running what where, and whether it is profitable. Performance marketing is all about finding veins of gold out of the billions of impressions available.

\n

They don't want to give their competitors an advantage.

", "votes": 2 }, { "id": 57738, "postDate": "2014-11-11T02:56:35.177Z", "content": "

Just finished Tradeshift and prepare to start this competition... Hope the changes to data set won't lead to any unfair issues to new competitors :)

", "votes": 2 }, { "id": 57616, "postDate": "2014-11-10T16:42:22.867Z", "content": "

String values should not really be used as field values. I'd say just use integers...just encode each distinct field values using distinct integers.

\n\n

It makes life much easier, no risk for cracking, and no chances of collision (probably minor).

\n\n

In retrospect, Criteo played it more safely. They didn't even disclose the name of each field. Although that's the top most reason I didn't want to engage to their competition. Too boring and feels no respect.

\n\n

So, fun with risks, or boring with security. Which do you guys want?

", "votes": 2 }, { "id": 58291, "postDate": "2014-11-18T09:40:09.740Z", "content": "

Are we going to have totally different dataset so then we should train (all) previous models or only problematic column(s) from the previous one will be replaced?

" }, { "id": 57930, "postDate": "2014-11-12T17:06:03.613Z", "content": "

[quote=laserwolf;57892]

\n

forgive me for being skeptical about this contest. the organizers have a conundrum. how do they:

\n

1) protect their user data

\n

2) keep the contest fair to competitors who have not downloaded the old data.

\n

they can't do both.

\n

[/quote]

\n\n

Organizers just have to add one extra rule stating that old data cannot be used:   http://www.kaggle.com/c/avazu-ctr-prediction/rules

\n\n

If anybody decides to disregard that rule (or any other), hopefully he will be disqualified. 

" }, { "id": 57892, "postDate": "2014-11-12T10:04:32.930Z", "content": "

forgive me for being skeptical about this contest. the organizers have a conundrum. how do they:

\n

1) protect their user data

\n

2) keep the contest fair to competitors who have not downloaded the old data.

\n

they can't do both.

" }, { "id": 58012, "postDate": "2014-11-13T17:13:01.913Z", "content": "

Finally, what happens to the data and the competition?

", "votes": 1 }, { "id": 57960, "postDate": "2014-11-13T01:22:52.770Z", "content": "

If you change how the device_geo_country field is encoded, could you provide approximate client local time? (or a proxy such as local timezone, unanonymized client country, etc.)

In my past experience, client-local time-of-day (and day-of-week) has a significant impact on click rates (not just for ad clicks, but for all website and mobile behavior).

", "votes": 1 }, { "id": 57938, "postDate": "2014-11-12T18:45:10.937Z", "content": "

Some here could do with a going for training, passing the assessment and then adopting into their lives the basics taught in every business ethics course.

\n

Not only are behaviors here incompatible with employment with a reputable organisation in any role, these actions have also wasted the time of hundreds of people who collectively have lost person years' of life.

" }, { "id": 57812, "postDate": "2014-11-11T16:16:07.183Z", "content": "

no communication for 24 hrs. i guess this competition is done.

", "votes": -5 }, { "id": 58045, "postDate": "2014-11-14T01:46:16.390Z", "content": "

Oh come on! It's been two days, when could we keep on going? 

\n

Sorry for complaining and good to see everything continues :P

", "votes": -5 }, { "id": 57886, "postDate": "2014-11-12T09:39:13.393Z", "content": "

could somebody please share data on s3 or the like? 

", "votes": -5 }, { "id": 58315, "postDate": "2014-11-18T14:49:06.027Z", "content": "

where can I get the dataSet?

", "votes": -3 }, { "id": 57638, "postDate": "2014-11-10T18:29:15.467Z", "content": "

I'd also recode the Id field. I did not check it but it seemed to be an autoincrement field.

\n

I was already wondering if one could squeeze some information out of that field.

\n

For instance.. if the click-sampling strategy is "take first X clicks" then you might deduce something about the click frequency in the test-set.

\n

Next to this.. rehashing without recoding the id's would give the opportunity to recode the data back to the original values..

", "votes": -1 }, { "id": 58331, "postDate": "2014-11-18T18:33:26.207Z", "content": "

[quote=William Cukierski;58325]

\n

The new dataset and leaderboard is live.

\n

[/quote]

\n

Is it possible to have the 7zip version?

" }, { "id": 58328, "postDate": "2014-11-18T18:31:42.630Z", "content": "

Sweet!

\n

1G training data, it is bigger than Tradeshift.......

" }, { "id": 58327, "postDate": "2014-11-18T18:21:46.883Z", "content": "

cheers!

" }, { "id": 58323, "postDate": "2014-11-18T17:51:12.500Z", "content": "

[quote=William Cukierski;57814]

\n

It takes time to pull and prepare new data...

\n

[/quote]

\n

@Herimanitra

\n

I think it's safe to assume that all the data will be replaced.

" }, { "id": 58319, "postDate": "2014-11-18T16:10:40.143Z", "content": "

The competition is on hold and you cannot download the dataset until it reopens. Those who entered the competition before it was paused may have old versions of the data, but Kaggle does not allow us to share them.

" }, { "id": 58070, "postDate": "2014-11-14T13:08:28.657Z", "content": "

[quote=j_scheibel;58051]

\n

we totally have a need for rash chaotic lunicy with irrational statements and impossible promises. But fear not! We are a self fulfilling audience. Be sure that we'll take everything you say out of context and make lude grotesque unmeasured slanderous remarks to slate out viscous need. My arms are flailing right now!! I can hardly stand my own mockery of my self! Who the hell do I think I am! And lo it is glourious!!! Sincerely - the audiance.

\n

[/quote]

\n

Epic.

" }, { "id": 57977, "postDate": "2014-11-13T10:10:41.093Z", "content": "

Hi Admin,

\n

I'm really surprised.

\n

I hope my question about if each value of geo country represented a different country did not create any problem. Instead I see that it has served to verify that there were people who had decoded!

\n

In particular, despite the little time I have to devote to this, I deleted the old data while waiting for the new data. I hope the rest do the same to compete fairly

\n

regards

" }, { "id": 57974, "postDate": "2014-11-13T08:50:39.677Z", "content": "

@DumbLearner - see first post in this topic:

\n

[quote=William Cukierski;57606]

\n

This competition is temporarily on hold while we investigate a potential issue with the data set. Apologies for the inconvenience.

\n

[/quote]

" }, { "id": 57971, "postDate": "2014-11-13T07:54:40.843Z", "content": "

Can participate in this competition?  Is this competition on hold ?

" }, { "id": 57962, "postDate": "2014-11-13T01:46:07.853Z", "content": "

[quote=Synthient;57960]

\n

If you change how the device_geo_country field is encoded, could you provide approximate client local time? (or a proxy such as local timezone, unanonymized client country, etc.)

In my past experience, client-local time-of-day (and day-of-week) has a significant impact on click rates (not just for ad clicks, but for all website and mobile behavior).

\n

[/quote]

\n

This could be the major motivation to hack the device_geo_country in the first place.

" }, { "id": 57830, "postDate": "2014-11-11T18:03:49.370Z", "content": "

[quote=James King;57826]

\n

Laserwolf is understandably skeptical about whether it is possible to go forward, but if new data is being pulled it sounds like the contest will proceed, which makes me very happy.

\n

755f85c2723bb39381c7379a604160d8 867c4235c7d5abbefd2b8abd92b57f8a

\n

ed881bac6397ede33c0a285c9f50bb83 !!

\n

[/quote]

\n

71d3e8b42792b5e476804f4f7fbddc58

" }, { "id": 57806, "postDate": "2014-11-11T15:41:47.110Z", "content": "

[quote=byronyi;57616]

\n

I'd say just use integers...just encode each distinct field values using distinct integers.

\n

[/quote]

\n

I second this.  Indexing the hashed values is probably safe.  Using a salt or stronger hash still leaves brute-force attacks open when we have a good idea of what values were hashed.

" }, { "id": 57739, "postDate": "2014-11-11T02:59:52.810Z", "content": "

Likely the best thing would be to re-hash properly a new 11 days of impressions.

" }, { "id": 57723, "postDate": "2014-11-11T00:47:10.130Z", "content": "

Oh, no...

" }, { "id": 57707, "postDate": "2014-11-11T00:05:22.160Z", "content": "

heh, finally decided to make a submission aaaaaand i can't make one. :( maybe the next dataset will be smaller 47,000,000 rows takes up a lot of memory!

" }, { "id": 57700, "postDate": "2014-11-10T23:57:59.200Z", "content": "

@William: out of curiosity, does that mean another restart + cleanup of the leaderboard?

" }, { "id": 57620, "postDate": "2014-11-10T17:01:37.037Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 58047, "author_name": "Will Cukierski", "author_url": "", "post_date": "2014-11-14T02:10:27.613000", "content": "

Hi all,

\n

Please don't associate lack of public commentary with not caring; we want to approach these issues in a calm, reasonable manner, particularly when there is uncertainty in timelines. It is not productive for us to flail around in the forums, make up idle deadlines, or promise you things that won't happen.

\n

The competition will resume early next week and yes, the deadline will be extended to compensate for lost time. Thank you for your continued professionalism and enthusiasm to get this back and running.

", "votes": 21, "replies": [] }, { "id": 57615, "author_name": "Marcin Mucha", "author_url": "", "post_date": "2014-11-10T16:18:07.770000", "content": "

To the organizers: I am hoping this is not about the md5 columns. However, if you are considering using cryptographically stronger (khm, khm) anonymization, consider this. Most of the competitors already have the poorly anonymized data, so you cannot really hide these columns anymore. Changing the encoding scheme is only going to: (a) introduce a disadvantage for new competitors  (b) introduce a gray area within the rules <- even if reverse engineering using old data is forbidden, it is really impossible to decide whether or not it has been used for model selection or tuning of some parameters. 

\n

Marcin

", "votes": 21, "replies": [] }, { "id": 58042, "author_name": "James King", "author_url": "", "post_date": "2014-11-14T01:25:50.887000", "content": "

There have been great competitions and really screwed up ones. Higgs, Yandex, Avito, and Tradeshift I thought were great. The Higgs admins responded promptly to questions and gave an exhaustive summary at the end of the competition. And then their were the train wrecks like the facebook leak and the "golden features" on denied/approved. The Walmart guys wanted to estimate the impact of discounts in a recruiting competition but neglected to give enough data to estimate those impacts.

\n

But there's been great stuff like what Triskelion taught about Vowpal Wabbit, the tinrtgu code with the unique decay rule for gradient descent, xgboost(!), the clever encoding of categorical features by SVC on tradeshift, you could go on. These make it worth it to me.

\n

Yes, being ignored when you put up a post that says "admins please response" is just not right. Nothing is more aggravating than being ignored, when it's our work that's being sold.

\n

But I can't worry about this now, I have five epileptic dogs running around the house ... oh, no wait, that's in my virtual world.

", "votes": 15, "replies": [] }, { "id": 57814, "author_name": "Will Cukierski", "author_url": "", "post_date": "2014-11-11T16:23:09.323000", "content": "

It takes time to pull and prepare new data, and the world is not on your time zone. Please be patient.

", "votes": 15, "replies": [] }, { "id": 58325, "author_name": "Will Cukierski", "author_url": "", "post_date": "2014-11-18T18:07:41.890000", "content": "

The new dataset and leaderboard is live.

", "votes": 13, "replies": [] }, { "id": 57893, "author_name": "Bluefool", "author_url": "", "post_date": "2014-11-12T10:14:01.873000", "content": "

[quote=laserwolf;57892]

\n

2) keep the contest fair to competitors who have not downloaded the old data.

\n

they can't do both.

\n

[/quote]

\n

I downloaded the old data and totally ignored all the decrypting. Sometimes that kind of knowledge is more distracting than worthwhile.

", "votes": 9, "replies": [] }, { "id": 58051, "author_name": "j_scheibel", "author_url": "", "post_date": "2014-11-14T02:41:09.777000", "content": "

[quote=William Cukierski;58047]

\n

Hi all,

\n

Please don't associate lack of public commentary with not caring; we want to approach these issues in a calm, reasonable manner, particularly when there is uncertainty in timelines. It is not productive for us to flail around in the forums, make up idle deadlines, or promise you things that won't happen.

\n

The competition will resume early next week and yes, the deadline will be extended to compensate for lost time. Thank you for your continued professionalism and enthusiasm to get this back and running.

\n

[/quote]

\n\n

we totally have a need for rash chaotic lunicy with irrational statements and impossible promises. But fear not! We are a self fulfilling audience. Be sure that we'll take everything you say out of context and make lude grotesque unmeasured slanderous remarks to slate out viscous need. My arms are flailing right now!! I can hardly stand my own mockery of my self! Who the hell do I think I am! And lo it is glourious!!! Sincerely - the audiance.

", "votes": 8, "replies": [] }, { "id": 57832, "author_name": "pi_informatics", "author_url": "", "post_date": "2014-11-11T18:12:42.187000", "content": "

Google translate for this thread! https://isc.sans.edu/tools/reversehash.html

", "votes": 5, "replies": [] }, { "id": 57820, "author_name": "inversion", "author_url": "", "post_date": "2014-11-11T17:01:48.417000", "content": "

Kaggle junkies need their next fix. lol

", "votes": 5, "replies": [] }, { "id": 57612, "author_name": "ivo", "author_url": "", "post_date": "2014-11-10T15:54:21.413000", "content": "

Salt them hashes. ;)

", "votes": 6, "replies": [] }, { "id": 58392, "author_name": "gmobaz", "author_url": "", "post_date": "2014-11-19T11:58:25.557000", "content": "

Dimitry:

\n

Variables device_os, device_make, device_geo_country, C22, C23 and C24 are out.

\n

C14-C18 seem to be now C17-C21. Dataset moves to end of month.

", "votes": 3, "replies": [] }, { "id": 58050, "author_name": "James King", "author_url": "", "post_date": "2014-11-14T02:22:17.417000", "content": "

Take two more weeks if it's the difference between getting it right and getting it wrong. I think most of us understand the uncertainty in estimating how long something like this will take.

", "votes": 3, "replies": [] }, { "id": 58038, "author_name": "James King", "author_url": "", "post_date": "2014-11-14T00:30:59.667000", "content": "

A bump to get this above the restart post on the forum page - at least one person other than me was confused.

", "votes": 3, "replies": [] }, { "id": 57963, "author_name": "MichaelB", "author_url": "", "post_date": "2014-11-13T01:54:40.197000", "content": "

Yes. When I've worked on projects like this inside large companies, you use all the salient features at your disposal. I understand that transparency around actual countries may be undesirable, but a client local time field (instead of a server time field) would be the better feature to use with this project.

In fact, if the contest continues to use a completely anonymized device_geo_country field (this time one that can't be easily reverse engineered), my next step would be to plot click rates per hour of the day split out by device_geo_country, and calculate the phase difference for each country.

Note that as long as server time is provided in UTC, this technique would enable any sufficiently-motivated competitor to roughly infer actual country values encoded by device_geo_country (or anyway, longitude), which will defeat the purpose of obfuscating it. If you don't want people to reverse engineer a feature such as country, then it shouldn't be provided at all, and instead provide a different, safer, salient feature (such as approximate client-local hour-of-day).

", "votes": 3, "replies": [] }, { "id": 57934, "author_name": "fchollet", "author_url": "", "post_date": "2014-11-12T17:43:05.393000", "content": "

[quote=laserwolf;57892]

\n

forgive me for being skeptical about this contest. the organizers have a conundrum. how do they:

\n

1) protect their user data

\n

2) keep the contest fair to competitors who have not downloaded the old data.

\n

they can't do both.

\n

[/quote]

\n

The problem here is 99% a privacy problem and not a fairness problem. The privacy problem is not solvable now that the weakly anonymized data has been widely downloaded, but the organizers can at least attempt to mitigate it by releasing new data and hoping we forget about the problem. 

\n

In terms of fairness, there is hardly any useful information you could extract from the deanonymized data that you couldn't see with the anonymized data. You don't care if the string you're looking at is "facebook.com" or "2343ec78". 

\n

The only case I can imagine would be if you work at a Criteo-like company and have access to your own similar data: deanonymation would then allow you to leverage your own data for the contest. But that's not very likely to happen, and any such solution would not be eligible to win anyway.

", "votes": 3, "replies": [] }, { "id": 57933, "author_name": "James King", "author_url": "", "post_date": "2014-11-12T17:32:30.807000", "content": "

@valera probably you haven't been through this before, but every time there is a contest where data is refreshed, someone asks if he can get the old data. The admins always say no and warn that rehosting data is against the rules. 

\n

Discussions then take place about whether the people who entered early and presumably have the old data have an advantage. Various arguments that they do or don't are presented.

\n

The outcome is always the same, which is that Kaggle does not give out the data that they previously took down.

\n

It was rather harsh to downvote valera so much when he/she was asking an innocent question. Probably the downvoters just don't want to go through the whole "give me the old data/no/it's unfair/no it isn't/" discussion they've seen previously.

", "votes": 3, "replies": [] }, { "id": 57848, "author_name": "", "author_url": "", "post_date": "2014-11-11T21:10:37.830000", "content": "

[quote=ACS69;57830]

\n

[quote=James King;57826]

\n

Laserwolf is understandably skeptical about whether it is possible to go forward, but if new data is being pulled it sounds like the contest will proceed, which makes me very happy.

\n

755f85c2723bb39381c7379a604160d8 867c4235c7d5abbefd2b8abd92b57f8a

\n

ed881bac6397ede33c0a285c9f50bb83 !!

\n

[/quote]

\n

71d3e8b42792b5e476804f4f7fbddc58

\n

[/quote]

\n

For lazy guys:

\n

Good luck

\n

everyone !!

\n

Thanks

", "votes": 3, "replies": [] }, { "id": 57891, "author_name": "beluga", "author_url": "", "post_date": "2014-11-12T09:46:42.967000", "content": "

[quote=valera;57886]

\n

could somebody please share data on s3 or the like? 

\n

[/quote]

\n

You should not ask for that

\n

A) it is against the rules
B) eventually we will get new data anyway

Btw I also wait for the data release and competition restart but I also realize that the competition will only end in next January so we can give the sponsors/administrators a few days patience...

", "votes": 4, "replies": [] }, { "id": 57826, "author_name": "James King", "author_url": "", "post_date": "2014-11-11T17:51:36.960000", "content": "

Laserwolf is understandably skeptical about whether it is possible to go forward, but if new data is being pulled it sounds like the contest will proceed, which makes me very happy.

\n

755f85c2723bb39381c7379a604160d8 867c4235c7d5abbefd2b8abd92b57f8a

\n

ed881bac6397ede33c0a285c9f50bb83 !!

", "votes": 4, "replies": [] }, { "id": 58369, "author_name": "Dmitry Dryomov", "author_url": "", "post_date": "2014-11-19T05:11:56.160000", "content": "

[quote=William Cukierski;58325]

\n

The new dataset and leaderboard is live.

\n

[/quote]

\n

We of course can research what differences between new and old dataset, but I think it would be great to share what was changed, if it is possible.

", "votes": 2, "replies": [] }, { "id": 58090, "author_name": "fchollet", "author_url": "", "post_date": "2014-11-14T21:21:47.880000", "content": "

[quote=James King;58050]

\n

Take two more weeks if it's the difference between getting it right and getting it wrong. I think most of us understand the uncertainty in estimating how long something like this will take.

\n

[/quote]

\n

Exactly. For us participants, having the peace of mind of knowing that we can start working without having to worry about future problems is much more important than waiting a few days. Take your time, and make sure the new data files are the last we see. 

\n

Thank you.

", "votes": 2, "replies": [] }, { "id": 57827, "author_name": "Julian de Wit", "author_url": "", "post_date": "2014-11-11T17:53:42.473000", "content": "

9cdfb439c7876e703e307864c9167a15

", "votes": 2, "replies": [] }, { "id": 57940, "author_name": "McSnappy", "author_url": "", "post_date": "2014-11-12T19:11:34.157000", "content": "

[quote=Yellowduck;57938]

\n

... Not only are behaviors here incompatible with employment with a reputable organisation in any role, these actions have also wasted the time of hundreds of people who collectively have lost person years' of life.

\n

[/quote]

\n

'Kagglers shanghaied into Avazu competition. Lives lost.'

", "votes": 3, "replies": [] }, { "id": 57862, "author_name": "Poojit Sharma", "author_url": "", "post_date": "2014-11-11T23:47:06.467000", "content": "

When can we expect the contest to resume?

", "votes": 1, "replies": [] }, { "id": 58230, "author_name": "inversion", "author_url": "", "post_date": "2014-11-17T21:29:40.387000", "content": "

[quote=Toby Cheese;58227]

\n

Ahhh, good. Now that the seizure prediction is practically over and this one is on hold, there is finally some time to rest. Lately, there were just too many interesting competitions with deadlines too close to each other.

\n

[/quote]

\n

I feel the same way. I've got two previous competitions I still need to finish writing up.

\n

I've also suddenly found the time to do some long-overdue tasks, such as upgrading the CPU fan on my rig which was noisy as heck. No way I'm going to do that mid-competition, for fear of screwing something up.

", "votes": 1, "replies": [] }, { "id": 58227, "author_name": "Toby Cheese", "author_url": "", "post_date": "2014-11-17T20:52:42.457000", "content": "

Ahhh, good. Now that the seizure prediction is practically over and this one is on hold, there is finally some time to rest. Lately, there were just too many interesting competitions with deadlines too close to each other.

\n

Please, take your time, this allows me to to some long-overdue reading. There's lots of splendid competition-winning code to learn from and lots of theory topics to read up on.

", "votes": 1, "replies": [] }, { "id": 58036, "author_name": "Nissan Pow", "author_url": "", "post_date": "2014-11-14T00:27:06.777000", "content": "

Is the deadline going to be extended due to all these restarts?

", "votes": 1, "replies": [] }, { "id": 57936, "author_name": "", "author_url": "", "post_date": "2014-11-12T18:22:21.903000", "content": "

I mean, guys, seriously, stop being like you are the center of the world.

\n

Avazu is doing business that worth millions of dollars, and the grand prize of this tiny competition is just a couple of thousands. This is not even comparable.

\n

Face the truth: it's just a small competition that turns out to be a bite on their ass. They have every right to immediately cancel the competition and sue anyone who benefits improperly from the cracked data. Fairness of this competition is NOTHING compared to the risk they are taking now.

\n

If I were some guy in Avazu, I would let my business go on without any fancy data science prediction given the privacy issue is most slightly concerned.

", "votes": 1, "replies": [] }, { "id": 57618, "author_name": "Dmitriy Guller", "author_url": "", "post_date": "2014-11-10T16:55:30.077000", "content": "

Good point, Marcin, I was actually just thinking about this.  At this point you can't just re-anonymize the data.  I don't know what Kaggle and Avazu can do that is fair at this point, though.

", "votes": 1, "replies": [] }, { "id": 58039, "author_name": "", "author_url": "", "post_date": "2014-11-14T00:34:47.740000", "content": "", "votes": 0, "replies": [] }, { "id": 58052, "author_name": "", "author_url": "", "post_date": "2014-11-14T02:58:17.230000", "content": "", "votes": 2, "replies": [] }, { "id": 58041, "author_name": "", "author_url": "", "post_date": "2014-11-14T00:42:45.280000", "content": "", "votes": 2, "replies": [] }, { "id": 57941, "author_name": "", "author_url": "", "post_date": "2014-11-12T19:29:17.407000", "content": "", "votes": 2, "replies": [] }, { "id": 57738, "author_name": "", "author_url": "", "post_date": "2014-11-11T02:56:35.177000", "content": "", "votes": 2, "replies": [] }, { "id": 57616, "author_name": "", "author_url": "", "post_date": "2014-11-10T16:42:22.867000", "content": "", "votes": 2, "replies": [] }, { "id": 58291, "author_name": "", "author_url": "", "post_date": "2014-11-18T09:40:09.740000", "content": "", "votes": 0, "replies": [] }, { "id": 57930, "author_name": "", "author_url": "", "post_date": "2014-11-12T17:06:03.613000", "content": "", "votes": 0, "replies": [] }, { "id": 57892, "author_name": "", "author_url": "", "post_date": "2014-11-12T10:04:32.930000", "content": "", "votes": 0, "replies": [] }, { "id": 58012, "author_name": "", "author_url": "", "post_date": "2014-11-13T17:13:01.913000", "content": "", "votes": 1, "replies": [] }, { "id": 57960, "author_name": "", "author_url": "", "post_date": "2014-11-13T01:22:52.770000", "content": "", "votes": 1, "replies": [] }, { "id": 57938, "author_name": "", "author_url": "", "post_date": "2014-11-12T18:45:10.937000", "content": "", "votes": 0, "replies": [] }, { "id": 57812, "author_name": "", "author_url": "", "post_date": "2014-11-11T16:16:07.183000", "content": "", "votes": -5, "replies": [] }, { "id": 58045, "author_name": "", "author_url": "", "post_date": "2014-11-14T01:46:16.390000", "content": "", "votes": -5, "replies": [] }, { "id": 57886, "author_name": "", "author_url": "", "post_date": "2014-11-12T09:39:13.393000", "content": "", "votes": -5, "replies": [] }, { "id": 58315, "author_name": "", "author_url": "", "post_date": "2014-11-18T14:49:06.027000", "content": "", "votes": -3, "replies": [] }, { "id": 57638, "author_name": "", "author_url": "", "post_date": "2014-11-10T18:29:15.467000", "content": "", "votes": -1, "replies": [] }, { "id": 58331, "author_name": "", "author_url": "", "post_date": "2014-11-18T18:33:26.207000", "content": "", "votes": 0, "replies": [] }, { "id": 58328, "author_name": "", "author_url": "", "post_date": "2014-11-18T18:31:42.630000", "content": "", "votes": 0, "replies": [] }, { "id": 58327, "author_name": "", "author_url": "", "post_date": "2014-11-18T18:21:46.883000", "content": "", "votes": 0, "replies": [] }, { "id": 58323, "author_name": "", "author_url": "", "post_date": "2014-11-18T17:51:12.500000", "content": "", "votes": 0, "replies": [] }, { "id": 58319, "author_name": "", "author_url": "", "post_date": "2014-11-18T16:10:40.143000", "content": "", "votes": 0, "replies": [] }, { "id": 58070, "author_name": "", "author_url": "", "post_date": "2014-11-14T13:08:28.657000", "content": "", "votes": 0, "replies": [] }, { "id": 57977, "author_name": "", "author_url": "", "post_date": "2014-11-13T10:10:41.093000", "content": "", "votes": 0, "replies": [] }, { "id": 57974, "author_name": "", "author_url": "", "post_date": "2014-11-13T08:50:39.677000", "content": "", "votes": 0, "replies": [] }, { "id": 57971, "author_name": "", "author_url": "", "post_date": "2014-11-13T07:54:40.843000", "content": "", "votes": 0, "replies": [] }, { "id": 57962, "author_name": "", "author_url": "", "post_date": "2014-11-13T01:46:07.853000", "content": "", "votes": 0, "replies": [] }, { "id": 57830, "author_name": "", "author_url": "", "post_date": "2014-11-11T18:03:49.370000", "content": "", "votes": 0, "replies": [] }, { "id": 57806, "author_name": "", "author_url": "", "post_date": "2014-11-11T15:41:47.110000", "content": "", "votes": 0, "replies": [] }, { "id": 57739, "author_name": "", "author_url": "", "post_date": "2014-11-11T02:59:52.810000", "content": "", "votes": 0, "replies": [] }, { "id": 57723, "author_name": "", "author_url": "", "post_date": "2014-11-11T00:47:10.130000", "content": "", "votes": 0, "replies": [] }, { "id": 57707, "author_name": "", "author_url": "", "post_date": "2014-11-11T00:05:22.160000", "content": "", "votes": 0, "replies": [] }, { "id": 57700, "author_name": "", "author_url": "", "post_date": "2014-11-10T23:57:59.200000", "content": "", "votes": 0, "replies": [] }, { "id": 57620, "author_name": "", "author_url": "", "post_date": "2014-11-10T17:01:37.037000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "58047": "", "57615": "", "58042": "", "57814": "", "58325": "", "57893": "", "58051": "", "57832": "", "57820": "", "57612": "", "58392": "", "58050": "", "58038": "", "57963": "", "57934": "", "57933": "", "57848": "", "57891": "", "57826": "", "57606": "", "58369": "", "58090": "", "57827": "", "57940": "", "57862": "", "58230": "", "58227": "", "58036": "", "57936": "", "57618": "", "58039": "", "58052": "", "58041": "", "57941": "", "57738": "", "57616": "", "58291": "", "57930": "", "57892": "", "58012": "", "57960": "", "57938": "", "57812": "", "58045": "", "57886": "", "58315": "", "57638": "", "58331": "", "58328": "", "58327": "", "58323": "", "58319": "", "58070": "", "57977": "", "57974": "", "57971": "", "57962": "", "57830": "", "57806": "", "57739": "", "57723": "", "57707": "", "57700": "", "57620": "" } }