{ "id": 3840, "title": "Competition Entering Final Phase", "url": "/competitions/event-recommendation-engine-challenge/discussion/3840", "author_name": "", "post_date": "2013-02-14T05:44:18.907Z", "votes": null, "comment_count": 12, "views": 5242, "content": "

This competition has now entered its final phase. We've released the public leaderboard answers to remove any informational advantage that participants making more submissions would have (you may download this from the data page).

\r\n

For the final week of the competition, you will only be submitting your results on the private leaderboard set. You can download a sample of the new submission format (as well as the ids for the private leaderboard set) from the data page as event_popularity_benchmark_private_test_only.csv.

\r\n

All submissions from this point forward will receive a score of 0.0 on the public leaderboard. Your score on the private leaderboard will become visible at the end of the competition.

\r\n

Good luck!

", "messages": [ { "id": "20461", "postDate": "02/14/2013 05:44:18", "content": "

This competition has now entered its final phase. We've released the public leaderboard answers to remove any informational advantage that participants making more submissions would have (you may download this from the data page).

\r\n

For the final week of the competition, you will only be submitting your results on the private leaderboard set. You can download a sample of the new submission format (as well as the ids for the private leaderboard set) from the data page as event_popularity_benchmark_private_test_only.csv.

\r\n

All submissions from this point forward will receive a score of 0.0 on the public leaderboard. Your score on the private leaderboard will become visible at the end of the competition.

\r\n

Good luck!

", "rawMarkdown": "", "votes": null }, { "id": "20465", "postDate": "02/14/2013 07:19:07", "content": "

Hi Ben,

\r\n

Can you explain the format of public_leaderboard_solution.csv? 

\r\n

Is it for every user in the user column, the events column gives the list of events for which the user replied with `interested'?

\r\n

Does that mean all users in the public leaderboard were interested in only one event?\r\n

\r\n

If so that is a significant deviation from the train set where >10% people had more than 1 event for which they replied with interested. Please clarify.

\r\n

 

\r\n

Thanks,

\r\n

Harishgp.

\r\n

 

\r\n

 

", "rawMarkdown": "", "votes": null }, { "id": "20468", "postDate": "02/14/2013 10:31:18", "content": "

"The same timestamp" users had exactly 1 interested event in the train set.

\r\n

Thanks Harishgp! I didn't know this fact before your post. It could be useful for building a model.

\r\n
dTrain <- read.csv("train.csv", as.is = TRUE)
dTest <- read.csv("test.csv", as.is = TRUE)
numUser <- length(unique(dTrain$user))
actual <- tapply(dTrain$event, dTrain[,c(5,1)], identity)[1:numUser * 2]
userix <- tapply(1:nrow(dTrain), dTrain$user, identity)
userix.test <- tapply(1:nrow(dTest), dTest$user, identity)

## interested length for the train set
a.len <- sapply(actual, length)

## event length for the train set
e.len <- sapply(tapply(dTrain$event, dTrain$user, identity), length)

## event length for the test set
e.len.test <- sapply(tapply(dTest$event, dTest$user, identity), length)
\r\n

## all users
table(a.len)
   1    2    3    4    5    6    7    8    9   10 
1178  400  191   97   61   38   24   13    7    8 
  11   12   14   15   17   18   19   21 
   4    5    1    1    2    1    2    1

table(e.len)
   4    5    6    7    8    9   10   11   12   13 
  57   91 1031  342  163   83   56   23   61   25 
  14   15   16   17   18   19   20   21   22   23 
  16   13    8    6    9    6    7    6    5    2 
  24   25   26   27   28   29   32   35   37   41 
   2    4    2    2    2    1    1    1    1    1 
  45   46   48   49   55   91 
   1    1    1    2    1    1

table(e.len.test)
  4   5   6   7   8   9  10  11  12  13  14  15 
 32  53 739 235  89  50  38  22  12  18  15   5 
 16  17  18  19  20  21  22  23  24  25  26  28 
  6   5   8   5   2   1   4   1   3   1   2   1 
 31  35  37  44  49  50  52  61  74 116 
  1   1   1   1   1   1   1   1   1   1 

## "the same timestamp" users
table(a.len[sapply(userix,function(x)all(dTrain[x[1],]$timestamp == dTrain[x[-1],]$timestamp))])
   1 
1123

table(e.len[sapply(userix,function(x)all(dTrain[x[1],]$timestamp == dTrain[x[-1],]$timestamp))])
  4   5   6 
 57  71 995

table(e.len.test[sapply(userix.test,function(x)all(dTest[x[1],]$timestamp == dTest[x[-1],]$timestamp))])
  4   5   6 
 32  44 711
", "rawMarkdown": "", "votes": null }, { "id": "20483", "postDate": "02/15/2013 07:44:58", "content": "

Ben could you clarify whether entrants need to submit a new entry against only the private leaderboard set, or whether the private leaderboard element of previous submissions would be scored?

\r\n

Cheers,

\r\n

Matthew

", "rawMarkdown": "", "votes": null }, { "id": "20485", "postDate": "02/15/2013 08:00:40", "content": "

Hi, it seems that the set of  (User, Event) pairs in 'event_popularity_benchmark_private_test_only.csv' is exactly a subset of (user, event) pairs in the previous 'test.csv' file. Is that the case? Thanks

", "rawMarkdown": "", "votes": null }, { "id": "20495", "postDate": "02/15/2013 16:47:02", "content": "

[quote=Matthew Pearce;20483]

\r\n

Ben could you clarify whether entrants need to submit a new entry against only the private leaderboard set, or whether the private leaderboard element of previous submissions would be scored?

\r\n

[/quote]New entries should be only submitted against the private leaderboard set.

", "rawMarkdown": "", "votes": null }, { "id": "20496", "postDate": "02/15/2013 16:47:39", "content": "

[quote=dolaameng;20485]

\r\n

Hi, it seems that the set of  (User, Event) pairs in 'event_popularity_benchmark_private_test_only.csv' is exactly a subset of (user, event) pairs in the previous 'test.csv' file. Is that the case? Thanks

\r\n

[/quote]This is correct - test.csv contained a random mix of the public and private leaderboard sets (along with additional rows that have been subsequently excluded due to leakage).

", "rawMarkdown": "", "votes": null }, { "id": "20522", "postDate": "02/16/2013 16:10:15", "content": "

Hi Ben,

\r\n

it seems kaggle points for this comp have been given at 14 th.

", "rawMarkdown": "", "votes": null }, { "id": "20523", "postDate": "02/16/2013 16:33:13", "content": "

Hi Ben,

\r\n

could you please explain what the public_leaderboard_solution.csv means? Is it true that (as harishgp suspected) these are only the entries in which each user is interested in?

\r\n

If that is true, where is the information about the not_interested column?

", "rawMarkdown": "", "votes": null }, { "id": "20535", "postDate": "02/17/2013 01:15:14", "content": "

[quote=n_m;20522]

\r\n

Hi Ben,

\r\n

it seems kaggle points for this comp have been given at 14 th.

\r\n

[/quote]Just recalculated all the points / rankings in case this happened.

", "rawMarkdown": "", "votes": null }, { "id": "20536", "postDate": "02/17/2013 01:15:48", "content": "

[quote=jsf;20523]

\r\n

Hi Ben,

\r\n

could you please explain what the public_leaderboard_solution.csv means? Is it true that (as harishgp suspected) these are only the entries in which each user is interested in?[/quote]Yes - it contains only\r\n the entries that each user is interested in.

", "rawMarkdown": "", "votes": null }, { "id": "20548", "postDate": "02/17/2013 11:18:57", "content": "

For avoidance of doubt -- that's a "no, you don't necessarily have to submit a new entry"? So previous entries would have covered the private leaderboard set and will be scored? Understand that any additional entries from here should only involve the private\r\n leaderboard data.

", "rawMarkdown": "", "votes": null }, { "id": "20556", "postDate": "02/17/2013 21:12:47", "content": "

[quote=Sean Owen;20548]

\r\n

For avoidance of doubt -- that's a "no, you don't necessarily have to submit a new entry"? So previous entries would have covered the private leaderboard set and will be scored? Understand that any additional entries from here should only involve the private\r\n leaderboard data.

\r\n

[/quote]This is correct - you don't have to submit a new entry.

", "rawMarkdown": "", "votes": null } ], "comments": [ { "id": 20465, "author_name": "harishgp", "author_url": "", "post_date": "02/14/2013 07:19:07", "content": "

Hi Ben,

\r\n

Can you explain the format of public_leaderboard_solution.csv? 

\r\n

Is it for every user in the user column, the events column gives the list of events for which the user replied with `interested'?

\r\n

Does that mean all users in the public leaderboard were interested in only one event?\r\n

\r\n

If so that is a significant deviation from the train set where >10% people had more than 1 event for which they replied with interested. Please clarify.

\r\n

 

\r\n

Thanks,

\r\n

Harishgp.

\r\n

 

\r\n

 

", "votes": null, "replies": [] }, { "id": 20468, "author_name": "tks0123456789", "author_url": "", "post_date": "02/14/2013 10:31:18", "content": "

"The same timestamp" users had exactly 1 interested event in the train set.

\r\n

Thanks Harishgp! I didn't know this fact before your post. It could be useful for building a model.

\r\n
dTrain <- read.csv("train.csv", as.is = TRUE)
dTest <- read.csv("test.csv", as.is = TRUE)
numUser <- length(unique(dTrain$user))
actual <- tapply(dTrain$event, dTrain[,c(5,1)], identity)[1:numUser * 2]
userix <- tapply(1:nrow(dTrain), dTrain$user, identity)
userix.test <- tapply(1:nrow(dTest), dTest$user, identity)

## interested length for the train set
a.len <- sapply(actual, length)

## event length for the train set
e.len <- sapply(tapply(dTrain$event, dTrain$user, identity), length)

## event length for the test set
e.len.test <- sapply(tapply(dTest$event, dTest$user, identity), length)
\r\n

## all users
table(a.len)
   1    2    3    4    5    6    7    8    9   10 
1178  400  191   97   61   38   24   13    7    8 
  11   12   14   15   17   18   19   21 
   4    5    1    1    2    1    2    1

table(e.len)
   4    5    6    7    8    9   10   11   12   13 
  57   91 1031  342  163   83   56   23   61   25 
  14   15   16   17   18   19   20   21   22   23 
  16   13    8    6    9    6    7    6    5    2 
  24   25   26   27   28   29   32   35   37   41 
   2    4    2    2    2    1    1    1    1    1 
  45   46   48   49   55   91 
   1    1    1    2    1    1

table(e.len.test)
  4   5   6   7   8   9  10  11  12  13  14  15 
 32  53 739 235  89  50  38  22  12  18  15   5 
 16  17  18  19  20  21  22  23  24  25  26  28 
  6   5   8   5   2   1   4   1   3   1   2   1 
 31  35  37  44  49  50  52  61  74 116 
  1   1   1   1   1   1   1   1   1   1 

## "the same timestamp" users
table(a.len[sapply(userix,function(x)all(dTrain[x[1],]$timestamp == dTrain[x[-1],]$timestamp))])
   1 
1123

table(e.len[sapply(userix,function(x)all(dTrain[x[1],]$timestamp == dTrain[x[-1],]$timestamp))])
  4   5   6 
 57  71 995

table(e.len.test[sapply(userix.test,function(x)all(dTest[x[1],]$timestamp == dTest[x[-1],]$timestamp))])
  4   5   6 
 32  44 711
", "votes": null, "replies": [] }, { "id": 20483, "author_name": "matthewpearce", "author_url": "", "post_date": "02/15/2013 07:44:58", "content": "

Ben could you clarify whether entrants need to submit a new entry against only the private leaderboard set, or whether the private leaderboard element of previous submissions would be scored?

\r\n

Cheers,

\r\n

Matthew

", "votes": null, "replies": [] }, { "id": 20485, "author_name": "truedolaameng", "author_url": "", "post_date": "02/15/2013 08:00:40", "content": "

Hi, it seems that the set of  (User, Event) pairs in 'event_popularity_benchmark_private_test_only.csv' is exactly a subset of (user, event) pairs in the previous 'test.csv' file. Is that the case? Thanks

", "votes": null, "replies": [] }, { "id": 20495, "author_name": "benhamner", "author_url": "", "post_date": "02/15/2013 16:47:02", "content": "

[quote=Matthew Pearce;20483]

\r\n

Ben could you clarify whether entrants need to submit a new entry against only the private leaderboard set, or whether the private leaderboard element of previous submissions would be scored?

\r\n

[/quote]New entries should be only submitted against the private leaderboard set.

", "votes": null, "replies": [] }, { "id": 20496, "author_name": "benhamner", "author_url": "", "post_date": "02/15/2013 16:47:39", "content": "

[quote=dolaameng;20485]

\r\n

Hi, it seems that the set of  (User, Event) pairs in 'event_popularity_benchmark_private_test_only.csv' is exactly a subset of (user, event) pairs in the previous 'test.csv' file. Is that the case? Thanks

\r\n

[/quote]This is correct - test.csv contained a random mix of the public and private leaderboard sets (along with additional rows that have been subsequently excluded due to leakage).

", "votes": null, "replies": [] }, { "id": 20522, "author_name": "naokazumizuta", "author_url": "", "post_date": "02/16/2013 16:10:15", "content": "

Hi Ben,

\r\n

it seems kaggle points for this comp have been given at 14 th.

", "votes": null, "replies": [] }, { "id": 20523, "author_name": "joseffeigl", "author_url": "", "post_date": "02/16/2013 16:33:13", "content": "

Hi Ben,

\r\n

could you please explain what the public_leaderboard_solution.csv means? Is it true that (as harishgp suspected) these are only the entries in which each user is interested in?

\r\n

If that is true, where is the information about the not_interested column?

", "votes": null, "replies": [] }, { "id": 20535, "author_name": "benhamner", "author_url": "", "post_date": "02/17/2013 01:15:14", "content": "

[quote=n_m;20522]

\r\n

Hi Ben,

\r\n

it seems kaggle points for this comp have been given at 14 th.

\r\n

[/quote]Just recalculated all the points / rankings in case this happened.

", "votes": null, "replies": [] }, { "id": 20536, "author_name": "benhamner", "author_url": "", "post_date": "02/17/2013 01:15:48", "content": "

[quote=jsf;20523]

\r\n

Hi Ben,

\r\n

could you please explain what the public_leaderboard_solution.csv means? Is it true that (as harishgp suspected) these are only the entries in which each user is interested in?[/quote]Yes - it contains only\r\n the entries that each user is interested in.

", "votes": null, "replies": [] }, { "id": 20548, "author_name": "", "author_url": "", "post_date": "02/17/2013 11:18:57", "content": "

For avoidance of doubt -- that's a "no, you don't necessarily have to submit a new entry"? So previous entries would have covered the private leaderboard set and will be scored? Understand that any additional entries from here should only involve the private\r\n leaderboard data.

", "votes": null, "replies": [] }, { "id": 20556, "author_name": "benhamner", "author_url": "", "post_date": "02/17/2013 21:12:47", "content": "

[quote=Sean Owen;20548]

\r\n

For avoidance of doubt -- that's a "no, you don't necessarily have to submit a new entry"? So previous entries would have covered the private leaderboard set and will be scored? Understand that any additional entries from here should only involve the private\r\n leaderboard data.

\r\n

[/quote]This is correct - you don't have to submit a new entry.

", "votes": null, "replies": [] } ], "raw_markdown_by_id": { "20461": "", "20465": "", "20468": "", "20483": "", "20485": "", "20495": "", "20496": "", "20522": "", "20523": "", "20535": "", "20536": "", "20548": "", "20556": "" }, "source": "meta" }