![\"enter](\"https://i.loli.net/2018/04/28/5ae3f82ecb754.jpg\")
Thank you all for your hard work in this competition and for the feedback on the Stage 1 model upload discussion. Your thoughtful discussions brought out many different aspects to 2-Stage competitions that we had to consider.
\n\nOur intention in requiring upload of the models before Stage 2 has been to lock in the efforts of Stage 1 and prevent further training on the models before the introduction of new data. We agree that this is an important component of this competition with the 2nd stage dataset.
\n\nFurther, since we base final rankings on the more popular Stage 1 of the competition, we want to make sure that the rankings are fair. During the second stage we wipe out the leaderboard, but we use the Stage 1 number of teams when we calculate the medals and points to incentivize participation in the second stage.
\n\nDespite these different aspects of 2-Stage competitions, clarity of the rules of engagement outweighs any other considerations and we could have done better here. We have decided to change course. We noted some inconsistency between the Timeline and the Rules and can see how the need to upload a model by April 11th may have been ambiguous to some. We also acknowledge the difference in this practice with our general FAQ’s for 2-Stage competitions.
\n\nWe have made the decision to reinstate those who made submissions in Stage 2 of the competition. We will implement this update in the next few days.
\n\nWe could have done better in communicating the specific requirements for this 2-stage competition and will do better next time in making specific deadlines clear. We regret the confusion caused and will work to over-communicate competitions with different dates and requirements going forward.
\n\nThanks again for your hard work in this competition!
", "messages": [ { "id": 318476, "postDate": "2018-04-23T22:44:02.557Z", "content": "Thank you all for your hard work in this competition and for the feedback on the Stage 1 model upload discussion. Your thoughtful discussions brought out many different aspects to 2-Stage competitions that we had to consider.
\n\nOur intention in requiring upload of the models before Stage 2 has been to lock in the efforts of Stage 1 and prevent further training on the models before the introduction of new data. We agree that this is an important component of this competition with the 2nd stage dataset.
\n\nFurther, since we base final rankings on the more popular Stage 1 of the competition, we want to make sure that the rankings are fair. During the second stage we wipe out the leaderboard, but we use the Stage 1 number of teams when we calculate the medals and points to incentivize participation in the second stage.
\n\nDespite these different aspects of 2-Stage competitions, clarity of the rules of engagement outweighs any other considerations and we could have done better here. We have decided to change course. We noted some inconsistency between the Timeline and the Rules and can see how the need to upload a model by April 11th may have been ambiguous to some. We also acknowledge the difference in this practice with our general FAQ’s for 2-Stage competitions.
\n\nWe have made the decision to reinstate those who made submissions in Stage 2 of the competition. We will implement this update in the next few days.
\n\nWe could have done better in communicating the specific requirements for this 2-stage competition and will do better next time in making specific deadlines clear. We regret the confusion caused and will work to over-communicate competitions with different dates and requirements going forward.
\n\nThanks again for your hard work in this competition!
", "rawMarkdown": "Thank you all for your hard work in this competition and for the feedback on the Stage 1 model upload discussion. Your thoughtful discussions brought out many different aspects to 2-Stage competitions that we had to consider. \n\nOur intention in requiring upload of the models before Stage 2 has been to lock in the efforts of Stage 1 and prevent further training on the models before the introduction of new data. We agree that this is an important component of this competition with the 2nd stage dataset. \n\nFurther, since we base final rankings on the more popular Stage 1 of the competition, we want to make sure that the rankings are fair. During the second stage we wipe out the leaderboard, but we use the Stage 1 number of teams when we calculate the medals and points to incentivize participation in the second stage.\n\nDespite these different aspects of 2-Stage competitions, clarity of the rules of engagement outweighs any other considerations and we could have done better here. We have decided to change course. We noted some inconsistency between the Timeline and the Rules and can see how the need to upload a model by April 11th may have been ambiguous to some. We also acknowledge the difference in this practice with our general FAQ’s for 2-Stage competitions. \n\nWe have made the decision to reinstate those who made submissions in Stage 2 of the competition. We will implement this update in the next few days.\n\nWe could have done better in communicating the specific requirements for this 2-stage competition and will do better next time in making specific deadlines clear. We regret the confusion caused and will work to over-communicate competitions with different dates and requirements going forward.\n\nThanks again for your hard work in this competition!\n", "votes": 75 }, { "id": 319020, "postDate": "2018-04-25T03:55:13.903Z", "content": "This is my first Kaggle competition. I entered the game late (about a month before the stage 1 deadline) and spent about three weeks of my spare time on it. Overall, it turns out to be a fantastic learning experience, way beyond my expectation. I was disappointed to learn that my final result that ranked 36th was removed due to not uploading model in time. Thanks to the communities' effort, the LB will be reinstated.
\n\nI have to say that the most amazing thing about Kaggle, from my perspective, is the community. I learnt a lot from the public kernels and discussion boards, contributed by people like @Heng CherKeng, @Waleed and @Stephen Bailey. I feel that this is great platform to learn from practice and I hope the collaborative atmosphere will not be affected by this incident.
\n\nI here just want to share my experience and suggestions regarding the communication of model uploading requirement and the way how removal and reinstatement is done, so that first-time Kagglers like me will not be confused or discouraged in the future.
\n\nThe timeline tab and the FAQ page. The only place I see requirement related to uploading model is the timeline tab. To figure out how to upload my model, I found the FAQ page (https://www.kaggle.com/two-stage-faq), which happens to state that the leaderboard position will not be affected as long as the team does not win the prize. This leaves me the impression that the model-uploading deadline of this competition applies only to the prize-eligible teams. I suggest when competition-specific requirement differs from the general FAQ, it should be stressed in bold so that participants will not miss the fact that this particular requirement overwrites the general FAQ in this competition. Also this should be included in the rule page.
The model upload page. This page allowed the participant to upload model after the stage 1 deadline without any notification while only the most recent submission is kept. In scenarios that a participant fixed a non-scientific bug when evaluating stage 2 test data and wanted to update their uploaded model, their proof of previous submission will be erased. I suggest either to prevent participants from submitting model after the stage 1 deadline or at least give a notification of the possible consequences.
Lack of message to individuals about the specific reason of leaderboard removal. To a participant who did spend some time and energy or possibly money, the removal is definitely not a trivial thing. Therefore, to tell a participant about the specific reason (like not submitting model on time, model contains non open-source licensed code, suspicious duplicated account and etc) of such removal decision shows a basic respect from the organizer. The message can either be sent through the Kaggle notification or to email account. I learnt about my removal when I was trying to show my friends my first Kaggle achievement...
Big decisions like removing more than 50% participants should be more carefully communicated. Message like \"We discussed this internally at Kaggle and decided that we are going to change our practice going forward.\" did not acknowledge the ambiguity of the rule (timeline vs FAQ) and seemed to put all the fault on the participants. This could leave participants to feel disturbing and become defensive during discussion.
I acknowledge the hard work of the Kaggle team to provide the great platform for people to learn, compete and have fun. I hope I can contribute more to the community in my next competition.
", "rawMarkdown": "This is my first Kaggle competition. I entered the game late (about a month before the stage 1 deadline) and spent about three weeks of my spare time on it. Overall, it turns out to be a fantastic learning experience, way beyond my expectation. I was disappointed to learn that my final result that ranked 36th was removed due to not uploading model in time. Thanks to the communities' effort, the LB will be reinstated. \n\nI have to say that the most amazing thing about Kaggle, from my perspective, is the community. I learnt a lot from the public kernels and discussion boards, contributed by people like @Heng CherKeng, @Waleed and @Stephen Bailey. I feel that this is great platform to learn from practice and I hope the collaborative atmosphere will not be affected by this incident.\n\nI here just want to share my experience and suggestions regarding the communication of model uploading requirement and the way how removal and reinstatement is done, so that first-time Kagglers like me will not be confused or discouraged in the future.\n\n1. The timeline tab and the FAQ page. The only place I see requirement related to uploading model is the timeline tab. To figure out how to upload my model, I found the FAQ page (https://www.kaggle.com/two-stage-faq), which happens to state that the leaderboard position will not be affected as long as the team does not win the prize. This leaves me the impression that the model-uploading deadline of this competition applies only to the prize-eligible teams. I suggest when competition-specific requirement differs from the general FAQ, it should be stressed in bold so that participants will not miss the fact that this particular requirement overwrites the general FAQ in this competition. Also this should be included in the rule page.\n\n2. The model upload page. This page allowed the participant to upload model after the stage 1 deadline without any notification while only the most recent submission is kept. In scenarios that a participant fixed a non-scientific bug when evaluating stage 2 test data and wanted to update their uploaded model, their proof of previous submission will be erased. I suggest either to prevent participants from submitting model after the stage 1 deadline or at least give a notification of the possible consequences. \n\n3. Lack of message to individuals about the specific reason of leaderboard removal. To a participant who did spend some time and energy or possibly money, the removal is definitely not a trivial thing. Therefore, to tell a participant about the specific reason (like not submitting model on time, model contains non open-source licensed code, suspicious duplicated account and etc) of such removal decision shows a basic respect from the organizer. The message can either be sent through the Kaggle notification or to email account. I learnt about my removal when I was trying to show my friends my first Kaggle achievement... \n\n4. Big decisions like removing more than 50% participants should be more carefully communicated. Message like \"We discussed this internally at Kaggle and **decided** that we are going to **change** our practice going forward.\" did not acknowledge the ambiguity of the rule (timeline vs FAQ) and seemed to put all the fault on the participants. This could leave participants to feel disturbing and become defensive during discussion.\n\nI acknowledge the hard work of the Kaggle team to provide the great platform for people to learn, compete and have fun. I hope I can contribute more to the community in my next competition.\n", "votes": 11 }, { "id": 321659, "postDate": "2018-05-01T17:51:08.580Z", "content": "We are working through final updates, thanks for your patience! You will see when the leaderboard is final if you refresh the leaderboard, we are shooting for next week. Once it is final you can email compliance with any questions. Thank you!
", "rawMarkdown": "We are working through final updates, thanks for your patience! You will see when the leaderboard is final if you refresh the leaderboard, we are shooting for next week. Once it is final you can email compliance with any questions. Thank you!", "votes": 9, "replies": [ { "id": 325638, "postDate": "2018-05-08T16:49:31.450Z", "content": "Is the leaderboard finalized? Why I still cannot see my team? There are only 726 teams on the LB now! (there are 861 teams just after the competition end)
", "rawMarkdown": "Is the leaderboard finalized? Why I still cannot see my team? There are only 726 teams on the LB now! (there are 861 teams just after the competition end)", "votes": 3 } ] }, { "id": 320800, "postDate": "2018-04-29T22:23:35.083Z", "content": "@Maggie, I am still not seeing our team being listed on the Leaderboard. Could you look into it? If there was something we did wrong in our submission, please let us know as well. To my knowledge we respected the submission timeline and put checkmarks on two of our submissions as per guidelines. This is our first competition, so we'd like to learn from our mistakes if any. Thanks!
", "rawMarkdown": "@Maggie, I am still not seeing our team being listed on the Leaderboard. Could you look into it? If there was something we did wrong in our submission, please let us know as well. To my knowledge we respected the submission timeline and put checkmarks on two of our submissions as per guidelines. This is our first competition, so we'd like to learn from our mistakes if any. Thanks!", "votes": 7, "replies": [ { "id": 327912, "postDate": "2018-05-12T21:56:37.350Z", "content": "@Maggie, Thank you very much for reinstating our team! Much appreciated.
", "rawMarkdown": "@Maggie, Thank you very much for reinstating our team! Much appreciated." } ] }, { "id": 319936, "postDate": "2018-04-27T06:12:54.580Z", "content": "@kaggle, my result/score has also not been reinstated. Please check if you have missed to reinstate some of the people which you had removed earlier from the LB. Thanks.
", "rawMarkdown": "@kaggle, my result/score has also not been reinstated. Please check if you have missed to reinstate some of the people which you had removed earlier from the LB. Thanks. ", "votes": 7, "replies": [ { "id": 319948, "postDate": "2018-04-27T06:43:23.547Z", "content": "Exactly the same. I was also removed just before the main wave. Already requested twice through compliance page but got no answer.
", "rawMarkdown": "Exactly the same. I was also removed just before the main wave. Already requested twice through compliance page but got no answer.", "votes": -1 } ] }, { "id": 319631, "postDate": "2018-04-26T13:24:13.217Z", "content": "Just wondering how long it will take....
", "rawMarkdown": "Just wondering how long it will take....", "votes": 8, "replies": [ { "id": 319789, "postDate": "2018-04-26T20:48:04.573Z", "content": "Kaggle reinstated us just now. Cheers!
", "rawMarkdown": "Kaggle reinstated us just now. Cheers!", "votes": 1 }, { "id": 319815, "postDate": "2018-04-26T22:08:21.930Z", "content": "But no medals. Are they coming?
", "rawMarkdown": "But no medals. Are they coming?", "votes": 2 }, { "id": 319817, "postDate": "2018-04-26T22:28:02.687Z", "content": "If i understood correctly they will calculate the final medals according to the stage 1 number of people so medals will be given out to top 363 people which probably takes some tweaking to make it work that way as well as the fact that they need to restore the score of people they removed earlier :)
", "rawMarkdown": "If i understood correctly they will calculate the final medals according to the stage 1 number of people so medals will be given out to top 363 people which probably takes some tweaking to make it work that way as well as the fact that they need to restore the score of people they removed earlier :)", "votes": 1 }, { "id": 319827, "postDate": "2018-04-26T23:00:47.383Z", "content": "From one of the previous posts, maybe from Maggie, medals will come in a few weeks when they finalize results. So I'm not expecting to see medals soon.
\nYeah, they reinstated all of us. You can tell because 99% of the folks that posted here now show rankings in the competition next to their name, versus nothing just a few hours ago :)
Not all of us.
", "rawMarkdown": "Not all of us. " } ] }, { "id": 325407, "postDate": "2018-05-08T11:41:44.553Z", "content": "@Maggie I am still not seeing our team being listed on the Leaderboard. we respected the submission timeline and selected two of our submissions for stage 1 and 2 .Thanks!
", "rawMarkdown": "@Maggie I am still not seeing our team being listed on the Leaderboard. we respected the submission timeline and selected two of our submissions for stage 1 and 2 .Thanks!", "votes": 6 }, { "id": 319857, "postDate": "2018-04-27T01:26:00.943Z", "content": "Maggie, may I know whether the reinstatement has been completed or is it still in progress? Mine has not been reinstated and I uploaded the 2 models during the stage 2 of the competition.
", "rawMarkdown": "Maggie, may I know whether the reinstatement has been completed or is it still in progress? Mine has not been reinstated and I uploaded the 2 models during the stage 2 of the competition.", "votes": 6, "replies": [ { "id": 319901, "postDate": "2018-04-27T04:32:27.403Z", "rawMarkdown": "", "votes": -2, "isDeleted": true } ] }, { "id": 318982, "postDate": "2018-04-25T00:40:12.923Z", "content": "a new competition called \"YOYO ranking\" is to predict the final ranking in this competition given the past ones...\nGood luck !
", "rawMarkdown": "a new competition called \"YOYO ranking\" is to predict the final ranking in this competition given the past ones...\nGood luck !", "votes": 5 }, { "id": 320156, "postDate": "2018-04-27T16:39:44.520Z", "content": "Thanks for the comments, we are still working through the updates. We have reinstated the majority of those who did not upload a model but are working through our normal compliance checks.
", "rawMarkdown": "Thanks for the comments, we are still working through the updates. We have reinstated the majority of those who did not upload a model but are working through our normal compliance checks. ", "votes": 5, "replies": [ { "id": 320161, "postDate": "2018-04-27T16:56:33.030Z", "content": "Thanks for the update maggie.
", "rawMarkdown": "Thanks for the update maggie.", "votes": 1 }, { "id": 321110, "postDate": "2018-04-30T16:19:09.487Z", "content": "Thanks for the update maggie.
", "rawMarkdown": "Thanks for the update maggie." } ] }, { "id": 318745, "postDate": "2018-04-24T11:50:01.103Z", "content": "Now all the people that scored better after the 'purge' will be upset. This has really turned into a donnybrook. Hopefully Kaggle has learned something from this.
", "rawMarkdown": "Now all the people that scored better after the 'purge' will be upset. This has really turned into a donnybrook. Hopefully Kaggle has learned something from this.", "votes": 5 }, { "id": 318641, "postDate": "2018-04-24T07:03:44.500Z", "content": "When 50% of the smartest minds on the planet don’t understand the instructions, there is probably something wrong with the instructions.
\n\nYou did the right thing, Kaggle. Well done.
", "rawMarkdown": "When 50% of the smartest minds on the planet don’t understand the instructions, there is probably something wrong with the instructions.\n\nYou did the right thing, Kaggle. Well done.", "votes": 3 }, { "id": 321561, "postDate": "2018-05-01T14:57:52.357Z", "content": "Hi, I cannot find my team too, we have selected two best solutions before deadline of stage 2.
", "rawMarkdown": "Hi, I cannot find my team too, we have selected two best solutions before deadline of stage 2.", "votes": 3 }, { "id": 320268, "postDate": "2018-04-28T04:20:23.953Z", "content": "@maggiemd Thanks for your hard working those days! But are you still working on more teams? I cannot find my team on the leaderboard. My team was removed on 20 April. Is there any problem?
\n\nI found a screenshot just after the end of competition.\n
And other screenshots after 4 days ago, in the morning of 20 April.
\n\n![\"\"](\"https://i.loli.net/2018/04/28/5ae3f81a77bed.png\")
\n![\"\"](\"https://i.loli.net/2018/04/28/5ae3f820068bb.png\")
\n![\"\"](\"https://i.loli.net/2018/04/28/5ae3f841351a3.png\")
@Maggie, \nI have the same problem as @Sumiko.\nI had submitted my model and code before the dead line of stage1, and I had submitted my prediction csv file of stage2 before the deadline of stage2. However, my score has not been reinstated yet.
", "rawMarkdown": "@Maggie, \nI have the same problem as @Sumiko.\nI had submitted my model and code before the dead line of stage1, and I had submitted my prediction csv file of stage2 before the deadline of stage2. However, my score has not been reinstated yet.", "votes": 3, "replies": [ { "id": 319872, "postDate": "2018-04-27T02:18:52.987Z", "content": "Hi I hope the leader board reinstatement is not completed yet. Because I had uploaded my code before stage 1 deadline and did submissions in stage 2 . still my entry missing on leader board. I think we need to wait till we hear from @maggie saying it is the final LB.
", "rawMarkdown": "Hi I hope the leader board reinstatement is not completed yet. Because I had uploaded my code before stage 1 deadline and did submissions in stage 2 . still my entry missing on leader board. I think we need to wait till we hear from @maggie saying it is the final LB. ", "votes": 2 } ] }, { "id": 318613, "postDate": "2018-04-24T06:07:23.533Z", "content": "If I understand correctly, stage 2 score is useless now and the final LB rank (and prize?) will be determined by the \"more popular\" stage 1 score? If that is the case, aren't stage 1 test set much smaller than stage 2 and much easier to overfit?
", "rawMarkdown": "If I understand correctly, stage 2 score is useless now and the final LB rank (and prize?) will be determined by the \"more popular\" stage 1 score? If that is the case, aren't stage 1 test set much smaller than stage 2 and much easier to overfit?", "votes": 4, "replies": [ { "id": 318619, "postDate": "2018-04-24T06:27:16.283Z", "content": "Furthermore, if rankings are indeed based off stage 1 (which is news to me), I think the leaderboards should both be available under tabs (like how public/private are both visible atm)
", "rawMarkdown": "Furthermore, if rankings are indeed based off stage 1 (which is news to me), I think the leaderboards should both be available under tabs (like how public/private are both visible atm)", "votes": 4 }, { "id": 318621, "postDate": "2018-04-24T06:32:01.557Z", "content": "I think it’s not the score but the participant number from Stage 1 is used to calculate how many people in Stage 2 get medals.
", "rawMarkdown": "I think it’s not the score but the participant number from Stage 1 is used to calculate how many people in Stage 2 get medals.", "votes": 4 }, { "id": 318863, "postDate": "2018-04-24T16:22:36.450Z", "content": "Shitian Ni is correct, the scores from Stage 2 are the final standing of the competition, but the ranking is based upon the total number in Stage 1.
", "rawMarkdown": "Shitian Ni is correct, the scores from Stage 2 are the final standing of the competition, but the ranking is based upon the total number in Stage 1. ", "votes": 6 }, { "id": 318903, "postDate": "2018-04-24T17:58:32.717Z", "content": "Thanks for the clarification! Thanks for listening to participants' feedback and changing the course!
", "rawMarkdown": "Thanks for the clarification! Thanks for listening to participants' feedback and changing the course! " } ] }, { "id": 320544, "postDate": "2018-04-29T02:23:53.890Z", "content": "@Maggie Same problem as Liang Jeff. Still can't find my score in LB. Can you please check it again?
", "rawMarkdown": "@Maggie Same problem as Liang Jeff. Still can't find my score in LB. Can you please check it again? ", "votes": 2 }, { "id": 318485, "postDate": "2018-04-23T23:24:53.827Z", "content": "Great -- thank you for listening to our feedback!
", "rawMarkdown": "Great -- thank you for listening to our feedback!", "votes": 2 }, { "id": 322785, "postDate": "2018-05-03T16:40:56.297Z", "content": "What does happen if my team zip file without md5 checksum? I also upload the model before the deadline but just compress the model without md5 checksum, and my team has been removed in the second round.
", "rawMarkdown": "What does happen if my team zip file without md5 checksum? I also upload the model before the deadline but just compress the model without md5 checksum, and my team has been removed in the second round.", "votes": 1 }, { "id": 321640, "postDate": "2018-05-01T17:32:06.573Z", "content": "thanks for the update Maggie\nIt makes things clearer
", "rawMarkdown": "thanks for the update [Maggie](https://www.kaggle.com/maggiemd)\nIt makes things clearer", "votes": 1 }, { "id": 321584, "postDate": "2018-05-01T15:54:28.917Z", "content": "@Maggie,thanks for all your hard work,cant find my lb in the leaderboard,can you help me ?
", "rawMarkdown": "@Maggie,thanks for all your hard work,cant find my lb in the leaderboard,can you help me ?", "votes": 1 }, { "id": 320943, "postDate": "2018-04-30T08:54:06.733Z", "content": "Hi,Maggie,thank you for your hard working!I still can't find my lb in the leaderboard,can you help me ?
", "rawMarkdown": "Hi,Maggie,thank you for your hard working!I still can't find my lb in the leaderboard,can you help me ?", "votes": 1 }, { "id": 320776, "postDate": "2018-04-29T19:44:50.123Z", "content": "@Maggie, I still can't find my score in LB (Team Name: Dataexplorers). Request you to please check. Thanks
", "rawMarkdown": "@Maggie, I still can't find my score in LB (Team Name: Dataexplorers). Request you to please check. Thanks ", "votes": 1 }, { "id": 319910, "postDate": "2018-04-27T05:08:48.860Z", "content": "same problem as Sumiko, @Maggie
", "rawMarkdown": "same problem as Sumiko, @Maggie", "votes": 1 }, { "id": 318579, "postDate": "2018-04-24T05:15:17.490Z", "content": "Thank you for restoring fairness. Kaggle is a community and trust is above all.
", "rawMarkdown": "Thank you for restoring fairness. Kaggle is a community and trust is above all.", "replies": [ { "id": 318594, "postDate": "2018-04-24T05:28:34.090Z", "content": "@gavrand thank you for fighting for the community through your Discussion posts so we can get this result
", "rawMarkdown": "@gavrand thank you for fighting for the community through your Discussion posts so we can get this result" } ] }, { "id": 326931, "postDate": "2018-05-10T14:26:13.717Z", "content": "Hi Maggie, Is the reinstatement final? Because there are lots of people (89 to be exact) who have not been reinstated. Thanks!
", "rawMarkdown": "Hi Maggie, Is the reinstatement final? Because there are lots of people (89 to be exact) who have not been reinstated. Thanks!", "votes": 2 }, { "id": 320622, "postDate": "2018-04-29T10:01:35.193Z", "content": "@Maggie, I still can't find my score in LB. Please check it again. Thanks
", "rawMarkdown": "@Maggie, I still can't find my score in LB. Please check it again. Thanks ", "votes": 2 }, { "id": 320532, "postDate": "2018-04-29T00:42:16.310Z", "content": "Hi @maggiemd can you please check our team? I logged in today and didn't see our score. Thanks.
", "rawMarkdown": "Hi @maggiemd can you please check our team? I logged in today and didn't see our score. Thanks.", "votes": 2 }, { "id": 320505, "postDate": "2018-04-28T20:53:23.473Z", "content": "@maggiemd my team is also not reinstated. We submitted the code for Stage1. Are you still working on the updates?
", "rawMarkdown": "@maggiemd my team is also not reinstated. We submitted the code for Stage1. Are you still working on the updates?", "votes": 2 }, { "id": 320278, "postDate": "2018-04-28T05:49:11.237Z", "content": "Hi @Maggie, My team(T---Team) got LB 0.557 at stage2 (51/816) .I submit my code before April 11, maybe is a little messy. I didn't change my model, I just run the model I generated three weeks ago and submitted the final result. I wonder why my rank is moved and not reinstated. I'm looking forward to your reply. Thanks.
", "rawMarkdown": "Hi @Maggie, My team(T---Team) got LB 0.557 at stage2 (51/816) .I submit my code before April 11, maybe is a little messy. I didn't change my model, I just run the model I generated three weeks ago and submitted the final result. I wonder why my rank is moved and not reinstated. I'm looking forward to your reply. Thanks.", "votes": 2 }, { "id": 320270, "postDate": "2018-04-28T04:25:35.750Z", "content": "@Maggie, I can't find my team Blade Runner in stage 2. Can you please check and confirm. Thanks.
", "rawMarkdown": "@Maggie, I can't find my team Blade Runner in stage 2. Can you please check and confirm. Thanks.", "votes": 2 }, { "id": 319935, "postDate": "2018-04-27T06:11:33.553Z", "content": "@Maggie, I noticed that my submission and my team disappeared and my Kaggle account shows that I am not in this competition. I accepted the rules and made submission during both stage 1 and stage 2 (before their deadline). During the first few days after stage 2 deadline, I can see my submission score and rank on private leaderboard. May I know that whether my submission, score and rank will be reinstated? Thanks!
", "rawMarkdown": "@Maggie, I noticed that my submission and my team disappeared and my Kaggle account shows that I am not in this competition. I accepted the rules and made submission during both stage 1 and stage 2 (before their deadline). During the first few days after stage 2 deadline, I can see my submission score and rank on private leaderboard. May I know that whether my submission, score and rank will be reinstated? Thanks!", "votes": 2 }, { "id": 319917, "postDate": "2018-04-27T05:21:05.007Z", "content": "we have same problem as Teppei Kanayama
", "rawMarkdown": "we have same problem as Teppei Kanayama", "votes": 2 }, { "id": 328584, "postDate": "2018-05-14T16:43:38.483Z", "content": "Hi Maggie, we also asked for reinstatement and have not heard. Our team was Getschwifty. Could you please comment or reinstate? Thank you!
", "rawMarkdown": "Hi Maggie, we also asked for reinstatement and have not heard. Our team was Getschwifty. Could you please comment or reinstate? Thank you!" }, { "id": 326121, "postDate": "2018-05-09T10:12:12.563Z", "content": "@maggiemd my team is still not reinstated. Are you still working on the updates? If not then will we get any mail with why our team was not reinstated?
", "rawMarkdown": "@maggiemd my team is still not reinstated. Are you still working on the updates? If not then will we get any mail with why our team was not reinstated?" }, { "id": 325625, "postDate": "2018-05-08T16:32:47.990Z", "content": "It seems that the medals have been sent. The LB is officially finalized, will we get response if we email compliance now? Thanks
", "rawMarkdown": "It seems that the medals have been sent. The LB is officially finalized, will we get response if we email compliance now? Thanks" }, { "id": 325570, "postDate": "2018-05-08T15:03:57.147Z", "content": "@Maggie Our team is still missing as well...(was at 38th) Now that the winners have been announced, is the leaderboard reinstatement officially finished?
", "rawMarkdown": "@Maggie Our team is still missing as well...(was at 38th) Now that the winners have been announced, is the leaderboard reinstatement officially finished?" }, { "id": 319947, "postDate": "2018-04-27T06:42:39.213Z", "content": "same problem
", "rawMarkdown": "same problem" }, { "id": 318570, "postDate": "2018-04-24T04:36:36.720Z", "content": "Appreciate this change. Fairness makes kaggle a popular and convincing platform for DS.
", "rawMarkdown": "Appreciate this change. Fairness makes kaggle a popular and convincing platform for DS. " }, { "id": 318525, "postDate": "2018-04-24T01:47:15.523Z", "content": "Maggie, thank you very much for listening to our feedbacks and taking necessary actions to get this corrected, very much appreciated. We'll wait for the reinstatement then.
", "rawMarkdown": "Maggie, thank you very much for listening to our feedbacks and taking necessary actions to get this corrected, very much appreciated. We'll wait for the reinstatement then." }, { "id": 318517, "postDate": "2018-04-24T01:24:10.543Z", "content": "Thank you for listening to our opinions.
", "rawMarkdown": "Thank you for listening to our opinions." }, { "id": 331174, "postDate": "2018-05-20T14:33:31.337Z", "content": "Has this been updated? Still no score for my team >:|
", "rawMarkdown": "Has this been updated? Still no score for my team >:|", "votes": 1, "replies": [ { "id": 343194, "postDate": "2018-06-14T21:13:46.030Z", "content": "No. Have submitted the compliance form for twice and got no response at all. I almost forgot this thing...
", "rawMarkdown": "No. Have submitted the compliance form for twice and got no response at all. I almost forgot this thing...", "votes": 3 }, { "id": 344447, "postDate": "2018-06-18T03:02:43.730Z", "content": "Compliance gave no response... what should I do?
", "rawMarkdown": "Compliance gave no response... what should I do?", "votes": 1 } ] }, { "id": 329067, "postDate": "2018-05-15T16:54:37.370Z", "content": "Hi. Did anyone here get a reply from compliance team? I submitted the form multiple times but to no avail. Thanks a lot!
", "rawMarkdown": "Hi. Did anyone here get a reply from compliance team? I submitted the form multiple times but to no avail. Thanks a lot!", "votes": 1, "replies": [ { "id": 329071, "postDate": "2018-05-15T16:57:42.747Z", "content": "I didn't get the reply from compliance team too.
", "rawMarkdown": "I didn't get the reply from compliance team too.", "votes": 1 }, { "id": 330842, "postDate": "2018-05-19T20:40:17.120Z", "content": "I submitted the compliance form once about a week ago for our team \"Summ\" and have not received any feedback yet
", "rawMarkdown": "I submitted the compliance form once about a week ago for our team \"Summ\" and have not received any feedback yet" } ] }, { "id": 320055, "postDate": "2018-04-27T11:18:21.133Z", "content": "We have made about 40 submissions before April 11, 2018,11:59 PM UTC on 1st stage, uploaded our model before April 11, 2018,11:59 PM UTC, made 5 submissions on 2nd stage before April 16, 2018,11:59 PM UTC. We have been removed and not reinstated. And we have send our compliance. I have no idea even on why we have been removed. After all these we just appreciate an explanation, thanks. @Maggie
", "rawMarkdown": "We have made about 40 submissions before April 11, 2018,11:59 PM UTC on 1st stage, uploaded our model before April 11, 2018,11:59 PM UTC, made 5 submissions on 2nd stage before April 16, 2018,11:59 PM UTC. We have been removed and not reinstated. And we have send our compliance. I have no idea even on why we have been removed. After all these we just appreciate an explanation, thanks. @Maggie", "votes": 1 }, { "id": 322243, "postDate": "2018-05-02T15:54:20.883Z", "content": "Thank you Maggie. We also had the same problem and our team was wiped out.
", "rawMarkdown": "Thank you Maggie. We also had the same problem and our team was wiped out. ", "votes": -1 }, { "id": 318623, "postDate": "2018-04-24T06:38:18.503Z", "content": "Thank you Maggie and all the kaggle team .
", "rawMarkdown": "Thank you Maggie and all the kaggle team .", "votes": -1 }, { "id": 318555, "postDate": "2018-04-24T03:35:26.683Z", "content": "Smart move, thanks.
", "rawMarkdown": "Smart move, thanks.", "replies": [ { "id": 318824, "postDate": "2018-04-24T14:49:31.097Z", "content": "I would like to appreciate that you are also very smart to say this.
\n\nI may see that your concern turns a reality, and hoped that many participants noticed your post and Kaggle team took your concern seriously before the end of stage 1.
\n\nAnyway, this is the decision based on the majority voices of the community, and is a smart move.
", "rawMarkdown": "I would like to appreciate that you are also very smart to say this.\n\nI may see that your concern turns a reality, and hoped that many participants noticed your post and Kaggle team took your concern seriously before the end of stage 1.\n\nAnyway, this is the decision based on the majority voices of the community, and is a smart move.\n", "votes": -1 }, { "id": 319046, "postDate": "2018-04-25T05:11:04.877Z", "rawMarkdown": "", "votes": -1, "isDeleted": true }, { "id": 319219, "postDate": "2018-04-25T14:31:58.873Z", "content": "anniezhang2018. I know that you did a right thing with following the integrity, and think you deserve the current % ranking. However, the % ranking will be doubled after the reinstatement. Well, I consider Kaggle is a learning platform and it is better not to stick on a ranking of just one competition.
", "rawMarkdown": "anniezhang2018. I know that you did a right thing with following the integrity, and think you deserve the current % ranking. However, the % ranking will be doubled after the reinstatement. Well, I consider Kaggle is a learning platform and it is better not to stick on a ranking of just one competition." }, { "id": 319268, "postDate": "2018-04-25T16:23:10.107Z", "rawMarkdown": "", "votes": -1, "isDeleted": true } ] }, { "id": 321236, "postDate": "2018-04-30T21:31:28.770Z", "content": "Our team (trisolaran) was in top 10 in stage2 LB. We uploaded a hash of our code before the deadline but somehow still got removed from LB and still haven't been reinstated. @Maggie Please check it for us. Thanks!
", "rawMarkdown": "Our team (trisolaran) was in top 10 in stage2 LB. We uploaded a hash of our code before the deadline but somehow still got removed from LB and still haven't been reinstated. @Maggie Please check it for us. Thanks!" }, { "id": 318481, "postDate": "2018-04-23T23:03:49.237Z", "content": "Thank you for changing the course! But
\n\n\n\n\nWe agree that this is an important component of this competition with a smaller 2nd stage dataset.
\n
Why do you keep saying this? This is wrong. 2nd stage dataset is bigger.
", "rawMarkdown": "Thank you for changing the course! But\n\n> We agree that this is an important component of this competition with a smaller 2nd stage dataset.\n\nWhy do you keep saying this? This is wrong. 2nd stage dataset is bigger.", "replies": [ { "id": 318492, "postDate": "2018-04-23T23:50:35.343Z", "content": "I think she means the scored subset of stage 2 test was smaller. The poison images of course made stage 2 test appear large.
", "rawMarkdown": "I think she means the scored subset of stage 2 test was smaller. The poison images of course made stage 2 test appear large.", "votes": 9 }, { "id": 318493, "postDate": "2018-04-23T23:54:25.800Z", "rawMarkdown": "", "isDeleted": true }, { "id": 318494, "postDate": "2018-04-23T23:58:00.590Z", "content": "@Anne ‘s explanation works for me.
\nAnd thank you for the extra information :)
Hi Anne, thank you for your help😃
", "rawMarkdown": "Hi Anne, thank you for your help😃", "votes": -2 }, { "id": 318629, "postDate": "2018-04-24T06:49:37.120Z", "content": "\n\n\nI think she means the scored subset of stage 2 test was smaller.
\n
How big was it? <65 images?
", "rawMarkdown": "> I think she means the scored subset of stage 2 test was smaller.\n\nHow big was it? <65 images?" }, { "id": 318766, "postDate": "2018-04-24T12:53:15.267Z", "content": "I cannot say until we decide on this thread: https://www.kaggle.com/c/data-science-bowl-2018/discussion/54764
", "rawMarkdown": "I cannot say until we decide on this thread: https://www.kaggle.com/c/data-science-bowl-2018/discussion/54764", "votes": 2 } ] }, { "id": 327067, "postDate": "2018-05-10T19:14:16.543Z", "content": "Hello there - the leaderboard has been finalized. If you feel you should be reinstated, please contact compliance.
", "rawMarkdown": "Hello there - the leaderboard has been finalized. If you feel you should be reinstated, please contact compliance. ", "votes": -4, "replies": [ { "id": 327084, "postDate": "2018-05-10T19:43:30.690Z", "content": "Thanks for the updates. Our team Summ has not been reinstated and I have contacted the compliance via the link https://www.kaggle.com/compliance. I believe it is necessary for every team that are removed to receive an official notification (even automatically generated) on the specific reasons for the removal decision
", "rawMarkdown": "Thanks for the updates. Our team Summ has not been reinstated and I have contacted the compliance via the link https://www.kaggle.com/compliance. I believe it is necessary for every team that are removed to receive an official notification (even automatically generated) on the specific reasons for the removal decision", "votes": 3 }, { "id": 327089, "postDate": "2018-05-10T19:50:39.307Z", "content": "Hi Maggie!\nyou wrote above that: \"We have made the decision to reinstate those who made submissions in Stage 2 of the competition.\"\nI made a submission in Stage 2, but I am not reinstated, I cannot find my result. Who should I contact and where, I am a bit confused. Thank you.
", "rawMarkdown": "Hi Maggie!\nyou wrote above that: \"We have made the decision to reinstate those who made submissions in Stage 2 of the competition.\"\nI made a submission in Stage 2, but I am not reinstated, I cannot find my result. Who should I contact and where, I am a bit confused. Thank you." }, { "id": 328114, "postDate": "2018-05-13T11:41:56.083Z", "content": "Hi Maggie! \nMy team (SwissBearsAndLions) has also not been reinstated! Could you please check why? \nThank you.
", "rawMarkdown": "Hi Maggie! \nMy team (SwissBearsAndLions) has also not been reinstated! Could you please check why? \nThank you." }, { "id": 328186, "postDate": "2018-05-13T15:44:48.443Z", "content": "Hi Maggie, We finished at 745 at the end of 2nd round, but we aren't present on the leaderboard now. Can you please look into it?
", "rawMarkdown": "Hi Maggie, We finished at 745 at the end of 2nd round, but we aren't present on the leaderboard now. Can you please look into it?", "votes": -1 }, { "id": 329774, "postDate": "2018-05-17T06:44:30.327Z", "content": "Hi Maggie, I've asked for reinstatement or any explanations as well through compliance page, I did it 3 times, but still didn't get any answer. Could you please comment on this? Thank you!
", "rawMarkdown": "Hi Maggie, I've asked for reinstatement or any explanations as well through compliance page, I did it 3 times, but still didn't get any answer. Could you please comment on this? Thank you!", "votes": 2 } ] }, { "id": 319640, "postDate": "2018-04-26T13:57:40.087Z", "content": "新手报道๑乛◡乛๑
", "rawMarkdown": "新手报道๑乛◡乛๑", "votes": -7 }, { "id": 538227, "postDate": "2019-05-28T10:13:55.963Z", "content": "hi Maggie \nI have a question about competitions \nIs that possible that u tell me how kaggle pays the prizes to the winners of a competition \ndoes it use credit methods like paypal or visa or something like this?\nthanks for your attention
", "rawMarkdown": "hi Maggie \nI have a question about competitions \nIs that possible that u tell me how kaggle pays the prizes to the winners of a competition \ndoes it use credit methods like paypal or visa or something like this?\nthanks for your attention", "votes": -1 }, { "id": 329773, "postDate": "2018-05-17T06:43:25.513Z", "rawMarkdown": "", "votes": -1 }, { "id": 327269, "postDate": "2018-05-11T06:47:38.303Z", "content": "Recovered, please notify us
", "rawMarkdown": "Recovered, please notify us", "votes": -1 }, { "id": 326822, "postDate": "2018-05-10T11:41:33.843Z", "content": "Please update us on this....still not reinstated
", "rawMarkdown": "Please update us on this....still not reinstated ", "votes": -1 }, { "id": 326611, "postDate": "2018-05-10T02:52:06.907Z", "content": "I'm not reinstated too
", "rawMarkdown": "I'm not reinstated too", "votes": -1 }, { "id": 319429, "postDate": "2018-04-26T03:02:22.637Z", "content": "hello, dsb2018 ddl is April 16, 2018,11:59 PM UTC.\nin beijing time, is April 17,2018,7:59 AM.\nI selected my latest submission in April 17,2018,7:30 AM in beijing time.\nand i saw that \"selected submissions updated\"\nbut actually , failed.\nmy history 2 submission (history selected) was successful.\nlatest submission was failed with a score 0.574\ncan you help me ?
", "rawMarkdown": "hello, dsb2018 ddl is April 16, 2018,11:59 PM UTC.\nin beijing time, is April 17,2018,7:59 AM.\nI selected my latest submission in April 17,2018,7:30 AM in beijing time.\nand i saw that \"selected submissions updated\"\nbut actually , failed.\nmy history 2 submission (history selected) was successful.\nlatest submission was failed with a score 0.574\ncan you help me ?\n", "votes": -3 }, { "id": 320187, "postDate": "2018-04-27T20:08:20.323Z", "content": "quick question - is it possible to access the leaderboard history for this competition, to see both stage 1 and stage 2 rankings and submission scores? In the past I've used public?asOf=<some date> but here this just redirects to the current leaderboard.
Fair decision, Maggie.
", "rawMarkdown": "Fair decision, Maggie." }, { "id": 318848, "postDate": "2018-04-24T15:34:22.077Z", "content": "Good..
", "rawMarkdown": "Good.." }, { "id": 318656, "postDate": "2018-04-24T08:01:01.800Z", "content": "Good job
", "rawMarkdown": "Good job" }, { "id": 318644, "postDate": "2018-04-24T07:11:31.387Z", "content": "Can you make it clear where to upload our code?
", "rawMarkdown": "Can you make it clear where to upload our code? ", "replies": [ { "id": 318647, "postDate": "2018-04-24T07:22:23.980Z", "content": "This was my first competition as well, so did not upload code or models kept uploading result.
\n\nStill not sure it requires code only or model also..
", "rawMarkdown": "This was my first competition as well, so did not upload code or models kept uploading result.\n\n - I think in the team page we need to upload the model as a zip.\n\nStill not sure it requires code only or model also.. " }, { "id": 318707, "postDate": "2018-04-24T09:58:54.847Z", "content": "You don't have to upload the code, your 2nd stage rankings will be re-instated and the medals and rankings will be based on that.
", "rawMarkdown": "You don't have to upload the code, your 2nd stage rankings will be re-instated and the medals and rankings will be based on that." } ] }, { "id": 318503, "postDate": "2018-04-24T00:37:19.283Z", "content": "Our appreciation.
", "rawMarkdown": "Our appreciation." }, { "id": 326174, "postDate": "2018-05-09T11:51:08.117Z", "rawMarkdown": "", "isDeleted": true }, { "id": 323054, "postDate": "2018-05-04T08:37:33.003Z", "rawMarkdown": "", "isDeleted": true, "replies": [ { "id": 323062, "postDate": "2018-05-04T09:04:59.107Z", "content": "Medals haven't been given yet so it is probably still in progress :)
", "rawMarkdown": "Medals haven't been given yet so it is probably still in progress :)" }, { "id": 323067, "postDate": "2018-05-04T09:19:39.027Z", "content": "Thankyou!
", "rawMarkdown": "Thankyou!" } ] }, { "id": 319432, "postDate": "2018-04-26T03:07:08.570Z", "rawMarkdown": "", "isDeleted": true }, { "id": 319224, "postDate": "2018-04-25T14:46:00.037Z", "rawMarkdown": "", "isDeleted": true }, { "id": 318657, "postDate": "2018-04-24T08:18:44.327Z", "rawMarkdown": "", "isDeleted": true }, { "id": 321219, "postDate": "2018-04-30T21:05:31.740Z", "content": "Maggie, Really thanks for your work!
", "rawMarkdown": "Maggie, Really thanks for your work!", "votes": 1 }, { "id": 318577, "postDate": "2018-04-24T05:06:25.007Z", "content": "Yes! Thank you so much!
", "rawMarkdown": "Yes! Thank you so much!" }, { "id": 318516, "postDate": "2018-04-24T01:16:36.437Z", "content": "This is great! Thanks!
", "rawMarkdown": "This is great! Thanks!" }, { "id": 318480, "postDate": "2018-04-23T22:59:50.237Z", "content": "Really thanks for your hard work!
", "rawMarkdown": "Really thanks for your hard work!", "votes": 1 }, { "id": 329593, "postDate": "2018-05-16T19:19:11.233Z", "content": "Thank You....for the reinstatement :)
", "rawMarkdown": "Thank You....for the reinstatement :)", "votes": -1 } ], "comments": [ { "id": 319020, "author_name": "Summit", "author_url": "", "post_date": "2018-04-25T03:55:13.903000", "content": "This is my first Kaggle competition. I entered the game late (about a month before the stage 1 deadline) and spent about three weeks of my spare time on it. Overall, it turns out to be a fantastic learning experience, way beyond my expectation. I was disappointed to learn that my final result that ranked 36th was removed due to not uploading model in time. Thanks to the communities' effort, the LB will be reinstated.
\n\nI have to say that the most amazing thing about Kaggle, from my perspective, is the community. I learnt a lot from the public kernels and discussion boards, contributed by people like @Heng CherKeng, @Waleed and @Stephen Bailey. I feel that this is great platform to learn from practice and I hope the collaborative atmosphere will not be affected by this incident.
\n\nI here just want to share my experience and suggestions regarding the communication of model uploading requirement and the way how removal and reinstatement is done, so that first-time Kagglers like me will not be confused or discouraged in the future.
\n\nThe timeline tab and the FAQ page. The only place I see requirement related to uploading model is the timeline tab. To figure out how to upload my model, I found the FAQ page (https://www.kaggle.com/two-stage-faq), which happens to state that the leaderboard position will not be affected as long as the team does not win the prize. This leaves me the impression that the model-uploading deadline of this competition applies only to the prize-eligible teams. I suggest when competition-specific requirement differs from the general FAQ, it should be stressed in bold so that participants will not miss the fact that this particular requirement overwrites the general FAQ in this competition. Also this should be included in the rule page.
The model upload page. This page allowed the participant to upload model after the stage 1 deadline without any notification while only the most recent submission is kept. In scenarios that a participant fixed a non-scientific bug when evaluating stage 2 test data and wanted to update their uploaded model, their proof of previous submission will be erased. I suggest either to prevent participants from submitting model after the stage 1 deadline or at least give a notification of the possible consequences.
Lack of message to individuals about the specific reason of leaderboard removal. To a participant who did spend some time and energy or possibly money, the removal is definitely not a trivial thing. Therefore, to tell a participant about the specific reason (like not submitting model on time, model contains non open-source licensed code, suspicious duplicated account and etc) of such removal decision shows a basic respect from the organizer. The message can either be sent through the Kaggle notification or to email account. I learnt about my removal when I was trying to show my friends my first Kaggle achievement...
Big decisions like removing more than 50% participants should be more carefully communicated. Message like \"We discussed this internally at Kaggle and decided that we are going to change our practice going forward.\" did not acknowledge the ambiguity of the rule (timeline vs FAQ) and seemed to put all the fault on the participants. This could leave participants to feel disturbing and become defensive during discussion.
I acknowledge the hard work of the Kaggle team to provide the great platform for people to learn, compete and have fun. I hope I can contribute more to the community in my next competition.
", "votes": 11, "replies": [] }, { "id": 321659, "author_name": "Maggie", "author_url": "", "post_date": "2018-05-01T17:51:08.580000", "content": "We are working through final updates, thanks for your patience! You will see when the leaderboard is final if you refresh the leaderboard, we are shooting for next week. Once it is final you can email compliance with any questions. Thank you!
", "votes": 9, "replies": [ { "id": 325638, "author_name": "Brian Luo", "author_url": "", "post_date": "2018-05-08T16:49:31.450000", "content": "Is the leaderboard finalized? Why I still cannot see my team? There are only 726 teams on the LB now! (there are 861 teams just after the competition end)
", "votes": 3, "replies": [] } ] }, { "id": 320800, "author_name": "photogazer", "author_url": "", "post_date": "2018-04-29T22:23:35.083000", "content": "@Maggie, I am still not seeing our team being listed on the Leaderboard. Could you look into it? If there was something we did wrong in our submission, please let us know as well. To my knowledge we respected the submission timeline and put checkmarks on two of our submissions as per guidelines. This is our first competition, so we'd like to learn from our mistakes if any. Thanks!
", "votes": 7, "replies": [ { "id": 327912, "author_name": "photogazer", "author_url": "", "post_date": "2018-05-12T21:56:37.350000", "content": "@Maggie, Thank you very much for reinstating our team! Much appreciated.
", "votes": 0, "replies": [] } ] }, { "id": 319936, "author_name": "Raoul", "author_url": "", "post_date": "2018-04-27T06:12:54.580000", "content": "@kaggle, my result/score has also not been reinstated. Please check if you have missed to reinstate some of the people which you had removed earlier from the LB. Thanks.
", "votes": 7, "replies": [ { "id": 319948, "author_name": "Vladimir Groza", "author_url": "", "post_date": "2018-04-27T06:43:23.547000", "content": "Exactly the same. I was also removed just before the main wave. Already requested twice through compliance page but got no answer.
", "votes": -1, "replies": [] } ] }, { "id": 319631, "author_name": "Songyao", "author_url": "", "post_date": "2018-04-26T13:24:13.217000", "content": "Just wondering how long it will take....
", "votes": 8, "replies": [ { "id": 319789, "author_name": "Shitian Ni", "author_url": "", "post_date": "2018-04-26T20:48:04.573000", "content": "Kaggle reinstated us just now. Cheers!
", "votes": 1, "replies": [] }, { "id": 319815, "author_name": "JamesEverard", "author_url": "", "post_date": "2018-04-26T22:08:21.930000", "content": "But no medals. Are they coming?
", "votes": 2, "replies": [] }, { "id": 319817, "author_name": "Mungos", "author_url": "", "post_date": "2018-04-26T22:28:02.687000", "content": "If i understood correctly they will calculate the final medals according to the stage 1 number of people so medals will be given out to top 363 people which probably takes some tweaking to make it work that way as well as the fact that they need to restore the score of people they removed earlier :)
", "votes": 1, "replies": [] }, { "id": 319827, "author_name": "Terry Kao", "author_url": "", "post_date": "2018-04-26T23:00:47.383000", "content": "From one of the previous posts, maybe from Maggie, medals will come in a few weeks when they finalize results. So I'm not expecting to see medals soon.
\nYeah, they reinstated all of us. You can tell because 99% of the folks that posted here now show rankings in the competition next to their name, versus nothing just a few hours ago :)
Not all of us.
", "votes": 0, "replies": [] } ] }, { "id": 325407, "author_name": "Yassine Ghouzam", "author_url": "", "post_date": "2018-05-08T11:41:44.553000", "content": "@Maggie I am still not seeing our team being listed on the Leaderboard. we respected the submission timeline and selected two of our submissions for stage 1 and 2 .Thanks!
", "votes": 6, "replies": [] }, { "id": 319857, "author_name": "Sumiko", "author_url": "", "post_date": "2018-04-27T01:26:00.943000", "content": "Maggie, may I know whether the reinstatement has been completed or is it still in progress? Mine has not been reinstated and I uploaded the 2 models during the stage 2 of the competition.
", "votes": 6, "replies": [ { "id": 319901, "author_name": "", "author_url": "", "post_date": "2018-04-27T04:32:27.403000", "content": "", "votes": -2, "replies": [] } ] }, { "id": 318982, "author_name": "eagle4", "author_url": "", "post_date": "2018-04-25T00:40:12.923000", "content": "a new competition called \"YOYO ranking\" is to predict the final ranking in this competition given the past ones...\nGood luck !
", "votes": 5, "replies": [] }, { "id": 320156, "author_name": "Maggie", "author_url": "", "post_date": "2018-04-27T16:39:44.520000", "content": "Thanks for the comments, we are still working through the updates. We have reinstated the majority of those who did not upload a model but are working through our normal compliance checks.
", "votes": 5, "replies": [ { "id": 320161, "author_name": "Kishore M", "author_url": "", "post_date": "2018-04-27T16:56:33.030000", "content": "Thanks for the update maggie.
", "votes": 1, "replies": [] }, { "id": 321110, "author_name": "Karthik", "author_url": "", "post_date": "2018-04-30T16:19:09.487000", "content": "Thanks for the update maggie.
", "votes": 0, "replies": [] } ] }, { "id": 318745, "author_name": "David Ermer", "author_url": "", "post_date": "2018-04-24T11:50:01.103000", "content": "Now all the people that scored better after the 'purge' will be upset. This has really turned into a donnybrook. Hopefully Kaggle has learned something from this.
", "votes": 5, "replies": [] }, { "id": 318641, "author_name": "JamesEverard", "author_url": "", "post_date": "2018-04-24T07:03:44.500000", "content": "When 50% of the smartest minds on the planet don’t understand the instructions, there is probably something wrong with the instructions.
\n\nYou did the right thing, Kaggle. Well done.
", "votes": 3, "replies": [] }, { "id": 321561, "author_name": "Ho-Kin", "author_url": "", "post_date": "2018-05-01T14:57:52.357000", "content": "Hi, I cannot find my team too, we have selected two best solutions before deadline of stage 2.
", "votes": 3, "replies": [] }, { "id": 320268, "author_name": "Brian Luo", "author_url": "", "post_date": "2018-04-28T04:20:23.953000", "content": "@maggiemd Thanks for your hard working those days! But are you still working on more teams? I cannot find my team on the leaderboard. My team was removed on 20 April. Is there any problem?
\n\nI found a screenshot just after the end of competition.\n
And other screenshots after 4 days ago, in the morning of 20 April.
\n\n\n\n
@Maggie, \nI have the same problem as @Sumiko.\nI had submitted my model and code before the dead line of stage1, and I had submitted my prediction csv file of stage2 before the deadline of stage2. However, my score has not been reinstated yet.
", "votes": 3, "replies": [ { "id": 319872, "author_name": "Kishore M", "author_url": "", "post_date": "2018-04-27T02:18:52.987000", "content": "Hi I hope the leader board reinstatement is not completed yet. Because I had uploaded my code before stage 1 deadline and did submissions in stage 2 . still my entry missing on leader board. I think we need to wait till we hear from @maggie saying it is the final LB.
", "votes": 2, "replies": [] } ] }, { "id": 318613, "author_name": "vacuum", "author_url": "", "post_date": "2018-04-24T06:07:23.533000", "content": "If I understand correctly, stage 2 score is useless now and the final LB rank (and prize?) will be determined by the \"more popular\" stage 1 score? If that is the case, aren't stage 1 test set much smaller than stage 2 and much easier to overfit?
", "votes": 4, "replies": [ { "id": 318619, "author_name": "anokas", "author_url": "", "post_date": "2018-04-24T06:27:16.283000", "content": "Furthermore, if rankings are indeed based off stage 1 (which is news to me), I think the leaderboards should both be available under tabs (like how public/private are both visible atm)
", "votes": 4, "replies": [] }, { "id": 318621, "author_name": "Shitian Ni", "author_url": "", "post_date": "2018-04-24T06:32:01.557000", "content": "I think it’s not the score but the participant number from Stage 1 is used to calculate how many people in Stage 2 get medals.
", "votes": 4, "replies": [] }, { "id": 318863, "author_name": "Maggie", "author_url": "", "post_date": "2018-04-24T16:22:36.450000", "content": "Shitian Ni is correct, the scores from Stage 2 are the final standing of the competition, but the ranking is based upon the total number in Stage 1.
", "votes": 6, "replies": [] }, { "id": 318903, "author_name": "vacuum", "author_url": "", "post_date": "2018-04-24T17:58:32.717000", "content": "Thanks for the clarification! Thanks for listening to participants' feedback and changing the course!
", "votes": 0, "replies": [] } ] }, { "id": 320544, "author_name": "Zheng Li", "author_url": "", "post_date": "2018-04-29T02:23:53.890000", "content": "@Maggie Same problem as Liang Jeff. Still can't find my score in LB. Can you please check it again?
", "votes": 2, "replies": [] }, { "id": 318485, "author_name": "Stephen Bailey", "author_url": "", "post_date": "2018-04-23T23:24:53.827000", "content": "Great -- thank you for listening to our feedback!
", "votes": 2, "replies": [] }, { "id": 322785, "author_name": "Toan Duc Bui", "author_url": "", "post_date": "2018-05-03T16:40:56.297000", "content": "What does happen if my team zip file without md5 checksum? I also upload the model before the deadline but just compress the model without md5 checksum, and my team has been removed in the second round.
", "votes": 1, "replies": [] }, { "id": 321640, "author_name": "Eric", "author_url": "", "post_date": "2018-05-01T17:32:06.573000", "content": "thanks for the update Maggie\nIt makes things clearer
", "votes": 1, "replies": [] }, { "id": 321584, "author_name": "Kunal.S.Kasodekar", "author_url": "", "post_date": "2018-05-01T15:54:28.917000", "content": "@Maggie,thanks for all your hard work,cant find my lb in the leaderboard,can you help me ?
", "votes": 1, "replies": [] }, { "id": 320943, "author_name": "yaya", "author_url": "", "post_date": "2018-04-30T08:54:06.733000", "content": "Hi,Maggie,thank you for your hard working!I still can't find my lb in the leaderboard,can you help me ?
", "votes": 1, "replies": [] }, { "id": 320776, "author_name": "Puneet Vashisht", "author_url": "", "post_date": "2018-04-29T19:44:50.123000", "content": "@Maggie, I still can't find my score in LB (Team Name: Dataexplorers). Request you to please check. Thanks
", "votes": 1, "replies": [] }, { "id": 319910, "author_name": "xumm16", "author_url": "", "post_date": "2018-04-27T05:08:48.860000", "content": "same problem as Sumiko, @Maggie
", "votes": 1, "replies": [] }, { "id": 318579, "author_name": "gavrand", "author_url": "", "post_date": "2018-04-24T05:15:17.490000", "content": "Thank you for restoring fairness. Kaggle is a community and trust is above all.
", "votes": 0, "replies": [ { "id": 318594, "author_name": "Shitian Ni", "author_url": "", "post_date": "2018-04-24T05:28:34.090000", "content": "@gavrand thank you for fighting for the community through your Discussion posts so we can get this result
", "votes": 0, "replies": [] } ] }, { "id": 326931, "author_name": "DeepNet", "author_url": "", "post_date": "2018-05-10T14:26:13.717000", "content": "Hi Maggie, Is the reinstatement final? Because there are lots of people (89 to be exact) who have not been reinstated. Thanks!
", "votes": 2, "replies": [] }, { "id": 320622, "author_name": "IAmLegend", "author_url": "", "post_date": "2018-04-29T10:01:35.193000", "content": "@Maggie, I still can't find my score in LB. Please check it again. Thanks
", "votes": 2, "replies": [] }, { "id": 320532, "author_name": "George Lee", "author_url": "", "post_date": "2018-04-29T00:42:16.310000", "content": "Hi @maggiemd can you please check our team? I logged in today and didn't see our score. Thanks.
", "votes": 2, "replies": [] }, { "id": 320505, "author_name": "Deepak Singh Rawat", "author_url": "", "post_date": "2018-04-28T20:53:23.473000", "content": "@maggiemd my team is also not reinstated. We submitted the code for Stage1. Are you still working on the updates?
", "votes": 2, "replies": [] }, { "id": 320278, "author_name": "Liang Jeff", "author_url": "", "post_date": "2018-04-28T05:49:11.237000", "content": "Hi @Maggie, My team(T---Team) got LB 0.557 at stage2 (51/816) .I submit my code before April 11, maybe is a little messy. I didn't change my model, I just run the model I generated three weeks ago and submitted the final result. I wonder why my rank is moved and not reinstated. I'm looking forward to your reply. Thanks.
", "votes": 2, "replies": [] }, { "id": 320270, "author_name": "", "author_url": "", "post_date": "2018-04-28T04:25:35.750000", "content": "", "votes": 2, "replies": [] }, { "id": 319935, "author_name": "", "author_url": "", "post_date": "2018-04-27T06:11:33.553000", "content": "", "votes": 2, "replies": [] }, { "id": 319917, "author_name": "", "author_url": "", "post_date": "2018-04-27T05:21:05.007000", "content": "", "votes": 2, "replies": [] }, { "id": 328584, "author_name": "", "author_url": "", "post_date": "2018-05-14T16:43:38.483000", "content": "", "votes": 0, "replies": [] }, { "id": 326121, "author_name": "", "author_url": "", "post_date": "2018-05-09T10:12:12.563000", "content": "", "votes": 0, "replies": [] }, { "id": 325625, "author_name": "", "author_url": "", "post_date": "2018-05-08T16:32:47.990000", "content": "", "votes": 0, "replies": [] }, { "id": 325570, "author_name": "", "author_url": "", "post_date": "2018-05-08T15:03:57.147000", "content": "", "votes": 0, "replies": [] }, { "id": 319947, "author_name": "", "author_url": "", "post_date": "2018-04-27T06:42:39.213000", "content": "", "votes": 0, "replies": [] }, { "id": 318570, "author_name": "", "author_url": "", "post_date": "2018-04-24T04:36:36.720000", "content": "", "votes": 0, "replies": [] }, { "id": 318525, "author_name": "", "author_url": "", "post_date": "2018-04-24T01:47:15.523000", "content": "", "votes": 0, "replies": [] }, { "id": 318517, "author_name": "", "author_url": "", "post_date": "2018-04-24T01:24:10.543000", "content": "", "votes": 0, "replies": [] }, { "id": 331174, "author_name": "", "author_url": "", "post_date": "2018-05-20T14:33:31.337000", "content": "", "votes": 1, "replies": [ { "id": 343194, "author_name": "", "author_url": "", "post_date": "2018-06-14T21:13:46.030000", "content": "", "votes": 3, "replies": [] }, { "id": 344447, "author_name": "", "author_url": "", "post_date": "2018-06-18T03:02:43.730000", "content": "", "votes": 1, "replies": [] } ] }, { "id": 329067, "author_name": "", "author_url": "", "post_date": "2018-05-15T16:54:37.370000", "content": "", "votes": 1, "replies": [ { "id": 329071, "author_name": "", "author_url": "", "post_date": "2018-05-15T16:57:42.747000", "content": "", "votes": 1, "replies": [] }, { "id": 330842, "author_name": "", "author_url": "", "post_date": "2018-05-19T20:40:17.120000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 320055, "author_name": "", "author_url": "", "post_date": "2018-04-27T11:18:21.133000", "content": "", "votes": 1, "replies": [] }, { "id": 322243, "author_name": "", "author_url": "", "post_date": "2018-05-02T15:54:20.883000", "content": "", "votes": -1, "replies": [] }, { "id": 318623, "author_name": "", "author_url": "", "post_date": "2018-04-24T06:38:18.503000", "content": "", "votes": -1, "replies": [] }, { "id": 318555, "author_name": "", "author_url": "", "post_date": "2018-04-24T03:35:26.683000", "content": "", "votes": 0, "replies": [ { "id": 318824, "author_name": "", "author_url": "", "post_date": "2018-04-24T14:49:31.097000", "content": "", "votes": -1, "replies": [] }, { "id": 319046, "author_name": "", "author_url": "", "post_date": "2018-04-25T05:11:04.877000", "content": "", "votes": -1, "replies": [] }, { "id": 319219, "author_name": "", "author_url": "", "post_date": "2018-04-25T14:31:58.873000", "content": "", "votes": 0, "replies": [] }, { "id": 319268, "author_name": "", "author_url": "", "post_date": "2018-04-25T16:23:10.107000", "content": "", "votes": -1, "replies": [] } ] }, { "id": 321236, "author_name": "", "author_url": "", "post_date": "2018-04-30T21:31:28.770000", "content": "", "votes": 0, "replies": [] }, { "id": 318481, "author_name": "", "author_url": "", "post_date": "2018-04-23T23:03:49.237000", "content": "", "votes": 0, "replies": [ { "id": 318492, "author_name": "", "author_url": "", "post_date": "2018-04-23T23:50:35.343000", "content": "", "votes": 9, "replies": [] }, { "id": 318493, "author_name": "", "author_url": "", "post_date": "2018-04-23T23:54:25.800000", "content": "", "votes": 0, "replies": [] }, { "id": 318494, "author_name": "", "author_url": "", "post_date": "2018-04-23T23:58:00.590000", "content": "", "votes": 0, "replies": [] }, { "id": 318510, "author_name": "", "author_url": "", "post_date": "2018-04-24T00:45:32.517000", "content": "", "votes": -2, "replies": [] }, { "id": 318629, "author_name": "", "author_url": "", "post_date": "2018-04-24T06:49:37.120000", "content": "", "votes": 0, "replies": [] }, { "id": 318766, "author_name": "", "author_url": "", "post_date": "2018-04-24T12:53:15.267000", "content": "", "votes": 2, "replies": [] } ] }, { "id": 327067, "author_name": "", "author_url": "", "post_date": "2018-05-10T19:14:16.543000", "content": "", "votes": -4, "replies": [ { "id": 327084, "author_name": "", "author_url": "", "post_date": "2018-05-10T19:43:30.690000", "content": "", "votes": 3, "replies": [] }, { "id": 327089, "author_name": "", "author_url": "", "post_date": "2018-05-10T19:50:39.307000", "content": "", "votes": 0, "replies": [] }, { "id": 328114, "author_name": "", "author_url": "", "post_date": "2018-05-13T11:41:56.083000", "content": "", "votes": 0, "replies": [] }, { "id": 328186, "author_name": "", "author_url": "", "post_date": "2018-05-13T15:44:48.443000", "content": "", "votes": -1, "replies": [] }, { "id": 329774, "author_name": "", "author_url": "", "post_date": "2018-05-17T06:44:30.327000", "content": "", "votes": 2, "replies": [] } ] }, { "id": 319640, "author_name": "", "author_url": "", "post_date": "2018-04-26T13:57:40.087000", "content": "", "votes": -7, "replies": [] }, { "id": 538227, "author_name": "", "author_url": "", "post_date": "2019-05-28T10:13:55.963000", "content": "", "votes": -1, "replies": [] }, { "id": 329773, "author_name": "", "author_url": "", "post_date": "2018-05-17T06:43:25.513000", "content": "", "votes": -1, "replies": [] }, { "id": 327269, "author_name": "", "author_url": "", "post_date": "2018-05-11T06:47:38.303000", "content": "", "votes": -1, "replies": [] }, { "id": 326822, "author_name": "", "author_url": "", "post_date": "2018-05-10T11:41:33.843000", "content": "", "votes": -1, "replies": [] }, { "id": 326611, "author_name": "", "author_url": "", "post_date": "2018-05-10T02:52:06.907000", "content": "", "votes": -1, "replies": [] }, { "id": 319429, "author_name": "", "author_url": "", "post_date": "2018-04-26T03:02:22.637000", "content": "", "votes": -3, "replies": [] }, { "id": 320187, "author_name": "", "author_url": "", "post_date": "2018-04-27T20:08:20.323000", "content": "", "votes": 0, "replies": [] }, { "id": 318963, "author_name": "", "author_url": "", "post_date": "2018-04-24T22:13:09.943000", "content": "", "votes": 0, "replies": [] }, { "id": 318848, "author_name": "", "author_url": "", "post_date": "2018-04-24T15:34:22.077000", "content": "", "votes": 0, "replies": [] }, { "id": 318656, "author_name": "", "author_url": "", "post_date": "2018-04-24T08:01:01.800000", "content": "", "votes": 0, "replies": [] }, { "id": 318644, "author_name": "", "author_url": "", "post_date": "2018-04-24T07:11:31.387000", "content": "", "votes": 0, "replies": [ { "id": 318647, "author_name": "", "author_url": "", "post_date": "2018-04-24T07:22:23.980000", "content": "", "votes": 0, "replies": [] }, { "id": 318707, "author_name": "", "author_url": "", "post_date": "2018-04-24T09:58:54.847000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 318503, "author_name": "", "author_url": "", "post_date": "2018-04-24T00:37:19.283000", "content": "", "votes": 0, "replies": [] }, { "id": 326174, "author_name": "", "author_url": "", "post_date": "2018-05-09T11:51:08.117000", "content": "", "votes": 0, "replies": [] }, { "id": 323054, "author_name": "", "author_url": "", "post_date": "2018-05-04T08:37:33.003000", "content": "", "votes": 0, "replies": [ { "id": 323062, "author_name": "", "author_url": "", "post_date": "2018-05-04T09:04:59.107000", "content": "", "votes": 0, "replies": [] }, { "id": 323067, "author_name": "", "author_url": "", "post_date": "2018-05-04T09:19:39.027000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 319432, "author_name": "", "author_url": "", "post_date": "2018-04-26T03:07:08.570000", "content": "", "votes": 0, "replies": [] }, { "id": 319224, "author_name": "", "author_url": "", "post_date": "2018-04-25T14:46:00.037000", "content": "", "votes": 0, "replies": [] }, { "id": 318657, "author_name": "", "author_url": "", "post_date": "2018-04-24T08:18:44.327000", "content": "", "votes": 0, "replies": [] }, { "id": 321219, "author_name": "", "author_url": "", "post_date": "2018-04-30T21:05:31.740000", "content": "", "votes": 1, "replies": [] }, { "id": 318577, "author_name": "", "author_url": "", "post_date": "2018-04-24T05:06:25.007000", "content": "", "votes": 0, "replies": [] }, { "id": 318516, "author_name": "", "author_url": "", "post_date": "2018-04-24T01:16:36.437000", "content": "", "votes": 0, "replies": [] }, { "id": 318480, "author_name": "", "author_url": "", "post_date": "2018-04-23T22:59:50.237000", "content": "", "votes": 1, "replies": [] }, { "id": 329593, "author_name": "", "author_url": "", "post_date": "2018-05-16T19:19:11.233000", "content": "", "votes": -1, "replies": [] } ], "raw_markdown_by_id": { "318476": "Thank you all for your hard work in this competition and for the feedback on the Stage 1 model upload discussion. Your thoughtful discussions brought out many different aspects to 2-Stage competitions that we had to consider. \n\nOur intention in requiring upload of the models before Stage 2 has been to lock in the efforts of Stage 1 and prevent further training on the models before the introduction of new data. We agree that this is an important component of this competition with the 2nd stage dataset. \n\nFurther, since we base final rankings on the more popular Stage 1 of the competition, we want to make sure that the rankings are fair. During the second stage we wipe out the leaderboard, but we use the Stage 1 number of teams when we calculate the medals and points to incentivize participation in the second stage.\n\nDespite these different aspects of 2-Stage competitions, clarity of the rules of engagement outweighs any other considerations and we could have done better here. We have decided to change course. We noted some inconsistency between the Timeline and the Rules and can see how the need to upload a model by April 11th may have been ambiguous to some. We also acknowledge the difference in this practice with our general FAQ’s for 2-Stage competitions. \n\nWe have made the decision to reinstate those who made submissions in Stage 2 of the competition. We will implement this update in the next few days.\n\nWe could have done better in communicating the specific requirements for this 2-stage competition and will do better next time in making specific deadlines clear. We regret the confusion caused and will work to over-communicate competitions with different dates and requirements going forward.\n\nThanks again for your hard work in this competition!\n", "319020": "This is my first Kaggle competition. I entered the game late (about a month before the stage 1 deadline) and spent about three weeks of my spare time on it. Overall, it turns out to be a fantastic learning experience, way beyond my expectation. I was disappointed to learn that my final result that ranked 36th was removed due to not uploading model in time. Thanks to the communities' effort, the LB will be reinstated. \n\nI have to say that the most amazing thing about Kaggle, from my perspective, is the community. I learnt a lot from the public kernels and discussion boards, contributed by people like @Heng CherKeng, @Waleed and @Stephen Bailey. I feel that this is great platform to learn from practice and I hope the collaborative atmosphere will not be affected by this incident.\n\nI here just want to share my experience and suggestions regarding the communication of model uploading requirement and the way how removal and reinstatement is done, so that first-time Kagglers like me will not be confused or discouraged in the future.\n\n1. The timeline tab and the FAQ page. The only place I see requirement related to uploading model is the timeline tab. To figure out how to upload my model, I found the FAQ page (https://www.kaggle.com/two-stage-faq), which happens to state that the leaderboard position will not be affected as long as the team does not win the prize. This leaves me the impression that the model-uploading deadline of this competition applies only to the prize-eligible teams. I suggest when competition-specific requirement differs from the general FAQ, it should be stressed in bold so that participants will not miss the fact that this particular requirement overwrites the general FAQ in this competition. Also this should be included in the rule page.\n\n2. The model upload page. This page allowed the participant to upload model after the stage 1 deadline without any notification while only the most recent submission is kept. In scenarios that a participant fixed a non-scientific bug when evaluating stage 2 test data and wanted to update their uploaded model, their proof of previous submission will be erased. I suggest either to prevent participants from submitting model after the stage 1 deadline or at least give a notification of the possible consequences. \n\n3. Lack of message to individuals about the specific reason of leaderboard removal. To a participant who did spend some time and energy or possibly money, the removal is definitely not a trivial thing. Therefore, to tell a participant about the specific reason (like not submitting model on time, model contains non open-source licensed code, suspicious duplicated account and etc) of such removal decision shows a basic respect from the organizer. The message can either be sent through the Kaggle notification or to email account. I learnt about my removal when I was trying to show my friends my first Kaggle achievement... \n\n4. Big decisions like removing more than 50% participants should be more carefully communicated. Message like \"We discussed this internally at Kaggle and **decided** that we are going to **change** our practice going forward.\" did not acknowledge the ambiguity of the rule (timeline vs FAQ) and seemed to put all the fault on the participants. This could leave participants to feel disturbing and become defensive during discussion.\n\nI acknowledge the hard work of the Kaggle team to provide the great platform for people to learn, compete and have fun. I hope I can contribute more to the community in my next competition.\n", "321659": "We are working through final updates, thanks for your patience! You will see when the leaderboard is final if you refresh the leaderboard, we are shooting for next week. Once it is final you can email compliance with any questions. Thank you!", "320800": "@Maggie, I am still not seeing our team being listed on the Leaderboard. Could you look into it? If there was something we did wrong in our submission, please let us know as well. To my knowledge we respected the submission timeline and put checkmarks on two of our submissions as per guidelines. This is our first competition, so we'd like to learn from our mistakes if any. Thanks!", "319936": "@kaggle, my result/score has also not been reinstated. Please check if you have missed to reinstate some of the people which you had removed earlier from the LB. Thanks. ", "319631": "Just wondering how long it will take....", "325407": "@Maggie I am still not seeing our team being listed on the Leaderboard. we respected the submission timeline and selected two of our submissions for stage 1 and 2 .Thanks!", "319857": "Maggie, may I know whether the reinstatement has been completed or is it still in progress? Mine has not been reinstated and I uploaded the 2 models during the stage 2 of the competition.", "318982": "a new competition called \"YOYO ranking\" is to predict the final ranking in this competition given the past ones...\nGood luck !", "320156": "Thanks for the comments, we are still working through the updates. We have reinstated the majority of those who did not upload a model but are working through our normal compliance checks. ", "318745": "Now all the people that scored better after the 'purge' will be upset. This has really turned into a donnybrook. Hopefully Kaggle has learned something from this.", "318641": "When 50% of the smartest minds on the planet don’t understand the instructions, there is probably something wrong with the instructions.\n\nYou did the right thing, Kaggle. Well done.", "321561": "Hi, I cannot find my team too, we have selected two best solutions before deadline of stage 2.", "320268": "@maggiemd Thanks for your hard working those days! But are you still working on more teams? I cannot find my team on the leaderboard. My team was removed on 20 April. Is there any problem?\n\nI found a screenshot just after the end of competition.\n![enter image description here][1]\n\nAnd other screenshots after 4 days ago, in the morning of 20 April.\n\n![][2]\n![][3]\n![][4]\n\n [1]: https://i.loli.net/2018/04/28/5ae3f82ecb754.jpg\n [2]: https://i.loli.net/2018/04/28/5ae3f81a77bed.png\n [3]: https://i.loli.net/2018/04/28/5ae3f820068bb.png\n [4]: https://i.loli.net/2018/04/28/5ae3f841351a3.png", "319862": "@Maggie, \nI have the same problem as @Sumiko.\nI had submitted my model and code before the dead line of stage1, and I had submitted my prediction csv file of stage2 before the deadline of stage2. However, my score has not been reinstated yet.", "318613": "If I understand correctly, stage 2 score is useless now and the final LB rank (and prize?) will be determined by the \"more popular\" stage 1 score? If that is the case, aren't stage 1 test set much smaller than stage 2 and much easier to overfit?", "320544": "@Maggie Same problem as Liang Jeff. Still can't find my score in LB. Can you please check it again? ", "318485": "Great -- thank you for listening to our feedback!", "322785": "What does happen if my team zip file without md5 checksum? I also upload the model before the deadline but just compress the model without md5 checksum, and my team has been removed in the second round.", "321640": "thanks for the update [Maggie](https://www.kaggle.com/maggiemd)\nIt makes things clearer", "321584": "@Maggie,thanks for all your hard work,cant find my lb in the leaderboard,can you help me ?", "320943": "Hi,Maggie,thank you for your hard working!I still can't find my lb in the leaderboard,can you help me ?", "320776": "@Maggie, I still can't find my score in LB (Team Name: Dataexplorers). Request you to please check. Thanks ", "319910": "same problem as Sumiko, @Maggie", "318579": "Thank you for restoring fairness. Kaggle is a community and trust is above all.", "326931": "Hi Maggie, Is the reinstatement final? Because there are lots of people (89 to be exact) who have not been reinstated. Thanks!", "320622": "@Maggie, I still can't find my score in LB. Please check it again. Thanks ", "320532": "Hi @maggiemd can you please check our team? I logged in today and didn't see our score. Thanks.", "320505": "@maggiemd my team is also not reinstated. We submitted the code for Stage1. Are you still working on the updates?", "320278": "Hi @Maggie, My team(T---Team) got LB 0.557 at stage2 (51/816) .I submit my code before April 11, maybe is a little messy. I didn't change my model, I just run the model I generated three weeks ago and submitted the final result. I wonder why my rank is moved and not reinstated. I'm looking forward to your reply. Thanks.", "320270": "@Maggie, I can't find my team Blade Runner in stage 2. Can you please check and confirm. Thanks.", "319935": "@Maggie, I noticed that my submission and my team disappeared and my Kaggle account shows that I am not in this competition. I accepted the rules and made submission during both stage 1 and stage 2 (before their deadline). During the first few days after stage 2 deadline, I can see my submission score and rank on private leaderboard. May I know that whether my submission, score and rank will be reinstated? Thanks!", "319917": "we have same problem as Teppei Kanayama", "328584": "Hi Maggie, we also asked for reinstatement and have not heard. Our team was Getschwifty. Could you please comment or reinstate? Thank you!", "326121": "@maggiemd my team is still not reinstated. Are you still working on the updates? If not then will we get any mail with why our team was not reinstated?", "325625": "It seems that the medals have been sent. The LB is officially finalized, will we get response if we email compliance now? Thanks", "325570": "@Maggie Our team is still missing as well...(was at 38th) Now that the winners have been announced, is the leaderboard reinstatement officially finished?", "319947": "same problem", "318570": "Appreciate this change. Fairness makes kaggle a popular and convincing platform for DS. ", "318525": "Maggie, thank you very much for listening to our feedbacks and taking necessary actions to get this corrected, very much appreciated. We'll wait for the reinstatement then.", "318517": "Thank you for listening to our opinions.", "331174": "Has this been updated? Still no score for my team >:|", "329067": "Hi. Did anyone here get a reply from compliance team? I submitted the form multiple times but to no avail. Thanks a lot!", "320055": "We have made about 40 submissions before April 11, 2018,11:59 PM UTC on 1st stage, uploaded our model before April 11, 2018,11:59 PM UTC, made 5 submissions on 2nd stage before April 16, 2018,11:59 PM UTC. We have been removed and not reinstated. And we have send our compliance. I have no idea even on why we have been removed. After all these we just appreciate an explanation, thanks. @Maggie", "322243": "Thank you Maggie. We also had the same problem and our team was wiped out. ", "318623": "Thank you Maggie and all the kaggle team .", "318555": "Smart move, thanks.", "321236": "Our team (trisolaran) was in top 10 in stage2 LB. We uploaded a hash of our code before the deadline but somehow still got removed from LB and still haven't been reinstated. @Maggie Please check it for us. Thanks!", "318481": "Thank you for changing the course! But\n\n> We agree that this is an important component of this competition with a smaller 2nd stage dataset.\n\nWhy do you keep saying this? This is wrong. 2nd stage dataset is bigger.", "327067": "Hello there - the leaderboard has been finalized. If you feel you should be reinstated, please contact compliance. ", "319640": "新手报道๑乛◡乛๑", "538227": "hi Maggie \nI have a question about competitions \nIs that possible that u tell me how kaggle pays the prizes to the winners of a competition \ndoes it use credit methods like paypal or visa or something like this?\nthanks for your attention", "329773": "", "327269": "Recovered, please notify us", "326822": "Please update us on this....still not reinstated ", "326611": "I'm not reinstated too", "319429": "hello, dsb2018 ddl is April 16, 2018,11:59 PM UTC.\nin beijing time, is April 17,2018,7:59 AM.\nI selected my latest submission in April 17,2018,7:30 AM in beijing time.\nand i saw that \"selected submissions updated\"\nbut actually , failed.\nmy history 2 submission (history selected) was successful.\nlatest submission was failed with a score 0.574\ncan you help me ?\n", "320187": "quick question - is it possible to access the leaderboard history for this competition, to see both stage 1 and stage 2 rankings and submission scores? In the past I've used `public?asOf=", "318963": "Fair decision, Maggie.", "318848": "Good..", "318656": "Good job", "318644": "Can you make it clear where to upload our code? ", "318503": "Our appreciation.", "326174": "", "323054": "", "319432": "", "319224": "", "318657": "", "321219": "Maggie, Really thanks for your work!", "318577": "Yes! Thank you so much!", "318516": "This is great! Thanks!", "318480": "Really thanks for your hard work!", "329593": "Thank You....for the reinstatement :)" } }