First of all, thanks to Kaggle, the host and everyone who has actively shared ideas and kernels throughout the competition. My teammate @negi009 and I are excited with the silver medal and the 3 dots that is going to appear under our profile pic (Kaggle expert :P)
\nI had 5 lgbm models with GroupKFold CV and validation was done using truncated samples. I have included features from event data of games such as: false-steps-average-per-round, game-time-average-per-round etc. for each game. These features were showing higher feature importances but minimal improvement on LB score.
\nCV: 0.555, public LB: 0.545, private LB: 0.538
\n@negi009 had xgb models with 4 GroupKFold CV with validation on truncated samples. Prior assessments in test sets are also included in train data. Within each fold he had truncated samples with 2 different seeds. So he had a total of 8 xgb models.
\nCV: 0.561, public LB: 0.547, private LB: 0.539
\n5 fold lgbm model from https://www.kaggle.com/fatsaltyfish/convert-to-regression-feature-test
\nFinal prediction is done using a custom voting function between all the above models. Out of the 18 models if an accuracy group gets more than 12 votes, it is selected as the final prediction. In all other cases, average distance from boundaries of model's thresholds has been used to determine the final prediction. This voting mechanism was giving stable results in multiple submissions as well as in public and private leaderboard.
\nPublic LB: 0.549, private LB: 0.549
", "comments": [ { "id": 727753, "author_name": "Ailurophile", "author_url": "", "post_date": "2020-01-24T02:22:44.780000", "content": "Congratulations\nThanks for Sharing your Approach & Insights!! @jayasoo
", "votes": 1, "replies": [] } ], "comment_count": 1, "messages": [ { "id": 727151, "postDate": "2020-01-23T13:53:01.507Z", "content": "First of all, thanks to Kaggle, the host and everyone who has actively shared ideas and kernels throughout the competition. My teammate @negi009 and I are excited with the silver medal and the 3 dots that is going to appear under our profile pic (Kaggle expert :P)
\nI had 5 lgbm models with GroupKFold CV and validation was done using truncated samples. I have included features from event data of games such as: false-steps-average-per-round, game-time-average-per-round etc. for each game. These features were showing higher feature importances but minimal improvement on LB score.
\nCV: 0.555, public LB: 0.545, private LB: 0.538
\n@negi009 had xgb models with 4 GroupKFold CV with validation on truncated samples. Prior assessments in test sets are also included in train data. Within each fold he had truncated samples with 2 different seeds. So he had a total of 8 xgb models.
\nCV: 0.561, public LB: 0.547, private LB: 0.539
\n5 fold lgbm model from https://www.kaggle.com/fatsaltyfish/convert-to-regression-feature-test
\nFinal prediction is done using a custom voting function between all the above models. Out of the 18 models if an accuracy group gets more than 12 votes, it is selected as the final prediction. In all other cases, average distance from boundaries of model's thresholds has been used to determine the final prediction. This voting mechanism was giving stable results in multiple submissions as well as in public and private leaderboard.
\nPublic LB: 0.549, private LB: 0.549
", "rawMarkdown": "First of all, thanks to Kaggle, the host and everyone who has actively shared ideas and kernels throughout the competition. My teammate @negi009 and I are excited with the silver medal and the 3 dots that is going to appear under our profile pic (Kaggle expert :P)\n\n### Model 1: \nI had 5 lgbm models with GroupKFold CV and validation was done using truncated samples. I have included features from event data of games such as: *false-steps-average-per-round*, *game-time-average-per-round* etc. for each game. These features were showing higher feature importances but minimal improvement on LB score. \n \nCV: 0.555, public LB: 0.545, private LB: 0.538\n\n### Model 2:\n@negi009 had xgb models with 4 GroupKFold CV with validation on truncated samples. Prior assessments in test sets are also included in train data. Within each fold he had truncated samples with 2 different seeds. So he had a total of 8 xgb models. \n\nCV: 0.561, public LB: 0.547, private LB: 0.539\n\n### Model 3: \n5 fold lgbm model from https://www.kaggle.com/fatsaltyfish/convert-to-regression-feature-test\n\n### **Ensemble:**\nFinal prediction is done using a custom voting function between all the above models. Out of the 18 models if an accuracy group gets more than 12 votes, it is selected as the final prediction. In all other cases, average distance from boundaries of model's thresholds has been used to determine the final prediction. This voting mechanism was giving stable results in multiple submissions as well as in public and private leaderboard.\n\nPublic LB: 0.549, private LB: 0.549", "votes": 11 }, { "id": 727753, "postDate": "2020-01-24T02:22:44.780Z", "content": "Congratulations\nThanks for Sharing your Approach & Insights!! @jayasoo
", "rawMarkdown": "Congratulations\nThanks for Sharing your Approach & Insights!! @jayasoo ", "votes": 1 } ], "complete": true, "source": "live", "fetched_at": "2026-10-22T10:51:43Z", "competition_id": 16531, "competition_slug": "data-science-bowl-2019", "team_id": 4135938, "solution_url": "/competitions/data-science-bowl-2019/writeups/lufoto-76th-place-solution-with-kernel" }