{
  "id": 566677,
  "title": "24th Place Solution",
  "content": "<p>First, congratulations to the competition winners, and sincere thanks to our team members <a href=\"https://www.kaggle.com/gentlezdh\" target=\"_blank\">@gentlezdh</a>,  <a href=\"https://www.kaggle.com/yoshifumimiya\" target=\"_blank\">@yoshifumimiya</a>,  <a href=\"https://www.kaggle.com/lizhecheng\" target=\"_blank\">@lizhecheng</a>,  <a href=\"https://www.kaggle.com/nandodmelo\" target=\"_blank\">@nandodmelo</a>,  <a href=\"https://www.kaggle.com/kekshibata\" target=\"_blank\">@kekshibata</a> , as well as the competition organizers.<br>\nWe present a short summary of our solution (<strong>24th place, private LB 0.694</strong>). More detailed version is <a href=\"https://www.kaggle.com/competitions/equity-post-HCT-survival-predictions/discussion/566809\" target=\"_blank\">here</a>.</p>\n<h1>Overview</h1>\n<p>We trained regressors and classifiers separately and combined their outputs using ensembling &amp; post-processing. And the “Trust CV” strategy led us to a final LB score of 0.694 to win silver.<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12062233%2F2924ed040bcb38a63b1b57eea1bcebd9%2Fsolution.jpg?generation=1741267861031260&amp;alt=media\" alt=\"\"></p>\n<h1>Model Training</h1>\n<h2>Regressors:</h2>\n<ul>\n<li>GBDTs (CAT, LGB, XGB) and AutoGluon on 8 targets with basic feature engineering.</li>\n<li>For specific 4 targets, applied extensive feature engineering with CatBoost and AutoGluon</li>\n<li>PRL NNs, including customized losses</li>\n</ul>\n<h2>Classifiers:</h2>\n<ul>\n<li>GBDT (CAT, LGB, XGB) classifiers</li>\n<li>Stacked logistic regression and combined Autogluon classifier.</li>\n</ul>\n<h1>Ensemble &amp; Post-Processing</h1>\n<ul>\n<li>Combined regressors’ outputs using a <strong>multi-task Elastic Net</strong> on 8 targets. (excluding some custom PRL NNs as inputs).</li>\n<li>Post-processing: Adjusted predictions based on classifier probabilities with race-specific parameters optimized by Optuna.</li>\n<li>Blended in custom PRL NNs for high efs probability data and weaker races.</li>\n</ul>\n<h1>Submission Strategy</h1>\n<ul>\n<li>Best CV:  CV 0.6908 / public LB 0.690 / private LB 0.694</li>\n<li>Best LB:  CV 0.6853 / public LB 0.694 / private LB 0.692</li>\n</ul>\n<p>Selected the best CV and LB for final submissions. “Trust CV” approach ultimately secured us the silver medal.</p>",
  "comments": [
    {
      "id": 3142587,
      "author_name": "Donghui Zhang",
      "author_url": "",
      "post_date": "2025-03-06T14:00:51.937000",
      "content": "<p>Enjoy this competition with our teammates!</p>",
      "votes": 4,
      "replies": []
    },
    {
      "id": 3142573,
      "author_name": "Octopus210",
      "author_url": "",
      "post_date": "2025-03-06T13:41:51.090000",
      "content": "<p>I also appreciate you all！<br>\nYou are a great engineer😆</p>",
      "votes": 4,
      "replies": []
    }
  ],
  "comment_count": 2,
  "messages": [
    {
      "id": 3142567,
      "postDate": "2025-03-06T13:34:48.913Z",
      "content": "<p>First, congratulations to the competition winners, and sincere thanks to our team members <a href=\"https://www.kaggle.com/gentlezdh\" target=\"_blank\">@gentlezdh</a>,  <a href=\"https://www.kaggle.com/yoshifumimiya\" target=\"_blank\">@yoshifumimiya</a>,  <a href=\"https://www.kaggle.com/lizhecheng\" target=\"_blank\">@lizhecheng</a>,  <a href=\"https://www.kaggle.com/nandodmelo\" target=\"_blank\">@nandodmelo</a>,  <a href=\"https://www.kaggle.com/kekshibata\" target=\"_blank\">@kekshibata</a> , as well as the competition organizers.<br>\nWe present a short summary of our solution (<strong>24th place, private LB 0.694</strong>). More detailed version is <a href=\"https://www.kaggle.com/competitions/equity-post-HCT-survival-predictions/discussion/566809\" target=\"_blank\">here</a>.</p>\n<h1>Overview</h1>\n<p>We trained regressors and classifiers separately and combined their outputs using ensembling &amp; post-processing. And the “Trust CV” strategy led us to a final LB score of 0.694 to win silver.<br>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12062233%2F2924ed040bcb38a63b1b57eea1bcebd9%2Fsolution.jpg?generation=1741267861031260&amp;alt=media\" alt=\"\"></p>\n<h1>Model Training</h1>\n<h2>Regressors:</h2>\n<ul>\n<li>GBDTs (CAT, LGB, XGB) and AutoGluon on 8 targets with basic feature engineering.</li>\n<li>For specific 4 targets, applied extensive feature engineering with CatBoost and AutoGluon</li>\n<li>PRL NNs, including customized losses</li>\n</ul>\n<h2>Classifiers:</h2>\n<ul>\n<li>GBDT (CAT, LGB, XGB) classifiers</li>\n<li>Stacked logistic regression and combined Autogluon classifier.</li>\n</ul>\n<h1>Ensemble &amp; Post-Processing</h1>\n<ul>\n<li>Combined regressors’ outputs using a <strong>multi-task Elastic Net</strong> on 8 targets. (excluding some custom PRL NNs as inputs).</li>\n<li>Post-processing: Adjusted predictions based on classifier probabilities with race-specific parameters optimized by Optuna.</li>\n<li>Blended in custom PRL NNs for high efs probability data and weaker races.</li>\n</ul>\n<h1>Submission Strategy</h1>\n<ul>\n<li>Best CV:  CV 0.6908 / public LB 0.690 / private LB 0.694</li>\n<li>Best LB:  CV 0.6853 / public LB 0.694 / private LB 0.692</li>\n</ul>\n<p>Selected the best CV and LB for final submissions. “Trust CV” approach ultimately secured us the silver medal.</p>",
      "rawMarkdown": "First, congratulations to the competition winners, and sincere thanks to our team members @gentlezdh,  @yoshifumimiya,  @lizhecheng,  @nandodmelo,  @kekshibata , as well as the competition organizers.\nWe present a short summary of our solution (**24th place, private LB 0.694**). More detailed version is [here](https://www.kaggle.com/competitions/equity-post-HCT-survival-predictions/discussion/566809).\n\n# Overview\nWe trained regressors and classifiers separately and combined their outputs using ensembling & post-processing. And the “Trust CV” strategy led us to a final LB score of 0.694 to win silver.\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F12062233%2F2924ed040bcb38a63b1b57eea1bcebd9%2Fsolution.jpg?generation=1741267861031260&alt=media)\n\n# Model Training\n## Regressors:\n- GBDTs (CAT, LGB, XGB) and AutoGluon on 8 targets with basic feature engineering.\n- For specific 4 targets, applied extensive feature engineering with CatBoost and AutoGluon\n- PRL NNs, including customized losses\n\n## Classifiers:\n- GBDT (CAT, LGB, XGB) classifiers\n- Stacked logistic regression and combined Autogluon classifier.\n\n# Ensemble & Post-Processing\n- Combined regressors’ outputs using a **multi-task Elastic Net** on 8 targets. (excluding some custom PRL NNs as inputs).\n- Post-processing: Adjusted predictions based on classifier probabilities with race-specific parameters optimized by Optuna.\n- Blended in custom PRL NNs for high efs probability data and weaker races.\n\n# Submission Strategy\n- Best CV:  CV 0.6908 / public LB 0.690 / private LB 0.694\n- Best LB:  CV 0.6853 / public LB 0.694 / private LB 0.692\n\nSelected the best CV and LB for final submissions. “Trust CV” approach ultimately secured us the silver medal.\n",
      "votes": 9
    },
    {
      "id": 3142587,
      "postDate": "2025-03-06T14:00:51.937Z",
      "content": "<p>Enjoy this competition with our teammates!</p>",
      "rawMarkdown": "Enjoy this competition with our teammates!",
      "votes": 4
    },
    {
      "id": 3142573,
      "postDate": "2025-03-06T13:41:51.090Z",
      "content": "<p>I also appreciate you all！<br>\nYou are a great engineer😆</p>",
      "rawMarkdown": "I also appreciate you all！\nYou are a great engineer😆",
      "votes": 4
    }
  ],
  "complete": true,
  "source": "live",
  "fetched_at": "2026-10-19T19:48:06Z",
  "competition_id": 70942,
  "competition_slug": "equity-post-HCT-survival-predictions",
  "team_id": 13086976,
  "solution_url": "/competitions/equity-post-HCT-survival-predictions/writeups/overfittingbest-24th-place-solution"
}