{
  "id": 685173,
  "title": "CSIRO - Image2Biomass Prediction — My Approach (Top 2% / 82nd)",
  "url": "/competitions/csiro-biomass/discussion/685173",
  "author_name": "Wosheng Deng",
  "post_date": "2026-03-27T05:35:24.577000",
  "votes": 0,
  "comment_count": 0,
  "views": 0,
  "content": "<p>The task involves predicting multiple pasture biomass components from <strong>natural field images</strong>, which is challenging due to:</p>\n<ul>\n<li>Strong dependency and coupling between targets  </li>\n<li>High variability across environments (lighting, species, density)  </li>\n<li>Imbalanced importance across targets (Dry_Total_g has high weight)  </li>\n</ul>\n<p>My approach focuses on combining <strong>structure-aware multi-target regression</strong> with large-scale vision models and hybrid ensembling for robust performance.</p>\n<hr>\n<h3>Key Idea</h3>\n<p><strong>Structure-aware multi-target regression with constraint-based modeling and hybrid vision + tabular ensemble.</strong></p>\n<p>Instead of directly predicting all targets independently, I model fundamental components and enforce deterministic relationships to improve consistency on high-weight outputs.</p>\n<hr>\n<h3>Approach Overview</h3>\n<p>The solution is built as a <strong>hybrid multi-branch system</strong>:</p>\n<ul>\n<li><p>A large-scale Vision Transformer (DINOv3 ViT-Huge) is fine-tuned for regression, with a dual-view input strategy (left-right image split) to better capture spatial heterogeneity in wide-field pasture images.  </p></li>\n<li><p>A structure-aware multi-target formulation is adopted, where only fundamental components (Green / Dead / Clover) are explicitly predicted, and aggregate targets are derived via deterministic relationships:  </p>\n<ul>\n<li>GDM = Green + Clover  </li>\n<li>Total = GDM + Dead<br>\nThis enforces physical consistency and stabilizes predictions on critical targets.  </li></ul></li>\n<li><p>A complementary semantic modeling branch is introduced using SigLIP embeddings and concept-level feature engineering (e.g., vegetation density, semantic similarity), followed by GBDT models to improve robustness under distribution shifts.  </p></li>\n</ul>\n<hr>\n<h3>Ensemble Strategy</h3>\n<p>Predictions from multiple models and branches are combined using <strong>weighted ensembling</strong>, including:</p>\n<ul>\n<li>4-fold cross-validation ensemble of DINO-based models  </li>\n<li>SigLIP + semantic feature + GBDT branch  </li>\n</ul>\n<p>This hybrid ensemble improves stability and generalization, especially in challenging or out-of-distribution scenarios.</p>\n<hr>\n<h3>Result</h3>\n<ul>\n<li>Final Score: <strong>Weighted R² ≈ 0.62</strong>  </li>\n<li>Rank: <strong>82 / 3802 (Top 2%)</strong>  </li>\n</ul>\n<p>The solution achieves strong performance on both:</p>\n<ul>\n<li>High-weight target (Dry_Total_g)  </li>\n<li>Component-level predictions with consistent structure  </li>\n</ul>\n<hr>\n<h3>Full Implementation</h3>\n<p>For full details, code, and system design:</p>\n<p>GitHub Repository:<br>\n<a href=\"https://github.com/WoshengDeng/pasture-biomass-prediction\" target=\"_blank\">https://github.com/WoshengDeng/pasture-biomass-prediction</a></p>\n<hr>\n<p>This writeup is intentionally concise. The full pipeline and implementation details are available in the GitHub repository.</p>",
  "messages": [
    {
      "id": 3429704,
      "postDate": "2026-03-27T05:35:24.577Z",
      "content": "<p>The task involves predicting multiple pasture biomass components from <strong>natural field images</strong>, which is challenging due to:</p>\n<ul>\n<li>Strong dependency and coupling between targets  </li>\n<li>High variability across environments (lighting, species, density)  </li>\n<li>Imbalanced importance across targets (Dry_Total_g has high weight)  </li>\n</ul>\n<p>My approach focuses on combining <strong>structure-aware multi-target regression</strong> with large-scale vision models and hybrid ensembling for robust performance.</p>\n<hr>\n<h3>Key Idea</h3>\n<p><strong>Structure-aware multi-target regression with constraint-based modeling and hybrid vision + tabular ensemble.</strong></p>\n<p>Instead of directly predicting all targets independently, I model fundamental components and enforce deterministic relationships to improve consistency on high-weight outputs.</p>\n<hr>\n<h3>Approach Overview</h3>\n<p>The solution is built as a <strong>hybrid multi-branch system</strong>:</p>\n<ul>\n<li><p>A large-scale Vision Transformer (DINOv3 ViT-Huge) is fine-tuned for regression, with a dual-view input strategy (left-right image split) to better capture spatial heterogeneity in wide-field pasture images.  </p></li>\n<li><p>A structure-aware multi-target formulation is adopted, where only fundamental components (Green / Dead / Clover) are explicitly predicted, and aggregate targets are derived via deterministic relationships:  </p>\n<ul>\n<li>GDM = Green + Clover  </li>\n<li>Total = GDM + Dead<br>\nThis enforces physical consistency and stabilizes predictions on critical targets.  </li></ul></li>\n<li><p>A complementary semantic modeling branch is introduced using SigLIP embeddings and concept-level feature engineering (e.g., vegetation density, semantic similarity), followed by GBDT models to improve robustness under distribution shifts.  </p></li>\n</ul>\n<hr>\n<h3>Ensemble Strategy</h3>\n<p>Predictions from multiple models and branches are combined using <strong>weighted ensembling</strong>, including:</p>\n<ul>\n<li>4-fold cross-validation ensemble of DINO-based models  </li>\n<li>SigLIP + semantic feature + GBDT branch  </li>\n</ul>\n<p>This hybrid ensemble improves stability and generalization, especially in challenging or out-of-distribution scenarios.</p>\n<hr>\n<h3>Result</h3>\n<ul>\n<li>Final Score: <strong>Weighted R² ≈ 0.62</strong>  </li>\n<li>Rank: <strong>82 / 3802 (Top 2%)</strong>  </li>\n</ul>\n<p>The solution achieves strong performance on both:</p>\n<ul>\n<li>High-weight target (Dry_Total_g)  </li>\n<li>Component-level predictions with consistent structure  </li>\n</ul>\n<hr>\n<h3>Full Implementation</h3>\n<p>For full details, code, and system design:</p>\n<p>GitHub Repository:<br>\n<a href=\"https://github.com/WoshengDeng/pasture-biomass-prediction\" target=\"_blank\">https://github.com/WoshengDeng/pasture-biomass-prediction</a></p>\n<hr>\n<p>This writeup is intentionally concise. The full pipeline and implementation details are available in the GitHub repository.</p>",
      "rawMarkdown": "The task involves predicting multiple pasture biomass components from **natural field images**, which is challenging due to:\n\n- Strong dependency and coupling between targets  \n- High variability across environments (lighting, species, density)  \n- Imbalanced importance across targets (Dry_Total_g has high weight)  \n\nMy approach focuses on combining **structure-aware multi-target regression** with large-scale vision models and hybrid ensembling for robust performance.\n\n---\n\n### Key Idea\n\n**Structure-aware multi-target regression with constraint-based modeling and hybrid vision + tabular ensemble.**\n\nInstead of directly predicting all targets independently, I model fundamental components and enforce deterministic relationships to improve consistency on high-weight outputs.\n\n---\n\n### Approach Overview\n\nThe solution is built as a **hybrid multi-branch system**:\n\n- A large-scale Vision Transformer (DINOv3 ViT-Huge) is fine-tuned for regression, with a dual-view input strategy (left-right image split) to better capture spatial heterogeneity in wide-field pasture images.  \n\n- A structure-aware multi-target formulation is adopted, where only fundamental components (Green / Dead / Clover) are explicitly predicted, and aggregate targets are derived via deterministic relationships:  \n  - GDM = Green + Clover  \n  - Total = GDM + Dead  \n  This enforces physical consistency and stabilizes predictions on critical targets.  \n\n- A complementary semantic modeling branch is introduced using SigLIP embeddings and concept-level feature engineering (e.g., vegetation density, semantic similarity), followed by GBDT models to improve robustness under distribution shifts.  \n\n---\n\n### Ensemble Strategy\n\nPredictions from multiple models and branches are combined using **weighted ensembling**, including:\n\n- 4-fold cross-validation ensemble of DINO-based models  \n- SigLIP + semantic feature + GBDT branch  \n\nThis hybrid ensemble improves stability and generalization, especially in challenging or out-of-distribution scenarios.\n\n---\n\n### Result\n\n- Final Score: **Weighted R² ≈ 0.62**  \n- Rank: **82 / 3802 (Top 2%)**  \n\nThe solution achieves strong performance on both:\n- High-weight target (Dry_Total_g)  \n- Component-level predictions with consistent structure  \n\n---\n\n### Full Implementation\n\nFor full details, code, and system design:\n\nGitHub Repository:  \nhttps://github.com/WoshengDeng/pasture-biomass-prediction\n\n---\n\nThis writeup is intentionally concise. The full pipeline and implementation details are available in the GitHub repository."
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "3429704": "The task involves predicting multiple pasture biomass components from **natural field images**, which is challenging due to:\n\n- Strong dependency and coupling between targets  \n- High variability across environments (lighting, species, density)  \n- Imbalanced importance across targets (Dry_Total_g has high weight)  \n\nMy approach focuses on combining **structure-aware multi-target regression** with large-scale vision models and hybrid ensembling for robust performance.\n\n---\n\n### Key Idea\n\n**Structure-aware multi-target regression with constraint-based modeling and hybrid vision + tabular ensemble.**\n\nInstead of directly predicting all targets independently, I model fundamental components and enforce deterministic relationships to improve consistency on high-weight outputs.\n\n---\n\n### Approach Overview\n\nThe solution is built as a **hybrid multi-branch system**:\n\n- A large-scale Vision Transformer (DINOv3 ViT-Huge) is fine-tuned for regression, with a dual-view input strategy (left-right image split) to better capture spatial heterogeneity in wide-field pasture images.  \n\n- A structure-aware multi-target formulation is adopted, where only fundamental components (Green / Dead / Clover) are explicitly predicted, and aggregate targets are derived via deterministic relationships:  \n  - GDM = Green + Clover  \n  - Total = GDM + Dead  \n  This enforces physical consistency and stabilizes predictions on critical targets.  \n\n- A complementary semantic modeling branch is introduced using SigLIP embeddings and concept-level feature engineering (e.g., vegetation density, semantic similarity), followed by GBDT models to improve robustness under distribution shifts.  \n\n---\n\n### Ensemble Strategy\n\nPredictions from multiple models and branches are combined using **weighted ensembling**, including:\n\n- 4-fold cross-validation ensemble of DINO-based models  \n- SigLIP + semantic feature + GBDT branch  \n\nThis hybrid ensemble improves stability and generalization, especially in challenging or out-of-distribution scenarios.\n\n---\n\n### Result\n\n- Final Score: **Weighted R² ≈ 0.62**  \n- Rank: **82 / 3802 (Top 2%)**  \n\nThe solution achieves strong performance on both:\n- High-weight target (Dry_Total_g)  \n- Component-level predictions with consistent structure  \n\n---\n\n### Full Implementation\n\nFor full details, code, and system design:\n\nGitHub Repository:  \nhttps://github.com/WoshengDeng/pasture-biomass-prediction\n\n---\n\nThis writeup is intentionally concise. The full pipeline and implementation details are available in the GitHub repository."
  }
}