{
  "id": 662860,
  "title": "Competition scoring metric",
  "url": "/competitions/csiro-biomass/discussion/662860",
  "author_name": "DJS885",
  "post_date": "2025-12-15T08:41:22.191000",
  "votes": 3,
  "comment_count": 0,
  "views": 0,
  "content": "<p>I am new to this competition and I got a bit lost in the scoring metric, mainly for 2 points.</p>\n<ol>\n<li>how it's calculated.\nCurrently, I am using.\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F24633958%2Fff8bf05bddab419fbba5bc5cb8eae4ea%2Fmetric1.png?generation=1765785292394790&amp;alt=media\" alt=\"\">\nwhere y_ture's columns is the same order as labels.</li>\n</ol>\n<p>But I found someone using other metrics from <a href=\"https://www.kaggle.com/code/jiazhuang/csiro-simple/notebook\" target=\"_blank\">https://www.kaggle.com/code/jiazhuang/csiro-simple/notebook</a>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F24633958%2F61b5d666c111642bcb4057058488fcba%2Fmetric2.png?generation=1765785413813379&amp;alt=media\" alt=\"\"></p>\n<ol>\n<li>Using the metric from 1st pic. I am having a high OOF cv like 0.78+. But the LB only shows 0.6. </li>\n</ol>\n<p>I found the metric from 2nd pic gave out a CV similar to LB. His notebook got \nAvg CV: 0.6547513428330423 and LB 0.64 \nI did a test in my notebook with the metric changed as well. It's more close to the LB. OOF CV 0.68</p>\n<p>Above all, I would like to ask which one is the correct metric. According to Overview page, I think it's the metric in 1st pic. But it seems the metric in 2st pic seems more \"reflective\"?\nAnd why there is a huge gap? Fyi, I found a related discussion <a href=\"https://www.kaggle.com/competitions/csiro-biomass/discussion/614642\" target=\"_blank\">https://www.kaggle.com/competitions/csiro-biomass/discussion/614642</a></p>",
  "messages": [
    {
      "id": 3376842,
      "postDate": "2025-12-15T08:41:22.193Z",
      "content": "<p>I am new to this competition and I got a bit lost in the scoring metric, mainly for 2 points.</p>\n<ol>\n<li>how it's calculated.\nCurrently, I am using.\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F24633958%2Fff8bf05bddab419fbba5bc5cb8eae4ea%2Fmetric1.png?generation=1765785292394790&amp;alt=media\" alt=\"\">\nwhere y_ture's columns is the same order as labels.</li>\n</ol>\n<p>But I found someone using other metrics from <a href=\"https://www.kaggle.com/code/jiazhuang/csiro-simple/notebook\" target=\"_blank\">https://www.kaggle.com/code/jiazhuang/csiro-simple/notebook</a>\n<img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F24633958%2F61b5d666c111642bcb4057058488fcba%2Fmetric2.png?generation=1765785413813379&amp;alt=media\" alt=\"\"></p>\n<ol>\n<li>Using the metric from 1st pic. I am having a high OOF cv like 0.78+. But the LB only shows 0.6. </li>\n</ol>\n<p>I found the metric from 2nd pic gave out a CV similar to LB. His notebook got \nAvg CV: 0.6547513428330423 and LB 0.64 \nI did a test in my notebook with the metric changed as well. It's more close to the LB. OOF CV 0.68</p>\n<p>Above all, I would like to ask which one is the correct metric. According to Overview page, I think it's the metric in 1st pic. But it seems the metric in 2st pic seems more \"reflective\"?\nAnd why there is a huge gap? Fyi, I found a related discussion <a href=\"https://www.kaggle.com/competitions/csiro-biomass/discussion/614642\" target=\"_blank\">https://www.kaggle.com/competitions/csiro-biomass/discussion/614642</a></p>",
      "rawMarkdown": "I am new to this competition and I got a bit lost in the scoring metric, mainly for 2 points.\n1. how it's calculated.\nCurrently, I am using.\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F24633958%2Fff8bf05bddab419fbba5bc5cb8eae4ea%2Fmetric1.png?generation=1765785292394790&alt=media)\nwhere y_ture's columns is the same order as labels.\n\nBut I found someone using other metrics from https://www.kaggle.com/code/jiazhuang/csiro-simple/notebook\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F24633958%2F61b5d666c111642bcb4057058488fcba%2Fmetric2.png?generation=1765785413813379&alt=media)\n\n2. Using the metric from 1st pic. I am having a high OOF cv like 0.78+. But the LB only shows 0.6. \n\nI found the metric from 2nd pic gave out a CV similar to LB. His notebook got \nAvg CV: 0.6547513428330423 and LB 0.64 \nI did a test in my notebook with the metric changed as well. It's more close to the LB. OOF CV 0.68\n\nAbove all, I would like to ask which one is the correct metric. According to Overview page, I think it's the metric in 1st pic. But it seems the metric in 2st pic seems more \"reflective\"?\nAnd why there is a huge gap? Fyi, I found a related discussion https://www.kaggle.com/competitions/csiro-biomass/discussion/614642\n\n",
      "votes": 3
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "3376842": "I am new to this competition and I got a bit lost in the scoring metric, mainly for 2 points.\n1. how it's calculated.\nCurrently, I am using.\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F24633958%2Fff8bf05bddab419fbba5bc5cb8eae4ea%2Fmetric1.png?generation=1765785292394790&alt=media)\nwhere y_ture's columns is the same order as labels.\n\nBut I found someone using other metrics from https://www.kaggle.com/code/jiazhuang/csiro-simple/notebook\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F24633958%2F61b5d666c111642bcb4057058488fcba%2Fmetric2.png?generation=1765785413813379&alt=media)\n\n2. Using the metric from 1st pic. I am having a high OOF cv like 0.78+. But the LB only shows 0.6. \n\nI found the metric from 2nd pic gave out a CV similar to LB. His notebook got \nAvg CV: 0.6547513428330423 and LB 0.64 \nI did a test in my notebook with the metric changed as well. It's more close to the LB. OOF CV 0.68\n\nAbove all, I would like to ask which one is the correct metric. According to Overview page, I think it's the metric in 1st pic. But it seems the metric in 2st pic seems more \"reflective\"?\nAnd why there is a huge gap? Fyi, I found a related discussion https://www.kaggle.com/competitions/csiro-biomass/discussion/614642\n\n"
  }
}