{
  "id": 417248,
  "title": "Competition Evaluation Metric. How is it calculated with respect to threshold value?",
  "url": "/competitions/cafa-5-protein-function-prediction/discussion/417248",
  "author_name": "",
  "post_date": "2023-06-14T23:04:01.488167200Z",
  "votes": 6,
  "comment_count": 2,
  "views": 0,
  "content": "<p>Hi,</p>\n<p>I'm looking at the paper and the competition outline for the evaluation metric.</p>\n<p>In the paper the wighted precision and recall are functions of tau the threshold. I assume the F-score is also a function of tau as well. However in the competition outline there is no mention of tau.</p>\n<p>How is the evaluation metric calculated with respect to tau?</p>\n<p>Is tau swept over a grid of vaules between 1 and 0, is tau a fixed number?</p>\n<p>Thanks</p>",
  "messages": [
    {
      "id": "2302868",
      "postDate": "06/14/2023 23:04:01",
      "content": "<p>Hi,</p>\n<p>I'm looking at the paper and the competition outline for the evaluation metric.</p>\n<p>In the paper the wighted precision and recall are functions of tau the threshold. I assume the F-score is also a function of tau as well. However in the competition outline there is no mention of tau.</p>\n<p>How is the evaluation metric calculated with respect to tau?</p>\n<p>Is tau swept over a grid of vaules between 1 and 0, is tau a fixed number?</p>\n<p>Thanks</p>",
      "rawMarkdown": "Hi,\n\nI'm looking at the paper and the competition outline for the evaluation metric.\n\nIn the paper the wighted precision and recall are functions of tau the threshold. I assume the F-score is also a function of tau as well. However in the competition outline there is no mention of tau.\n\nHow is the evaluation metric calculated with respect to tau?\n\nIs tau swept over a grid of vaules between 1 and 0, is tau a fixed number?\n\nThanks",
      "votes": null
    },
    {
      "id": "2303480",
      "postDate": "06/15/2023 10:08:01",
      "content": "<p>There is a github webpage <a href=\"https://github.com/BioComputingUP/CAFA-evaluator\" target=\"_blank\">https://github.com/BioComputingUP/CAFA-evaluator</a> with the evaluator, maybe it's helpful for you.</p>",
      "rawMarkdown": "There is a github webpage https://github.com/BioComputingUP/CAFA-evaluator with the evaluator, maybe it's helpful for you.",
      "votes": null
    },
    {
      "id": "2303584",
      "postDate": "06/15/2023 11:12:27",
      "content": "<p>See also: <a href=\"https://www.kaggle.com/code/sergeifironov/validate-ridge\" target=\"_blank\">https://www.kaggle.com/code/sergeifironov/validate-ridge</a></p>",
      "rawMarkdown": "See also: https://www.kaggle.com/code/sergeifironov/validate-ridge",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 2303480,
      "author_name": "victorfernandezalbor",
      "author_url": "",
      "post_date": "06/15/2023 10:08:01",
      "content": "<p>There is a github webpage <a href=\"https://github.com/BioComputingUP/CAFA-evaluator\" target=\"_blank\">https://github.com/BioComputingUP/CAFA-evaluator</a> with the evaluator, maybe it's helpful for you.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 2303584,
      "author_name": "alexandervc",
      "author_url": "",
      "post_date": "06/15/2023 11:12:27",
      "content": "<p>See also: <a href=\"https://www.kaggle.com/code/sergeifironov/validate-ridge\" target=\"_blank\">https://www.kaggle.com/code/sergeifironov/validate-ridge</a></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "2302868": "Hi,\n\nI'm looking at the paper and the competition outline for the evaluation metric.\n\nIn the paper the wighted precision and recall are functions of tau the threshold. I assume the F-score is also a function of tau as well. However in the competition outline there is no mention of tau.\n\nHow is the evaluation metric calculated with respect to tau?\n\nIs tau swept over a grid of vaules between 1 and 0, is tau a fixed number?\n\nThanks",
    "2303480": "There is a github webpage https://github.com/BioComputingUP/CAFA-evaluator with the evaluator, maybe it's helpful for you.",
    "2303584": "See also: https://www.kaggle.com/code/sergeifironov/validate-ridge"
  },
  "source": "meta"
}