{
  "id": 416955,
  "title": "Doubts regarding the scoring/evaluation criteria",
  "url": "/competitions/cafa-5-protein-function-prediction/discussion/416955",
  "author_name": "Priya Nagda",
  "post_date": "2023-06-13T15:20:35.385000",
  "votes": 3,
  "comment_count": 0,
  "views": 0,
  "content": "<p><code>In case the predictions in the submitted files are not propagated to the root of ontology, the predictions will be recursively propagated by assigning each parent term a score that is the maximum score among its children's scores.</code> - Submission File Sub-paragraph from the Evaluation page in Overview.</p>\n<p>I am a little confused as to what this means.<br>\nFor example, if GO:0009314 is the parent term, and GO:0009416, GO:0010212, and GO:0071478 are the child terms, how will the scoring occur under the following circumstances?</p>\n<ol>\n<li>If I include all 4 terms in the submission file, will the score for the parent term be what I submitted, or as mentioned will it be taken a maximum of the child terms? Also, will the score of all 4 terms be used individually while evaluation or only the parent term?</li>\n<li>If I do not include the parent term in the submission file, but include the child terms, but the test set has parent term. Will the score be propagated and counted as my submission containing the parent term or will it negatively affect my final score?</li>\n<li>If I only include the parent term in the submission file, but the test set has child terms. Will I still be given a positive score? (I mean will it still help my score?)</li>\n</ol>\n<p>Hopefully, I haven't asked very silly doubts and/or haven't made my questions too difficult to understand. Thanks in advance!</p>",
  "messages": [
    {
      "id": 2301029,
      "postDate": "2023-06-13T15:20:35.387Z",
      "content": "<p><code>In case the predictions in the submitted files are not propagated to the root of ontology, the predictions will be recursively propagated by assigning each parent term a score that is the maximum score among its children's scores.</code> - Submission File Sub-paragraph from the Evaluation page in Overview.</p>\n<p>I am a little confused as to what this means.<br>\nFor example, if GO:0009314 is the parent term, and GO:0009416, GO:0010212, and GO:0071478 are the child terms, how will the scoring occur under the following circumstances?</p>\n<ol>\n<li>If I include all 4 terms in the submission file, will the score for the parent term be what I submitted, or as mentioned will it be taken a maximum of the child terms? Also, will the score of all 4 terms be used individually while evaluation or only the parent term?</li>\n<li>If I do not include the parent term in the submission file, but include the child terms, but the test set has parent term. Will the score be propagated and counted as my submission containing the parent term or will it negatively affect my final score?</li>\n<li>If I only include the parent term in the submission file, but the test set has child terms. Will I still be given a positive score? (I mean will it still help my score?)</li>\n</ol>\n<p>Hopefully, I haven't asked very silly doubts and/or haven't made my questions too difficult to understand. Thanks in advance!</p>",
      "rawMarkdown": "`In case the predictions in the submitted files are not propagated to the root of ontology, the predictions will be recursively propagated by assigning each parent term a score that is the maximum score among its children's scores. ` - Submission File Sub-paragraph from the Evaluation page in Overview.\n\nI am a little confused as to what this means.\nFor example, if GO:0009314 is the parent term, and GO:0009416, GO:0010212, and GO:0071478 are the child terms, how will the scoring occur under the following circumstances?\n1. If I include all 4 terms in the submission file, will the score for the parent term be what I submitted, or as mentioned will it be taken a maximum of the child terms? Also, will the score of all 4 terms be used individually while evaluation or only the parent term?\n2. If I do not include the parent term in the submission file, but include the child terms, but the test set has parent term. Will the score be propagated and counted as my submission containing the parent term or will it negatively affect my final score?\n3. If I only include the parent term in the submission file, but the test set has child terms. Will I still be given a positive score? (I mean will it still help my score?)\n\nHopefully, I haven't asked very silly doubts and/or haven't made my questions too difficult to understand. Thanks in advance!",
      "votes": 3
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "2301029": "`In case the predictions in the submitted files are not propagated to the root of ontology, the predictions will be recursively propagated by assigning each parent term a score that is the maximum score among its children's scores. ` - Submission File Sub-paragraph from the Evaluation page in Overview.\n\nI am a little confused as to what this means.\nFor example, if GO:0009314 is the parent term, and GO:0009416, GO:0010212, and GO:0071478 are the child terms, how will the scoring occur under the following circumstances?\n1. If I include all 4 terms in the submission file, will the score for the parent term be what I submitted, or as mentioned will it be taken a maximum of the child terms? Also, will the score of all 4 terms be used individually while evaluation or only the parent term?\n2. If I do not include the parent term in the submission file, but include the child terms, but the test set has parent term. Will the score be propagated and counted as my submission containing the parent term or will it negatively affect my final score?\n3. If I only include the parent term in the submission file, but the test set has child terms. Will I still be given a positive score? (I mean will it still help my score?)\n\nHopefully, I haven't asked very silly doubts and/or haven't made my questions too difficult to understand. Thanks in advance!"
  }
}