{
  "id": 419413,
  "title": "Understanding the Evaluation Process ",
  "url": "/competitions/cafa-5-protein-function-prediction/discussion/419413",
  "author_name": "gzguevara",
  "post_date": "2023-06-25T19:59:59.135000",
  "votes": 3,
  "comment_count": 0,
  "views": 0,
  "content": "<p>The task is to predict <em>functions</em> of proteins in the test data. <code>Many proteins in the test data do not currently have ANY assigned functions.</code> Functions/annotations will be experimentally accumulated after the deadline in 08.2022 until 12.2023.</p>\n<p>A protein may have many functions, which are described by the Gene Ontology (GO). A function of a protein is part of one (and only one) of three subontologies: Molecular Function (MF), Biological Process (BP), and Cellular Component (CC).</p>\n<p>In 12.2023 our predictions will be evaluated on a set of those three subontologies separately, where the final score/ranking is the average of the competition metric on those subontologies. However, only those protein functions will make it into this set, which were experimentally accumulated by a protein which currently has no function experimentally accumulated in the given subontology.</p>\n<p>Three examples of proteins in the test superset:</p>\n<p><strong>Protein A</strong> has currently experimentally accumulated 1 function in every subontology. -&gt; The functions of this protein will not be in the final test set (private test set). Even if functions should be experimentally accumulated they won't form part of the final test set. This is because the protein had already functions in the three subontologies experimentally accumulated.</p>\n<p><strong>Protein B</strong> has currently no accumulated function. Neither in MF, nor in BP, nor in CC. Until 12.2023, however, no functions were experimentally accumulated. -&gt; This protein will not be in the final test set (private test set), because no function could be experimentally accumulated.</p>\n<p><strong>Protein C</strong> has currently no accumulated function. Neither in MF, nor in BP, nor in CC. Until 12.2023, however, it accumulated experimentally 3 functions in every subontology. -&gt; All those functions will be in the final test set (private test set), because the protein had no functions in any of the three subontologies.</p>\n<p><strong>Protein D</strong> has currently 1 function in MF and 1 function in BP. After 08.2022, the protein experimentally accumulates further functions in all three subontologies. -&gt; Only those experimentally accumulated functions, belonging to CC will be part of the final test set (private test set), because only in this subontology the protein had no experimentally accumulated functions.</p>\n<p>Did I get it correctly?</p>",
  "messages": [
    {
      "id": 2317609,
      "postDate": "2023-06-25T19:59:59.137Z",
      "content": "<p>The task is to predict <em>functions</em> of proteins in the test data. <code>Many proteins in the test data do not currently have ANY assigned functions.</code> Functions/annotations will be experimentally accumulated after the deadline in 08.2022 until 12.2023.</p>\n<p>A protein may have many functions, which are described by the Gene Ontology (GO). A function of a protein is part of one (and only one) of three subontologies: Molecular Function (MF), Biological Process (BP), and Cellular Component (CC).</p>\n<p>In 12.2023 our predictions will be evaluated on a set of those three subontologies separately, where the final score/ranking is the average of the competition metric on those subontologies. However, only those protein functions will make it into this set, which were experimentally accumulated by a protein which currently has no function experimentally accumulated in the given subontology.</p>\n<p>Three examples of proteins in the test superset:</p>\n<p><strong>Protein A</strong> has currently experimentally accumulated 1 function in every subontology. -&gt; The functions of this protein will not be in the final test set (private test set). Even if functions should be experimentally accumulated they won't form part of the final test set. This is because the protein had already functions in the three subontologies experimentally accumulated.</p>\n<p><strong>Protein B</strong> has currently no accumulated function. Neither in MF, nor in BP, nor in CC. Until 12.2023, however, no functions were experimentally accumulated. -&gt; This protein will not be in the final test set (private test set), because no function could be experimentally accumulated.</p>\n<p><strong>Protein C</strong> has currently no accumulated function. Neither in MF, nor in BP, nor in CC. Until 12.2023, however, it accumulated experimentally 3 functions in every subontology. -&gt; All those functions will be in the final test set (private test set), because the protein had no functions in any of the three subontologies.</p>\n<p><strong>Protein D</strong> has currently 1 function in MF and 1 function in BP. After 08.2022, the protein experimentally accumulates further functions in all three subontologies. -&gt; Only those experimentally accumulated functions, belonging to CC will be part of the final test set (private test set), because only in this subontology the protein had no experimentally accumulated functions.</p>\n<p>Did I get it correctly?</p>",
      "rawMarkdown": "The task is to predict *functions* of proteins in the test data. `Many proteins in the test data do not currently have ANY assigned functions.` Functions/annotations will be experimentally accumulated after the deadline in 08.2022 until 12.2023.\n\nA protein may have many functions, which are described by the Gene Ontology (GO). A function of a protein is part of one (and only one) of three subontologies: Molecular Function (MF), Biological Process (BP), and Cellular Component (CC).\n\nIn 12.2023 our predictions will be evaluated on a set of those three subontologies separately, where the final score/ranking is the average of the competition metric on those subontologies. However, only those protein functions will make it into this set, which were experimentally accumulated by a protein which currently has no function experimentally accumulated in the given subontology.\n\nThree examples of proteins in the test superset:\n\n**Protein A** has currently experimentally accumulated 1 function in every subontology. -> The functions of this protein will not be in the final test set (private test set). Even if functions should be experimentally accumulated they won't form part of the final test set. This is because the protein had already functions in the three subontologies experimentally accumulated.\n\n**Protein B** has currently no accumulated function. Neither in MF, nor in BP, nor in CC. Until 12.2023, however, no functions were experimentally accumulated. -> This protein will not be in the final test set (private test set), because no function could be experimentally accumulated.\n\n**Protein C** has currently no accumulated function. Neither in MF, nor in BP, nor in CC. Until 12.2023, however, it accumulated experimentally 3 functions in every subontology. -> All those functions will be in the final test set (private test set), because the protein had no functions in any of the three subontologies.\n\n**Protein D** has currently 1 function in MF and 1 function in BP. After 08.2022, the protein experimentally accumulates further functions in all three subontologies. -> Only those experimentally accumulated functions, belonging to CC will be part of the final test set (private test set), because only in this subontology the protein had no experimentally accumulated functions.\n\nDid I get it correctly?",
      "votes": 3
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "2317609": "The task is to predict *functions* of proteins in the test data. `Many proteins in the test data do not currently have ANY assigned functions.` Functions/annotations will be experimentally accumulated after the deadline in 08.2022 until 12.2023.\n\nA protein may have many functions, which are described by the Gene Ontology (GO). A function of a protein is part of one (and only one) of three subontologies: Molecular Function (MF), Biological Process (BP), and Cellular Component (CC).\n\nIn 12.2023 our predictions will be evaluated on a set of those three subontologies separately, where the final score/ranking is the average of the competition metric on those subontologies. However, only those protein functions will make it into this set, which were experimentally accumulated by a protein which currently has no function experimentally accumulated in the given subontology.\n\nThree examples of proteins in the test superset:\n\n**Protein A** has currently experimentally accumulated 1 function in every subontology. -> The functions of this protein will not be in the final test set (private test set). Even if functions should be experimentally accumulated they won't form part of the final test set. This is because the protein had already functions in the three subontologies experimentally accumulated.\n\n**Protein B** has currently no accumulated function. Neither in MF, nor in BP, nor in CC. Until 12.2023, however, no functions were experimentally accumulated. -> This protein will not be in the final test set (private test set), because no function could be experimentally accumulated.\n\n**Protein C** has currently no accumulated function. Neither in MF, nor in BP, nor in CC. Until 12.2023, however, it accumulated experimentally 3 functions in every subontology. -> All those functions will be in the final test set (private test set), because the protein had no functions in any of the three subontologies.\n\n**Protein D** has currently 1 function in MF and 1 function in BP. After 08.2022, the protein experimentally accumulates further functions in all three subontologies. -> Only those experimentally accumulated functions, belonging to CC will be part of the final test set (private test set), because only in this subontology the protein had no experimentally accumulated functions.\n\nDid I get it correctly?"
  }
}