{
  "id": 680569,
  "title": "Evaluation perspective",
  "url": "/competitions/cvpr-mslr-2026-track-2/discussion/680569",
  "author_name": "",
  "post_date": "2026-03-09T11:26:01.378757800Z",
  "votes": null,
  "comment_count": 1,
  "views": 0,
  "content": "<p>Deer organizers,\nI was wondering if you could share a bit more about the expected evaluation perspective for research submissions related to this challenge. For example, is there any reference point (such as baseline approaches or typical performance ranges, e.g,. baseline performance or top teams) that participants could consider when preparing a potential paper?</p>",
  "messages": [
    {
      "id": "3418842",
      "postDate": "03/09/2026 11:26:01",
      "content": "<p>Deer organizers,\nI was wondering if you could share a bit more about the expected evaluation perspective for research submissions related to this challenge. For example, is there any reference point (such as baseline approaches or typical performance ranges, e.g,. baseline performance or top teams) that participants could consider when preparing a potential paper?</p>",
      "rawMarkdown": "Deer organizers,\nI was wondering if you could share a bit more about the expected evaluation perspective for research submissions related to this challenge. For example, is there any reference point (such as baseline approaches or typical performance ranges, e.g,. baseline performance or top teams) that participants could consider when preparing a potential paper?",
      "votes": null
    },
    {
      "id": "3418851",
      "postDate": "03/09/2026 11:51:49",
      "content": "<p>Dear Vu NDLe,\nThank you for your interest in the challenge.</p>\n<p>At present, we are not defining a fixed evaluation reference in terms of baseline methods, expected performance intervals, or benchmark results from top-performing teams.</p>\n<p>Regarding the timeline, participants are requested to submit a <strong>one-page report by March 23</strong>. These reports will be assessed promptly, and on March 24 the selected contributions will be invited to submit a <strong>full paper by March 30</strong>. The submitted papers will then go through 3-days review process, and the <strong>camera-ready version will be due by April 11</strong>.</p>\n<p>We would also like to note that, by March 23, we will release our own paper presenting a method developed on the challenge dataset. This manuscript will provide detailed information on the preprocessing applied to the original dataset, which participants may find helpful as a reference when preparing their own paper.</p>\n<p>Accordingly, the initial evaluation will concern the one-page report, whereas a more comprehensive scientific assessment will be carried out during the full paper review phase.</p>\n<p>Best Regards\nRaffaele</p>",
      "rawMarkdown": "Dear Vu NDLe,\nThank you for your interest in the challenge.\n\nAt present, we are not defining a fixed evaluation reference in terms of baseline methods, expected performance intervals, or benchmark results from top-performing teams.\n\nRegarding the timeline, participants are requested to submit a **one-page report by March 23**. These reports will be assessed promptly, and on March 24 the selected contributions will be invited to submit a **full paper by March 30**. The submitted papers will then go through 3-days review process, and the **camera-ready version will be due by April 11**.\n\nWe would also like to note that, by March 23, we will release our own paper presenting a method developed on the challenge dataset. This manuscript will provide detailed information on the preprocessing applied to the original dataset, which participants may find helpful as a reference when preparing their own paper.\n\nAccordingly, the initial evaluation will concern the one-page report, whereas a more comprehensive scientific assessment will be carried out during the full paper review phase.\n\nBest Regards\nRaffaele",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3418851,
      "author_name": "raffaelemineo",
      "author_url": "",
      "post_date": "03/09/2026 11:51:49",
      "content": "<p>Dear Vu NDLe,\nThank you for your interest in the challenge.</p>\n<p>At present, we are not defining a fixed evaluation reference in terms of baseline methods, expected performance intervals, or benchmark results from top-performing teams.</p>\n<p>Regarding the timeline, participants are requested to submit a <strong>one-page report by March 23</strong>. These reports will be assessed promptly, and on March 24 the selected contributions will be invited to submit a <strong>full paper by March 30</strong>. The submitted papers will then go through 3-days review process, and the <strong>camera-ready version will be due by April 11</strong>.</p>\n<p>We would also like to note that, by March 23, we will release our own paper presenting a method developed on the challenge dataset. This manuscript will provide detailed information on the preprocessing applied to the original dataset, which participants may find helpful as a reference when preparing their own paper.</p>\n<p>Accordingly, the initial evaluation will concern the one-page report, whereas a more comprehensive scientific assessment will be carried out during the full paper review phase.</p>\n<p>Best Regards\nRaffaele</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "3418842": "Deer organizers,\nI was wondering if you could share a bit more about the expected evaluation perspective for research submissions related to this challenge. For example, is there any reference point (such as baseline approaches or typical performance ranges, e.g,. baseline performance or top teams) that participants could consider when preparing a potential paper?",
    "3418851": "Dear Vu NDLe,\nThank you for your interest in the challenge.\n\nAt present, we are not defining a fixed evaluation reference in terms of baseline methods, expected performance intervals, or benchmark results from top-performing teams.\n\nRegarding the timeline, participants are requested to submit a **one-page report by March 23**. These reports will be assessed promptly, and on March 24 the selected contributions will be invited to submit a **full paper by March 30**. The submitted papers will then go through 3-days review process, and the **camera-ready version will be due by April 11**.\n\nWe would also like to note that, by March 23, we will release our own paper presenting a method developed on the challenge dataset. This manuscript will provide detailed information on the preprocessing applied to the original dataset, which participants may find helpful as a reference when preparing their own paper.\n\nAccordingly, the initial evaluation will concern the one-page report, whereas a more comprehensive scientific assessment will be carried out during the full paper review phase.\n\nBest Regards\nRaffaele"
  },
  "source": "meta"
}