{
  "id": 17077,
  "title": "Does it normally take so long to validate results?",
  "url": "/competitions/flavours-of-physics/discussion/17077",
  "author_name": "",
  "post_date": "2015-10-19T19:36:34.087Z",
  "votes": 1,
  "comment_count": 8,
  "views": 1874,
  "content": "<p>I joined Kaggle not long ago, so I'm just curious why it takes so much time to validate final results. Is it specific to this competition? For instance, Truly Native's results were validated on the next day.</p>",
  "messages": [
    {
      "id": "96701",
      "postDate": "10/19/2015 19:36:34",
      "content": "<p>I joined Kaggle not long ago, so I'm just curious why it takes so much time to validate final results. Is it specific to this competition? For instance, Truly Native's results were validated on the next day.</p>",
      "rawMarkdown": "I joined Kaggle not long ago, so I'm just curious why it takes so much time to validate final results. Is it specific to this competition? For instance, Truly Native's results were validated on the next day.",
      "votes": null
    },
    {
      "id": "96705",
      "postDate": "10/19/2015 19:54:55",
      "content": "<p>Hi Anton,</p>\n\n<p>This competition is a special case and is different from &quot;normal&quot; Kaggle competitions. The organizers at CERN requested to go through solutions to verify methods used are acceptable and makes sense in physics, which is why it will take a longer time. </p>",
      "rawMarkdown": "Hi Anton,\r\n\r\nThis competition is a special case and is different from \"normal\" Kaggle competitions. The organizers at CERN requested to go through solutions to verify methods used are acceptable and makes sense in physics, which is why it will take a longer time.",
      "votes": null
    },
    {
      "id": "96710",
      "postDate": "10/19/2015 22:56:23",
      "content": "<p>Hi Wendy,</p>\n\n<p>Thanks for clarification.</p>",
      "rawMarkdown": "Hi Wendy,\r\n\r\nThanks for clarification.",
      "votes": null
    },
    {
      "id": "96785",
      "postDate": "10/20/2015 09:37:58",
      "content": "<p>It seems that October 19 was officially declared as the date of final announcement. I can't see it here anymore:\n<a href=\"https://www.kaggle.com/c/flavours-of-physics/details/timeline\">https://www.kaggle.com/c/flavours-of-physics/details/timeline</a>\nWas it postponed for November 2?</p>",
      "rawMarkdown": "It seems that October 19 was officially declared as the date of final announcement. I can't see it here anymore:\r\nhttps://www.kaggle.com/c/flavours-of-physics/details/timeline\r\nWas it postponed for November 2?",
      "votes": null
    },
    {
      "id": "96846",
      "postDate": "10/20/2015 17:45:15",
      "content": "<p>[quote=rakhlin;96785]</p>\n\n<p>It seems that October 19 was officially declared as the date of final announcement. I can't see it here anymore:\n<a href=\"https://www.kaggle.com/c/flavours-of-physics/details/timeline\">https://www.kaggle.com/c/flavours-of-physics/details/timeline</a>\nWas it postponed for November 2?</p>\n\n<p>[/quote]</p>\n\n<p>Yes, they postponed the announcement. See <a href=\"https://www.kaggle.com/c/flavours-of-physics/forums/t/17006/physics-prize/96164#post96164\">https://www.kaggle.com/c/flavours-of-physics/forums/t/17006/physics-prize/96164#post96164</a></p>",
      "rawMarkdown": "[quote=rakhlin;96785]\r\n\r\nIt seems that October 19 was officially declared as the date of final announcement. I can't see it here anymore:\r\nhttps://www.kaggle.com/c/flavours-of-physics/details/timeline\r\nWas it postponed for November 2?\r\n\r\n[/quote]\r\n\r\nYes, they postponed the announcement. See https://www.kaggle.com/c/flavours-of-physics/forums/t/17006/physics-prize/96164#post96164",
      "votes": null
    },
    {
      "id": "96848",
      "postDate": "10/20/2015 17:58:52",
      "content": "<p>Well, in my opinion, this has nothing to do with this other competition. The LB is settled, as I understand organizer are investigating now first solutions in money, to check if they fit the rules. And this is why we are waiting. Do I understand it correctly?  </p>",
      "rawMarkdown": "Well, in my opinion, this has nothing to do with this other competition. The LB is settled, as I understand organizer are investigating now first solutions in money, to check if they fit the rules. And this is why we are waiting. Do I understand it correctly?",
      "votes": null
    },
    {
      "id": "96851",
      "postDate": "10/20/2015 18:04:13",
      "content": "<p>No, this is announcement re. deadline change for application for the special &quot;HEP meets ML&quot; award. It was extended from October 19 to 26. This topic (and my remark) relates to validation of final results which was officially set - if I remember correctly - for October 19 and must have been postponed for November 2 without notice.</p>\n\n<p>P.S. &quot;Springleaf Marketing Response&quot; competition with 100,000 Prize fund finished just 18 hours ago and already validated and settled.</p>",
      "rawMarkdown": "No, this is announcement re. deadline change for application for the special \"HEP meets ML\" award. It was extended from October 19 to 26. This topic (and my remark) relates to validation of final results which was officially set - if I remember correctly - for October 19 and must have been postponed for November 2 without notice.\r\n\r\nP.S. \"Springleaf Marketing Response\" competition with 100,000 Prize fund finished just 18 hours ago and already validated and settled.",
      "votes": null
    },
    {
      "id": "96853",
      "postDate": "10/20/2015 18:17:31",
      "content": "<p>Well, at least they have such a right according to the rules:</p>\n\n<blockquote>\n  <p>Competition Sponsor reserves the right to modify the Start Date, End Date, and the right to modify, add or remove additional Competition deadlines for any reason.</p>\n</blockquote>\n\n<p>Clearly, the results of the competition are disappointing. Though it's not the fault of participants, I guess we can wait a little bit.</p>",
      "rawMarkdown": "Well, at least they have such a right according to the rules:\r\n\r\n> Competition Sponsor reserves the right to modify the Start Date, End Date, and the right to modify, add or remove additional Competition deadlines for any reason.\r\n\r\nClearly, the results of the competition are disappointing. Though it's not the fault of participants, I guess we can wait a little bit.",
      "votes": null
    },
    {
      "id": "96884",
      "postDate": "10/21/2015 04:21:08",
      "content": "<p>I can wait but that would be good to clarify, if organizer expects us all to submit model by the button &quot;Upload your model&quot; - if so this should be clearly announced. If not what we are waiting for - checking if 3 models satisfy the rules for more than one week? It is very likely that some models provided in this second competition might be better than those who scored good places on LB, because a lot of information was shared after the deadline of this competition. And that's ok - this is the point of this forum. But this can't affect past results. So now, I am a bit confused, will my submission of my model (which now is of course better than my last model in this competition) to this second competition affect this LB in any way? If not - still, why we are waiting with validation so long. What could change and why? </p>",
      "rawMarkdown": "I can wait but that would be good to clarify, if organizer expects us all to submit model by the button \"Upload your model\" - if so this should be clearly announced. If not what we are waiting for - checking if 3 models satisfy the rules for more than one week? It is very likely that some models provided in this second competition might be better than those who scored good places on LB, because a lot of information was shared after the deadline of this competition. And that's ok - this is the point of this forum. But this can't affect past results. So now, I am a bit confused, will my submission of my model (which now is of course better than my last model in this competition) to this second competition affect this LB in any way? If not - still, why we are waiting with validation so long. What could change and why?",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 96705,
      "author_name": "wendykan",
      "author_url": "",
      "post_date": "10/19/2015 19:54:55",
      "content": "<p>Hi Anton,</p>\n\n<p>This competition is a special case and is different from &quot;normal&quot; Kaggle competitions. The organizers at CERN requested to go through solutions to verify methods used are acceptable and makes sense in physics, which is why it will take a longer time. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 96710,
      "author_name": "anton79",
      "author_url": "",
      "post_date": "10/19/2015 22:56:23",
      "content": "<p>Hi Wendy,</p>\n\n<p>Thanks for clarification.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 96785,
      "author_name": "rakhlin",
      "author_url": "",
      "post_date": "10/20/2015 09:37:58",
      "content": "<p>It seems that October 19 was officially declared as the date of final announcement. I can't see it here anymore:\n<a href=\"https://www.kaggle.com/c/flavours-of-physics/details/timeline\">https://www.kaggle.com/c/flavours-of-physics/details/timeline</a>\nWas it postponed for November 2?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 96846,
      "author_name": "gramolin",
      "author_url": "",
      "post_date": "10/20/2015 17:45:15",
      "content": "<p>[quote=rakhlin;96785]</p>\n\n<p>It seems that October 19 was officially declared as the date of final announcement. I can't see it here anymore:\n<a href=\"https://www.kaggle.com/c/flavours-of-physics/details/timeline\">https://www.kaggle.com/c/flavours-of-physics/details/timeline</a>\nWas it postponed for November 2?</p>\n\n<p>[/quote]</p>\n\n<p>Yes, they postponed the announcement. See <a href=\"https://www.kaggle.com/c/flavours-of-physics/forums/t/17006/physics-prize/96164#post96164\">https://www.kaggle.com/c/flavours-of-physics/forums/t/17006/physics-prize/96164#post96164</a></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 96848,
      "author_name": "chalmi",
      "author_url": "",
      "post_date": "10/20/2015 17:58:52",
      "content": "<p>Well, in my opinion, this has nothing to do with this other competition. The LB is settled, as I understand organizer are investigating now first solutions in money, to check if they fit the rules. And this is why we are waiting. Do I understand it correctly?  </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 96851,
      "author_name": "rakhlin",
      "author_url": "",
      "post_date": "10/20/2015 18:04:13",
      "content": "<p>No, this is announcement re. deadline change for application for the special &quot;HEP meets ML&quot; award. It was extended from October 19 to 26. This topic (and my remark) relates to validation of final results which was officially set - if I remember correctly - for October 19 and must have been postponed for November 2 without notice.</p>\n\n<p>P.S. &quot;Springleaf Marketing Response&quot; competition with 100,000 Prize fund finished just 18 hours ago and already validated and settled.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 96853,
      "author_name": "gramolin",
      "author_url": "",
      "post_date": "10/20/2015 18:17:31",
      "content": "<p>Well, at least they have such a right according to the rules:</p>\n\n<blockquote>\n  <p>Competition Sponsor reserves the right to modify the Start Date, End Date, and the right to modify, add or remove additional Competition deadlines for any reason.</p>\n</blockquote>\n\n<p>Clearly, the results of the competition are disappointing. Though it's not the fault of participants, I guess we can wait a little bit.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 96884,
      "author_name": "chalmi",
      "author_url": "",
      "post_date": "10/21/2015 04:21:08",
      "content": "<p>I can wait but that would be good to clarify, if organizer expects us all to submit model by the button &quot;Upload your model&quot; - if so this should be clearly announced. If not what we are waiting for - checking if 3 models satisfy the rules for more than one week? It is very likely that some models provided in this second competition might be better than those who scored good places on LB, because a lot of information was shared after the deadline of this competition. And that's ok - this is the point of this forum. But this can't affect past results. So now, I am a bit confused, will my submission of my model (which now is of course better than my last model in this competition) to this second competition affect this LB in any way? If not - still, why we are waiting with validation so long. What could change and why? </p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "96701": "I joined Kaggle not long ago, so I'm just curious why it takes so much time to validate final results. Is it specific to this competition? For instance, Truly Native's results were validated on the next day.",
    "96705": "Hi Anton,\r\n\r\nThis competition is a special case and is different from \"normal\" Kaggle competitions. The organizers at CERN requested to go through solutions to verify methods used are acceptable and makes sense in physics, which is why it will take a longer time.",
    "96710": "Hi Wendy,\r\n\r\nThanks for clarification.",
    "96785": "It seems that October 19 was officially declared as the date of final announcement. I can't see it here anymore:\r\nhttps://www.kaggle.com/c/flavours-of-physics/details/timeline\r\nWas it postponed for November 2?",
    "96846": "[quote=rakhlin;96785]\r\n\r\nIt seems that October 19 was officially declared as the date of final announcement. I can't see it here anymore:\r\nhttps://www.kaggle.com/c/flavours-of-physics/details/timeline\r\nWas it postponed for November 2?\r\n\r\n[/quote]\r\n\r\nYes, they postponed the announcement. See https://www.kaggle.com/c/flavours-of-physics/forums/t/17006/physics-prize/96164#post96164",
    "96848": "Well, in my opinion, this has nothing to do with this other competition. The LB is settled, as I understand organizer are investigating now first solutions in money, to check if they fit the rules. And this is why we are waiting. Do I understand it correctly?",
    "96851": "No, this is announcement re. deadline change for application for the special \"HEP meets ML\" award. It was extended from October 19 to 26. This topic (and my remark) relates to validation of final results which was officially set - if I remember correctly - for October 19 and must have been postponed for November 2 without notice.\r\n\r\nP.S. \"Springleaf Marketing Response\" competition with 100,000 Prize fund finished just 18 hours ago and already validated and settled.",
    "96853": "Well, at least they have such a right according to the rules:\r\n\r\n> Competition Sponsor reserves the right to modify the Start Date, End Date, and the right to modify, add or remove additional Competition deadlines for any reason.\r\n\r\nClearly, the results of the competition are disappointing. Though it's not the fault of participants, I guess we can wait a little bit.",
    "96884": "I can wait but that would be good to clarify, if organizer expects us all to submit model by the button \"Upload your model\" - if so this should be clearly announced. If not what we are waiting for - checking if 3 models satisfy the rules for more than one week? It is very likely that some models provided in this second competition might be better than those who scored good places on LB, because a lot of information was shared after the deadline of this competition. And that's ok - this is the point of this forum. But this can't affect past results. So now, I am a bit confused, will my submission of my model (which now is of course better than my last model in this competition) to this second competition affect this LB in any way? If not - still, why we are waiting with validation so long. What could change and why?"
  },
  "source": "meta"
}