{
  "id": 102741,
  "title": "Quantum Uncertainty Theories",
  "url": "/competitions/champs-scalar-coupling/discussion/102741",
  "author_name": "",
  "post_date": "2019-08-04T15:04:48.525678Z",
  "votes": 8,
  "comment_count": 37,
  "views": 0,
  "content": "<p>It's clear one team has pulled ahead from the rest on the public leaderboard. Certainly it's possible that other teams have similarly strong models but are just holding back on submitting. Apart from that, right now it appears they are blowing the rest of the field away.</p>\n\n<p>Are there theories as to how one team could be so much stronger than the rest?</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F644036%2Fe0406162927cdec7c1db546d0d957acc%2Flb_Tr.png?generation=1564930492180256&amp;alt=media\" alt=\"\"></p>\n\n<p><img src=\"https://i.imgur.com/d4z0vdl.gif\" alt=\"\"></p>",
  "messages": [
    {
      "id": "591959",
      "postDate": "08/04/2019 15:04:48",
      "content": "<p>It's clear one team has pulled ahead from the rest on the public leaderboard. Certainly it's possible that other teams have similarly strong models but are just holding back on submitting. Apart from that, right now it appears they are blowing the rest of the field away.</p>\n\n<p>Are there theories as to how one team could be so much stronger than the rest?</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F644036%2Fe0406162927cdec7c1db546d0d957acc%2Flb_Tr.png?generation=1564930492180256&amp;alt=media\" alt=\"\"></p>\n\n<p><img src=\"https://i.imgur.com/d4z0vdl.gif\" alt=\"\"></p>",
      "rawMarkdown": "It's clear one team has pulled ahead from the rest on the public leaderboard. Certainly it's possible that other teams have similarly strong models but are just holding back on submitting. Apart from that, right now it appears they are blowing the rest of the field away.\n\nAre there theories as to how one team could be so much stronger than the rest?\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F644036%2Fe0406162927cdec7c1db546d0d957acc%2Flb_Tr.png?generation=1564930492180256&amp;alt=media)\n\n![](https://i.imgur.com/d4z0vdl.gif)",
      "votes": null
    },
    {
      "id": "591978",
      "postDate": "08/04/2019 15:26:49",
      "content": "<blockquote>\n  <p>Are there theories as to how one team could be so much stronger than the rest?</p>\n</blockquote>\n\n<p>You provided the answer:</p>\n\n<blockquote>\n  <p>Certainly it's possible that other teams have similarly strong models but are just holding back on submitting. </p>\n</blockquote>",
      "rawMarkdown": "&gt; Are there theories as to how one team could be so much stronger than the rest?\n\nYou provided the answer:\n\n&gt; Certainly it's possible that other teams have similarly strong models but are just holding back on submitting.",
      "votes": null
    },
    {
      "id": "591990",
      "postDate": "08/04/2019 15:37:30",
      "content": "<p>We have developed a quantum computer and achieved quantum supremacy.</p>",
      "rawMarkdown": "We have developed a quantum computer and achieved quantum supremacy.",
      "votes": null
    },
    {
      "id": "591999",
      "postDate": "08/04/2019 15:50:01",
      "content": "<p>Great, you'll be removed then because you use quantum computation :D</p>",
      "rawMarkdown": "Great, you'll be removed then because you use quantum computation :D",
      "votes": null
    },
    {
      "id": "592068",
      "postDate": "08/04/2019 18:39:33",
      "content": "<p>Maybe they ensemble models?</p>",
      "rawMarkdown": "Maybe they ensemble models?",
      "votes": null
    },
    {
      "id": "592084",
      "postDate": "08/04/2019 19:20:20",
      "content": "<p>Out of curiosity, for those of you who has average log MAE less than -2.5 (by which I assume is achieved by ensembling different types of models), which one is better 1JHC and 1JHN? GB-based (LGB XGB) or NN-based (NN, GNN, GCN)?</p>",
      "rawMarkdown": "Out of curiosity, for those of you who has average log MAE less than -2.5 (by which I assume is achieved by ensembling different types of models), which one is better 1JHC and 1JHN? GB-based (LGB XGB) or NN-based (NN, GNN, GCN)?",
      "votes": null
    },
    {
      "id": "592458",
      "postDate": "08/05/2019 10:16:11",
      "content": "<p>It seems some poeple were motivated to close some of the gap after 1st team...</p>",
      "rawMarkdown": "It seems some poeple were motivated to close some of the gap after 1st team...",
      "votes": null
    },
    {
      "id": "592479",
      "postDate": "08/05/2019 11:07:41",
      "content": "<p>We basically work with one model for now, hence cannot  really answer your question ;)  </p>\n\n<p>I would be surprised if lgb is better than NNs here.</p>",
      "rawMarkdown": "We basically work with one model for now, hence cannot  really answer your question ;)  \n\nI would be surprised if lgb is better than NNs here.",
      "votes": null
    },
    {
      "id": "592601",
      "postDate": "08/05/2019 14:37:02",
      "content": "<p>or to be ahead of uncle</p>",
      "rawMarkdown": "or to be ahead of uncle",
      "votes": null
    },
    {
      "id": "592648",
      "postDate": "08/05/2019 16:00:39",
      "content": "<p>ok, you convinced me to start a MPNN.</p>",
      "rawMarkdown": "ok, you convinced me to start a MPNN.",
      "votes": null
    },
    {
      "id": "592713",
      "postDate": "08/05/2019 18:02:57",
      "content": "<p>I really want to do quantum jump to top...:)</p>",
      "rawMarkdown": "I really want to do quantum jump to top...:)",
      "votes": null
    },
    {
      "id": "592763",
      "postDate": "08/05/2019 19:37:59",
      "content": "<p>Im rooting for you YouHan. you are always so close to gold. Good luck </p>",
      "rawMarkdown": "Im rooting for you YouHan. you are always so close to gold. Good luck",
      "votes": null
    },
    {
      "id": "592826",
      "postDate": "08/05/2019 21:17:19",
      "content": "<p>Pics or it didn't happen</p>",
      "rawMarkdown": "Pics or it didn't happen",
      "votes": null
    },
    {
      "id": "593138",
      "postDate": "08/06/2019 08:08:37",
      "content": "<p>As requested, here's a pic of our quantum computer. We're worried b/c it's getting AGI-like qualities and we don't know how to contain it:</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2Ffee4f2f20de135798baf02d6f6a41252%2Fall-your-atoms.png?generation=1565078913929451&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "As requested, here's a pic of our quantum computer. We're worried b/c it's getting AGI-like qualities and we don't know how to contain it:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2Ffee4f2f20de135798baf02d6f6a41252%2Fall-your-atoms.png?generation=1565078913929451&amp;alt=media)",
      "votes": null
    },
    {
      "id": "593171",
      "postDate": "08/06/2019 08:48:10",
      "content": "<p>Thanks for kind words, Corey! \nI'm also rooting for you. I hope both of us get golds, then I became competition master, and you became so close to grand master! Good luck :)</p>",
      "rawMarkdown": "Thanks for kind words, Corey! \nI'm also rooting for you. I hope both of us get golds, then I became competition master, and you became so close to grand master! Good luck :)",
      "votes": null
    },
    {
      "id": "593258",
      "postDate": "08/06/2019 11:24:55",
      "content": "<blockquote>\n  <p>We're worried b/c it's getting AGI-like qualities and we don't know how to contain it</p>\n</blockquote>\n\n<p>AGI getting out of control? hmm\nIt is going to decide humankind's fate? hmm</p>\n\n<p>Thats a serious situation rather than try to fool it with adversarial samples and give humanity another chance, I would just pull the plug out.</p>\n\n<p><img src=\"http://bookofjoe.typepad.com/.a/6a00d8341c5dea53ef010536e44351970c-pi\" alt=\"\"></p>",
      "rawMarkdown": "&gt; We're worried b/c it's getting AGI-like qualities and we don't know how to contain it\n \nAGI getting out of control? hmm\nIt is going to decide humankind's fate? hmm\n \nThats a serious situation rather than try to fool it with adversarial samples and give humanity another chance, I would just pull the plug out.\n \n![](http://bookofjoe.typepad.com/.a/6a00d8341c5dea53ef010536e44351970c-pi)",
      "votes": null
    },
    {
      "id": "594110",
      "postDate": "08/07/2019 15:22:43",
      "content": "<p><img src=\"https://i.imgflip.com/37gd4k.jpg\" alt=\"\"></p>",
      "rawMarkdown": "![](https://i.imgflip.com/37gd4k.jpg)",
      "votes": null
    },
    {
      "id": "594459",
      "postDate": "08/08/2019 04:05:45",
      "content": "<p>My theory: they use quantum tunneling to go through the -3.0 barrier.</p>",
      "rawMarkdown": "My theory: they use quantum tunneling to go through the -3.0 barrier.",
      "votes": null
    },
    {
      "id": "594476",
      "postDate": "08/08/2019 04:53:32",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F644036%2F3b4a78877ca26fef9de98d987f1a68ea%2F37ib37.jpg?generation=1565239995447448&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F644036%2F3b4a78877ca26fef9de98d987f1a68ea%2F37ib37.jpg?generation=1565239995447448&amp;alt=media)",
      "votes": null
    },
    {
      "id": "594483",
      "postDate": "08/08/2019 05:04:54",
      "content": "<p>Nice one!</p>",
      "rawMarkdown": "Nice one!",
      "votes": null
    },
    {
      "id": "594511",
      "postDate": "08/08/2019 05:48:17",
      "content": "<p>BTW I found it also interesting that there is a team named Walter White while another team is named Pinkman, and what is more interesting is that a team-member of Pinkman has Bojack horseman's character as his avatar (which was voiced by Pinkman's actor). </p>\n\n<p>I think someone should form a team named DEA.</p>",
      "rawMarkdown": "BTW I found it also interesting that there is a team named Walter White while another team is named Pinkman, and what is more interesting is that a team-member of Pinkman has Bojack horseman's character as his avatar (which was voiced by Pinkman's actor). \n\nI think someone should form a team named DEA.",
      "votes": null
    },
    {
      "id": "594519",
      "postDate": "08/08/2019 06:05:28",
      "content": "<p>A bit off-topic but Todd Chavez is my favorite TV character. I started watching Breaking Bad much later and didn't even notice it is the same voice until a random google search.</p>\n\n<p>In this competition, there are a lot of cartels on top of us and we couldn't get our desired purity yet. It is not blue enough:)</p>",
      "rawMarkdown": "A bit off-topic but Todd Chavez is my favorite TV character. I started watching Breaking Bad much later and didn't even notice it is the same voice until a random google search.\n\nIn this competition, there are a lot of cartels on top of us and we couldn't get our desired purity yet. It is not blue enough:)",
      "votes": null
    },
    {
      "id": "595056",
      "postDate": "08/08/2019 19:42:08",
      "content": "<p>I agree. \"4 GM and the brain\" sounds pretty villain'ish.</p>",
      "rawMarkdown": "I agree. \"4 GM and the brain\" sounds pretty villain'ish.",
      "votes": null
    },
    {
      "id": "602896",
      "postDate": "08/19/2019 16:07:22",
      "content": "<blockquote>\n  <p>or to be ahead of uncle</p>\n</blockquote>\n\n<p>Seems this motivates you indeed ;)</p>",
      "rawMarkdown": "&gt; or to be ahead of uncle\n\nSeems this motivates you indeed ;)",
      "votes": null
    },
    {
      "id": "602898",
      "postDate": "08/19/2019 16:10:14",
      "content": "<p>Seems like you found someone who can handle GNN ;)</p>",
      "rawMarkdown": "Seems like you found someone who can handle GNN ;)",
      "votes": null
    },
    {
      "id": "602900",
      "postDate": "08/19/2019 16:12:19",
      "content": "<p>We still miss a quantum chemist and a fourth scientist.</p>",
      "rawMarkdown": "We still miss a quantum chemist and a fourth scientist.",
      "votes": null
    },
    {
      "id": "605884",
      "postDate": "08/22/2019 22:33:20",
      "content": "<p>Maybe the top team is primarily training on the first 29 % of the data </p>",
      "rawMarkdown": "Maybe the top team is primarily training on the first 29 % of the data",
      "votes": null
    },
    {
      "id": "605897",
      "postDate": "08/22/2019 23:21:41",
      "content": "<p>Why do you think so ? Do you revealed the way to devide public/private dataset ?</p>",
      "rawMarkdown": "Why do you think so ? Do you revealed the way to devide public/private dataset ?",
      "votes": null
    },
    {
      "id": "609271",
      "postDate": "08/27/2019 14:53:25",
      "content": "<p>The gap is being closed, and there is a continuum of scores now.  Largest gap is only a out 0.085.  It will be very interesting to read writeups.</p>",
      "rawMarkdown": "The gap is being closed, and there is a continuum of scores now.  Largest gap is only a out 0.085.  It will be very interesting to read writeups.",
      "votes": null
    },
    {
      "id": "610444",
      "postDate": "08/28/2019 20:02:14",
      "content": "<p>The gap has been closed!</p>\n\n<p><img src=\"https://www.kaggleusercontent.com/kf/19738636/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..Ttx4j8D1MPHOs-nXPY_Fpw.QH8itByxYz9gXyNluODXmmn8fXr5CPARbK6kXtA2Dq8gfPj5FdeK9CgS4EN-ULpSX2jjSiuYW54QNzMLa5msD0nJybURlui10js1r4sOG6Hpyrq-udXIfpi8qzFPqMDQWnM-3hr3Shs0lcvuuVak7-4hgMTw-j4IRFMI3HRRmes.mFGC2H25HBZlpuOfQLu2Kg/__results___files/__results___10_0.png\" alt=\"\"></p>",
      "rawMarkdown": "The gap has been closed!\n\n![](https://www.kaggleusercontent.com/kf/19738636/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..Ttx4j8D1MPHOs-nXPY_Fpw.QH8itByxYz9gXyNluODXmmn8fXr5CPARbK6kXtA2Dq8gfPj5FdeK9CgS4EN-ULpSX2jjSiuYW54QNzMLa5msD0nJybURlui10js1r4sOG6Hpyrq-udXIfpi8qzFPqMDQWnM-3hr3Shs0lcvuuVak7-4hgMTw-j4IRFMI3HRRmes.mFGC2H25HBZlpuOfQLu2Kg/__results___files/__results___10_0.png)",
      "votes": null
    },
    {
      "id": "610677",
      "postDate": "08/29/2019 00:08:30",
      "content": "<p>Well it's over. I can put my computer to sleep ;-)</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2F143bc3851ec23a95417ba91642250e88%2FScreen%20Shot%202019-08-29%20at%202.07.46%20AM.png?generation=1567037287027219&amp;alt=media\" alt=\"\"></p>",
      "rawMarkdown": "Well it's over. I can put my computer to sleep ;-)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2F143bc3851ec23a95417ba91642250e88%2FScreen%20Shot%202019-08-29%20at%202.07.46%20AM.png?generation=1567037287027219&amp;alt=media)",
      "votes": null
    },
    {
      "id": "610683",
      "postDate": "08/29/2019 00:10:33",
      "content": "<p>This is very fitting 😄 </p>",
      "rawMarkdown": "This is very fitting 😄",
      "votes": null
    },
    {
      "id": "615715",
      "postDate": "09/02/2019 09:35:18",
      "content": "<p>&gt; Seems like you found someone who can handle GNN ;)</p>\n\n<p>Outrunner NN is not a graph NN by any mean actually.  I couldn't say it during the competition obviously  ;)  </p>\n\n<p>Our models are closer in spirit to 2nd team, except twe use distance and angles instead of xyz coordinates.  I'm still puzzled that the order of atom index and xyz coordinates are significant given how model that use it outperform models that are rotation and atom order independent.</p>",
      "rawMarkdown": "&gt; Seems like you found someone who can handle GNN ;)\n\nOutrunner NN is not a graph NN by any mean actually.  I couldn't say it during the competition obviously  ;)  \n\nOur models are closer in spirit to 2nd team, except twe use distance and angles instead of xyz coordinates.  I'm still puzzled that the order of atom index and xyz coordinates are significant given how model that use it outperform models that are rotation and atom order independent.",
      "votes": null
    },
    {
      "id": "615719",
      "postDate": "09/02/2019 09:38:56",
      "content": "<p>We do not use atom index (position in the array) 9999?9</p>",
      "rawMarkdown": "We do not use atom index (position in the array) 9999?9",
      "votes": null
    },
    {
      "id": "615755",
      "postDate": "09/02/2019 10:36:34",
      "content": "<p>3rd team uses the atoms as a sequence.</p>",
      "rawMarkdown": "3rd team uses the atoms as a sequence.",
      "votes": null
    },
    {
      "id": "615764",
      "postDate": "09/02/2019 11:00:32",
      "content": "<p>I bet if you remove the positional info their model performs equal or better</p>",
      "rawMarkdown": "I bet if you remove the positional info their model performs equal or better",
      "votes": null
    },
    {
      "id": "615772",
      "postDate": "09/02/2019 11:06:55",
      "content": "<p>Maybe.  My point is that models that are rotation invariant and translation invariant and atom order invariant perform worse than those that miss one or more of these properties.  </p>\n\n<p>This is surprising to me (and few others).  </p>\n\n<p>It does not mean that the models that perform better are bad, to the contrary.   They use data better than the other models.  </p>\n\n<p>Having preconceived assumptions about what the models should be led to worse performance.  Mind openness led to better performance.</p>",
      "rawMarkdown": "Maybe.  My point is that models that are rotation invariant and translation invariant and atom order invariant perform worse than those that miss one or more of these properties.  \n\nThis is surprising to me (and few others).  \n\nIt does not mean that the models that perform better are bad, to the contrary.   They use data better than the other models.  \n\nHaving preconceived assumptions about what the models should be led to worse performance.  Mind openness led to better performance.",
      "votes": null
    },
    {
      "id": "615780",
      "postDate": "09/02/2019 11:24:21",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2F187e12a764956e7e758b6c44514fe6db%2FIMG_20190902_132158.jpg?generation=1567423420659081&amp;alt=media\" alt=\"\">\nFrom <a href=\"https://www.quantamagazine.org/how-artificial-intelligence-is-changing-science-20190311/\">https://www.quantamagazine.org/how-artificial-intelligence-is-changing-science-20190311/</a></p>\n\n<p>This was an inspiration to approach this challenge</p>",
      "rawMarkdown": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2F187e12a764956e7e758b6c44514fe6db%2FIMG_20190902_132158.jpg?generation=1567423420659081&amp;alt=media)\nFrom https://www.quantamagazine.org/how-artificial-intelligence-is-changing-science-20190311/\n\nThis was an inspiration to approach this challenge",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 591978,
      "author_name": "cpmpml",
      "author_url": "",
      "post_date": "08/04/2019 15:26:49",
      "content": "<blockquote>\n  <p>Are there theories as to how one team could be so much stronger than the rest?</p>\n</blockquote>\n\n<p>You provided the answer:</p>\n\n<blockquote>\n  <p>Certainly it's possible that other teams have similarly strong models but are just holding back on submitting. </p>\n</blockquote>",
      "votes": null,
      "replies": []
    },
    {
      "id": 591990,
      "author_name": "antorsae",
      "author_url": "",
      "post_date": "08/04/2019 15:37:30",
      "content": "<p>We have developed a quantum computer and achieved quantum supremacy.</p>",
      "votes": null,
      "replies": [
        {
          "id": 591999,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "08/04/2019 15:50:01",
          "content": "<p>Great, you'll be removed then because you use quantum computation :D</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 592826,
          "author_name": "summationnotations",
          "author_url": "",
          "post_date": "08/05/2019 21:17:19",
          "content": "<p>Pics or it didn't happen</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 593138,
          "author_name": "antorsae",
          "author_url": "",
          "post_date": "08/06/2019 08:08:37",
          "content": "<p>As requested, here's a pic of our quantum computer. We're worried b/c it's getting AGI-like qualities and we don't know how to contain it:</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2Ffee4f2f20de135798baf02d6f6a41252%2Fall-your-atoms.png?generation=1565078913929451&amp;alt=media\" alt=\"\"></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 593258,
          "author_name": "cyberia",
          "author_url": "",
          "post_date": "08/06/2019 11:24:55",
          "content": "<blockquote>\n  <p>We're worried b/c it's getting AGI-like qualities and we don't know how to contain it</p>\n</blockquote>\n\n<p>AGI getting out of control? hmm\nIt is going to decide humankind's fate? hmm</p>\n\n<p>Thats a serious situation rather than try to fool it with adversarial samples and give humanity another chance, I would just pull the plug out.</p>\n\n<p><img src=\"http://bookofjoe.typepad.com/.a/6a00d8341c5dea53ef010536e44351970c-pi\" alt=\"\"></p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 592068,
      "author_name": "cpmpml",
      "author_url": "",
      "post_date": "08/04/2019 18:39:33",
      "content": "<p>Maybe they ensemble models?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 592084,
      "author_name": "scaomath",
      "author_url": "",
      "post_date": "08/04/2019 19:20:20",
      "content": "<p>Out of curiosity, for those of you who has average log MAE less than -2.5 (by which I assume is achieved by ensembling different types of models), which one is better 1JHC and 1JHN? GB-based (LGB XGB) or NN-based (NN, GNN, GCN)?</p>",
      "votes": null,
      "replies": [
        {
          "id": 592479,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "08/05/2019 11:07:41",
          "content": "<p>We basically work with one model for now, hence cannot  really answer your question ;)  </p>\n\n<p>I would be surprised if lgb is better than NNs here.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 592458,
      "author_name": "cpmpml",
      "author_url": "",
      "post_date": "08/05/2019 10:16:11",
      "content": "<p>It seems some poeple were motivated to close some of the gap after 1st team...</p>",
      "votes": null,
      "replies": [
        {
          "id": 592601,
          "author_name": "christofhenkel",
          "author_url": "",
          "post_date": "08/05/2019 14:37:02",
          "content": "<p>or to be ahead of uncle</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 592648,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "08/05/2019 16:00:39",
          "content": "<p>ok, you convinced me to start a MPNN.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 594110,
          "author_name": "christofhenkel",
          "author_url": "",
          "post_date": "08/07/2019 15:22:43",
          "content": "<p><img src=\"https://i.imgflip.com/37gd4k.jpg\" alt=\"\"></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 602896,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "08/19/2019 16:07:22",
          "content": "<blockquote>\n  <p>or to be ahead of uncle</p>\n</blockquote>\n\n<p>Seems this motivates you indeed ;)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 602898,
          "author_name": "christofhenkel",
          "author_url": "",
          "post_date": "08/19/2019 16:10:14",
          "content": "<p>Seems like you found someone who can handle GNN ;)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 602900,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "08/19/2019 16:12:19",
          "content": "<p>We still miss a quantum chemist and a fourth scientist.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 615715,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "09/02/2019 09:35:18",
          "content": "<p>&gt; Seems like you found someone who can handle GNN ;)</p>\n\n<p>Outrunner NN is not a graph NN by any mean actually.  I couldn't say it during the competition obviously  ;)  </p>\n\n<p>Our models are closer in spirit to 2nd team, except twe use distance and angles instead of xyz coordinates.  I'm still puzzled that the order of atom index and xyz coordinates are significant given how model that use it outperform models that are rotation and atom order independent.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 615719,
          "author_name": "antorsae",
          "author_url": "",
          "post_date": "09/02/2019 09:38:56",
          "content": "<p>We do not use atom index (position in the array) 9999?9</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 615755,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "09/02/2019 10:36:34",
          "content": "<p>3rd team uses the atoms as a sequence.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 615764,
          "author_name": "antorsae",
          "author_url": "",
          "post_date": "09/02/2019 11:00:32",
          "content": "<p>I bet if you remove the positional info their model performs equal or better</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 615772,
          "author_name": "cpmpml",
          "author_url": "",
          "post_date": "09/02/2019 11:06:55",
          "content": "<p>Maybe.  My point is that models that are rotation invariant and translation invariant and atom order invariant perform worse than those that miss one or more of these properties.  </p>\n\n<p>This is surprising to me (and few others).  </p>\n\n<p>It does not mean that the models that perform better are bad, to the contrary.   They use data better than the other models.  </p>\n\n<p>Having preconceived assumptions about what the models should be led to worse performance.  Mind openness led to better performance.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 615780,
          "author_name": "antorsae",
          "author_url": "",
          "post_date": "09/02/2019 11:24:21",
          "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2F187e12a764956e7e758b6c44514fe6db%2FIMG_20190902_132158.jpg?generation=1567423420659081&amp;alt=media\" alt=\"\">\nFrom <a href=\"https://www.quantamagazine.org/how-artificial-intelligence-is-changing-science-20190311/\">https://www.quantamagazine.org/how-artificial-intelligence-is-changing-science-20190311/</a></p>\n\n<p>This was an inspiration to approach this challenge</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 592713,
      "author_name": "youhanlee",
      "author_url": "",
      "post_date": "08/05/2019 18:02:57",
      "content": "<p>I really want to do quantum jump to top...:)</p>",
      "votes": null,
      "replies": [
        {
          "id": 592763,
          "author_name": "returnofsputnik",
          "author_url": "",
          "post_date": "08/05/2019 19:37:59",
          "content": "<p>Im rooting for you YouHan. you are always so close to gold. Good luck </p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 593171,
          "author_name": "youhanlee",
          "author_url": "",
          "post_date": "08/06/2019 08:48:10",
          "content": "<p>Thanks for kind words, Corey! \nI'm also rooting for you. I hope both of us get golds, then I became competition master, and you became so close to grand master! Good luck :)</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 594459,
      "author_name": "tunguz",
      "author_url": "",
      "post_date": "08/08/2019 04:05:45",
      "content": "<p>My theory: they use quantum tunneling to go through the -3.0 barrier.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 594476,
      "author_name": "robikscube",
      "author_url": "",
      "post_date": "08/08/2019 04:53:32",
      "content": "<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F644036%2F3b4a78877ca26fef9de98d987f1a68ea%2F37ib37.jpg?generation=1565239995447448&amp;alt=media\" alt=\"\"></p>",
      "votes": null,
      "replies": [
        {
          "id": 594483,
          "author_name": "antorsae",
          "author_url": "",
          "post_date": "08/08/2019 05:04:54",
          "content": "<p>Nice one!</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 594511,
      "author_name": "scaomath",
      "author_url": "",
      "post_date": "08/08/2019 05:48:17",
      "content": "<p>BTW I found it also interesting that there is a team named Walter White while another team is named Pinkman, and what is more interesting is that a team-member of Pinkman has Bojack horseman's character as his avatar (which was voiced by Pinkman's actor). </p>\n\n<p>I think someone should form a team named DEA.</p>",
      "votes": null,
      "replies": [
        {
          "id": 594519,
          "author_name": "aerdem4",
          "author_url": "",
          "post_date": "08/08/2019 06:05:28",
          "content": "<p>A bit off-topic but Todd Chavez is my favorite TV character. I started watching Breaking Bad much later and didn't even notice it is the same voice until a random google search.</p>\n\n<p>In this competition, there are a lot of cartels on top of us and we couldn't get our desired purity yet. It is not blue enough:)</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 595056,
          "author_name": "scaomath",
          "author_url": "",
          "post_date": "08/08/2019 19:42:08",
          "content": "<p>I agree. \"4 GM and the brain\" sounds pretty villain'ish.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 605884,
      "author_name": "eladwar",
      "author_url": "",
      "post_date": "08/22/2019 22:33:20",
      "content": "<p>Maybe the top team is primarily training on the first 29 % of the data </p>",
      "votes": null,
      "replies": [
        {
          "id": 605897,
          "author_name": "toshik",
          "author_url": "",
          "post_date": "08/22/2019 23:21:41",
          "content": "<p>Why do you think so ? Do you revealed the way to devide public/private dataset ?</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 609271,
      "author_name": "cpmpml",
      "author_url": "",
      "post_date": "08/27/2019 14:53:25",
      "content": "<p>The gap is being closed, and there is a continuum of scores now.  Largest gap is only a out 0.085.  It will be very interesting to read writeups.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 610444,
      "author_name": "robikscube",
      "author_url": "",
      "post_date": "08/28/2019 20:02:14",
      "content": "<p>The gap has been closed!</p>\n\n<p><img src=\"https://www.kaggleusercontent.com/kf/19738636/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..Ttx4j8D1MPHOs-nXPY_Fpw.QH8itByxYz9gXyNluODXmmn8fXr5CPARbK6kXtA2Dq8gfPj5FdeK9CgS4EN-ULpSX2jjSiuYW54QNzMLa5msD0nJybURlui10js1r4sOG6Hpyrq-udXIfpi8qzFPqMDQWnM-3hr3Shs0lcvuuVak7-4hgMTw-j4IRFMI3HRRmes.mFGC2H25HBZlpuOfQLu2Kg/__results___files/__results___10_0.png\" alt=\"\"></p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 610677,
      "author_name": "antorsae",
      "author_url": "",
      "post_date": "08/29/2019 00:08:30",
      "content": "<p>Well it's over. I can put my computer to sleep ;-)</p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2F143bc3851ec23a95417ba91642250e88%2FScreen%20Shot%202019-08-29%20at%202.07.46%20AM.png?generation=1567037287027219&amp;alt=media\" alt=\"\"></p>",
      "votes": null,
      "replies": [
        {
          "id": 610683,
          "author_name": "robikscube",
          "author_url": "",
          "post_date": "08/29/2019 00:10:33",
          "content": "<p>This is very fitting 😄 </p>",
          "votes": null,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "591959": "It's clear one team has pulled ahead from the rest on the public leaderboard. Certainly it's possible that other teams have similarly strong models but are just holding back on submitting. Apart from that, right now it appears they are blowing the rest of the field away.\n\nAre there theories as to how one team could be so much stronger than the rest?\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F644036%2Fe0406162927cdec7c1db546d0d957acc%2Flb_Tr.png?generation=1564930492180256&amp;alt=media)\n\n![](https://i.imgur.com/d4z0vdl.gif)",
    "591978": "&gt; Are there theories as to how one team could be so much stronger than the rest?\n\nYou provided the answer:\n\n&gt; Certainly it's possible that other teams have similarly strong models but are just holding back on submitting.",
    "591990": "We have developed a quantum computer and achieved quantum supremacy.",
    "591999": "Great, you'll be removed then because you use quantum computation :D",
    "592068": "Maybe they ensemble models?",
    "592084": "Out of curiosity, for those of you who has average log MAE less than -2.5 (by which I assume is achieved by ensembling different types of models), which one is better 1JHC and 1JHN? GB-based (LGB XGB) or NN-based (NN, GNN, GCN)?",
    "592458": "It seems some poeple were motivated to close some of the gap after 1st team...",
    "592479": "We basically work with one model for now, hence cannot  really answer your question ;)  \n\nI would be surprised if lgb is better than NNs here.",
    "592601": "or to be ahead of uncle",
    "592648": "ok, you convinced me to start a MPNN.",
    "592713": "I really want to do quantum jump to top...:)",
    "592763": "Im rooting for you YouHan. you are always so close to gold. Good luck",
    "592826": "Pics or it didn't happen",
    "593138": "As requested, here's a pic of our quantum computer. We're worried b/c it's getting AGI-like qualities and we don't know how to contain it:\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2Ffee4f2f20de135798baf02d6f6a41252%2Fall-your-atoms.png?generation=1565078913929451&amp;alt=media)",
    "593171": "Thanks for kind words, Corey! \nI'm also rooting for you. I hope both of us get golds, then I became competition master, and you became so close to grand master! Good luck :)",
    "593258": "&gt; We're worried b/c it's getting AGI-like qualities and we don't know how to contain it\n \nAGI getting out of control? hmm\nIt is going to decide humankind's fate? hmm\n \nThats a serious situation rather than try to fool it with adversarial samples and give humanity another chance, I would just pull the plug out.\n \n![](http://bookofjoe.typepad.com/.a/6a00d8341c5dea53ef010536e44351970c-pi)",
    "594110": "![](https://i.imgflip.com/37gd4k.jpg)",
    "594459": "My theory: they use quantum tunneling to go through the -3.0 barrier.",
    "594476": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F644036%2F3b4a78877ca26fef9de98d987f1a68ea%2F37ib37.jpg?generation=1565239995447448&amp;alt=media)",
    "594483": "Nice one!",
    "594511": "BTW I found it also interesting that there is a team named Walter White while another team is named Pinkman, and what is more interesting is that a team-member of Pinkman has Bojack horseman's character as his avatar (which was voiced by Pinkman's actor). \n\nI think someone should form a team named DEA.",
    "594519": "A bit off-topic but Todd Chavez is my favorite TV character. I started watching Breaking Bad much later and didn't even notice it is the same voice until a random google search.\n\nIn this competition, there are a lot of cartels on top of us and we couldn't get our desired purity yet. It is not blue enough:)",
    "595056": "I agree. \"4 GM and the brain\" sounds pretty villain'ish.",
    "602896": "&gt; or to be ahead of uncle\n\nSeems this motivates you indeed ;)",
    "602898": "Seems like you found someone who can handle GNN ;)",
    "602900": "We still miss a quantum chemist and a fourth scientist.",
    "605884": "Maybe the top team is primarily training on the first 29 % of the data",
    "605897": "Why do you think so ? Do you revealed the way to devide public/private dataset ?",
    "609271": "The gap is being closed, and there is a continuum of scores now.  Largest gap is only a out 0.085.  It will be very interesting to read writeups.",
    "610444": "The gap has been closed!\n\n![](https://www.kaggleusercontent.com/kf/19738636/eyJhbGciOiJkaXIiLCJlbmMiOiJBMTI4Q0JDLUhTMjU2In0..Ttx4j8D1MPHOs-nXPY_Fpw.QH8itByxYz9gXyNluODXmmn8fXr5CPARbK6kXtA2Dq8gfPj5FdeK9CgS4EN-ULpSX2jjSiuYW54QNzMLa5msD0nJybURlui10js1r4sOG6Hpyrq-udXIfpi8qzFPqMDQWnM-3hr3Shs0lcvuuVak7-4hgMTw-j4IRFMI3HRRmes.mFGC2H25HBZlpuOfQLu2Kg/__results___files/__results___10_0.png)",
    "610677": "Well it's over. I can put my computer to sleep ;-)\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2F143bc3851ec23a95417ba91642250e88%2FScreen%20Shot%202019-08-29%20at%202.07.46%20AM.png?generation=1567037287027219&amp;alt=media)",
    "610683": "This is very fitting 😄",
    "615715": "&gt; Seems like you found someone who can handle GNN ;)\n\nOutrunner NN is not a graph NN by any mean actually.  I couldn't say it during the competition obviously  ;)  \n\nOur models are closer in spirit to 2nd team, except twe use distance and angles instead of xyz coordinates.  I'm still puzzled that the order of atom index and xyz coordinates are significant given how model that use it outperform models that are rotation and atom order independent.",
    "615719": "We do not use atom index (position in the array) 9999?9",
    "615755": "3rd team uses the atoms as a sequence.",
    "615764": "I bet if you remove the positional info their model performs equal or better",
    "615772": "Maybe.  My point is that models that are rotation invariant and translation invariant and atom order invariant perform worse than those that miss one or more of these properties.  \n\nThis is surprising to me (and few others).  \n\nIt does not mean that the models that perform better are bad, to the contrary.   They use data better than the other models.  \n\nHaving preconceived assumptions about what the models should be led to worse performance.  Mind openness led to better performance.",
    "615780": "![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F8507%2F187e12a764956e7e758b6c44514fe6db%2FIMG_20190902_132158.jpg?generation=1567423420659081&amp;alt=media)\nFrom https://www.quantamagazine.org/how-artificial-intelligence-is-changing-science-20190311/\n\nThis was an inspiration to approach this challenge"
  },
  "source": "meta"
}