{
  "id": 103444,
  "title": "Don't do this",
  "url": "/competitions/champs-scalar-coupling/discussion/103444",
  "author_name": "CPMP",
  "post_date": "2019-08-09T08:46:17.958000",
  "votes": 20,
  "comment_count": 27,
  "views": 0,
  "content": "<p>Late at night, you're tired, and you don't create a new conda env when installing something.  And you did not notice this install also installs a new Python version.  From then, nothing works anymore, notebooks don't start, etc...</p>\n\n<p>It happened to me last night, and I spent several hours reinstalling a clean python stack.  </p>\n\n<p>Sure, it could have been worse, it could have happened 2 days before competition end...</p>\n\n<p>The good side is that I have an up to date machine.</p>\n\n<p>Let's go back to competing.</p>",
  "messages": [
    {
      "id": 595455,
      "postDate": "2019-08-09T08:46:17.960Z",
      "content": "<p>Late at night, you're tired, and you don't create a new conda env when installing something.  And you did not notice this install also installs a new Python version.  From then, nothing works anymore, notebooks don't start, etc...</p>\n\n<p>It happened to me last night, and I spent several hours reinstalling a clean python stack.  </p>\n\n<p>Sure, it could have been worse, it could have happened 2 days before competition end...</p>\n\n<p>The good side is that I have an up to date machine.</p>\n\n<p>Let's go back to competing.</p>",
      "rawMarkdown": "Late at night, you're tired, and you don't create a new conda env when installing something.  And you did not notice this install also installs a new Python version.  From then, nothing works anymore, notebooks don't start, etc...\n\nIt happened to me last night, and I spent several hours reinstalling a clean python stack.  \n\nSure, it could have been worse, it could have happened 2 days before competition end...\n\nThe good side is that I have an up to date machine.\n\nLet's go back to competing.",
      "votes": 20
    },
    {
      "id": 596107,
      "postDate": "2019-08-10T07:15:31.467Z",
      "content": "<p><img src=\"https://i.imgflip.com/37ohix.jpg\" alt=\"\"></p>",
      "rawMarkdown": "![](https://i.imgflip.com/37ohix.jpg)",
      "votes": 10,
      "replies": [
        {
          "id": 596351,
          "postDate": "2019-08-10T14:09:09.203Z",
          "content": "<p>Well that is a very targeted reference 😁 </p>",
          "rawMarkdown": "Well that is a very targeted reference 😁 ",
          "votes": 2
        },
        {
          "id": 596417,
          "postDate": "2019-08-10T16:03:41.103Z",
          "content": "<p>I didn't dare install rdkit on my machine, I used Kaggle kernel when I used rdkit :)</p>",
          "rawMarkdown": "I didn't dare install rdkit on my machine, I used Kaggle kernel when I used rdkit :)"
        },
        {
          "id": 596536,
          "postDate": "2019-08-10T19:50:47.297Z",
          "content": "<p>Haha, I've had to clean install because of this comp. Pip + pip3 + conda2 + conda3 + rdkit + openbabel + bugs = need a new pc after.</p>",
          "rawMarkdown": "Haha, I've had to clean install because of this comp. Pip + pip3 + conda2 + conda3 + rdkit + openbabel + bugs = need a new pc after.",
          "votes": 4
        },
        {
          "id": 597439,
          "postDate": "2019-08-12T10:53:33.497Z",
          "content": "<p>RDKIT is beautiful for visualization model of neural network Thank you for your share</p>",
          "rawMarkdown": "RDKIT is beautiful for visualization model of neural network Thank you for your share"
        }
      ]
    },
    {
      "id": 595461,
      "postDate": "2019-08-09T08:55:33.250Z",
      "content": "<p>Keep calm. \nBrew some coffee. \nWait for it's kicking in.</p>\n\n<blockquote>\n  <p>Let's go back to competing.</p>\n</blockquote>",
      "rawMarkdown": "Keep calm. \nBrew some coffee. \nWait for it's kicking in.\n\n&gt; Let's go back to competing.",
      "votes": 3,
      "replies": [
        {
          "id": 595556,
          "postDate": "2019-08-09T11:21:19.017Z",
          "content": "<p>I stayed calm, getting angry can just lead to even worse situations.</p>",
          "rawMarkdown": "I stayed calm, getting angry can just lead to even worse situations.",
          "votes": 3
        }
      ]
    },
    {
      "id": 596937,
      "postDate": "2019-08-11T14:42:25.623Z",
      "content": "<p>Already done it! I ended up having to compile tensorflow from source an absolute joy - swearbox is now full ;(</p>\n\n<p>I am not that impressed with this conda</p>",
      "rawMarkdown": "Already done it! I ended up having to compile tensorflow from source an absolute joy - swearbox is now full ;(\n\nI am not that impressed with this conda",
      "votes": 1,
      "replies": [
        {
          "id": 597321,
          "postDate": "2019-08-12T07:13:13.027Z",
          "content": "<p>Wow, for me it was simple: wipe anaconda, install latest, build environements with what I use.  Everything with conda, except few pip install like for tensoflow-gpu.  But I'm using ubuntu 18.04 which may make it simpler.</p>",
          "rawMarkdown": "Wow, for me it was simple: wipe anaconda, install latest, build environements with what I use.  Everything with conda, except few pip install like for tensoflow-gpu.  But I'm using ubuntu 18.04 which may make it simpler."
        }
      ]
    },
    {
      "id": 595706,
      "postDate": "2019-08-09T15:06:23.343Z",
      "content": "<p>Docker for life :)</p>",
      "rawMarkdown": "Docker for life :)",
      "votes": 1,
      "replies": [
        {
          "id": 595758,
          "postDate": "2019-08-09T16:11:00.093Z",
          "content": "<p>You create a new docker image each time you install or upgrade a package?</p>",
          "rawMarkdown": "You create a new docker image each time you install or upgrade a package?"
        },
        {
          "id": 595759,
          "postDate": "2019-08-09T16:15:43.200Z",
          "content": "<p>I have a Docker that I upgrade every 3 months. Then usually for each project I can do some light installation base on this image</p>",
          "rawMarkdown": "I have a Docker that I upgrade every 3 months. Then usually for each project I can do some light installation base on this image",
          "votes": 2
        },
        {
          "id": 595824,
          "postDate": "2019-08-09T18:28:09.037Z",
          "content": "<p>mine was a rather light install:  I upgraded numpy...</p>",
          "rawMarkdown": "mine was a rather light install:  I upgraded numpy...",
          "votes": 1
        }
      ]
    },
    {
      "id": 595470,
      "postDate": "2019-08-09T09:05:53.937Z",
      "content": "<p>If you use btrfs try snapper.io it has saved my life wiping my whole home directory</p>",
      "rawMarkdown": "If you use btrfs try snapper.io it has saved my life wiping my whole home directory",
      "votes": 1,
      "replies": [
        {
          "id": 595559,
          "postDate": "2019-08-09T11:24:20.360Z",
          "content": "<p>Thanks, I didn't know about btrfs nor about snapper.io. Will look into it.</p>",
          "rawMarkdown": "Thanks, I didn't know about btrfs nor about snapper.io. Will look into it."
        }
      ]
    },
    {
      "id": 597872,
      "postDate": "2019-08-12T20:52:56.420Z",
      "content": "<p>I can empathize:\nFor various reasons I prefer to use R as my \"base of operations\" for Kaggle contests rather than Python, although I can get to Python (3.6) from R if I need to via the \"reticulate\" package.   In addition to other machine learning tools like lightgbm, xgboost, etc., R has packages that expose the keras and tensorflow APIs directly, although I think they use reticulate to accomplish this.  It all works as long as the components (Ubuntu OS, my R installation, the R packages for keras and tensorflow, my Python installation,  the Python modules for keras and tensorflow, and cuda for the GPU) all play nice together.  But an innocent looking but incompatible update to any one of these can break the toolchain.  I ran into this several days ago with keras and tensorflow, which started issuing mysterious error messages about class and method incompatibilities involving my model objects.  After many hours of testing, updating, and more testing, including installing a development Github version of R keras, I finally got the whole thing working again.  During that pitched and gory battle there were dark times when I wasn't sure I would emerge the victor, but somewhere inside of me I knew from long experience that persistence and grit should eventually win out.  Reminds me of that expression: \"What doesn't kill you makes you stronger\".</p>",
      "rawMarkdown": "I can empathize:\nFor various reasons I prefer to use R as my \"base of operations\" for Kaggle contests rather than Python, although I can get to Python (3.6) from R if I need to via the \"reticulate\" package.   In addition to other machine learning tools like lightgbm, xgboost, etc., R has packages that expose the keras and tensorflow APIs directly, although I think they use reticulate to accomplish this.  It all works as long as the components (Ubuntu OS, my R installation, the R packages for keras and tensorflow, my Python installation,  the Python modules for keras and tensorflow, and cuda for the GPU) all play nice together.  But an innocent looking but incompatible update to any one of these can break the toolchain.  I ran into this several days ago with keras and tensorflow, which started issuing mysterious error messages about class and method incompatibilities involving my model objects.  After many hours of testing, updating, and more testing, including installing a development Github version of R keras, I finally got the whole thing working again.  During that pitched and gory battle there were dark times when I wasn't sure I would emerge the victor, but somewhere inside of me I knew from long experience that persistence and grit should eventually win out.  Reminds me of that expression: \"What doesn't kill you makes you stronger\".",
      "votes": 2
    },
    {
      "id": 595986,
      "postDate": "2019-08-10T00:18:09.620Z",
      "content": "<p>I forced myself to use kaggle dockers and pull their latest changes. Of course we have an internal version with our rapids software. Here is our PR <a href=\"https://github.com/Kaggle/docker-python/pull/595\">https://github.com/Kaggle/docker-python/pull/595</a></p>",
      "rawMarkdown": "I forced myself to use kaggle dockers and pull their latest changes. Of course we have an internal version with our rapids software. Here is our PR https://github.com/Kaggle/docker-python/pull/595",
      "votes": 2
    },
    {
      "id": 595510,
      "postDate": "2019-08-09T09:55:17.830Z",
      "content": "<p>Sorry to hear that <a href=\"/cpmpml\">@cpmpml</a>  ... but a fresh install may mean more upside subs to come for you guys ;-) </p>",
      "rawMarkdown": "Sorry to hear that @cpmpml  ... but a fresh install may mean more upside subs to come for you guys ;-) ",
      "replies": [
        {
          "id": 595560,
          "postDate": "2019-08-09T11:25:21.137Z",
          "content": "<p>Thanks.  If only refreshing versions  were enough to improve model performances... ;)</p>",
          "rawMarkdown": "Thanks.  If only refreshing versions  were enough to improve model performances... ;)",
          "votes": 1
        }
      ]
    },
    {
      "id": 597674,
      "postDate": "2019-08-12T16:40:40.063Z",
      "content": "<p>Sorry for being off topic, but what IDE do you people use for Python?</p>",
      "rawMarkdown": "Sorry for being off topic, but what IDE do you people use for Python?",
      "replies": [
        {
          "id": 597684,
          "postDate": "2019-08-12T16:54:29.973Z",
          "content": "<p>Currently, I use just Jupyter notebooks and Vim.</p>",
          "rawMarkdown": "Currently, I use just Jupyter notebooks and Vim.",
          "votes": 1
        }
      ]
    },
    {
      "id": 596496,
      "postDate": "2019-08-10T18:13:01.157Z",
      "content": "<p>I haven't done this yet, but it's definitely possible.</p>",
      "rawMarkdown": "I haven't done this yet, but it's definitely possible."
    },
    {
      "id": 595946,
      "postDate": "2019-08-09T22:22:24.530Z",
      "content": "<p>happens!</p>",
      "rawMarkdown": "happens!"
    },
    {
      "id": 598032,
      "postDate": "2019-08-13T03:09:16.480Z",
      "rawMarkdown": "",
      "isDeleted": true
    },
    {
      "id": 595744,
      "postDate": "2019-08-09T15:49:31.683Z",
      "rawMarkdown": "",
      "votes": 4,
      "isDeleted": true,
      "replies": [
        {
          "id": 595757,
          "postDate": "2019-08-09T16:10:27.290Z",
          "content": "<p>Exactly, I have no excuse ;)</p>",
          "rawMarkdown": "Exactly, I have no excuse ;)"
        },
        {
          "id": 595972,
          "postDate": "2019-08-09T23:16:47.733Z",
          "content": "<p>The irony is that a similar effect you can obtain updating conda. The only difference is that someone who does not like Python does not repair it in several hours.</p>",
          "rawMarkdown": "The irony is that a similar effect you can obtain updating conda. The only difference is that someone who does not like Python does not repair it in several hours.",
          "votes": 2
        }
      ]
    }
  ],
  "comments": [
    {
      "id": 596107,
      "author_name": "Dieter",
      "author_url": "",
      "post_date": "2019-08-10T07:15:31.467000",
      "content": "<p><img src=\"https://i.imgflip.com/37ohix.jpg\" alt=\"\"></p>",
      "votes": 10,
      "replies": [
        {
          "id": 596351,
          "author_name": "Boris D.",
          "author_url": "",
          "post_date": "2019-08-10T14:09:09.203000",
          "content": "<p>Well that is a very targeted reference 😁 </p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 596417,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-08-10T16:03:41.103000",
          "content": "<p>I didn't dare install rdkit on my machine, I used Kaggle kernel when I used rdkit :)</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 596536,
          "author_name": "roush",
          "author_url": "",
          "post_date": "2019-08-10T19:50:47.297000",
          "content": "<p>Haha, I've had to clean install because of this comp. Pip + pip3 + conda2 + conda3 + rdkit + openbabel + bugs = need a new pc after.</p>",
          "votes": 4,
          "replies": []
        },
        {
          "id": 597439,
          "author_name": "ForesightKing",
          "author_url": "",
          "post_date": "2019-08-12T10:53:33.497000",
          "content": "<p>RDKIT is beautiful for visualization model of neural network Thank you for your share</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 595461,
      "author_name": "Stanislav Blinov",
      "author_url": "",
      "post_date": "2019-08-09T08:55:33.250000",
      "content": "<p>Keep calm. \nBrew some coffee. \nWait for it's kicking in.</p>\n\n<blockquote>\n  <p>Let's go back to competing.</p>\n</blockquote>",
      "votes": 3,
      "replies": [
        {
          "id": 595556,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-08-09T11:21:19.017000",
          "content": "<p>I stayed calm, getting angry can just lead to even worse situations.</p>",
          "votes": 3,
          "replies": []
        }
      ]
    },
    {
      "id": 596937,
      "author_name": "Scirpus",
      "author_url": "",
      "post_date": "2019-08-11T14:42:25.623000",
      "content": "<p>Already done it! I ended up having to compile tensorflow from source an absolute joy - swearbox is now full ;(</p>\n\n<p>I am not that impressed with this conda</p>",
      "votes": 1,
      "replies": [
        {
          "id": 597321,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-08-12T07:13:13.027000",
          "content": "<p>Wow, for me it was simple: wipe anaconda, install latest, build environements with what I use.  Everything with conda, except few pip install like for tensoflow-gpu.  But I'm using ubuntu 18.04 which may make it simpler.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 595706,
      "author_name": "Kaggoo",
      "author_url": "",
      "post_date": "2019-08-09T15:06:23.343000",
      "content": "<p>Docker for life :)</p>",
      "votes": 1,
      "replies": [
        {
          "id": 595758,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-08-09T16:11:00.093000",
          "content": "<p>You create a new docker image each time you install or upgrade a package?</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 595759,
          "author_name": "Lam Dang",
          "author_url": "",
          "post_date": "2019-08-09T16:15:43.200000",
          "content": "<p>I have a Docker that I upgrade every 3 months. Then usually for each project I can do some light installation base on this image</p>",
          "votes": 2,
          "replies": []
        },
        {
          "id": 595824,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-08-09T18:28:09.037000",
          "content": "<p>mine was a rather light install:  I upgraded numpy...</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 595470,
      "author_name": "Andrés Miguel Torrubia Sáez",
      "author_url": "",
      "post_date": "2019-08-09T09:05:53.937000",
      "content": "<p>If you use btrfs try snapper.io it has saved my life wiping my whole home directory</p>",
      "votes": 1,
      "replies": [
        {
          "id": 595559,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-08-09T11:24:20.360000",
          "content": "<p>Thanks, I didn't know about btrfs nor about snapper.io. Will look into it.</p>",
          "votes": 0,
          "replies": []
        }
      ]
    },
    {
      "id": 597872,
      "author_name": "David J. Slate",
      "author_url": "",
      "post_date": "2019-08-12T20:52:56.420000",
      "content": "<p>I can empathize:\nFor various reasons I prefer to use R as my \"base of operations\" for Kaggle contests rather than Python, although I can get to Python (3.6) from R if I need to via the \"reticulate\" package.   In addition to other machine learning tools like lightgbm, xgboost, etc., R has packages that expose the keras and tensorflow APIs directly, although I think they use reticulate to accomplish this.  It all works as long as the components (Ubuntu OS, my R installation, the R packages for keras and tensorflow, my Python installation,  the Python modules for keras and tensorflow, and cuda for the GPU) all play nice together.  But an innocent looking but incompatible update to any one of these can break the toolchain.  I ran into this several days ago with keras and tensorflow, which started issuing mysterious error messages about class and method incompatibilities involving my model objects.  After many hours of testing, updating, and more testing, including installing a development Github version of R keras, I finally got the whole thing working again.  During that pitched and gory battle there were dark times when I wasn't sure I would emerge the victor, but somewhere inside of me I knew from long experience that persistence and grit should eventually win out.  Reminds me of that expression: \"What doesn't kill you makes you stronger\".</p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 595986,
      "author_name": "Jiwei Liu",
      "author_url": "",
      "post_date": "2019-08-10T00:18:09.620000",
      "content": "<p>I forced myself to use kaggle dockers and pull their latest changes. Of course we have an internal version with our rapids software. Here is our PR <a href=\"https://github.com/Kaggle/docker-python/pull/595\">https://github.com/Kaggle/docker-python/pull/595</a></p>",
      "votes": 2,
      "replies": []
    },
    {
      "id": 595510,
      "author_name": "olivier",
      "author_url": "",
      "post_date": "2019-08-09T09:55:17.830000",
      "content": "<p>Sorry to hear that <a href=\"/cpmpml\">@cpmpml</a>  ... but a fresh install may mean more upside subs to come for you guys ;-) </p>",
      "votes": 0,
      "replies": [
        {
          "id": 595560,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-08-09T11:25:21.137000",
          "content": "<p>Thanks.  If only refreshing versions  were enough to improve model performances... ;)</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 597674,
      "author_name": "agenlu",
      "author_url": "",
      "post_date": "2019-08-12T16:40:40.063000",
      "content": "<p>Sorry for being off topic, but what IDE do you people use for Python?</p>",
      "votes": 0,
      "replies": [
        {
          "id": 597684,
          "author_name": "somnambWl",
          "author_url": "",
          "post_date": "2019-08-12T16:54:29.973000",
          "content": "<p>Currently, I use just Jupyter notebooks and Vim.</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 596496,
      "author_name": "Ingus T",
      "author_url": "",
      "post_date": "2019-08-10T18:13:01.157000",
      "content": "<p>I haven't done this yet, but it's definitely possible.</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 595946,
      "author_name": "Firat Gonen",
      "author_url": "",
      "post_date": "2019-08-09T22:22:24.530000",
      "content": "<p>happens!</p>",
      "votes": 0,
      "replies": []
    },
    {
      "id": 598032,
      "author_name": "",
      "author_url": "",
      "post_date": "2019-08-13T03:09:16.480000",
      "content": "",
      "votes": 0,
      "replies": []
    },
    {
      "id": 595744,
      "author_name": "",
      "author_url": "",
      "post_date": "2019-08-09T15:49:31.683000",
      "content": "",
      "votes": 4,
      "replies": [
        {
          "id": 595757,
          "author_name": "CPMP",
          "author_url": "",
          "post_date": "2019-08-09T16:10:27.290000",
          "content": "<p>Exactly, I have no excuse ;)</p>",
          "votes": 0,
          "replies": []
        },
        {
          "id": 595972,
          "author_name": "Grzegorz Sionkowski",
          "author_url": "",
          "post_date": "2019-08-09T23:16:47.733000",
          "content": "<p>The irony is that a similar effect you can obtain updating conda. The only difference is that someone who does not like Python does not repair it in several hours.</p>",
          "votes": 2,
          "replies": []
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "595455": "Late at night, you're tired, and you don't create a new conda env when installing something.  And you did not notice this install also installs a new Python version.  From then, nothing works anymore, notebooks don't start, etc...\n\nIt happened to me last night, and I spent several hours reinstalling a clean python stack.  \n\nSure, it could have been worse, it could have happened 2 days before competition end...\n\nThe good side is that I have an up to date machine.\n\nLet's go back to competing.",
    "596107": "![](https://i.imgflip.com/37ohix.jpg)",
    "595461": "Keep calm. \nBrew some coffee. \nWait for it's kicking in.\n\n&gt; Let's go back to competing.",
    "596937": "Already done it! I ended up having to compile tensorflow from source an absolute joy - swearbox is now full ;(\n\nI am not that impressed with this conda",
    "595706": "Docker for life :)",
    "595470": "If you use btrfs try snapper.io it has saved my life wiping my whole home directory",
    "597872": "I can empathize:\nFor various reasons I prefer to use R as my \"base of operations\" for Kaggle contests rather than Python, although I can get to Python (3.6) from R if I need to via the \"reticulate\" package.   In addition to other machine learning tools like lightgbm, xgboost, etc., R has packages that expose the keras and tensorflow APIs directly, although I think they use reticulate to accomplish this.  It all works as long as the components (Ubuntu OS, my R installation, the R packages for keras and tensorflow, my Python installation,  the Python modules for keras and tensorflow, and cuda for the GPU) all play nice together.  But an innocent looking but incompatible update to any one of these can break the toolchain.  I ran into this several days ago with keras and tensorflow, which started issuing mysterious error messages about class and method incompatibilities involving my model objects.  After many hours of testing, updating, and more testing, including installing a development Github version of R keras, I finally got the whole thing working again.  During that pitched and gory battle there were dark times when I wasn't sure I would emerge the victor, but somewhere inside of me I knew from long experience that persistence and grit should eventually win out.  Reminds me of that expression: \"What doesn't kill you makes you stronger\".",
    "595986": "I forced myself to use kaggle dockers and pull their latest changes. Of course we have an internal version with our rapids software. Here is our PR https://github.com/Kaggle/docker-python/pull/595",
    "595510": "Sorry to hear that @cpmpml  ... but a fresh install may mean more upside subs to come for you guys ;-) ",
    "597674": "Sorry for being off topic, but what IDE do you people use for Python?",
    "596496": "I haven't done this yet, but it's definitely possible.",
    "595946": "happens!",
    "598032": "",
    "595744": ""
  }
}