{
  "id": 28117,
  "title": "ResNet-101 pytorch .05 example",
  "url": "/competitions/dogs-vs-cats-redux-kernels-edition/discussion/28117",
  "author_name": "",
  "post_date": "2017-01-25T17:04:56.307Z",
  "votes": 4,
  "comment_count": 4,
  "views": 93,
  "content": "<p><strong><a href=\"https://www.kaggle.com/nothxplz/dogs-vs-cats-redux-kernels-edition/cats-vs-dogs-05-pytorch-example\">Kernel</a></strong> and <a href=\"https://github.com/desimone/pytorch-cat-vs-dogs\">Github</a></p>\n\n<p>Have fun.</p>",
  "messages": [
    {
      "id": "158117",
      "postDate": "01/25/2017 17:04:56",
      "content": "<p><strong><a href=\"https://www.kaggle.com/nothxplz/dogs-vs-cats-redux-kernels-edition/cats-vs-dogs-05-pytorch-example\">Kernel</a></strong> and <a href=\"https://github.com/desimone/pytorch-cat-vs-dogs\">Github</a></p>\n\n<p>Have fun.</p>",
      "rawMarkdown": "**[Kernel][1]** and [Github][2]\r\n\r\nHave fun.\r\n\r\n  [1]: https://www.kaggle.com/nothxplz/dogs-vs-cats-redux-kernels-edition/cats-vs-dogs-05-pytorch-example\r\n  [2]: https://github.com/desimone/pytorch-cat-vs-dogs",
      "votes": null
    },
    {
      "id": "158201",
      "postDate": "01/26/2017 03:59:53",
      "content": "<p>it might be nice for you to introduce the torch package to the community and flush out what you are doing in your github (kernel is empty btw).</p>\n\n<p>Yes we can all go read up the docs, but having someone who knows it might be a big push to get people to adopt--it wasn't immediately clear in the code what was happening.</p>\n\n<p>Just a suggestion</p>",
      "rawMarkdown": "it might be nice for you to introduce the torch package to the community and flush out what you are doing in your github (kernel is empty btw).\r\n\r\nYes we can all go read up the docs, but having someone who knows it might be a big push to get people to adopt--it wasn't immediately clear in the code what was happening.\r\n\r\nJust a suggestion",
      "votes": null
    },
    {
      "id": "161562",
      "postDate": "02/14/2017 13:55:25",
      "content": "<p>Hey bdd, thanks for the code -- great to see pytorch getting some use here already. </p>\n\n<p>Did you test any of the other models that come included with torchvision or just res101? I was able to get a slight improvement from res152 and a few other tweaks (see <a href=\"https://github.com/rdcolema/pytorch-image-classification/blob/master/pytorch_model.ipynb\">here</a> for implementation) so just curious if you had any luck with other model architectures.  </p>",
      "rawMarkdown": "Hey bdd, thanks for the code -- great to see pytorch getting some use here already. \n\nDid you test any of the other models that come included with torchvision or just res101? I was able to get a slight improvement from res152 and a few other tweaks (see [here][1] for implementation) so just curious if you had any luck with other model architectures.  \n\n\n  [1]: https://github.com/rdcolema/pytorch-image-classification/blob/master/pytorch_model.ipynb",
      "votes": null
    },
    {
      "id": "161601",
      "postDate": "02/14/2017 19:51:27",
      "content": "<p>Glad it was useful. </p>\n\n<p>I did not try other models or data augmentation. I wanted to show a friend how to do model fine-tuning in pytorch, and at the time there were no examples. I considered spending some time trying to get further up the leaderboard, but spot-checked some of data and found many images are mislabeled. </p>",
      "rawMarkdown": "Glad it was useful. \n\nI did not try other models or data augmentation. I wanted to show a friend how to do model fine-tuning in pytorch, and at the time there were no examples. I considered spending some time trying to get further up the leaderboard, but spot-checked some of data and found many images are mislabeled.",
      "votes": null
    },
    {
      "id": "163727",
      "postDate": "02/25/2017 13:23:33",
      "content": "<p>Hello, I'm trying to reproduce your results in Caffe, I have successfully trained ResNet-101 by finetuning and on 80%-20% train-test split I get accuracy 99.4%, howewer in terms of LogLoss I can't get such good score as yours(my best score is ~0.14).</p>\n\n<p>As I see <a href=\"https://github.com/desimone/pytorch-cat-vs-dogs/blob/master/main.py#L139\">here</a> you use <code>CrossEntropyLoss</code> and I'm using <a href=\"http://caffe.berkeleyvision.org/doxygen/classcaffe_1_1SoftmaxWithLossLayer.html\">SoftmaxWithLoss</a>, seems they are the same, so maybe some other tricks were used?</p>\n\n<p><a href=\"https://github.com/mrgloom/kaggle-dogs-vs-cats-solution\">https://github.com/mrgloom/kaggle-dogs-vs-cats-solution</a></p>",
      "rawMarkdown": "Hello, I'm trying to reproduce your results in Caffe, I have successfully trained ResNet-101 by finetuning and on 80%-20% train-test split I get accuracy 99.4%, howewer in terms of LogLoss I can't get such good score as yours(my best score is ~0.14).\n\nAs I see [here][1] you use `CrossEntropyLoss` and I'm using [SoftmaxWithLoss][2], seems they are the same, so maybe some other tricks were used?\n\nhttps://github.com/mrgloom/kaggle-dogs-vs-cats-solution\n\n\n  [1]: https://github.com/desimone/pytorch-cat-vs-dogs/blob/master/main.py#L139\n  [2]: http://caffe.berkeleyvision.org/doxygen/classcaffe_1_1SoftmaxWithLossLayer.html",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 158201,
      "author_name": "rdslater",
      "author_url": "",
      "post_date": "01/26/2017 03:59:53",
      "content": "<p>it might be nice for you to introduce the torch package to the community and flush out what you are doing in your github (kernel is empty btw).</p>\n\n<p>Yes we can all go read up the docs, but having someone who knows it might be a big push to get people to adopt--it wasn't immediately clear in the code what was happening.</p>\n\n<p>Just a suggestion</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 161562,
      "author_name": "rdcolema",
      "author_url": "",
      "post_date": "02/14/2017 13:55:25",
      "content": "<p>Hey bdd, thanks for the code -- great to see pytorch getting some use here already. </p>\n\n<p>Did you test any of the other models that come included with torchvision or just res101? I was able to get a slight improvement from res152 and a few other tweaks (see <a href=\"https://github.com/rdcolema/pytorch-image-classification/blob/master/pytorch_model.ipynb\">here</a> for implementation) so just curious if you had any luck with other model architectures.  </p>",
      "votes": null,
      "replies": [
        {
          "id": 161601,
          "author_name": "nothxplz",
          "author_url": "",
          "post_date": "02/14/2017 19:51:27",
          "content": "<p>Glad it was useful. </p>\n\n<p>I did not try other models or data augmentation. I wanted to show a friend how to do model fine-tuning in pytorch, and at the time there were no examples. I considered spending some time trying to get further up the leaderboard, but spot-checked some of data and found many images are mislabeled. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 163727,
      "author_name": "mrgloom",
      "author_url": "",
      "post_date": "02/25/2017 13:23:33",
      "content": "<p>Hello, I'm trying to reproduce your results in Caffe, I have successfully trained ResNet-101 by finetuning and on 80%-20% train-test split I get accuracy 99.4%, howewer in terms of LogLoss I can't get such good score as yours(my best score is ~0.14).</p>\n\n<p>As I see <a href=\"https://github.com/desimone/pytorch-cat-vs-dogs/blob/master/main.py#L139\">here</a> you use <code>CrossEntropyLoss</code> and I'm using <a href=\"http://caffe.berkeleyvision.org/doxygen/classcaffe_1_1SoftmaxWithLossLayer.html\">SoftmaxWithLoss</a>, seems they are the same, so maybe some other tricks were used?</p>\n\n<p><a href=\"https://github.com/mrgloom/kaggle-dogs-vs-cats-solution\">https://github.com/mrgloom/kaggle-dogs-vs-cats-solution</a></p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "158117": "**[Kernel][1]** and [Github][2]\r\n\r\nHave fun.\r\n\r\n  [1]: https://www.kaggle.com/nothxplz/dogs-vs-cats-redux-kernels-edition/cats-vs-dogs-05-pytorch-example\r\n  [2]: https://github.com/desimone/pytorch-cat-vs-dogs",
    "158201": "it might be nice for you to introduce the torch package to the community and flush out what you are doing in your github (kernel is empty btw).\r\n\r\nYes we can all go read up the docs, but having someone who knows it might be a big push to get people to adopt--it wasn't immediately clear in the code what was happening.\r\n\r\nJust a suggestion",
    "161562": "Hey bdd, thanks for the code -- great to see pytorch getting some use here already. \n\nDid you test any of the other models that come included with torchvision or just res101? I was able to get a slight improvement from res152 and a few other tweaks (see [here][1] for implementation) so just curious if you had any luck with other model architectures.  \n\n\n  [1]: https://github.com/rdcolema/pytorch-image-classification/blob/master/pytorch_model.ipynb",
    "161601": "Glad it was useful. \n\nI did not try other models or data augmentation. I wanted to show a friend how to do model fine-tuning in pytorch, and at the time there were no examples. I considered spending some time trying to get further up the leaderboard, but spot-checked some of data and found many images are mislabeled.",
    "163727": "Hello, I'm trying to reproduce your results in Caffe, I have successfully trained ResNet-101 by finetuning and on 80%-20% train-test split I get accuracy 99.4%, howewer in terms of LogLoss I can't get such good score as yours(my best score is ~0.14).\n\nAs I see [here][1] you use `CrossEntropyLoss` and I'm using [SoftmaxWithLoss][2], seems they are the same, so maybe some other tricks were used?\n\nhttps://github.com/mrgloom/kaggle-dogs-vs-cats-solution\n\n\n  [1]: https://github.com/desimone/pytorch-cat-vs-dogs/blob/master/main.py#L139\n  [2]: http://caffe.berkeleyvision.org/doxygen/classcaffe_1_1SoftmaxWithLossLayer.html"
  },
  "source": "meta"
}