{
  "id": 156997,
  "title": "Facebook's DE⫶TR: End-to-End Object Detection with Transformers",
  "url": "/competitions/global-wheat-detection/discussion/156997",
  "author_name": "SumitJha",
  "post_date": "2020-06-08T20:17:41.195000",
  "votes": 2,
  "comment_count": 4,
  "views": 0,
  "content": "<p>PyTorch training code and pre-trained models for DETR (DEtection TRansformer). <strong>We replace the full complex hand-crafted object detection pipeline with a Transformer, and match Faster R-CNN with a ResNet-50, obtaining 42 AP on COCO using half the computation power (FLOPs) and the same number of parameters. Inference in 50 lines of PyTorch.</strong></p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F505538%2F416961869a7be93dcc241afc243a82aa%2FDETR.png?generation=1591647223902151&amp;alt=media\" alt=\"\"></p>\n\n<p>DETR</p>\n\n<p>What it is. Unlike traditional computer vision techniques, DETR approaches object detection as a direct set prediction problem. It consists of a set-based global loss, which forces unique predictions via bipartite matching, and a Transformer encoder-decoder architecture. Given a fixed small set of learned object queries, DETR reasons about the relations of the objects and the global image context to directly output the final set of predictions in parallel. Due to this parallel nature, DETR is very fast and efficient.</p>\n\n<p>Github Code-\n<a href=\"https://github.com/facebookresearch/detr\">DETR</a></p>\n\n<p>Paper -\n<a href=\"https://ai.facebook.com/research/publications/end-to-end-object-detection-with-transformers\">https://ai.facebook.com/research/publications/end-to-end-object-detection-with-transformers</a></p>\n\n<p>Enjoy  working with Object Detection Models - MaskRCNN/Yolov4/DETR.</p>",
  "messages": [
    {
      "id": 878768,
      "postDate": "2020-06-08T20:17:41.197Z",
      "content": "<p>PyTorch training code and pre-trained models for DETR (DEtection TRansformer). <strong>We replace the full complex hand-crafted object detection pipeline with a Transformer, and match Faster R-CNN with a ResNet-50, obtaining 42 AP on COCO using half the computation power (FLOPs) and the same number of parameters. Inference in 50 lines of PyTorch.</strong></p>\n\n<p><img src=\"https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F505538%2F416961869a7be93dcc241afc243a82aa%2FDETR.png?generation=1591647223902151&amp;alt=media\" alt=\"\"></p>\n\n<p>DETR</p>\n\n<p>What it is. Unlike traditional computer vision techniques, DETR approaches object detection as a direct set prediction problem. It consists of a set-based global loss, which forces unique predictions via bipartite matching, and a Transformer encoder-decoder architecture. Given a fixed small set of learned object queries, DETR reasons about the relations of the objects and the global image context to directly output the final set of predictions in parallel. Due to this parallel nature, DETR is very fast and efficient.</p>\n\n<p>Github Code-\n<a href=\"https://github.com/facebookresearch/detr\">DETR</a></p>\n\n<p>Paper -\n<a href=\"https://ai.facebook.com/research/publications/end-to-end-object-detection-with-transformers\">https://ai.facebook.com/research/publications/end-to-end-object-detection-with-transformers</a></p>\n\n<p>Enjoy  working with Object Detection Models - MaskRCNN/Yolov4/DETR.</p>",
      "rawMarkdown": "PyTorch training code and pre-trained models for DETR (DEtection TRansformer). **We replace the full complex hand-crafted object detection pipeline with a Transformer, and match Faster R-CNN with a ResNet-50, obtaining 42 AP on COCO using half the computation power (FLOPs) and the same number of parameters. Inference in 50 lines of PyTorch.**\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F505538%2F416961869a7be93dcc241afc243a82aa%2FDETR.png?generation=1591647223902151&amp;alt=media)\n\nDETR\n\nWhat it is. Unlike traditional computer vision techniques, DETR approaches object detection as a direct set prediction problem. It consists of a set-based global loss, which forces unique predictions via bipartite matching, and a Transformer encoder-decoder architecture. Given a fixed small set of learned object queries, DETR reasons about the relations of the objects and the global image context to directly output the final set of predictions in parallel. Due to this parallel nature, DETR is very fast and efficient.\n\nGithub Code-\n[DETR](https://github.com/facebookresearch/detr)\n\nPaper -\nhttps://ai.facebook.com/research/publications/end-to-end-object-detection-with-transformers\n\nEnjoy  working with Object Detection Models - MaskRCNN/Yolov4/DETR.",
      "votes": 2
    },
    {
      "id": 878769,
      "postDate": "2020-06-08T20:19:55.043Z",
      "content": "<p>Been posted here twice already. I don't think it's very viable due to the computational requirements.</p>",
      "rawMarkdown": "Been posted here twice already. I don't think it's very viable due to the computational requirements.",
      "replies": [
        {
          "id": 878774,
          "postDate": "2020-06-08T20:28:33.543Z",
          "content": "<p>As FB Article says this model will take time to mature to detect small objects. I think some of the researcher will optimise the Code to reduce computational requirement. I lile the idea in taking Transformer into Object Detection. \nAnyways, I have not seen this here so posted it. Kaggle should run a model to check similarity of topic before submit. 😁 </p>",
          "rawMarkdown": "As FB Article says this model will take time to mature to detect small objects. I think some of the researcher will optimise the Code to reduce computational requirement. I lile the idea in taking Transformer into Object Detection. \nAnyways, I have not seen this here so posted it. Kaggle should run a model to check similarity of topic before submit. 😁 ",
          "votes": -2
        },
        {
          "id": 878789,
          "postDate": "2020-06-08T20:56:23.197Z",
          "content": "<p><strong>You</strong> should check similarity of topic before submit. 😁</p>\n\n<p>Nevertheless, the progress with transformers is astonishing and I am very interested in the results in the upcoming months</p>",
          "rawMarkdown": "**You** should check similarity of topic before submit. 😁\n\nNevertheless, the progress with transformers is astonishing and I am very interested in the results in the upcoming months",
          "votes": 1
        }
      ]
    },
    {
      "id": 1033978,
      "postDate": "2020-10-01T11:57:57.553Z",
      "rawMarkdown": "",
      "isDeleted": true
    }
  ],
  "comments": [
    {
      "id": 878769,
      "author_name": "Matt",
      "author_url": "",
      "post_date": "2020-06-08T20:19:55.043000",
      "content": "<p>Been posted here twice already. I don't think it's very viable due to the computational requirements.</p>",
      "votes": 0,
      "replies": [
        {
          "id": 878774,
          "author_name": "SumitJha",
          "author_url": "",
          "post_date": "2020-06-08T20:28:33.543000",
          "content": "<p>As FB Article says this model will take time to mature to detect small objects. I think some of the researcher will optimise the Code to reduce computational requirement. I lile the idea in taking Transformer into Object Detection. \nAnyways, I have not seen this here so posted it. Kaggle should run a model to check similarity of topic before submit. 😁 </p>",
          "votes": -2,
          "replies": []
        },
        {
          "id": 878789,
          "author_name": "Pascal Pfeiffer",
          "author_url": "",
          "post_date": "2020-06-08T20:56:23.197000",
          "content": "<p><strong>You</strong> should check similarity of topic before submit. 😁</p>\n\n<p>Nevertheless, the progress with transformers is astonishing and I am very interested in the results in the upcoming months</p>",
          "votes": 1,
          "replies": []
        }
      ]
    },
    {
      "id": 1033978,
      "author_name": "",
      "author_url": "",
      "post_date": "2020-10-01T11:57:57.553000",
      "content": "",
      "votes": 0,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "878768": "PyTorch training code and pre-trained models for DETR (DEtection TRansformer). **We replace the full complex hand-crafted object detection pipeline with a Transformer, and match Faster R-CNN with a ResNet-50, obtaining 42 AP on COCO using half the computation power (FLOPs) and the same number of parameters. Inference in 50 lines of PyTorch.**\n\n![](https://www.googleapis.com/download/storage/v1/b/kaggle-user-content/o/inbox%2F505538%2F416961869a7be93dcc241afc243a82aa%2FDETR.png?generation=1591647223902151&amp;alt=media)\n\nDETR\n\nWhat it is. Unlike traditional computer vision techniques, DETR approaches object detection as a direct set prediction problem. It consists of a set-based global loss, which forces unique predictions via bipartite matching, and a Transformer encoder-decoder architecture. Given a fixed small set of learned object queries, DETR reasons about the relations of the objects and the global image context to directly output the final set of predictions in parallel. Due to this parallel nature, DETR is very fast and efficient.\n\nGithub Code-\n[DETR](https://github.com/facebookresearch/detr)\n\nPaper -\nhttps://ai.facebook.com/research/publications/end-to-end-object-detection-with-transformers\n\nEnjoy  working with Object Detection Models - MaskRCNN/Yolov4/DETR.",
    "878769": "Been posted here twice already. I don't think it's very viable due to the computational requirements.",
    "1033978": ""
  }
}