{
  "id": 172395,
  "title": "List of things that didn't work",
  "url": "/competitions/global-wheat-detection/discussion/172395",
  "author_name": "",
  "post_date": "2020-08-04T22:21:34.139952900Z",
  "votes": 12,
  "comment_count": 8,
  "views": 0,
  "content": "<p>For me the it's quite long.....</p>\n\n<ul>\n<li>mmdetection (only managed to get to 0.73, but I did not implement mixup/mosaic myself)</li>\n<li>Generalized Focal Loss</li>\n<li>Guided Anchoring</li>\n<li>DetectoRS/recursive feature pyramid</li>\n<li>Integral Loss (I tried to design a cascade architecture as well but it was too hard to optimize)</li>\n<li>Messing up with anchors/target assigners</li>\n<li>DIoU/CIoU Loss</li>\n<li>Reppoints V2</li>\n<li>FCOS</li>\n<li>ATSS</li>\n<li>Stitcher Augmentation</li>\n<li>DETR, or generally using a transformer as a feature encoder (I designed two models myself, none worked)</li>\n<li>FixMatch's detection variant (Also self-designed. I will try to make it work after the entire dataset is released and maybe write a tech report/paper)</li>\n<li>Autoaugment a la carte, meaning that I didn't search for the augmentations myself</li>\n<li>Consistency regularization based on feature maps in general</li>\n<li>SPIKE Dataset (I didn't use their labels; I re-pseudo-labelled the dataset myself)</li>\n<li>AdaBN</li>\n<li>NOH-NMS/Adaptive NMS</li>\n<li>Cluster NMS (takes too long and wasn't significantly different from batched nms)</li>\n<li>AdjNMS (won OID last year, but gives horrible results in this competition for some reason)</li>\n<li>Anything that is not COCO-pretrained entirely</li>\n<li>Exponential Weight Averaging</li>\n<li>CycleLR </li>\n<li>Free Anchor</li>\n<li>GHM/GHC Loss</li>\n</ul>\n\n<p>Also I suggest that the daily submission limit should be increased to 10-20 for a unstable dataset like this. In a way, public LB should be allowed to probed so that we can gauge the difference in distribution between test and train.</p>\n\n<p>You're welcomed to add more!</p>",
  "messages": [
    {
      "id": "958269",
      "postDate": "08/04/2020 22:21:34",
      "content": "<p>For me the it's quite long.....</p>\n\n<ul>\n<li>mmdetection (only managed to get to 0.73, but I did not implement mixup/mosaic myself)</li>\n<li>Generalized Focal Loss</li>\n<li>Guided Anchoring</li>\n<li>DetectoRS/recursive feature pyramid</li>\n<li>Integral Loss (I tried to design a cascade architecture as well but it was too hard to optimize)</li>\n<li>Messing up with anchors/target assigners</li>\n<li>DIoU/CIoU Loss</li>\n<li>Reppoints V2</li>\n<li>FCOS</li>\n<li>ATSS</li>\n<li>Stitcher Augmentation</li>\n<li>DETR, or generally using a transformer as a feature encoder (I designed two models myself, none worked)</li>\n<li>FixMatch's detection variant (Also self-designed. I will try to make it work after the entire dataset is released and maybe write a tech report/paper)</li>\n<li>Autoaugment a la carte, meaning that I didn't search for the augmentations myself</li>\n<li>Consistency regularization based on feature maps in general</li>\n<li>SPIKE Dataset (I didn't use their labels; I re-pseudo-labelled the dataset myself)</li>\n<li>AdaBN</li>\n<li>NOH-NMS/Adaptive NMS</li>\n<li>Cluster NMS (takes too long and wasn't significantly different from batched nms)</li>\n<li>AdjNMS (won OID last year, but gives horrible results in this competition for some reason)</li>\n<li>Anything that is not COCO-pretrained entirely</li>\n<li>Exponential Weight Averaging</li>\n<li>CycleLR </li>\n<li>Free Anchor</li>\n<li>GHM/GHC Loss</li>\n</ul>\n\n<p>Also I suggest that the daily submission limit should be increased to 10-20 for a unstable dataset like this. In a way, public LB should be allowed to probed so that we can gauge the difference in distribution between test and train.</p>\n\n<p>You're welcomed to add more!</p>",
      "rawMarkdown": "For me the it's quite long.....\n\n- mmdetection (only managed to get to 0.73, but I did not implement mixup/mosaic myself)\n- Generalized Focal Loss\n- Guided Anchoring\n- DetectoRS/recursive feature pyramid\n- Integral Loss (I tried to design a cascade architecture as well but it was too hard to optimize)\n- Messing up with anchors/target assigners\n- DIoU/CIoU Loss\n- Reppoints V2\n- FCOS\n- ATSS\n- Stitcher Augmentation\n- DETR, or generally using a transformer as a feature encoder (I designed two models myself, none worked)\n- FixMatch's detection variant (Also self-designed. I will try to make it work after the entire dataset is released and maybe write a tech report/paper)\n- Autoaugment a la carte, meaning that I didn't search for the augmentations myself\n- Consistency regularization based on feature maps in general\n- SPIKE Dataset (I didn't use their labels; I re-pseudo-labelled the dataset myself)\n- AdaBN\n- NOH-NMS/Adaptive NMS\n- Cluster NMS (takes too long and wasn't significantly different from batched nms)\n- AdjNMS (won OID last year, but gives horrible results in this competition for some reason)\n- Anything that is not COCO-pretrained entirely\n- Exponential Weight Averaging\n- CycleLR \n- Free Anchor\n- GHM/GHC Loss\n\nAlso I suggest that the daily submission limit should be increased to 10-20 for a unstable dataset like this. In a way, public LB should be allowed to probed so that we can gauge the difference in distribution between test and train.\n\nYou're welcomed to add more!",
      "votes": null
    },
    {
      "id": "958286",
      "postDate": "08/04/2020 22:56:12",
      "content": "<p>YoloV5</p>",
      "rawMarkdown": "YoloV5",
      "votes": null
    },
    {
      "id": "958290",
      "postDate": "08/04/2020 23:00:40",
      "content": "<p>Thanks, that's an impressive list. Also interested in what did work 😉 </p>",
      "rawMarkdown": "Thanks, that's an impressive list. Also interested in what did work 😉",
      "votes": null
    },
    {
      "id": "958303",
      "postDate": "08/04/2020 23:30:34",
      "content": "<p>For me, I was very very disappointed with yolov4. Reading some medium articles and such, yolov4 is supposedly both faster and more accurate than yolov5, but with WBF/TTA, I couldn't get higher than about 0.715 and with PL/OOF, 0.735. For how much time I put in creating the training pipeline as well as figuring out how to run Darknet (I had so much trouble running Darknet on Kaggle until someone helped me out) to get the licence compliant, I'm quite disappointed. Should've gone with FRCNN I guess. Great list, most of which I didn't even think about. </p>",
      "rawMarkdown": "For me, I was very very disappointed with yolov4. Reading some medium articles and such, yolov4 is supposedly both faster and more accurate than yolov5, but with WBF/TTA, I couldn't get higher than about 0.715 and with PL/OOF, 0.735. For how much time I put in creating the training pipeline as well as figuring out how to run Darknet (I had so much trouble running Darknet on Kaggle until someone helped me out) to get the licence compliant, I'm quite disappointed. Should've gone with FRCNN I guess. Great list, most of which I didn't even think about.",
      "votes": null
    },
    {
      "id": "958304",
      "postDate": "08/04/2020 23:32:42",
      "content": "<p>I didn't do much of what you mentioned. \n* YoloV3, V4\n* DetectoRS\n* LabelSmoothing\n* etc...</p>\n\n<p>I look forward to your solution.😊 </p>",
      "rawMarkdown": "I didn't do much of what you mentioned. \n* YoloV3, V4\n* DetectoRS\n* LabelSmoothing\n* etc...\n\nI look forward to your solution.😊",
      "votes": null
    },
    {
      "id": "958384",
      "postDate": "08/05/2020 00:40:32",
      "content": "<p>I am using CenterNet with EfficientNet b5 + BiFPN backbone. For me it's super short haha</p>\n\n<ol>\n<li>Pseudo label - it gives +0.0002 on private LB, but -0.003 on public, so I didn't select it as my final submission</li>\n<li>Backbones larger than b5 - I only tried efficientnet-b6 and it was worse than b5</li>\n<li>Ensemble too many folds - for me 3-fold WBF better than 5-fold. Wondering why</li>\n<li>Large batch by gradient accumulation</li>\n<li>EMA</li>\n</ol>",
      "rawMarkdown": "I am using CenterNet with EfficientNet b5 + BiFPN backbone. For me it's super short haha\n\n1. Pseudo label - it gives +0.0002 on private LB, but -0.003 on public, so I didn't select it as my final submission\n2. Backbones larger than b5 - I only tried efficientnet-b6 and it was worse than b5\n3. Ensemble too many folds - for me 3-fold WBF better than 5-fold. Wondering why\n4. Large batch by gradient accumulation\n5. EMA",
      "votes": null
    },
    {
      "id": "958409",
      "postDate": "08/05/2020 01:07:25",
      "content": "<p>After the shake? Nothing :(</p>",
      "rawMarkdown": "After the shake? Nothing :(",
      "votes": null
    },
    {
      "id": "958571",
      "postDate": "08/05/2020 04:06:34",
      "content": "",
      "rawMarkdown": "",
      "votes": null
    },
    {
      "id": "958587",
      "postDate": "08/05/2020 04:22:36",
      "content": "<p>in the end mmdet take top1)</p>",
      "rawMarkdown": "in the end mmdet take top1)",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 958286,
      "author_name": "jonykarki",
      "author_url": "",
      "post_date": "08/04/2020 22:56:12",
      "content": "<p>YoloV5</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 958290,
      "author_name": "datahobbit",
      "author_url": "",
      "post_date": "08/04/2020 23:00:40",
      "content": "<p>Thanks, that's an impressive list. Also interested in what did work 😉 </p>",
      "votes": null,
      "replies": [
        {
          "id": 958409,
          "author_name": "alexanderliao",
          "author_url": "",
          "post_date": "08/05/2020 01:07:25",
          "content": "<p>After the shake? Nothing :(</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 958303,
      "author_name": "stanleyjzheng",
      "author_url": "",
      "post_date": "08/04/2020 23:30:34",
      "content": "<p>For me, I was very very disappointed with yolov4. Reading some medium articles and such, yolov4 is supposedly both faster and more accurate than yolov5, but with WBF/TTA, I couldn't get higher than about 0.715 and with PL/OOF, 0.735. For how much time I put in creating the training pipeline as well as figuring out how to run Darknet (I had so much trouble running Darknet on Kaggle until someone helped me out) to get the licence compliant, I'm quite disappointed. Should've gone with FRCNN I guess. Great list, most of which I didn't even think about. </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 958304,
      "author_name": "piantic",
      "author_url": "",
      "post_date": "08/04/2020 23:32:42",
      "content": "<p>I didn't do much of what you mentioned. \n* YoloV3, V4\n* DetectoRS\n* LabelSmoothing\n* etc...</p>\n\n<p>I look forward to your solution.😊 </p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 958384,
      "author_name": "jihangz",
      "author_url": "",
      "post_date": "08/05/2020 00:40:32",
      "content": "<p>I am using CenterNet with EfficientNet b5 + BiFPN backbone. For me it's super short haha</p>\n\n<ol>\n<li>Pseudo label - it gives +0.0002 on private LB, but -0.003 on public, so I didn't select it as my final submission</li>\n<li>Backbones larger than b5 - I only tried efficientnet-b6 and it was worse than b5</li>\n<li>Ensemble too many folds - for me 3-fold WBF better than 5-fold. Wondering why</li>\n<li>Large batch by gradient accumulation</li>\n<li>EMA</li>\n</ol>",
      "votes": null,
      "replies": []
    },
    {
      "id": 958571,
      "author_name": "",
      "author_url": "",
      "post_date": "08/05/2020 04:06:34",
      "content": "",
      "votes": null,
      "replies": []
    },
    {
      "id": 958587,
      "author_name": "kupchanski",
      "author_url": "",
      "post_date": "08/05/2020 04:22:36",
      "content": "<p>in the end mmdet take top1)</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "958269": "For me the it's quite long.....\n\n- mmdetection (only managed to get to 0.73, but I did not implement mixup/mosaic myself)\n- Generalized Focal Loss\n- Guided Anchoring\n- DetectoRS/recursive feature pyramid\n- Integral Loss (I tried to design a cascade architecture as well but it was too hard to optimize)\n- Messing up with anchors/target assigners\n- DIoU/CIoU Loss\n- Reppoints V2\n- FCOS\n- ATSS\n- Stitcher Augmentation\n- DETR, or generally using a transformer as a feature encoder (I designed two models myself, none worked)\n- FixMatch's detection variant (Also self-designed. I will try to make it work after the entire dataset is released and maybe write a tech report/paper)\n- Autoaugment a la carte, meaning that I didn't search for the augmentations myself\n- Consistency regularization based on feature maps in general\n- SPIKE Dataset (I didn't use their labels; I re-pseudo-labelled the dataset myself)\n- AdaBN\n- NOH-NMS/Adaptive NMS\n- Cluster NMS (takes too long and wasn't significantly different from batched nms)\n- AdjNMS (won OID last year, but gives horrible results in this competition for some reason)\n- Anything that is not COCO-pretrained entirely\n- Exponential Weight Averaging\n- CycleLR \n- Free Anchor\n- GHM/GHC Loss\n\nAlso I suggest that the daily submission limit should be increased to 10-20 for a unstable dataset like this. In a way, public LB should be allowed to probed so that we can gauge the difference in distribution between test and train.\n\nYou're welcomed to add more!",
    "958286": "YoloV5",
    "958290": "Thanks, that's an impressive list. Also interested in what did work 😉",
    "958303": "For me, I was very very disappointed with yolov4. Reading some medium articles and such, yolov4 is supposedly both faster and more accurate than yolov5, but with WBF/TTA, I couldn't get higher than about 0.715 and with PL/OOF, 0.735. For how much time I put in creating the training pipeline as well as figuring out how to run Darknet (I had so much trouble running Darknet on Kaggle until someone helped me out) to get the licence compliant, I'm quite disappointed. Should've gone with FRCNN I guess. Great list, most of which I didn't even think about.",
    "958304": "I didn't do much of what you mentioned. \n* YoloV3, V4\n* DetectoRS\n* LabelSmoothing\n* etc...\n\nI look forward to your solution.😊",
    "958384": "I am using CenterNet with EfficientNet b5 + BiFPN backbone. For me it's super short haha\n\n1. Pseudo label - it gives +0.0002 on private LB, but -0.003 on public, so I didn't select it as my final submission\n2. Backbones larger than b5 - I only tried efficientnet-b6 and it was worse than b5\n3. Ensemble too many folds - for me 3-fold WBF better than 5-fold. Wondering why\n4. Large batch by gradient accumulation\n5. EMA",
    "958409": "After the shake? Nothing :(",
    "958571": "",
    "958587": "in the end mmdet take top1)"
  },
  "source": "meta"
}