I guess now the question is how much of the private LB is yolov5?
\n\nDang... That was much rougher than I expected for my first competition. Oh well, I guess I just relearned the importance of having good CV. Trust CV, not public LB.
\n\nEdit: Biggest indicator of how many people using yolov5 are the positions of NVNN and Tereka. Tereka absolutely rocked the compliant leaderboards made by Matthew, yet ended up 77th, similarly to NVNN. I really hope Kaggle does something about this.
", "messages": [ { "id": 958313, "postDate": "2020-08-05T00:01:15.143Z", "content": "I guess now the question is how much of the private LB is yolov5?
\n\nDang... That was much rougher than I expected for my first competition. Oh well, I guess I just relearned the importance of having good CV. Trust CV, not public LB.
\n\nEdit: Biggest indicator of how many people using yolov5 are the positions of NVNN and Tereka. Tereka absolutely rocked the compliant leaderboards made by Matthew, yet ended up 77th, similarly to NVNN. I really hope Kaggle does something about this.
", "rawMarkdown": "I guess now the question is how much of the private LB is yolov5? \n\nDang... That was much rougher than I expected for my first competition. Oh well, I guess I just relearned the importance of having good CV. Trust CV, not public LB. \n\nEdit: Biggest indicator of how many people using yolov5 are the positions of NVNN and Tereka. Tereka absolutely rocked the compliant leaderboards made by Matthew, yet ended up 77th, similarly to NVNN. I really hope Kaggle does something about this.", "votes": 5 }, { "id": 958390, "postDate": "2020-08-05T00:45:29.703Z", "content": "what about me? from top 40 to 600 😃 , good lesson learned here.
", "rawMarkdown": "what about me? from top 40 to 600 😃 , good lesson learned here.", "votes": 3, "replies": [ { "id": 958397, "postDate": "2020-08-05T00:48:22.183Z", "rawMarkdown": "", "isDeleted": true } ] }, { "id": 958317, "postDate": "2020-08-05T00:07:00.420Z", "content": "Indeed. According to my compliant leaderboard, I was ranked >30th but now I am in the 600s on the private LB! I believe many of the top scorers unfortunately decided to use YoloV5.
\n\nEdit: I now know that if you didn't select a score, it will automatically select your highest score. So I'll give them the benefit of the doubt that they didn't intentionally break the rules. I still do hope Kaggle enforces the rule across the leaderboard
", "rawMarkdown": "Indeed. According to my compliant leaderboard, I was ranked >30th but now I am in the 600s on the private LB! I believe many of the top scorers unfortunately decided to use YoloV5.\n\nEdit: I now know that if you didn't select a score, it will automatically select your highest score. So I'll give them the benefit of the doubt that they didn't intentionally break the rules. I still do hope Kaggle enforces the rule across the leaderboard", "votes": 4, "replies": [ { "id": 958321, "postDate": "2020-08-05T00:09:04.527Z", "content": "Did u mean that yolov5 has been removed？
", "rawMarkdown": "Did u mean that yolov5 has been removed？" }, { "id": 958324, "postDate": "2020-08-05T00:09:51.590Z", "rawMarkdown": "", "isDeleted": true }, { "id": 958326, "postDate": "2020-08-05T00:10:47.880Z", "rawMarkdown": "", "isDeleted": true }, { "id": 958328, "postDate": "2020-08-05T00:11:37.533Z", "content": "@zekun98 YoloV5 is not allowed, though it appears to me that many decided to use it anyways. Kaggle will be inspecting the submissions and will likely disqualify those that used it.
", "rawMarkdown": "@zekun98 YoloV5 is not allowed, though it appears to me that many decided to use it anyways. Kaggle will be inspecting the submissions and will likely disqualify those that used it.", "votes": 2 }, { "id": 958329, "postDate": "2020-08-05T00:13:05.867Z", "content": "maybe your personal leaderboard lacks participation(only several ppl commented)
", "rawMarkdown": "maybe your personal leaderboard lacks participation(only several ppl commented)", "votes": 1 }, { "id": 958341, "postDate": "2020-08-05T00:16:21.267Z", "content": "@underwearfitting I understand not everyone participated and it's certainly an incomplete list. But I think it is also obvious that many have decided to submit with YoloV5.
", "rawMarkdown": "@underwearfitting I understand not everyone participated and it's certainly an incomplete list. But I think it is also obvious that many have decided to submit with YoloV5.", "votes": 1 }, { "id": 958342, "postDate": "2020-08-05T00:16:30.167Z", "content": "That may definitely be the case, but I think most of the competitors who were active on discussions posted (who are the same people who know yolov5 is banned). I also don't see there being 300 people who have compliant kernels but didn't post at all on the discussion. The biggest indicator is Tereka, who placed 77th after absolutely dominating the compliant LB.
", "rawMarkdown": "That may definitely be the case, but I think most of the competitors who were active on discussions posted (who are the same people who know yolov5 is banned). I also don't see there being 300 people who have compliant kernels but didn't post at all on the discussion. The biggest indicator is Tereka, who placed 77th after absolutely dominating the compliant LB. ", "votes": 2 }, { "id": 958343, "postDate": "2020-08-05T00:16:39.833Z", "content": "Oh，thanks
", "rawMarkdown": "Oh，thanks" } ] }, { "id": 958350, "postDate": "2020-08-05T00:20:05.257Z", "content": "I`m wonder how many top 0.7xxx solutions are yolo ...hmmm
", "rawMarkdown": "I`m wonder how many top 0.7xxx solutions are yolo ...hmmm", "votes": 1, "replies": [ { "id": 958354, "postDate": "2020-08-05T00:21:54.870Z", "rawMarkdown": "", "isDeleted": true } ] }, { "id": 958657, "postDate": "2020-08-05T05:26:15.913Z", "content": "Effdet performed poorly compared to YOLO v5 in the private LB. Here is a close comparison between this two from my submission:\n1. YOLO V5: Public- .7528 Private-.7021\n2. Effdet : Public- .7533 Private- .6693
\n\nMy biggest mistake in this competition was not having a strong CV and relied on Public LB. Learned a lot as a first-timer.
", "rawMarkdown": "Effdet performed poorly compared to YOLO v5 in the private LB. Here is a close comparison between this two from my submission:\n1. YOLO V5: Public- .7528 Private-.7021\n2. Effdet : Public- .7533 Private- .6693\n\nMy biggest mistake in this competition was not having a strong CV and relied on Public LB. Learned a lot as a first-timer. ", "votes": 2, "replies": [ { "id": 958672, "postDate": "2020-08-05T05:33:53.233Z", "rawMarkdown": "", "isDeleted": true } ] } ], "comments": [ { "id": 958390, "author_name": "Jacob", "author_url": "", "post_date": "2020-08-05T00:45:29.703000", "content": "what about me? from top 40 to 600 😃 , good lesson learned here.
", "votes": 3, "replies": [ { "id": 958397, "author_name": "", "author_url": "", "post_date": "2020-08-05T00:48:22.183000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 958317, "author_name": "Matt", "author_url": "", "post_date": "2020-08-05T00:07:00.420000", "content": "Indeed. According to my compliant leaderboard, I was ranked >30th but now I am in the 600s on the private LB! I believe many of the top scorers unfortunately decided to use YoloV5.
\n\nEdit: I now know that if you didn't select a score, it will automatically select your highest score. So I'll give them the benefit of the doubt that they didn't intentionally break the rules. I still do hope Kaggle enforces the rule across the leaderboard
", "votes": 4, "replies": [ { "id": 958321, "author_name": "HAaHAa", "author_url": "", "post_date": "2020-08-05T00:09:04.527000", "content": "Did u mean that yolov5 has been removed？
", "votes": 0, "replies": [] }, { "id": 958324, "author_name": "", "author_url": "", "post_date": "2020-08-05T00:09:51.590000", "content": "", "votes": 0, "replies": [] }, { "id": 958326, "author_name": "", "author_url": "", "post_date": "2020-08-05T00:10:47.880000", "content": "", "votes": 0, "replies": [] }, { "id": 958328, "author_name": "Matt", "author_url": "", "post_date": "2020-08-05T00:11:37.533000", "content": "@zekun98 YoloV5 is not allowed, though it appears to me that many decided to use it anyways. Kaggle will be inspecting the submissions and will likely disqualify those that used it.
", "votes": 2, "replies": [] }, { "id": 958329, "author_name": "sin", "author_url": "", "post_date": "2020-08-05T00:13:05.867000", "content": "maybe your personal leaderboard lacks participation(only several ppl commented)
", "votes": 1, "replies": [] }, { "id": 958341, "author_name": "Matt", "author_url": "", "post_date": "2020-08-05T00:16:21.267000", "content": "@underwearfitting I understand not everyone participated and it's certainly an incomplete list. But I think it is also obvious that many have decided to submit with YoloV5.
", "votes": 1, "replies": [] }, { "id": 958342, "author_name": "Stanley Zheng", "author_url": "", "post_date": "2020-08-05T00:16:30.167000", "content": "That may definitely be the case, but I think most of the competitors who were active on discussions posted (who are the same people who know yolov5 is banned). I also don't see there being 300 people who have compliant kernels but didn't post at all on the discussion. The biggest indicator is Tereka, who placed 77th after absolutely dominating the compliant LB.
", "votes": 2, "replies": [] }, { "id": 958343, "author_name": "HAaHAa", "author_url": "", "post_date": "2020-08-05T00:16:39.833000", "content": "Oh，thanks
", "votes": 0, "replies": [] } ] }, { "id": 958350, "author_name": "Marcin Czelej", "author_url": "", "post_date": "2020-08-05T00:20:05.257000", "content": "I`m wonder how many top 0.7xxx solutions are yolo ...hmmm
", "votes": 1, "replies": [ { "id": 958354, "author_name": "", "author_url": "", "post_date": "2020-08-05T00:21:54.870000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 958657, "author_name": "bendang", "author_url": "", "post_date": "2020-08-05T05:26:15.913000", "content": "Effdet performed poorly compared to YOLO v5 in the private LB. Here is a close comparison between this two from my submission:\n1. YOLO V5: Public- .7528 Private-.7021\n2. Effdet : Public- .7533 Private- .6693
\n\nMy biggest mistake in this competition was not having a strong CV and relied on Public LB. Learned a lot as a first-timer.
", "votes": 2, "replies": [ { "id": 958672, "author_name": "", "author_url": "", "post_date": "2020-08-05T05:33:53.233000", "content": "", "votes": 0, "replies": [] } ] } ], "raw_markdown_by_id": { "958313": "I guess now the question is how much of the private LB is yolov5? \n\nDang... That was much rougher than I expected for my first competition. Oh well, I guess I just relearned the importance of having good CV. Trust CV, not public LB. \n\nEdit: Biggest indicator of how many people using yolov5 are the positions of NVNN and Tereka. Tereka absolutely rocked the compliant leaderboards made by Matthew, yet ended up 77th, similarly to NVNN. I really hope Kaggle does something about this.", "958390": "what about me? from top 40 to 600 😃 , good lesson learned here.", "958317": "Indeed. According to my compliant leaderboard, I was ranked >30th but now I am in the 600s on the private LB! I believe many of the top scorers unfortunately decided to use YoloV5.\n\nEdit: I now know that if you didn't select a score, it will automatically select your highest score. So I'll give them the benefit of the doubt that they didn't intentionally break the rules. I still do hope Kaggle enforces the rule across the leaderboard", "958350": "I`m wonder how many top 0.7xxx solutions are yolo ...hmmm", "958657": "Effdet performed poorly compared to YOLO v5 in the private LB. Here is a close comparison between this two from my submission:\n1. YOLO V5: Public- .7528 Private-.7021\n2. Effdet : Public- .7533 Private- .6693\n\nMy biggest mistake in this competition was not having a strong CV and relied on Public LB. Learned a lot as a first-timer. " } }