{
  "id": 170888,
  "title": "Optimizer: Rectified Adam (RAdam). Improve your AI accuracy",
  "url": "/competitions/global-wheat-detection/discussion/170888",
  "author_name": "",
  "post_date": "2020-07-29T12:22:58.053630900Z",
  "votes": 5,
  "comment_count": 8,
  "views": 0,
  "content": "<p>\nI have tested RAdam myself inside the Effdet B7, and quickly achieved new high accuracy records.</p>",
  "messages": [
    {
      "id": "950476",
      "postDate": "07/29/2020 12:22:58",
      "content": "<p>\nI have tested RAdam myself inside the Effdet B7, and quickly achieved new high accuracy records.</p>",
      "rawMarkdown": "![radam](https://miro.medium.com/max/700/1*BMwu8Km-CtPsvaH8OM5_-g.jpeg)\nI have tested RAdam myself inside the Effdet B7, and quickly achieved new high accuracy records.",
      "votes": null
    },
    {
      "id": "950546",
      "postDate": "07/29/2020 13:12:11",
      "content": "<p>Thanks for sharing. I have a question. Why ur model have huge improve after epoch 80?</p>",
      "rawMarkdown": "Thanks for sharing. I have a question. Why ur model have huge improve after epoch 80?",
      "votes": null
    },
    {
      "id": "950548",
      "postDate": "07/29/2020 13:13:48",
      "content": "<p>Thanks for the trick. I will try it too.</p>",
      "rawMarkdown": "Thanks for the trick. I will try it too.",
      "votes": null
    },
    {
      "id": "950592",
      "postDate": "07/29/2020 13:37:34",
      "content": "<p>These plots are from RAdam paper. \n<a href=\"https://arxiv.org/pdf/1908.03265.pdf\">https://arxiv.org/pdf/1908.03265.pdf</a></p>",
      "rawMarkdown": "These plots are from RAdam paper. \nhttps://arxiv.org/pdf/1908.03265.pdf",
      "votes": null
    },
    {
      "id": "950611",
      "postDate": "07/29/2020 13:47:17",
      "content": "<p>yep. I don't have plot my loss but the result improve faster </p>",
      "rawMarkdown": "yep. I don't have plot my loss but the result improve faster",
      "votes": null
    },
    {
      "id": "950718",
      "postDate": "07/29/2020 15:10:11",
      "content": "<p>ranger?</p>",
      "rawMarkdown": "ranger?",
      "votes": null
    },
    {
      "id": "951174",
      "postDate": "07/30/2020 00:57:29",
      "content": "<p>Should its lr smaller than adam?</p>",
      "rawMarkdown": "Should its lr smaller than adam?",
      "votes": null
    },
    {
      "id": "951334",
      "postDate": "07/30/2020 04:35:47",
      "content": "<p>the same. </p>",
      "rawMarkdown": "the same.",
      "votes": null
    },
    {
      "id": "951464",
      "postDate": "07/30/2020 06:53:25",
      "content": "<p>RAdam, Ranger improved my CV but LB got worse in my case</p>",
      "rawMarkdown": "RAdam, Ranger improved my CV but LB got worse in my case",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 950546,
      "author_name": "lognat0704",
      "author_url": "",
      "post_date": "07/29/2020 13:12:11",
      "content": "<p>Thanks for sharing. I have a question. Why ur model have huge improve after epoch 80?</p>",
      "votes": null,
      "replies": [
        {
          "id": 950592,
          "author_name": "alexxx",
          "author_url": "",
          "post_date": "07/29/2020 13:37:34",
          "content": "<p>These plots are from RAdam paper. \n<a href=\"https://arxiv.org/pdf/1908.03265.pdf\">https://arxiv.org/pdf/1908.03265.pdf</a></p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 950611,
          "author_name": "doanquanvietnamca",
          "author_url": "",
          "post_date": "07/29/2020 13:47:17",
          "content": "<p>yep. I don't have plot my loss but the result improve faster </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 950548,
      "author_name": "kuohsintu",
      "author_url": "",
      "post_date": "07/29/2020 13:13:48",
      "content": "<p>Thanks for the trick. I will try it too.</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 950718,
      "author_name": "l4morak",
      "author_url": "",
      "post_date": "07/29/2020 15:10:11",
      "content": "<p>ranger?</p>",
      "votes": null,
      "replies": []
    },
    {
      "id": 951174,
      "author_name": "qq1623620766",
      "author_url": "",
      "post_date": "07/30/2020 00:57:29",
      "content": "<p>Should its lr smaller than adam?</p>",
      "votes": null,
      "replies": [
        {
          "id": 951334,
          "author_name": "doanquanvietnamca",
          "author_url": "",
          "post_date": "07/30/2020 04:35:47",
          "content": "<p>the same. </p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 951464,
      "author_name": "a2015003713",
      "author_url": "",
      "post_date": "07/30/2020 06:53:25",
      "content": "<p>RAdam, Ranger improved my CV but LB got worse in my case</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "950476": "![radam](https://miro.medium.com/max/700/1*BMwu8Km-CtPsvaH8OM5_-g.jpeg)\nI have tested RAdam myself inside the Effdet B7, and quickly achieved new high accuracy records.",
    "950546": "Thanks for sharing. I have a question. Why ur model have huge improve after epoch 80?",
    "950548": "Thanks for the trick. I will try it too.",
    "950592": "These plots are from RAdam paper. \nhttps://arxiv.org/pdf/1908.03265.pdf",
    "950611": "yep. I don't have plot my loss but the result improve faster",
    "950718": "ranger?",
    "951174": "Should its lr smaller than adam?",
    "951334": "the same.",
    "951464": "RAdam, Ranger improved my CV but LB got worse in my case"
  },
  "source": "meta"
}