{
  "id": 666727,
  "title": "metric issues",
  "url": "/competitions/deep-past-initiative-machine-translation/discussion/666727",
  "author_name": "",
  "post_date": "2026-01-08T18:30:15.573009200Z",
  "votes": null,
  "comment_count": 3,
  "views": 0,
  "content": "<p>Everyone's chrf and Bleu scores are around 40-50, but our training scores are around 4.9-5.4. Which metric are you using? </p>",
  "messages": [
    {
      "id": "3388395",
      "postDate": "01/08/2026 18:30:15",
      "content": "<p>Everyone's chrf and Bleu scores are around 40-50, but our training scores are around 4.9-5.4. Which metric are you using? </p>",
      "rawMarkdown": "Everyone's chrf and Bleu scores are around 40-50, but our training scores are around 4.9-5.4. Which metric are you using?",
      "votes": null
    },
    {
      "id": "3388404",
      "postDate": "01/08/2026 18:40:47",
      "content": "<p>The default parameter for generate() function is only generate 20 tokens. You should try increase the max length.</p>",
      "rawMarkdown": "The default parameter for generate() function is only generate 20 tokens. You should try increase the max length.",
      "votes": null
    },
    {
      "id": "3388405",
      "postDate": "01/08/2026 18:42:51",
      "content": "<p>I am currently using max_length = 512. What do you think I should set it to?</p>",
      "rawMarkdown": "I am currently using max_length = 512. What do you think I should set it to?",
      "votes": null
    },
    {
      "id": "3388406",
      "postDate": "01/08/2026 18:45:28",
      "content": "<p>I suppose you are using Seq2SeqTrainingArguments, predict_with_generate only generate 20 tokens by default. You should try adding generation_max_length=512.</p>",
      "rawMarkdown": "I suppose you are using Seq2SeqTrainingArguments, predict_with_generate only generate 20 tokens by default. You should try adding generation_max_length=512.",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 3388404,
      "author_name": "dunglt",
      "author_url": "",
      "post_date": "01/08/2026 18:40:47",
      "content": "<p>The default parameter for generate() function is only generate 20 tokens. You should try increase the max length.</p>",
      "votes": null,
      "replies": [
        {
          "id": 3388405,
          "author_name": "ulasdesouza",
          "author_url": "",
          "post_date": "01/08/2026 18:42:51",
          "content": "<p>I am currently using max_length = 512. What do you think I should set it to?</p>",
          "votes": null,
          "replies": [
            {
              "id": 3388406,
              "author_name": "dunglt",
              "author_url": "",
              "post_date": "01/08/2026 18:45:28",
              "content": "<p>I suppose you are using Seq2SeqTrainingArguments, predict_with_generate only generate 20 tokens by default. You should try adding generation_max_length=512.</p>",
              "votes": null,
              "replies": []
            }
          ]
        }
      ]
    }
  ],
  "raw_markdown_by_id": {
    "3388395": "Everyone's chrf and Bleu scores are around 40-50, but our training scores are around 4.9-5.4. Which metric are you using?",
    "3388404": "The default parameter for generate() function is only generate 20 tokens. You should try increase the max length.",
    "3388405": "I am currently using max_length = 512. What do you think I should set it to?",
    "3388406": "I suppose you are using Seq2SeqTrainingArguments, predict_with_generate only generate 20 tokens by default. You should try adding generation_max_length=512."
  },
  "source": "meta"
}