{
  "id": 433921,
  "title": "T5 residual embeds for further experiments",
  "url": "/competitions/cafa-5-protein-function-prediction/discussion/433921",
  "author_name": "Ogurtsov",
  "post_date": "2023-08-23T12:05:20.580000",
  "votes": 5,
  "comment_count": 0,
  "views": 0,
  "content": "<p>We didn't get any success with residual-level embeds, but maybe someone will be more fortunate.</p>\n<p><a href=\"https://www.kaggle.com/code/ogurtsov/cafa5-train-proteins-t5-residual-embeds/notebook\" target=\"_blank\">CAFA5 train proteins - T5 residual embeds</a></p>\n<p><a href=\"https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-1-150000\" target=\"_blank\">CAFA5 T5 embeds, part 1 (1…50000)</a></p>\n<p><a href=\"https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-2-50001100000\" target=\"_blank\">CAFA5 T5 embeds, part 2 (50001…100000)</a></p>\n<p><a href=\"https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-3-100001142246\" target=\"_blank\">CAFA5 T5 embeds, part 3 (100001…142246)</a></p>\n<p>(train proteins only, <code>max_length=1000</code>)</p>",
  "messages": [
    {
      "id": 2404646,
      "postDate": "2023-08-23T12:05:20.580Z",
      "content": "<p>We didn't get any success with residual-level embeds, but maybe someone will be more fortunate.</p>\n<p><a href=\"https://www.kaggle.com/code/ogurtsov/cafa5-train-proteins-t5-residual-embeds/notebook\" target=\"_blank\">CAFA5 train proteins - T5 residual embeds</a></p>\n<p><a href=\"https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-1-150000\" target=\"_blank\">CAFA5 T5 embeds, part 1 (1…50000)</a></p>\n<p><a href=\"https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-2-50001100000\" target=\"_blank\">CAFA5 T5 embeds, part 2 (50001…100000)</a></p>\n<p><a href=\"https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-3-100001142246\" target=\"_blank\">CAFA5 T5 embeds, part 3 (100001…142246)</a></p>\n<p>(train proteins only, <code>max_length=1000</code>)</p>",
      "rawMarkdown": "We didn't get any success with residual-level embeds, but maybe someone will be more fortunate.\n\n[CAFA5 train proteins - T5 residual embeds](https://www.kaggle.com/code/ogurtsov/cafa5-train-proteins-t5-residual-embeds/notebook)\n\n[CAFA5 T5 embeds, part 1 (1...50000)](https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-1-150000)\n\n[CAFA5 T5 embeds, part 2 (50001...100000)](https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-2-50001100000)\n\n[CAFA5 T5 embeds, part 3 (100001...142246)](https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-3-100001142246)\n\n(train proteins only, `max_length=1000`)",
      "votes": 5
    }
  ],
  "comments": [],
  "raw_markdown_by_id": {
    "2404646": "We didn't get any success with residual-level embeds, but maybe someone will be more fortunate.\n\n[CAFA5 train proteins - T5 residual embeds](https://www.kaggle.com/code/ogurtsov/cafa5-train-proteins-t5-residual-embeds/notebook)\n\n[CAFA5 T5 embeds, part 1 (1...50000)](https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-1-150000)\n\n[CAFA5 T5 embeds, part 2 (50001...100000)](https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-2-50001100000)\n\n[CAFA5 T5 embeds, part 3 (100001...142246)](https://www.kaggle.com/datasets/ogurtsov/cafa5-t5-embeds-part-3-100001142246)\n\n(train proteins only, `max_length=1000`)"
  }
}