{
  "id": 235068,
  "title": "GPU weekly limit is too little?",
  "url": "/competitions/coleridgeinitiative-show-us-the-data/discussion/235068",
  "author_name": "",
  "post_date": "2021-04-27T15:25:24.302829600Z",
  "votes": null,
  "comment_count": 12,
  "views": 0,
  "content": "<p>Hi,</p>\n<p>Every week we have 40 hours of GPU time, and we can send our notebook and use it in GPU for 9 hours. If we want to take advantage of that to train models, that means that we can send only 3 to 5 submissions per week.</p>\n<p>Are you guys having the same issue or am I missing something? How do you overcome that?</p>\n<p>Thanks</p>",
  "messages": [
    {
      "id": "1286113",
      "postDate": "04/27/2021 15:25:24",
      "content": "<p>Hi,</p>\n<p>Every week we have 40 hours of GPU time, and we can send our notebook and use it in GPU for 9 hours. If we want to take advantage of that to train models, that means that we can send only 3 to 5 submissions per week.</p>\n<p>Are you guys having the same issue or am I missing something? How do you overcome that?</p>\n<p>Thanks</p>",
      "rawMarkdown": "Hi,\n\nEvery week we have 40 hours of GPU time, and we can send our notebook and use it in GPU for 9 hours. If we want to take advantage of that to train models, that means that we can send only 3 to 5 submissions per week.\n\nAre you guys having the same issue or am I missing something? How do you overcome that?\n\nThanks",
      "votes": null
    },
    {
      "id": "1286156",
      "postDate": "04/27/2021 16:07:30",
      "content": "<p>Watch the time. Every minute of clock time equals 2 min of GPU time…</p>",
      "rawMarkdown": "Watch the time. Every minute of clock time equals 2 min of GPU time...",
      "votes": null
    },
    {
      "id": "1286195",
      "postDate": "04/27/2021 17:07:09",
      "content": "<p>what do you mean? i don't understand.</p>",
      "rawMarkdown": "what do you mean? i don't understand.",
      "votes": null
    },
    {
      "id": "1286263",
      "postDate": "04/27/2021 18:29:10",
      "content": "<p>You can send 5 submissions every day. The GPU usage is measured while you are training and when you save your model for predictions in the test data that only has 4 documents so it shouldnt last longer than 10 min to run. They re run your notebook on their servers with over 8000 documents but this doesn't consume your GPU usage</p>",
      "rawMarkdown": "You can send 5 submissions every day. The GPU usage is measured while you are training and when you save your model for predictions in the test data that only has 4 documents so it shouldnt last longer than 10 min to run. They re run your notebook on their servers with over 8000 documents but this doesn't consume your GPU usage",
      "votes": null
    },
    {
      "id": "1286274",
      "postDate": "04/27/2021 18:43:20",
      "content": "<p>Thanks, Carlos. So the idea here is to train models in an external place and then upload it as a dataset and test?</p>",
      "rawMarkdown": "Thanks, Carlos. So the idea here is to train models in an external place and then upload it as a dataset and test?",
      "votes": null
    },
    {
      "id": "1286398",
      "postDate": "04/28/2021 00:13:55",
      "content": "<p>Try google colab. You'll get extra time for free.</p>",
      "rawMarkdown": "Try google colab. You'll get extra time for free.",
      "votes": null
    },
    {
      "id": "1286581",
      "postDate": "04/28/2021 07:06:09",
      "content": "<p>Check your watch as the GPU is running and compare the readings</p>",
      "rawMarkdown": "Check your watch as the GPU is running and compare the readings",
      "votes": null
    },
    {
      "id": "1286767",
      "postDate": "04/28/2021 11:44:58",
      "content": "<p>Haven't noticed that, but will be checking it.</p>",
      "rawMarkdown": "Haven't noticed that, but will be checking it.",
      "votes": null
    },
    {
      "id": "1286779",
      "postDate": "04/28/2021 11:57:01",
      "content": "<p>Yes or train in one notebook and use the saved model in a second</p>",
      "rawMarkdown": "Yes or train in one notebook and use the saved model in a second",
      "votes": null
    },
    {
      "id": "1286883",
      "postDate": "04/28/2021 13:56:31",
      "content": "<p>That's because you are running 2 sessions. The interactive session and the session that you are committing.</p>",
      "rawMarkdown": "That's because you are running 2 sessions. The interactive session and the session that you are committing.",
      "votes": null
    },
    {
      "id": "1290345",
      "postDate": "05/01/2021 20:50:21",
      "content": "<p>Thanks for the explanation. So the 8000 documents doesn't consume the GPU limits. But does the time for predicting the 8000 documents count toward the 9 hour GPU limit?</p>",
      "rawMarkdown": "Thanks for the explanation. So the 8000 documents doesn't consume the GPU limits. But does the time for predicting the 8000 documents count toward the 9 hour GPU limit?",
      "votes": null
    },
    {
      "id": "1290349",
      "postDate": "05/01/2021 21:00:19",
      "content": "<p>Are we allowed to just upload a saved model?</p>",
      "rawMarkdown": "Are we allowed to just upload a saved model?",
      "votes": null
    },
    {
      "id": "1290374",
      "postDate": "05/01/2021 22:05:36",
      "content": "<p>Yes, from the competition requirements:</p>\n<p>Submissions to this competition must be made through Notebooks. In order for the \"Submit\" button to be active after a commit, the following conditions must be met:</p>\n<p>CPU Notebook &lt;= 9 hours run-time<br>\nGPU Notebook &lt;= 9 hours run-time<br>\nInternet access disabled<br>\n<strong>Freely &amp; publicly available external data is allowed, including pre-trained models</strong><br>\nSubmission file must be named submission.csv</p>",
      "rawMarkdown": "Yes, from the competition requirements:\n\nSubmissions to this competition must be made through Notebooks. In order for the \"Submit\" button to be active after a commit, the following conditions must be met:\n\nCPU Notebook <= 9 hours run-time\nGPU Notebook <= 9 hours run-time\nInternet access disabled\n**Freely & publicly available external data is allowed, including pre-trained models**\nSubmission file must be named submission.csv",
      "votes": null
    }
  ],
  "comments": [
    {
      "id": 1286156,
      "author_name": "georgem",
      "author_url": "",
      "post_date": "04/27/2021 16:07:30",
      "content": "<p>Watch the time. Every minute of clock time equals 2 min of GPU time…</p>",
      "votes": null,
      "replies": [
        {
          "id": 1286195,
          "author_name": "manuelsh",
          "author_url": "",
          "post_date": "04/27/2021 17:07:09",
          "content": "<p>what do you mean? i don't understand.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1286581,
          "author_name": "georgem",
          "author_url": "",
          "post_date": "04/28/2021 07:06:09",
          "content": "<p>Check your watch as the GPU is running and compare the readings</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1286767,
          "author_name": "manuelsh",
          "author_url": "",
          "post_date": "04/28/2021 11:44:58",
          "content": "<p>Haven't noticed that, but will be checking it.</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1286883,
          "author_name": "verracodeguacas",
          "author_url": "",
          "post_date": "04/28/2021 13:56:31",
          "content": "<p>That's because you are running 2 sessions. The interactive session and the session that you are committing.</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1286263,
      "author_name": "sneyderyepes",
      "author_url": "",
      "post_date": "04/27/2021 18:29:10",
      "content": "<p>You can send 5 submissions every day. The GPU usage is measured while you are training and when you save your model for predictions in the test data that only has 4 documents so it shouldnt last longer than 10 min to run. They re run your notebook on their servers with over 8000 documents but this doesn't consume your GPU usage</p>",
      "votes": null,
      "replies": [
        {
          "id": 1286274,
          "author_name": "manuelsh",
          "author_url": "",
          "post_date": "04/27/2021 18:43:20",
          "content": "<p>Thanks, Carlos. So the idea here is to train models in an external place and then upload it as a dataset and test?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1286779,
          "author_name": "hamishdickson",
          "author_url": "",
          "post_date": "04/28/2021 11:57:01",
          "content": "<p>Yes or train in one notebook and use the saved model in a second</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1290345,
          "author_name": "willyboy1",
          "author_url": "",
          "post_date": "05/01/2021 20:50:21",
          "content": "<p>Thanks for the explanation. So the 8000 documents doesn't consume the GPU limits. But does the time for predicting the 8000 documents count toward the 9 hour GPU limit?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1290349,
          "author_name": "willyboy1",
          "author_url": "",
          "post_date": "05/01/2021 21:00:19",
          "content": "<p>Are we allowed to just upload a saved model?</p>",
          "votes": null,
          "replies": []
        },
        {
          "id": 1290374,
          "author_name": "sneyderyepes",
          "author_url": "",
          "post_date": "05/01/2021 22:05:36",
          "content": "<p>Yes, from the competition requirements:</p>\n<p>Submissions to this competition must be made through Notebooks. In order for the \"Submit\" button to be active after a commit, the following conditions must be met:</p>\n<p>CPU Notebook &lt;= 9 hours run-time<br>\nGPU Notebook &lt;= 9 hours run-time<br>\nInternet access disabled<br>\n<strong>Freely &amp; publicly available external data is allowed, including pre-trained models</strong><br>\nSubmission file must be named submission.csv</p>",
          "votes": null,
          "replies": []
        }
      ]
    },
    {
      "id": 1286398,
      "author_name": "verracodeguacas",
      "author_url": "",
      "post_date": "04/28/2021 00:13:55",
      "content": "<p>Try google colab. You'll get extra time for free.</p>",
      "votes": null,
      "replies": []
    }
  ],
  "raw_markdown_by_id": {
    "1286113": "Hi,\n\nEvery week we have 40 hours of GPU time, and we can send our notebook and use it in GPU for 9 hours. If we want to take advantage of that to train models, that means that we can send only 3 to 5 submissions per week.\n\nAre you guys having the same issue or am I missing something? How do you overcome that?\n\nThanks",
    "1286156": "Watch the time. Every minute of clock time equals 2 min of GPU time...",
    "1286195": "what do you mean? i don't understand.",
    "1286263": "You can send 5 submissions every day. The GPU usage is measured while you are training and when you save your model for predictions in the test data that only has 4 documents so it shouldnt last longer than 10 min to run. They re run your notebook on their servers with over 8000 documents but this doesn't consume your GPU usage",
    "1286274": "Thanks, Carlos. So the idea here is to train models in an external place and then upload it as a dataset and test?",
    "1286398": "Try google colab. You'll get extra time for free.",
    "1286581": "Check your watch as the GPU is running and compare the readings",
    "1286767": "Haven't noticed that, but will be checking it.",
    "1286779": "Yes or train in one notebook and use the saved model in a second",
    "1286883": "That's because you are running 2 sessions. The interactive session and the session that you are committing.",
    "1290345": "Thanks for the explanation. So the 8000 documents doesn't consume the GPU limits. But does the time for predicting the 8000 documents count toward the 9 hour GPU limit?",
    "1290349": "Are we allowed to just upload a saved model?",
    "1290374": "Yes, from the competition requirements:\n\nSubmissions to this competition must be made through Notebooks. In order for the \"Submit\" button to be active after a commit, the following conditions must be met:\n\nCPU Notebook <= 9 hours run-time\nGPU Notebook <= 9 hours run-time\nInternet access disabled\n**Freely & publicly available external data is allowed, including pre-trained models**\nSubmission file must be named submission.csv"
  },
  "source": "meta"
}