![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F7902411%2F7a7d7b6e72d459326c9f4f3dc75c99ae%2FScreenshot%20from%202023-07-17%2005-45-57.png?generation=1689553084679185&alt=media\")
Ask questions about the 2023 Kaggle AI Report Competition in this thread for better visibility by the Kaggle Team. Please make sure that you have reviewed all of the pages on the competition overview, data, evaluation, submission instructions, and timeline pages prior to asking your questions!
", "messages": [ { "id": 2212483, "postDate": "2023-04-06T19:40:27.227Z", "content": "Ask questions about the 2023 Kaggle AI Report Competition in this thread for better visibility by the Kaggle Team. Please make sure that you have reviewed all of the pages on the competition overview, data, evaluation, submission instructions, and timeline pages prior to asking your questions!
", "rawMarkdown": "Ask questions about the 2023 Kaggle AI Report Competition in this thread for better visibility by the Kaggle Team. Please make sure that you have reviewed all of the pages on the competition [overview](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview), [data](https://www.kaggle.com/competitions/2023-kaggle-ai-report/data), [evaluation](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation), [submission instructions](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions), and [timeline](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline) pages prior to asking your questions! \n\n", "votes": 11 }, { "id": 2256215, "postDate": "2023-05-12T10:31:50.623Z", "content": "I don't have a question, but I do want to express that subjective evaluations in competitions category just dilutes competitions category. Perhaps a separate category for this analytics competitions would be better.
", "rawMarkdown": "I don't have a question, but I do want to express that subjective evaluations in competitions category just dilutes competitions category. Perhaps a separate category for this analytics competitions would be better.", "votes": 8, "replies": [ { "id": 2256326, "postDate": "2023-05-12T11:45:14.830Z", "content": "Thank you for the feedback, it is very much appreciated.
\nWe are trying to make this competition as objective as possible (for example, by bringing in an expert grading panel and by using a detailed evaluation rubric), and we still consider this competition to be \"skill-based\", but it is very valuable to hear additional perspectives as well.
", "rawMarkdown": "Thank you for the feedback, it is very much appreciated.\n\nWe are trying to make this competition as objective as possible (for example, by bringing in an expert grading panel and by using a detailed [evaluation rubric](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation)), and we still consider this competition to be \"skill-based\", but it is very valuable to hear additional perspectives as well.", "votes": 3, "replies": [ { "id": 2256527, "postDate": "2023-05-12T14:48:34.953Z", "content": "But the expert panel are other competitors, that is not necessarily objective.
", "rawMarkdown": "But the expert panel are other competitors, that is not necessarily objective.", "votes": 2 }, { "id": 2256547, "postDate": "2023-05-12T15:07:59.473Z", "content": "To clarify, the 7x Kaggle Grandmasters that make up the expert grading panel -- they are not allowed to compete in this competition. They were specifically selected because in addition to their expertise we also trust them to be fair graders. (The Kaggle Team will also participate and oversee the evaluation process.)
\nHopefully this alleviates some of your concerns. We were hoping to make this competition a low-risk experiment that we can learn from and make decisions from afterward.
", "rawMarkdown": "To clarify, the 7x Kaggle Grandmasters that make up the expert grading panel -- they are not allowed to compete in this competition. They were specifically selected because in addition to their expertise we also trust them to be fair graders. (The Kaggle Team will also participate and oversee the evaluation process.)\n\nHopefully this alleviates some of your concerns. We were hoping to make this competition a low-risk experiment that we can learn from and make decisions from afterward.", "votes": 2 }, { "id": 2256548, "postDate": "2023-05-12T15:09:55.467Z", "content": "But they are competing with us on the global leaderboard.
\n\n\nWe were hoping to make this competition a low-risk experiment that we can learn from and make decisions from afterward.
\n
Why not cut the points down heavily then? Keep in mind that winning such a competition solo gives close to 70k points and can inflate the global ranking by quite a bit.
\nAnyways, I also opened a separate discussion.
", "rawMarkdown": "But they are competing with us on the global leaderboard. \n\n> We were hoping to make this competition a low-risk experiment that we can learn from and make decisions from afterward.\n\nWhy not cut the points down heavily then? Keep in mind that winning such a competition solo gives close to 70k points and can inflate the global ranking by quite a bit.\n\nAnyways, I also opened a separate [discussion](https://www.kaggle.com/competitions/2023-kaggle-ai-report/discussion/409784).", "votes": 6 } ] } ] }, { "id": 2330387, "postDate": "2023-07-05T00:44:37Z", "content": "When can we expect the final results?
", "rawMarkdown": "When can we expect the final results?", "votes": 1, "replies": [ { "id": 2331370, "postDate": "2023-07-05T13:59:58.890Z", "content": "Final results will be released during the month of August
", "rawMarkdown": "Final results will be released during the month of August", "votes": 5 } ] }, { "id": 2322832, "postDate": "2023-06-29T14:17:29.870Z", "content": "I am seeing this alert, that indicates, \"Do not publish new notebooks during the final week of a competition\". Should we just ignore this alert?
", "rawMarkdown": "I am seeing this alert, that indicates, \"Do not publish new notebooks during the final week of a competition\". Should we just ignore this alert?", "votes": 1, "replies": [ { "id": 2322899, "postDate": "2023-06-29T15:03:17.277Z", "content": "Yes, please ignore that alert. We will remove the alert shortly, thank you for bringing it to our attention.
", "rawMarkdown": "Yes, please ignore that alert. We will remove the alert shortly, thank you for bringing it to our attention." } ] }, { "id": 2335801, "postDate": "2023-07-08T19:44:57.840Z", "content": "Hi,
\n@paultimothymooney I have a Question:
\nAs Paul mentioned below, we are not supposed to do that. However, it was not clear from the description. I've made an update in my notebook because I didn't have time to move drafts. I also was confident that we were supposed to update our notebooks because of the phrase \"Authors are encouraged to make updates in response to peer feedback received prior to the final submission deadline\". Nevertheless, after I saw Paul's comment under the same question, I did not change anything anymore. Only specified a category.
", "rawMarkdown": "As Paul mentioned below, we are not supposed to do that. However, it was not clear from the description. I've made an update in my notebook because I didn't have time to move drafts. I also was confident that we were supposed to update our notebooks because of the phrase \"Authors are encouraged to make updates in response to peer feedback received prior to the final submission deadline\". Nevertheless, after I saw Paul's comment under the same question, I did not change anything anymore. Only specified a category. ", "replies": [ { "id": 2335816, "postDate": "2023-07-08T20:13:38.740Z", "content": "Great, But I have seen some notebooks where the version I commented on and the new version have an entirely different structure and like heading, etc. So That's why I tagged him to confirm.
", "rawMarkdown": "Great, But I have seen some notebooks where the version I commented on and the new version have an entirely different structure and like heading, etc. So That's why I tagged him to confirm. " }, { "id": 2335817, "postDate": "2023-07-08T20:18:07.943Z", "content": "Now I understand why you are asking this question. If the notebooks are not eligible, then there is a risk that your feedback may not be eligible as well. Interesting.
", "rawMarkdown": "Now I understand why you are asking this question. If the notebooks are not eligible, then there is a risk that your feedback may not be eligible as well. Interesting.", "votes": 2 } ] }, { "id": 2335889, "postDate": "2023-07-08T23:07:47.943Z", "content": "A related comment. I do think that essays that get constructive feedback are at an advantage than the essays that have little to no feedback.
\nIf every essay received at least 3 reviews from the community then all participants could constructively work towards improving their essays. If you have little or no feedback, then your hands are kind of tied behind your back in terms of having the opportunity to modify the essay as per peer review comments.
\nAt the same time you are held accountable for providing feedback on at least 3 participants, who will have the opportunity to improve upon their essays since you gave them feedback but at the same time there is nothing you can do to your own essay since there was little to no feedback on your essay.
", "rawMarkdown": "A related comment. I do think that essays that get constructive feedback are at an advantage than the essays that have little to no feedback. \n\nIf every essay received at least 3 reviews from the community then all participants could constructively work towards improving their essays. If you have little or no feedback, then your hands are kind of tied behind your back in terms of having the opportunity to modify the essay as per peer review comments. \n\nAt the same time you are held accountable for providing feedback on at least 3 participants, who will have the opportunity to improve upon their essays since you gave them feedback but at the same time there is nothing you can do to your own essay since there was little to no feedback on your essay.", "votes": 1 }, { "id": 2336520, "postDate": "2023-07-09T12:14:04.883Z", "content": "Updates made after the 1st deadline should focus predominantly on addressing points that were raised during the peer-feedback period. The scope of the changes would then depend on the specific feedback received. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/peer-feedback-instructions.
", "rawMarkdown": "Updates made after the 1st deadline should focus predominantly on addressing points that were raised during the peer-feedback period. The scope of the changes would then depend on the specific feedback received. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/peer-feedback-instructions.", "votes": 1, "replies": [ { "id": 2343374, "postDate": "2023-07-13T16:05:44.840Z", "content": "Hi @paultimothymooney , Can you please help me out, I submitted my essay before the deadline and also made it public but it is not shown in the list you shared in any category.
", "rawMarkdown": "Hi @paultimothymooney , Can you please help me out, I submitted my essay before the deadline and also made it public but it is not shown in the list you shared in any category." } ] } ] }, { "id": 2327829, "postDate": "2023-07-03T07:37:04.240Z", "content": "1) Can I still submit new submission now, even when the deadline for making notebook publicly available for peer review is over?
\n2) What if I successfully provide 3 reviews to my peers but I do not get 3 peer reviews on my work? Would it affect my score?
", "rawMarkdown": "1) Can I still submit new submission now, even when the deadline for making notebook publicly available for peer review is over?\n\n2) What if I successfully provide 3 reviews to my peers but I do not get 3 peer reviews on my work? Would it affect my score?", "replies": [ { "id": 2330305, "postDate": "2023-07-04T22:23:40.550Z", "content": "1) Yes, you should make a final submission sometime between July 5 and July 16, where you update the submission.csv file to include the updated URLs that reference your 3x peer-feedback comments. This is in addition to needing to make the notebook that contains your essay public prior to July 5th in order to be eligible for the final prizes. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
\n2) That is fine, it does not affect your score, just make sure to make the notebook that contains your essay public prior to July 5th in order to make it visible during the peer-feedback period (July 5 to July 16). Making the notebook public prior to July 5th is also a requirement for being eligible for a prize.
", "rawMarkdown": "1) Yes, you should make a final submission sometime between July 5 and July 16, where you update the submission.csv file to include the updated URLs that reference your 3x peer-feedback comments. This is in addition to needing to make the notebook that contains your essay public prior to July 5th in order to be eligible for the final prizes. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.\n\n2) That is fine, it does not affect your score, just make sure to make the notebook that contains your essay public prior to July 5th in order to make it visible during the peer-feedback period (July 5 to July 16). Making the notebook public prior to July 5th is also a requirement for being eligible for a prize.", "replies": [ { "id": 2330329, "postDate": "2023-07-04T22:39:41.367Z", "rawMarkdown": "", "isDeleted": true }, { "id": 2332059, "postDate": "2023-07-06T00:03:15.027Z", "content": "From the Overview / Timeline:
\n\n\nJuly 5, 2023 - Start of the peer-feedback period
\n
\n You are required to make the notebook containing your essay public prior to this deadline
\n …
\n All submissions are evaluated after the deadline and all deadlines are at 11:59 PM UTC on the corresponding day unless otherwise noted.
\n …
From the previous post:
\n\n\nMaking the notebook public prior to July 5th is also a requirement for being eligible for a prize.
\n
To be eligible for a prize, was the deadline for making the notebook public July 4th at 11:59 PM UTC (\"prior to July 5th\"), or was it July 5th (\"the corresponding day\") at 11:59 PM UTC?
", "rawMarkdown": "From the [Overview / Timeline](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline):\n\n>July 5, 2023 - Start of the peer-feedback period\nYou are required to make the notebook containing your essay public prior to this deadline\n...\nAll submissions are evaluated after the deadline and all deadlines are at 11:59 PM UTC on the corresponding day unless otherwise noted.\n...\n\nFrom the previous post:\n\n>Making the notebook public prior to July 5th is also a requirement for being eligible for a prize.\n\n**To be eligible for a prize, was the deadline for making the notebook public July 4th at 11:59 PM UTC (\"prior to July 5th\"), or was it July 5th (\"the corresponding day\") at 11:59 PM UTC?**\n" }, { "id": 2332065, "postDate": "2023-07-06T00:09:55.853Z", "content": "All deadlines are at 11:59PM UTC. To be eligible for a prize, notebooks must have been made public prior to the July 5 11:59PM deadline.
\nFor more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
", "rawMarkdown": "All deadlines are at 11:59PM UTC. To be eligible for a prize, notebooks must have been made public prior to the July 5 11:59PM deadline.\n\nFor more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline." } ] } ] }, { "id": 2282592, "postDate": "2023-05-31T17:08:58.403Z", "content": "I saw in the rules, you must display parental consent if not at the age of 18. How would I go about this. I would really appreciate some clarification as I am not yet 18.
", "rawMarkdown": "I saw in the rules, you must display parental consent if not at the age of 18. How would I go about this. I would really appreciate some clarification as I am not yet 18. ", "votes": 2, "replies": [ { "id": 2282652, "postDate": "2023-05-31T18:08:39.057Z", "content": "You will need to fill out both of the following forms if you want to participate in this competition as a minor (prior to reaching the age of majority in your jurisdiction of residence):
\nThank you so much!
", "rawMarkdown": "Thank you so much!" } ] } ] }, { "id": 2271968, "postDate": "2023-05-24T08:04:50.713Z", "content": "Good day community, I recently joined this competition and as expected I have a number of questions.
\nMy first question is did I join the competition at a wrong time as the competition has been on for a couple of days now.
\nMy second question is a number of topics where listed and it was Indicated that the essay be written under these topics, my question here is does a competitor pick just a single topic or the essay be structured around these topics.
\nMy third and last question is how do I get paired with a team, and if I don't have a team can I compete solo?
\nThanks in anticipation to your favourable response.
Q1: We began promoting the launch of the competition just recently (May 19th), please do write an essay!
\nQ2: Each team should write a single essay focusing on a single topic. For additional details see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
\nQ3: Yes, you can compete solo. The most common team size will most likely be 1. There is no official pairing process.
\nHopefully that helps!
", "rawMarkdown": "Q1: We began promoting the launch of the competition just recently (May 19th), please do write an essay!\n\nQ2: Each team should write a single essay focusing on a single topic. For additional details see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.\n\nQ3: Yes, you can compete solo. The most common team size will most likely be 1. There is no official pairing process.\n\nHopefully that helps!", "votes": 1, "replies": [ { "id": 2272938, "postDate": "2023-05-24T21:08:08.140Z", "content": "Thank you so much, that would be all for now.
", "rawMarkdown": "Thank you so much, that would be all for now.", "votes": 1 } ] } ] }, { "id": 2258622, "postDate": "2023-05-14T11:03:57.507Z", "content": "Why is this part of the competitive track? What is so competitive in essay writing? It can be useful, educational, etc, but competitive?
", "rawMarkdown": "Why is this part of the competitive track? What is so competitive in essay writing? It can be useful, educational, etc, but competitive?", "votes": 2, "replies": [ { "id": 2260273, "postDate": "2023-05-15T15:16:53.437Z", "content": "In response to demand and feedback from prior analytics competitions this competition also pilots a format in which all eligible participants will be ranked on the leaderboard and awarded points . Results will show on your profile, just as in a standard competition. One idea that is being tested is to see if awarding points will motivate a level and quality of participation that exceeds what we have seen in prior analytics competitions on Kaggle. This is our first-ever analytics competition that offers points , and we're planning to debrief after this competition to see what we learned, what we can do better, etc.
", "rawMarkdown": "In response to demand and feedback from prior analytics competitions this competition also pilots a format in which all eligible participants will be ranked on the leaderboard and awarded points ~~and medals~~. Results will show on your profile, just as in a standard competition. One idea that is being tested is to see if awarding points ~~and medals~~ will motivate a level and quality of participation that exceeds what we have seen in prior analytics competitions on Kaggle. This is our first-ever analytics competition that offers points ~~and medals~~, and we're planning to debrief after this competition to see what we learned, what we can do better, etc.", "votes": 2, "replies": [ { "id": 2260648, "postDate": "2023-05-15T19:19:43.623Z", "content": "well it may motivate, but it should be in another type of competition
", "rawMarkdown": "well it may motivate, but it should be in another type of competition", "votes": 1 }, { "id": 2260863, "postDate": "2023-05-16T00:15:22.733Z", "content": "Since you're going to conduct a debrief (after concluding the competition), I just wanted to provide some feedback on \"the level of motivation\" from a kaggler(I think you are interested in hearing from us directly (since we are targeted by the motivation)).
\nThe evaluation method has already undergone significant improvement (moving from a host who announces the winners and honorable mentions (without any feedback or a comment) to a triple assessment system: 3 peer reviews + competition Kaggle GM + Kaggle staff) and scores. This is a significant advancement and it is encouraging (and really motivating).
\nBut the distribution of medals and points is what is most demotivating (paradoxical? : No): I explain it by saying that, compared to the medals the Kaggle community won in the leaderboard competitions, whatever medal I receive\"a hypothesis\"(in analytical ones) will not be well merited. To use a metaphor, consider it as a \"Shy Medal\" among \"Shiny Medals\"
\nAnother point on motivation: I decided to participate in the leaderboard competitions this year (I started with WIDS2023), and I will really start with featured competitions this end of summer-fall 2023 (I managed to release time…). Although I am extremely motivated to start this journey, I am now feeling a bit demotivated (a title in the competitions tier will become diluted, undeserved, and not as impressive as it once was and and it will not be credible either).
==> Kindly, keep this improvement in the assessment (even it is still human evaluation), I mean this new triple assessment + scores, because before, it was only a discussion on the winners announcement without any feedback (we didn't even know if the notebooks were seen or not…)=> so it is already a big step, but I don't think it's appropriate to award medals and points again or to undermine the current trustworthy ranking system. And consider the detrimental impact that this will have on leaderboard competitors' motivation in the future…
", "rawMarkdown": "Since you're going to conduct a debrief (after concluding the competition), I just wanted to provide some feedback on **\"the level of motivation\"** from a kaggler(I think you are interested in hearing from us directly (since we are targeted by the motivation)). \nThe evaluation method has already undergone significant improvement (moving from a host who announces the winners and honorable mentions (without any feedback or a comment) to a **triple assessment system**: 3 peer reviews + competition Kaggle GM + Kaggle staff) and scores. This is a significant advancement and it is encouraging (and really motivating). \nBut the distribution of medals and points is what is most demotivating (paradoxical? : No): I explain it by saying that, compared to the medals the Kaggle community won in the leaderboard competitions, whatever medal I receive\"a hypothesis\"(in analytical ones) will not be well merited. To use a metaphor, consider it as a **\"Shy Medal\"** among **\"Shiny Medals\"** \nAnother point on motivation: I decided to participate in the leaderboard competitions this year (I started with WIDS2023), and I will really start with featured competitions this end of summer-fall 2023 (I managed to release time...). Although I am extremely motivated to start this journey, I am now feeling a bit demotivated **(a title in the competitions tier will become diluted, undeserved, and not as impressive as it once was and and it will not be credible either)**.\n\n==> Kindly, keep this improvement in the assessment (even it is still human evaluation), I mean this new triple assessment + scores, because before, it was only a discussion on the winners announcement without any feedback (we didn't even know if the notebooks were seen or not...)=> so it is already a big step, but I don't think it's appropriate to award medals and points again or to **undermine the current trustworthy ranking system**. And consider the detrimental impact that this will have on leaderboard competitors' motivation in the future...", "votes": 1 }, { "id": 2261449, "postDate": "2023-05-16T10:28:40.863Z", "content": "To summarize for your future debrief:
\n\n\nQ: Why is this part of the competitive track?
\n
Because people who have participated in previous analytics competitions want to get competition points and medals without participating in real competition.
\n\n\nQ: What is so competitive in essay writing?
\n
?
\n\n\nAwarding points and medals will motivate a level and quality of participation that exceeds what we have seen in prior analytics competitions on Kaggle
\n
It probably will, because of a 'competition' status. What will happen if K starts to throw in everything in that category? Dont get me wrong, the idea of 'practical knowledge distillation' is extremely good, and kaggle is one of the few places that can get it done, but actual execution of that idea for me is questionable. Why not ask the community, for example psi come up with 'scientific journal' for kaggle, which sounds amazing to me
", "rawMarkdown": "To summarize for your future debrief: \n\n> Q: Why is this part of the competitive track? \n\nBecause people who have participated in previous analytics competitions want to get competition points and medals without participating in real competition.\n\n> Q: What is so competitive in essay writing? \n\n?\n\n> Awarding points and medals will motivate a level and quality of participation that exceeds what we have seen in prior analytics competitions on Kaggle\n\nIt probably will, because of a 'competition' status. What will happen if K starts to throw in everything in that category? Dont get me wrong, the idea of 'practical knowledge distillation' is extremely good, and kaggle is one of the few places that can get it done, but actual execution of that idea for me is questionable. Why not ask the community, for example psi come up with 'scientific journal' for kaggle, which sounds amazing to me", "votes": 1 }, { "id": 2285770, "postDate": "2023-06-03T01:52:26.353Z", "content": "How many types of competitions are there?
", "rawMarkdown": "How many types of competitions are there?" }, { "id": 2305658, "postDate": "2023-06-16T20:23:47.740Z", "rawMarkdown": "", "isDeleted": true }, { "id": 2305660, "postDate": "2023-06-16T20:26:41.050Z", "content": "Can you clarify the medals, Paul? The overview page says points, no medals. If there are medals, then will a solo gold count toward being a competition GM?
", "rawMarkdown": "Can you clarify the medals, Paul? The overview page says points, no medals. If there are medals, then will a solo gold count toward being a competition GM?" }, { "id": 2305666, "postDate": "2023-06-16T20:35:15.457Z", "content": "I agree, empty. Not that we need a 5th category, but I would prefer a separate Analytics category if there are going to be points and tiers, just like for ML comps, datasets, notebooks, discussions.
", "rawMarkdown": "I agree, empty. Not that we need a 5th category, but I would prefer a separate Analytics category if there are going to be points and tiers, just like for ML comps, datasets, notebooks, discussions." } ] } ] }, { "id": 2255798, "postDate": "2023-05-12T02:17:17.247Z", "content": "I noticed that Kaggle encourages participating team members to first submit a 'blank' template to indicate their desire to participate in the competition, but the 'sample_submission.csv' file of the instance is not sufficient to submit to LB. What are the specific requirements for submitting LB files?
", "rawMarkdown": "I noticed that Kaggle encourages participating team members to first submit a 'blank' template to indicate their desire to participate in the competition, but the 'sample_submission.csv' file of the instance is not sufficient to submit to LB. What are the specific requirements for submitting LB files?", "votes": 2, "replies": [ { "id": 2255821, "postDate": "2023-05-12T02:51:19.567Z", "content": "'sample_submission.csv' looks like this:
\n ,value\n essay_category,\n essay_url,\n feedback1_url,\n feedback2_url,\n feedback3_url,\nIf you submit this blank template you will show up on the leaderboard immediately, but then after the grading process you will get removed from the leaderboard (unless if you replace the empty URLs with real ones and then submit that new file to Kaggle).
\nIf you follow the eligibility guidelines and then upload a submission.csv file (where you have replaced these empty URLs with valid ones) then you will not get dropped from the final leaderboard.
As far as I understood from rules that, reviewing process will start after the competition deadline (please correct if my understanding is wrong).
\nI understand that we need to update essay_url with a public notebook that contains our essay before the deadline. However, what about the feedback1_url, feedback2_url and feedback3_url? Can these fields be left blank and updated after the deadline?
Thank you!
", "rawMarkdown": "@paultimothymooney, \n\nAs far as I understood from rules that, reviewing process will start after the competition deadline (please correct if my understanding is wrong). \n\nI understand that we need to update `essay_url` with a public notebook that contains our essay before the deadline. However, what about the `feedback1_url`, `feedback2_url` and `feedback3_url`? Can these fields be left blank and updated after the deadline?\n\nThank you!" }, { "id": 2324873, "postDate": "2023-07-01T00:20:25.727Z", "content": "The peer-feedback period begins on July 5th, at which point all of the essays from all of the participants in the competition will have been made public. You'll then need to both: (A) complete your 3x peer-feedback comments; and (B) update your submission.csv file to indicate the URLs corresponding with your 3x comments -- prior to the final deadline on July 16th. If you are submitting prior to actually completing your peer-feedback requirements then you can leave placeholder URLs in your submission.csv file until you are ready to replace the placeholder URLs with the real URLs that correspond with your 3x peer-feedback comments. Hopefully that helps!
\nSee the submission instrctions, the peer-feedback instructions, and the timeline page for more detail.
", "rawMarkdown": "The peer-feedback period begins on July 5th, at which point all of the essays from all of the participants in the competition will have been made public. You'll then need to both: (A) complete your 3x peer-feedback comments; and (B) update your submission.csv file to indicate the URLs corresponding with your 3x comments -- prior to the final deadline on July 16th. If you are submitting prior to actually completing your peer-feedback requirements then you can leave placeholder URLs in your submission.csv file until you are ready to replace the placeholder URLs with the real URLs that correspond with your 3x peer-feedback comments. Hopefully that helps!\n\nSee the [submission instrctions](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions), the [peer-feedback instructions](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/peer-feedback-instructions), and the [timeline page](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline) for more detail.", "votes": 1 }, { "id": 2330702, "postDate": "2023-07-05T06:35:31.293Z", "content": "can you tell me or give a link where it shows exactly how to submit with a csv file bex=cause this is my first time
", "rawMarkdown": "can you tell me or give a link where it shows exactly how to submit with a csv file bex=cause this is my first time" }, { "id": 2334501, "postDate": "2023-07-07T18:10:30.093Z", "rawMarkdown": "", "isDeleted": true } ] } ] }, { "id": 2392249, "postDate": "2023-08-15T14:56:25.720Z", "content": "Hi,
\nI have a question @paultimothymooney regarding my notebook, It was made public before the deadline and appears in the dataset, but it did not receive a score on the Leaderboard. Also all versions of submitted notebooks show error under submission tab. It would be greatly appreciated if you could provide insights into why this might have happened, as it would help me avoid making similar mistakes in the future
My notebook -link
", "rawMarkdown": "Hi, \nI have a question @paultimothymooney regarding my notebook, It was made public before the deadline and appears in the [dataset](https://www.kaggle.com/datasets/paultimothymooney/list-of-public-notebooks-ai-report-competition), but it did not receive a score on the Leaderboard. Also all versions of submitted notebooks show error under submission tab. It would be greatly appreciated if you could provide insights into why this might have happened, as it would help me avoid making similar mistakes in the future\n\nMy notebook -[link](https://www.kaggle.com/code/kavisekar/latest-development-in-time-series-analysis-report/notebook)" }, { "id": 2354953, "postDate": "2023-07-23T01:34:46.160Z", "content": "weird that the last version of my notebook(which i tried to submit before the deadline)couldn't generate the csv i needed to submit especially so when all of my peer review feedbacks were on that version. 😑
", "rawMarkdown": "weird that the last version of my notebook(which i tried to submit before the deadline)couldn't generate the csv i needed to submit especially so when all of my peer review feedbacks were on that version. 😑" }, { "id": 2352107, "postDate": "2023-07-20T16:29:05.487Z", "content": "Hello @paultimothymooney, are we still allowed to update our notebooks even after the final deadline? I noticed we can do that without having to submit again.
", "rawMarkdown": "Hello @paultimothymooney, are we still allowed to update our notebooks even after the final deadline? I noticed we can do that without having to submit again. " }, { "id": 2350439, "postDate": "2023-07-19T08:19:05.173Z", "content": "The version of the notebook i planned to submit was the 14th version. I ran it again , a minute before the deadline,(11:58)but having to deal with the errors took more time. The feedbacks were already there just couldn't get it to run and save the CSV. I thought about copying and pasting manually in the excel template but my excel has a product failure problem meaning I'd have to switch tabs to Google sheets so I went with the code version. Looks like the alternative might have been more ideal. Wouldn't have run into errors.
", "rawMarkdown": "The version of the notebook i planned to submit was the 14th version. I ran it again , a minute before the deadline,(11:58)but having to deal with the errors took more time. The feedbacks were already there just couldn't get it to run and save the CSV. I thought about copying and pasting manually in the excel template but my excel has a product failure problem meaning I'd have to switch tabs to Google sheets so I went with the code version. Looks like the alternative might have been more ideal. Wouldn't have run into errors.", "replies": [ { "id": 2350442, "postDate": "2023-07-19T08:21:18.947Z", "content": "Here's the link to the notebook to verify the time I ran it https://www.kaggle.com/competitions/2023-kaggle-ai-report
", "rawMarkdown": "Here's the link to the notebook to verify the time I ran it https://www.kaggle.com/competitions/2023-kaggle-ai-report", "replies": [ { "id": 2350447, "postDate": "2023-07-19T08:26:36.050Z", "content": "Yup same problem. I think it would be fair to consider the last run version of the notebook instead of the submitted version almost everyone has done the same mistake but they haven't realized it yet.
", "rawMarkdown": "Yup same problem. I think it would be fair to consider the last run version of the notebook instead of the submitted version almost everyone has done the same mistake but they haven't realized it yet." }, { "id": 2350540, "postDate": "2023-07-19T09:35:20.897Z", "content": "I agree. Notebooks that were run before the deadline in accordance with the rules should be accepted, because many of us have updated our notebooks but did not submit them. Of course I don't mean notebooks that were updated after the deadline.
", "rawMarkdown": "I agree. Notebooks that were run before the deadline in accordance with the rules should be accepted, because many of us have updated our notebooks but did not submit them. Of course I don't mean notebooks that were updated after the deadline." } ] } ] }, { "id": 2347463, "postDate": "2023-07-17T02:04:35.280Z", "content": "Hi @paultimothymooney similar case with the others too as for many of them its their first competition they don't know that we can submit each version to competition. Hence our request is to consider most most recent version of the recet submitted notebook… Hoping that they get a fair chance as it isn't their fault.
", "rawMarkdown": "Hi @paultimothymooney similar case with the others too as for many of them its their first competition they don't know that we can submit each version to competition. Hence our request is to consider most most recent version of the recet submitted notebook... Hoping that they get a fair chance as it isn't their fault.", "replies": [ { "id": 2347835, "postDate": "2023-07-17T08:30:01Z", "content": "@wcukierski please have a look into this matter. We are still confused. Whether most recent version before deadline is considered for submission or the the version which was submitted ??. Many of them submitted a version as a sample for peer evaluation thinking that the most recent version in that notebook will be considered automatically. We haven't submitted separately the recent one. Hence you can see that almost all of them have a single submission, where they have submitted once and they kept on editing the same notebook thinking that most recent version of that notebook will be considered for the evaluation. Please consider most recent version of the notebook before deadline, as most of them has put months of research and work and many of them are first time attendees of the kaggle competition. Although they have a very good essay they can't be eliminated due to misunderstanding of the rules.
", "rawMarkdown": "@wcukierski please have a look into this matter. We are still confused. Whether most recent version before deadline is considered for submission or the the version which was submitted ??. Many of them submitted a version as a sample for peer evaluation thinking that the most recent version in that notebook will be considered automatically. We haven't submitted separately the recent one. Hence you can see that almost all of them have a single submission, where they have submitted once and they kept on editing the same notebook thinking that most recent version of that notebook will be considered for the evaluation. Please consider most recent version of the notebook before deadline, as most of them has put months of research and work and many of them are first time attendees of the kaggle competition. Although they have a very good essay they can't be eliminated due to misunderstanding of the rules." }, { "id": 2349959, "postDate": "2023-07-18T20:13:38.533Z", "content": "Your most recent submission.csv file is the file that will be used to retrieve your essay URL and your peer feedback URLs. For additional detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
", "rawMarkdown": "Your most recent submission.csv file is the file that will be used to retrieve your essay URL and your peer feedback URLs. For additional detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions." } ] }, { "id": 2347429, "postDate": "2023-07-17T00:34:33.297Z", "content": "\nHello Paul,
\nThis is my first time to participate in analytics competition.
\nI have submitted a series:
\nI understand the deadline is 11:59pm UTC.
\nIs it correct that only version X will be used by the panel when judging but we may continue to improve the notebook for all other readers?
\nThanks a lot!
", "rawMarkdown": "@paultimothymooney \n\nHello Paul,\n\nThis is my first time to participate in analytics competition.\n\nI have submitted a series: \n- 11:55pm - version X\n- 11:59pm - version Y\n- 12:21am - version Z\n- ...\n\nI understand the deadline is 11:59pm UTC. \n\nIs it correct that only ****version X**** will be used by the panel when judging but we may continue to improve the notebook for all other readers?\n\nThanks a lot!", "replies": [ { "id": 2349954, "postDate": "2023-07-18T20:10:04.053Z", "content": "Your most recent submission.csv file is the file that will be used to retrieve your essay URL and your peer feedback URLs. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
", "rawMarkdown": "Your most recent submission.csv file is the file that will be used to retrieve your essay URL and your peer feedback URLs. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions." } ] }, { "id": 2347416, "postDate": "2023-07-17T00:10:05.200Z", "content": "Hi @paultimothymooney. I had a Notebook which i submitted as testing. I thought that it would be enough. Now 2 mins before competition ends when I saw the submissions it was still showing the old version of the same notebook. Even though I made 15 versions of it I didn't submit it as I thought submission of one version is enough whichever is the new version it will be considered for submission. When I submitted my new version 2mins before the deadline it took 21 secs to show up on the submission portal. What can I do Now. I've done research regarding this essays for weeks. I have clicked the submit button before the deadline but submission happened after deadline . Please consider my submisssion .
You can see from the image that my notebooks submission time is exactly the same as the time from deadline which is 17min ago.
", "rawMarkdown": "Hi @paultimothymooney. I had a Notebook which i submitted as testing. I thought that it would be enough. Now 2 mins before competition ends when I saw the submissions it was still showing the old version of the same notebook. Even though I made 15 versions of it I didn't submit it as I thought submission of one version is enough whichever is the new version it will be considered for submission. When I submitted my new version 2mins before the deadline it took 21 secs to show up on the submission portal. What can I do Now. I've done research regarding this essays for weeks. I have clicked the submit button before the deadline but submission happened after deadline . Please consider my submisssion .\n\nYou can see from the image that my notebooks submission time is exactly the same as the time from deadline which is 17min ago.", "replies": [ { "id": 2349948, "postDate": "2023-07-18T20:07:48.240Z", "content": "Submissions need to be received prior to the deadline in order to be considered valid. For more detail you can refer to https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
", "rawMarkdown": "Submissions need to be received prior to the deadline in order to be considered valid. For more detail you can refer to https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions." } ] }, { "id": 2340277, "postDate": "2023-07-11T11:41:54.727Z", "content": "I noticed that in my first submission, the dataset Meta Kaggle disappeared. It says it has been deleted. I had to remove it and reattach it again in v2 (when submitting feedback review links). This seems strange. @paultimothymooney
\n![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6674022%2F158cdacfae3ba87627eafa32c75a22a9%2FScreenshot%20from%202023-07-11%2013-40-34.png?generation=1689075656039812&alt=media\")
The Meta Kaggle dataset gets deleted and re-created daily (for compliance reasons). It is still there, and the notebook should still run as-is, but the data file tree explorer will get confused and say that the dataset is no longer available. I'll try to remember to respond to this message eventually when that gets fixed.
", "rawMarkdown": "The [Meta Kaggle](https://www.kaggle.com/datasets/kaggle/meta-kaggle) dataset gets deleted and re-created daily (for compliance reasons). It is still there, and the notebook should still run as-is, but the data file tree explorer will get confused and say that the dataset is no longer available. I'll try to remember to respond to this message eventually when that gets fixed.", "votes": 2, "replies": [ { "id": 2340525, "postDate": "2023-07-11T14:35:19.913Z", "content": "@crodoc Was your notebook \"running\" when you saw this or were you editing while it was \"off\"?
\nI had written code a couple years back to at least detect when this happens when a notebook turns \"on\" and autoupdate missing dataset versions.
Thanks for the answear!
", "rawMarkdown": "Thanks for the answear!" }, { "id": 2340587, "postDate": "2023-07-11T15:09:29.803Z", "content": "@herbison I am not sure. I think I was editing it while it was off.
", "rawMarkdown": "@herbison I am not sure. I think I was editing it while it was off." }, { "id": 2340596, "postDate": "2023-07-11T15:13:59.743Z", "content": "@crodoc Thanks, you'll likely see this happen again in the next 24hr when the dataset gets updated again.
\nTry turning the notebook on and seeing if it auto fixes it, let me know if you continue to have trouble after that. Thanks!
In the description, it says it is updated every day, but seems the last update was 4 days ago. Since there was no update, the dataset is still available. Will share what happens after the dataset gets updated.
\n![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6674022%2Fc3400156b27e634eefb3c08166daa693%2FScreenshot%20from%202023-07-11%2020-54-25.png?generation=1689101696659933&alt=media\")
Thanks, I'm guessing the pipeline that generates it has an error, I'll take a look. Thanks for reporting!
", "rawMarkdown": "Thanks, I'm guessing the pipeline that generates it has an error, I'll take a look. Thanks for reporting!", "votes": 2 }, { "id": 2346588, "postDate": "2023-07-16T11:11:48.983Z", "content": "Still no updates to meta kaggle.
\n![\"\"](\"https://www.googleapis.com/download/storage/v1/b/kaggle-forum-message-attachments/o/inbox%2F6674022%2F4ff06b04fae3f548f69d8e2121c8b0b1%2FScreenshot%20from%202023-07-16%2013-11-01.png?generation=1689505877985377&alt=media\")
@herbison the dataset was refreshed, it is deleted in my latest submission, but when I edit the notebook and turn it on, it seems to update the missing dataset (although not immediately)
", "rawMarkdown": "@herbison the dataset was refreshed, it is deleted in my latest submission, but when I edit the notebook and turn it on, it seems to update the missing dataset (although not immediately)", "votes": 1 } ] } ] }, { "id": 2335812, "postDate": "2023-07-08T20:01:38.380Z", "content": "Hi all,
\nI am relatively new to Kaggle. Made my first official submission to any competition with my essay \"Time Series Forecasting: Is Simplicity the Key?\". When I was creating my notebook I had issues figuring out how best to bring images into markdown that are centered, and without hosting images somewhere outside of Kaggle. However, I found a cheeky way of creating a dataset with the images on Kaggle and copying the image address directly into markdown. Seemed to be working fine. However, today I noticed some of my image links had broken and had to go through to update the links. Seems whatever server the dataset is on had shifted address, or at least the images had changed address. Thinking this may cause issues going forward…. and was curious if anyone had found a solution similar that worked long-term? Thanks in advance!
If you drag and drop images into your markdown cells then the notebook will break. Instead, you should upload your images to file hosting websites such as imgur.com or GitHub, and then you should use markdown cells to display those images (e.g. ). If you prefer to use Kaggle Datasets rather than a dedicated image hosting platform to store your images, you'll need to use Python or R code to display the images (e.g. from IPython.display import Image).
\nHopefully that helps!
", "rawMarkdown": "If you drag and drop images into your markdown cells then the notebook will break. Instead, you should upload your images to file hosting websites such as imgur.com or GitHub, and then you should use markdown cells to display those images (e.g. ). If you prefer to use Kaggle Datasets rather than a dedicated image hosting platform to store your images, you'll need to use Python or R code to display the images (e.g. [from IPython.display import Image](https://www.kaggle.com/code/residentmario/images-in-kernels)). \n\nHopefully that helps!", "votes": 1, "replies": [ { "id": 2337396, "postDate": "2023-07-10T05:13:54.547Z", "content": "Thanks so much!
", "rawMarkdown": "Thanks so much!" } ] } ] }, { "id": 2335616, "postDate": "2023-07-08T16:57:23.503Z", "content": "There are a lot of notebooks without a submission. Will my reviews be eligible even if the authors of the essays do not make a new submission?
\nSecond question: are reviews left before 5th July eligible? If not, can I leave a review on the essay that already has 3 or more reviews, each of which was left before 5th July?
", "rawMarkdown": "There are a lot of notebooks without a submission. Will my reviews be eligible even if the authors of the essays do not make a new submission? \n\nSecond question: are reviews left before 5th July eligible? If not, can I leave a review on the essay that already has 3 or more reviews, each of which was left before 5th July? \n\n", "replies": [ { "id": 2336514, "postDate": "2023-07-09T12:08:54.440Z", "content": "You are required to leave 3 thoughtful comments on 3 essays that were written in the same category as what you wrote about yourself. In the rare event that someone publishes an essay in your category but does not submit it, there will be no impact on your submission or your eligibility. Comments left before July 5th do indeed count, so long as they are comments left on actual essays from your peers (as guided by the peer-feedback rubric).
", "rawMarkdown": "You are required to leave 3 thoughtful comments on 3 essays that were written in the same category as what you wrote about yourself. In the rare event that someone publishes an essay in your category but does not submit it, there will be no impact on your submission or your eligibility. Comments left before July 5th do indeed count, so long as they are comments left on actual essays from your peers (as guided by the [peer-feedback rubric](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/peer-feedback-instructions)).", "replies": [ { "id": 2336654, "postDate": "2023-07-09T14:04:12.497Z", "content": "Thank you very much for the clarification!
", "rawMarkdown": "Thank you very much for the clarification! " } ] } ] }, { "id": 2333153, "postDate": "2023-07-06T17:23:38.793Z", "content": "I want to ask is it necessary to write a general essay on the topic or can we choose a topic and write on its subdomain. For example, in Ai Ethics can I write my complete essay on AI Ethics in Credit Risk Prediction. ?
", "rawMarkdown": "I want to ask is it necessary to write a general essay on the topic or can we choose a topic and write on its subdomain. For example, in Ai Ethics can I write my complete essay on AI Ethics in Credit Risk Prediction. ?", "replies": [ { "id": 2334533, "postDate": "2023-07-07T18:39:20.143Z", "content": "Ultimately the goal is to respond to one of the 7x prompts in a way that will score highest against the evaluation rubric, and the prompt begins with \"what the ML community has learned over the past 2 years of working with…\", which is a fairly broad mandate.
\nAn essay that comprehensively summarizes the recent advancements in a given area will likely score higher than an essay that has a comparatively narrow focus. It still sounds like an interesting topic that could score well against the evaluation rubric though.
", "rawMarkdown": "Ultimately the goal is to respond to one of the [7x prompts](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/description) in a way that will score highest against the [evaluation rubric](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation), and the prompt begins with \"what the ML community has learned over the past 2 years of working with...\", which is a fairly broad mandate. \n\nAn essay that comprehensively summarizes the recent advancements in a given area will likely score higher than an essay that has a comparatively narrow focus. It still sounds like an interesting topic that could score well against the evaluation rubric though." } ] }, { "id": 2333134, "postDate": "2023-07-06T17:15:23.650Z", "content": "Is there any shortcut/trick to find all submissions in a category?
\nFrom the title it is not always clear which category a submission belongs to and I think some Notebooks are not submissions. That's why I think going through every Notebook in this competition to find submissions to review is the brute force way to go - and I think we don't like doing things the brute force way around here :)
\nI hope there is a simpler way. Please someone tell me.
", "rawMarkdown": "Is there any shortcut/trick to find all submissions in a category?\n\nFrom the title it is not always clear which category a submission belongs to and I think some Notebooks are not submissions. That's why I think going through every Notebook in this competition to find submissions to review is the brute force way to go - and I think we don't like doing things the brute force way around here :)\n\nI hope there is a simpler way. Please someone tell me.", "replies": [ { "id": 2334520, "postDate": "2023-07-07T18:32:14.240Z", "content": "We won't have a final list of the submissions and the categories until the July 16 deadline. For example, a large fraction of the leaderboard submitted to us only placeholder values and they have until July 16th to update those submission.csv files with the appropriate URLs. As such, it is too early to exclude any public notebooks from our search.
\nMy recommended method for finding essays to provide peer-feedback to would be as follows:
\nAlternatively, here is a preliminary list of all of the public notebooks, sorted by category, such that you can quickly filter to see only your chosen category.
\nHopefully that helps!
", "rawMarkdown": "We won't have a final list of the submissions and the categories until the July 16 deadline. For example, a large fraction of the leaderboard submitted to us only placeholder values and they have until July 16th to update those submission.csv files with the appropriate URLs. As such, it is too early to exclude any public notebooks from our search.\n\nMy recommended method for finding essays to provide peer-feedback to would be as follows:\n- Navigate to the [code listing](https://www.kaggle.com/competitions/2023-kaggle-ai-report/code)\n- Sort by \"recently created\"\n- Find a notebook that has a title that seems aligned with the topic that you chose for your own essay\n- Verify that it does not yet already have 3x thoughtful comments providing peer feedback (this information can only be found on the ./code listing page)\n- If it already has >3 comments providing peer-feedback, keep scrolling until you find one that does not.\n- If all of the notebooks in your category already have >3 comments providing peer-feedback, expand your search to also include additional categories\n\n**Alternatively, [here is a preliminary list of all of the public notebooks, sorted by category](https://www.kaggle.com/datasets/paultimothymooney/list-of-public-notebooks-ai-report-competition), such that you can quickly filter to see only your chosen category.**\n\nHopefully that helps!", "votes": 2, "replies": [ { "id": 2334672, "postDate": "2023-07-07T21:42:47.973Z", "content": "This is really helpful Paul. Thanks for sharing the link.
", "rawMarkdown": "This is really helpful Paul. Thanks for sharing the link.", "votes": 1 }, { "id": 2335609, "postDate": "2023-07-08T16:50:53.643Z", "rawMarkdown": "", "isDeleted": true }, { "id": 2337507, "postDate": "2023-07-10T06:39:02.620Z", "content": "Very helpful, Paul. Thank you!
", "rawMarkdown": "Very helpful, Paul. Thank you!" } ] } ] }, { "id": 2330539, "postDate": "2023-07-05T04:25:22.060Z", "content": "Please can anyone tell me how to upload an output. I don't understand it
", "rawMarkdown": " Please can anyone tell me how to upload an output. I don't understand it ", "replies": [ { "id": 2331380, "postDate": "2023-07-05T14:05:05.397Z", "content": "Your essay should be in a public Kaggle Notebook. For information about Kaggle notebooks see https://www.kaggle.com/docs/notebooks.
\nYour submission is a CSV file named submission.csv and in that CSV file you will put a URL that points to your public notebook. This is described in detail at https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
\nYou can find additional instructions on the competition overview, data, evaluation, submission instructions, and timeline pages.
\nHopefully that helps!
", "rawMarkdown": "Your essay should be in a public Kaggle Notebook. For information about Kaggle notebooks see https://www.kaggle.com/docs/notebooks.\n\nYour submission is a CSV file named submission.csv and in that CSV file you will put a URL that points to your public notebook. This is described in detail at https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.\n\nYou can find additional instructions on the competition [overview](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview), [data](https://www.kaggle.com/competitions/2023-kaggle-ai-report/data), [evaluation](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation), [submission instructions](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions), and [timeline](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline) pages.\n\nHopefully that helps!" } ] }, { "id": 2330045, "postDate": "2023-07-04T17:17:17.670Z", "content": "Hi Paul,
\nCan we choose which version of the notebook we want to submit? And how does the Kaggle team select a submission if we make multiple submissions? Also, can I modify the peer feedback urls and resubmit after the initial deadline? Thank you!
We will grade your team's most recent submission only. Your most recent submission will be a new submission, received during the peer feedback period which is July 5 to July 16 (most likely towards the very end of it since you'll need to give yourself time to provide 3x thoughtful comments on 3x peer essays -- and many or most of the essays won't be made public until July 5th). Please ensure you submit a final, updated file once you have completed your peer feedback. This is in addition to needing to make the notebook that contains your essay public prior to July 5th in order to make the essay itself visible during the peer feedback period (and in order to be eligible for the final prizes). For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
\nYes, you can reference specific versions of notebooks (or pin your notebook to a specific version within the notebook editor UI).
", "rawMarkdown": "We will grade your team's most recent submission only. Your most recent submission will be a new submission, received during the peer feedback period which is July 5 to July 16 (most likely towards the very end of it since you'll need to give yourself time to provide 3x thoughtful comments on 3x peer essays -- and many or most of the essays won't be made public until July 5th). Please ensure you submit a final, updated file once you have completed your peer feedback. This is in addition to needing to make the notebook that contains your essay public prior to July 5th in order to make the essay itself visible during the peer feedback period (and in order to be eligible for the final prizes). For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.\n\nYes, you can reference specific versions of notebooks (or pin your notebook to a specific version within the notebook editor UI).\n", "votes": 1 } ] }, { "id": 2329546, "postDate": "2023-07-04T10:25:08.040Z", "content": "Hello Everyone, I'm facing difficulties in submitting my work on Generative AI and I mentioned them below. Please take a look into that if possible
\nI have run into this same issue. One of the things I tried is converting all of my .PNG files to .JPEG files. That compressed some of the figures I am using in the notebook.
", "rawMarkdown": "I have run into this same issue. One of the things I tried is converting all of my .PNG files to .JPEG files. That compressed some of the figures I am using in the notebook.", "replies": [ { "id": 2330324, "postDate": "2023-07-04T22:37:04.593Z", "content": "Q1: What should I do if my notebook is a really large size?
\nA1: The most common reason for large notebook sizes is dragging and dropping images into the markdown cells rather than using markdown language to reference URLs that contain your images (e.g. ). To fix this issue, upload your images to a file hosting website such as imgur.com or GitHub and then reference those URLs using markdown.
Q2: Should I convert my notebook from .ipynb to .csv?
\nA2: No, just include a link to the URL that points to the public Kaggle notebook that contains your essay. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
Q3: What are the submission instructions?
\nA3: The most straightforward workflow to get the competition submission to work is likely going to be as follows: (0) download the sample_submission.csv file from the ./data tab; (1) replace the URLs in sample_submission.csv with your actual URLs; (2) save and rename the file as submission.csv; and then (3) submit your submission.csv file by uploading it into the \"Submit Predictions\" module. The submission.csv file is a small file that gives us 4 important URLs: the URL that points to the public notebook that contains your essay; and, eventually, in your final submission, the 3x URLs that point to the 3x thoughtful comments that you provided on 3x peer essays. For more detail see the submission instructions page as well as the competition overview, data, evaluation, and timeline.
Yes I have done it. Thanks for helping me out.
", "rawMarkdown": "Yes I have done it. Thanks for helping me out." } ] } ] }, { "id": 2325305, "postDate": "2023-07-01T08:41:28.923Z", "content": "Hi @paultimothymooney ,
\nI majorly work on Robotics. I've written essay on AI for Robotics which describes the recent advancements in the field of Robotics with the help of AI. Eligibility checklist says 'The essay was relevant to one of the 7x pre-defined topics'. Just for confirmation, Can my essay be considered under the 'others' category ?? Can I submit this essay ?? Or it should be only related to those topics related to pure AI ….
", "rawMarkdown": "Hi @paultimothymooney ,\n\nI majorly work on Robotics. I've written essay on **AI for Robotics** which describes the recent advancements in the field of Robotics with the help of AI. Eligibility checklist says 'The essay was relevant to one of the 7x pre-defined topics'. Just for confirmation, Can my essay be considered under the 'others' category ?? Can I submit this essay ?? Or it should be only related to those topics related to pure AI ....", "replies": [ { "id": 2325504, "postDate": "2023-07-01T12:19:11.627Z", "content": "Yes, this is a great topic for the \"other\" category. Anything that doesn't fit neatly into any of the other categories, such as field-specific essays that span multiple categories, will fit best in the \"other\" category.
", "rawMarkdown": "Yes, this is a great topic for the \"other\" category. Anything that doesn't fit neatly into any of the other categories, such as field-specific essays that span multiple categories, will fit best in the \"other\" category." } ] }, { "id": 2320620, "postDate": "2023-06-28T01:05:47.947Z", "content": "Can you clarify the deadline for making the notebook publicly available for peer feedback - is it July 4 before the feedback process starts or does July 5 work as well?
", "rawMarkdown": "Can you clarify the deadline for making the notebook publicly available for peer feedback - is it July 4 before the feedback process starts or does July 5 work as well?\n", "replies": [ { "id": 2321555, "postDate": "2023-06-28T16:59:12.110Z", "content": "All deadlines are at 11:59 PM UTC on the corresponding day unless otherwise noted. The July 5th deadlines are therefore July 5, 2023 11:59 PM UTC. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
", "rawMarkdown": "All deadlines are at 11:59 PM UTC on the corresponding day unless otherwise noted. The July 5th deadlines are therefore July 5, 2023 11:59 PM UTC. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.\n", "votes": 2, "replies": [ { "id": 2322045, "postDate": "2023-06-29T03:52:54.020Z", "content": "Hi @paultimothymooney, I notice that there's a note under the code section that says not to publish any high scoring public notebook until it ends. However, the deadline is still 7 days from now (July 5, 2023). I wonder if I can still make my notebook public before the deadline. Thank you!
", "rawMarkdown": "Hi @paultimothymooney, I notice that there's a note under the code section that says not to publish any high scoring public notebook until it ends. However, the deadline is still 7 days from now (July 5, 2023). I wonder if I can still make my notebook public before the deadline. Thank you!", "votes": 2 }, { "id": 2322901, "postDate": "2023-06-29T15:04:22.073Z", "content": "We will remove the alert shortly, thank you for bringing it to our attention. In the meantime, please ignore the alert and feel free to mark your notebook as public.
", "rawMarkdown": "We will remove the alert shortly, thank you for bringing it to our attention. In the meantime, please ignore the alert and feel free to mark your notebook as public.", "votes": 1 } ] } ] }, { "id": 2320576, "postDate": "2023-06-27T22:36:12.520Z", "content": "Hello! Can I ask if there are any word limitations? Can we submit essays containing hundreds of pages for example 😄?
", "rawMarkdown": "Hello! Can I ask if there are any word limitations? Can we submit essays containing hundreds of pages for example 😄?", "replies": [ { "id": 2321551, "postDate": "2023-06-28T16:55:38.380Z", "content": "There is not a strict word limit (although the evaluation rubric does encourage you to be \"concise\"). Recently a similar competition had a 2000 word limit, which seems consistent with common recommendations from journals. I think much shorter essays could also score very well against our evaluation rubric, though.
", "rawMarkdown": "There is not a strict word limit (although the evaluation rubric does encourage you to be \"concise\"). Recently a [similar competition](https://www.kaggle.com/competitions/nfl-big-data-bowl-2023/overview/evaluation) had a 2000 word limit, which seems consistent with [common recommendations from journals](https://www.science.org/content/page/science-information-authors). I think much shorter essays could also score very well against our [evaluation rubric](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation), though. ", "votes": 1, "replies": [ { "id": 2322761, "postDate": "2023-06-29T13:35:07.180Z", "content": "thank you!!
", "rawMarkdown": "thank you!!" } ] } ] }, { "id": 2320283, "postDate": "2023-06-27T16:52:08.067Z", "content": "Hello, should the updates made to our essay after the start of the feedback period be based only upon the feedback received, or can we continue to add novel content to our essay up until the final submission deadline?
", "rawMarkdown": "Hello, should the updates made to our essay after the start of the feedback period be based only upon the feedback received, or can we continue to add novel content to our essay up until the final submission deadline?", "replies": [ { "id": 2321568, "postDate": "2023-06-28T17:11:56.150Z", "content": "Participants are expected to submit final drafts rather than works-in-progress, and updates in response to peer-feedback should be relatively minor, focusing predominantly on addressing the feedback that was received.
\nIf your final essay does not resemble your original submission then you will not have satisfied the requirement of sharing your essay in a public manner in advance of the relevant deadline.
", "rawMarkdown": "Participants are expected to submit final drafts rather than works-in-progress, and updates in response to peer-feedback should be relatively minor, focusing predominantly on addressing the feedback that was received. \n\nIf your final essay does not resemble your original submission then you will not have satisfied the requirement of sharing your essay in a public manner in advance of the relevant deadline.\n", "replies": [ { "id": 2321686, "postDate": "2023-06-28T19:08:29.150Z", "content": "Got it thanks!
", "rawMarkdown": "Got it thanks!" }, { "id": 2325514, "postDate": "2023-07-01T12:27:28.630Z", "content": "I was going to ask a similar question. Can we have some clarity on how much change is allowed between the 5th of July and the final deadline? Is it a % change, or no new sections type of rule? No new diagrams? Do we have to directly connect changes to feedback or can they be unconnected improvements? I’m asking as 10 days is a long time to reflect and improve the draft. Will any penalty for making changes be at the subjective discretion of the judges?
", "rawMarkdown": "I was going to ask a similar question. Can we have some clarity on how much change is allowed between the 5th of July and the final deadline? Is it a % change, or no new sections type of rule? No new diagrams? Do we have to directly connect changes to feedback or can they be unconnected improvements? I’m asking as 10 days is a long time to reflect and improve the draft. Will any penalty for making changes be at the subjective discretion of the judges? ", "votes": 3 }, { "id": 2331820, "postDate": "2023-07-05T19:48:20.740Z", "content": "@paultimothymooney any thoughts?
", "rawMarkdown": "@paultimothymooney any thoughts?" } ] } ] }, { "id": 2319089, "postDate": "2023-06-26T20:32:08.770Z", "content": "I have two questions:
\nsubmission.csv with placeholders for peer reviews before this date?Q1: No, each team should write a single essay focusing on a single topic. For more details see the submission instructions page.
\nQ2: Yes, if you have not yet provided peer-feedback then you will want to include placeholder URLs in your submission.csv file. For more details see the submission instructions page.
\nQ3: Yes, authors are encouraged to make updates in response to peer feedback received prior to the final submission deadline. For more details see the timeline page.
\nHopefully that helps!
", "rawMarkdown": "Q1: No, each team should write a single essay focusing on a single topic. For more details see the [submission instructions](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions) page.\n\nQ2: Yes, if you have not yet provided peer-feedback then you will want to include placeholder URLs in your submission.csv file. For more details see the [submission instructions](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions) page.\n\nQ3: Yes, authors are encouraged to make updates in response to peer feedback received prior to the final submission deadline. For more details see the [timeline page](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline).\n\n\nHopefully that helps!", "votes": 1, "replies": [ { "id": 2319199, "postDate": "2023-06-27T01:17:51.810Z", "content": "Thanks, so much @paultimothymooney ! Super helpful response - cleared up everything. Excited to participate in this event!
", "rawMarkdown": "Thanks, so much @paultimothymooney ! Super helpful response - cleared up everything. Excited to participate in this event!", "votes": 1 } ] } ] }, { "id": 2309866, "postDate": "2023-06-20T00:18:11.560Z", "content": "Can we use images that are published in other articles and cite the source of the image?
", "rawMarkdown": "Can we use images that are published in other articles and cite the source of the image?", "replies": [ { "id": 2310701, "postDate": "2023-06-20T14:59:05.113Z", "content": "Yes (ideally paired with some original writing that explains or interprets that same figure or image)
", "rawMarkdown": "Yes (ideally paired with some original writing that explains or interprets that same figure or image)", "votes": 1, "replies": [ { "id": 2310769, "postDate": "2023-06-20T15:41:08.623Z", "content": "Thanks for the response.
", "rawMarkdown": "Thanks for the response.\n" } ] } ] }, { "id": 2305688, "postDate": "2023-06-16T21:08:41.587Z", "content": "I seem to recall that the 7 judges are assigned one per area, and each judge will grade only the papers in that area. If that's the case, can you release names of the judges for each category?
\nAssume that each judge has different preferences and ideas on what \"good\" looks like:
\nI haven't read enough to know how the peer evals work, so maybe that's an offsetting factor.
", "rawMarkdown": "I seem to recall that the 7 judges are assigned one per area, and each judge will grade only the papers in that area. If that's the case, can you release names of the judges for each category?\n\nAssume that each judge has different preferences and ideas on what \"good\" looks like:\n- If you release names, then we can game the system and submit to a judge most likely to favor our submission.\n- If you don't, there's an element of randomness that depends on which category we pick.\n\nI haven't read enough to know how the peer evals work, so maybe that's an offsetting factor." }, { "id": 2296199, "postDate": "2023-06-11T16:02:36.363Z", "content": "Under the Kaggle Competitions topic, can the essay also discuss popular approaches and trends observed in the competitions from the past two years? Or solely the impacts following the competitions?
", "rawMarkdown": "Under the Kaggle Competitions topic, can the essay also discuss popular approaches and trends observed in the competitions from the past two years? Or solely the impacts following the competitions?", "replies": [ { "id": 2297453, "postDate": "2023-06-12T15:39:24.797Z", "content": "Ultimately the goal is to respond to one of the 7x prompts in a way that will score highest against the evaluation rubric. The prompt \"what has the ML community learned over the past 2 years of working and experimenting with Kaggle Competitions\" is meant to encourage authors to summarize the overall impact of Kaggle's competitions on the broader ML community. Did the ML community benefit from these competitions? Did these competitions drive forward any important advancements in the field of ML?
\nIf you are simply summarizing the most popular approaches used in Kaggle Competitions without putting any of that into a larger context then your essay would score poorly as compared to an essay that describes how the field was actually advanced.
", "rawMarkdown": "Ultimately the goal is to respond to one of the [7x prompts](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/description) in a way that will score highest against the [evaluation rubric](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation). The prompt \"what has the ML community learned over the past 2 years of working and experimenting with Kaggle Competitions\" is meant to encourage authors to summarize the overall impact of Kaggle's competitions on the broader ML community. Did the ML community benefit from these competitions? Did these competitions drive forward any important advancements in the field of ML?\n\nIf you are simply summarizing the most popular approaches used in Kaggle Competitions without putting any of that into a larger context then your essay would score poorly as compared to an essay that describes how the field was actually advanced." } ] }, { "id": 2294395, "postDate": "2023-06-10T03:29:52.807Z", "content": "Hi, I've heard that if one of the teammates is a Google employee, the whole team will not get the cash 10K prize. Is that true or not? Do we have that policy?
", "rawMarkdown": "Hi, I've heard that if one of the teammates is a Google employee, the whole team will not get the cash 10K prize. Is that true or not? Do we have that policy?", "replies": [ { "id": 2297446, "postDate": "2023-06-12T15:28:44.310Z", "content": "The rules always apply to the team rather than to the individual. As such, the entire team will be excluded from collecting prize money if there is at least one team member that is employed by the organization that is hosting the competition.
", "rawMarkdown": "[The rules](https://www.kaggle.com/competitions/2023-kaggle-ai-report/rules) always apply to the team rather than to the individual. As such, the entire team will be excluded from collecting prize money if there is at least one team member that is employed by the organization that is hosting the competition." } ] }, { "id": 2288027, "postDate": "2023-06-05T06:08:51.450Z", "content": "Hi admins, I'm curious in
\n\n\nWinning essays will be aggregated in a post-competition publication and given authorship credit.
\n
Do we plan to submit the post-competition publication to a peer-reviewed venue (e.g. KDD) in order to receive broader attention? Thanks in advance!
", "rawMarkdown": "Hi admins, I'm curious in \n> Winning essays will be aggregated in a post-competition publication and given authorship credit.\n\nDo we plan to submit the post-competition publication to a peer-reviewed venue (e.g. KDD) in order to receive broader attention? Thanks in advance!", "replies": [ { "id": 2288851, "postDate": "2023-06-05T18:00:59.437Z", "content": "Winning essays will be aggregated in a post-competition publication to be self-published on the Kaggle website
", "rawMarkdown": "Winning essays will be aggregated in a post-competition publication to be self-published on the Kaggle website", "replies": [ { "id": 2293278, "postDate": "2023-06-09T04:36:29.207Z", "content": "I appreciate your reply. Could we consider submitting the consolidated publication to a peer-reviewed platform, like a KDD workshop, in addition to self-publishing on Kaggle? This approach could significantly broaden our readership, thus contributing further to the academic community and facilitating progress within our field.
", "rawMarkdown": "I appreciate your reply. Could we consider submitting the consolidated publication to a peer-reviewed platform, like a KDD workshop, in addition to self-publishing on Kaggle? This approach could significantly broaden our readership, thus contributing further to the academic community and facilitating progress within our field.", "votes": 3 } ] } ] }, { "id": 2285219, "postDate": "2023-06-02T14:34:41.180Z", "content": "Hello, I had three questions regarding essays in the kaggle competitions category:
\n1)Is the essay supposed to provide an overall summary/summary statistics of kaggle competitions over the past two years or is it supposed to focus more on the impact that these have had on the ML community's advancements?
\n2)Must the essay detail only the positive aspects of these competitions or can their flaws be written about as well?
\n3)Can subjective opinions be included in the essay?
Waiting on your reply,
\nCheers!
The prompt you are referencing was worded as follows:
\n\n\nDescribe what the ML community has learned over the past 2 years of working and experimenting with Kaggle Competitions
\n
The intention is to summarize the overall impact of Kaggle's Competitions on the broader ML community. Did the ML community benefit from these competitions? Did these competitions drive forward any important advancements in the field of ML?
\nAs per your 3 specific questions:
\nGot it, Thanks!
", "rawMarkdown": "Got it, Thanks!" } ] } ] }, { "id": 2284478, "postDate": "2023-06-02T04:33:55.197Z", "content": "Hi everyone,
\nI'm relatively new to Kaggle, but I have experience in biochemistry research. I have been pondering the idea of writing an essay in the \"Other\" category, specifically focused on the Applications of Artificial Intelligence in Biomedicine and highlighting the recent advancements.
In order to produce a high-quality research paper, I am currently seeking 2-3 like-minded individuals who share a passion for this topic to form a team and work on this project together. If you have a genuine interest in this field, I would be thrilled to have you join me in this project.
", "rawMarkdown": "Hi everyone,\nI'm relatively new to Kaggle, but I have experience in biochemistry research. I have been pondering the idea of writing an essay in the \"Other\" category, specifically focused on the Applications of Artificial Intelligence in Biomedicine and highlighting the recent advancements.\n\nIn order to produce a high-quality research paper, I am currently seeking 2-3 like-minded individuals who share a passion for this topic to form a team and work on this project together. If you have a genuine interest in this field, I would be thrilled to have you join me in this project.", "replies": [ { "id": 2285261, "postDate": "2023-06-02T15:11:54.567Z", "content": "That is a great idea for a topic! I created a new pinned thread (just now) to help give a bit more visibility to Kagglers that are looking to join a team: https://www.kaggle.com/competitions/2023-kaggle-ai-report/discussion/414659
", "rawMarkdown": "That is a great idea for a topic! I created a new pinned thread (just now) to help give a bit more visibility to Kagglers that are looking to join a team: https://www.kaggle.com/competitions/2023-kaggle-ai-report/discussion/414659" } ] }, { "id": 2283500, "postDate": "2023-06-01T09:49:32.800Z", "content": "Hi , thanks for running this competition, great idea and a nice way to mix things up!
\nI just had a question about the licensing or restrictions (if any) on submitted essays? I see winning essays will be treated under an Apache 2.0 licence, but wondered about the non-winning essays, if the entrant felt they might want to share elsewhere or similar would that present a problem? Thanks in advance!
", "rawMarkdown": "Hi , thanks for running this competition, great idea and a nice way to mix things up!\n\nI just had a question about the licensing or restrictions (if any) on submitted essays? I see winning essays will be treated under an Apache 2.0 licence, but wondered about the non-winning essays, if the entrant felt they might want to share elsewhere or similar would that present a problem? Thanks in advance!", "replies": [ { "id": 2283977, "postDate": "2023-06-01T16:32:16.010Z", "content": "All public notebooks have Apache 2.0 licenses on Kaggle (not just the winning essays). These licenses are permissive and allow for sharing your work on multiple platforms (with attribution).
", "rawMarkdown": "All public notebooks have [Apache 2.0 licenses](http://www.apache.org/licenses/LICENSE-2.0) on Kaggle (not just the winning essays). These licenses are permissive and allow for sharing your work on multiple platforms (with attribution).", "votes": 1, "replies": [ { "id": 2285684, "postDate": "2023-06-02T22:39:54.883Z", "content": "Great, thank you!
", "rawMarkdown": "Great, thank you!", "votes": 1 } ] } ] }, { "id": 2283199, "postDate": "2023-06-01T05:55:03.213Z", "content": "Is there a cut-off year for what's considered \"recent\" research?
\nThe context of the competition mentions summarizing recent AI advances from the past 2 years, but the eligibility criteria says over the past 3 years. I am wondering if there would be a hard-line on what's considered a recent advance, e.g. if I cite a paper from 2019 is that considered too far in the past?
\nI'm assuming any paper from 2020 is ok, but please let me know if that's not the case.
", "rawMarkdown": "Is there a cut-off year for what's considered \"recent\" research?\n\nThe context of the competition mentions summarizing recent AI advances from the past 2 years, but the eligibility criteria says over the past 3 years. I am wondering if there would be a hard-line on what's considered a recent advance, e.g. if I cite a paper from 2019 is that considered too far in the past?\n\nI'm assuming any paper from 2020 is ok, but please let me know if that's not the case.", "replies": [ { "id": 2283966, "postDate": "2023-06-01T16:24:27.773Z", "content": "Ultimately the goal is to respond to one of the 7x prompts in a way that will score highest against the evaluation rubric, and the prompt begins with \"what the ML community has learned over the past 2 years of working with…\".
\nYou are welcome to discuss a much longer timescale (this can make a really strong introduction section I think), but we recommend focusing your essay on the most exciting recent advances.
", "rawMarkdown": "Ultimately the goal is to respond to one of the [7x prompts](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/description) in a way that will score highest against the [evaluation rubric](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation), and the prompt begins with \"what the ML community has learned over the past 2 years of working with...\".\n\nYou are welcome to discuss a much longer timescale (this can make a really strong introduction section I think), but we recommend **focusing** your essay on the most exciting **recent** advances.\n\n" } ] }, { "id": 2274375, "postDate": "2023-05-25T23:15:50.057Z", "content": "Hello! I saw that we are encouraged to submit early, even with placeholders, to help show how many will be entering the competition. This is the first time I really try at a competition. At the moment, my notebook is private. I saw that submitting will run a new version. Does submitting also make the notebook public?
", "rawMarkdown": "Hello! I saw that we are encouraged to submit early, even with placeholders, to help show how many will be entering the competition. This is the first time I really try at a competition. At the moment, my notebook is private. I saw that submitting will run a new version. Does submitting also make the notebook public?", "replies": [ { "id": 2276156, "postDate": "2023-05-26T14:47:33.297Z", "content": "To make a submission you just upload a .CSV file that contains a link to your notebook.
\nTo make your notebook public, you will need to either click on the \"settings\" menu within the notebook viewer or the \"share\" menu within the notebook editor, modify the visibility setting, and then save your changes.
\n(For more details see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.)
", "rawMarkdown": "To make a submission you just upload a .CSV file that contains a link to your notebook. \n\nTo make your notebook public, you will need to either click on the \"settings\" menu within the notebook viewer or the \"share\" menu within the notebook editor, modify the visibility setting, and then save your changes.\n\n (For more details see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.)", "votes": 1, "replies": [ { "id": 2276500, "postDate": "2023-05-26T22:31:55.457Z", "content": "That helps a lot. I wasn't sure if the \"Public Notebook\" requirement would make it automatically change. Thank you for answering this and the other questions here!
", "rawMarkdown": "That helps a lot. I wasn't sure if the \"Public Notebook\" requirement would make it automatically change. Thank you for answering this and the other questions here! ", "votes": 1 } ] } ] }, { "id": 2272615, "postDate": "2023-05-24T15:56:04.793Z", "content": "Hi , I am inquiring about plagiarism and cheating rules , for example does it is permitted to read articles ,watching tutorials , Use resources and see the notebooks of competitors ?
", "rawMarkdown": "Hi , I am inquiring about plagiarism and cheating rules , for example does it is permitted to read articles ,watching tutorials , Use resources and see the notebooks of competitors ?", "replies": [ { "id": 2272668, "postDate": "2023-05-24T16:26:52.023Z", "content": "None of those activities would be considered plagiarism. In this video plagiarism is defined as the act of presenting someone else's work (or someone else's ideas) as your own (and without citation). Here are two additional resources that can help you to better understand what plagiarism is and how to avoid it:
\n", "rawMarkdown": "None of those activities would be considered plagiarism. In [this video](https://www.youtube.com/watch?v=4v2Antvc9TQ) plagiarism is defined as the act of presenting someone else's work (or someone else's ideas) as your own (and without citation). Here are two additional resources that can help you to better understand what plagiarism is and how to avoid it: \n - [Video lecture from U of G](https://www.youtube.com/watch?v=GW3BzAG8aaY)\n - [Collection of resources from Purdue Online Writing Lab](https://owl.purdue.edu/owl/teacher_and_tutor_resources/preventing_plagiarism/avoiding_plagiarism/index.html)\n\n" } ] }, { "id": 2271900, "postDate": "2023-05-24T07:26:55.517Z", "content": "I meet a problem, when I trying to host a discussion, it gives \"Internal error/Too many requests\", and I cannot publish a topic ATM.
", "rawMarkdown": "I meet a problem, when I trying to host a discussion, it gives \"Internal error/Too many requests\", and I cannot publish a topic ATM.", "replies": [ { "id": 2272483, "postDate": "2023-05-24T14:27:27.830Z", "content": "There are rate limits that limit the amount of requests from a given ip address. If you hit the rate limit, please wait for a few minutes before you try again. If you keep trying after hitting the limit it'll never reset.
", "rawMarkdown": "There are rate limits that limit the amount of requests from a given ip address. If you hit the rate limit, please wait for a few minutes before you try again. If you keep trying after hitting the limit it'll never reset." } ] }, { "id": 2268317, "postDate": "2023-05-21T16:26:55.240Z", "content": "I need to review some ones work for my submission , help please
", "rawMarkdown": "I need to review some ones work for my submission , help please", "replies": [ { "id": 2269565, "postDate": "2023-05-22T14:45:02.507Z", "content": "The peer-feedback period begins on July 5th, 2023, once all of the submissions are made public. You can find additional guidance for providing peer-feedback here.
", "rawMarkdown": "The [peer-feedback period](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline) begins on July 5th, 2023, once all of the submissions are made public. You can find additional guidance for providing peer-feedback [here](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/peer-feedback-instructions)." } ] }, { "id": 2266490, "postDate": "2023-05-20T06:08:44.673Z", "content": "Is there an expectation for users to submit some kind of illustrative code and actually train models in these notebooks?
", "rawMarkdown": "Is there an expectation for users to submit some kind of illustrative code and actually train models in these notebooks?", "replies": [ { "id": 2269561, "postDate": "2023-05-22T14:43:07.473Z", "content": "There is no requirement to write any code. Strong essays will include tables and figures, though, and many participants will find that writing code is the best way to produce these types of supplementary materials.
", "rawMarkdown": "There is no requirement to write any code. Strong essays will include tables and figures, though, and many participants will find that writing code is the best way to produce these types of supplementary materials.", "votes": 1 } ] }, { "id": 2260518, "postDate": "2023-05-15T17:42:15.163Z", "content": "How will the breath and depth of the essay be evaluated? For example, if I want to write about generative AI, should I write about: 1. evolutions in the field in general 2. a particular vertical like chatbots or 3. a particular technology like diffusion models?
", "rawMarkdown": "How will the breath and depth of the essay be evaluated? For example, if I want to write about generative AI, should I write about: 1. evolutions in the field in general 2. a particular vertical like chatbots or 3. a particular technology like diffusion models?", "replies": [ { "id": 2260644, "postDate": "2023-05-15T19:14:55.460Z", "content": "The exact evaluation criteria is described here. An essay that comprehensively summarizes the recent advancements in a given area will likely score higher than an essay that has a comparatively narrow focus.
", "rawMarkdown": "The exact evaluation criteria is described [here](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation). An essay that comprehensively summarizes the recent advancements in a given area will likely score higher than an essay that has a comparatively narrow focus.", "votes": 1 } ] }, { "id": 2258293, "postDate": "2023-05-14T04:45:54.223Z", "content": "Is the goal for the essay to include as much information as possible on the chosen category in a concise way, or would it be better to choose a single, specific subcategory and write about that in a more detailed way?
", "rawMarkdown": "Is the goal for the essay to include as much information as possible on the chosen category in a concise way, or would it be better to choose a single, specific subcategory and write about that in a more detailed way?", "replies": [ { "id": 2260263, "postDate": "2023-05-15T15:08:02.333Z", "content": "An essay that comprehensively summarizes the recent advancements in a given area will likely score higher than an essay that has a comparatively narrow focus. Ultimately the goal is to respond to one of the 7x prompts in a way that will score highest against the evaluation rubric, and the prompt begins with \"what the ML community has learned over the past 2 years of working with…\", which is a fairly broad mandate.
", "rawMarkdown": "An essay that comprehensively summarizes the recent advancements in a given area will likely score higher than an essay that has a comparatively narrow focus. Ultimately the goal is to respond to one of the [7x prompts](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/description) in a way that will score highest against the [evaluation rubric](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation), and the prompt begins with \"what the ML community has learned over the past 2 years of working with...\", which is a fairly broad mandate.", "votes": 1 } ] }, { "id": 2256679, "postDate": "2023-05-12T16:45:21.340Z", "content": "When I submitted the sample submission file I got the following error: \"Solution and submission values for type do not match\". If I understood correctly submitting the template as it is should have worked. Am I missing something?
", "rawMarkdown": "When I submitted the sample submission file I got the following error: \"Solution and submission values for type do not match\". If I understood correctly submitting the template as it is should have worked. Am I missing something?\n", "replies": [ { "id": 2256696, "postDate": "2023-05-12T16:56:00.663Z", "content": "This should be working now -- can you please try again?
", "rawMarkdown": "This should be working now -- can you please try again?", "votes": 1, "replies": [ { "id": 2256705, "postDate": "2023-05-12T17:03:49.447Z", "content": "It worked thanks Paul!
", "rawMarkdown": "It worked thanks Paul!", "votes": 1 }, { "id": 2256726, "postDate": "2023-05-12T17:10:33.537Z", "content": "You're in 1st place! 🙌 🎉
", "rawMarkdown": "You're in 1st place! 🙌 🎉", "votes": 1 }, { "id": 2256730, "postDate": "2023-05-12T17:16:04.060Z", "content": "Being the first submitter is the only way I can be in 1st place 🥲
", "rawMarkdown": "Being the first submitter is the only way I can be in 1st place 🥲", "votes": 6 }, { "id": 2277430, "postDate": "2023-05-27T18:08:45.753Z", "content": "Hey, I am running into this error as well. Any suggestions? 🙏
", "rawMarkdown": "Hey, I am running into this error as well. Any suggestions? 🙏", "votes": 1 } ] } ] }, { "id": 2392248, "postDate": "2023-08-15T14:55:29.340Z", "rawMarkdown": "", "isDeleted": true }, { "id": 2356083, "postDate": "2023-07-23T21:40:38.850Z", "rawMarkdown": "", "isDeleted": true }, { "id": 2350339, "postDate": "2023-07-19T07:15:34.437Z", "rawMarkdown": "", "isDeleted": true }, { "id": 2347699, "postDate": "2023-07-17T06:23:28.340Z", "rawMarkdown": "", "isDeleted": true, "replies": [ { "id": 2349965, "postDate": "2023-07-18T20:18:47.977Z", "content": "That is correct, the Kaggle platform does not \"lock\" your public notebooks to prevent additional modifications.
\nOnly notebook versions published prior to the competition deadline will be eligible for the prizes and the grading.
", "rawMarkdown": "That is correct, the Kaggle platform does not \"lock\" your public notebooks to prevent additional modifications. \n\nOnly notebook versions published prior to the competition deadline will be eligible for the prizes and the grading." } ] }, { "id": 2344689, "postDate": "2023-07-14T17:32:00.710Z", "rawMarkdown": "", "isDeleted": true, "replies": [ { "id": 2346025, "postDate": "2023-07-15T23:46:26.717Z", "content": "Authors are encouraged to make updates in response to peer feedback received prior to the final submission deadline. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/peer-feedback-instructions.
", "rawMarkdown": "Authors are encouraged to make updates in response to peer feedback received prior to the final submission deadline. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/peer-feedback-instructions." } ] }, { "id": 2331809, "postDate": "2023-07-05T19:37:58.143Z", "rawMarkdown": "", "votes": 1, "isDeleted": true, "replies": [ { "id": 2331836, "postDate": "2023-07-05T20:16:37.157Z", "content": "Participants are expected to submit final drafts rather than works-in-progress, and updates in response to peer-feedback should be relatively minor, focusing predominantly on addressing the feedback that was received. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
", "rawMarkdown": "Participants are expected to submit final drafts rather than works-in-progress, and updates in response to peer-feedback should be relatively minor, focusing predominantly on addressing the feedback that was received. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.", "votes": 1 } ] }, { "id": 2258696, "postDate": "2023-05-14T12:22:18.397Z", "rawMarkdown": "", "isDeleted": true } ], "comments": [ { "id": 2256215, "author_name": "RB", "author_url": "", "post_date": "2023-05-12T10:31:50.623000", "content": "I don't have a question, but I do want to express that subjective evaluations in competitions category just dilutes competitions category. Perhaps a separate category for this analytics competitions would be better.
", "votes": 8, "replies": [ { "id": 2256326, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-05-12T11:45:14.830000", "content": "Thank you for the feedback, it is very much appreciated.
\nWe are trying to make this competition as objective as possible (for example, by bringing in an expert grading panel and by using a detailed evaluation rubric), and we still consider this competition to be \"skill-based\", but it is very valuable to hear additional perspectives as well.
", "votes": 3, "replies": [ { "id": 2256527, "author_name": "Psi", "author_url": "", "post_date": "2023-05-12T14:48:34.953000", "content": "But the expert panel are other competitors, that is not necessarily objective.
", "votes": 2, "replies": [] }, { "id": 2256547, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-05-12T15:07:59.473000", "content": "To clarify, the 7x Kaggle Grandmasters that make up the expert grading panel -- they are not allowed to compete in this competition. They were specifically selected because in addition to their expertise we also trust them to be fair graders. (The Kaggle Team will also participate and oversee the evaluation process.)
\nHopefully this alleviates some of your concerns. We were hoping to make this competition a low-risk experiment that we can learn from and make decisions from afterward.
", "votes": 2, "replies": [] }, { "id": 2256548, "author_name": "Psi", "author_url": "", "post_date": "2023-05-12T15:09:55.467000", "content": "But they are competing with us on the global leaderboard.
\n\n\nWe were hoping to make this competition a low-risk experiment that we can learn from and make decisions from afterward.
\n
Why not cut the points down heavily then? Keep in mind that winning such a competition solo gives close to 70k points and can inflate the global ranking by quite a bit.
\nAnyways, I also opened a separate discussion.
", "votes": 6, "replies": [] } ] } ] }, { "id": 2330387, "author_name": "Narendra G", "author_url": "", "post_date": "2023-07-05T00:44:37", "content": "When can we expect the final results?
", "votes": 1, "replies": [ { "id": 2331370, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-05T13:59:58.890000", "content": "Final results will be released during the month of August
", "votes": 5, "replies": [] } ] }, { "id": 2322832, "author_name": "Gouri Prakash", "author_url": "", "post_date": "2023-06-29T14:17:29.870000", "content": "I am seeing this alert, that indicates, \"Do not publish new notebooks during the final week of a competition\". Should we just ignore this alert?
", "votes": 1, "replies": [ { "id": 2322899, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-06-29T15:03:17.277000", "content": "Yes, please ignore that alert. We will remove the alert shortly, thank you for bringing it to our attention.
", "votes": 0, "replies": [] } ] }, { "id": 2335801, "author_name": "Bharat SHARMA1998", "author_url": "", "post_date": "2023-07-08T19:44:57.840000", "content": "Hi,
\n@paultimothymooney I have a Question:
\nAs Paul mentioned below, we are not supposed to do that. However, it was not clear from the description. I've made an update in my notebook because I didn't have time to move drafts. I also was confident that we were supposed to update our notebooks because of the phrase \"Authors are encouraged to make updates in response to peer feedback received prior to the final submission deadline\". Nevertheless, after I saw Paul's comment under the same question, I did not change anything anymore. Only specified a category.
", "votes": 0, "replies": [ { "id": 2335816, "author_name": "Bharat SHARMA1998", "author_url": "", "post_date": "2023-07-08T20:13:38.740000", "content": "Great, But I have seen some notebooks where the version I commented on and the new version have an entirely different structure and like heading, etc. So That's why I tagged him to confirm.
", "votes": 0, "replies": [] }, { "id": 2335817, "author_name": "SN", "author_url": "", "post_date": "2023-07-08T20:18:07.943000", "content": "Now I understand why you are asking this question. If the notebooks are not eligible, then there is a risk that your feedback may not be eligible as well. Interesting.
", "votes": 2, "replies": [] } ] }, { "id": 2335889, "author_name": "Gouri Prakash", "author_url": "", "post_date": "2023-07-08T23:07:47.943000", "content": "A related comment. I do think that essays that get constructive feedback are at an advantage than the essays that have little to no feedback.
\nIf every essay received at least 3 reviews from the community then all participants could constructively work towards improving their essays. If you have little or no feedback, then your hands are kind of tied behind your back in terms of having the opportunity to modify the essay as per peer review comments.
\nAt the same time you are held accountable for providing feedback on at least 3 participants, who will have the opportunity to improve upon their essays since you gave them feedback but at the same time there is nothing you can do to your own essay since there was little to no feedback on your essay.
", "votes": 1, "replies": [] }, { "id": 2336520, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-09T12:14:04.883000", "content": "Updates made after the 1st deadline should focus predominantly on addressing points that were raised during the peer-feedback period. The scope of the changes would then depend on the specific feedback received. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/peer-feedback-instructions.
", "votes": 1, "replies": [ { "id": 2343374, "author_name": "Bharat SHARMA1998", "author_url": "", "post_date": "2023-07-13T16:05:44.840000", "content": "Hi @paultimothymooney , Can you please help me out, I submitted my essay before the deadline and also made it public but it is not shown in the list you shared in any category.
", "votes": 0, "replies": [] } ] } ] }, { "id": 2327829, "author_name": "Shreyansh Murathia", "author_url": "", "post_date": "2023-07-03T07:37:04.240000", "content": "1) Can I still submit new submission now, even when the deadline for making notebook publicly available for peer review is over?
\n2) What if I successfully provide 3 reviews to my peers but I do not get 3 peer reviews on my work? Would it affect my score?
", "votes": 0, "replies": [ { "id": 2330305, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-04T22:23:40.550000", "content": "1) Yes, you should make a final submission sometime between July 5 and July 16, where you update the submission.csv file to include the updated URLs that reference your 3x peer-feedback comments. This is in addition to needing to make the notebook that contains your essay public prior to July 5th in order to be eligible for the final prizes. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
\n2) That is fine, it does not affect your score, just make sure to make the notebook that contains your essay public prior to July 5th in order to make it visible during the peer-feedback period (July 5 to July 16). Making the notebook public prior to July 5th is also a requirement for being eligible for a prize.
", "votes": 0, "replies": [ { "id": 2330329, "author_name": "", "author_url": "", "post_date": "2023-07-04T22:39:41.367000", "content": "", "votes": 0, "replies": [] }, { "id": 2332059, "author_name": "Chris Busse", "author_url": "", "post_date": "2023-07-06T00:03:15.027000", "content": "From the Overview / Timeline:
\n\n\nJuly 5, 2023 - Start of the peer-feedback period
\n
\n You are required to make the notebook containing your essay public prior to this deadline
\n …
\n All submissions are evaluated after the deadline and all deadlines are at 11:59 PM UTC on the corresponding day unless otherwise noted.
\n …
From the previous post:
\n\n\nMaking the notebook public prior to July 5th is also a requirement for being eligible for a prize.
\n
To be eligible for a prize, was the deadline for making the notebook public July 4th at 11:59 PM UTC (\"prior to July 5th\"), or was it July 5th (\"the corresponding day\") at 11:59 PM UTC?
", "votes": 0, "replies": [] }, { "id": 2332065, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-06T00:09:55.853000", "content": "All deadlines are at 11:59PM UTC. To be eligible for a prize, notebooks must have been made public prior to the July 5 11:59PM deadline.
\nFor more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
", "votes": 0, "replies": [] } ] } ] }, { "id": 2282592, "author_name": "Arjun", "author_url": "", "post_date": "2023-05-31T17:08:58.403000", "content": "I saw in the rules, you must display parental consent if not at the age of 18. How would I go about this. I would really appreciate some clarification as I am not yet 18.
", "votes": 2, "replies": [ { "id": 2282652, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-05-31T18:08:39.057000", "content": "You will need to fill out both of the following forms if you want to participate in this competition as a minor (prior to reaching the age of majority in your jurisdiction of residence):
\nThank you so much!
", "votes": 0, "replies": [] } ] } ] }, { "id": 2271968, "author_name": "Jude Omeiza", "author_url": "", "post_date": "2023-05-24T08:04:50.713000", "content": "Good day community, I recently joined this competition and as expected I have a number of questions.
\nMy first question is did I join the competition at a wrong time as the competition has been on for a couple of days now.
\nMy second question is a number of topics where listed and it was Indicated that the essay be written under these topics, my question here is does a competitor pick just a single topic or the essay be structured around these topics.
\nMy third and last question is how do I get paired with a team, and if I don't have a team can I compete solo?
\nThanks in anticipation to your favourable response.
Q1: We began promoting the launch of the competition just recently (May 19th), please do write an essay!
\nQ2: Each team should write a single essay focusing on a single topic. For additional details see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
\nQ3: Yes, you can compete solo. The most common team size will most likely be 1. There is no official pairing process.
\nHopefully that helps!
", "votes": 1, "replies": [ { "id": 2272938, "author_name": "Jude Omeiza", "author_url": "", "post_date": "2023-05-24T21:08:08.140000", "content": "Thank you so much, that would be all for now.
", "votes": 1, "replies": [] } ] } ] }, { "id": 2258622, "author_name": "Gleb", "author_url": "", "post_date": "2023-05-14T11:03:57.507000", "content": "Why is this part of the competitive track? What is so competitive in essay writing? It can be useful, educational, etc, but competitive?
", "votes": 2, "replies": [ { "id": 2260273, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-05-15T15:16:53.437000", "content": "In response to demand and feedback from prior analytics competitions this competition also pilots a format in which all eligible participants will be ranked on the leaderboard and awarded points . Results will show on your profile, just as in a standard competition. One idea that is being tested is to see if awarding points will motivate a level and quality of participation that exceeds what we have seen in prior analytics competitions on Kaggle. This is our first-ever analytics competition that offers points , and we're planning to debrief after this competition to see what we learned, what we can do better, etc.
", "votes": 2, "replies": [ { "id": 2260648, "author_name": "empty", "author_url": "", "post_date": "2023-05-15T19:19:43.623000", "content": "well it may motivate, but it should be in another type of competition
", "votes": 1, "replies": [] }, { "id": 2260863, "author_name": "", "author_url": "", "post_date": "2023-05-16T00:15:22.733000", "content": "Since you're going to conduct a debrief (after concluding the competition), I just wanted to provide some feedback on \"the level of motivation\" from a kaggler(I think you are interested in hearing from us directly (since we are targeted by the motivation)).
\nThe evaluation method has already undergone significant improvement (moving from a host who announces the winners and honorable mentions (without any feedback or a comment) to a triple assessment system: 3 peer reviews + competition Kaggle GM + Kaggle staff) and scores. This is a significant advancement and it is encouraging (and really motivating).
\nBut the distribution of medals and points is what is most demotivating (paradoxical? : No): I explain it by saying that, compared to the medals the Kaggle community won in the leaderboard competitions, whatever medal I receive\"a hypothesis\"(in analytical ones) will not be well merited. To use a metaphor, consider it as a \"Shy Medal\" among \"Shiny Medals\"
\nAnother point on motivation: I decided to participate in the leaderboard competitions this year (I started with WIDS2023), and I will really start with featured competitions this end of summer-fall 2023 (I managed to release time…). Although I am extremely motivated to start this journey, I am now feeling a bit demotivated (a title in the competitions tier will become diluted, undeserved, and not as impressive as it once was and and it will not be credible either).
==> Kindly, keep this improvement in the assessment (even it is still human evaluation), I mean this new triple assessment + scores, because before, it was only a discussion on the winners announcement without any feedback (we didn't even know if the notebooks were seen or not…)=> so it is already a big step, but I don't think it's appropriate to award medals and points again or to undermine the current trustworthy ranking system. And consider the detrimental impact that this will have on leaderboard competitors' motivation in the future…
", "votes": 1, "replies": [] }, { "id": 2261449, "author_name": "Gleb", "author_url": "", "post_date": "2023-05-16T10:28:40.863000", "content": "To summarize for your future debrief:
\n\n\nQ: Why is this part of the competitive track?
\n
Because people who have participated in previous analytics competitions want to get competition points and medals without participating in real competition.
\n\n\nQ: What is so competitive in essay writing?
\n
?
\n\n\nAwarding points and medals will motivate a level and quality of participation that exceeds what we have seen in prior analytics competitions on Kaggle
\n
It probably will, because of a 'competition' status. What will happen if K starts to throw in everything in that category? Dont get me wrong, the idea of 'practical knowledge distillation' is extremely good, and kaggle is one of the few places that can get it done, but actual execution of that idea for me is questionable. Why not ask the community, for example psi come up with 'scientific journal' for kaggle, which sounds amazing to me
", "votes": 1, "replies": [] }, { "id": 2285770, "author_name": "Hector Anaya", "author_url": "", "post_date": "2023-06-03T01:52:26.353000", "content": "How many types of competitions are there?
", "votes": 0, "replies": [] }, { "id": 2305658, "author_name": "", "author_url": "", "post_date": "2023-06-16T20:23:47.740000", "content": "", "votes": 0, "replies": [] }, { "id": 2305660, "author_name": "JohnM", "author_url": "", "post_date": "2023-06-16T20:26:41.050000", "content": "Can you clarify the medals, Paul? The overview page says points, no medals. If there are medals, then will a solo gold count toward being a competition GM?
", "votes": 0, "replies": [] }, { "id": 2305666, "author_name": "JohnM", "author_url": "", "post_date": "2023-06-16T20:35:15.457000", "content": "I agree, empty. Not that we need a 5th category, but I would prefer a separate Analytics category if there are going to be points and tiers, just like for ML comps, datasets, notebooks, discussions.
", "votes": 0, "replies": [] } ] } ] }, { "id": 2255798, "author_name": "Dewei Chen", "author_url": "", "post_date": "2023-05-12T02:17:17.247000", "content": "I noticed that Kaggle encourages participating team members to first submit a 'blank' template to indicate their desire to participate in the competition, but the 'sample_submission.csv' file of the instance is not sufficient to submit to LB. What are the specific requirements for submitting LB files?
", "votes": 2, "replies": [ { "id": 2255821, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-05-12T02:51:19.567000", "content": "'sample_submission.csv' looks like this:
\n ,value\n essay_category,\n essay_url,\n feedback1_url,\n feedback2_url,\n feedback3_url,\nIf you submit this blank template you will show up on the leaderboard immediately, but then after the grading process you will get removed from the leaderboard (unless if you replace the empty URLs with real ones and then submit that new file to Kaggle).
\nIf you follow the eligibility guidelines and then upload a submission.csv file (where you have replaced these empty URLs with valid ones) then you will not get dropped from the final leaderboard.
As far as I understood from rules that, reviewing process will start after the competition deadline (please correct if my understanding is wrong).
\nI understand that we need to update essay_url with a public notebook that contains our essay before the deadline. However, what about the feedback1_url, feedback2_url and feedback3_url? Can these fields be left blank and updated after the deadline?
Thank you!
", "votes": 0, "replies": [] }, { "id": 2324873, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-01T00:20:25.727000", "content": "The peer-feedback period begins on July 5th, at which point all of the essays from all of the participants in the competition will have been made public. You'll then need to both: (A) complete your 3x peer-feedback comments; and (B) update your submission.csv file to indicate the URLs corresponding with your 3x comments -- prior to the final deadline on July 16th. If you are submitting prior to actually completing your peer-feedback requirements then you can leave placeholder URLs in your submission.csv file until you are ready to replace the placeholder URLs with the real URLs that correspond with your 3x peer-feedback comments. Hopefully that helps!
\nSee the submission instrctions, the peer-feedback instructions, and the timeline page for more detail.
", "votes": 1, "replies": [] }, { "id": 2330702, "author_name": "Mughees Abbas", "author_url": "", "post_date": "2023-07-05T06:35:31.293000", "content": "can you tell me or give a link where it shows exactly how to submit with a csv file bex=cause this is my first time
", "votes": 0, "replies": [] }, { "id": 2334501, "author_name": "", "author_url": "", "post_date": "2023-07-07T18:10:30.093000", "content": "", "votes": 0, "replies": [] } ] } ] }, { "id": 2392249, "author_name": "kavitha G", "author_url": "", "post_date": "2023-08-15T14:56:25.720000", "content": "Hi,
\nI have a question @paultimothymooney regarding my notebook, It was made public before the deadline and appears in the dataset, but it did not receive a score on the Leaderboard. Also all versions of submitted notebooks show error under submission tab. It would be greatly appreciated if you could provide insights into why this might have happened, as it would help me avoid making similar mistakes in the future
My notebook -link
", "votes": 0, "replies": [] }, { "id": 2354953, "author_name": "Orere Israel", "author_url": "", "post_date": "2023-07-23T01:34:46.160000", "content": "weird that the last version of my notebook(which i tried to submit before the deadline)couldn't generate the csv i needed to submit especially so when all of my peer review feedbacks were on that version. 😑
", "votes": 0, "replies": [] }, { "id": 2352107, "author_name": "Hermela Belay", "author_url": "", "post_date": "2023-07-20T16:29:05.487000", "content": "Hello @paultimothymooney, are we still allowed to update our notebooks even after the final deadline? I noticed we can do that without having to submit again.
", "votes": 0, "replies": [] }, { "id": 2350439, "author_name": "Orere Israel", "author_url": "", "post_date": "2023-07-19T08:19:05.173000", "content": "The version of the notebook i planned to submit was the 14th version. I ran it again , a minute before the deadline,(11:58)but having to deal with the errors took more time. The feedbacks were already there just couldn't get it to run and save the CSV. I thought about copying and pasting manually in the excel template but my excel has a product failure problem meaning I'd have to switch tabs to Google sheets so I went with the code version. Looks like the alternative might have been more ideal. Wouldn't have run into errors.
", "votes": 0, "replies": [ { "id": 2350442, "author_name": "Orere Israel", "author_url": "", "post_date": "2023-07-19T08:21:18.947000", "content": "Here's the link to the notebook to verify the time I ran it https://www.kaggle.com/competitions/2023-kaggle-ai-report
", "votes": 0, "replies": [ { "id": 2350447, "author_name": "Bhargav6031", "author_url": "", "post_date": "2023-07-19T08:26:36.050000", "content": "Yup same problem. I think it would be fair to consider the last run version of the notebook instead of the submitted version almost everyone has done the same mistake but they haven't realized it yet.
", "votes": 0, "replies": [] }, { "id": 2350540, "author_name": "FlappyJack", "author_url": "", "post_date": "2023-07-19T09:35:20.897000", "content": "I agree. Notebooks that were run before the deadline in accordance with the rules should be accepted, because many of us have updated our notebooks but did not submit them. Of course I don't mean notebooks that were updated after the deadline.
", "votes": 0, "replies": [] } ] } ] }, { "id": 2347463, "author_name": "Chinmaya Y N", "author_url": "", "post_date": "2023-07-17T02:04:35.280000", "content": "Hi @paultimothymooney similar case with the others too as for many of them its their first competition they don't know that we can submit each version to competition. Hence our request is to consider most most recent version of the recet submitted notebook… Hoping that they get a fair chance as it isn't their fault.
", "votes": 0, "replies": [ { "id": 2347835, "author_name": "Chinmaya Y N", "author_url": "", "post_date": "2023-07-17T08:30:01", "content": "@wcukierski please have a look into this matter. We are still confused. Whether most recent version before deadline is considered for submission or the the version which was submitted ??. Many of them submitted a version as a sample for peer evaluation thinking that the most recent version in that notebook will be considered automatically. We haven't submitted separately the recent one. Hence you can see that almost all of them have a single submission, where they have submitted once and they kept on editing the same notebook thinking that most recent version of that notebook will be considered for the evaluation. Please consider most recent version of the notebook before deadline, as most of them has put months of research and work and many of them are first time attendees of the kaggle competition. Although they have a very good essay they can't be eliminated due to misunderstanding of the rules.
", "votes": 0, "replies": [] }, { "id": 2349959, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-18T20:13:38.533000", "content": "Your most recent submission.csv file is the file that will be used to retrieve your essay URL and your peer feedback URLs. For additional detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
", "votes": 0, "replies": [] } ] }, { "id": 2347429, "author_name": "Vcol", "author_url": "", "post_date": "2023-07-17T00:34:33.297000", "content": "\nHello Paul,
\nThis is my first time to participate in analytics competition.
\nI have submitted a series:
\nI understand the deadline is 11:59pm UTC.
\nIs it correct that only version X will be used by the panel when judging but we may continue to improve the notebook for all other readers?
\nThanks a lot!
", "votes": 0, "replies": [ { "id": 2349954, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-18T20:10:04.053000", "content": "Your most recent submission.csv file is the file that will be used to retrieve your essay URL and your peer feedback URLs. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
", "votes": 0, "replies": [] } ] }, { "id": 2347416, "author_name": "Bhargav6031", "author_url": "", "post_date": "2023-07-17T00:10:05.200000", "content": "Hi @paultimothymooney. I had a Notebook which i submitted as testing. I thought that it would be enough. Now 2 mins before competition ends when I saw the submissions it was still showing the old version of the same notebook. Even though I made 15 versions of it I didn't submit it as I thought submission of one version is enough whichever is the new version it will be considered for submission. When I submitted my new version 2mins before the deadline it took 21 secs to show up on the submission portal. What can I do Now. I've done research regarding this essays for weeks. I have clicked the submit button before the deadline but submission happened after deadline . Please consider my submisssion .
You can see from the image that my notebooks submission time is exactly the same as the time from deadline which is 17min ago.
", "votes": 0, "replies": [ { "id": 2349948, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-18T20:07:48.240000", "content": "Submissions need to be received prior to the deadline in order to be considered valid. For more detail you can refer to https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
", "votes": 0, "replies": [] } ] }, { "id": 2340277, "author_name": "CroDoc", "author_url": "", "post_date": "2023-07-11T11:41:54.727000", "content": "I noticed that in my first submission, the dataset Meta Kaggle disappeared. It says it has been deleted. I had to remove it and reattach it again in v2 (when submitting feedback review links). This seems strange. @paultimothymooney
\n
The Meta Kaggle dataset gets deleted and re-created daily (for compliance reasons). It is still there, and the notebook should still run as-is, but the data file tree explorer will get confused and say that the dataset is no longer available. I'll try to remember to respond to this message eventually when that gets fixed.
", "votes": 2, "replies": [ { "id": 2340525, "author_name": "Dustin", "author_url": "", "post_date": "2023-07-11T14:35:19.913000", "content": "@crodoc Was your notebook \"running\" when you saw this or were you editing while it was \"off\"?
\nI had written code a couple years back to at least detect when this happens when a notebook turns \"on\" and autoupdate missing dataset versions.
Thanks for the answear!
", "votes": 0, "replies": [] }, { "id": 2340587, "author_name": "CroDoc", "author_url": "", "post_date": "2023-07-11T15:09:29.803000", "content": "@herbison I am not sure. I think I was editing it while it was off.
", "votes": 0, "replies": [] }, { "id": 2340596, "author_name": "Dustin", "author_url": "", "post_date": "2023-07-11T15:13:59.743000", "content": "@crodoc Thanks, you'll likely see this happen again in the next 24hr when the dataset gets updated again.
\nTry turning the notebook on and seeing if it auto fixes it, let me know if you continue to have trouble after that. Thanks!
In the description, it says it is updated every day, but seems the last update was 4 days ago. Since there was no update, the dataset is still available. Will share what happens after the dataset gets updated.
\n
Thanks, I'm guessing the pipeline that generates it has an error, I'll take a look. Thanks for reporting!
", "votes": 2, "replies": [] }, { "id": 2346588, "author_name": "CroDoc", "author_url": "", "post_date": "2023-07-16T11:11:48.983000", "content": "Still no updates to meta kaggle.
\n
@herbison the dataset was refreshed, it is deleted in my latest submission, but when I edit the notebook and turn it on, it seems to update the missing dataset (although not immediately)
", "votes": 1, "replies": [] } ] } ] }, { "id": 2335812, "author_name": "Miles", "author_url": "", "post_date": "2023-07-08T20:01:38.380000", "content": "Hi all,
\nI am relatively new to Kaggle. Made my first official submission to any competition with my essay \"Time Series Forecasting: Is Simplicity the Key?\". When I was creating my notebook I had issues figuring out how best to bring images into markdown that are centered, and without hosting images somewhere outside of Kaggle. However, I found a cheeky way of creating a dataset with the images on Kaggle and copying the image address directly into markdown. Seemed to be working fine. However, today I noticed some of my image links had broken and had to go through to update the links. Seems whatever server the dataset is on had shifted address, or at least the images had changed address. Thinking this may cause issues going forward…. and was curious if anyone had found a solution similar that worked long-term? Thanks in advance!
If you drag and drop images into your markdown cells then the notebook will break. Instead, you should upload your images to file hosting websites such as imgur.com or GitHub, and then you should use markdown cells to display those images (e.g. ). If you prefer to use Kaggle Datasets rather than a dedicated image hosting platform to store your images, you'll need to use Python or R code to display the images (e.g. from IPython.display import Image).
\nHopefully that helps!
", "votes": 1, "replies": [ { "id": 2337396, "author_name": "Miles", "author_url": "", "post_date": "2023-07-10T05:13:54.547000", "content": "Thanks so much!
", "votes": 0, "replies": [] } ] } ] }, { "id": 2335616, "author_name": "SN", "author_url": "", "post_date": "2023-07-08T16:57:23.503000", "content": "There are a lot of notebooks without a submission. Will my reviews be eligible even if the authors of the essays do not make a new submission?
\nSecond question: are reviews left before 5th July eligible? If not, can I leave a review on the essay that already has 3 or more reviews, each of which was left before 5th July?
", "votes": 0, "replies": [ { "id": 2336514, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-09T12:08:54.440000", "content": "You are required to leave 3 thoughtful comments on 3 essays that were written in the same category as what you wrote about yourself. In the rare event that someone publishes an essay in your category but does not submit it, there will be no impact on your submission or your eligibility. Comments left before July 5th do indeed count, so long as they are comments left on actual essays from your peers (as guided by the peer-feedback rubric).
", "votes": 0, "replies": [ { "id": 2336654, "author_name": "SN", "author_url": "", "post_date": "2023-07-09T14:04:12.497000", "content": "Thank you very much for the clarification!
", "votes": 0, "replies": [] } ] } ] }, { "id": 2333153, "author_name": "Ansh Tanwar", "author_url": "", "post_date": "2023-07-06T17:23:38.793000", "content": "I want to ask is it necessary to write a general essay on the topic or can we choose a topic and write on its subdomain. For example, in Ai Ethics can I write my complete essay on AI Ethics in Credit Risk Prediction. ?
", "votes": 0, "replies": [ { "id": 2334533, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-07T18:39:20.143000", "content": "Ultimately the goal is to respond to one of the 7x prompts in a way that will score highest against the evaluation rubric, and the prompt begins with \"what the ML community has learned over the past 2 years of working with…\", which is a fairly broad mandate.
\nAn essay that comprehensively summarizes the recent advancements in a given area will likely score higher than an essay that has a comparatively narrow focus. It still sounds like an interesting topic that could score well against the evaluation rubric though.
", "votes": 0, "replies": [] } ] }, { "id": 2333134, "author_name": "Leonie", "author_url": "", "post_date": "2023-07-06T17:15:23.650000", "content": "Is there any shortcut/trick to find all submissions in a category?
\nFrom the title it is not always clear which category a submission belongs to and I think some Notebooks are not submissions. That's why I think going through every Notebook in this competition to find submissions to review is the brute force way to go - and I think we don't like doing things the brute force way around here :)
\nI hope there is a simpler way. Please someone tell me.
", "votes": 0, "replies": [ { "id": 2334520, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-07T18:32:14.240000", "content": "We won't have a final list of the submissions and the categories until the July 16 deadline. For example, a large fraction of the leaderboard submitted to us only placeholder values and they have until July 16th to update those submission.csv files with the appropriate URLs. As such, it is too early to exclude any public notebooks from our search.
\nMy recommended method for finding essays to provide peer-feedback to would be as follows:
\nAlternatively, here is a preliminary list of all of the public notebooks, sorted by category, such that you can quickly filter to see only your chosen category.
\nHopefully that helps!
", "votes": 2, "replies": [ { "id": 2334672, "author_name": "Gouri Prakash", "author_url": "", "post_date": "2023-07-07T21:42:47.973000", "content": "This is really helpful Paul. Thanks for sharing the link.
", "votes": 1, "replies": [] }, { "id": 2335609, "author_name": "", "author_url": "", "post_date": "2023-07-08T16:50:53.643000", "content": "", "votes": 0, "replies": [] }, { "id": 2337507, "author_name": "Leonie", "author_url": "", "post_date": "2023-07-10T06:39:02.620000", "content": "Very helpful, Paul. Thank you!
", "votes": 0, "replies": [] } ] } ] }, { "id": 2330539, "author_name": "Cynthia Onyinyechi Aniobi", "author_url": "", "post_date": "2023-07-05T04:25:22.060000", "content": "Please can anyone tell me how to upload an output. I don't understand it
", "votes": 0, "replies": [ { "id": 2331380, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-05T14:05:05.397000", "content": "Your essay should be in a public Kaggle Notebook. For information about Kaggle notebooks see https://www.kaggle.com/docs/notebooks.
\nYour submission is a CSV file named submission.csv and in that CSV file you will put a URL that points to your public notebook. This is described in detail at https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
\nYou can find additional instructions on the competition overview, data, evaluation, submission instructions, and timeline pages.
\nHopefully that helps!
", "votes": 0, "replies": [] } ] }, { "id": 2330045, "author_name": "Nghi Huynh", "author_url": "", "post_date": "2023-07-04T17:17:17.670000", "content": "Hi Paul,
\nCan we choose which version of the notebook we want to submit? And how does the Kaggle team select a submission if we make multiple submissions? Also, can I modify the peer feedback urls and resubmit after the initial deadline? Thank you!
We will grade your team's most recent submission only. Your most recent submission will be a new submission, received during the peer feedback period which is July 5 to July 16 (most likely towards the very end of it since you'll need to give yourself time to provide 3x thoughtful comments on 3x peer essays -- and many or most of the essays won't be made public until July 5th). Please ensure you submit a final, updated file once you have completed your peer feedback. This is in addition to needing to make the notebook that contains your essay public prior to July 5th in order to make the essay itself visible during the peer feedback period (and in order to be eligible for the final prizes). For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions and https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
\nYes, you can reference specific versions of notebooks (or pin your notebook to a specific version within the notebook editor UI).
", "votes": 1, "replies": [] } ] }, { "id": 2329546, "author_name": "BHAVYA SREE SUNDURU", "author_url": "", "post_date": "2023-07-04T10:25:08.040000", "content": "Hello Everyone, I'm facing difficulties in submitting my work on Generative AI and I mentioned them below. Please take a look into that if possible
\nI have run into this same issue. One of the things I tried is converting all of my .PNG files to .JPEG files. That compressed some of the figures I am using in the notebook.
", "votes": 0, "replies": [ { "id": 2330324, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-04T22:37:04.593000", "content": "Q1: What should I do if my notebook is a really large size?
\nA1: The most common reason for large notebook sizes is dragging and dropping images into the markdown cells rather than using markdown language to reference URLs that contain your images (e.g. ). To fix this issue, upload your images to a file hosting website such as imgur.com or GitHub and then reference those URLs using markdown.
Q2: Should I convert my notebook from .ipynb to .csv?
\nA2: No, just include a link to the URL that points to the public Kaggle notebook that contains your essay. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions.
Q3: What are the submission instructions?
\nA3: The most straightforward workflow to get the competition submission to work is likely going to be as follows: (0) download the sample_submission.csv file from the ./data tab; (1) replace the URLs in sample_submission.csv with your actual URLs; (2) save and rename the file as submission.csv; and then (3) submit your submission.csv file by uploading it into the \"Submit Predictions\" module. The submission.csv file is a small file that gives us 4 important URLs: the URL that points to the public notebook that contains your essay; and, eventually, in your final submission, the 3x URLs that point to the 3x thoughtful comments that you provided on 3x peer essays. For more detail see the submission instructions page as well as the competition overview, data, evaluation, and timeline.
Yes I have done it. Thanks for helping me out.
", "votes": 0, "replies": [] } ] } ] }, { "id": 2325305, "author_name": "Bhargav6031", "author_url": "", "post_date": "2023-07-01T08:41:28.923000", "content": "Hi @paultimothymooney ,
\nI majorly work on Robotics. I've written essay on AI for Robotics which describes the recent advancements in the field of Robotics with the help of AI. Eligibility checklist says 'The essay was relevant to one of the 7x pre-defined topics'. Just for confirmation, Can my essay be considered under the 'others' category ?? Can I submit this essay ?? Or it should be only related to those topics related to pure AI ….
", "votes": 0, "replies": [ { "id": 2325504, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-07-01T12:19:11.627000", "content": "Yes, this is a great topic for the \"other\" category. Anything that doesn't fit neatly into any of the other categories, such as field-specific essays that span multiple categories, will fit best in the \"other\" category.
", "votes": 0, "replies": [] } ] }, { "id": 2320620, "author_name": "Kobe Python", "author_url": "", "post_date": "2023-06-28T01:05:47.947000", "content": "Can you clarify the deadline for making the notebook publicly available for peer feedback - is it July 4 before the feedback process starts or does July 5 work as well?
", "votes": 0, "replies": [ { "id": 2321555, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-06-28T16:59:12.110000", "content": "All deadlines are at 11:59 PM UTC on the corresponding day unless otherwise noted. The July 5th deadlines are therefore July 5, 2023 11:59 PM UTC. For more detail see https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline.
", "votes": 2, "replies": [ { "id": 2322045, "author_name": "Nghi Huynh", "author_url": "", "post_date": "2023-06-29T03:52:54.020000", "content": "Hi @paultimothymooney, I notice that there's a note under the code section that says not to publish any high scoring public notebook until it ends. However, the deadline is still 7 days from now (July 5, 2023). I wonder if I can still make my notebook public before the deadline. Thank you!
", "votes": 2, "replies": [] }, { "id": 2322901, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-06-29T15:04:22.073000", "content": "We will remove the alert shortly, thank you for bringing it to our attention. In the meantime, please ignore the alert and feel free to mark your notebook as public.
", "votes": 1, "replies": [] } ] } ] }, { "id": 2320576, "author_name": "FlappyJack", "author_url": "", "post_date": "2023-06-27T22:36:12.520000", "content": "Hello! Can I ask if there are any word limitations? Can we submit essays containing hundreds of pages for example 😄?
", "votes": 0, "replies": [ { "id": 2321551, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-06-28T16:55:38.380000", "content": "There is not a strict word limit (although the evaluation rubric does encourage you to be \"concise\"). Recently a similar competition had a 2000 word limit, which seems consistent with common recommendations from journals. I think much shorter essays could also score very well against our evaluation rubric, though.
", "votes": 1, "replies": [ { "id": 2322761, "author_name": "FlappyJack", "author_url": "", "post_date": "2023-06-29T13:35:07.180000", "content": "thank you!!
", "votes": 0, "replies": [] } ] } ] }, { "id": 2320283, "author_name": "Anagha", "author_url": "", "post_date": "2023-06-27T16:52:08.067000", "content": "Hello, should the updates made to our essay after the start of the feedback period be based only upon the feedback received, or can we continue to add novel content to our essay up until the final submission deadline?
", "votes": 0, "replies": [ { "id": 2321568, "author_name": "Paul Mooney", "author_url": "", "post_date": "2023-06-28T17:11:56.150000", "content": "Participants are expected to submit final drafts rather than works-in-progress, and updates in response to peer-feedback should be relatively minor, focusing predominantly on addressing the feedback that was received.
\nIf your final essay does not resemble your original submission then you will not have satisfied the requirement of sharing your essay in a public manner in advance of the relevant deadline.
", "votes": 0, "replies": [ { "id": 2321686, "author_name": "Anagha", "author_url": "", "post_date": "2023-06-28T19:08:29.150000", "content": "Got it thanks!
", "votes": 0, "replies": [] }, { "id": 2325514, "author_name": "Anthony Wynne", "author_url": "", "post_date": "2023-07-01T12:27:28.630000", "content": "I was going to ask a similar question. Can we have some clarity on how much change is allowed between the 5th of July and the final deadline? Is it a % change, or no new sections type of rule? No new diagrams? Do we have to directly connect changes to feedback or can they be unconnected improvements? I’m asking as 10 days is a long time to reflect and improve the draft. Will any penalty for making changes be at the subjective discretion of the judges?
", "votes": 3, "replies": [] }, { "id": 2331820, "author_name": "Niyamat Ullah", "author_url": "", "post_date": "2023-07-05T19:48:20.740000", "content": "@paultimothymooney any thoughts?
", "votes": 0, "replies": [] } ] } ] }, { "id": 2319089, "author_name": "Devin Horvay", "author_url": "", "post_date": "2023-06-26T20:32:08.770000", "content": "I have two questions:
\nsubmission.csv with placeholders for peer reviews before this date?Q1: No, each team should write a single essay focusing on a single topic. For more details see the submission instructions page.
\nQ2: Yes, if you have not yet provided peer-feedback then you will want to include placeholder URLs in your submission.csv file. For more details see the submission instructions page.
\nQ3: Yes, authors are encouraged to make updates in response to peer feedback received prior to the final submission deadline. For more details see the timeline page.
\nHopefully that helps!
", "votes": 1, "replies": [ { "id": 2319199, "author_name": "Devin Horvay", "author_url": "", "post_date": "2023-06-27T01:17:51.810000", "content": "Thanks, so much @paultimothymooney ! Super helpful response - cleared up everything. Excited to participate in this event!
", "votes": 1, "replies": [] } ] } ] }, { "id": 2309866, "author_name": "", "author_url": "", "post_date": "2023-06-20T00:18:11.560000", "content": "", "votes": 0, "replies": [ { "id": 2310701, "author_name": "", "author_url": "", "post_date": "2023-06-20T14:59:05.113000", "content": "", "votes": 1, "replies": [ { "id": 2310769, "author_name": "", "author_url": "", "post_date": "2023-06-20T15:41:08.623000", "content": "", "votes": 0, "replies": [] } ] } ] }, { "id": 2305688, "author_name": "", "author_url": "", "post_date": "2023-06-16T21:08:41.587000", "content": "", "votes": 0, "replies": [] }, { "id": 2296199, "author_name": "", "author_url": "", "post_date": "2023-06-11T16:02:36.363000", "content": "", "votes": 0, "replies": [ { "id": 2297453, "author_name": "", "author_url": "", "post_date": "2023-06-12T15:39:24.797000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2294395, "author_name": "", "author_url": "", "post_date": "2023-06-10T03:29:52.807000", "content": "", "votes": 0, "replies": [ { "id": 2297446, "author_name": "", "author_url": "", "post_date": "2023-06-12T15:28:44.310000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2288027, "author_name": "", "author_url": "", "post_date": "2023-06-05T06:08:51.450000", "content": "", "votes": 0, "replies": [ { "id": 2288851, "author_name": "", "author_url": "", "post_date": "2023-06-05T18:00:59.437000", "content": "", "votes": 0, "replies": [ { "id": 2293278, "author_name": "", "author_url": "", "post_date": "2023-06-09T04:36:29.207000", "content": "", "votes": 3, "replies": [] } ] } ] }, { "id": 2285219, "author_name": "", "author_url": "", "post_date": "2023-06-02T14:34:41.180000", "content": "", "votes": 0, "replies": [ { "id": 2285237, "author_name": "", "author_url": "", "post_date": "2023-06-02T14:52:22.717000", "content": "", "votes": 0, "replies": [ { "id": 2286034, "author_name": "", "author_url": "", "post_date": "2023-06-03T07:27:59.253000", "content": "", "votes": 0, "replies": [] } ] } ] }, { "id": 2284478, "author_name": "", "author_url": "", "post_date": "2023-06-02T04:33:55.197000", "content": "", "votes": 0, "replies": [ { "id": 2285261, "author_name": "", "author_url": "", "post_date": "2023-06-02T15:11:54.567000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2283500, "author_name": "", "author_url": "", "post_date": "2023-06-01T09:49:32.800000", "content": "", "votes": 0, "replies": [ { "id": 2283977, "author_name": "", "author_url": "", "post_date": "2023-06-01T16:32:16.010000", "content": "", "votes": 1, "replies": [ { "id": 2285684, "author_name": "", "author_url": "", "post_date": "2023-06-02T22:39:54.883000", "content": "", "votes": 1, "replies": [] } ] } ] }, { "id": 2283199, "author_name": "", "author_url": "", "post_date": "2023-06-01T05:55:03.213000", "content": "", "votes": 0, "replies": [ { "id": 2283966, "author_name": "", "author_url": "", "post_date": "2023-06-01T16:24:27.773000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2274375, "author_name": "", "author_url": "", "post_date": "2023-05-25T23:15:50.057000", "content": "", "votes": 0, "replies": [ { "id": 2276156, "author_name": "", "author_url": "", "post_date": "2023-05-26T14:47:33.297000", "content": "", "votes": 1, "replies": [ { "id": 2276500, "author_name": "", "author_url": "", "post_date": "2023-05-26T22:31:55.457000", "content": "", "votes": 1, "replies": [] } ] } ] }, { "id": 2272615, "author_name": "", "author_url": "", "post_date": "2023-05-24T15:56:04.793000", "content": "", "votes": 0, "replies": [ { "id": 2272668, "author_name": "", "author_url": "", "post_date": "2023-05-24T16:26:52.023000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2271900, "author_name": "", "author_url": "", "post_date": "2023-05-24T07:26:55.517000", "content": "", "votes": 0, "replies": [ { "id": 2272483, "author_name": "", "author_url": "", "post_date": "2023-05-24T14:27:27.830000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2268317, "author_name": "", "author_url": "", "post_date": "2023-05-21T16:26:55.240000", "content": "", "votes": 0, "replies": [ { "id": 2269565, "author_name": "", "author_url": "", "post_date": "2023-05-22T14:45:02.507000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2266490, "author_name": "", "author_url": "", "post_date": "2023-05-20T06:08:44.673000", "content": "", "votes": 0, "replies": [ { "id": 2269561, "author_name": "", "author_url": "", "post_date": "2023-05-22T14:43:07.473000", "content": "", "votes": 1, "replies": [] } ] }, { "id": 2260518, "author_name": "", "author_url": "", "post_date": "2023-05-15T17:42:15.163000", "content": "", "votes": 0, "replies": [ { "id": 2260644, "author_name": "", "author_url": "", "post_date": "2023-05-15T19:14:55.460000", "content": "", "votes": 1, "replies": [] } ] }, { "id": 2258293, "author_name": "", "author_url": "", "post_date": "2023-05-14T04:45:54.223000", "content": "", "votes": 0, "replies": [ { "id": 2260263, "author_name": "", "author_url": "", "post_date": "2023-05-15T15:08:02.333000", "content": "", "votes": 1, "replies": [] } ] }, { "id": 2256679, "author_name": "", "author_url": "", "post_date": "2023-05-12T16:45:21.340000", "content": "", "votes": 0, "replies": [ { "id": 2256696, "author_name": "", "author_url": "", "post_date": "2023-05-12T16:56:00.663000", "content": "", "votes": 1, "replies": [ { "id": 2256705, "author_name": "", "author_url": "", "post_date": "2023-05-12T17:03:49.447000", "content": "", "votes": 1, "replies": [] }, { "id": 2256726, "author_name": "", "author_url": "", "post_date": "2023-05-12T17:10:33.537000", "content": "", "votes": 1, "replies": [] }, { "id": 2256730, "author_name": "", "author_url": "", "post_date": "2023-05-12T17:16:04.060000", "content": "", "votes": 6, "replies": [] }, { "id": 2277430, "author_name": "", "author_url": "", "post_date": "2023-05-27T18:08:45.753000", "content": "", "votes": 1, "replies": [] } ] } ] }, { "id": 2392248, "author_name": "", "author_url": "", "post_date": "2023-08-15T14:55:29.340000", "content": "", "votes": 0, "replies": [] }, { "id": 2356083, "author_name": "", "author_url": "", "post_date": "2023-07-23T21:40:38.850000", "content": "", "votes": 0, "replies": [] }, { "id": 2350339, "author_name": "", "author_url": "", "post_date": "2023-07-19T07:15:34.437000", "content": "", "votes": 0, "replies": [] }, { "id": 2347699, "author_name": "", "author_url": "", "post_date": "2023-07-17T06:23:28.340000", "content": "", "votes": 0, "replies": [ { "id": 2349965, "author_name": "", "author_url": "", "post_date": "2023-07-18T20:18:47.977000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2344689, "author_name": "", "author_url": "", "post_date": "2023-07-14T17:32:00.710000", "content": "", "votes": 0, "replies": [ { "id": 2346025, "author_name": "", "author_url": "", "post_date": "2023-07-15T23:46:26.717000", "content": "", "votes": 0, "replies": [] } ] }, { "id": 2331809, "author_name": "", "author_url": "", "post_date": "2023-07-05T19:37:58.143000", "content": "", "votes": 1, "replies": [ { "id": 2331836, "author_name": "", "author_url": "", "post_date": "2023-07-05T20:16:37.157000", "content": "", "votes": 1, "replies": [] } ] }, { "id": 2258696, "author_name": "", "author_url": "", "post_date": "2023-05-14T12:22:18.397000", "content": "", "votes": 0, "replies": [] } ], "raw_markdown_by_id": { "2212483": "Ask questions about the 2023 Kaggle AI Report Competition in this thread for better visibility by the Kaggle Team. Please make sure that you have reviewed all of the pages on the competition [overview](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview), [data](https://www.kaggle.com/competitions/2023-kaggle-ai-report/data), [evaluation](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/evaluation), [submission instructions](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/submission-instructions), and [timeline](https://www.kaggle.com/competitions/2023-kaggle-ai-report/overview/timeline) pages prior to asking your questions! \n\n", "2256215": "I don't have a question, but I do want to express that subjective evaluations in competitions category just dilutes competitions category. Perhaps a separate category for this analytics competitions would be better.", "2330387": "When can we expect the final results?", "2322832": "I am seeing this alert, that indicates, \"Do not publish new notebooks during the final week of a competition\". Should we just ignore this alert?", "2335801": "Hi,\n\n@paultimothymooney I have a Question:\n\n1. I have seen a lot of notebooks with version updates(significant changes) after the comments are added in the peer review process(adding multiple new sections, rewriting entire sections, adding more content, etc). Would these notebooks be eligible for rewards i.e. can we do significant updates to our notebooks after the review process?", "2327829": "1) Can I still submit new submission now, even when the deadline for making notebook publicly available for peer review is over?\n\n2) What if I successfully provide 3 reviews to my peers but I do not get 3 peer reviews on my work? Would it affect my score?", "2282592": "I saw in the rules, you must display parental consent if not at the age of 18. How would I go about this. I would really appreciate some clarification as I am not yet 18. ", "2271968": "Good day community, I recently joined this competition and as expected I have a number of questions.\nMy first question is did I join the competition at a wrong time as the competition has been on for a couple of days now.\nMy second question is a number of topics where listed and it was Indicated that the essay be written under these topics, my question here is does a competitor pick just a single topic or the essay be structured around these topics. \nMy third and last question is how do I get paired with a team, and if I don't have a team can I compete solo?\nThanks in anticipation to your favourable response.", "2258622": "Why is this part of the competitive track? What is so competitive in essay writing? It can be useful, educational, etc, but competitive?", "2255798": "I noticed that Kaggle encourages participating team members to first submit a 'blank' template to indicate their desire to participate in the competition, but the 'sample_submission.csv' file of the instance is not sufficient to submit to LB. What are the specific requirements for submitting LB files?", "2392249": "Hi, \nI have a question @paultimothymooney regarding my notebook, It was made public before the deadline and appears in the [dataset](https://www.kaggle.com/datasets/paultimothymooney/list-of-public-notebooks-ai-report-competition), but it did not receive a score on the Leaderboard. Also all versions of submitted notebooks show error under submission tab. It would be greatly appreciated if you could provide insights into why this might have happened, as it would help me avoid making similar mistakes in the future\n\nMy notebook -[link](https://www.kaggle.com/code/kavisekar/latest-development-in-time-series-analysis-report/notebook)", "2354953": "weird that the last version of my notebook(which i tried to submit before the deadline)couldn't generate the csv i needed to submit especially so when all of my peer review feedbacks were on that version. 😑", "2352107": "Hello @paultimothymooney, are we still allowed to update our notebooks even after the final deadline? I noticed we can do that without having to submit again. ", "2350439": "The version of the notebook i planned to submit was the 14th version. I ran it again , a minute before the deadline,(11:58)but having to deal with the errors took more time. The feedbacks were already there just couldn't get it to run and save the CSV. I thought about copying and pasting manually in the excel template but my excel has a product failure problem meaning I'd have to switch tabs to Google sheets so I went with the code version. Looks like the alternative might have been more ideal. Wouldn't have run into errors.", "2347463": "Hi @paultimothymooney similar case with the others too as for many of them its their first competition they don't know that we can submit each version to competition. Hence our request is to consider most most recent version of the recet submitted notebook... Hoping that they get a fair chance as it isn't their fault.", "2347429": "@paultimothymooney \n\nHello Paul,\n\nThis is my first time to participate in analytics competition.\n\nI have submitted a series: \n- 11:55pm - version X\n- 11:59pm - version Y\n- 12:21am - version Z\n- ...\n\nI understand the deadline is 11:59pm UTC. \n\nIs it correct that only ****version X**** will be used by the panel when judging but we may continue to improve the notebook for all other readers?\n\nThanks a lot!", "2347416": "Hi @paultimothymooney. I had a Notebook which i submitted as testing. I thought that it would be enough. Now 2 mins before competition ends when I saw the submissions it was still showing the old version of the same notebook. Even though I made 15 versions of it I didn't submit it as I thought submission of one version is enough whichever is the new version it will be considered for submission. When I submitted my new version 2mins before the deadline it took 21 secs to show up on the submission portal. What can I do Now. I've done research regarding this essays for weeks. I have clicked the submit button before the deadline but submission happened after deadline . Please consider my submisssion .\n\nYou can see from the image that my notebooks submission time is exactly the same as the time from deadline which is 17min ago.", "2340277": "I noticed that in my first submission, the dataset [Meta Kaggle](https://www.kaggle.com/datasets/kaggle/meta-kaggle) disappeared. It says it has been deleted. I had to remove it and reattach it again in v2 (when submitting feedback review links). This seems strange. @paultimothymooney \n\n", "2335812": "Hi all,\nI am relatively new to Kaggle. Made my first official submission to any competition with my essay \"Time Series Forecasting: Is Simplicity the Key?\". When I was creating my notebook I had issues figuring out how best to bring images into markdown that are centered, and without hosting images somewhere outside of Kaggle. However, I found a cheeky way of creating a dataset with the images on Kaggle and copying the image address directly into markdown. Seemed to be working fine. However, today I noticed some of my image links had broken and had to go through to update the links. Seems whatever server the dataset is on had shifted address, or at least the images had changed address. Thinking this may cause issues going forward.... and was curious if anyone had found a solution similar that worked long-term? Thanks in advance!", "2335616": "There are a lot of notebooks without a submission. Will my reviews be eligible even if the authors of the essays do not make a new submission? \n\nSecond question: are reviews left before 5th July eligible? If not, can I leave a review on the essay that already has 3 or more reviews, each of which was left before 5th July? \n\n", "2333153": "I want to ask is it necessary to write a general essay on the topic or can we choose a topic and write on its subdomain. For example, in Ai Ethics can I write my complete essay on AI Ethics in Credit Risk Prediction. ?", "2333134": "Is there any shortcut/trick to find all submissions in a category?\n\nFrom the title it is not always clear which category a submission belongs to and I think some Notebooks are not submissions. That's why I think going through every Notebook in this competition to find submissions to review is the brute force way to go - and I think we don't like doing things the brute force way around here :)\n\nI hope there is a simpler way. Please someone tell me.", "2330539": " Please can anyone tell me how to upload an output. I don't understand it ", "2330045": "Hi Paul,\nCan we choose which version of the notebook we want to submit? And how does the Kaggle team select a submission if we make multiple submissions? Also, can I modify the peer feedback urls and resubmit after the initial deadline? Thank you!", "2329546": "Hello Everyone, I'm facing difficulties in submitting my work on Generative AI and I mentioned them below. Please take a look into that if possible \n1. My Jupyter notebook is of 15 MB size I could not submit the notebook as it exceeded the limit of 14MB.\n2. Should I covert my notebook into csv file for submission?\n3. I couldn't understand the process of submitting my work.\nGuiding me through submission is appreciated.", "2325305": "Hi @paultimothymooney ,\n\nI majorly work on Robotics. I've written essay on **AI for Robotics** which describes the recent advancements in the field of Robotics with the help of AI. Eligibility checklist says 'The essay was relevant to one of the 7x pre-defined topics'. Just for confirmation, Can my essay be considered under the 'others' category ?? Can I submit this essay ?? Or it should be only related to those topics related to pure AI ....", "2320620": "Can you clarify the deadline for making the notebook publicly available for peer feedback - is it July 4 before the feedback process starts or does July 5 work as well?\n", "2320576": "Hello! Can I ask if there are any word limitations? Can we submit essays containing hundreds of pages for example 😄?", "2320283": "Hello, should the updates made to our essay after the start of the feedback period be based only upon the feedback received, or can we continue to add novel content to our essay up until the final submission deadline?", "2319089": "I have two questions:\n1. Are you allowed to submit multiple essays? (I would like to submit an essay on one of the well-defined category and also a more \"experimental\" essay on the \"other\" category)\n2. I see peer review starts on July 5th. Is the expectation you submit the ```submission.csv``` with placeholders for peer reviews before this date?", "2309866": "Can we use images that are published in other articles and cite the source of the image?", "2305688": "I seem to recall that the 7 judges are assigned one per area, and each judge will grade only the papers in that area. If that's the case, can you release names of the judges for each category?\n\nAssume that each judge has different preferences and ideas on what \"good\" looks like:\n- If you release names, then we can game the system and submit to a judge most likely to favor our submission.\n- If you don't, there's an element of randomness that depends on which category we pick.\n\nI haven't read enough to know how the peer evals work, so maybe that's an offsetting factor.", "2296199": "Under the Kaggle Competitions topic, can the essay also discuss popular approaches and trends observed in the competitions from the past two years? Or solely the impacts following the competitions?", "2294395": "Hi, I've heard that if one of the teammates is a Google employee, the whole team will not get the cash 10K prize. Is that true or not? Do we have that policy?", "2288027": "Hi admins, I'm curious in \n> Winning essays will be aggregated in a post-competition publication and given authorship credit.\n\nDo we plan to submit the post-competition publication to a peer-reviewed venue (e.g. KDD) in order to receive broader attention? Thanks in advance!", "2285219": "Hello, I had three questions regarding essays in the kaggle competitions category:\n\n1)Is the essay supposed to provide an overall summary/summary statistics of kaggle competitions over the past two years or is it supposed to focus more on the impact that these have had on the ML community's advancements?\n2)Must the essay detail only the positive aspects of these competitions or can their flaws be written about as well?\n3)Can subjective opinions be included in the essay?\n\nWaiting on your reply,\nCheers!", "2284478": "Hi everyone,\nI'm relatively new to Kaggle, but I have experience in biochemistry research. I have been pondering the idea of writing an essay in the \"Other\" category, specifically focused on the Applications of Artificial Intelligence in Biomedicine and highlighting the recent advancements.\n\nIn order to produce a high-quality research paper, I am currently seeking 2-3 like-minded individuals who share a passion for this topic to form a team and work on this project together. If you have a genuine interest in this field, I would be thrilled to have you join me in this project.", "2283500": "Hi , thanks for running this competition, great idea and a nice way to mix things up!\n\nI just had a question about the licensing or restrictions (if any) on submitted essays? I see winning essays will be treated under an Apache 2.0 licence, but wondered about the non-winning essays, if the entrant felt they might want to share elsewhere or similar would that present a problem? Thanks in advance!", "2283199": "Is there a cut-off year for what's considered \"recent\" research?\n\nThe context of the competition mentions summarizing recent AI advances from the past 2 years, but the eligibility criteria says over the past 3 years. I am wondering if there would be a hard-line on what's considered a recent advance, e.g. if I cite a paper from 2019 is that considered too far in the past?\n\nI'm assuming any paper from 2020 is ok, but please let me know if that's not the case.", "2274375": "Hello! I saw that we are encouraged to submit early, even with placeholders, to help show how many will be entering the competition. This is the first time I really try at a competition. At the moment, my notebook is private. I saw that submitting will run a new version. Does submitting also make the notebook public?", "2272615": "Hi , I am inquiring about plagiarism and cheating rules , for example does it is permitted to read articles ,watching tutorials , Use resources and see the notebooks of competitors ?", "2271900": "I meet a problem, when I trying to host a discussion, it gives \"Internal error/Too many requests\", and I cannot publish a topic ATM.", "2268317": "I need to review some ones work for my submission , help please", "2266490": "Is there an expectation for users to submit some kind of illustrative code and actually train models in these notebooks?", "2260518": "How will the breath and depth of the essay be evaluated? For example, if I want to write about generative AI, should I write about: 1. evolutions in the field in general 2. a particular vertical like chatbots or 3. a particular technology like diffusion models?", "2258293": "Is the goal for the essay to include as much information as possible on the chosen category in a concise way, or would it be better to choose a single, specific subcategory and write about that in a more detailed way?", "2256679": "When I submitted the sample submission file I got the following error: \"Solution and submission values for type do not match\". If I understood correctly submitting the template as it is should have worked. Am I missing something?\n", "2392248": "", "2356083": "", "2350339": "", "2347699": "", "2344689": "", "2331809": "", "2258696": "" } }