{ "fetched_at": "2026-10-19T22:21:34Z", "source_url": "https://www.kaggle.com/competitions/arc-prize-2024/data", "pages": [ { "name": "rules", "content": "**Rules updated: July 2, 2024, Submission Limits; September 18, 2024, Prize Increase**\n\n\n## One account per participant\n\nYou cannot sign up to Kaggle from multiple accounts and therefore you cannot submit from multiple accounts.\n\n## No private sharing outside teams\n\nPrivately sharing code or data outside of teams is not permitted. It's okay to share code if made available to all participants on the forums.\n\n## Team Mergers\n\nTeam mergers are allowed and can be performed by the team leader. In order to merge, the combined team must have a total submission count less than or equal to the maximum allowed as of the Team Merger Deadline. The maximum allowed is the number of submissions per day multiplied by the number of days the competition has been running.\n\n## Team Limits\n\nThe maximum team size is 5.\n\n## Submission Limits\n\nYou may submit a maximum of 3 entries per day.\n\n## Competition Timeline\n\nCompetition Timeline dates (including Entry Deadline, Final Submission Deadline, Start Date, and Team Merger Deadline, as applicable) are reflected on the competition’s Overview > Timeline page.\n\n## COMPETITION-SPECIFIC TERMS\n\n**COMPETITION TITLE**: ARC Prize 2024\n\n**COMPETITION SPONSOR**: ARC Prize Inc\n\n**COMPETITION SPONSOR ADDRESS**: 548 Market Street #83849 San Francisco CA 94104\n\n**COMPETITION WEBSITE**: https://www.kaggle.com/competitions/arc-prize-2024\n\n**TOTAL PRIZES AVAILABLE: $725,000**\n\n* 2024 Progress Prizes: $125,000\n* Grand Prize: $600,000\n\n**2024 Progress Prizes**\n- First Prize: $25,000\n- Second Prize: $10,000\n- Third Prize: $5,000\n- Fourth Prize: $5,000\n- Fifth Prize: $5,000\n\n- Paper Award: $50,000 \n- Paper Award First Runner Up: $20,000\n- Paper Award Second Runner Up: $5,000 \n\n\n**Grand Prize**\nThe Grand Prize of an additional $600,000 will be unlocked in the event that a team achieves a score of 85% accuracy on the competition leaderboard. At the end of the competition, the Grand Prize will be divided among the Top 5 teams that have achieved at least 85% accuracy as outlined below. In the event that fewer than 5 teams have achieved 85% accuracy, those prizes will be divided proportionately among qualifying teams.\n- First Prize: $300,000\n- Second Prize: $120,000\n- Third Prize: $60,000\n- Fourth Prize: $60,000\n- Fifth Prize: $60,000\n\n**WINNER LICENSE TYPE**: Public domain. Either MIT-0 or CC0.\n\n**DATA ACCESS AND USE**: The ARC dataset is publishing under Apache-2.0 license here: https://github.com/fchollet/ARC-AGI\n\nCompetitions are open to residents of the United States and worldwide, except that if you are a resident of Crimea, so-called Donetsk People's Republic (DNR) or Luhansk People's Republic (LNR), Cuba, Iran, Syria, North Korea, or are subject to U.S. export controls or sanctions, you may not enter the Competition. Other local rules and regulations may apply to you, so please check your local laws to ensure that you are eligible to participate in skills-based competitions. The Competition Sponsor reserves the right to award alternative Prizes where needed to comply with local laws.\n\n**ENTRY IN THIS COMPETITION CONSTITUTES YOUR ACCEPTANCE OF THESE OFFICIAL COMPETITION RULES.**\n\nThe Competition named above is a skills-based competition to promote and further the field of data science. You must register via the Competition Website to enter. Your competition submissions (\"Submissions\") must conform to the requirements stated on the Competition Website. Your Submissions will be scored based on the evaluation metric described on the Competition Website. Subject to compliance with the Competition Rules, Prizes, if any, will be awarded to participants with the best scores, based on the merits of the data science models submitted. See below for the complete Competition Rules.\n\n## A. COMPETITION-SPECIFIC RULES\n\nIn addition to the provisions of the General Competition Rules below, you understand and agree to these Competition-Specific Rules required by the Competition Sponsor:\n\n### **1. WINNER LICENSE.**\n\nUnder Section 11 (Winners Obligations) of the General Rules below, you hereby grant and will grant Competition Sponsor the following license(s) with respect to your Submission if you are a Competition winner:\n \n*Open Source*: You hereby license and will license your winning Submission and the source code used to generate the Submission under an [Open Source Initiative-approved license](https://www.opensource.org), defaulting to MIT-0, that in no event limits commercial use of such code or model containing or depending on such code. To the extent your Submission makes use of generally commercially available software not owned by you that you used to generate your submission, but that can be procured without undue expense, you do not grant the license in the preceding sentence to that software.\n\nIf your winning solution has been generated with input data or pre-trained models which either host or participant determine has been produced with an incompatible license, you will have to provide the organizers with a detailed description, to the Competition Sponsor’s satisfaction, of how the winning submission was generated. This includes a detailed description of methodology, where one must be able to reproduce the approach by reading the description, and includes a detailed explanation of the architecture, preprocessing, loss function, training details, hyper-parameters, etc. The description should also include a link to a code repository with complete and detailed instructions so that the results obtained can be reproduced. Whether a submission meets the eligibility criteria or not shall be determined by the Competition Sponsor, whose decision shall be final.\n\nBy entering and participating in the Competition you warrant that your Submission, and the models and/or source code used to generate it, are your own original work or that it is used by permission of the owner.\n \n### **2. AUTOMATED MACHINE LEARNING TOOLS (AMLT).** \n\nIndividual participants and Teams may use automated machine learning tool(s) (“AMLT”) (e.g., Google AutoML, H2O Driverless AI, etc.) to create a Submission, provided that the participant or Team ensures that they have an appropriate license to the AMLT such that they are able to comply with the Competition Rules. \n \nThe following provision is added to the end of Section 11 of the General Competition Rules below: “Individual participants and Teams who create a Submission using an AMLT may win a Prize. However, for clarity, the potential winner’s Submission must still meet the requirements of these Rules, including but not limited to Section A.1 (Winners License), Section B.11 (Winners Obligations), and Section B.17 (Warranty, Indemnity, and Release).” \n\n## B. GENERAL COMPETITION RULES\n### **1.\tBINDING AGREEMENT.** \n\nTo enter the Competition, you must agree to these Official Competition Rules, which incorporate by reference the provisions and content of the Competition Website and any Specific Competition Rules above (collectively, the \"Rules\"). Please read these Rules carefully before entry to ensure you understand and agree. You further agree that submission of an entry in the Competition constitutes agreement to these Rules. You may not submit an entry to the Competition and are not eligible to receive the prizes associated with this Competition (“Prizes”) unless you agree to these Rules. These Rules form a binding legal agreement between you and the Competition Sponsor with respect to the Competition.\n\n### **2.\tELIGIBILITY.** \n\nA. To be eligible to enter the Competition, you must be:\n\t(i) a registered account holder at Kaggle.com; \n\t(ii) the older of 18 years old or the age of majority in your jurisdiction of residence (unless otherwise agreed to by Competition Sponsor and appropriate parental/guardian consents have been obtained by Competition Sponsor); \n\t(iii) not a resident of Crimea, so-called Donetsk People's Republic (DNR) or Luhansk People's Republic (LNR), Cuba, Iran, Syria, or North Korea; and\n\t(iv) not a person or representative of an entity under U.S. export controls or sanctions (see [https://www.treasury.gov/resource-center/sanctions/Programs/Pages/Programs.aspx][1]).\n\nIf you are entering as a representative of a company, educational institution or other legal entity, or on behalf of your employer, these rules are binding on you, individually, and the entity you represent or are an employee. If you are acting within the scope of your employment, as an employee, contractor, or agent of another party, you warrant that such party has full knowledge of your actions and has consented thereto, including your potential receipt of a Prize. You further warrant that your actions do not violate your employer's or entity's policies and procedures. \n\nThe Competition Sponsor reserves the right to verify eligibility and to adjudicate on any dispute at any time. If you provide any false information relating to the Competition concerning your identity, residency, mailing address, telephone number, email address, ownership of right, or information required for entering the Competition, you may be immediately disqualified from the Competition.\n\nB. Unless otherwise stated in the Specific Competition Rules above or prohibited by internal policies of the Competition Entities, employees, interns, contractors, officers and directors of Competition Entities may enter and participate in the Competition, but are not eligible to win any Prizes. \"Competition Entities\" means the Competition Sponsor, Kaggle Inc., and their respective parent companies, subsidiaries and affiliates. If you are such a participant from a Competition Entity, you are subject to all applicable internal policies of your employer with respect to your participation.\n\n### **3.\tSPONSOR AND HOSTING PLATFORM.** \n\nThe Competition is sponsored by Competition Sponsor named above. The Competition is hosted on behalf of Competition Sponsor by Kaggle Inc. (\"Kaggle\"). Kaggle is an independent contractor of Competition Sponsor, and is not a party to this or any agreement between you and Competition Sponsor. You understand that Kaggle has no responsibility with respect to selecting the potential Competition winner(s) or awarding any Prizes. Kaggle will perform certain administrative functions relating to hosting the Competition, and you agree to abide by the provisions relating to Kaggle under these Rules. As a Kaggle.com account holder and user of the Kaggle competition platform, remember you have accepted and are subject to the Kaggle Terms of Service at [www.kaggle.com/terms][2] in addition to these Rules.\n\n### **4.\tCOMPETITION PERIOD.** \n\nFor the purposes of Prizes, the Competition will run from the Start Date and time to the Final Submission Deadline (such duration the “Competition Period”). The Competition Timeline is subject to change, and Competition Sponsor may introduce additional hurdle deadlines during the Competition Period. Any updated or additional deadlines will be publicized on the Competition Website. It is your responsibility to check the Competition Website regularly to stay informed of any deadline changes. *YOU ARE RESPONSIBLE FOR DETERMINING THE CORRESPONDING TIME ZONE IN YOUR LOCATION.* \n\n### **5.\tCOMPETITION ENTRY.** \n\nNO PURCHASE NECESSARY TO ENTER OR WIN. To enter the Competition, you must register on the Competition Website prior to the Entry Deadline, and follow the instructions for developing and entering your Submission through the Competition Website. Your Submissions must be made in the manner and format, and in compliance with all other requirements, stated on the Competition Website (the \"Requirements\"). Submissions must be received before any Submission deadlines stated on the Competition Website. Submissions not received by the stated deadlines will not be eligible to receive a Prize.\n\nSubmissions may not use or incorporate information from hand labeling or human prediction of the validation dataset or test data records.\n\nIf the Competition is a multi-stage competition with temporally separate training and/or test data, one or more valid Submissions may be required during each Competition stage in the manner described on the Competition Website in order for the Submissions to be Prize eligible.\n\nSubmissions are void if they are in whole or part illegible, incomplete, damaged, altered, counterfeit, obtained through fraud, or late. Competition Sponsor reserves the right to disqualify any entrant who does not follow these Rules, including making a Submission that does not meet the Requirements. \n\n### **6.\tINDIVIDUALS AND TEAMS.** \n\nA. *Individual Account*. You may make Submissions only under one, unique Kaggle.com account. You will be disqualified if you make Submissions through more than one Kaggle account, or attempt to falsify an account to act as your proxy. You may submit up to the maximum number of Submissions per day as specified on the Competition Website. \n\nB. *Teams*. If permitted under the Competition Website guidelines, multiple individuals may collaborate as a team (a \"Team\"); however, you may join or form only one Team. Each Team member must be a single individual with a separate Kaggle account. You must register individually for the Competition before joining a Team. You must confirm your Team membership to make it official by responding to the Team notification message sent to your Kaggle account. Team membership may not exceed the Maximum Team Size stated on the Competition Website.\n\nC. *Team Merger*. Teams may request to merge via the Competition Website. Team mergers may be allowed provided that: (i) the combined Team does not exceed the Maximum Team Size; (ii) the number of Submissions made by the merging Teams does not exceed the number of Submissions permissible for one Team at the date of the merger request; (iii) the merger is completed before the earlier of: any merger deadline or the Competition deadline; and (iv) the proposed combined Team otherwise meets all the requirements of these Rules. \n\n### **7.\tCOMPETITION DATA.** \n\n\"Competition Data\" means the data or datasets available from the Competition Website for the purpose of use in the Competition, including any prototype or executable code provided on the Competition Website. The Competition Data will contain private and public test sets. Which data belongs to which set will not be made available to participants. \n\nA. *Data Access and Use*. You may access and use the Competition Data for any purpose, whether commercial or non-commercial, including for participating in the Competition and on Kaggle.com forums, and for academic research and education. The Competition Sponsor reserves the right to disqualify any participant who uses the Competition Data other than as permitted by the Competition Website and these Rules.\n \nThe Competition Data is also subject to the following terms and conditions: Licensed under Apache 2.0. To the extent that the terms and conditions located at the URL conflict with or are inconsistent with these Rules, these Rules will govern your use of the Competition Data.\n\nB. *Data Security*. You agree to use reasonable and suitable measures to prevent persons who have not formally agreed to these Rules from gaining access to the Competition Data. You agree not to transmit, duplicate, publish, redistribute or otherwise provide or make available the Competition Data to any party not participating in the Competition. You agree to notify Kaggle immediately upon learning of any possible unauthorized transmission of or unauthorized access to the Competition Data and agree to work with Kaggle to rectify any unauthorized transmission or access.\n\nC. *External Data*. You may use data other than the Competition Data (“External Data”) to develop and test your Submissions including private or proprietary data sets however eligible Submissions must be able to comply and comply with all of Section A (Competition-Specific Rules), Section 1 (Winners License), and Section 11 (Winners Obligations).\n\n### **8.\tSUBMISSION CODE REQUIREMENTS.**\n\nA. *Private Code Sharing*. Unless otherwise specifically permitted under the Competition Website or Competition Specific Rules above, during the Competition Period, you are not allowed to privately share source or executable code developed in connection with or based upon the Competition Data or other source or executable code relevant to the Competition (“Competition Code”). This prohibition includes sharing Competition Code between separate Teams, unless a Team merger occurs. Any such sharing of Competition Code is a breach of these Competition Rules and may result in disqualification.\n\nB. *Public Code Sharing*. You are permitted to publicly share Competition Code, provided that such public sharing does not violate the intellectual property rights of any third party. If you do choose to share Competition Code or other such code, you are required to share it on Kaggle.com on the discussion forum or notebooks associated specifically with the Competition for the benefit of all competitors. By so sharing, you are deemed to have licensed the shared code under an Open Source Initiative-approved license (see [www.opensource.org][3]) that in no event limits commercial use of such Competition Code or model containing or depending on such Competition Code.\n\nC. *Use of Open Source*. Unless otherwise stated in the Specific Competition Rules above, if open source code is used in the model to generate the Submission, then you must only use open source code licensed under an Open Source Initiative-approved license (see [www.opensource.org][4]) that in no event limits commercial use of such code or model containing or depending on such code.\n\n### **9.\tDETERMINING WINNERS.** \n\nEach Submission will be scored and ranked by the evaluation metric stated on the Competition Website. During the Competition Period, the current ranking will be visible on the Competition Website's public leaderboard. The potential winner(s) are determined solely by the leaderboard ranking on the private leaderboard, subject to compliance with these Rules. The public leaderboard will be based on the public test set and the private leaderboard will be based on the private test set.\n\nIn the event of a tie, the Submission that was entered first to the Competition will be the winner. In the event a potential winner is disqualified for any reason, the Submission that received the next highest score rank will be chosen as the potential winner.\n\n### **10.\tNOTIFICATION OF WINNERS & DISQUALIFICATION.**\n\nThe potential winner(s) will be notified by email. \n \nIf a potential winner (i) does not respond to the notification attempt within one (1) week from the first notification attempt or (ii) notifies Kaggle within one week after the Final Submission Deadline that the potential winner does not want to be nominated as a winner or does not want to receive a Prize, then, in each case (i) and (ii) such potential winner will not receive any Prize, and an alternate potential winner will be selected from among all eligible entries received based on the Competition’s judging criteria.\n \nIn case (i) and (ii) above Kaggle may disqualify the participant. However, in case (ii) above, if requested by Kaggle, such potential winner may provide code and documentation to verify the participant’s compliance with these Rules. If the potential winner provides code and documentation to the satisfaction of Kaggle, the participant will not be disqualified pursuant to this paragraph.\n \nCompetition Sponsor reserves the right to disqualify any participant from the Competition if the Competition Sponsor reasonably believes that the participant has attempted to undermine the legitimate operation of the Competition by cheating, deception, or other unfair playing practices or abuses, threatens or harasses any other participants, Competition Sponsor or Kaggle.\n \nA disqualified participant may be removed from the Competition leaderboard, at Kaggle's sole discretion. If a Participant is removed from the Competition Leaderboard, additional winning features associated with the Kaggle competition platform, for example Kaggle points or medals, may also not be awarded.\n \nThe final leaderboard list will be publicly displayed at Kaggle.com. Determinations of Competition Sponsor are final and binding.\n\n### **11.\tWINNERS OBLIGATIONS.**\n\nAs a condition to being awarded a Prize, a Prize winner must fulfill the following obligations:\n\n(a) deliver to the Competition Sponsor the final model's software code as used to generate the winning Submission and associated documentation. The delivered software code should follow [these documentation guidelines][5], must be capable of generating the winning Submission, and contain a description of resources required to build and/or run the executable code successfully. To the extent that the final model’s software code includes generally commercially available software that is not owned by you, but that can be procured by the Competition Sponsor without undue expense, then instead of delivering the code for that software to the Competition Sponsor, you must identify that software, method for procuring it, and any parameters or other information necessary to replicate the winning Submission;\n\n(b) grant to the Competition Sponsor the license to the winning Submission stated in the Competition Specific Rules above, and represent that you have the unrestricted right to grant that license; \n\n(c) sign and return all Prize acceptance documents as may be required by Competition Sponsor or Kaggle, including without limitation: (i) eligibility certifications; (ii) licenses, releases and other agreements required under the Rules; and (iii) U.S. tax forms (such as IRS Form W-9 if U.S. resident, IRS Form W-8BEN if foreign resident, or future equivalents).\n\n### **12.\tPRIZES.** \n\nPrize(s) are as described on the Competition Website and are only available for winning during the time period described on the Competition Website. The odds of winning any Prize depends on the number of eligible Submissions received during the Competition Period and the skill of the participants. \n\nAll Prizes are subject to Competition Sponsor's review and verification of the participant’s eligibility and compliance with these Rules, and the compliance of the winning Submissions with the Submissions Requirements. In the event that the Submission demonstrates non-compliance with these Competition Rules, Competition Sponsor may at its discretion take either of the following actions: (i) disqualify the Submission(s); or (ii) require the potential winner to remediate within one week after notice all issues identified in the Submission(s) (including, without limitation, the resolution of license conflicts, the fulfillment of all obligations required by software licenses, and the removal of any software that violates the software restrictions).\n\nA potential winner may decline to be nominated as a Competition winner in accordance with Section 10.\n\nPotential winners must return all required Prize acceptance documents within two (2) weeks following notification of such required documents, or such potential winner will be deemed to have forfeited the prize and another potential winner will be selected. Prize(s) will be awarded within approximately 30 days after receipt by Competition Sponsor or Kaggle of the required Prize acceptance documents. Transfer or assignment of a Prize is not allowed. \n\nYou are not eligible to receive any Prize if you do not meet the Eligibility requirements in Section 2 above.\n\nIf a Team wins a monetary Prize, the Prize money will be allocated in even shares between the eligible Team members, unless the Team unanimously opts for a different Prize split and notifies Kaggle before Prizes are issued.\n\n### **13.\tTAXES.** \n\nALL TAXES IMPOSED ON PRIZES ARE THE SOLE RESPONSIBILITY OF THE WINNERS. Payments to potential winners are subject to the express requirement that they submit all documentation requested by Competition Sponsor or Kaggle for compliance with applicable state, federal, local and foreign (including provincial) tax reporting and withholding requirements. Prizes will be net of any taxes that Competition Sponsor is required by law to withhold. If a potential winner fails to provide any required documentation or comply with applicable laws, the Prize may be forfeited and Competition Sponsor may select an alternative potential winner. Any winners who are U.S. residents will receive an IRS Form-1099 in the amount of their Prize.\n\n### **14.\tGENERAL CONDITIONS.** \n\nAll federal, state, provincial and local laws and regulations apply. \n\n### **15.\tPUBLICITY.**\n\nYou agree that Competition Sponsor, Kaggle and its affiliates may use your name and likeness for advertising and promotional purposes without additional compensation, unless prohibited by law.\n\n### **16.\tPRIVACY.**\n\nYou acknowledge and agree that Competition Sponsor and Kaggle may collect, store, share and otherwise use personally identifiable information provided by you during the Kaggle account registration process and the Competition, including but not limited to, name, mailing address, phone number, and email address (“Personal Information”). Kaggle acts as an independent controller with regard to its collection, storage, sharing, and other use of this Personal Information, and will use this Personal Information in accordance with its Privacy Policy <[www.kaggle.com/privacy][6]>, including for administering the Competition. As a Kaggle.com account holder, you have the right to request access to, review, rectification, portability or deletion of any personal data held by Kaggle about you by logging into your account and/or contacting Kaggle Support at <[www.kaggle.com/contact][7]>.\n\n As part of Competition Sponsor performing this contract between you and the Competition Sponsor, Kaggle will transfer your Personal Information to Competition Sponsor, which acts as an independent controller with regard to this Personal Information. As a controller of such Personal Information, Competition Sponsor agrees to comply with all U.S. and foreign data protection obligations with regard to your Personal Information. Kaggle will transfer your Personal Information to Competition Sponsor in the country specified in the Competition Sponsor Address listed above, which may be a country outside the country of your residence. Such country may not have privacy laws and regulations similar to those of the country of your residence.\n\n### **17.\tWARRANTY, INDEMNITY AND RELEASE.** \n\nYou warrant that your Submission is your own original work and, as such, you are the sole and exclusive owner and rights holder of the Submission, and you have the right to make the Submission and grant all required licenses. You agree not to make any Submission that: (i) infringes any third party proprietary rights, intellectual property rights, industrial property rights, personal or moral rights or any other rights, including without limitation, copyright, trademark, patent, trade secret, privacy, publicity or confidentiality obligations, or defames any person; or (ii) otherwise violates any applicable U.S. or foreign state or federal law.\n\nTo the maximum extent permitted by law, you indemnify and agree to keep indemnified Competition Entities at all times from and against any liability, claims, demands, losses, damages, costs and expenses resulting from any of your acts, defaults or omissions and/or a breach of any warranty set forth herein. To the maximum extent permitted by law, you agree to defend, indemnify and hold harmless the Competition Entities from and against any and all claims, actions, suits or proceedings, as well as any and all losses, liabilities, damages, costs and expenses (including reasonable attorneys fees) arising out of or accruing from: (a) your Submission or other material uploaded or otherwise provided by you that infringes any third party proprietary rights, intellectual property rights, industrial property rights, personal or moral rights or any other rights, including without limitation, copyright, trademark, patent, trade secret, privacy, publicity or confidentiality obligations, or defames any person; (b) any misrepresentation made by you in connection with the Competition; (c) any non-compliance by you with these Rules or any applicable U.S. or foreign state or federal law; (d) claims brought by persons or entities other than the parties to these Rules arising from or related to your involvement with the Competition; and (e) your acceptance, possession, misuse or use of any Prize, or your participation in the Competition and any Competition-related activity.\n\nYou hereby release Competition Entities from any liability associated with: (a) any malfunction or other problem with the Competition Website; (b) any error in the collection, processing, or retention of any Submission; or (c) any typographical or other error in the printing, offering or announcement of any Prize or winners.\n\n### **18.\tINTERNET.** \n\nCompetition Entities are not responsible for any malfunction of the Competition Website or any late, lost, damaged, misdirected, incomplete, illegible, undeliverable, or destroyed Submissions or entry materials due to system errors, failed, incomplete or garbled computer or other telecommunication transmission malfunctions, hardware or software failures of any kind, lost or unavailable network connections, typographical or system/human errors and failures, technical malfunction(s) of any telephone network or lines, cable connections, satellite transmissions, servers or providers, or computer equipment, traffic congestion on the Internet or at the Competition Website, or any combination thereof, which may limit a participant’s ability to participate.\n\n### **19.\tRIGHT TO CANCEL, MODIFY OR DISQUALIFY.**\n\nIf for any reason the Competition is not capable of running as planned, including infection by computer virus, bugs, tampering, unauthorized intervention, fraud, technical failures, or any other causes which corrupt or affect the administration, security, fairness, integrity, or proper conduct of the Competition, Competition Sponsor reserves the right to cancel, terminate, modify or suspend the Competition. Competition Sponsor further reserves the right to disqualify any participant who tampers with the submission process or any other part of the Competition or Competition Website. Any attempt by a participant to deliberately damage any website, including the Competition Website, or undermine the legitimate operation of the Competition is a violation of criminal and civil laws. Should such an attempt be made, Competition Sponsor and Kaggle each reserves the right to seek damages from any such participant to the fullest extent of the applicable law.\n\n### **20.\tNOT AN OFFER OR CONTRACT OF EMPLOYMENT.**\n\nUnder no circumstances will the entry of a Submission, the awarding of a Prize, or anything in these Rules be construed as an offer or contract of employment with Competition Sponsor or any of the Competition Entities. You acknowledge that you have submitted your Submission voluntarily and not in confidence or in trust. You acknowledge that no confidential, fiduciary, agency, employment or other similar relationship is created between you and Competition Sponsor or any of the Competition Entities by your acceptance of these Rules or your entry of your Submission.\n\n### **21.\tGOVERNING LAW.** \n\nUnless otherwise provided in the Competition Specific Rules above, all claims arising out of or relating to these Rules will be governed by California law, excluding its conflict of laws rules, and will be litigated exclusively in the Federal or State courts of Santa Clara County, California, USA. The parties consent to personal jurisdiction in those courts. If any provision of these Rules is held to be invalid or unenforceable, all remaining provisions of the Rules will remain in full force and effect.\n\n\n [1]: https://www.treasury.gov/resource-center/sanctions/Programs/Pages/Programs.aspx\n [2]: http://www.kaggle.com/terms\n [3]: http://www.opensource.org\n [4]: http://www.opensource.org\n [5]: https://www.kaggle.com/WinningModelDocumentationGuidelines\n [6]: http://www.kaggle.com/privacy\n [7]: http://www.kaggle.com/contact\n\n", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "data-description", "content": "The objective of this competition is to create an algorithm that is capable of solving abstract reasoning tasks. Critically, these are *novel* tasks: tasks that the algorithm has never seen before. Hence, simply memorizing a set of reasoning templates will not suffice.\n\nThe format is different from the previous competition, so please read this information carefully, and refer to supplementary documentation as needed.\n\nWhen looking at a task, a \"test-taker\" has access to inputs and outputs of the demonstration pairs (train pairs), plus the input(s) of the test pair(s). The goal is to construct the output grid(s) corresponding to the test input grid(s), using **2 trials** for each test input. \"Constructing the output grid\" involves picking the height and width of the output grid, then filling each cell in the grid with a symbol (integer between 0 and 9, which are visualized as colors). Only **exact** solutions (all cells match the expected answer) can be said to be correct.\n\nAny additional information, as well as an interactive app to explore the objective of this competition is found at the [ARCPrize.org](http://ARCPrize.org/play). _**It is highly recommended that you explore the interactive app, as the best way to understand the objective of the competition**._\n\n## Task files\n\nThe information is stored in two files:\n- **arc-agi_training-challenges.json**: contains input/output pairs that demonstrate reasoning pattern to be applied to the \"test\" input for each task. This file and the corresponding **solutions** file can be used as training for your models.\n- **arc-agi_training-solutions.json**: contains the corresponding task \"test\" outputs (ground truth).\n- **arc-agi_evaluation-challenges.json**: contains input/output pairs that demonstrate reasoning pattern to be applied to the \"test\" input for each task. This file and the corresponding **solutions** file can be used as validation data for your models.\n- **arc-agi_evaluation-solutions.json**: contains the corresponding task \"test\" outputs (ground truth).\n- **arc-agi_test-challenges.json**: this file contains the tasks that will be used for the leaderboard evaluation, and contains \"train\" input/output pairs as well as the \"test\" input for each task. Your task is to predict the \"test\" output. **Note:** The file shown on this page is a placeholder using tasks from **arc-agi_evaluation-challenges.json**. When you submit your notebook to be rerun, this file is swapped with the actual test challenges.\n- **sample_submission.json**: a submission file in the correct format\n\nEach task contains a dictionary with two fields:\n- `\"train\"`: demonstration input/output pairs. It is a list of \"pairs\" (typically 3 pairs).\n- `\"test\"`: test input - your model should predict the output.\n\nA \"pair\" is a dictionary with two fields:\n- `\"input\"`: the input \"grid\" for the pair.\n- `\"output\"`: the output \"grid\" for the pair.\n\nA \"grid\" is a rectangular matrix (list of lists) of integers between 0 and 9 (inclusive). The smallest possible grid size is 1x1 and the largest is 30x30.\n\nThe data on this page should be used to develop and evaluate your models. When notebooks are submitted for rerun, they are scored using 100 unseen tasks found in the rerun file named **arc-agi_test_challenges.json**. The rerun tasks will contain `train` pairs of inputs and outputs as well as the tasks `test` input. Your algorithm must predict the `test` output. The majority of the 100 tasks used for leaderboard score only have one `test` input that will require a corresponding output prediction, although for a small number of tasks, you will be asked to make predictions for two `test` inputs. ", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "Description", "content": "Current AI systems can not generalize to new problems outside their training data, despite extensive training on large datasets. LLMs have brought AI to the mainstream for a large selection of known tasks. However, progress towards Artificial General Intelligence (AGI) has stalled. Improvements in AGI could enable AI systems that think and invent alongside humans.\n\nThe Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) benchmark measures an AI system's ability to efficiently learn new skills. Humans easily score 85% in ARC, whereas the best AI systems only score 34%. The [ARC Prize competition](https://www.arcprize.org) encourages researchers to explore ideas beyond LLMs, which depend heavily on large datasets and struggle with novel problems. \n\nThis competition includes several components. The competition as described here carries a prize of $100,000 with an additional $500,000 available if any team can beat a score of 85% on the leaderboard. Further opportunities outside of Kaggle are also available with associated prizes- to learn more visit [ARCprize.org](https://www.arcprize.org/).\n\nYour work could contribute to new AI problem-solving applicable across industries. Vastly improved AGI will likely reshape human-machine interactions. Winning solutions will be open-sourced to promote transparency and collaboration in the field of AGI.\n", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "Evaluation", "content": "This competition evaluates submissions on the percentage of correct predictions. For each task, you should predict exactly 2 outputs for every test input grid contained in the task. (Tasks can have more than one test input that needs a predicted output.) Each task test output has one ground truth. For a given task output, any of the 2 predicted outputs matches the ground truth exactly, you score `1` for that task test output, otherwise `0`. The final score is the sum averaged of the highest score per task output divided by the total number of task test outputs.\n\n## Submission File\n\nThe submission file for this competition must be a json named `submission.json`. \n\nFor each task output in the evaluation set, you should make exactly 2 predictions (`attempt_1`, `attempt_2`). The structure of predictions is shown below. Most tasks only have a single output (a single dictionary enclosed in a list), although some tasks have multiple outputs that must be predicted. These should contain two dictionaries of predictions enclosed in a list, as is shown by the example below. When a task has multiple test outputs that need to be predicted (e.g., task `12997ef3` below), they must be in the same order as the corresponding test inputs.\n\n**IMPORTANT:** All the task_ids in the input challenges json file must also be present in the `submission.json` file. Both \"attempt_1\" and \"attempt_2\" must be present, even if your submission doesn't have 2 predictions.\n\n {\"00576224\": [{\"attempt_1\": [[0, 0], [0, 0]], \"attempt_2\": [[0, 0], [0, 0]]}],\n \"009d5c81\": [{\"attempt_1\": [[0, 0], [0, 0]], \"attempt_2\": [[0, 0], [0, 0]]}],\n \"12997ef3\": [{\"attempt_1\": [[0, 0], [0, 0]], \"attempt_2\": [[0, 0], [0, 0]]},\n \t {\"attempt_1\": [[0, 0], [0, 0]], \"attempt_2\": [[0, 0], [0, 0]]}],\n ...\n }\n\n", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "Timeline", "content": "* **June 11, 2024** - Start Date\n\n* **November 3, 2024** - Entry deadline. You must accept the competition rules before this date in order to compete.\n\n* **November 3, 2024** - Team Merger deadline. This is the last day participants may join or merge teams.\n\n* **November 10, 2024** - Final submission deadline.\n\n* **November 12, 2024** - Paper Award submission deadline.\n\nAll deadlines are at 11:59 PM UTC on the corresponding day unless otherwise noted. The competition organizers reserve the right to update the contest timeline if they deem it necessary.", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "Prizes", "content": "**TOTAL PRIZES AVAILABLE: $1,100,000**\n- 2024 Progress Prizes: $125,000\n- Grand Prize: $600,000\n- To Be Announced Prizes (on [ARCprize.org](https://arcprize.org)): $375,000\n\n**2024 Progress Prizes**\n- **Prizes for Top-Ranking Teams in this Competition**: $50,000\n - First Prize: $25,000\n - Second Prize: $10,000\n - Third Prize: $5,000\n - Fourth Prize: $5,000\n - Fifth Prize: $5,000\n- **Paper Award Prizes**: $75,000\n - Winner: $50,000\n - First Runner Up: $20,000\n - Second Runner Up: $5,000\n\nSee the [Paper Award](https://www.kaggle.com/competitions/arc-prize-2024/overview/prizes) tab for more details on submission and evaluation.\n\n**Grand Prize**\nA Grand Prize of an additional $600,000 will be unlocked in the event that a team achieves a score of at least 85% accuracy on the competition leaderboard. At the end of the competition, the Grand Prize will be divided among the Top 5 teams that have achieved 85% accuracy as outlined below. In the event that fewer than 5 teams have achieved 85% accuracy, those prizes will be divided proportionately among qualifying teams.\n- First Prize: $300,000\n- Second Prize: $120,000\n- Third Prize: $60,000\n- Fourth Prize: $60,000\n- Fifth Prize: $60,000\n\n**To Be Announced Prizes** (Off Kaggle)\n$375,000 in additional prizes will be announced later on [ARCprize.org](https://arcprize.org)\n", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "Code Requirements", "content": "![Kerneler](https://storage.googleapis.com/kaggle-media/competitions/general/Kerneler-white-desc2_transparent.png)\n### This is a Code Competition\n\nSubmissions to this competition must be made through Notebooks. In order for the \"Submit to Competition\" button to be active after a commit, the following conditions must be met:\n\n- CPU Notebook <= 12 hours run-time\n- GPU Notebook <= 12 hours run-time\n- No internet access enabled\n- External data, freely & publicly available, is allowed, including pre-trained models\n- Submission file must be named `submission.json`\n\nPlease see the [Code Competition FAQ](https://www.kaggle.com/docs/competitions#kernels-only-FAQ) for more information on how to submit.", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "Paper Award ", "content": "You may choose to submit a paper to be eligible to win a Paper Award Prize.\n\nTo be eligible for a Paper Award, you must separately submit a paper (Kaggle Notebook, PDF, arXiv, txt, etc.) documenting and describing the conceptual approach of your eligible ARC Prize 2024 Kaggle submission. Paper submissions must be submitted within 48 hours of the competition ending.\n\nPaper Awards are evaluated equally on the following six components, where a score of 0 (lowest) and 5 (highest) is given in each category.\n\n| Category   | Description | \n|----------------|---------|\n|**Accuracy** | How accurate is the submission based on its performance on the leaderboard? (Note: you will be asked to provide your submission ID to match your notebook to your submission)  | \n|**Universality** | How general and universal is the Submission approach beyond the competition? Does your submission translate to other similar problems? How well does your method generalize?|\n|**Progress** | How much does the paper increase the overall chance of anyone achieving 85% on ARC Prize?|\n|**Theory** | How well does the paper describe why the Submission works (as opposed to merely describing how it works)? |\n|**Completeness** | How thoroughly and completely does the paper cover your submission to the leaderboard?|\n|**Novelty** | How novel is the Submission relative to existing public research?|\n\nThe Paper Award will be awarded to the Submission with the most points and the Paper Award Runner Up will the second most points. Your Paper rubric evaluation will not be shared with you. In the event of a tie, the Paper that was entered first to the Competition will be the winner. In the event a potential winner is disqualified for any reason, the Paper that received the next highest score rank will be chosen as the potential winner.\n\n### Click here to go to the [Submission form](https://docs.google.com/forms/d/e/1FAIpQLSfhmYE6AMYfMBkxj5_G8QHyWTWWEe1wUg98LM1UQsUR8ci-1w/viewform)", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "abstract", "content": "In this competition, you’ll develop AI systems to efficiently learn new skills and solve open-ended problems, rather than depend exclusively on AI systems trained with extensive datasets. The top submissions will show improvement toward human reasoning benchmarks.\n", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false } ] }