For more information, you can check the following papers:
\n- Dataset paper: ASAD: A Twitter-based Benchmark Arabic Sentiment Analysis Dataset\n- Competition paper: Overview of the Arabic Sentiment Analysis 2021 Competition at KAUST\n\nNote: If you use this dataset, please cite the first paper.", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "Description", "content": "Sentiment Analysis is to build machine learning models that can determine the tone (positive, negative, neutral) of the text (e.g., movie reviews, tweets).
\nIt is one of the most important and standard tasks in NLP. However, Arabic sentiment analysis has not been studied at a level as high as other languages, e.g., English, Chinese, French. One of the key factors is the lack of high-quality and large-scale training data.
\nIn this challenge, we release 55K annotated tweets for Arabic sentiment analysis. This dataset will also be extremely useful for building Arabic language models, which are essential for supporting other Arabic NLP tasks, such as Question&Answering, Machine Translation, and Text Generation.
\nMore information about the dataset can be found in a paper at https://arxiv.org/abs/2011.00578\n\n\n## Important Notes:\n- To be eligible to participate in this competition, please register via the competition [web page](https://wti.kaust.edu.sa/solve/Arabic-Sentiment-Analysis-Challenge) and download the dataset from there.\n- Follow carefully the instructions on this page and the evaluation page.\n- The deadline for this completion is May 31, 2021 (11:59 PM UTC). Any further deadline extension will be announced on the event website.\n- Winners will be announced 15 days after the deadline.\n\n## Data Pre-processing\nThe labels of the training and testing files should be converted (mapped) into integer values.\n- Convert the label values (sentiment column) from string to integers following this: \nPositive→ 1, Negative → -1, Neutral → 0\n- In python, you can do something like: \n`df.sentiment= df.sentiment.map({'Positive’:1, 'Negative':-1, 'Neutral':0})`\n\n\n", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "Evaluation", "content": "## Scoring Metric\nThe evaluation metric for this competition is Macro F1-Score.\n\n## Evaluation Strategy\nThe evaluation will be done in two stages:\n1- The first stage is based on the evaluation of test_1 prediction, which is the test set available on the competition web page.
\n2- The second stage is based on the evaluation of test_2 prediction (test_2 has the same class distribution with test_1). This stage is private. We will invite the top-ranked participants to submit or share their codes to the organizers for the final evaluation.
\n\n\n## Submission Format\nYou should submit your solution of test_1 in a csv file with exactly 20K entries plus a header row.
\nSubmission files should contain two columns: Tweet_id and sentiment. Please use the exact required column names. Both columns should follow the format of the corresponding columns in the training data. Additionally, make sure that the ‘sentiment’ column contains only integer values: 1 or 0 or -1 (indicating positive, neutral, or negative respectively).
\n\nThe file should contain a header and have the following format:\n> Tweet_id, sentiment\n1221883443467952128,1\n1221884257490042887,0\n......\n\n\n ", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false }, { "name": "rules", "content": "- To be eligible to enter the Competition, you must be:\n\n1) a registered account holder at Kaggle.com;\n\n2) Registed account on the competition platform on [wti.kaust.edu.sa](https://wti.kaust.edu.sa/solve/Arabic-Sentiment-Analysis-Challenge)\n\n3) 18 Years old or more\n \n \n- Competition Sponsor reserves the right to disqualify any participant from the Competition if the Competition Sponsor reasonably believes that the participant has attempted to undermine the legitimate operation of the Competition by cheating, deception, or other unfair playing practices or abuses, threatens or harasses any other participants, Competition Sponsor or the hosting platform, or by providing false information related to your identity\n \n- You may make Submissions only under one, unique Kaggle.com account. You will be disqualified if you make Submissions through more than one Kaggle account, or attempt to falsify an account to act as your proxy. You may submit up to the maximum number of two Submissions per day as specified on the Competition Website. \n \n- If permitted under the Competition Website guidelines, multiple individuals may collaborate as a team (a \"Team\"); however, you may join or form only one Team. Each Team member must be a single individual with a separate Kaggle account. You must register individually for the Competition before joining a Team. You must confirm your Team membership to make it official by responding to the Team notification message sent to your Kaggle account. Team membership may not exceed the Maximum Team Size of 5 members.\n \n- You may access and use the Competition Data only for participating in the Competition and on Kaggle.com forums. The Competition Sponsor reserves the right to disqualify any participant who uses the Competition Data other than as permitted by the Competition Website and these Rules.\n \n- You may not use data other than the Competition Data (“External Data”) to develop and test your models and Submissions. \n \n- You are not allowed to privately share source or executable code developed in connection with or based upon the Competition Data or other source or executable code relevant to the Competition (“Competition Code”). This prohibition includes sharing Competition Code between separate Teams, unless a Team merger occurs. Any such sharing of Competition Code is a breach of these Competition Rules and may result in disqualification.\n \n- You agree that Competition Sponsor, Kaggle and its affiliates may use your name and likeness for advertising and promotional purposes without additional compensation, unless prohibited by law.\n \n- The potential winner(s) will be notified by Email, and will have the obligation to deliver to the competition sponsor their final software code as used to produce the submission and associated documentation.\n\n\n\n**Failing to comply with any of the above rules will result in disqualifying you from the competition.**\n", "isPublished": false, "hasIsPublished": false, "postTitle": "", "hasPostTitle": false, "mimeType": "", "hasMimeType": false } ] }