## CrowdBias Challenge

Participate in the CrowdBias challenge organised with [CSCW 2021 Workshop - Investigating and Mitigating Biases in Crowdsourced Data](https://sites.google.com/view/biases-in-crowdsourced-data). Register [here](https://forms.gle/m2esEZegkDYyQ8jH7) to take part in teams of up to 4 members.

The broad task goal is to collect correct, unbiased labels for an annotation task in which each item to annotate has a true answer, known to the organizers. Teams are free to pursue whatever research designs they see fit, such as interface design, annotation workflows, assignment methods, aggregation approaches, etc. Teams will be evaluated based on a combination of accuracy and fairness metrics. Successful teams will also be invited to present their approach during the workshop.

Participants may use any crowdsourcing platform of their choice to collect human annotations. 
For any teams interested in using [Amazon’s Sagemaker Ground Truth](https://aws.amazon.com/sagemaker/groundtruth/) (GT) or [Augmented Artificial Intelligence](https://aws.amazon.com/augmented-ai/) (A2I) service to collect human annotations, Amazon will provide $250 in AWS credits to the first 15 teams who commit to participating in the challenge and to using GT as part of their participation. AWS credits cannot be used with Amazon Mechanical Turk. 

Challenge participants are also invited to attend our workshop at CSCW. Please note that you will have to [register](https://cscw.acm.org/2021/registration/) for both the CSCW conference and the workshop in order to attend (per the registration link above, one can see that prices are fairly inexpensive as a virtual conference, and further discounted with early registration through October 1, 2021). 

**Step 1** - Follow this link to register for the CrowdBias challenge and receive AWS credits
https://forms.gle/m2esEZegkDYyQ8jH7

**Step 2** - **Optional** - Register for CSCW Conference and Workshop (use the code “MIBI09”)
https://cscw.acm.org/2021/registration/

Please contact workshop organizers for any questions.
bcd21@easychair.org