Evaluation
All submissions will be judged using two steps:
Score File Check
You must provide a submission.csv containing your model’s cross entropy loss or any loss value.
Official Verification
SmilyAI-Labs will re-run your model on the SmilyAI-Computer to verify the MMLU score.
The verified score is the one that counts toward ranking.