**Evaluation**

Given a path to an MP4 file, the evaluation script should intake the video and output the category and label. The evaluation framework will use the following metrics to ensure a fair and comprehensive assessment:


**Metrics**

Primary Metric: Average Accuracy across the evaluation datasets
Secondary Metrics: Precision, Recall, F1-Score, and confusion matrix insights

**Evaluation Script**


An evaluation script will calculate all metrics and provide a leaderboard ranking. The script will not be accessible during training. In the event of tied scores, secondary metrics will determine leaderboard positions.


## Submission File
For each ID in the test set, you must predict a probability for the TARGET variable. The file should contain a header and have the following format:

```
video_name,action_category
0000.mp4,manipulation
0003.mp4,leisure
0005.mp4,communication
0006.mp4,locomotion
0007.mp4,leisure
```

Take a look at the submission template here: [template_predictions.csv](https://github.com/user-attachments/files/18528383/template_predictions.csv)

The evaluation dataset will contain videos from multiple resources. It involves 42 actions and six categories. Please add action and category names in lowercase.

| **Category**          | **Actions**                                                                                                     |
|------------------------|-----------------------------------------------------------------------------------------------------------------|
| **Locomotion**         | walking, walking, entering a space, leaving a space, sitting, standing, sitting down, getting up, lying down    |
| **Manipulation**       | cooking, making coffee, making tea, wiping table, spreading bedding/folding bedding, cleaning dishes, vacuuming, looking for something, putting on/taking off shoes, putting on/taking off glasses, cleaning, writing |
| **Communication**      | talking, beckoning, waving a hand, clapping, pointing, shaking hands, phone calls, using a telephone, hugging   |
| **Hygiene**            | washing face, washing hands, brushing teeth, brushing hair, massaging a shoulder oneself, taking medicine       |
| **Eating_Drinking**    | eating, drinking                                                                                               |
| **Leisure**            | watching tv, reading, using a laptop, using a tablet, exercising                                               |


Evaluation Dataset is here: [https://drive.google.com/file/d/1m709wOxyxxaFoAqlTxbpXq1CTsQ6hnup/view?usp=sharing](https://drive.google.com/file/d/1m709wOxyxxaFoAqlTxbpXq1CTsQ6hnup/view?usp=sharing)