# Learnings from this competition

I'd first of all like to express my gratitude for the Kaggle team to organize this challenge and my colleagues from my office for supporting me through the journey.
Apart from the coding & conceptual knowledge that I gained through this I also learnt the most important values of patience, perseverence & hardwork.
Late into the competition I also joined in the efficiency track, so that was an additional learning i got about making the inference superfast and actually developing strong & meaningful textual features.
this is my code for the efficiency track:
[https://www.kaggle.com/bhavesjain/commonlit-2023-train](https://www.kaggle.com/bhavesjain/commonlit-2023-train)
and for the accuracy track i modified the publicly available solution with my fixes:
[https://www.kaggle.com/code/bhavesjain/commonlit-ess-lgbm-autocorrect-deberta-v3-tuned/](https://www.kaggle.com/code/bhavesjain/commonlit-ess-lgbm-autocorrect-deberta-v3-tuned/)
Overview:
My prime objective in the journey was to experiment with logical approaches than just bruteforce techniques of concatenating everything & feeding it to a powerful & large models. I experimented with textual features like lexical diversity, readability indices, syllables& word metrics. I wanted to explore more into the area of metadiscourse & publicly available datasets for grading the quality but i had time & computation quota limitations. I also experimented with BERT, different versions of DeBERTa, sentence transformers but that's about it.
Submission Details:
I primarily stuck to XGBoost with Optuna. And rest was just hit & trial with various models.
The USP of my solution is the wide array of features that i used inspired from
[https://textinspector.com/help/statistics-readability/](https://textinspector.com/help/statistics-readability/)
I hope you all too check it out
Additionally i also learnt that i need to focus more on the robustness of my training techniques & optimization to avoid such loss in shakeups.
Even though I didn't get a medal, i'm glad that i learnt a lot of things worth applying in my own domain  & possibly in upcoming competitions.