# Single 5 fold deberta v3 large to obtain silver medal

Cv score of the model was 0.4447 and it scored 0.436405 in private leaderboard.
Key things were:
Concat last 4 layers (it stabilized trained by a lot)
Adding lstm on top
AWP
Here is training code:
[https://www.kaggle.com/code/themadrambito/63th-place-deberta-v3-large-private-0-436405](https://www.kaggle.com/code/themadrambito/63th-place-deberta-v3-large-private-0-436405)