# Custom QA model over fitting

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcustom-qa-model-over-fitting%2F100387%3E%5C
**Category:** 🤗Transformers\
**Created:** [August 1, 2024, 8:44am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcustom-qa-model-over-fitting%2F100387 "2024-08-01T08:44:40Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Sushmitaupadhyay](https://avatars.discourse-cdn.com/v4/letter/s/a88e4f/32.png) [@Sushmitaupadhyay](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FSushmitaupadhyay)%5C
**Post date:** [August 1, 2024, 8:44am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcustom-qa-model-over-fitting%2F100387%2F1 "2024-08-01T08:44:40Z")

</div>

I am training a custom QA model and my validation accuracy is starting from 61% and training from 54% after that training accuracy is continuously increasing and training loss decreasing whereas validation accuracy only increases till 3rd epoch to reach 64% (and training accuracy at 3rd epoch is 71%) and then starts decreasing and validation loss increases. I have around 90000 data and my model has 18.9M training parameter. I suspect that it is over fitting. I have tried everything to fix this my nothing helped. Can anyone help to identify the issue. Also even if there is over fitting can I still use the result till the 3rd epoch as validation loss increases after that?