# Fine-tuning process - dataset update training

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-process-dataset-update-training%2F76329%3E%5C
**Category:** Beginners\
**Created:** [March 7, 2024, 6:22am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-process-dataset-update-training%2F76329 "2024-03-07T06:22:27Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![yeonanii](https://avatars.discourse-cdn.com/v4/letter/y/85e7bf/32.png) [@yeonanii](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fyeonanii)%5C
**Post date:** [March 7, 2024, 6:22am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-process-dataset-update-training%2F76329%2F1 "2024-03-07T06:22:28Z")

</div>

I have a question about Fine-tuning.  
Can I train model only update dataset in Fine-tuning process not include pre-training(before data)?

---

<div class="post-metadata">

**Author:** ![Saugatkafley](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/saugatkafley/32/26738_2.png) [@Saugatkafley](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FSaugatkafley)%5C
**Post date:** [March 7, 2024, 6:55am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tuning-process-dataset-update-training%2F76329%2F2 "2024-03-07T06:55:20Z")

</div>

As fine-tuning a model we are transfering the generalized knowledge acquired during pre-training process to a specified, narrow (downstream) tasks to improve performance on the task.

But we have to also be careful about the pre-training corpus. Did it had enough information in the corpus that we really needed(usefulness)? The selection of appropriate models is also crucial,

- model size
- model vocabulary
- model performance.