# Can you fine tune fine-tuned models?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-you-fine-tune-fine-tuned-models%2F33680%3E%5C
**Category:** Beginners\
**Created:** [March 13, 2023, 8:25am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-you-fine-tune-fine-tuned-models%2F33680 "2023-03-13T08:25:53Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![onturenio](https://avatars.discourse-cdn.com/v4/letter/o/47e85d/32.png) [@onturenio](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fonturenio)%5C
**Post date:** [March 13, 2023, 8:25am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-you-fine-tune-fine-tuned-models%2F33680%2F1 "2023-03-13T08:25:53Z")

</div>

Hi, I’m new in the community. I’m reading the course and I’m a bit confused with the concept of fine tuning, model heads, and so on in transformers. I’m more familiar with convnets, so I’ll try to draw an analogy to emphasise what I don’t quite grasp.

In convnets, to fine tune a model for image classification for instance you remove the last layer of the model, put a dense at the end with some softmax functions, freeze the rest of the model, and train it again with smaller learning rate. What’s going on when you do the same to a transformer? What is exactly the “head”? Do you also freeze the rest of the model? Because I didn’t see that movement in the course.

I’ll try to be more concrete. I’m thinking of this model [Recognai/selectra\_medium · Hugging Face](https://huggingface.co/Recognai/selectra_medium), which is an Electra model fine-tuned for Spanish. Then you have [Recognai/zeroshot\_selectra\_medium · Hugging Face](https://huggingface.co/Recognai/zeroshot_selectra_medium), which is fine tuned of the former for zero-shot classification. Don’t you remove the head for fine tuning? Doesn’t this get you back to the regular non-fine tuned model? Can I fine tune the zero-shot classification? What head do I remove then, and how does this not break the latter fine tuning?

Thanks a lot in advance!

---

<div class="post-metadata">

**Author:** ![dmnapolitano](https://avatars.discourse-cdn.com/v4/letter/d/a9adbd/32.png) [@dmnapolitano](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fdmnapolitano)%5C
**Post date:** [March 31, 2023, 8:39pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-you-fine-tune-fine-tuned-models%2F33680%2F2 "2023-03-31T20:39:15Z")

</div>

Hi @onturenio were you able to find any answers to your questions? I have the same ones! 😂

Thanks,  
Diane

---

<div class="post-metadata">

**Author:** ![onturenio](https://avatars.discourse-cdn.com/v4/letter/o/47e85d/32.png) [@onturenio](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fonturenio)%5C
**Post date:** [April 12, 2023, 6:38am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-you-fine-tune-fine-tuned-models%2F33680%2F3 "2023-04-12T06:38:23Z")

</div>

Unfortunately not yet. I’m still learning but I cannot fully answer these questions. I’ll come back to this post if I ever end up understanding the issue 😅

---

<div class="post-metadata">

**Author:** ![adityashukzy](https://avatars.discourse-cdn.com/v4/letter/a/9de053/32.png) [@adityashukzy](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fadityashukzy)%5C
**Post date:** [April 12, 2023, 8:10am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-you-fine-tune-fine-tuned-models%2F33680%2F4 "2023-04-12T08:10:44Z")

</div>

Hey!

I have a similar question: training an LLM for more than 5 epochs at a time is increasingly difficult on Kaggle or Colab.

One strategy I came up with is to train for 3 epochs at a time, and sequentially repeat this training for 5 times. Each time, we begin by fine-tuning the model from the previous training session. I would say that the underlying concept of “fine-tuning fine-tuned models” is the same as what you’re asking?

Any thoughts?

---

<div class="post-metadata">

**Author:** ![mcr1974](https://avatars.discourse-cdn.com/v4/letter/m/ce73a5/32.png) [@mcr1974](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmcr1974)%5C
**Post date:** [September 12, 2023, 1:31pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-you-fine-tune-fine-tuned-models%2F33680%2F5 "2023-09-12T13:31:47Z")

</div>

Any news on this? All the tutorials start from e.g. base llama2 for fine\_tuning. Can I start from a model that’s already been finetuned on top of a base llama2?

---

<div class="post-metadata">

**Author:** ![kbigdelysh](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/kbigdelysh/32/54464_2.png) [@kbigdelysh](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fkbigdelysh)%5C
**Post date:** [October 21, 2025, 7:04pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-you-fine-tune-fine-tuned-models%2F33680%2F6 "2025-10-21T19:04:47Z")

</div>

Yes, you can fine-tune a fine-tuned model. In Transformers the “head” is the small task layer on top of the shared encoder or decoder, for example a sequence-classification head. You may keep that head and continue training on the same task or remove it and attach a new head for a different task while keeping the underlying pretrained weights. Freezing the base is optional. Many recipes unfreeze some or all layers and use a small learning rate, or use adapters or LoRA to keep changes small.
