# LM fine-tuning on unlabelled dataset

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-fine-tuning-on-unlabelled-dataset%2F5400%3E%5C
**Category:** Beginners\
**Created:** [April 10, 2021, 4:44am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-fine-tuning-on-unlabelled-dataset%2F5400 "2021-04-10T04:44:59Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![sML](https://avatars.discourse-cdn.com/v4/letter/s/aca169/32.png) [@sML](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FsML)%5C
**Post date:** [April 10, 2021, 4:44am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Flm-fine-tuning-on-unlabelled-dataset%2F5400%2F1 "2021-04-10T04:44:59Z")

</div>

Hello Team,

Can you please tell me how to finetune a(any) MLM model on domain specific corpus ? I am following this [link](https://colab.research.google.com/github/huggingface/notebooks/blob/master/examples/language_modeling.ipynb) obtained from the huggingface documentation. Is this the procedure I should be following ? if this is how it is done, how will this update the vocabulary to adapt to new tokens of my domain specific corpus ?

Thanks in advance.
