# Has anyone come across BERT fine-tuned for CLM task?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhas-anyone-come-across-bert-fine-tuned-for-clm-task%2F76553%3E%5C
**Category:** 🤗Transformers\
**Created:** [March 8, 2024, 3:38pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhas-anyone-come-across-bert-fine-tuned-for-clm-task%2F76553 "2024-03-08T15:38:35Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![HF-stark-Jthik](https://avatars.discourse-cdn.com/v4/letter/h/e495f1/32.png) [@HF-stark-Jthik](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FHF-stark-Jthik)%5C
**Post date:** [March 8, 2024, 3:38pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fhas-anyone-come-across-bert-fine-tuned-for-clm-task%2F76553%2F1 "2024-03-08T15:38:35Z")

</div>

Basically the question. BERTs documentation on HF has a **[BertLMHeadModel](https://huggingface.co/docs/transformers/model_doc/bert#transformers.BertLMHeadModel)** class, I am curious to know if anyone has successfully fine-tuned pre-trained BERT (MLM task) to a CLM task [with a good model card]. Could not find any models on HF. Thanks!
