# Fine tune the text generation with gpt2

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-the-text-generation-with-gpt2%2F31664%3E%5C
**Category:** Beginners\
**Created:** [February 14, 2023, 2:01am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-the-text-generation-with-gpt2%2F31664 "2023-02-14T02:01:26Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![LycheeX](https://avatars.discourse-cdn.com/v4/letter/l/f1d935/32.png) [@LycheeX](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FLycheeX)%5C
**Post date:** [February 14, 2023, 2:01am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-the-text-generation-with-gpt2%2F31664%2F1 "2023-02-14T02:01:26Z")

</div>

with my own datasets,such as a lot of text (not dialog)  
could you pls help me ?

---

<div class="post-metadata">

**Author:** ![joaogante](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/joaogante/32/20106_2.png) [@joaogante](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fjoaogante)%5C
**Post date:** [February 21, 2023, 4:07pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-the-text-generation-with-gpt2%2F31664%2F2 "2023-02-21T16:07:40Z")

</div>

Hi @LycheeX 👋 We have examples covering it [here](https://github.com/huggingface/transformers/tree/main/examples/pytorch/language-modeling)

---

<div class="post-metadata">

**Author:** ![LycheeX](https://avatars.discourse-cdn.com/v4/letter/l/f1d935/32.png) [@LycheeX](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FLycheeX)%5C
**Post date:** [February 22, 2023, 5:45am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Ffine-tune-the-text-generation-with-gpt2%2F31664%2F3 "2023-02-22T05:45:12Z")

</div>

thx, have tried.
