# Can i use BPE tokenizer for T5 model not pretrain

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-i-use-bpe-tokenizer-for-t5-model-not-pretrain%2F16787%3E%5C
**Category:** Beginners\
**Created:** [April 13, 2022, 10:23am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-i-use-bpe-tokenizer-for-t5-model-not-pretrain%2F16787 "2022-04-13T10:23:36Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![Slcreator](https://avatars.discourse-cdn.com/v4/letter/s/8edcca/32.png) [@Slcreator](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FSlcreator)%5C
**Post date:** [April 13, 2022, 10:23am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fcan-i-use-bpe-tokenizer-for-t5-model-not-pretrain%2F16787%2F1 "2022-04-13T10:23:36Z")

</div>

Hi! I’m beginners in NLP, i want to use T5 model not pretrain:

my\_config = T5Config.from\_pretrained("/content/config.json")  
model = T5ForConditionalGeneration(my\_config)

and used my BPE tokenizers:  
fast\_tokenizer = PreTrainedTokenizerFast(tokenizer\_file="/content/tokenizer.json")  
fast\_tokenizer.add\_special\_tokens({‘pad\_token’: ‘[PAD]’})  
fast\_tokenizer.padding\_side = “left”

, but when i trained and i used model.generate this return a tensor([0,1]) i just train 1 epoch.  
Am i wrong anything? or I should train more epochs
