Reformer-enwik8 do not have <EOS> token

Flash321 July 28, 2021, 12:34pm 1

It seems that the language model does not have a token Is this correct?

Topic		Replies	Views
Reformer-enwik8 output does not seem to make sense Models	1	505	July 28, 2021
How does GPT decide to stop generating sentences without EOS token? 🤗Transformers	13	25412	August 19, 2024
Causal language modeling documentation is wrong? 🤗Transformers	0	185	May 26, 2023
Why does the falcon QLoRA tutorial code use eos_token as pad_token? Models	19	8148	January 17, 2024
Chatbot using Reformer model. Not able to find "token_type_ids" like BERT 🤗Transformers	1	638	September 24, 2020