BERT as language model
Compare different tokenizers in char-level and byte-level.
Generating synthetic data via self-chatting
GPT 4o like bot.
Knowledge-injected Pre-trained Language Model