# Qwen tokenizer, omit Ġ from offset\_mapping

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fqwen-tokenizer-omit-g-from-offset-mapping%2F163495%3E%5C
**Category:** 🤗Tokenizers\
**Created:** [July 17, 2025, 5:19pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fqwen-tokenizer-omit-g-from-offset-mapping%2F163495 "2025-07-17T17:19:03Z")\
**Posts on this page:** 1\
**Showing post:** 4

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [July 18, 2025, 10:39am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fqwen-tokenizer-omit-g-from-offset-mapping%2F163495%2F4 "2025-07-18T10:39:53Z")

</div>

Looking at [the GitHub issue above](https://github.com/huggingface/transformers/issues/39401#issuecomment-3077842949) and [old posts](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fissues-with-offset-mapping-values%2F4237)%2C it seems like there’s no way to do this…  
It might be quicker to raise an issue in the Transoformers repo…

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fqwen-tokenizer-omit-g-from-offset-mapping%2F163495)._