# BigBirDNA - Pretraining BigBird on DNA sequences

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbigbirdna-pretraining-bigbird-on-dna-sequences%2F7315%3E%5C
**Category:** Flax/JAX Projects\
**Created:** [June 24, 2021, 11:43pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbigbirdna-pretraining-bigbird-on-dna-sequences%2F7315 "2021-06-24T23:43:26Z")\
**Posts on this page:** 1\
**Showing post:** 9

<div class="post-metadata">

**Author:** ![SauravMaheshkar](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/sauravmaheshkar/32/23652_2.png) [@SauravMaheshkar](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FSauravMaheshkar)%5C
**Post date:** [June 28, 2021, 5:28pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbigbirdna-pretraining-bigbird-on-dna-sequences%2F7315%2F9 "2021-06-28T17:28:21Z")

</div>

Hey @valhalla, I’m still not sure if I want to be a part of this project or the [ProteinBERT](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fpretrain-proteinbert-from-scratch%2F7519) project. I’d rather be a part of ProteinBERT, incase it gets accepted

---

_[View the full topic](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fbigbirdna-pretraining-bigbird-on-dna-sequences%2F7315)._
