# Why our dataset have unsafe files?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671%3E%5C
**Category:** 🤗Datasets\
**Created:** [August 6, 2023, 11:35am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671 "2023-08-06T11:35:33Z")\
**Posts on this page:** 7\
**Page:** 1

<div class="post-metadata">

**Author:** ![silver](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/silver/32/18252_2.png) [@silver](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsilver)%5C
**Post date:** [August 6, 2023, 11:35am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671%2F1 "2023-08-06T11:35:33Z")

</div>

We have uploaded a set of .gz files.

However, on the main page of our dataset ([liwu/MNBVC · Datasets at Hugging Face](https://huggingface.co/datasets/liwu/MNBVC)), the following warning is shown:

This dataset has 267 files that have been marked as unsafe.

For each file, the following error can be seen:

Virus: Can’t write to file ERROR

I am wondering why? Why our dataset is unsafe?

These files are just compressed text files, in particular, compressed .jsonl files in UTF-8. They are absolutly **SAFE**.

---

<div class="post-metadata">

**Author:** ![severo](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/severo/32/27449_2.png) [@severo](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsevero)%5C
**Post date:** [August 7, 2023, 3:32pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671%2F2 "2023-08-07T15:32:14Z")

</div>

cc @mcpotato

---

<div class="post-metadata">

**Author:** ![silver](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/silver/32/18252_2.png) [@silver](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsilver)%5C
**Post date:** [August 16, 2023, 1:54am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671%2F3 "2023-08-16T01:54:22Z")

</div>

any update?

---

<div class="post-metadata">

**Author:** ![mcpotato](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mcpotato/32/19469_2.png) [@mcpotato](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmcpotato)%5C
**Post date:** [September 13, 2023, 2:49pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671%2F4 "2023-09-13T14:49:55Z")

</div>

Ah sorry about that, an error must have happened during scanning. I’ll check to see what happened and try to re-scan.

---

<div class="post-metadata">

**Author:** ![mcpotato](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mcpotato/32/19469_2.png) [@mcpotato](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmcpotato)%5C
**Post date:** [September 14, 2023, 9:30am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671%2F5 "2023-09-14T09:30:38Z")

</div>

Re-scan was broken, it seems to have went through this time, only 27 files are marked as unsafe now, with “valid” flags.

---

<div class="post-metadata">

**Author:** ![silver](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/silver/32/18252_2.png) [@silver](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsilver)%5C
**Post date:** [September 15, 2023, 1:32am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671%2F6 "2023-09-15T01:32:59Z")

</div>

These files are just texts in json format. How texts be “unsafe” 😅

---

<div class="post-metadata">

**Author:** ![mcpotato](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/mcpotato/32/19469_2.png) [@mcpotato](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmcpotato)%5C
**Post date:** [September 25, 2023, 9:09am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fwhy-our-dataset-have-unsafe-files%2F49671%2F7 "2023-09-25T09:09:34Z")

</div>

It depends on the matching rules of the antivirus, some text files can contain code or some string that is used to detect viruses.
