# Malicious code at top of huggingface leaderboard?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmalicious-code-at-top-of-huggingface-leaderboard%2F99682%3E%5C
**Category:** Models\
**Created:** [July 27, 2024, 2:30pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmalicious-code-at-top-of-huggingface-leaderboard%2F99682 "2024-07-27T14:30:36Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![rosmine](https://avatars.discourse-cdn.com/v4/letter/r/c6cbf5/32.png) [@rosmine](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Frosmine)%5C
**Post date:** [July 27, 2024, 2:30pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmalicious-code-at-top-of-huggingface-leaderboard%2F99682%2F1 "2024-07-27T14:30:36Z")

</div>

A pretty simple attack would be to train on the test set to get a model to the top of the leaderboard, then put bad code in a pickle file. Since Safetensors are so common people won’t even check file format anymore.

The model at the top of the MTEB leaderboard seems sketchy [MTEB Leaderboard - a Hugging Face Space by mteb](https://huggingface.co/spaces/mteb/leaderboard)  
It’s a pickle file, and it’s a 1.5B param model that scores way better than 7B param models.

Also the model card specifically says that you have to use “trust\_remote\_code=True” [dunzhang/stella\_en\_1.5B\_v5 · Hugging Face](https://huggingface.co/dunzhang/stella_en_1.5B_v5)

Am I being paranoid or is this a problem?

P.S. If the developer is reading this, I’ve sorry for being suspicious, but please use safetensors next time.