# mistralai/Mistral-7B-v0.1 temperature

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmistralai-mistral-7b-v0-1-temperature%2F114601%3E%5C
**Category:** Models\
**Created:** [October 29, 2024, 8:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmistralai-mistral-7b-v0-1-temperature%2F114601 "2024-10-29T20:44:46Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![Coralevy](https://avatars.discourse-cdn.com/v4/letter/c/b2d939/32.png) [@Coralevy](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FCoralevy)%5C
**Post date:** [October 29, 2024, 8:44pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmistralai-mistral-7b-v0-1-temperature%2F114601%2F1 "2024-10-29T20:44:46Z")

</div>

I use the HF end point for the mistralai/Mistral-7B-v0.1 model. I set the temperature to 1. I run the same question and get the same answer. Isn’t it should be the opposite? (to give the same output for temp=0 and the most randomness for temp=1)

---

<div class="post-metadata">

**Author:** ![John6666](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/john6666/32/27664_2.png) [@John6666](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FJohn6666)%5C
**Post date:** [October 29, 2024, 11:33pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmistralai-mistral-7b-v0-1-temperature%2F114601%2F2 "2024-10-29T23:33:36Z")

</div>

No, that is correct; it is the same for Llamacpp as well as Transformers.  
If you want it to work even more deterministically, set **doSample=False**.

---

<div class="post-metadata">

**Author:** ![DataTiger](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/datatiger/32/34464_2.png) [@DataTiger](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FDataTiger)%5C
**Post date:** [November 13, 2024, 6:50am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fmistralai-mistral-7b-v0-1-temperature%2F114601%2F3 "2024-11-13T06:50:02Z")

</div>

The temperature parameter in language models influences the randomness of their outputs. Setting it to 1 should generally allow for variability, so if you’re still getting the same answer, it might be due to implementation issues, model-specific behavior, or endpoint configuration affecting the output. Double-checking API settings and testing with different temperature values could be helpful.

By the way, if you’re still navigating which LLMs work best for your needs, you might want to check out PepperMill Beta. It’s an AI evaluation and orchestration platform with over 200 LLMs to choose from, helping businesses quickly identify and deploy the most effective AI solutions. It ensures optimal LLM choices, prompt quality, and token management tailored to your specific requirements.
