# Same loss on multiple nodes

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fsame-loss-on-multiple-nodes%2F60803%3E%5C
**Category:** 🤗Accelerate\
**Created:** [November 2, 2023, 9:57am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fsame-loss-on-multiple-nodes%2F60803 "2023-11-02T09:57:02Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![cwallenwein](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/cwallenwein/32/21752_2.png) [@cwallenwein](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fcwallenwein)%5C
**Post date:** [November 2, 2023, 9:57am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fsame-loss-on-multiple-nodes%2F60803%2F1 "2023-11-02T09:57:02Z")

</div>

Hi Friends 😊  
I’m training a model on two nodes (using Huggingface Trainer) and in the console, both nodes log the same loss. Is that expected or are both nodes seeing the same training data?

---

<div class="post-metadata">

**Author:** ![muellerzr](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/muellerzr/32/21583_2.png) [@muellerzr](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fmuellerzr)%5C
**Post date:** [November 2, 2023, 11:09am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fsame-loss-on-multiple-nodes%2F60803%2F2 "2023-11-02T11:09:04Z")

</div>

Yes, that is how DDP works 🙂