# A custom trainer for multi-task learning?

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fa-custom-trainer-for-multi-task-learning%2F27039%3E%5C
**Category:** 🤗Transformers\
**Created:** [December 1, 2022, 8:07am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fa-custom-trainer-for-multi-task-learning%2F27039 "2022-12-01T08:07:30Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![EvilIceCream](https://avatars.discourse-cdn.com/v4/letter/e/eb8c5e/32.png) [@EvilIceCream](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2FEvilIceCream)%5C
**Post date:** [December 1, 2022, 8:07am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fa-custom-trainer-for-multi-task-learning%2F27039%2F1 "2022-12-01T08:07:30Z")

</div>

Hi!  
I am working on using Trainer under a multi-task setting. Specifically, a list of losses(`[loss1, loss2, ...]`) is returned in a single model forward, and optimized with a custom optimizer like [PCGrad](https://github.com/WeiChengTseng/Pytorch-PCGrad). How can I do this with minimal changes to Trainer (while preserving all the nice features of Trainer like multi-gpu training)?  
Thanks!

---

<div class="post-metadata">

**Author:** ![yeshwanthv5](https://sea2.discourse-cdn.com/hellohellohello/user_avatar/discuss.huggingface.co/yeshwanthv5/32/18621_2.png) [@yeshwanthv5](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fyeshwanthv5)%5C
**Post date:** [September 18, 2024, 6:13pm UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fa-custom-trainer-for-multi-task-learning%2F27039%2F2 "2024-09-18T18:13:57Z")

</div>

Did you find a reliable solution for this?
