# Llama2 70b - Cuda out of memory exceptions

**URL:** </static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fllama2-70b-cuda-out-of-memory-exceptions%2F75110%3E%5C
**Category:** 🤗Transformers\
**Created:** [February 28, 2024, 6:47am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fllama2-70b-cuda-out-of-memory-exceptions%2F75110 "2024-02-28T06:47:44Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![sanipanwala](https://avatars.discourse-cdn.com/v4/letter/s/8491ac/32.png) [@sanipanwala](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Fu%2Fsanipanwala)%5C
**Post date:** [February 28, 2024, 6:47am UTC](/static-proxy?url=https%3A%2F%2Fdiscuss.huggingface.co%2Ft%2Fllama2-70b-cuda-out-of-memory-exceptions%2F75110%2F1 "2024-02-28T06:47:44Z")

</div>

Hello,

I have 2 GPU of 24 GB RTX 4090 GPU.

I want to fine-tune the 70b model but it throws a **cuda out of memory exceptions** even though I have used Lora and BitsAndBytesConfig.

Let me know if I’m overlooking this or please give me suggestions.

Thanks.
