Update README.md
Browse files
README.md
CHANGED
|
@@ -108,7 +108,7 @@ pip install git+https://github.com/ZagrosLLMModel/transformers.git@main
|
|
| 108 |
```
|
| 109 |
|
| 110 |
### Inference
|
| 111 |
-
- **Hardware Requirements**: Recommended to use a GPU with at least
|
| 112 |
- **Software Dependencies**: Compatible with PyTorch and the specified Transformers library (version from ZagrosLLMModel repository).
|
| 113 |
- **Example Code**:
|
| 114 |
```python
|
|
|
|
| 108 |
```
|
| 109 |
|
| 110 |
### Inference
|
| 111 |
+
- **Hardware Requirements**: Recommended to use a GPU with at least 64GB VRAM for efficient inference. CPU inference is possible but slower.
|
| 112 |
- **Software Dependencies**: Compatible with PyTorch and the specified Transformers library (version from ZagrosLLMModel repository).
|
| 113 |
- **Example Code**:
|
| 114 |
```python
|