Chapter 1 questions

John6666 · May 28, 2025, 7:06am

I tend to use max_new_tokens.

"Both `max_new_tokens` and `max_length` have been set but they serve the same purpose" when only setting max_new_tokens.

opened 02:03PM - 30 Jan 23 UTC

closed 08:47PM - 30 Jan 23 UTC

### System Info - `transformers` version: 4.27.0.dev0 - Platform: Windows-10…-10.0.19044-SP0 - Python version: 3.10.4 - Huggingface_hub version: 0.12.0 - PyTorch version (GPU?): 1.13.1+cpu (False) - Tensorflow version (GPU?): not installed (NA) - Flax version (CPU?/GPU?/TPU?): not installed (NA) - Jax version: not installed - JaxLib version: not installed - Using GPU in script?: No - Using distributed or parallel set-up in script?: No ### Who can help? @gante I believe. ### Information - [ ] The official example scripts - [X] My own modified scripts ### Tasks - [X] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...) - [ ] My own task or dataset (give details below) ### Reproduction 1. Install transformers 2. Run the following script ``` from transformers import pipeline summarizer = pipeline("summarization", max_new_tokens=50) prompt = "text to summarize" summary = summarizer(prompt) ``` 3. It crashes with the following error: > ValueError: Both `max_new_tokens` and `max_length` have been set but they serve the same purpose -- setting a limit to the generated output length. Remove one of those arguments. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation) ### Expected behavior Expected behavior is that the script should run. I only set `max_new_tokens` and not `max_length`. This might seem like a duplicate of https://github.com/huggingface/transformers/issues/20894 but the issue persists even after installing the latest version of transformers with the fix for that issue.

Topic		Replies	Views
Bert2bert translator? 🤗Transformers	6	66	August 28, 2025
Chapter 7 questions Course	121	10726	October 22, 2025
EncoderDecoderModel for token classification 🤗Transformers	0	207	October 29, 2022
GPT-GPT encoder decoder 🤗Transformers	0	302	May 4, 2021
Encoder-Decoder model only generates bos_token's [<s><s><s>] Models	17	3258	December 6, 2022

Chapter 1 questions

Related topics