squarelike
/

Gugugo-koen-7B-V1.1-GPTQ

text-generation

text-generation-inference

4-bit precision

Model card Files Files and versions

squarelike commited on Oct 29, 2023

Commit

2dc7fa1

·

1 Parent(s): e34c599

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -71,8 +71,9 @@ def gen(lan="en", x=""):
             return_token_type_ids=False
         ).to("cuda"),
         max_new_tokens=2000,
-        temperature=0.1,
-        do_sample=True,
         stopping_criteria=stopping_criteria
     )
     return tokenizer.decode(gened[0][1:]).replace(prompt+" ", "").replace("</끝>", "")

             return_token_type_ids=False
         ).to("cuda"),
         max_new_tokens=2000,
+        temperature=0.3,
+        # no_repeat_ngram_size=5,
+        num_beams=5,
         stopping_criteria=stopping_criteria
     )
     return tokenizer.decode(gened[0][1:]).replace(prompt+" ", "").replace("</끝>", "")