ocisd4
/

Phi-3-mini-tokenizer

Model card Files Files and versions

AlexHT_Hung commited on Jun 19, 2024

Commit

4bb24b8

·

1 Parent(s): 6d96773

fix

Files changed (1) hide show

tokenizer.json +1 -1

tokenizer.json CHANGED Viewed

@@ -77,7 +77,7 @@
     },
     {
       "id": 32005,
-      "content": "<|placeholder4|>",
       "single_word": false,
       "lstrip": false,
       "rstrip": true,

     },
     {
       "id": 32005,
+      "content": "<|tool_calls|>",
       "single_word": false,
       "lstrip": false,
       "rstrip": true,