internlm

/

Intern-S1-mini-FP8

like 1

Follow

Intern Large Models 849

Is there something wrong with the chat template?
I'm using vllm serve internlm/Intern-S1-mini-FP8 --task generate --trust-remote-code to launch the model. I tried using it in OpenWebui and AnythingLLM. The <think> token doesn't seem to work right.

The text that should be inside the <think> tags are instead being output as regular text. I see the reasoning text, the </think>token, and then the response after thinking. The first <think> never seems to never be outputted.

This causes all the reasoning and non-reasoning response to be output as one thing.

tell me a story

Okay, the user asked for a story. Let me think of a good one. Maybe a fairy tale? They usually are engaging and have a nice structure. Let me pick a classic theme, like a magical forest. The main character should be a young protagonist, perhaps a girl. She could discover something magical. Let’s name her Lily. She finds a hidden door in an old cottage. Inside, there’s a magical forest with talking animals. A wise old owl asks her to help a creature in trouble. Maybe a unicorn trapped in a thorn bush. She helps it, and the unicorn rewards her with a gift. The moral could be about kindness and bravery. Let me make sure the story flows well and has a happy ending. Check for any errors and keep it simple and clear. Alright, time to put it all together. </think>

Once upon a time, in a village nestled between misty hills, there lived a curious girl named Lily. She spent her days exploring the edges of her quiet town, where the woods whispered secrets only the wind could hear. One autumn afternoon, while chasing a butterfly that led her deeper than she’d ever gone, Lily stumbled upon a weathered cottage hidden behind a curtain of ivy. Its windows glowed with an amber light, and a single cracked door creaked open.

Inside, the air shimmered like dust motes caught in sunlight. A tiny door sat on the floor, adorned with intricate carvings of leaves and stars. Without hesitation, Lily stepped through it, and the world beyond unfolded like a dream. The forest here was alive: trees hummed with ancient songs, fireflies wove constellations in the air, and a silver fox with eyes like twin moons bowed to her, beckoning her forward.

“Welcome, Seeker,” said a voice—soft and wise, as if the wind had spoken. A great owl perched on a gnarled branch, its feathers ruffled by unseen currents. “This realm is fragile. A shadow threatens to devour its light. Will you help restore balance?”

...

What should be output

<think>Okay, the user asked for a story. Let me think of a good one. Maybe a fairy tale? They usually are engaging and have a nice structure. Let me pick a classic theme, like a magical forest. The main character should be a young protagonist, perhaps a girl. She could discover something magical. Let’s name her Lily. She finds a hidden door in an old cottage. Inside, there’s a magical forest with talking animals. A wise old owl asks her to help a creature in trouble. Maybe a unicorn trapped in a thorn bush. She helps it, and the unicorn rewards her with a gift. The moral could be about kindness and bravery. Let me make sure the story flows well and has a happy ending. Check for any errors and keep it simple and clear. Alright, time to put it all together. </think>

Once upon a time, in a village nestled between misty hills, there lived a curious girl named Lily. She spent her days exploring the edges of her quiet town, where the woods whispered secrets only the wind could hear. One autumn afternoon, while chasing a butterfly that led her deeper than she’d ever gone, Lily stumbled upon a weathered cottage hidden behind a curtain of ivy. Its windows glowed with an amber light, and a single cracked door creaked open.

Inside, the air shimmered like dust motes caught in sunlight. A tiny door sat on the floor, adorned with intricate carvings of leaves and stars. Without hesitation, Lily stepped through it, and the world beyond unfolded like a dream. The forest here was alive: trees hummed with ancient songs, fireflies wove constellations in the air, and a silver fox with eyes like twin moons bowed to her, beckoning her forward.

“Welcome, Seeker,” said a voice—soft and wise, as if the wind had spoken. A great owl perched on a gnarled branch, its feathers ruffled by unseen currents. “This realm is fragile. A shadow threatens to devour its light. Will you help restore balance?”

...