InferenceClient

#30
by aabruneau - opened

Does anyone know if the InferenceClient function works with this model:
code returns
HfHubHTTPError: 404 Client Error: Not Found for url: https://a2xrga6nu9h8jf1n.us-east-1.aws.endpoints.huggingface.cloud/ (Request ID: M92ZXC)

using:
client = InferenceClient(CODE_QWEN_URL, token=hf_token)

Best approach for your model

response = client.text_generation(
prompt="Write a function to sort a list",
max_new_tokens=3000,
temperature=0.2, # Lower for code generation
stream=False
)

print(response)

I've confirmed that everything else works with a different model but instead of giving up, wanted to troubleshoot further

Sign up or log in to comment