InferenceClient
#30
by
aabruneau
- opened
Does anyone know if the InferenceClient function works with this model:
code returns
HfHubHTTPError: 404 Client Error: Not Found for url: https://a2xrga6nu9h8jf1n.us-east-1.aws.endpoints.huggingface.cloud/ (Request ID: M92ZXC)
using:
client = InferenceClient(CODE_QWEN_URL, token=hf_token)
Best approach for your model
response = client.text_generation(
prompt="Write a function to sort a list",
max_new_tokens=3000,
temperature=0.2, # Lower for code generation
stream=False
)
print(response)
I've confirmed that everything else works with a different model but instead of giving up, wanted to troubleshoot further