How to pass Pipeline parameters to SageMaker Hosting?

[OlivierCR]

Hi,

Some HF Pipelines have many controls allowing to customize the inference. How to pass those parameters to a SageMaker HF hosting endpoint, for a specific invocation request?

[philschmid]

You can find documentation here: Reference

[marshmellow77]

To give a specific example (in this case text generation):

• gptj-playground/gptj-playground-app.py at prompt-engineering · marshmellow77/gptj-playground · GitHub (setting parameters)
• gptj-playground/utils.py at prompt-engineering · marshmellow77/gptj-playground · GitHub (calling the endpoint)

[OlivierCR]

many many thanks!