Custom BenchMark creation

[John6666]

It’s a field I know nothing about, but it seems that Ragas is famous.

Use RAGAS with huggingface LLM

Hello everybody, I want to use the RAGAS lib to evaluate my RAG pipeline. The evaluation model should be a huggingface model like Llama-2, Mistral, Gemma and more. How can I implement it with the named library or is there another solution? The examples by the team Examples by RAGAS team aren’t helpful for me, because they doesn’t show, how to use specific Huggingface model. Also a specifc langchain pipeline doesn’t work, because it isn’t the required class. Best regards Christian