Metrics

Component-Wise Evaluation

Just like in any machine learning system, the performance of individual components within the LLM and RAG pipeline has a significant impact on the overall experience. Ragas offers metrics tailored for evaluating each component of your RAG pipeline in isolation.

• Faithfulness

• Answer relevancy

• Context recall

• Context precision

• Context relevancy

• Context entity recall

End-to-End Evaluation

Evaluating the end-to-end performance of a pipeline is also crucial, as it directly affects the user experience. Ragas provides metrics that can be employed to assess the overall performance of your pipeline, ensuring a comprehensive evaluation.

• Answer semantic similarity

• Answer correctness