📚 Core Concepts¶
Ragas aims to create an open standard, providing developers with the tools and techniques to leverage continual learning in their RAG applications. With Ragas, you would be able to
Synthetically generate a diverse test dataset that you can use to evaluate your app.
Use LLM-assisted evaluation metrics designed to help you objectively measure the performance of your application.
Monitor the quality of your apps in production using smaller, cheaper models that can give actionable insights. For example, the number of hallucinations in the generated answer.
Use these insights to iterate and improve your application.
what is RAG and continual learning?
RAG
Retrieval augmented generation (RAG) is a paradigm for augmenting LLM with custom data. It generally consists of two stages:
indexing stage: preparing a knowledge base, and
querying stage: retrieving relevant context from the knowledge to assist the LLM in responding to a question
Continual Learning
Continual learning is concept used in machine learning that aims to learn, iterate and improve ML pipelines over it’s lifetime using the insights derived from continuous stream of data points. In LLM & RAGs, this can be applied by iterating and improving each components of LLM application from insights derived from production and feedback data.