Customizations

How to Customize Ragas for Your Needs

• Bring Your Own LLMs and Embeddings
  • Evaluations
  • Test set Generation
    • LLMs
    • DocumentStore
• Using Ragas Critic Model instead of GPT-4
  • Initialize the required Models
    • Setting up generator Model (gpt-3.5)
    • Setting up Model
    • Set up custom Critic Model instead of GPT-4
  • Loading data
  • Generating
• Max Workers, Timeouts, Retries and more with RunConfig
  • Rate Limits
• Using Azure OpenAI
  • Load sample dataset
  • Configuring them for Azure OpenAI endpoints
  • Evaluation
  • Test set generation
• Using Amazon Bedrock
  • Metrics
    • Load sample dataset
    • Evaluation
  • Test Data Generation
• Vertex AI
  • Load Sample Dataset
  • Evaluation