Welcome to AI Build & Learn a weekly AI engineering stream where we pick a new topic and learn by building together.
This event is about evaluating LLM and RAG applications with Ragas, an open-source Python toolkit for objective, automated evals instead of vibes-based testing.
We'll explore Ragas metrics for retrieval and generation quality, automated test data generation, and how to wire evals into a feedback loop so production data drives continuous improvement.
Some things to look up to get started:
- Ragas GitHub: https://github.com/explodinggradients/ragas
- Ragas docs: https://docs.ragas.io/
Resources
- GitHub: https://github.com/sagecodes/ai-build-and-learn - Events Calendar: https://luma.com/ai-builders-and-learners - Slack (Discuss during the week): https://slack.flyte.org/ - Hosted by Sage Elliott: https://www.linkedin.com/in/sageelliott/