What people actually say about RAGAS
52 mentions across 5 sources · 50% positive · researched Aug 24, 2026
Hacker News, YouTube, Stack Overflow, GitHub, Lemmy
What users praise
- • Free, open-source, and integrates with LangChain, LlamaIndex, and more.
- • Provides LLM-driven metrics like Faithfulness and Context Precision that work well.
- • Test data generation for RAG and agents saves significant manual effort.
What frustrates them
- • Setup can be tricky, especially with Azure OpenAI and API key configuration.
- • Dataset schema is picky; 'contexts' must be exactly Sequence[string] or errors occur.
- • Custom metric creation with decorators is still clunky and undocumented in places.
This is a summary. The full report adds every quote we found, a per-source breakdown, recurring themes, hidden costs and the learning curve — run a free scan below, or see the full RAGAS review.
What comes up again and again about RAGAS
Recurring themes across everything we collected, with where each one showed up.
RAGAS is a must-have for RAG evaluation, catching retrieval issues early.
praised · seen on Hacker News, YouTube
Setup and integration pain, especially with Azure OpenAI and non-standard setups.
criticised · seen on Stack Overflow, GitHub
Dataset format restrictions cause frequent errors and frustration.
criticised · seen on GitHub
Excellent learning resources, with tutorials that are clear and beginner-friendly.
praised · seen on YouTube
Feature gaps and bugbears: embedding support, language adaptation, and open issues.
criticised · seen on GitHub, Stack Overflow
How hard is RAGAS to learn?
Users describe it as intermediate · typically A few hours to get going
Where people get stuck
- • Dataset format strictness (Sequence[string] for contexts)
- • Setting up API keys and non-OpenAI providers
- • Understanding the experiment workflow and metric configuration
Who RAGAS actually suits
Works well for
- • Developers building RAG-based applications who need to validate retrieval quality
- • ML engineers looking for reproducible, code-based evaluation loops
- • Teams using LangChain or LlamaIndex who want tight integration
- • Anyone needing agent-specific metrics like tool call accuracy
Not the right fit for
- • Beginners looking for a plug-and-play evaluation solution
- • Teams without a budget for LLM API costs at scale (metrics require LLM calls)
- • Users needing pre-computed embeddings without re-sending text
- • Teams requiring extensive out-of-the-box language support beyond English
What people are discussing right now
Discussion volume is medium and trending up
- RAG vs agent evaluation, comparing RAGAS to DeepEval, using RAGAS with Azure, getting started tutorials
What people really think about RAGAS
A real-time sweep of the open web — social media, forums, review sites, video reviews and live community discussions — distilled into one honest verdict with the actual mentions behind it.
What's inside your RAGAS report
Everything you need to decide — distilled from real, current user opinion.
Live mentions
The actual posts, reviews & complaints about RAGAS — with links and dates.
Honest verdict
A straight answer on whether it lives up to the hype — and who it’s really for.
Praise & gripes
What users genuinely love and the frustrations that keep coming up.
Real quotes
Representative voices from real users, not marketing copy.
Recurring themes
The patterns across hundreds of opinions, surfaced at a glance.
Red flags
Hidden costs and dealbreakers people only discover after signing up.
How it works
Sign up free
Create an account in seconds — get 5 free scans, no card.
We sweep the web
Live social media, forums, reviews & video opinions — in ~30–60s.
Get your report
An honest, downloadable verdict with the real mentions behind it.
Ready to see the real verdict on RAGAS?
Your scan is ready in under a minute · ₹20 / $1.
Top alternatives to RAGAS
Researching options? Explore the closest alternatives.
Phoenix
Open-source tracing, evaluation, and prompt iteration for AI agents — self-host it on your own infrastructure with no per-span bill.
Evidently AI
Open-source AI evaluation and observability for LLMs, RAG, agents, and predictive ML models.
Arize Phoenix
Open-source LLM observability and evals for building reliable agents
Langfuse
Open-source LLM observability for tracing, evaluating, and optimizing AI agents.
TruLens
Open-source, OpenTelemetry-native agent evaluation and tracing that finds where your agent fails.
MLflow
Open source platform to debug, evaluate, monitor, and optimize AI agents and ML models.
Check sentiment on these too
Run a live scan on the alternatives before you decide.
RAGAS — questions buyers ask
What do people complain about most with RAGAS?
The complaints that recur most often are setup can be tricky, especially with Azure OpenAI and API key configuration, dataset schema is picky, 'contexts' must be exactly Sequence[string] or errors occur and custom metric creation with decorators is still clunky and undocumented in places. Drawn from 52 mentions across 5 sources.
What do users like about RAGAS?
Users consistently praise free, open-source, and integrates with LangChain, LlamaIndex, and more, provides LLM-driven metrics like Faithfulness and Context Precision that work well and test data generation for RAG and agents saves significant manual effort.
Is RAGAS hard to learn?
Users describe it as intermediate; most people are up and running in a few hours; the usual sticking points are dataset format strictness (Sequence[string] for contexts) and setting up API keys and non-OpenAI providers.
Who should not use RAGAS?
Based on what users report, it is a poor fit for beginners looking for a plug-and-play evaluation solution, teams without a budget for LLM API costs at scale (metrics require LLM calls) and users needing pre-computed embeddings without re-sending text.
What are people saying about RAGAS right now?
Discussion volume is medium and trending up. Current topics: RAG vs agent evaluation, comparing RAGAS to DeepEval, using RAGAS with Azure, getting started tutorials.
How current is this report?
Each scan runs live the moment you click — it reflects what people are saying now, and every report lists the dated mentions behind it.
Can I download it?
Yes — download the full report as a polished, shareable PDF.