Skip to main content
See this post for a step-by-step guide and video on how to use Athina IDE to measure retrieval accuracy in RAG applications: Measure Retrieval Accuracy Using Athina IDE

Common Failures in RAG-based LLM apps

RAG-based LLM apps are great, but there are always a lot of kinks and imperfections to iron out. Here are some common ones:

Bad retrieval

Bad outputs

How to detect such issues

Just plug in the evaluators you need and run the evals on your dataset.
You can run these evaluations in a python notebook, and view results in a dataframe like this: Example Notebook on Github