.github/workflows
directory.
We have defined a workflow for the evals too. The workflow file is named athina_ci.yml
. The workflow is triggered on every push to the main
branch.
run_athina_evals.py
script is the entry point for our Athina Evals. It is a simple script that uses the Athina Evals SDK to evaluate and validate the Rag Application.
For example we are testing if the response from the Rag Application answers the query using the DoesResponseAnswerQuery
evaluation from athina.
OPENAI_API_KEY
and ATHINA_API_KEY
. You can add these secrets to your repository by navigating to Settings
> Secrets
> New repository secret
.