> ## Documentation Index
> Fetch the complete documentation index at: https://docs.athina.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Athina Evals

### Quick Start Guides

<CardGroup>
  <Card title="Running evals using Athina SDK" icon="code" color="#ff0077" href="/api-reference/evals/running-evals/run-eval-suite">
    Run 40+ preset evals or your own custom evals in just a few lines of code using our python SDK.
  </Card>

  <Card title="Running evals on Athina Platform" icon="play" color="#ff0077" href="/datasets/run-eval">
    Run 40+ preset evals or your own custom evals on any dataset.
  </Card>

  <Card title="Comparing different models and prompts using Athina" icon="table-columns" color="#ff0077" href="/datasets/compare-datasets">
    Compare retrievals and responses from different datasets, and run evaluations on both datasets.
  </Card>

  <Card title="Continuous evaluation in production" icon="watchman-monitoring" color="#ff0077" href="/evals/online-evals">
    Configure evaluations to run continuously on production logs to measure quality, and detect hallucinations.
  </Card>

  <Card title="Setting up evals in CI / CD" icon="timeline" color="#ff0077" href="/evals/running-evals-ci-cd">
    Run evals in your CI / CD pipeline to prevent regressions, and ensure that bad prompts / models don't get to production.
  </Card>

  <Card title="Real-time guardrailing using Athina Guard" icon="shield" color="#ff0077" href="/guides/evals/running-evals-guardrails">
    Detect bad inputs and outputs in real-time.
  </Card>
</CardGroup>

***

### Preset Evaluators

Athina has a large library of preset evaluators to cover all kinds of common use cases.

However, evals are not one-size-fits-all. Which is why Athina supports many ways to use custom evals, or even create your own.

[Schedule a call](https://cal.com/shiv-athina/30min) with us, and we'll set up your evaluation and safety suite for you.

#### Hallucinations

<CardGroup>
  <Card title="Detect hallucinations in RAG apps" icon="exclamation" color="#1177dd" href="/guides/evals/measuring-retrieval-accuracy-in-rag">
    Detect hallucinations and measure quality of RAG apps in a few minutes.
  </Card>

  <Card title="Detect hallucinations in LLM generated summaries" icon="exclamation" color="#1177dd" href="/api-reference/evals/preset-evals/summarization-qa">
    Detect hallucinations and measure accuracy of LLM-generated summaries.
  </Card>
</CardGroup>

#### Safety

<CardGroup>
  <Card title="Prompt Injection" icon="square" color="#1177dd" href="/api-reference/evals/preset-evals/safety/prompt-injection">
    Fails if Prompt Injection attack is found in the text.
  </Card>

  <Card title="Detect PII" icon="square" color="#1177dd" href="/api-reference/evals/preset-evals/safety/pii-detection">
    Detect common Prompt Injection attacks.
  </Card>

  <Card title="OpenAI Content Moderation" icon="square" color="#1177dd" href="/api-reference/evals/preset-evals/safety/open-ai-content-moderation">
    Detect common Prompt Injection attacks.
  </Card>

  <Card title="Guardrails" icon="hand" color="#1177dd" href="/api-reference/evals/preset-evals/guardrails">
    Detect common Prompt Injection attacks.
  </Card>
</CardGroup>

#### RAG

<CardGroup>
  <Card title="Measure retrieval and response quality in RAG apps" icon="timeline" color="#1177dd" href="/guides/evals/measuring-retrieval-accuracy-in-rag">
    Use a suite of Ragas + Athina evals to measure the quality of your
    retrievals and responses for RAG apps.
  </Card>

  <Card title="Ragas" icon="timeline" color="#1177dd" href="/api-reference/evals/preset-evals/rag/ragas">
    Ragas is a popular open-source library with state-of-the-art evals for RAG
    use cases.
  </Card>

  <Card title="Context Sufficiency" icon="timeline" color="#1177dd" href="/api-reference/evals/preset-evals/rag/context-sufficiency">
    Checks if the retrieved context contains enough information to answer the
    query.
  </Card>

  <Card title="Answer Completeness" icon="timeline" color="#1177dd" href="/api-reference/evals/preset-evals/rag/answer-completeness">
    Checks if the LLM response completely answers the query.
  </Card>

  <Card title="Faithfulness" icon="timeline" color="#1177dd" href="/api-reference/evals/preset-evals/rag/response-faithfulness">
    Checks if the LLM response was faithful to the provided context
  </Card>

  <Card title="Groundedness" icon="timeline" color="#1177dd" href="/api-reference/evals/preset-evals/rag/groundedness">
    Checks the LLM response sentence-by-sentence to find evidence of each
    sentence in the provided context.
  </Card>
</CardGroup>

#### Grounded evals

If you have ground truth data, you may use these evals

{" "}

<Card title="Grounded Evals" icon="circle" color="#1177dd" href="/api-reference/evals/preset-evals/conversation-evals">
  These evaluators look at the entire chat instead of just a single message.
</Card>

#### Conversation evals

{" "}

<Card title="Conversational Evaluators" icon="timeline" color="#1177dd" href="/api-reference/evals/preset-evals/conversation-evals">
  These evaluators look at the entire chat instead of just a single message.
</Card>

#### Custom evals

<Card title="Custom Evals" icon="code" color="#1177dd" href="/evals/custom-evals">
  Learn how you can use custom evals on Athina.
</Card>

#### Function evals

<Card title="Function Evals" icon="code" color="#1177dd" href="/api-reference/evals/preset-evals/function-evals">
  A set of preset functions for quick evaluation.
</Card>

#### Write your own eval

<Card title="Custom Code Eval" icon="code" color="#1177dd" href="/api-reference/evals/custom-evals/custom-code-eval">
  Learn how you can write python code as an eval.
</Card>

#### We can build evals for you

<Card title="We'll work with you to create custom evals for your use case" icon="timeline" color="#1177dd" href="https://cal.com/shiv-athina/30min">
  Schedule a call with us - we are happy to create custom evaluators for your
  use case.
</Card>

<Card title="Want us to integrate an open-source eval library?" icon="timeline" color="#1177dd" href="mailto:hello@athina.ai">
  We are happy to integrate with new libraries. Send us an email at
  [hello@athina.ai](mailto:hello@athina.ai).
</Card>
