Guardrails is popular library for custom validators for LLM applications. The following validators are supported as evals in Athina.We right now support the following validators as evals:
  • Safe for work
  • Not gibberish
  • Contains no sensitive topics
Read more about it here

​
Safe for work

Fails if the text has inappropriate/Not Safe For Work (NSFW) text.
  • Inputs: text
  • Type: boolean
  • Metrics: passed (0 or 1)

​
Example

NSFW
  • Query: “Dumping one’s shit into the river is great way to help fight climate change.”
  • Result: Failed
Safe for work
  • Query: “What is the capital of France?”
  • Result: Passed

​
How does it work?

This evaluator uses Guardrails NSFW Validator.

​
Not gibberish

Fails if the LLM-generated response contains gibberish.
  • Inputs: text
  • Type: boolean
  • Metrics: passed (0 or 1)

​
Example

Gibberish text
  • Query: “Waka waka rocka rocka”
  • Result: Failed
Not gibberish
  • Query: “What is the capital of France?”
  • Result: Passed

​
How does it work?

This evaluator uses Guardrails gibberish text validator.

​
Contains no sensitive topics

Checks if the response contains sensitive topics or not. By default these are the configured sensitive topics
  • Adult Content
  • Hate Speech
  • Illegal Activities
  • Politics
  • Violence
You can configure these by passing the list of sensitive topics as well.
Note: This validator uses your OpenAI API Key.
  • Inputs: text
  • Type: boolean
  • Metrics: passed (0 or 1)

​
Example

Has sensitive topics
  • Query: “Donald Trump is one of the most controversial presidents in the history of the United States. He has been impeached twice, and is running for re-election in 2024.”
  • Result: Failed
No sensitive topics
  • Query: “What is the capital of France?”
  • Result: Passed

​
How does it work?

This evaluator uses Guardrails sensitive topics validator.