Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.athina.ai/llms.txt

Use this file to discover all available pages before exploring further.

Yes, you can specify your own model for running evals. However, keep the following in mind.
  • If your evaluation task is complex, use a powerful model like gpt-4o or claude-3-5-sonnet.
  • If your evaluation task is simple, use a smaller model like gpt-3.5-turbo or llama-3-8b.
Currently, we support all the major public models, as well as custom models. 
from athina.evals import LlmEvaluator

LlmEvaluator(model="gpt-4", grading_criteria=grading_criteria).run(response)