Athina AI
Monitoring, Analytics & Evaluations for LLM Developers
Logging
Logging your data is the first step to using Athina’s Observability Platform.
OpenAI Logging
Using OpenAI? Get set up in 2 lines of code.
Langchain Logging
Using Langchain? Get set up in 2 lines of code.
LiteLLM Logging
Using LiteLLM? Get set up in 2 lines of code.
Log via API
Log your inferences through our flexible API or SDK (works with all models!)
Log complex traces
Log complex traces - use our SDK to log complex traces
Evaluations
Running evals using Athina SDK
Run 40+ preset evals or your own custom evals in just a few lines of code using our python SDK.
Running evals on Athina Platform
Run 40+ preset evals or your own custom evals on any dataset.
Comparing datasets using Athina
Compare retrievals and responses from different datasets, and run evaluations on both datasets.
Continuous evaluation in production
Configure evaluations to run continuously on production logs to measure quality, and detect hallucinations.
Setting up evals in CI / CD
Run evals in your CI / CD pipeline to prevent regressions, and ensure that bad prompts / models don’t get to production.
Analytics
Analytics
Want to view analytics for production logs?
Cost Tracking
How to track inference costs by prompt, model, or customer ID.
Comparing Metrics
Compare usage analytics and evaluation metrics for different models, prompts, topics or customer IDs.
Prompt Management
You might find these guides useful.
Athina Playground
Experiment with different prompts and models
Prompt Management
How to manage your prompts on Athina