Athina home page

AI Hub
Website
Sign-up
Sign-up

API / SDK Reference

Open-Source Evals

Getting Started

Introduction
Getting Started

Datasets

Introduction
Creating a dataset
Dynamic Columns
Run evaluations (UI)
View Metrics
Run Experiments
Compare datasets
Join Datasets
Export / Download Datasets
SQL Notebook
Automations
Manage Datasets
Delete a Dataset

Evals

Overview
Quick Start
Online Evals
Offline Evals
Preset Evaluators
Custom Evals
Running Evals in UI
Running Evals via SDK
Running Evals in CI/CD
Why Athina Evals?
Cookbooks

Flows

Overview
Concepts
Variables
Sharing Flows
Flow Templates
Blocks

Annotation

Overview
Metrics
Configure Project
View Data
Review Entries
Export Data
Permissions

Prompts

Overview
Concepts
Prompt Syntax
Create Prompt Template
Prompt Versioning
Delete Prompt Slug
List Prompt Slugs
Duplicate Prompt Slug
Run Prompt
Multi-Prompt Playground
Run Evaluations on a Prompt Response
Organize Prompts

Monitoring

Overview
Inference Trace
Analytics
Topic Classification
Export Data from Athina
Continuous Evaluation
Model Performance Metrics

Settings

Custom Models
Sampling Evals
Credits

Integrations

Integrations

Self Hosting

Self-Hosting
Self-Hosting On Azure

Datasets

Import a HuggingFace Dataset

Evals

Offline Evals

Offline evals are evaluations that you can run on your datasets. You can configure offline evals in the Evals page. You can then:

Run offline evals on datasets
Run offline evals on logged inferences
Run offline evals on a combination of datasets and logged inferences
Use offline evals in Experiments

Online Evals Preset Evaluators

twitter linkedin

Powered by Mintlify

Assistant

Responses are generated using AI and may contain mistakes.