You can configure custom models on Athina in the settings page, and then use them for running prompts, experiments and evaluations.

  1. Go to https://app.athina.ai/settings

  2. Click on the “Custom Models” tab

  3. Click on the “Add Custom Model” button

  4. Fill in the configuration details for the custom model

  5. Save the custom model

That’s it - 🎉

Your custom model will show in all the model pickers throughout the platform, so you can easily select it for running prompts, experiments and evaluations.

Model Performance MetricsSampling Evals