Logging LLM Inferences
Log via API Request
POST
Using OpenAI with Python? Just follow our quick
start guide to get started in
just a few lines of code.
Using LiteLLM? Follow this guide to get
set up in just a few lines of code.
-
Method:
POST -
Endpoint:
https://log.athina.ai/api/v2/log/inference -
Headers:
athina-api-key: YOUR_ATHINA_API_KEYContent-Type:application/json
string
required
Identifier for the language model used for inference. This is just a string
label, all models are supported.
string | {role: string, content: string}[]
The prompt sent for inference. This can be either a
string or the messages
array sent to OpenAI. Note that in case of Tool message content can be either
string or array.string
required
The response from the LLM. This should be a
string.