Skip to main content
1

Install the Python SDK

Run pip install athina-logger
2

Configure API key

3

Replace your OpenAI import

4

Add metadata fields

Use OpenAI as your normally would, but optionally add AthinaMeta fields for better segmentation on the platform.
Note: We support both stream=True and stream=False for OpenAI chat completions. OpenAI doesn’t provide usage statistics such as prompt and completion tokens when streaming. However, We overcomes this limitation by getting these with the help of the tiktoken package, which is designed to work with all tokenized OpenAI GPT models.

Frequently Asked Questions

Nope! We know how important your OpenAI inference call is, so we don’t want to interfere with that or increase response times.Importing openai from athina just makes an async logging request to Athina (separate from your OpenAI request) after you get back the response from openai
Nope. The logging call is being made in a background thread as a fire and forget request, so there is almost no additional latency (< 5ms).
The AthinaMeta fields are used for segmentation of your data on the dashboard. All these fields are optional, but highly recommended.You can view the full list of logging attributes here.