Loader
class. Other loaders also work similarly.
You can load data for evals from a JSON, Python Dictionary, or directly from your logged inferences on Athina.
Loading from a JSON file
Loading from a Python Dictionary
Loading logged inferences from Athina
Instead of generating inferences, you can just load inferences that you have already logged to Athina.Output Format
The output format will be different for different Loaders. TheLoader
will return a List[DataPoint]
type after you call the load function of choice.