Evaluators
Latency
Measure how fast your prompts respond.
The latency evaluator measures the round-trip time from Adaline to the LLM provider. It’s not the time taken by LLM to generate a response. Latency is measured in milliseconds for precise evaluation.
Setting up Latency
1
Select the Latency evaluation from the Add evaluator action menu.
2
Link the dataset and provide the input to the evaluator using the comparison operator.
less than: Response must be faster than your thresholdgreater than: Response must be slower than your thresholdequal to: Response must match your exact timing requirement
3
Execute the evaluation and see the results.