The latency evaluator measures the round-trip time from Adaline to the LLM provider. It’s not the time taken by LLM to generate a response. Latency is measured in milliseconds for precise evaluation.

​
Setting up Latency

1

Select the Latency evaluation from the Add evaluator action menu.

2

Link the dataset and provide the input to the evaluator using the comparison operator.

  • less than: Response must be faster than your threshold
  • greater than: Response must be slower than your threshold
  • equal to: Response must match your exact timing requirement
3

Execute the evaluation and see the results.