Observability
Overview
Observability provides deep insight into your AI system’s internal operations, going beyond surface metrics to reveal how prompts execute in production.
Features
Traces
Follow complete request journeys:
- Track requests through your entire system.
- Understand failure cascades.
Spans
Analyze individual operations:
- Measure each step’s duration.
- Get insights on how the response was given by the LLM.
Cost Management
Control and optimize spending:
- Monitor usage per prompt and model via token tracking.
- Analyze spending by operation.