Core offerings
Record agent runs
Send traces and group runs into sessions.
Inspect one run
Follow model calls, tool calls, and errors step by step.
Test changes with evals
Score fixed cases before you release a change.
Score production sessions
Judge real sessions against your rubric.
Track spend and tokens
Compare cost across agents and check the rates behind it.
Choose where to start
- New to tracing? Trace your first agent run records one run with the atlanai SDK and finds it under your agent.
- Why did this run fail? Start from the agent’s Sessions or Usage tab, then Inspect recorded run.
- Did a change improve the answers? Start from a fixed dataset and an experiment, then Review experiment results.
- Are real sessions meeting the rubric? Start from a hosted scorer, then Score production sessions.
- Which agent drove the cost increase? Start from Reports → Agent usage, then Investigate agent cost.
- Why is a skill’s usage empty? Check the recorded skill attribution in How skill usage works.
- Run missing or under the wrong identity? Trace errors.
Monitoring covers only the runs you send to Atlan Trident. Missing spans, scores, or costs do not show that a run succeeded or cost nothing. A trace error is an execution failure; an answer with no errors can still fail your rubric, so read traces and eval scores together. Run costs are calculated from traces and your rates; they are not your provider’s invoice.
See also
- Trace attributes: The OpenTelemetry attributes that set agent, session, model, tokens, and cost.
- Trace limits and privacy: Ingest limits, the content policy, and content deletion.
- Eval options and errors: Every
Evaloption, status, limit, and error code. - Usage and cost measures: What each report measure means.
- Public API: Trace, eval, and OTLP ingest operations.