copilotkit Datadog APM
Use the Datadog Labs Pup CLI for APM and trace investigations.
Setup
brew tap datadog-labs/pack
brew install pup
pup auth login
Services
Always pass --env to APM service commands.
pup apm services list --env prod
pup apm services stats --env prod --from 4h
pup apm services operations --env prod --service app-api
pup apm services resources --env prod --service app-api --name <operation>
pup apm dependencies list --env prod
pup apm flow-map --query "service:app-api" --env prod
List operations before querying resources and use an exact returned operation
name. Do not assume http.request.
Traces
Trace commands are top-level. Durations are nanoseconds, so one second is
1000000000.
pup traces search --query="service:app-api" --from="1h"
pup traces search --query="service:app-api status:error" --from="1h"
pup traces search --query="service:app-api @duration:>1000000000" --from="1h"
pup traces aggregate \
--query="service:app-api" \
--compute="avg(@duration)" \
--group-by="resource_name" \
--from="1h"
Trace sampling means search results may not include every request. Avoid high-cardinality tags such as user IDs and request IDs.