Skip to content

add service dashboard based on span metrics - #90

Merged
greatestusername-splunk merged 1 commit into
splunk:mainfrom
technimad-splunk:add_dashboard
Jul 16, 2026
Merged

add service dashboard based on span metrics#90
greatestusername-splunk merged 1 commit into
splunk:mainfrom
technimad-splunk:add_dashboard

Conversation

@technimad-splunk

Copy link
Copy Markdown
Contributor

Add service dashboard based on span metrics, so that internal spans are visible.
This will be accompanied by a community blog.
internal-spans-on-dashboard

"unitPrefix": "Metric"
},
"packageSpecifications": "",
"programText": "A = histogram('traces.span.metrics.duration').percentile(pct=90, by=['span.name']).publish(label='A')",

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In some of the ootb dashboards for apm we do this like

filter_ = filter('deployment.environment', '*') and filter('service.name', '*') and filter('sf_operation', '*') and filter('sf_kind', 'SERVER', 'CONSUMER') and (not filter('sf_dimensionalized', '*')) and (not filter('sf_serviceMesh', '*'))
groupby = ['deployment.environment', 'service.name', 'sf_operation', 'sf_httpMethod']
allow_missing = ['sf_httpMethod']

A = histogram('spans', filter=filter_).percentile(pct=90, by=groupby, allow_missing=allow_missing).publish(label='p90')

is traces.span.metrics.duration preferred for some use cases?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sf_operation is not created for spans with spanKind INTERNAL. This dashboard is specifically build to get insights into the performance on INTERNAL spans. I have a draft blog ready that explains this further.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh nice! That's awesome!

@greatestusername greatestusername left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would be nice to have a short README in this directory describing/linking to the span_metrics connector and describing why/when this dashboard is useful?

Helps users/search engine find your content!

@greatestusername-splunk greatestusername-splunk left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🖖

@greatestusername-splunk
greatestusername-splunk merged commit 1ae5813 into splunk:main Jul 16, 2026
2 checks passed
@github-actions github-actions Bot locked and limited conversation to collaborators Jul 16, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants