Build Pipeline Details Overview dashboard

[estolfo]

Build the Pipeline Details Overview dashboard using the Logstash metrics exported via OTLP.

• Test with multiple pipelines
• Test with multiple hosts
• Test with higher volume of data, greater worker utilization

[estolfo]

[estolfo]

Limitations:

• Worker Utilization > Breakdown > Ranking: existing integration uses Last Value of logstash.pipeline.total.flow.worker_utilization.last_1_minute but we can't with OTel metrics because we would need to use a formula to get the equivalent of logstash.pipeline.total.flow.worker_utilization.last_1_minute and only scalar values are allowed for the Ranking.
• Inputs > Time Spent Pushing to Queues: can't select Count as a function for the Breakdown Ranking on metrics.logstash.pipeline.events.out. Using Last Value instead.
• Filters > Worker Utilization: Can't use a formula for the Breakdown Ranking. The existing integration uses logstash.pipeline.plugin.filter.flow.worker_millis_per_event.last_1_minute for the ranking but the equivalent with OTel metrics would need to be a formula.
• Outputs > Worker Utilization: Same as above, can't add Breakdown Ranking

[estolfo]

Update: I removed the Worker Utilization chart for now.