Proposal to collect additional metrics needed for cost monitoring - #258

Proposal to collect additional metrics needed for cost monitoring#258

simanadler wants to merge 3 commits into

llm-d:mainllm-d/llm-d-inference-payload-processor:mainfrom

simanadler:cost-metrics-proposalsimanadler/llm-d-inference-payload-processor:cost-metrics-proposalCopy head branch name to clipboard