Create a model plugin to calculate the energy and carbon consumed during LLM inference

[navveenb]

Story

As a user, I want to calculate the environmental impact during LLM inference

Rationale

This idea is to generate a model that could be used to calculate the energy and carbon consumed during LLM inference

Scope

This is a Model implementation.

Implementation guidelines

This model MUST conform to the ModelPlugin interface*

Difficulty

4/5

Impact

4/5

Examples and resources

IMPL writing guide