Refactors Prompt Caching

[philipph-askui]

Note: The updated lock file bloats the size of this PR, as +1.933 -2.280 lines are changed there. Hence, the actual PR is only +739 - 113)

• This PR adds support for Anthropic's automatic prompt caching (see here) through the provider_options parameter.
• Further, it refactors and improves the usage tracking as implemented by @mlikasam-askui here: 3ffd3ca#diff-dce7ba865eec3d7fb4af9c5fabe55d6e51892e9bbc4cdad35a01813d4723f404

CAUTION: prompt caching will yet only work with the AnthropicVlmProvider!

Here is a minimal example to try it:

import logging

from askui import ComputerAgent
from askui.agent_settings import AgentSettings
from askui.model_providers.anthropic_vlm_provider import AnthropicVlmProvider
from askui.models.shared.agent_message_param import CacheControlEphemeralParam
from askui.models.shared.settings import ActSettings, MessageSettings
from askui.reporting import SimpleHtmlReporter

logging.basicConfig(level=logging.INFO)
logger = logging.getLogger(__name__)


# test and implement anthropic's automatic prompt caching, as explained here:
# https://platform.claude.com/docs/en/build-with-claude/prompt-caching#automatic-caching


def main() -> None:
    agent = ComputerAgent(
        display=1,
        reporters=[SimpleHtmlReporter()],
        settings=AgentSettings(vlm_provider=AnthropicVlmProvider()),
    )
    agent.act_settings.messages.provider_options = {
        "cache_control": CacheControlEphemeralParam()
    }
    with agent:
        agent.act("Open a new Chrome browser")

        agent.act("Navigate to www.askui.com")


if __name__ == "__main__":
    main()

[mlikasam-askui]

@philipph-askui Regarding the example code in the PR, it overrides the act_settings for a single act command and removes the system prompt. I would suggest documenting how to modify only the caching setting by accessing agent.act_settings.messages... instead.

Additionally, I recommend enabling caching by default and documenting how to disable this behavior, even if disabling it is generally not advisable.

[philipph-askui]

@philipph-askui Regarding the example code in the PR, it overrides the act_settings for a single act command and removes the system prompt. I would suggest documenting how to modify only the caching setting by accessing agent.act_settings.messages... instead.

Additionally, I recommend enabling caching by default and documenting how to disable this behavior, even if disabling it is generally not advisable.

I updated the example accordingly.
However, we cannot enable prompt caching by default, as it will is not yet supported by all providers (e.g. bedrock or vertexAI are still missing)

[programminx-askui]

@mlikasam-askui,

I will not review this PR. If you give a go @philipph-askui will merge it.