feat: connect ledger / refactor

[Sang-it]

No description provided.

[greptile-apps]

Greptile Summary

This PR adds per-model pricing data to the Redis cache. When modelsDevAction runs, it now decodes the models.dev JSON a second time through the new ProviderModelToCostSchema, extracts {input, output} costs keyed as provider/model, and persists them via the new bulkSetProviderModelCost helper in model_cost.ts. A corresponding getCostForModel getter is also introduced for downstream lookup.

Key changes:

• New packages/resolver/src/redis/model_cost.ts — Redis helpers for cost get/set/delete with JSON serialisation via Effect Schema.parseJson.
• ProviderSchema in modelsdev.ts now types the model value to expose the optional cost struct, enabling two separate schema transforms from the same raw payload.
• fetch.ts decodes cost data alongside the existing model-list decode and writes it to Redis in the same modelsDevAction call.

Issues found:

• getCostForModel returns [] (an empty array) for a cache miss instead of null/Option, producing a Cost | never[] union that makes safe consumption error-prone.
• Models with no upstream cost data are stored as {input: 0, output: 0}, making it impossible to distinguish a genuinely free model from one with missing data.
• The .ts extension is included in the re-export in index.ts, inconsistent with every other export in that file.
• Minor typo: canonicalProvdierModelName in bulkSetProviderModelCost.

Confidence Score: 3/5

• The feature is mostly correct but getCostForModel returns a wrong type on cache miss, which will surface as a runtime bug in any caller that treats the result as a Cost object.
• The bulk-write path is sound and won't break existing functionality, but the read path (getCostForModel) returns [] instead of null for a missing key. Any consumer that destructures the returned value as { input, output } will get undefined for both fields, which is a latent runtime bug as soon as this getter is used. The @ts-expect-error workaround and the 0-default for unknown costs are also worth addressing before the feature is considered production-ready.
• packages/resolver/src/redis/model_cost.ts — the cache-miss return value needs to be fixed before the getter is wired up to any endpoint.

Important Files Changed

Filename	Overview
packages/resolver/src/redis/model_cost.ts	New file providing CRUD helpers for model cost data in Redis; getCostForModel has a logic bug returning [] instead of null for a cache miss, and a typo in bulkSetProviderModelCost's callback variable name.
packages/resolver/src/data_manager/fetch.ts	Extends modelsDevAction to decode cost data from the same JSON payload and bulk-write it to Redis; uses a @ts-expect-error workaround with a FIXME for typing the accumulator, but the core logic is sound.
packages/resolver/src/data_manager/schema/modelsdev.ts	Extends ProviderSchema to include typed cost fields and adds ProviderModelToCostSchema; silently defaults absent cost values to 0, making free vs. unknown costs indistinguishable.
packages/resolver/src/redis/index.ts	Re-exports the new model_cost module but includes the .ts extension, inconsistent with all other re-exports in the file.
packages/resolver/src/redis/fetch_point.ts	Whitespace-only change adding a blank line after the import; no functional impact.

Sequence Diagram

sequenceDiagram
    participant DM as DataManager (fetch.ts)
    participant API as models.dev API
    participant S as Schema (modelsdev.ts)
    participant R as Redis (model_cost.ts)

    DM->>API: GET /api.json
    API-->>DM: JSON payload
    DM->>S: decodeUnknown(ProviderModelMapSchema)(json)
    S-->>DM: provider → string[] map
    DM->>R: bulkSetModelsForProvider(supported)
    DM->>S: decodeUnknown(ProviderModelToCostSchema)(json)
    S-->>DM: provider → [{model, input, output}][]
    DM->>DM: reduce to {provider/model → {input, output}}
    DM->>R: bulkSetProviderModelCost(supportedCost)
    R->>R: setCostForModel × N (concurrency=5)
    Note over R: PREFIX = "enfinyte:model_to_cost:"

Loading

_{Reviews (1): Last reviewed commit: "feat: add model cost to redis" | Re-trigger Greptile}