Skip to content

Add additionalContext support to MLXLanguageModel#145

Open
noorbhatia wants to merge 1 commit intomattt:mainfrom
noorbhatia:mlx-custom-generation-options
Open

Add additionalContext support to MLXLanguageModel#145
noorbhatia wants to merge 1 commit intomattt:mainfrom
noorbhatia:mlx-custom-generation-options

Conversation

@noorbhatia
Copy link
Contributor

@noorbhatia noorbhatia commented Mar 13, 2026

Add CustomGenerationOptions struct to MLXLanguageModel with an additionalContext: [String: JSONValue]? property for injecting variables into Jinja2 chat templates

Usage

var options = GenerationOptions()
options[custom: MLXLanguageModel.self] = .init(
    additionalContext: ["enable_thinking": .bool(true)]
)
let response = try await session.respond(to: "Hello", options: options)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant