Skip to content

Loading a model through the SDK does not use per model defaults #178

@jmaver

Description

@jmaver

Let’s take Qwen3 1.7B. The installed model default temp is 0.8.
I change the default temp to 0.6.
When I load the model in the UI, the temp is 0.8.
If I use the cli with lms load, the temp is 0.8.
If I use the REST API v1, the temp is 0.8
If I use the python sdk lmstudio.llm(), the temp is not 0.8, but back to 0.6.

The other params follow the same pattern - use my custom defaults when loaded everywhere except the python sdk.

The SDK should load using the per model custom defaults I set.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions