Skip to content

LSEP: speculative decoding load flags#575

Merged
will-lms merged 3 commits into
mainfrom
will/lsep-spec-decoding
Jun 9, 2026
Merged

LSEP: speculative decoding load flags#575
will-lms merged 3 commits into
mainfrom
will/lsep-spec-decoding

Conversation

@will-lms

@will-lms will-lms commented Jun 4, 2026

Copy link
Copy Markdown
Contributor

Summary

Adds lms load support for load-time speculative decoding fields:

  • draft model
  • draft max tokens
  • draft min tokens
  • draft min continue probability

When a draft model is supplied, the CLI explicitly disables Draft MTP so model defaults do not conflict.

Validation

  • npm test -- --runTestsByPath src/subcommands/load.test.ts

@github-actions github-actions Bot added the CLA signed Indicates if all contributors have signed the CLA label Jun 4, 2026
Comment thread src/subcommands/load.ts
@will-lms will-lms merged commit 6041ae0 into main Jun 9, 2026
1 check passed
@will-lms will-lms deleted the will/lsep-spec-decoding branch June 9, 2026 20:53
@github-actions github-actions Bot locked and limited conversation to collaborators Jun 9, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

CLA signed Indicates if all contributors have signed the CLA

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants