Feature request: 4bit and 8bit support #41

Open

opened

on Aug 19, 2026

bf16 is more than 80G. Can I get support with 4bit/8bit to solve ram and storage? Thank you!

to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests