Skip to content

Can it support ggml as BLAS layer? #34

Open
Open
Can it support ggml as BLAS layer?#34
@znsoftm

Description

@znsoftm
znsoftm
opened on Jul 3, 2023

ggml.ai can quantize a model to int4/8, and can seed up the inference of a model.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions