Skip to content

DeepSeek V4 pro cannot support TP16 #400

@mpjlu

Description

@mpjlu
Image can not run with this error: Image V4 shape: 3072/16=192, fp8 quantization need size is 128*x

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions