Skip to content

Code script for measuring inference fps #1

Description

@HuangChiEn

Thanks for releasing this amazing work.
As paper described, the current VLM-based work suffer from lower fps due to their larger size.
Since the fps of carllava and your work are quite speicific in the paper, i wonder that do you have some script for measuring the fps for VLM ?
If it's not contained in your code base, could you give me some suggestion that how should i measure fps, which can produced the fps results consist with the paper description ?

2B model : 300 ms ~ 3.3 fps ; carllava model : 102 ms ~ 9.8 fps

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions