-
Notifications
You must be signed in to change notification settings - Fork 99
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
Consumer-class GPU profile bundles (RTX 4090 / 3090 / A5000)
enhancementNew feature or requestNew feature or requestStatus: Open.#58 In casys-kaist/LLMServingSim;P/D handoff eagerly allocates KV state on the decode worker and can abort on insufficient NPU memory
bugSomething isn't workingSomething isn't workingStatus: Open.#47 In casys-kaist/LLMServingSim;Question: Where is the KV Cache Transfer delay formula implemented in the source code?
questionFurther information is requestedFurther information is requestedStatus: Open.#42 In casys-kaist/LLMServingSim;Request for Official Support of Additional Hardware for Prefill/Decode Separation
enhancementNew feature or requestNew feature or requestStatus: Open.#31 In casys-kaist/LLMServingSim;General Questions on Sim
questionFurther information is requestedFurther information is requestedStatus: Open.#24 In casys-kaist/LLMServingSim;Question: Support different numbers of NPU in Prefill and Decode instance with PD-Disaggregation scenario?
questionFurther information is requestedFurther information is requestedStatus: Open.#23 In casys-kaist/LLMServingSim;