You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Requested Feature: enable DeepCache acceleration in onedfiff for use with img2img and img2imgControlNet diffusers pipelines.
Alternatives
There are many other optimizations I use in my pipeline already, I just need DeepCache to work with OneDiff
Additional context
The performace boost according to your documentation from DeepCache+OneDiff is great enough that it would be a huge benefit to have it fully functional for img2img pipelines (at least). ControlNet and img2img ControlNet pipelines would also be extremely useful as a lot of realtime applications make heavy use of these for controlling the output of realtime SDXL and SD 1.5 rendering.
The below video demonstrates one such usecase: Multiple ControlNet outputs from NDI from Unity3D into OneDiff accelerated diffusers pipelines for interactive/realtime WASD/mouse control
Without DeepCache the speed is somewhat OK at 2 steps on a single rtx3090, but to be able to add just 1 or 2 extra denoising steps and retain this same speed per the performance boost added by DeepCache, would result in far more viable rendering quality for use in a realtime ControlNet+Agent based WASD-controlled videogame.
🚀 The feature, motivation and pitch
Requested Feature: enable DeepCache acceleration in onedfiff for use with img2img and img2imgControlNet diffusers pipelines.
Alternatives
There are many other optimizations I use in my pipeline already, I just need DeepCache to work with OneDiff
Additional context
The performace boost according to your documentation from DeepCache+OneDiff is great enough that it would be a huge benefit to have it fully functional for img2img pipelines (at least). ControlNet and img2img ControlNet pipelines would also be extremely useful as a lot of realtime applications make heavy use of these for controlling the output of realtime SDXL and SD 1.5 rendering.
The below video demonstrates one such usecase: Multiple ControlNet outputs from NDI from Unity3D into OneDiff accelerated diffusers pipelines for interactive/realtime WASD/mouse control
Without DeepCache the speed is somewhat OK at 2 steps on a single rtx3090, but to be able to add just 1 or 2 extra denoising steps and retain this same speed per the performance boost added by DeepCache, would result in far more viable rendering quality for use in a realtime ControlNet+Agent based WASD-controlled videogame.
367620057-03de1e1f-5d9f-49c4-ade1-58f9743135a1.mp4