VSD loss dosen't decrease and keeps oscilating

[whuwenfei]

When I finetuening osediff using sd2.1-base, the L2 and LPIPS loss can normally go down and converge, but VSD loss always oscilate from the begining, has anyone encountered this problem?

[YukinoshitaLove]

When I finetuening osediff using sd2.1-base, the L2 and LPIPS loss can normally go down and converge, but VSD loss always oscilate from the begining, has anyone encountered this problem?

@whuwenfei 我也遇到了类似的问题，想问下您解决了吗，还是这是VSD loss的特性？@cswry

[YukinoshitaLove]

我的LIPIS loss也下降的很慢，大概在60K个steps只能到0.7

[Henry-Bi]

我也遇到了类似的问题

[YukinoshitaLove]

#70 (comment) 看样子确实是VSD loss的特性

[MedAIerHHL]

#70 (comment) 看样子确实是VSD loss的特性

这会不会是osediff代码的问题，实际上dmd loss和vsd loss都需要交替训练的

[YukinoshitaLove]

这会不会是osediff代码的问题，实际上dmd loss和vsd loss都需要交替训练的

osediff是交替训练的啊

[MedAIerHHL]

这会不会是osediff代码的问题，实际上dmd loss和vsd loss都需要交替训练的

osediff是交替训练的啊
说错了，应该是说像dmd2 loss一样多训练几次，你有遇到其他办法嘛，我看其他工作 TSD-SR TAD-SR等也用了。而且我训练的vsd loss，不但震荡还在升高趋势