Thanks for your the implementation! In LsqQuan. https://github.com/zhutmost/lsq-net/blob/2c24a96be06d044fa4c7d651727f4574b8d88c86/quan/quantizer/lsq.py#L54 If s_scale contains 0, there will be Divided by 0 Error, and the training loss will become nan. Maybe eps should be used.
Thanks for your the implementation!
In LsqQuan.
lsq-net/quan/quantizer/lsq.py
Line 54 in 2c24a96
If s_scale contains 0, there will be Divided by 0 Error, and the training loss will become nan.
Maybe eps should be used.