NaN for low pass branch in training

[KlZOnmyway]

loss for masking high frequency part, the loss mse of specturm goes to NaN. Why this happend?

[KlZOnmyway]

More specific, the FFT upon the half precision image results in nan value, I'd appreciate if you could provide some insights on this.