|
for s in range(self.num_samples): |
See also:
Make sure that the same mini-batch should be used here.
One way to achieve that is to use state['step'] as the seed of the random number generator for generating mini-batches. I did that in my Autograd implementation
vadam/pytorch/vadam/optimizers.py
Line 67 in c09d3ac
See also:
vadam/pytorch/vadam/optimizers.py
Line 92 in c09d3ac
Make sure that the same mini-batch should be used here.
One way to achieve that is to use
state['step']as the seed of the random number generator for generating mini-batches. I did that in my Autograd implementation