To decrease communication and speed up convergence, we should have an option (default=True) to only update weights when margin constraints have been violated:
e.g.: Line #66 should move up (to Line #63) and if margin >= 1: continue.
https://github.com/npinto/asgd/blob/master/asgd/naive_asgd.py#L66
To decrease communication and speed up convergence, we should have an option (default=True) to only update weights when margin constraints have been violated:
e.g.: Line #66 should move up (to Line #63) and
if margin >= 1: continue.https://github.com/npinto/asgd/blob/master/asgd/naive_asgd.py#L66