A quant scheme that james/someone else at occulus suggested:
Use normal L2 regularization.
Quantize each weight to either -1 or 1 with probability proportional to the current weight.
FOr example: If W = -0.5, set W = -1 with 75% probility and W = 1 with 25% probability.
A quant scheme that james/someone else at occulus suggested:
Use normal L2 regularization.
Quantize each weight to either -1 or 1 with probability proportional to the current weight.
FOr example: If W = -0.5, set W = -1 with 75% probility and W = 1 with 25% probability.