We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
2 parents 94e3569 + 5330dfe commit d024a7cCopy full SHA for d024a7c
1 file changed
README.md
@@ -74,8 +74,8 @@ Our implementations enable theoretically **infinitely large batch size**, with *
74
75
| Technique | Usage |
76
| - | - |
77
-| `Adaptive Gradient Clipping` | `model = GradientAccumulateModel(accum_steps=4, agc=True, inputs=model.input, outputs=model.output)` |
78
| `Batch Normalization` | `layer = AccumBatchNormalization(accum_steps=4)` |
+| `Adaptive Gradient Clipping` | `model = GradientAccumulateModel(accum_steps=4, agc=True, inputs=model.input, outputs=model.output)` |
79
| `Mixed precision` | `model = GradientAccumulateModel(accum_steps=4, mixed_precision=True, inputs=model.input, outputs=model.output)` |
80
81
* As batch normalization (BN) is not natively compatible with GA, we have implemented a custom BN layer which can be used as a drop-in replacement.
0 commit comments