grad_clip

grad_clip(x: numpy.ndarray) → numpy.ndarray

Clips too big and too small gradients.

Example:

grad = grad_clip(grad)

Parameters

x (Tensor) – Gradient with too large or small values

Returns

Cliped Gradient

Return type

Tensor