leaky_relu_prime

leaky_relu_prime(x: numpy.ndarray, alpha) → numpy.ndarray

Derivation of the relu activation function.

derivation:

f’(x) = c if x < 0

f’(x) = 1 if x > 0

Parameters

• x (Tensor) – input to the function

• alpha (float) – small value that multiplies the input

Returns

f’(x), applies derivation of activation function

Return type

Tensor