leaky_relu

leaky_relu(x: numpy.ndarray, alpha) → numpy.ndarray

Relu activation function.

function:

f(x) = 0 if x < 0

f(x) = c * x if x > 0

Parameters
  • x (Tensor) – input to the function

  • alpha (float) – small value that multiplies the input

Returns

f(x), applies activation function

Return type

Tensor