utils

Utility functions

Small utility functions.

Functions

clip(x)

Clips very small values from tensor, used in cross entropy.

fix_overflow(x)

Ensures to fix infinite and not a number values.

grad_clip(x)

Clips too big and too small gradients.