TransferFunctions

Here are the transfer functions that are available for use in neural2d. If not specified, all neurons will use tanh. The transfer function can be specified per-layer with the tf parameter in the topology config file (see the README.md and ParameterList for more information).

tanh

logistic

linear

ramp

gaussian

ReLU

This is a softplus approximation of a ReLU.