activationfunction

Overview ¶

Package activationfunction is for isolating the concept of an activation function into its own area. Activation functions are used in neural networks to provide stability to their inputs and outputs through non-linearization. What that means is that a neuron which is loaded up with tons of values in its weighted sum will be sent through an activation function which sets a bound on it to prevent this large value from influencing the rest of the network.