Softmax activation

This is the activation function to go for in most of the classification tasks. Most of the times, the network has to predict the probability of input belonging to that particular class. Softmax activation outputs this probability score, signifying how confident the model is at predicting the classes: