Explain 'Softmax' function.

Approach: Describe the conversion of vectors into probability distributions.

A function that takes a vector of K real numbers and normalizes it into a probability distribution consisting of K probabilities proportional to the exponentials of the input numbers. The sum of outputs is 1.

Follow-up: Is it used in the hidden layers or the output layer?

Key concepts: multi-class, probabilities, exponential.