Which of the following is a common activation function used in neural networks?
Practice Questions
Q1
Which of the following is a common activation function used in neural networks?
Mean Squared Error
ReLU
Gradient Descent
Softmax
Questions & Step-by-Step Solutions
Which of the following is a common activation function used in neural networks?
Step 1: Understand what an activation function is. It is a mathematical function used in neural networks to determine the output of a neuron.
Step 2: Learn about different types of activation functions. Common ones include Sigmoid, Tanh, and ReLU.
Step 3: Identify ReLU (Rectified Linear Unit) as a specific activation function. It outputs the input directly if it is positive; otherwise, it outputs zero.
Step 4: Recognize that ReLU is popular because it helps prevent the vanishing gradient problem, which can occur with other activation functions.
