Is it possible to train a neural network model by setting all biases t

1.	Is it possible to train a neural network model by setting all biases to 0? Also, is it possible to train a neural network model by setting all of the weights to 0?
Answer» Yes, even if all of the biases are set to zero, the neural network model has a chance of learning. No, TRAINING a model by setting all of the weights to 0 is impossible SINCE the neural network will never learn to complete a task. When all weights are set to zero, the DERIVATIVES for each w remain constant, resulting in NEURONS learning the same features in each iteration. Any constant initialization of weights, not simply zero, is likely to generate a poor result.

Is it possible to train a neural network model by setting all biases to 0? Also, is it possible to train a neural network model by setting all of the weights to 0?

Answer»

Yes, even if all of the biases are set to zero, the neural network model has a chance of learning.

No, TRAINING a model by setting all of the weights to 0 is impossible SINCE the neural network will never learn to complete a task. When all weights are set to zero, the DERIVATIVES for each w remain constant, resulting in NEURONS learning the same features in each iteration. Any constant initialization of weights, not simply zero, is likely to generate a poor result.

Discussion

No Comment Found

Related InterviewSolutions

What do you mean by an epochs in the context of deep learning?
What is an activation function? What is the use of an activation function?
Which deep learning algorithm is the best for face detection?
Explain Stochastic Gradient Descent. How is it different from Batch Gradient Descent?
Explain Batch Gradient Descent.
In a Convolutional Neural Network (CNN), how can you fix the constant validation accuracy?
Explain the difference between a shallow network and a deep network.
What is a tensor in deep learning?
Is it possible to train a neural network model by setting all biases to 0? Also, is it possible to train a neural network model by setting all of the weights to 0?
What are the advantages of transfer learning?

Is it possible to train a neural network model by setting all biases to 0? Also, is it possible to train a neural network model by setting all of the weights to 0?

Discussion

No Comment Found

Related InterviewSolutions

Reply to Comment