Where do I call the BatchNormalization function in Keras?
If I want to use the BatchNormalization function in Keras, then do I need to call it once only at the beginning? I … Read more
neural-network
Why binary_crossentropy and categorical_crossentropy give different performances for the same problem?
I’m trying to train a CNN to categorize text by topic. When I use binary cross-entropy I get ~80% accuracy, with categorical cross-entropy … Read more
Ordering of batch normalization and dropout?
The original question was in regard to TensorFlow implementations specifically. However, the answers are for implementations in general. This general answer is also … Read more
Why use softmax as opposed to standard normalization?
In the output layer of a neural network, it is typical to use the softmax function to approximate a probability distribution: This is … Read more
How to initialize weights in PyTorch?
How do I initialize weights and biases of a network (via e.g. He or Xavier initialization)? 10 Answers 10
Why do we need to call zero_grad() in PyTorch?
Why does zero_grad() need to be called during training? | zero_grad(self) | Sets gradients of all model parameters to zero. 5 Answers 5
How to interpret loss and accuracy for a machine learning model [closed]
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers. Want to improve this question? Update the question … Read more
Extremely small or NaN values appear in training neural network
I’m trying to implement a neural network architecture in Haskell, and use it on MNIST. I’m using the hmatrix package for linear algebra. … Read more
Keras input explanation: input_shape, units, batch_size, dim, etc
For any Keras layer (Layer class), can someone explain how to understand the difference between input_shape, units, dim, etc.? For example the doc … Read more
What is the meaning of the word logits in TensorFlow? [duplicate]
This question already has answers here: What are logits? What is the difference between softmax and softmax_cross_entropy_with_logits? (7 answers) Closed 1 year ago. … Read more