Why do we need to call zero_grad() in PyTorch?

Why does zero_grad() need to be called during training?

|  zero_grad(self)
|      Sets gradients of all model parameters to zero.