The Vanishing Gradient Problem – Why Deep Networks Forget Where They Came From

There is a paradox buried in the design of deep neural networks. The deeper you make a network, the more expressive it should become – more layers means…