Machine Learning

If Dropout Limits Trainable Depth, Does Critical Initialisation Still Matter? A Large-scale Statistical Analysis on ReLU Networks
Recent work in signal propagation theory has shown that dropout limits the depth to which information can propagate through a neural …
PDF Cite