Simsek
Simsek
Home
Publications
Posts
Light
Dark
Automatic
"Statistics - Machine Learning"
Weight-space symmetry in deep networks gives rise to permutation saddles, connected by equal-loss valleys across the loss landscape
The permutation symmetry of neurons in each layer of a deep neural network gives rise not only to multiple equivalent global minima of the loss function, but also to first-order saddle points located on the path between the global minima. In a …
Cite
×