Complexity at almost every level of the universe arises from disorder and chaos. Order and symmetry are units of uniformity, which is sterilisation for complexity.
At the same time, this 'chaos' needs regularity in order for it to accrue.
The universe has lower and upper bounds
Life (and neural networks) needs noise/chaos