The Complexity of ReLU Network Synthesis from a Parameter MultisetResearch Paper
Training a neural network usually means fixing an architecture and searching a continuous space of weights. A different question separates the numbers from the architecture: the parameter values are supplied in advance, as a finite multiset, and one asks whether some ReLU network with a bounded number of neurons can be wired up and have those numbers placed…