Sprint 31/90 · From perceptron to multilayer network No line \(w \cdot x + b = 0\) separates XOR. Rosenblatt's rule: AND has no miss from epoch 6; XOR ends every epoch on the same weights from epoch 2. Two ReLU units with hand-set weights (Goodfellow et al. §6.1) map (0,1) and (1,0) to one point; then \(h_1 - 2h_2\) gives 0, 1, 1, 0. Gradient descent, 100 seeds: 2 hidden units solve 77, 4 solve 100. Archive: zenodo.org/communities/mt24-le… #MT24Learning #NeuralNetworks #MachineLearning
zenodo.org