Single neuron == linear regression Simple NN graph: Image taken from tutorialspoint.com RELU stands for rectified linear unit is the most popular activation function right now that makes deep NNs ...