Collection (collecting? as if work in progress) of the simplest explanations possible:

• First, A Quick Introduction to Neural Networks
• Plus, a visual explanation for the back propagation algorithm for neural networks
  
• Then , An Intuitive Explanation of Convolutional Neural Networks