Study in Berlin at HTW Berlin

Neural Networks and Deep Learning

Content:

• Introduction in Deep Learning
• Technical Background
  • Scientific Python (Slides)
  • Theano
    • Repetition: Cost function, Gradient descent, Regularization
    • Intoduction Code - linear regression
    • Theano Tutorial (external link)
• Using Theano to build feedforward Neural Networks
  • Slides
  • Logistic Regression (external link)
  • Multilayer Perceptron

• Layer wise pretraining and auto-encoder

  • Slides
  • Denoising Autoencoder (external link)
  • Stacked denoising Autoencoder with theano (external link)

• Recurrent neural networks

  • Simple Recurrent Neural Networks (Elman Networks)
  • LSTM