Deep Neural Network Workshop

This repository contains the material for the deep neural network workshop delivered on May14-16, 2018 at Microsoft.

Day 1

• Intro to Neural Networks (theory)
• Lab1: Setup
• Intro to Keras library
• Lab2: Keras – simple image classification on mnist dataset
• Intro to Deep Neural Networks and Convolutional Neural Networks
• Lab3: Keras – CNNs for image classification on fashion mnist dataset

Day 2

• Intro to Computational Network Toolkit
• Lab4: CNTK with Cifar10 image classification
• Transfer learning
• Lab5: CNTK with transfer learning
• Intro to Recurrent Neural Networks
• Lab6: Character models with char-rnn
• Word Embeddings
• Lab7: LSTM with Keras and CNTK: sentiment analysis on imdb movie reviews

Day 3:

• Deployment of models using containers
• Deployment of models using MLServer
• Lab8: Deploying a CNN model to ML cluster
• Introduction to Cognitive Services 
• Introduction to Generative Adversarial Networks
• Lab9: Build a simple GAN
• Introduction to Reinforcement Learning
• Lab10: A simple Q-learning RL model with CNTK

Recommended Readings

• Develop Your First Neural Network in Python With Keras Step-By-Step: https://machinelearningmastery.com/tutorial-first-neural-network-python-keras/
• A relatively easy to understand Neural Networks and Using Keras: https://www.learnopencv.com/neural-networks-a-30000-feet-view-for-beginners/
• Neural Networks & Deep Learning (Coursera, Andrew Ng): https://www.coursera.org/learn/neural-networks-deep-learning/home/welcome
• OpenCV & Machine Learning: http://opencv-python-tutroals.readthedocs.io/en/latest/py_tutorials/py_setup/py_intro/py_intro.html

Resources

• Deep Learning Virtual Machine: https://docs.microsoft.com/en-us/azure/machine-learning/data-science-virtual-machine/deep-learning-dsvm-overview 
• Using the Deep Learning VM: https://docs.microsoft.com/en-us/azure/machine-learning/data-science-virtual-machine/use-deep-learning-dsvm
• Samples on the Data Science VM: https://docs.microsoft.com/en-us/azure/machine-learning/data-science-virtual-machine/dsvm-samples-and-walkthroughs#cntk 
• Submit request for quota increase (GPUs): https://docs.microsoft.com/en-us/azure/azure-supportability/resource-manager-core-quotas-request 

Sources & Acknowledgements

• Azure / LearnAnalytics: https://github.com/Azure/learnAnalytics-DeepLearning-Azure
• Using Microsofts Data Science VM: https://github.com/Microsoft/computerscience/blob/6fe13af1b7c684b47db404ce9fd06c4542bb9147/Labs/Deep%20Learning/200%20-%20Machine%20Learning%20in%20Python/1%20-%20Ingest/readme.md