CUDA introduction to neural networks and cuDNN library

1. Basics

• CUDA simple add kernel implementation
• CUDA C++ Jupyter Notebook integration

2. Simple CUDA MLP

• example implemetation of simple neural net
• simple cuda matrix implemetation
• layers: linear
• activations: relu, leaky_relu, sigmoid
• loss: BCE Cost

3. cuDNN

• example implementation of using cuDNN library
• convolution example implementation