schedule.md

layout	title	permalink	schedule
default	MATH 80600A - Machine Learning II<br>Deep Learning and Applications	/schedule	date topics readings Jan. 5,6 name url Introduction (Eng) https://www.dropbox.com/scl/fi/pxvhbtvn7kc5a6w4acna5/Week1-Intro.pptx?dl=0&rlkey=z99e8opm9si45a3irrwpo9lv4 name url Mathematics (Eng) https://www.dropbox.com/s/a81iqbq875sfiqa/Week1-Maths.pdf?dl=0 name url ML Basics (Eng) https://www.dropbox.com/s/tsjrj7awawli5ax/Week1-ML.pdf?dl=0 name url Introduction (Fr) https://www.dropbox.com/s/qbfkq13vfrvs94d/Week1-Intro-Fr.pdf?dl=0 name url Mathematics (Fr) https://www.dropbox.com/scl/fi/9s1z3aj94omm1c31i3i74/Week1-Maths-Fr.pptx?dl=0&rlkey=zmvys8noegv5he9x19p0t7ccd name url ML Basics (Fr) https://www.dropbox.com/scl/fi/s9tasll7x6v9rdy2y57k7/Week1-ML-Fr.pptx?dl=0&rlkey=xk5xh1s0s83rrjkmoui3xnkpp name Deep Learning Book name url Chap. 2 http://www.deeplearningbook.org/contents/linear_algebra.html name url Chap. 3 http://www.deeplearningbook.org/contents/prob.html name url Chap. 5 http://www.deeplearningbook.org/contents/ml.html date topics readings Jan. 12,13 name url Feedforward Neural Networks & Optimization Tricks (Eng) https://www.dropbox.com/s/j06w5wyv53e27x8/Week2-FFN%26Regularization.pdf?dl=0 name url Feedforward Neural Networks & Optimization Tricks (Fr) https://www.dropbox.com/scl/fi/46fjxkbpxlqa3o9jeqfrd/Week2-FFN-Regularization-Fr.pptx?dl=0&rlkey=lne5bbk06f2tvhg8hgzq0dily name Deep Learning Book name url Chap. 6 http://www.deeplearningbook.org/contents/mlp.html name url Chap. 7 http://www.deeplearningbook.org/contents/regularization.html name url Chap. 8 http://www.deeplearningbook.org/contents/optimization.html date topics readings Jan. 19,20 name url PyTorch (Eng) https://www.dropbox.com/s/8b4g20nbyfe12ir/2022_Deep%20Learning%20Frameworks.pdf?dl=0 name url Notebook Part I (Eng) https://colab.research.google.com/drive/194KrzIRPRVJbVg2LcQH8-hSl-fjrcUdz?usp=sharing name url Notebook Part II (Eng) https://colab.research.google.com/drive/1sTdqVEJUzBMcXI_NOXVrdfzP4D_xzWwy?usp=sharing name url PyTorch (Fr) https://www.dropbox.com/s/bb5x16tp9j17gy0/S4-Pytorch.pdf?dl=0 name url Notebook (Fr) https://www.dropbox.com/s/3a678a33w4hmh4g/Introduction_%C3%A0_Pytorch.ipynb?dl=0 name url Python Numpy Tutorial http://cs231n.github.io/python-numpy-tutorial/ name url Neural Network from Scratch https://medium.com/dair-ai/a-simple-neural-network-from-scratch-with-pytorch-and-google-colab-c7f3830618e0 name url Dive into Deep Learning https://github.com/dsgiitr/d2l-pytorch date topics readings presentations Jan. 26,27 name url Convolutional Neural Networks & Recurrent Neural Networks (Eng) https://www.dropbox.com/s/6qoo6g37xf08m3q/Week4-CNN%26RNN.pdf?dl=0 name url Convolutional Neural Networks & Recurrent Neural Networks (Fr) https://www.dropbox.com/s/j9mrvgl0ve9ctzy/S3-CNN.pdf?dl=0 name Deep Learning Book name url Chap. 9 http://www.deeplearningbook.org/contents/convnets.html name url Chap. 10 http://www.deeplearningbook.org/contents/rnn.html name url ResNet http://arxiv.org/abs/1512.03385 name url GRU https://arxiv.org/abs/1412.3555 name url DenseNet https://arxiv.org/abs/1608.06993 date topics readings presentations Feb. 2,3 name url Natural Language Processing I (Eng) https://www.dropbox.com/s/ds4jlcbpvfrdl4r/Week5-DL4NLP-part1.pdf?dl=0 name url Natural Language Processing I (Fr) https://www.dropbox.com/s/yrgndvmakd9jmos/S5-RNN.pdf?dl=0 name url Word2Vec https://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf name url SGNS https://papers.nips.cc/paper/2014/file/feab05aa91085b7a8012516bc3533958-Paper.pdf date topics readings presentations homeworks Feb. 9,10 name url Natural Language Processing II (Eng) https://www.dropbox.com/s/ds4jlcbpvfrdl4r/Week5-DL4NLP-part1.pdf?dl=0 name url Natural Language Processing II (Fr) https://www.dropbox.com/s/yi13slkbfuz6pu2/S6-NLP.pdf?dl=0 name url CNN for sentence classification https://arxiv.org/abs/1408.5882 name url Seq2Seq https://arxiv.org/abs/1409.3215 name url Tree LSTM https://arxiv.org/abs/1503.00075 name url CNN Multi-task Learning https://ronan.collobert.com/pub/matos/2008_nlp_icml.pdf name url Instruction (Eng) https://www.dropbox.com/s/e36h34ovpde4jl3/2022_Math80600A_HW_1.pdf?dl=0 name url Instruction (Fr) https://www.dropbox.com/s/4y915stmx3zmqdb/2022_Math80600H_DEV_1.pdf?dl=0 date topics Feb. 16,17 Q & A for Projects date topics readings presentations Mar. 2,3 name url Natural Language Processing III (PDF, Eng) https://www.dropbox.com/s/4i3k59kakn74dd5/Week7-DL4NLP-part2.pdf?dl=0 name url Natural Language Processing III (PPT/Keynote, Eng) https://www.dropbox.com/scl/fi/dxmnnec6wlvh3vbliabzu/Week7-DL4NLP-part2.pptx?dl=0&rlkey=0enqauq5fgmk8dd8azyxtkqpj name url Natural Language Processing III (PDF, Fr) https://www.dropbox.com/s/ofcbhg1hhuaz10x/S7-Transformer_Bert.pdf?dl=0 name url Natural Language Processing III (PPT/KetNote, Fr) https://www.dropbox.com/s/yq47vyxf20qa1qg/S7-Transformer_Bert.key?dl=0 name url Attention Seq2Seq https://arxiv.org/abs/1409.0473 name url Transformer https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf name url Memory Networks https://arxiv.org/abs/1503.08895 name url SQuAD Dataset https://arxiv.org/abs/1606.05250 name url GLUE Benchmark https://arxiv.org/abs/1804.07461 date topics readings presentations homeworks Mar. 9,10 name url Natural Language Processing IV (Eng) https://www.dropbox.com/s/0aid8ndangj9np1/Week8-DL4NLP-part3.pdf?dl=0 name url Natural Language Processing IV (Fr) https://www.dropbox.com/s/38y90wmj5dlejzq/S8-AE%26VAE.pdf?dl=0 name url BERT https://arxiv.org/abs/1810.04805 name url GPT-3 https://arxiv.org/abs/2005.14165 name url RoBERTa https://arxiv.org/pdf/1907.11692 name url Instruction (Eng & Fr) https://www.dropbox.com/s/r32tentediwy854/HW2_Instruction.pdf?dl=0 date topics readings presentations Mar. 16,17 name url Graph Representation Learning I (Eng) https://www.dropbox.com/s/93xzu60nnp3kyhk/Week9-Graph-part1.pdf?dl=0 name url Graph Representation Learning I (Fr) https://www.dropbox.com/s/jmxyummz2022zpk/S9-Graphes-P1.pdf?dl=0 name url DeepWalk https://arxiv.org/abs/1403.6652 name url LINE https://arxiv.org/abs/1503.03578 name url Node2Vec https://arxiv.org/abs/1607.00653 name url Metapath2Vec https://ericdongyx.github.io/papers/KDD17-dong-chawla-swami-metapath2vec.pdf name url LargeVis https://arxiv.org/abs/1602.00370 date topics readings presentations Mar. 23,24 name url Graph Representation Learning II (Eng) https://www.dropbox.com/s/lxuk6rcw2bv4ea4/Week10-Graph-part2.pdf?dl=0 name url Graph Representation Learning II (Fr) https://www.dropbox.com/s/ra56jtujrogz8qa/S10-Graphes-P2.pdf?dl=0 name url Graph Convolutional Networks https://arxiv.org/abs/1609.02907 name url Graph Attention Networks https://arxiv.org/abs/1710.10903 name url Neural Message Passing https://arxiv.org/abs/1704.01212 name url Graph Isomorphism Network https://arxiv.org/pdf/1810.00826 name url GraphSAGE https://arxiv.org/abs/1706.02216 name url PinSAGE https://arxiv.org/abs/1806.01973 name url HAN https://arxiv.org/abs/1903.07293 date topics readings presentations Marh. 30,31 name url AI for drug discovery (Eng) https://www.dropbox.com/s/ob4vn10kn4mqrlk/GDL4DD.pdf?dl=0 date topics Apr. 6,7 Poster Sessions

Schedule for In-class Presentations

{% for week in page.schedule %} {% endfor %}

Date	Topic	Suggested Readings	Reference	Homework
{{ week.date }}	{% for topic in week.topics %} {% include href item=topic %} {% endfor %}	{% for reading in week.readings %} {% include href item=reading %} {% endfor %}	{% for presentation in week.presentations %} {% include href item=presentation %} {% endfor %}	{% for homework in week.homeworks %} {% include href item=homework %} {% endfor %}