Mathematics of Newtwork Algorithm

QR Codes for attendence: DS4114 MT4154


Date

References
Lecture 1 1th August 2023 Video 1, Video 2
Lecture 2 2th August 2023 Video 1, Video 2
Office Hour 7th August 2023 --
Lecture 3 8th August 2023 Principle Component Analysis Video 3
Lecture 4 9th August 2023 Principle Component Analysis. Ch 2.12 in [1]

Assignment Nr 1 Due

11th August 2023 Assignment Nr 1
Lecture 5 14th August 2023 Principle Component Analysis. Ch 2.12 in [1]

Quiz 1

16th August 2023 Quiz 1

Assignment Nr 2 Due

18th August 2023 Assignment Nr 2 (Modified on 7th Aug)
asst-2-Q1.txt, asst-2-Q2.txt, asst-2-Q3.txt

Tutorial

21th August 2023 --
Lecture 6 22nd August 2023 Numerical Optimization (Ch 4.1, 4.2, 4.3 (without 4.3.1)) in [1]
Lecture 7 23rd August 2023 Numerical Optimization (Ch 4.4, 4.5) in [1]
Lecture 8 28th August 2023 Machine Learning Basics (Ch 5.1, 5.2, 5.3) in [1]
Lecture 9 29th August 2023 Estimators, Bias, Variance (Ch 5.4) in [1]
Lecture 10 30th August 2023 Maximum Likelihood Estimation (Ch 5.5) in [1]
Lecture 11 4th September 2023 Deep Feedforward Networks: Example (Ch 6.1) in [1]
Lecture 12 5th September 2023 MLP for Recognizing Handwriting
(Ch 1 in [2]. Relevant Code)

Quiz 2

6th September 2023 Quiz 2

Assignment Nr 3 Due

11th September 2023 Assignment Nr 3 (Modified on 7th Aug)
asst-3-Q1.txt, asst-3-Q1.xlsx,
asst-3-Q2.xlsx, asst-3-Q3.xlsx
Tutorial 11th September 2023 --
Office Hour 12th September 2023 --

Mid-sem

25th September 2023 Mid Sem
Lecture 13 9th October 2023 Backpropagation Algorithm (Ch 2 in [2])
Lecture 14 10th October 2023 Cross-Entropy as Cost Function (Ch 3.1 in [2])
Lecture 15 11th October 2023 Regularization (Ch 3.2 in [2])
Lecture 16 16th October 2023 Weight Initialization + Setting Hyperparameters (Ch 3.3 + 3.4 in [2])
Tutorial 17th October 2023 --
Lecture 17 18th October 2023 Universality of ANN + Unstable Gradient Problem (Ch 4 + 5 in [2])
Lecture 18 23rd October 2023 Deep Convolutional Networks (Ch 6 in [2])
Lecture 19 25rd October 2023 Introduction to Keras (Ch 3.2 in [3])
Lecture 20 30th October 2023 IMDb Dataset (Ch 3.3 in [3])
Code
Lecture 21 31st October 2023 Reuters Dataset (Ch 3.4 in [3])
Code
Office Hours 31st October 2023 --
Lecture 22 1st November 2023 Housing Prices Dataset (Ch 3.5 in [3]) + Titanic dataset
Code
Lecture 23 6th November 2023 Workflow of ML/DL Algorithms (Ch 4 in [3])

Quiz 3

7th November 2023 Quiz 3
Office Hours 7th November 2023 --
Lecture 24 8th November 2023 Convolutional Neural Networks (Ch 5.1 in [3])

Assignment Nr 4 Due

10th November 2023 Assignment Nr 4
asst-4-data.txt, asst-4-data-info.txt
Lecture 25 13th November 2023 Embedding (Ch 6.1.2 in [3])
Lecture 26 14th November 2023 Recurrent Neural Networks (Ch 6.2.1 in [3])
Office Hours 14th November 2023 --

Quiz 4

15th November 2023 Quiz 4

End Term

20th November 2023 End Sem

*****

***** *****
Problem Set -- Problem Set (Modified on 6th Nov)

Nr. Book Authors
[1] Deep Learning Ian Goodfellow, Yoshua Bengio, and Aaron Courville
[2] Neural Networks and Deep Learning Michael Nielsen
[3] Deep Learning for Python François Chollet
[4] Mathematics for Machine Learning Marc Peter Deisenroth, A. Aldo Faisal, and Cheng Soon Ong