-
Notifications
You must be signed in to change notification settings - Fork 0
/
training.html
350 lines (301 loc) · 19.1 KB
/
training.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
<!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta content="width=device-width, initial-scale=1.0" name="viewport">
<title>PSALM Lab</title>
<meta content="" name="description">
<meta content="" name="keywords">
<!-- Google Fonts -->
<link href="https://fonts.googleapis.com/css?family=Open+Sans:300,300i,400,400i,700,700i|Montserrat:300,400,500,700" rel="stylesheet">
<!-- Vendor CSS Files -->
<link href="assets/vendor/animate.css/animate.min.css" rel="stylesheet">
<link href="assets/vendor/aos/aos.css" rel="stylesheet">
<link href="assets/vendor/bootstrap/css/bootstrap.min.css" rel="stylesheet">
<link href="assets/vendor/bootstrap-icons/bootstrap-icons.css" rel="stylesheet">
<link href="assets/vendor/glightbox/css/glightbox.min.css" rel="stylesheet">
<link href="assets/vendor/swiper/swiper-bundle.min.css" rel="stylesheet">
<link rel="stylesheet" href="assets/css/academicons.css"/>
<!-- Template Main CSS File -->
<link href="assets/css/style.css" rel="stylesheet">
<!-- =======================================================
* Template Name: BizPage
* Updated: Mar 10 2023 with Bootstrap v5.2.3
* Template URL: https://bootstrapmade.com/bizpage-bootstrap-business-template/
* Author: BootstrapMade.com
* License: https://bootstrapmade.com/license/
======================================================== -->
</head>
<body>
<!-- ======= Header ======= -->
<header id="header" class="fixed-top d-flex align-items-center header-transparent">
<div class="container-fluid">
<div class="row justify-content-center align-items-center">
<div class="col-xl-11 d-flex align-items-center justify-content-between">
<h1 class="logo"><a href="./index.html">Prabhat Kumar Mishra</a></h1>
<!-- Uncomment below if you prefer to use an image logo
<a href="index.html" class="logo"><img src="assets/img/prabhat.jpg" alt="" class="img-fluid"></a> -->
<nav id="navbar" class="navbar">
<ul>
<li><a class="nav-link scrollto active" href="./index.html">Home</a></li>
<li class="dropdown"><a class="nav-link scrollto "><span>PSALM Lab</span> <i class="bi bi-chevron-down"></i></a>
<ul>
<li><a class="nav-link scrollto " href="./people.html">People</a></li>
<li><a class="nav-link scrollto " href="./resources.html">Resources</a></li>
</ul>
<!-- <li><a class="nav-link scrollto " href="./research.html">Research</a></li> -->
<li class="dropdown"><a class="nav-link scrollto "><span>Research</span> <i class="bi bi-chevron-down"></i></a>
<ul>
<li><a class="nav-link scrollto " href="https://sites.google.com/view/psalm-lab">Projects</a></li>
<li><a class="nav-link scrollto " href="./publications.html">Publications</a></li>
</ul>
</li>
<li class="dropdown"><a class="nav-link scrollto "><span>Training</span> <i class="bi bi-chevron-down"></i></a>
<ul>
<li><a class="nav-link scrollto " href="./training.html">AI/ML for Robot autonomy</a></li>
<li><a class="nav-link scrollto " href="./training.html">AI for Cyber Physical Systems</a></li>
<li><a class="nav-link scrollto " href="./training.html">Linear Algebra for AI/ML</a></li>
<!-- <li><a class="nav-link scrollto " href="./training.html">Course Proejcts</a></li>
<li><a class="nav-link scrollto " href="./training.html">Seminar Topics</a></li> -->
</ul>
<!-- <li><a class="nav-link scrollto " href="./training.html">Training</a></li> -->
<li><a class="nav-link scrollto" href="#footer">Contact</a></li>
</ul>
<i class="bi bi-list mobile-nav-toggle"></i>
</nav>
<!-- .navbar -->
</div>
</div>
</div>
</header><!-- End Header -->
<!-- ======= hero Section ======= -->
<section id="hero">
<div class="hero-container">
<div id="heroCarousel" class="carousel slide carousel-fade" data-bs-ride="carousel" data-bs-interval="5000">
<ol id="hero-carousel-indicators" class="carousel-indicators"></ol>
<div class="carousel-inner" role="listbox">
<div class="carousel-item active" style="background-image: url(assets/img/hero-carousel/banner.jpeg)">
<div class="carousel-container">
<div class="container">
<div class="container">
<h2 class="animate__animated animate__fadeInDown">Predictive Stochastic Adaptive Learning Machines</h2>
<p class="animate__animated animate__fadeInUp">
PSALM (Predictive Stochastic Adaptive Learning Machines) Lab at IIT Kharagpur is focused on research at the intersection of control theory and Artificial Intelligence (AI). The real world applications of AI require safety guarantee and explainability of the AI module. In addition, several modules such as sensing and perception, planning and action need to interact to complete the feedback loop. Our main focus is in planning and decision making but we also consider sensing and actuation along with the effects of communication channels whenever required.
</p>
<a href="./people.html" class="btn-get-started scrollto animate__animated animate__fadeInUp">People</a>
<a href="./resources.html" class="btn-get-started scrollto animate__animated animate__fadeInUp">Resources</a>
<!-- <h2 class="animate__animated animate__fadeInDown">Predictive Stochastic Adaptive Learning Machines</h2> -->
<!-- <a href="./index.html" class="btn-get-started scrollto animate__animated animate__fadeInUp">Home</a> -->
<!-- <a href="./people.html" class="btn-get-started scrollto animate__animated animate__fadeInUp">People</a> -->
<a href="./publications.html" class="btn-get-started scrollto animate__animated animate__fadeInUp">Publications</a>
<!-- <a href="./training.html" class="btn-get-started scrollto animate__animated animate__fadeInUp">Training</a> -->
<!-- <a href="#footer" class="btn-get-started scrollto animate__animated animate__fadeInUp">Contact</a> -->
</div>
</div>
</div>
</div>
</div>
</div>
</section>
<!-- End Hero Section -->
<main id="main">
<!-- End Hero Section -->
<section id="robot">
<div class="container" data-aos="fade-up">
<header class="section-header">
<h3>AI60209: AI/ML for Robot Autonomy</h3>
</header>
<h1>Objective</h1>
<p>This course presents AI/ML based principles for endowing robots with capabilities to autonomously learn new skills to make the control of robots safe.
The global robotics technology market size is expected to surpass around 283 billion USD by 2032 (<a href = "https://www.precedenceresearch.com/robotics-technology-market">Ref</a>).
The aim of this course is to introduce students with basics as well as modern robot autonomy.
Students will be able to understand why AI/ML based methods are required in the modern robotics industry and why the traditional AI/ML is not directly applicable.
Students will be introduced to the following</p>
<ul>
<li>a set of control laws that enable motion- planning by learning the dynamical systems</li>
<li>reinforcement learning and its relationship to optimal control for robotics, and imitation learning</li>
</ul>
<h1>Modus Operandi</h1>
<ul>
<li>Class-room activities: 10%</li>
<ul>
<li>Participate in class-room discussions and ask quality questions</li>
<li>Five minutes teaching: Pick any small topic that is taught in the class before your schedule and teach it for five minutes.</li>
<li>Attendance</li>
</ul>
<li>Course project: 20%</li>
<ul>
<li>I will provide you codes. Your job will be to run that code by yourself and understand the algorithms and associated theory.</li>
</ul>
<li>Mid-sem: 30%</li>
<li>End-sem: 40%</li>
</ul>
<h1>Syllabus</h1>
<h1>Module 1: Foundation for robotics and control</h1>
<p>Robot body (introduction and rigid transformation), Robot motion (SO3, screw, twist and inverse kinematics), Robot dynamics (angular momentum, rotational inertia, kinetic energy, force, change of frames), cart-pole, quadrotors (simulation using ROS/ Gazebo), mobile robots (simulation using ROS/ Gazebo), Open-loop vs. closed-loop control, notions of safety, chance constraints, stability, stabilizability, controllability and reachability</p>
<h1>Module 2: Autonomy with dynamical systems</h1>
<p>Learning from demonstration: teaching robots via human demonstration such as teleoperation, kinesthetic teaching and observational learning</p>
<p>Learning a control law: three classic regression methods to estimate model and demonstrates their inability to learn a stable dynamical system (DS), brief introduction to Lyapunov theory, Gaussian mixture regression, physically consistent estimation approach for Gaussian mixture models</p>
<p>Adapting and modulating an existing control law: modulations that act locally to preserve the generic properties of the nominal DS (e.g., asymptotic or global stability)</p>
<h1>Module 3: Autonomy under constraints</h1>
<p>Obstacle avoidance: modulate the DS to contour obstacles or to remain within a given workspace, Model Predictive Control (MPC), Deep MPC, stochastic MPC and constrained estimator</p>
<h1>Module 4: Autonomy with RL</h1>
<p>Robots as Markov Decision Problems,
Intro to RL: Sequential decision making examples of robotics, principle of optimality, dynamic programming, examples of uncertainty in the robotics, challenges and extensions of dynamic programming</p>
<p>Model-based and model-free RL for robot control: problem formulation, value iteration, policy iteration, Q learning, policy gradient, actor-critic, deep RL for robotics</p>
<p>Deep RL: DQN (Deep Q learning, deep value network, training deep Q network), Unbiased policy gradient method</p>
<p>Advanced on-policy RL and off-policy RL: practical first order policy optimization, efficient and stable policy optimization, incremental Monte Carlo value function estimation, trust region method, deep deterministic policy gradient, trouble and tricks in robotics, soft actor critic</p>
<p>Imitation learning: Behavioral cloning, direct policy learning, inverse RL, learning from comparison and physical feedback</p>
<h1>Resources</h1>
<ol>
<li>A Mathematical Introduction to Robotic Manipulation by Richard Murray, Zexiang Li and Shankar Sastry, CRC Press</li>
<li>Learning for Adaptive and Reactive Robot Control By Aude Billard, Sina Mirrazavi and Nadia Figueroa, MIT press</li>
<li>Lecture notes of Machine Learning for Robotics by Hao Su</li>
<li>Lecture notes of Principles of Robot Autonomy II by Marco Pavone, Dorsa Sadigh and Jeannette Bohg</li>
<li>Springer Handbook of Robotics, Editors: B. Siciliano and O. Khatib</li>
<li>Robotics, Vision and Control by Peter Corke</li>
<li>Probabilistic Robotics by Sebastian Thrun, Wolfram Burgard and Dieter Fox</li>
<li>Lecture notes on Underactuated Robotics by Russ Tedrake</li>
<li>Lecture notes of Robot Learning by Sanjiban Choudhury</li>
</ol>
</div>
</section>
<!-- End Robot Autonomy -->
<!-- AI4CPS -->
<section id="AI4CPS">
<div class="container" data-aos="fade-up">
<header class="section-header">
<h3>AI61006: Artificial Intelligence for Cyber Physical Systems</h3>
</header>
<h1>Objective</h1>
<ul>
<li>How to formulate your domain specific problem as a CPS</li>
<li>How to apply some suitable AI techniques to solve a CPS problem</li>
</ul>
<h1>Modus Operandi</h1>
<ul>
<li>Class-room activities: 10%</li>
<ul>
<li>Participate in class-room discussions</li>
<li>Five minutes teaching: Pick any small topic that is taught in the class before your schedule and teach it for five minutes.</li>
<li>Attendance</li>
</ul>
<li>Course project: 20%</li>
<ul>
<li>Refer to <a href="#student_projects">course-project</a> details.</li>
</ul>
<li>Mid-sem: 30%</li>
<li>End-sem: 40%</li>
</ul>
<h1>Syllabus</h1>
<h1>Module 1: Introduction</h1>
<h1>Module 2: Physical Systems</h1>
<h1>Module 3: Sensing and Perception</h1>
<h1>Module 4: Planning and Acting</h1>
</div>
</section>
<!-- End AI4CPS -->
<section id="student_projects">
<div class="container" data-aos="fade-up">
<header class="section-header">
<h3>Projects for students (Internship, BTP, MTP, Course)</h3>
</header>
<p>
Student projects are divided in three categories. The expected outcome depends on the duration of the project and therefore,
students are not supposed to complete the project. Instead, their performance will be evaluated on the basis of efforts they put in
learning. In addition, my inputs will be proportional to the efforts of the student. The three categories of projects are
</p>
<ol>
<li>
Review and tutorial: You can select a few papers relevant as per your interest in which control and learning both are present.
You can summarize those papers or their problem formulation, try to make a tree to connect other related papers and attempt to provide your own perspective.
I will grade you on the basis of consistency, exhaustiveness, and completeness. You can write an article on medium or
a post on LinkedIn to get noticed by the people or industries working in the related area. In this way, you will be able to secure your next career stop.
Please do not use my name in your social media post without my permission.
Maximum two members in a team are allowed.
</li>
<li>
Reproduce and benchmarking: You can select a paper according to your interest and my recommendations, and reproduce their simulation results.
If you have some novelty, you can make your git repository public.
This open source contribution will help you to demonstrate your skills in front of interviewers and boost your resume.
Please do not use my name anywhere in your git repository without my permission.
You can work in a team of at most three members.
</li>
<li>
Research and invent: For the course project, you can choose any topic within the general theme of the course for your research in a team of maximum four members.
You can continue the work that you are doing with other faculty members with their permission.
I will provide the publishable and applicable research directions to students who are working with me as intern, BTP or MTP student.
</li>
</ol>
<p>
You should consider the papers published in top AI and robotics conferences. You can choose papers written by famous people
so that you can understand their research direction.
You can also see the work carried out in top universities and industries.
</p>
</div>
</section>
</main><!-- End #main -->
<!-- ======= Footer ======= -->
<footer id="footer">
<div class="footer-top">
<div class="container">
<div class="row">
<!-- ======= Contact Section ======= -->
<!-- <section id="contact" class="section-bg"> -->
<!-- <div class="container" data-aos="fade-up"> -->
<div class="row contact-info">
<div class="col-md-4">
<div class="contact-address">
<i class="bi bi-geo-alt"></i>
<!-- <h3>Address</h3> -->
<address>Dept. of Artificial Intelligence,</address>
<address>CET 021, Takshashila building, IIT Kharagpur</address>
<address>Kharagpur, India - 721302</address>
</div>
</div>
<div class="col-md-4">
<div class="contact-email">
<i class="bi bi-envelope"></i>
<!-- <h3>Email</h3> -->
<p><a href="mailto:[email protected]">pkmishra at ai.iitkgp.ac.in</a></p>
</div>
</div>
</div>
<!-- </div> -->
<!-- </section> -->
<!-- End Contact Section -->
<div class="col-lg-3 col-md-6 footer-contact">
<div class="social-links">
<a href="https://scholar.google.co.in/citations?user=rXhwtr0AAAAJ&hl=en"><i class="twitter"><i class="bi bi-google"></i></a>
<a href="https://twitter.com/mishra_p_k" class="twitter"><i class="bi bi-twitter"></i></a>
<a href="https://www.linkedin.com/in/mishra-p-k" class="linkedin"><i class="bi bi-linkedin"></i></a>
</div>
</div>
</div>
</div>
</div>
<div class="container">
<div class="credits">
<!--
All the links in the footer should remain intact.
You can delete the links only if you purchased the pro version.
Licensing information: https://bootstrapmade.com/license/
Purchase the pro version with working PHP/AJAX contact form: https://bootstrapmade.com/buy/?theme=BizPage
-->
Designed by <a href="https://bootstrapmade.com/">BootstrapMade</a>
</div>
</div>
</footer><!-- End Footer -->
<!-- <a href="#" class="back-to-top d-flex align-items-center justify-content-center"><i class="bi bi-arrow-up-short"></i></a> -->
<script src="assets/vendor/purecounter/purecounter_vanilla.js"></script>
<script src="assets/vendor/aos/aos.js"></script>
<script src="assets/vendor/bootstrap/js/bootstrap.bundle.min.js"></script>
<script src="assets/vendor/glightbox/js/glightbox.min.js"></script>
<script src="assets/vendor/isotope-layout/isotope.pkgd.min.js"></script>
<script src="assets/vendor/swiper/swiper-bundle.min.js"></script>
<script src="assets/vendor/waypoints/noframework.waypoints.js"></script>
<script src="assets/vendor/php-email-form/validate.js"></script>
<!-- Template Main JS File -->
<script src="assets/js/main.js"></script>
</body>
</html>