Main page | Study Branches/Specializations | Groups of Courses | All Courses | Roles                Instructions

A course is the basic teaching unit, it's design as a medium for a student to acquire comprehensive knowledge and skills indispensable in the given field. A course guarantor is responsible for the factual content of the course.
For each course, there is a department responsible for the course organisation. A person responsible for timetabling for a given department sets a time schedule of teaching and for each class, s/he assigns an instructor and/or an examiner.
Expected time consumption of the course is expressed by a course attribute extent of teaching. For example, extent = 2 +2 indicates two teaching hours of lectures and two teaching hours of seminar (lab) per week.
At the end of each semester, the course instructor has to evaluate the extent to which a student has acquired the expected knowledge and skills. The type of this evaluation is indicated by the attribute completion. So, a course can be completed by just an assessment ('pouze zápočet'), by a graded assessment ('klasifikovaný zápočet'), or by just an examination ('pouze zkouška') or by an assessment and examination ('zápočet a zkouška') .
The difficulty of a given course is evaluated by the amount of ECTS credits.
The course is in session (cf. teaching is going on) during a semester. Each course is offered either in the winter ('zimní') or summer ('letní') semester of an academic year. Exceptionally, a course might be offered in both semesters.
The subject matter of a course is described in various texts.

NI-GLR Games and reinforcement learning Extent of teaching: 2P+2C
Instructor: Completion: Z,ZK
Department: 18105 Credits: 4 Semester: L

Annotation:
The field of reinforcement learning is very hot recently, because of advances in deep learning, recurrent neural networks and general artificial intelligence. This course is intended to give you both theoretical and practical background so you can participate in related research activities. Presented in English.

Lecture syllabus:
Algorithmic game theory
1. Sealed-bid combinatorial auctions
2. Iterative combinatorial auctions
3. Stable matching
4. Congestion games. Selfish routing and the price of anarchy
5. Potential games. Network cost-sharing games
6. Best response dynamics. No-regret dynamics.
Introduction to Reinforcement Learning
7. Multiarmed Bandit Algorithms.
8. Finite Markov Decision Processes
9. Dynamic Programming
10. Montecarlo methods
11. Temporal-Difference learning
12. Multi-step bootstrapping
13. Planning and learning with tabular methods

Seminar syllabus:
Algorithmic game theory
1. Mechanism design basics. Auctions of physical goods.
2. Sponsored search auctions (online advertising).
3. Congestion games. Selfish routing and the price of anarchy
4. Traffic assignment in networks.
5. Best response dynamics. No-regret dynamics.
6. Rock, paper, scissors.
Introduction to Reinforcement Learning
7. Multiarmed Bandit Algorithms.
8. Markov chains and MDP's.
9. Algorithms: Q-learning, TD
10. Playing tic-tac-toe, checkers.
11. Tensorflow introduction.
12. Case studies: TD-gammon, Atari games, Go playing.
13. OpenAI Gym. Policy gradient algorithm.

Literature:
Reinforcement Learning: An introduction, Sutton and Barto, 2nd edition draft, 2017. Algorithmic Game Theory, Roughgarden, Tardos, Vazirani and Nisan, 2007.

Requirements:
BI-ZUM - Introduction to artificial intelligence

Informace o předmětu a výukové materiály naleznete na https://courses.fit.cvut.cz/MI-GLR/

The course is also part of the following Study plans:
Study Plan Study Branch/Specialization Role Recommended semester
NI-PB.2020 Computer Security V 4
NI-ZI.2020 Knowledge Engineering V 4
NI-SPOL.2020 Unspecified Branch/Specialisation of Study V 4
NI-TI.2020 Computer Science V 4
NI-TI.2023 Computer Science V 4
NI-NPVS.2020 Design and Programming of Embedded Systems V 4
NI-PSS.2020 Computer Systems and Networks V 4
NI-MI.2020 Managerial Informatics V 4
NI-SI.2020 Software Engineering (in Czech) V 4
NI-SP.2020 System Programming V 4
NI-WI.2020 Web Engineering V 4
NI-SP.2023 System Programming V 4
NIE-SI.21 Software Engineering 2021 V Není
NIE-TI.21 Computer Science 2021 V Není
NIE-DBE.2023 Digital Business Engineering V Není
NIE-NPVS.21 Design and Programming of Embedded Systems 2021 V Není
NIE-PSS.21 Computer Systems and Networks 2021 V Není
NIE-PB.21 Computer Security 2021 V Není


Page updated 29. 3. 2024, semester: L/2021-2, Z,L/2023-4, Z/2021-2, Z/2020-1, Z/2019-20, L/2020-1, Z,L/2022-3, L/2019-20, Send comments to the content presented here to Administrator of study plans Design and implementation: J. Novák, I. Halaška