[{"command":"insert","method":null,"selector":".course-modal-ajax-placeholder-962041","data":"\u003Cdiv class=\u0022container content-rte\u0022\u003E\n  \u003Cdiv class=\u0022row\u0022\u003E\n    \u003Cdiv class=\u0022box col-md-6 bg-primary text-white\u0022\u003E\n      \u003Ch2 class=\u0022h1 text-left\u0022\u003E  Statistical and Reinforcement Learning\n\u003C\/h2\u003E\n                  \u003Cdiv class=\u0022field-spacing\u0022\u003E\n        \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EECTS :\n          3\n        \u003C\/div\u003E\n      \u003C\/div\u003E\n                  \u003Cdiv class=\u0022field-spacing\u0022\u003E\n        \u003Cdiv class=\u0022field__label h3 dash\u0022\u003ESemestre calendaire :\n          Semestre 1\n        \u003C\/div\u003E\n      \u003C\/div\u003E\n                    \u003Cdiv class=\u0022field-spacing\u0022\u003E\n      \u003Cdiv class=\u0022field__label h3 dash\u0022\u003ELangue d\u0026#039;enseignement\u003C\/div\u003E\n                        \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n                                      \u003Cspan\u003EAnglais\u003C\/span\u003E\n                      \u003C\/div\u003E\n                  \u003C\/div\u003E\n        \u003Cdiv class=\u0022field-spacing\u0022\u003E\n      \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EEnseignement \u00e0 distance\u003C\/div\u003E\n                        \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n                                      \u003Cspan\u003Enon\u003C\/span\u003E\n                      \u003C\/div\u003E\n                  \u003C\/div\u003E\n      \u003C\/div\u003E\n    \u003Cdiv class=\u0022box col-md-6\u0022\u003E\n            \u003Cdiv class=\u0022field-spacing\u0022\u003E\n      \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EPr\u00e9requis\u003C\/div\u003E\n                        \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n                                      \u003Cspan\u003E\u003Cp\u003Eprobability, statistics, optimisation\u003C\/p\u003E\u003C\/span\u003E\n                      \u003C\/div\u003E\n                  \u003C\/div\u003E\n        \u003Cdiv class=\u0022field-spacing\u0022\u003E\n      \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EProgramme \/ plan \/ contenus\u003C\/div\u003E\n                        \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n                                      \u003Cspan\u003E\u003Cp\u003EI Statistical Learning\u003Cbr\u003E\n\u2013 Framework, empirical risk minimisation, overfitting\u003Cbr\u003E\n\u2013 Algorithms: gradient descent, stochastic gradient descent\u003Cbr\u003E\n\u2013Statistical models: linear classification\/regression, kernel methods, neural networks\u003Cbr\u003E\nII Reinforcement Learning I\u0026nbsp;\u003Cbr\u003E\n\u2013 Multi-Armed Bandits (MAB)\u003Cbr\u003E\n\u2013 Algorithms for stochastic MABs: UCB, KL-UCB, Thompson Sampling \u2013 Algorithms for adversarial MABs: Hedge, EXP3.\u003Cbr\u003E\nIII Reinforcement learning II\u003Cbr\u003E\n\u2013 Basic algorithms: Q-Learning, SARSA\u003Cbr\u003E\n\u2013 Algorithms for large scale problems: value approximation, policy gradient. \u2013 Monte-Carlo tree search and the UCT algorithm.\u003Cbr\u003E\nIV Application of Learning in Wireless Networks\u003Cbr\u003E\n\u2013 Example of wireless networking problems where Reinforcement Learning is applied.\u003Cbr\u003E\n\u2013 Examples of Implementation using Matlab, Python.\u003C\/p\u003E\u003C\/span\u003E\n                      \u003C\/div\u003E\n                  \u003C\/div\u003E\n        \u003Cdiv class=\u0022field-spacing\u0022\u003E\n      \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EObjectifs d\u0026#039;apprentissage\u003C\/div\u003E\n                        \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n                                      \u003Cspan\u003E\u003Cp\u003EThe goal of this course is to provide students with an introduction to the field of machine learning, with a particular focus on online learning. In the first part we will review statistical learning theory, and provide efficient algorithms for regression and classification. In the second part, we will focus on reinforcement learning which enables to solve Markov Decision Processes (MDPs) when the statistics of the environment are unknown. We will first consider algorithms for Multi-Armed Bandits (i.e. MDPs with a single state), and then extend our approach to general MDPs. Approximation techniques for large scale problems will also be addressed. Applications in the context of wireless networks will be discussed.\u003C\/p\u003E\u003C\/span\u003E\n                      \u003C\/div\u003E\n                  \u003C\/div\u003E\n        \u003Cdiv class=\u0022field-spacing\u0022\u003E\n      \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EOrganisation g\u00e9n\u00e9rale et modalit\u00e9s p\u00e9dagogiques\u003C\/div\u003E\n                        \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n                                      \u003Cspan\u003E\u003Cp\u003EThe course is composed of 6 lectures of 3h each and two practical work of 3h each.\u003C\/p\u003E\u003C\/span\u003E\n                      \u003C\/div\u003E\n                  \u003C\/div\u003E\n                        \u003Cdiv class=\u0022field-spacing\u0022\u003E\n      \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EBibliographie\u003C\/div\u003E\n                        \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n                                      \u003Cspan\u003E\u003Cp\u003E1. Machine Learning: A Probabilistic Perspective, by Kevin P. Murphy, Adaptive Computation and Machine Learning series, MIT Press, ISBN-10: 0262018020.\u0026nbsp;\u003C\/p\u003E\n\u003Cp\u003E2. Machine Learning, by Tom M. Mitchell, Mcgraw-Hill Series in Computer Science, McGraw-Hill Education, ISBN-10: 0070428077.\u0026nbsp;\u003C\/p\u003E\n\u003Cp\u003E3. Recent papers in the domain.\u003C\/p\u003E\u003C\/span\u003E\n                      \u003C\/div\u003E\n                  \u003C\/div\u003E\n        \u003Cdiv class=\u0022field-spacing\u0022\u003E\n      \u003Cdiv class=\u0022field__label h3 dash\u0022\u003ENature de l\u0026#039;\u00e9valuation\u003C\/div\u003E\n                        \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n                                      \u003Cspan\u003EEvaluation Continue non Int\u00e9grale\u003C\/span\u003E\n                      \u003C\/div\u003E\n                  \u003C\/div\u003E\n      \u003C\/div\u003E\n  \u003C\/div\u003E\n\u003C\/div\u003E\n","settings":null}]