[{"command":"insert","method":null,"selector":".course-modal-ajax-placeholder-965817","data":"\u003Cdiv class=\u0022container content-rte\u0022\u003E\n \u003Cdiv class=\u0022row\u0022\u003E\n \u003Cdiv class=\u0022box col-md-6 bg-primary text-white\u0022\u003E\n \u003Ch2 class=\u0022h1 text-left\u0022\u003E Information Theory\n\u003C\/h2\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EECTS :\n 4\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003ESemester:\n Semestre 2\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003ED\u00e9tail du volume horaire\u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan class=\u0022field__label h4 mt-5 \u0022\u003ELecture:\u003C\/span\u003E\n \u003Cspan\u003E12\u003C\/span\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan class=\u0022field__label h4 mt-5 \u0022\u003EPractical study :\u003C\/span\u003E\n \u003Cspan\u003E8\u003C\/span\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan class=\u0022field__label h4 mt-5 \u0022\u003EDirected study:\u003C\/span\u003E\n \u003Cspan\u003E8\u003C\/span\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003ELangue d\u0026#039;enseignement\u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan\u003EAnglais\u003C\/span\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EEnseignement \u00e0 distance\u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan\u003Enon\u003C\/span\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022box col-md-6\u0022\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EProgramme \/ plan \/ contenus\u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan\u003E\u003Cp\u003ELesson IT-01. Measures and chain rules I; Lesson IT-02. Measures and chain rules II; Lesson IT-03. Fundamental inequalities I; Lesson IT-04. Fundamental inequalities II; Lesson IT-05. Weak typicality\/AEP\/JAEP; Lesson IT-06. Entropy rates of random processes; Lesson IT-07. Data compression\/Source coding theorem\/Huffman; Lesson IT-08. Data transmission\/Channel capacity; Lesson IT-09. Data transmission\/Noisy channel coding theorem; Lesson IT-10. Data transmission\/Joint source-channel coding theorem; Lesson IT-11. Strong typicality\/AEP\/JAEP + strong vs weak; Lesson IT-12. Rate-distorsion theory\/theorem; Lesson IT-13. Statistics\/Large deviations\/Fisher\/CRB; Lesson IT-14. Machine learning\/Information-theoretic methods.\u003C\/p\u003E\u003C\/span\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EObjectifs d\u0026#039;apprentissage\u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan\u003E\u003Cp\u003EThe objectives of this course are to establish a rigorous mathematical foundation for information theory by developing the principal information measures, their chain rules, the fundamental inequalities that govern them, and the notions of weak and strong typicality, together with the analysis of entropy rates in random processes. The course further aims to formalize the principles underlying the optimal representation and transmission of information, drawing on the main source-coding theorems\u2014including Huffman coding\u2014channel capacity theory, the noisy-channel coding theorem, the joint source\u2013channel coding theorem, and the framework of rate\u2013distortion theory. Finally, it seeks to articulate the connections between information theory, statistics, and machine learning through the study of large-deviation principles, Fisher information and Cram\u00e9r\u2013Rao bounds, and the application of information-theoretic methodologies within contemporary learning systems.\u003C\/p\u003E\u003C\/span\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003EBibliographie\u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan\u003E\u003Cp\u003E[1] COVER, T.M. and THOMAS, J.A., Elements of Information Theory, Wiley, 2006.\u003Cbr\u003E\n[2] YEUNG, R.W. Information Theory and Network Coding, Springer, 2008.\u003Cbr\u003E\n[3] GALLAGER, R.G., Information Theory and Reliable Communications, Wiley, 1968.\u003Cbr\u003E\n[4] MAC WILLIAMS, F.J. and SLOANE, N.J.A., The Theory of Error-Correcting Codes, North Holland, 1977.\u003Cbr\u003E\n[5] VITERBI, A.J. and OMURA, J.K., Principles of Digital Communications and Coding, McGraw Hill, 1979.\u003Cbr\u003E\n[6] RYAN, W.E. and LIN, S., Channel Codes: Classical and Modern, Cambridge, 2009.\u003C\/p\u003E\u003C\/span\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003Cdiv class=\u0022field-spacing\u0022\u003E\n \u003Cdiv class=\u0022field__label h3 dash\u0022\u003ENature de l\u0026#039;\u00e9valuation\u003C\/div\u003E\n \u003Cdiv class=\u0022mt-5 text-justify\u0022\u003E\n \u003Cspan\u003EEvaluation Continue non Int\u00e9grale\u003C\/span\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n \u003C\/div\u003E\n\u003C\/div\u003E\n","settings":null}]