Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
teaching:st23:seminar [2023/09/29 17:05]
ipa [Descripion of Seminar.]
teaching:st23:seminar [2023/10/11 19:56] (current)
ipa [Organization]
Line 5: Line 5:
 ====  Descripion of Seminar. ==== ====  Descripion of Seminar. ====
  
-This seminar ​reviews the main concepts ​of stochastic differential equations (SDEs) in view of better ​understanding diffusion models, ​state of the art family of deep generative models. ​This seminar ​takes place on the first half of the winter term. Participants can (voluntarily) attend to the follow-up seminar [[teaching:​st23:​master-seminar|Score-based Generative Models for Machine Learning (Master Seminar)]], which take part on the second half of the winter term. +This seminar ​provides an overview ​of stochastic differential equations (SDEs) ​with a focus on their relevance ​in understanding diffusion models, ​which are considered ​state-of-the-art deep generative models. ​The seminar ​is scheduled for the first half of the winter term, and participants have the option to attend a follow-up seminar ​titled ​[[teaching:​st23:​master-seminar|Score-based Generative Models for Machine Learning (Master Seminar)]], which takes place in the second half of the winter term.\\ 
 +The seminar covers a wide range of topics without delving into minute details. Instead, it aims to address the most essential aspects related to the aforementioned generative models. The content of the seminar is structured as follows: ​  
 +  * Review of Differential Equations: The seminar begins with a review of fundamental concepts in differential equations, with a specific emphasis on the initial value problem. It covers key results related to existence, uniqueness, and numerical analysis for integration. 
 +  * Mathematical notations and statistical concepts of stochastic processes: We revisit the basic mathematical notations and introduce necessary statistical concepts essential for introducing the Ito integral. 
 +  * Ito calculus: Participants will learn about Ito integrals and their main properties. Special attention is given to the Ito isometry. The seminar will include derivations,​ examples, and applications of Ito integrals. 
 +  * Ito Formula: We derive the Ito formula, providing insights into its significance and practical applications. 
 +  * Statistics of SDEs: The final part of the seminar focuses on the statistical aspects of SDEs. Topics include the derivation of the Fokker-Planck-Kolmogorov equation, an examination of the markov and martingale properties of SDEs, and the derivation of the equations for the moments of SDEs. 
 + 
 +By the end of the seminar, participants will have a better understanding of SDEs with insights in the context of diffusion models. This knowledge can be valuable for those interested in advanced topics in machine learning and mathematical modeling. 
 + 
 + 
 + 
 + 
  
-The topics covered in this seminar are broad. We intend not to dive into small details, but to handle instead the most important aspects in view on the aforementioned generative models. We start this seminar reviewing the most important results on differential equations, putting a special focus on the initial value problem. We review existence and uniqueness results as well as the numerical analysis. We continue the seminar revisiting the basic mathematical notations and statistical concepts needed to introduce the Ito integrals. We derive the most important properties for the Ito calculus, as it is the Ito isometry. Having this setup, we derive the Ito formula and handle some examples and applications. We conclude this seminar studying the statistics of SDEs. We derive the Fokker-Planck-Kolmogorov equation, review the Markov and Martigale Properties of SDEs, and derive general equations for the moments of SDEs. 
  
  
Line 16: Line 28:
   * **Prerequisites:​** Basic knowledge in probability theory and statistics ​   * **Prerequisites:​** Basic knowledge in probability theory and statistics ​
   * **Registration:​** Via Müsli. [[https://​muesli.mathi.uni-heidelberg.de/​lecture/​view/​1756|Link]]   * **Registration:​** Via Müsli. [[https://​muesli.mathi.uni-heidelberg.de/​lecture/​view/​1756|Link]]
-  * **First (organizational) meeting:​** ​Kalenderwoche 42Specific day and time will be announced soon.  +  * **First (organizational) meeting:​** ​ ​Tuesday,​ 17 October at 11:00 c.t
-  * **Time and Location:​** ​Time and location will be announced soon.+  * **Time and Location:​** ​Tuesdays 14:00 c.tin SR 6
  
  
-Further information on the seminar will be announced in the first organizational meeting. For any specific question you can contact [[:people | Daniel Gonzalez]].+Further information on the seminar will be announced in the first organizational meeting. For any specific question you can contact [[:people | Daniel Gonzalez, Jonas Cassel]].
  
  
Line 37: Line 49:
   *  **An introduction to stochastic differential equations**,​ // Evans, Lawrence C// American Mathematical Soc. (2012)   *  **An introduction to stochastic differential equations**,​ // Evans, Lawrence C// American Mathematical Soc. (2012)
   *  **Analysis 2. Differential-und Integralrechnung für Funktionen mehrerer reeller Veränderlichen**,​ // Rannacher, Rolf// Heidelberg University Publishing (2018)  ​   *  **Analysis 2. Differential-und Integralrechnung für Funktionen mehrerer reeller Veränderlichen**,​ // Rannacher, Rolf// Heidelberg University Publishing (2018)  ​
 +
 +