Differences

This shows you the differences between two versions of the page.

 research [2017/11/02 02:51]ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] research [2019/04/25 10:44] (current)ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] Both sides previous revision Previous revision 2019/04/25 10:44 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2019/03/20 09:59 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/10/17 12:17 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/09/23 15:31 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/05/28 09:58 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/05/28 09:57 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/03/01 21:39 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/02/19 23:35 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/02/19 23:33 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/01/26 00:24 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/02 11:49 ipa [Minimum Energy Filtering on Lie Groups with Application to Structure and Motion Estimation from Monocular Videos] 2017/11/02 11:49 ipa [Minimum Energy Filtering on Lie Groups with Application to Structure and Motion Estimation from Monocular Videos] 2017/11/02 02:53 ipa [Context Specific Independence and Graphical Models] 2017/11/02 02:53 ipa [Segmentation of Thin Fiber Structures in 3D Tomographical Data] 2017/11/02 02:53 ipa [Phase Transitions and Recovery of Cosparse Objects Through Limited Angle Tomography] 2017/11/02 02:51 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/01 22:15 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/01 22:14 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/01 17:33 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/01 17:32 ipa [Geometric Low-Level Variational Image Analysis] 2017/10/28 15:38 ipa [Geometric Low-Level Variational Image Analysis] 2017/10/28 15:37 ipa [Geometric Low-Level Variational Image Analysis] 2017/05/21 11:18 ipa use https for links2017/01/19 14:11 ipa [Geometric Low-Level Variational Image Analysis] 2016/10/18 16:19 ipa [Geometric Low-Level Variational Image Analysis] 2016/09/06 12:54 ipa [Geometric Low-Level Variational Image Analysis] 2016/07/19 13:38 ipa [Geometric Low-Level Variational Image Analysis] 2016/07/19 13:35 ipa [Geometric Low-Level Variational Image Analysis] 2016/03/22 15:12 ipa 2016/03/04 16:29 ipa [Partial Optimality in MAP-MRF] 2016/03/04 16:28 ipa [Partial Optimality in MAP-MRF] 2016/03/04 16:27 ipa [Partial Optimality in MAP-MRF] 2015/09/21 11:16 aneufeld 2015/09/21 11:16 aneufeld [Monocular 3D Reconstruction of Traffic Scenes from Optical Flow] 2015/08/21 10:50 ipa [Minimum Energy Filtering on Lie Groups with Application to Structure and Motion Estimation from Monocular Videos] 2015/08/20 13:03 aneufeld 2015/08/20 13:03 aneufeld 2015/08/13 15:55 aneufeld 2015/08/12 18:41 aneufeld 2015/08/12 18:34 aneufeld [Monocular 3D Reconstruction of Traffic Scenes from Optical Flow] 2015/08/12 18:33 aneufeld [Monocular 3D Reconstruction of Traffic Scenes from Optical Flow] Next revision Previous revision 2019/04/25 10:44 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2019/03/20 09:59 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/10/17 12:17 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/09/23 15:31 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/05/28 09:58 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/05/28 09:57 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/03/01 21:39 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/02/19 23:35 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/02/19 23:33 ipa [Variational Image Analysis on Manifolds and Metric Measure Spaces] 2018/01/26 00:24 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/02 11:49 ipa [Minimum Energy Filtering on Lie Groups with Application to Structure and Motion Estimation from Monocular Videos] 2017/11/02 11:49 ipa [Minimum Energy Filtering on Lie Groups with Application to Structure and Motion Estimation from Monocular Videos] 2017/11/02 02:53 ipa [Context Specific Independence and Graphical Models] 2017/11/02 02:53 ipa [Segmentation of Thin Fiber Structures in 3D Tomographical Data] 2017/11/02 02:53 ipa [Phase Transitions and Recovery of Cosparse Objects Through Limited Angle Tomography] 2017/11/02 02:51 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/01 22:15 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/01 22:14 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/01 17:33 ipa [Geometric Low-Level Variational Image Analysis on Metric Measure Spaces] 2017/11/01 17:32 ipa [Geometric Low-Level Variational Image Analysis] 2017/10/28 15:38 ipa [Geometric Low-Level Variational Image Analysis] 2017/10/28 15:37 ipa [Geometric Low-Level Variational Image Analysis] 2017/05/21 11:18 ipa use https for links2017/01/19 14:11 ipa [Geometric Low-Level Variational Image Analysis] 2016/10/18 16:19 ipa [Geometric Low-Level Variational Image Analysis] 2016/09/06 12:54 ipa [Geometric Low-Level Variational Image Analysis] 2016/07/19 13:38 ipa [Geometric Low-Level Variational Image Analysis] 2016/07/19 13:35 ipa [Geometric Low-Level Variational Image Analysis] 2016/03/22 15:12 ipa 2016/03/04 16:29 ipa [Partial Optimality in MAP-MRF] 2016/03/04 16:28 ipa [Partial Optimality in MAP-MRF] 2016/03/04 16:27 ipa [Partial Optimality in MAP-MRF] 2015/09/21 11:16 aneufeld 2015/09/21 11:16 aneufeld [Monocular 3D Reconstruction of Traffic Scenes from Optical Flow] 2015/08/21 10:50 ipa [Minimum Energy Filtering on Lie Groups with Application to Structure and Motion Estimation from Monocular Videos] 2015/08/20 13:03 aneufeld 2015/08/20 13:03 aneufeld 2015/08/13 15:55 aneufeld 2015/08/12 18:41 aneufeld 2015/08/12 18:34 aneufeld [Monocular 3D Reconstruction of Traffic Scenes from Optical Flow] 2015/08/12 18:33 aneufeld [Monocular 3D Reconstruction of Traffic Scenes from Optical Flow] 2015/08/12 18:33 aneufeld 2015/08/12 18:30 aneufeld 2015/08/12 18:30 aneufeld 2015/08/10 17:10 aneufeld 2015/08/10 17:09 aneufeld 2015/08/07 11:44 aneufeld 2015/08/07 11:43 aneufeld 2015/08/07 11:43 aneufeld 2015/03/24 11:27 ipa [Phase Transitions and Recovery of Cosparse Objects Through Limited Angle Tomography] 2015/03/24 11:27 ipa [Phase Transitions and Recovery of Cosparse Objects Through Limited Angle Tomography] Line 1: Line 1: ====== Research ====== ====== Research ====== - ===== Geometric Low-Level ​Variational Image Analysis on Metric Measure Spaces ===== + ===== Variational Image Analysis on Manifolds and Metric Measure Spaces ===== - We exploit basic statistical manifolds to devise variational models of low-level image analysis that exhibit favourable properties in comparison to established convex and non-convex models: smoothness, probabilistic interpretation,​ efficiently converging parallel and sparse Riemannian numerical updates that scale up to large problem sizes. The current focus is on the assignment manifold and image labeling, and on learning from image assignments in large-scale unsupervised scenarios, within the mathematical frameworks of information geometry and regularised optimal transport. + **Scope.** ​We exploit basic statistical manifolds to devise variational models of low-level image analysis that exhibit favourable properties in comparison to established convex and non-convex models: smoothness, probabilistic interpretation,​ efficiently converging parallel and sparse Riemannian numerical updates that scale up to large problem sizes. ​ - We applied our approach to solve in a novel way the MAP labeling ​problem based on a given graphical model by smoothly combining a geometric reformulation of the local polytope relaxation with rounding to an integral solution. A key ingredient are local Wasserstein messages'​ that couple local assignment ​measures along edges. + The current focus is on the **//​assignment manifold//​** and image labeling, and on learning from image assignments in large-scale unsupervised scenarios, within ​the mathematical frameworks of information geometry and regularised optimal transport. A novel smooth dynamical system evolving on a statistical manifold, called **//assignment ​flow//**, forms the basis of our work. - ​* [[https://arxiv.org/abs/1710.01493|preprint, arXiv:​1710.01493,​ 2017]] + **Mathematical aspects.** The assignment flow evolves non-locally for any data given on a graph. Variational aspects, extensions to continuous domains and scale separation are investigated. A preliminary step concerns a more classical //​additive//​ variational formulation that provides a smooth geometric version of the continuous cut approach. + ​* [[https://ipa.math.uni-heidelberg.de/dokuwiki/Papers/​Savarino2019aa.pdf|A Variational Perspective on the Assignment Flow, SSVM 2019]]. - Kick-off paper that introduces ​the basic approach: + **Parameter learning.** We study how weights for geometric diffusion ​that parametrize ​the adaptivity of the assignment flow can be learned from data. Symplectic integration ensures the commutativity of discretisation and optimisation operations. We currently investigate this approach ​in connection with more general objective functions. + * [[https://​ipa.math.uni-heidelberg.de/​dokuwiki/​Papers/​Huhnerbein2019aa.pdf|Learning Adaptive Regularization for Image Labeling Using Geometric Assignment, SSVM 2019]]. - ​* [[https://link.springer.com/article/10.1007/s10851-016-0702-4|J. Math. Imag. Vision, 2017]] + **Unsupervised label learning.** Our recent work concerns the emergence of labels in a completely unsupervised way by data //​self//​-assignment. The resulting unsupervised assignment flow has connections to low-rank matrix factorisation and discrete optimal mass transport that are explored in our current work. - * [[https://www.readcube.com/articles/10.1007/s10851-016-0702-4?​author_access_token=qTJknl5fUiTP-FjpTKUBO_e4RwlQNchNByi7wbcMAY6Xsf53Ss0CTbPqiHjWrFr9KxurTkJxDnblRwd66rV9vVhzVeITjqSsDSC8NWZFxg9y-pWgHhjix00mggjora7T-qHFcXzGInobFGxuIfcnEA%3D%3D|Link to online PDF]] + ​* [[https://ipa.math.uni-heidelberg.de/dokuwiki/Papers/​Zisler2019aa.pdf|Unsupervised Labeling by Geometric and Spatially Regularized Self-Assignment,​ SSVM 2019]]. + + We extended the assignment flow to //​unsupervised//​ scenarios, where label evolution on a feature manifold is simultaneously performed together with label assignment to given data. The following papers introduce the corresponding //​unsupervised assignment flow//. + * [[https://​ipa.math.uni-heidelberg.de/​dokuwiki/​Papers/​Zern2019aa.pdf|Unsupervised Assignment Flow: Label Learning on Feature Manifolds by Spatially Regularized Geometric Assignment, preprint: arXiv:​1904.10863]] + * [[https://​ipa.math.uni-heidelberg.de/​dokuwiki/​Papers/​gcpr2018.pdf|Unsupervised Label Learning on Manifolds by Spatially Regularized Geometric Assignment, GCPR 2018]]. + + **Geometric numerical integration.** We conducted a comprehensive study of //geometric integration//​ techniques, including automatic step size adaption, for numerically computing the assignment flow in a stable, efficient and parameter-free way. + * [[https://​ipa.math.uni-heidelberg.de/​dokuwiki/​Papers/​Zeilmann2018aa.pdf|Geometric Numerical Integration of the Assignment Flow, preprint: arXiv:​1810.06970]] + + **Evaluation of discrete graphical models.** We applied our approach to solve in a novel way the //MAP labeling problem// based on a given graphical model by smoothly combining a geometric reformulation of the local polytope relaxation with rounding to an integral solution. A key ingredient are local //​Wasserstein messages//'​ that couple local assignment measures along edges. + + * [[https://epubs.siam.org/doi/abs/10.1137/​17M1150669|Image Labeling Based on Graphical Models Using Wasserstein Messages and Geometric Assignment, SIAM J. on Imaging Science, 11/2 (2018) 1317--1362]] + + **Kick-off paper** that introduces the basic approach: + + * [[https://​ipa.math.uni-heidelberg.de/​dokuwiki/​Papers/​Astroem2017.pdf|Image Labeling by Assignment.,​ J. Math. Imag. Vision 58/2 (2017) 211--238]] * [[http://​www-rech.telecom-lille.fr/​diff-cv2016/​|Proceedings DIFF-CVML'​16;​ Grenander best paper award]] * [[http://​www-rech.telecom-lille.fr/​diff-cv2016/​|Proceedings DIFF-CVML'​16;​ Grenander best paper award]] * [[https://​ipa.iwr.uni-heidelberg.de/​dokuwiki/​Papers/​Astroem2016d.pdf|Proceedings ECCV'​16]] * [[https://​ipa.iwr.uni-heidelberg.de/​dokuwiki/​Papers/​Astroem2016d.pdf|Proceedings ECCV'​16]] Line 24: Line 41: [[research:​hflow:​start|Details]] [[research:​hflow:​start|Details]] - ===== Phase Transitions and Recovery of Cosparse Objects Through Limited Angle Tomography ===== - - Sampling patterns as used in industrial tomographical set-ups with limited numbers of projections fall short of the common assumptions (e.g.~restricted isometry property) underlying compressed sensing. In this project, we investigate the relation between the number of sufficient tomographic projections and the co-/​sparsity of volume functions for unique recovery of these functions from given projection data. We also investigate approaches to efficiently solve the corresponding large numerical optimization problem in the 3D case. - - - **Researchers**:​ Andreea Denitiu, Stefania Petra, Christoph Schnörr - - [[research:​tomography:​start|Details]] - - ===== Segmentation of Thin Fiber Structures in 3D Tomographical Data ===== - - Recognizing the microstructure of fiber reinforced polymers is a necessary prerequisite for inferring macroscopic material properties. This project aims to combine low-level image processing and stochastic models of fiber distributions in order to reliably segment fibers in noisy image data. A major aspect concerns variational methods for approximate inference in connection with set covering, Gibbs distributions and marked point processes. - - **Researchers**: ​ - Peter Markowsky, Tabea Zuber, Gabriele Steidl (TU Kaiserslautern),​ Christoph Schnörr Line 48: Line 50: Johannes Berger, Andreas Neufeld, Florian Becker, Frank Lenzen, Christoph Schnörr Johannes Berger, Andreas Neufeld, Florian Becker, Frank Lenzen, Christoph Schnörr - [[https://hciweb.iwr.uni-heidelberg.de/​node/2385|Details]] + Details: ​[[https://ipa.iwr.uni-heidelberg.de/​dokuwiki/Papers/​Berger2015a.pdf|Paper]] ===== Partial Optimality in MAP-MRF ===== ===== Partial Optimality in MAP-MRF ===== Line 55: Line 57: **Researchers**:​ Paul Swoboda, Bogdan Savchynskyy,​ Alexander Shekhovtsov,​ Jörg Hendrik Kappes, Christoph Schnörr\\ ​ **Researchers**:​ Paul Swoboda, Bogdan Savchynskyy,​ Alexander Shekhovtsov,​ Jörg Hendrik Kappes, Christoph Schnörr\\ ​ Details: ​ [[https://​ipa.iwr.uni-heidelberg.de/​dokuwiki/​Papers/​Swoboda2016.pdf|Paper]] Details: ​ [[https://​ipa.iwr.uni-heidelberg.de/​dokuwiki/​Papers/​Swoboda2016.pdf|Paper]] - ===== Context Specific Independence and Graphical Models ===== - - This projects focuses on the connections between the field of probabilistic graphical models and the family of models that are able to represent efficiently distributions in which Context Specific Independences (CSIs) appear (dependences that are not fixed but only happen given a certain "​context"​ state). Such models include And/Or graphs, Arithmetic Circuits, Sum-Product Networks, and others. - - These CSI models are more expressive than graphical models but they lack the compactness and the theoretical framework of the latter. By creating new connections between the two fields we aim to translate algorithms and methodologies from one to the other, thereby obtaining a compact representation of CSI enjoying the sound probabilistic framework of graphical models. - - A long-term objective is to better understand the properties of - deep learning architectures,​ in particular those with a probabilistic ​ - interpretation. - - **Researchers**:​ Mattia Desana, Christoph Schnörr