ZESS Lecture Series
24 September 2024, 14-15 h in PB-H 0103
Dr Sonali Agarwal (Big Data Analytics Lab, Indian Institute of Information Technology): "Addressing Uncertainties and Challenges in Big Data for Healthcare"
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
17 September 2024, 11-12 h in PB-H 0103
Dr Partha Das (University of Amsterdam): Physics based photometric invariance for image understanding
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
The physics for image formation is known: light from light sources get reflected (and absorbed) by an object and reaches the sensor. Inverting this process is called intrinsics image decomposition (IID). Deep learning-based approaches have shown remarkably good performance in inverting this phenomenon. However, they often utilize very large datasets and complicated loss functions. Further, most of the approaches rely purely on image features, ignoring the underlying physics of image formation, adding to the data requirement and failing under the presence of strong photometric effects. In this talk, I will discuss about how the physics of image formation can be exploited to simplify the problem and allowing the network to learn the underlying model, rather than memorising the dataset. I will talk about my work where I focus on utilizing such physics-based modifications to simplify the IID problem, resulting in smaller networks that are trained on much smaller, purely synthetic datasets, while being generalisable to unseen real-world scenes.
Partha Das holds a PhD from the Computer Vision Lab under the Informatics Institute of the University of Amsterdam. He was supervised by Prof Theo Gevers and Dr Sezer Karaoglu. His research interests are in physics based image understanding, using deep learning & traditional approaches. Specifically, tasks like image formation, light estimation and colour correction, etc. He is interested in levying these approaches to build efficient & stable AR/VR/Mixed Reality systems.
26 August 2024, 14-15 h in H-C 7327
Ilya Chugunov (Princeton University): Neural Field Representations of Mobile Computational Photography
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
Burst imaging pipelines allow cellphones to compensate for less-than-ideal optical and sensor hardware by computationally merging multiple lower-quality images into a single high-quality output. The main challenge for these pipelines is compensating for pixel motion, estimating how to align and merge measurements across time while the user's natural hand tremor involuntarily shakes the camera. In this work, we explore continuous projective models of burst photography, backed by multi-resolution neural field representations, and fit to real in-the-wild mobile burst captures. These task-specific models not only estimate and compensate for pixel motion, but use it as a powerful source of geometric information to estimate scene depth, see behind occlusions, separate reflections, and erase photographer-cast shadows.
Ilya Chugunov is a PhD candidate in the Princeton Computational Imaging Lab, advised by Professor Felix Heide. His work focuses on neural field representations for inverse imaging problems, depth reconstruction, and computational photography. He received his bachelor's in electrical engineering and computer science from UC Berkeley, where he worked on low-rank reconstruction methods for magnetic resonance imaging with Professors Moriel Vandsburger and Miki Lustig. Ilya is an NSF graduate research fellow.
23 April 2024, 13-14 h in PB-H 0103
Dr Manuel Dietrich (Honda Research Institute Europe): Designing AI-powered technologies to align with social norms in human environments
AI-powered systems navigating everyday human environments can pose challenges to individual’s ethical and social values, presenting particular issues, when systems act upon their own initiative without strong oversight. In my talk, I will focus on research in two distinct areas of technological development where system design has been shaped by human values. Firstly, I will present research in the area of semi-automated driving investigating how distributive fairness principles can be applied to “normal” driving behavior selection, aiming to ensure equitable outcomes for all road users. Secondly, I will present research in the field of robotic mediators where robots take a pro-active role in facilitating interactions among humans. To be accepted in human spaces, they need to be trusted to handle personal information adequately, not only adhering to security and data protection laws, but also aligning with contextual norms. I will discuss user expectation and to what extent robots are capable to comprehend informational norms and act accordingly.
29 April 2024, 16-18 h in PB-H 0103
Prof Onofre Martorell (University of the Balearic Islands): Joint fusion and denoising for multi-exposure sequences
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
Sequences of images taken with different exposure time can be combined by both multi-exposure fusion (MEF) or high dynamic range (HDR) techniques. In both cases, information from all images of a sequence is combined in order to get an image with a higher amount of details on all areas of the selected reference image. This combination of information can also be used in combination with techniques so as to remove the existing noise on the images. In this presentation we will present two different techniques for joint multi-exposure sequence and denoising which exploit the redundancy of similar patches. The first one is a MEF technique for static images and the second one is a HDR technique applied on RAW data which is able to deal with ghosting artifacts.
14 March 202, 14-15 h in H-C 7327
Anna Kukleva (MPI Saarbrücken): Advancing Image and Video Recognition with Less Supervision
Deep learning has become an essential component of modern life, transforming various tasks across multiple domains such as entertainment, education, and autonomous driving. However, the increasing demand for data to train models for emerging tasks poses significant challenges. Deep learning models heavily rely on high-quality labeled datasets, yet obtaining comprehensive supervision is resource-intensive and can introduce biases. Therefore, this talk explores strategies to mitigate the need for full supervision and reduce data acquisition costs. The first part of the discussion focuses on self-supervised and unsupervised learning methods, which enable learning without explicit labels by leveraging inherent data structures and injecting prior knowledge for robust data representations. The second part of the presentation discusses strategies such as minimizing precise annotations in multimodal learning, allowing for effective utilization of correlated information across different modalities. Moreover, we discuss open-world scenarios, proposing novel setup and method to adapt vision-language models to the new domains. Overall, this research contributes to understanding learning dynamics and biases present in data, advancing training methods that require less supervision.
21 March 2024, 14-15 h in H-C 7327
Dr Simone Schaub-Meyer (TU Darmstadt): Efficient and Understandable Neural Networks for Image and Video Analysis
Recent developments in deep learning have led to significant advances in many areas of computer vision. However, the success of these methods often depends on having a well-defined task corresponding training data, and measuring success by improved task specific accuracy. However, in order to apply new methods in the real world, other aspects become relevant as well, such as required labelled data, computational requirements, as well as, especially in safety critical scenarios, how trust worthy a model is.
In my talk, I will first discuss how motion in videos can be used to learn representations in an unsupervised way as well as methods to efficiently handle higher resolution data. In the second part, I will show how attribution maps, which help to gain a better understanding of the predictions, can be obtained efficiently, as well as how we can evaluate them.
25 March 2024, 14-15 h in H-C 7327
Dr Alexandra Diehl (ETH Zurich): Visualization Research for Characterization of High Impact Weather Events (HIWE)
-- The talk will be held at a later date. --
The efficient analysis, decision making, and communication of high-impact weather events (HIWE) and their associated risks is a challenging and ongoing research topic for meteorologists and computer scientists. The challenge is due, in part, to the inherent unpredictability of weather and the difficulty of quantifying its risk and communicating its uncertainties.
In this talk, I will summarize my recent contributions to the research on efficient visualization tools for the analysis and communication of weather forecasts and the characterization of HIWEs. I will also present my current efforts in citizen data analysis and discuss the open challenges for efficient communication of severe weather events through citizen participatory science.
26 March 2024, 13-14 h in H-C 7327
Dr Jing Ren (ETH Zurich): Shape matching and map space exploration via functional maps
Computing semantically meaningful correspondences between shapes is an important yet challenging task in computer graphics and geometry processing, with a wide range of applications including deformation, motion, and texture transfer , as well as 3D shape retrieval, shape analysis and exploration, among others. The functional map framework emerges as a powerful solution to this shape matching problem. Rather than directly attempting to establish point-wise correspondences, it operates by matching functions defined on shapes.
This presentation delves into techniques build upon functional map framework. Specifically, we will explore (1) how to design various regularizers to resolve orientation ambiguity or promote matching accuracy; (2) how to refine a given point-wise map effectively and efficiently; (3) and how to formulate and structure the map space to explore all possible high-quality maps between a shape pair.
4 March 2024, 17.30-18.30 h at US-C 105
Prof Matthias Uhl (TH Ingolstadt): Behavioral Ethics of Artificial Intelligence
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
Behavioral ethics deviates from armchair philosophy by systematically incorporating the moral concepts and intuitions of laypeople. In his talk, Prof Uhl will discuss behavioral approaches to questions from two different subfields of the ethics of AI: machine ethics and human-machine ethics. In machine ethics, he will consider the problem of algorithm aversion and folk attitudes regarding the use of AI. In human-machine ethics, he considers the influence that the use of AI has on people’s moral behavior. He will present some exemplary research projects from each subfield.
Matthias Uhl is professor of Societal Implications and Ethical Aspects of Artificial Intelligence at Technische Hochschule Ingolstadt. Before this, he was a research associate at the Peter Löscher Chair of Business Ethics (TU München) and Leader of Junior Research Group Ethics of Digitization (TUM School of Governance, TU München). His PhD thesis from Max Planck Institute of Economics and Friedrich Schiller University Jena is on Multiple Selves in Economics - Four Studies on Intrapersonal Conflict is in Economics and his research focuses on the ethical implications of digitization, especially human-machine interaction, moral intuitions regarding the use of algorithms, and polarization tendencies through social media. He regularly gives lectures in the ethics of technology, business ethics and behavioral economics.
7 November 2023 - 30 January 2024 in PB-A 118
Prof Peter Kraemer with Wölfel Engineering and Alstom: Lectures on Structural Health Monitoring
30 January 2024, 16.00 h in PB-A 118 Dr Yan Niu, Alstom: Bogie Health Monitoring Using Acoustic Data
23 January 2024, 16.00 h in PB-A 118 Dr Manuel Eckstein, Wölfel Engineering: Mechatronics in Industry - Active Vibration Control for Renewables & Wind Energy
12 December 2023, 16.00 h in PB-A 118 Dr Carles Colomer, Wölfel Engineering: Structural Health Monitoring in Wind Energy III - Offshore Wind Foundations
21 November 2023, 16.00 h in PB-A 118 Dr Carles Colomer, Wölfel Engineering: Structural Health Monitoring in Wind Energy II: Rotor Blades
7. November 2023, 16.00 h in PB-A 118 MSc. Bernhard Huber, Wölfel Engineering: Structural Health Monitoring in Wind Energy I - Machine Learning Applications from a Practical Perspective
| |
27 October 2023, 14-15 h at PB-H 0103
Dr Onofre Matorell: Variational models for High Dynamic Range Video
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
High Dynamic Range (HDR) reconstruction for multi-exposure video sequences is a very challenging task. Consecutive frames are acquired with alternate exposures times, generally only two or three different values. Generally, HDR video methods aim at registering neighboring frames and fuse them using image HDR techniques. In this talk we will present variational models for both main steps of HDR video synthesis. On one hand, a model for optical flow estimation which incorporates a comparison of non-consecutive images and temporal regularization. On the other hand, a model for HDR video synthesis that uses a nonlocal regularization term to combine pixel information from neighboring frames.
Onofre Martorell belongs to the research group of Mathematical Analysis and Processing of Images (TAMI) at the University of the Balearic Islands and is a visiting postdoctoral researcher with the DFG research unit “Learning to Sense” (L2S). His research areas are computer vision and mathematical digital image processing and, more specifically, on the detection of geometrical structures in images and registration of multi-exposure images.
14 August 2023, 13-14 h in H-C 7327
Dr Rajiv Joshi (T. J. Watson Research Center, IBM): Variability Aware Design in nm Era
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
As the technology scales, process, voltage, and temperature, variations (PVT) and model inaccuracies impact design yield. In this talk, a predictive analytical technique based on statistical analysis methodology targeting both memory and custom logic design applications is highlighted. The methodology hinges on Mixture Important Sampling (MIS) is 5-6 orders of magnitude faster than Monte Carlo and a few orders compared to recent techniques. For advanced technologies, we extend the methodology to enable key features such as the Front End of the Line (FEOL) and back end of the line (BEOL) parasitic extraction and TCAD for manufacturability for 16nm and below. This increases the statistical confidence in the functionality and operability of the system- on-chip as a whole. The methodology is further extended to predict aging effects in memories and the utility of this technique is demonstrated through hardware fabrication.
Rajiv Joshi is a Mercator fellow at L2S. He holds a masters from MIT, doctorate from Columbia and has worked in IBM for almost 40 years now. His primary research has been in memory and recently big data analytics. He is also one of the drivers behind AI in Circuits and Systems conference.
17 July 2023, 11-12 h in H-C 7327
Jérome Eertmans (UC Louvain): Differentiable Ray Tracing for Telecommunications
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
Over the last few decades, ray tracing (RT) has established itself as the method of choice for everything to do with modelling wave propagation. Telecoms being no exception, it's common practice to model the transmission channel using RT software. Although RT offers remarkable accuracy, its computational time cost raises many questions, not least that of differentiability.This presentation discusses ray tracing and its applications in telecoms, as well as mathematical tools for making RT differentiable.
Jérome Eertmans is a PhD student working at UCLouvain within COmmunication SYstems (COSY) group. His research topic is Differentiable Ray Tracing for Telecommunications.
5 July 2023, 14-15 h in H-C 7327
Jovita Lukasik (MPI for Informatics Saarbrücken): Topology Learning for Prediction, Generation, and Robustness in Neural Architecture Search
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
Jovita Lukasik is a Ph.D. candidate in the focus group of Computer Vision in the Data and Web Science Group and in the computer vision and machine learning group at the Max-Planck-Institute for Informatics in Saarbrücken.
7 June 2023, 11-12 h in H-C 7327
Jack Naylor (Sydney University Robotic Imaging Lab): Through the Looking Glass - Neural Fields for Robotics
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
Robotic imaging is an emergent field which seeks to synthesize concepts across computational imaging and robotics to create new cameras and algorithms in aid of extending robotic capabilities. Unconventional camera technologies including plenoptic, neuromorphic and hyperspectral cameras enable robotic platforms to deal with unique scenarios and environments, however they provide information which requires additional interpretation and are not suited to all robotic tasks. This talk will provide an overview of recent work towards auto-interpretation of new cameras on-board robotic platforms using neural interpretation of scenes, and regularisation of neural radiance fields to improve scene representation for robotics around complex visual phenomena.
Jack Naylor is a PhD candidate with the Australian Centre for Robotics at the University of Sydney where he also majored in Space Engineering and Physics. His research seeks to adapt neural representations of light, in the form of neural radiance fields (NeRFs), as a new robotic map representation to enable understanding of complex visual phenomena in unstructured environments.
31 May 2023, 10-11 h in H-C 7327
Dr John Meshreki (University of Siegen): Modelling Vignetting in Fourier Ptychographic Microscopy
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
John Meshreki completed his masters and PhD in Experimental Particle Physics with the ATLAS experiment at CERN. After his PhD, he started investigating a new research area which has innovative applications in Biology – bringing improvements to the quality of people’s lives – that is Computational Microscopy.
24 May 2023, 13-14 h in H-C 7327
Prof Wolfgang Heidrich (KAUST):Learned Optics — Improving Computational Imaging Systems through Deep Learning and Optimization
The talk is part of the ZESS lecture series and hosted by the DFG research unit "Learning to Sense” (L2S).
Computational imaging systems are based on the joint design of optics andassociated image reconstruction algorithms. Historically, many such systemshave employed simple transform-based reconstruction methods. Modernoptimization methods and priors can drastically improve the reconstructionquality in computational imaging systems. Furthermore, learning-basedmethods can be used to design the optics along with the reconstructionmethod, yielding truly end-to-end optimized imaging systems that outperformclassical solutions.
Wolfgang Heidrich is a Mercator fellow at L2S and Professor at the King Abdullah University of Science and Technology (KAUST) in Saudi Arabia. Wolfgang Heidrich is a Professor of Computer Science and Electrical and Computer Engineering in the KAUST Visual Computing Center, for which he alsoserved as director from 2014 to 2021. He received his PhD infrom the University of Erlangen in 1999, and then worked as a ResearchAssociate in the Computer Graphics Group of the Max-Planck-Institute for Computer Science in Saarbrucken, Germany, before joining UBC in 2000. Prof.Heidrich's research interests lie at the intersection of imaging, optics,computer vision, computer graphics, and inverse problems. His more recent interest is in computational imaging, focusing on hardware-software co-design of the next generation of imaging systems, with applications such as High-Dynamic Range imaging, compact computational cameras, and hyperspectral cameras. Prof. Heidrich's work on High Dynamic Range Displays served as the basis for the technology behind Brightside Technologies, which was acquired by Dolby in 2007. Prof. Heidrich is aFellow of the IEEE and Eurographics, and the recipient of a Humboldt Research Award.