Publications | Empirical Inference - Max Planck Institute for Intelligent Systems

Stimper, V. Advancing Normalising Flows to Model Boltzmann Distributions University of Cambridge, UK, Cambridge, June 2024, (Cambridge-Tübingen-Fellowship-Program) (phdthesis)

[BibTex]

Language Models Can Reduce Asymmetry in Information Markets

Rahaman, N., Weiss, M., Wüthrich, M., Bengio, Y., Li, E., Pal, C., Schölkopf, B.

arXiv:2403.14443, March 2024, Published as: Redesigning Information Markets in the Era of Language Models, Conference on Language Modeling (COLM) (techreport)

Abstract

This work addresses the buyer's inspection paradox for information markets. The paradox is that buyers need to access information to determine its value, while sellers need to limit access to prevent theft. To study this, we introduce an open-source simulated digital marketplace where intelligent agents, powered by language models, buy and sell information on behalf of external participants. The central mechanism enabling this marketplace is the agents' dual capabilities: they not only have the capacity to assess the quality of privileged information but also come equipped with the ability to forget. This ability to induce amnesia allows vendors to grant temporary access to proprietary information, significantly reducing the risk of unauthorized retention while enabling agents to accurately gauge the information's relevance to specific queries or tasks. To perform well, agents must make rational decisions, strategically explore the marketplace through generated sub-queries, and synthesize answers from purchased information. Concretely, our experiments (a) uncover biases in language models leading to irrational behavior and evaluate techniques to mitigate these biases, (b) investigate how price affects demand in the context of informational goods, and (c) show that inspection and higher budgets both lead to higher quality outcomes.

link (url) [BibTex]

Rahaman, N., Weiss, M., Wüthrich, M., Bengio, Y., Li, E., Pal, C., Schölkopf, B. Language Models Can Reduce Asymmetry in Information Markets arXiv:2403.14443, March 2024, Published as: Redesigning Information Markets in the Era of Language Models, Conference on Language Modeling (COLM) (techreport)

link (url) [BibTex]

Interpreting How Large Language Models Handle Facts and Counterfactuals through Mechanistic Interpretability

Ortu, F.

University of Trieste, Italy, March 2024 (mastersthesis)

[BibTex]

Ortu, F. Interpreting How Large Language Models Handle Facts and Counterfactuals through Mechanistic Interpretability University of Trieste, Italy, March 2024 (mastersthesis)

[BibTex]

Identifiable Causal Representation Learning

von Kügelgen, J.

University of Cambridge, UK, Cambridge, February 2024, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

von Kügelgen, J. Identifiable Causal Representation Learning University of Cambridge, UK, Cambridge, February 2024, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

2023

Denoising Representation Learning for Causal Discovery

Sakenyte, U.

Université de Genèva, Switzerland, December 2023, external supervision (mastersthesis)

[BibTex]

2023

Sakenyte, U. Denoising Representation Learning for Causal Discovery Université de Genèva, Switzerland, December 2023, external supervision (mastersthesis)

[BibTex]

Navigating the Ocean of Biases: Political Bias Attribution in Language Models via Causal Structures

Jenny, D.

ETH Zurich, Switzerland, November 2023, external supervision (thesis)

[BibTex]

Jenny, D. Navigating the Ocean of Biases: Political Bias Attribution in Language Models via Causal Structures ETH Zurich, Switzerland, November 2023, external supervision (thesis)

[BibTex]

Efficient Sampling from Differentiable Matrix Elements

Kofler, A.

Technical University of Munich, Germany, September 2023 (mastersthesis)

[BibTex]

Kofler, A. Efficient Sampling from Differentiable Matrix Elements Technical University of Munich, Germany, September 2023 (mastersthesis)

[BibTex]

Advances in Algorithmic Recourse: Ensuring Causal Consistency, Fairness, & Robustness

Karimi, A.

ETH Zurich, Switzerland, July 2023 (phdthesis)

[BibTex]

Karimi, A. Advances in Algorithmic Recourse: Ensuring Causal Consistency, Fairness, & Robustness ETH Zurich, Switzerland, July 2023 (phdthesis)

[BibTex]

Learning and Testing Powerful Hypotheses

Kübler, J. M.

University of Tübingen, Germany, July 2023 (phdthesis)

[BibTex]

Kübler, J. M. Learning and Testing Powerful Hypotheses University of Tübingen, Germany, July 2023 (phdthesis)

[BibTex]

Learning Identifiable Representations: Independent Influences and Multiple Views

Gresele, L.

University of Tübingen, Germany, June 2023 (phdthesis)

[BibTex]

Gresele, L. Learning Identifiable Representations: Independent Influences and Multiple Views University of Tübingen, Germany, June 2023 (phdthesis)

[BibTex]

Learning with and for discrete optimization

Paulus, M.

ETH Zurich, Switzerland, May 2023, CLS PhD Program (phdthesis)

[BibTex]

Paulus, M. Learning with and for discrete optimization ETH Zurich, Switzerland, May 2023, CLS PhD Program (phdthesis)

[BibTex]

Intrinsic complexity and mechanisms of expressivity of cortical neurons

Spieler, A. M.

University of Tübingen, Germany, March 2023 (mastersthesis)

[BibTex]

Spieler, A. M. Intrinsic complexity and mechanisms of expressivity of cortical neurons University of Tübingen, Germany, March 2023 (mastersthesis)

[BibTex]

CausalEffect Estimation by Combining Observational and Interventional Data

Kladny, K.

ETH Zurich, Switzerland, February 2023 (mastersthesis)

[BibTex]

Kladny, K. CausalEffect Estimation by Combining Observational and Interventional Data ETH Zurich, Switzerland, February 2023 (mastersthesis)

[BibTex]

Towards Generative Machine Teaching

Qui, Z.

Technical University of Munich, Germany, February 2023 (mastersthesis)

[BibTex]

Qui, Z. Towards Generative Machine Teaching Technical University of Munich, Germany, February 2023 (mastersthesis)

[BibTex]

ArchiSound: Audio Generation with Diffusion

Schneider, F.

ETH Zurich, Switzerland, January 2023, external supervision (mastersthesis)

[BibTex]

Schneider, F. ArchiSound: Audio Generation with Diffusion ETH Zurich, Switzerland, January 2023, external supervision (mastersthesis)

[BibTex]

Generation and Quantification of Spin in Robot Table Tennis

Dittrich, A.

University of Stuttgart, Germany, January 2023 (mastersthesis)

[BibTex]

Dittrich, A. Generation and Quantification of Spin in Robot Table Tennis University of Stuttgart, Germany, January 2023 (mastersthesis)

[BibTex]

Synchronizing Machine Learning Algorithms, Realtime Robotic Control and Simulated Environment with o80

Berenz, V., Widmaier, F., Guist, S., Schölkopf, B., Büchler, D.

Robot Software Architectures Workshop (RSA) 2023, ICRA, 2023 (techreport)

Abstract

Robotic applications require the integration of various modalities, encompassing perception, control of real robots and possibly the control of simulated environments. While the state-of-the-art robotic software solutions such as ROS 2 provide most of the required features, flexible synchronization between algorithms, data streams and control loops can be tedious. o80 is a versatile C++ framework for robotics which provides a shared memory model and a command framework for real-time critical systems. It enables expert users to set up complex robotic systems and generate Python bindings for scientists. o80's unique feature is its flexible synchronization between processes, including the traditional blocking commands and the novel ``bursting mode'', which allows user code to control the execution of the lower process control loop. This makes it particularly useful for setups that mix real and simulated environments.

arxiv poster link (url) [BibTex]

Berenz, V., Widmaier, F., Guist, S., Schölkopf, B., Büchler, D. Synchronizing Machine Learning Algorithms, Realtime Robotic Control and Simulated Environment with o80 Robot Software Architectures Workshop (RSA) 2023, ICRA, 2023 (techreport)

arxiv poster link (url) [BibTex]

2022

Proceedings of the Second Workshop on NLP for Positive Impact (NLP4PI)

Biester, L., Demszky, D., Jin, Z., Sachan, M., Tetreault, J., Wilson, S., Xiao, L., Zhao, J.

Association for Computational Linguistics, December 2022 (proceedings)

link (url) [BibTex]

2022

Biester, L., Demszky, D., Jin, Z., Sachan, M., Tetreault, J., Wilson, S., Xiao, L., Zhao, J. Proceedings of the Second Workshop on NLP for Positive Impact (NLP4PI) Association for Computational Linguistics, December 2022 (proceedings)

link (url) [BibTex]

Towards learning mechanistic models at the right level of abstraction

Neitz, A.

University of Tübingen, Germany, November 2022 (phdthesis)

[BibTex]

Neitz, A. Towards learning mechanistic models at the right level of abstraction University of Tübingen, Germany, November 2022 (phdthesis)

[BibTex]

Learning Causal Representations for Generalization and Adaptation in Supervised, Imitation, and Reinforcement Learning

Lu, C.

University of Cambridge, UK, Cambridge, October 2022, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Lu, C. Learning Causal Representations for Generalization and Adaptation in Supervised, Imitation, and Reinforcement Learning University of Cambridge, UK, Cambridge, October 2022, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Investigating Independent Mechanisms in Neural Networks

Liang, W.

Université Paris-Saclay, France, October 2022 (mastersthesis)

[BibTex]

Liang, W. Investigating Independent Mechanisms in Neural Networks Université Paris-Saclay, France, October 2022 (mastersthesis)

[BibTex]

Modeling subgroup differences in fMRI data: disentangling subgroup-specific responses from shared ones

Keidar, D.

ETH Zurich, Switzerland, October 2022 (mastersthesis)

[BibTex]

Keidar, D. Modeling subgroup differences in fMRI data: disentangling subgroup-specific responses from shared ones ETH Zurich, Switzerland, October 2022 (mastersthesis)

[BibTex]

Learning Time-Continuous Dynamics Models with Gaussian-Process-Based Gradient Matching

Wenk, P.

ETH Zurich, Switzerland, October 2022, CLS PhD Program (phdthesis)

[BibTex]

Wenk, P. Learning Time-Continuous Dynamics Models with Gaussian-Process-Based Gradient Matching ETH Zurich, Switzerland, October 2022, CLS PhD Program (phdthesis)

[BibTex]

Multi-Target Multi-Object Manipulation using Relational Deep Reinforcement Learning

Feil, M.

Technnical University Munich, Germany, September 2022 (mastersthesis)

[BibTex]

Feil, M. Multi-Target Multi-Object Manipulation using Relational Deep Reinforcement Learning Technnical University Munich, Germany, September 2022 (mastersthesis)

[BibTex]

Independent Mechanism Analysis for High Dimensions

Sliwa, J.

University of Tübingen, Germany, September 2022, (Graduate Training Centre of Neuroscience) (mastersthesis)

[BibTex]

Sliwa, J. Independent Mechanism Analysis for High Dimensions University of Tübingen, Germany, September 2022, (Graduate Training Centre of Neuroscience) (mastersthesis)

[BibTex]

Methods for Minimizing the Spread of Misinformation on the Web

Tabibian, B.

University of Tübingen, Germany, September 2022 (phdthesis)

[BibTex]

Tabibian, B. Methods for Minimizing the Spread of Misinformation on the Web University of Tübingen, Germany, September 2022 (phdthesis)

[BibTex]

On the Adversarial Robustness of Causal Algorithmic Recourse

Dominguez-Olmedo, R.

University of Tübingen, Germany, August 2022 (mastersthesis)

[BibTex]

Dominguez-Olmedo, R. On the Adversarial Robustness of Causal Algorithmic Recourse University of Tübingen, Germany, August 2022 (mastersthesis)

[BibTex]

Learning and Using Causal Knowledge: A Further Step Towards a Higher-Level Intelligence

Huang, B.

Carnegie Mellon University, Pittsburgh, USA, July 2022 (phdthesis)

[BibTex]

Huang, B. Learning and Using Causal Knowledge: A Further Step Towards a Higher-Level Intelligence Carnegie Mellon University, Pittsburgh, USA, July 2022 (phdthesis)

[BibTex]

Learning and Using Causal Knowledge: A Further Step Towards a Higher-Level Intelligence

Huang, B.

Carnegie Mellon University, July 2022, external supervision (phdthesis)

[BibTex]

Huang, B. Learning and Using Causal Knowledge: A Further Step Towards a Higher-Level Intelligence Carnegie Mellon University, July 2022, external supervision (phdthesis)

[BibTex]

Independent Mechanism Analysis in High-Dimensional Observation Spaces

Ghosh, S.

ETH Zurich, Switzerland, June 2022 (mastersthesis)

[BibTex]

Ghosh, S. Independent Mechanism Analysis in High-Dimensional Observation Spaces ETH Zurich, Switzerland, June 2022 (mastersthesis)

[BibTex]

Proceedings of the First Conference on Causal Learning and Reasoning (CLeaR 2022)

Schölkopf, B., Uhler, C., Zhang, K.

177, Proceedings of Machine Learning Research, PMLR, April 2022 (proceedings)

link (url) [BibTex]

Schölkopf, B., Uhler, C., Zhang, K. Proceedings of the First Conference on Causal Learning and Reasoning (CLeaR 2022) 177, Proceedings of Machine Learning Research, PMLR, April 2022 (proceedings)

link (url) [BibTex]

Variational Inference in Dynamical Systems

Ialongo, A.

University of Cambridge, UK, Cambridge, February 2022, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Ialongo, A. Variational Inference in Dynamical Systems University of Cambridge, UK, Cambridge, February 2022, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

2021

Learning Neural Causal Models with Active Interventions

Scherrer, N.

ETH Zurich, Switzerland, November 2021 (mastersthesis)

[BibTex]

2021

Scherrer, N. Learning Neural Causal Models with Active Interventions ETH Zurich, Switzerland, November 2021 (mastersthesis)

[BibTex]

HealthGen: Conditional Generation of Realistic Medical Time Series with Informative Missingness

Bing, S.

ETH Zurich, Switzerland, October 2021 (mastersthesis)

[BibTex]

Bing, S. HealthGen: Conditional Generation of Realistic Medical Time Series with Informative Missingness ETH Zurich, Switzerland, October 2021 (mastersthesis)

[BibTex]

Study of the Interventional Consistency of Autoencoders

Lanzillotta, G.

ETH Zurich, Switzerland, October 2021 (mastersthesis)

[BibTex]

Lanzillotta, G. Study of the Interventional Consistency of Autoencoders ETH Zurich, Switzerland, October 2021 (mastersthesis)

[BibTex]

Training with Few to Manipulate Many. On OOD generalization in relational reinforcement learning

Mambelli, D.

ETH Zurich, Switzerland, October 2021 (mastersthesis)

[BibTex]

Mambelli, D. Training with Few to Manipulate Many. On OOD generalization in relational reinforcement learning ETH Zurich, Switzerland, October 2021 (mastersthesis)

[BibTex]

Dynamics of Learning and Learning of Dynamics

Mehrjou, A.

ETH Zürich, Zürich, October 2021 (phdthesis)

DOI [BibTex]

Mehrjou, A. Dynamics of Learning and Learning of Dynamics ETH Zürich, Zürich, October 2021 (phdthesis)

DOI [BibTex]

A Large Scale Brain-Computer Interface for Patients with Neurological Diseases

Hohmann, M.

University of Tübingen, Germany, September 2021 (phdthesis)

[BibTex]

Hohmann, M. A Large Scale Brain-Computer Interface for Patients with Neurological Diseases University of Tübingen, Germany, September 2021 (phdthesis)

[BibTex]

Deep Learning Beyond The Training Distribution

Parascandolo, G.

ETH Zürich, Switzerland, Zürich, September 2021, (CLS Fellowship Program) (phdthesis)

DOI [BibTex]

Parascandolo, G. Deep Learning Beyond The Training Distribution ETH Zürich, Switzerland, Zürich, September 2021, (CLS Fellowship Program) (phdthesis)

DOI [BibTex]

Proceedings of the 1st Workshop on NLP for Positive Impact

Field, A., Prabhumoye, S., Sap, M., Jin, Z., Zhao, J., Brockett, C.

Association for Computational Linguistics, August 2021 (proceedings)

link (url) [BibTex]

Field, A., Prabhumoye, S., Sap, M., Jin, Z., Zhao, J., Brockett, C. Proceedings of the 1st Workshop on NLP for Positive Impact Association for Computational Linguistics, August 2021 (proceedings)

link (url) [BibTex]

Optimization Algorithms for Machine Learning

Raj, A.

University of Tübingen, Germany, June 2021 (phdthesis)

[BibTex]

Raj, A. Optimization Algorithms for Machine Learning University of Tübingen, Germany, June 2021 (phdthesis)

[BibTex]

Causal Inference in Vision

Meding, K.

Eberhard Karls Universität Tübingen, Tübingen, June 2021 (phdthesis)

[BibTex]

Meding, K. Causal Inference in Vision Eberhard Karls Universität Tübingen, Tübingen, June 2021 (phdthesis)

[BibTex]

Machine Learning Methods for Modeling Synthesizable Molecules

Bradshaw, J.

University of Cambridge, UK, Cambridge, April 2021, (Cambridge-Tübingen-Fellowship) (phdthesis)

DOI [BibTex]

Bradshaw, J. Machine Learning Methods for Modeling Synthesizable Molecules University of Cambridge, UK, Cambridge, April 2021, (Cambridge-Tübingen-Fellowship) (phdthesis)

DOI [BibTex]

Reinforcement Learning Algorithms: Analysis and Applications

Belousov, B., H., A., Klink, P., Parisi, S., Peters, J.

883, Studies in Computational Intelligence, Springer International Publishing, 2021 (book)

DOI [BibTex]

Belousov, B., H., A., Klink, P., Parisi, S., Peters, J. Reinforcement Learning Algorithms: Analysis and Applications 883, Studies in Computational Intelligence, Springer International Publishing, 2021 (book)

DOI [BibTex]

Scientific Report 2016 - 2021

2021 (mpi_year_book)

Abstract

This report presents research done at the Max Planck Institute for Intelligent Systems from January2016 to November 2021. It is our fourth report since the founding of the institute in 2011. Dueto the fact that the upcoming evaluation is an extended one, the report covers a longer reportingperiod.This scientific report is organized as follows: we begin with an overview of the institute, includingan outline of its structure, an introduction of our latest research departments, and a presentationof our main collaborative initiatives and activities (Chapter1). The central part of the scientificreport consists of chapters on the research conducted by the institute’s departments (Chapters2to6) and its independent research groups (Chapters7 to24), as well as the work of the institute’scentral scientific facilities (Chapter25). For entities founded after January 2016, the respectivereport sections cover work done from the date of the establishment of the department, group, orfacility. These chapters are followed by a summary of selected outreach activities and scientificevents hosted by the institute (Chapter26). The scientific publications of the featured departmentsand research groups published during the 6-year review period complete this scientific report.

Scientific Report 2016 - 2021 [BibTex]