Publications | Empirical Inference - Max Planck Institute for Intelligent Systems

Stimper, V. Advancing Normalising Flows to Model Boltzmann Distributions University of Cambridge, UK, Cambridge, June 2024, (Cambridge-Tübingen-Fellowship-Program) (phdthesis)

[BibTex]

LFP transient events in macaque subcortical areas reveal network coordination across scales and structures: a simultaneous fMRI-electrophysiology study

Besserve, M., Safavi, S., Schölkopf, B., Logothetis, N.

Computational and Systems Neuroscience Meeting (COSYNE), March 2024 (poster)

link (url) [BibTex]

Besserve, M., Safavi, S., Schölkopf, B., Logothetis, N. LFP transient events in macaque subcortical areas reveal network coordination across scales and structures: a simultaneous fMRI-electrophysiology study Computational and Systems Neuroscience Meeting (COSYNE), March 2024 (poster)

link (url) [BibTex]

Language Models Can Reduce Asymmetry in Information Markets

Rahaman, N., Weiss, M., Wüthrich, M., Bengio, Y., Li, E., Pal, C., Schölkopf, B.

arXiv:2403.14443, March 2024, Published as: Redesigning Information Markets in the Era of Language Models, Conference on Language Modeling (COLM) (techreport)

Abstract

This work addresses the buyer's inspection paradox for information markets. The paradox is that buyers need to access information to determine its value, while sellers need to limit access to prevent theft. To study this, we introduce an open-source simulated digital marketplace where intelligent agents, powered by language models, buy and sell information on behalf of external participants. The central mechanism enabling this marketplace is the agents' dual capabilities: they not only have the capacity to assess the quality of privileged information but also come equipped with the ability to forget. This ability to induce amnesia allows vendors to grant temporary access to proprietary information, significantly reducing the risk of unauthorized retention while enabling agents to accurately gauge the information's relevance to specific queries or tasks. To perform well, agents must make rational decisions, strategically explore the marketplace through generated sub-queries, and synthesize answers from purchased information. Concretely, our experiments (a) uncover biases in language models leading to irrational behavior and evaluate techniques to mitigate these biases, (b) investigate how price affects demand in the context of informational goods, and (c) show that inspection and higher budgets both lead to higher quality outcomes.

link (url) [BibTex]

Rahaman, N., Weiss, M., Wüthrich, M., Bengio, Y., Li, E., Pal, C., Schölkopf, B. Language Models Can Reduce Asymmetry in Information Markets arXiv:2403.14443, March 2024, Published as: Redesigning Information Markets in the Era of Language Models, Conference on Language Modeling (COLM) (techreport)

link (url) [BibTex]

Koopman Spectral Analysis Uncovers the Temporal Structure of Spontaneous Neural Events

Shao, K., Xu, Y., Logothetis, N., Shen, Z., Besserve, M.

Computational and Systems Neuroscience Meeting (COSYNE), March 2024 (poster)

link (url) [BibTex]

Shao, K., Xu, Y., Logothetis, N., Shen, Z., Besserve, M. Koopman Spectral Analysis Uncovers the Temporal Structure of Spontaneous Neural Events Computational and Systems Neuroscience Meeting (COSYNE), March 2024 (poster)

link (url) [BibTex]

Identifiable Causal Representation Learning

von Kügelgen, J.

University of Cambridge, UK, Cambridge, February 2024, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

von Kügelgen, J. Identifiable Causal Representation Learning University of Cambridge, UK, Cambridge, February 2024, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

2023

Navigating the Ocean of Biases: Political Bias Attribution in Language Models via Causal Structures

Jenny, D.

ETH Zurich, Switzerland, November 2023, external supervision (thesis)

[BibTex]

2023

Jenny, D. Navigating the Ocean of Biases: Political Bias Attribution in Language Models via Causal Structures ETH Zurich, Switzerland, November 2023, external supervision (thesis)

[BibTex]

Advances in Algorithmic Recourse: Ensuring Causal Consistency, Fairness, & Robustness

Karimi, A.

ETH Zurich, Switzerland, July 2023 (phdthesis)

[BibTex]

Karimi, A. Advances in Algorithmic Recourse: Ensuring Causal Consistency, Fairness, & Robustness ETH Zurich, Switzerland, July 2023 (phdthesis)

[BibTex]

Learning and Testing Powerful Hypotheses

Kübler, J. M.

University of Tübingen, Germany, July 2023 (phdthesis)

[BibTex]

Kübler, J. M. Learning and Testing Powerful Hypotheses University of Tübingen, Germany, July 2023 (phdthesis)

[BibTex]

Learning Identifiable Representations: Independent Influences and Multiple Views

Gresele, L.

University of Tübingen, Germany, June 2023 (phdthesis)

[BibTex]

Gresele, L. Learning Identifiable Representations: Independent Influences and Multiple Views University of Tübingen, Germany, June 2023 (phdthesis)

[BibTex]

Learning with and for discrete optimization

Paulus, M.

ETH Zurich, Switzerland, May 2023, CLS PhD Program (phdthesis)

[BibTex]

Paulus, M. Learning with and for discrete optimization ETH Zurich, Switzerland, May 2023, CLS PhD Program (phdthesis)

[BibTex]

Natural Language Processing for Policymaking

Jin, Z., Mihalcea, R.

In Handbook of Computational Social Science for Policy, pages: 141-162, 7, (Editors: Bertoni, E. and Fontana, M. and Gabrielli, L. and Signorelli, S. and Vespe, M.), Springer International Publishing, 2023 (inbook)

DOI [BibTex]

Jin, Z., Mihalcea, R. Natural Language Processing for Policymaking In Handbook of Computational Social Science for Policy, pages: 141-162, 7, (Editors: Bertoni, E. and Fontana, M. and Gabrielli, L. and Signorelli, S. and Vespe, M.), Springer International Publishing, 2023 (inbook)

DOI [BibTex]

Synchronizing Machine Learning Algorithms, Realtime Robotic Control and Simulated Environment with o80

Berenz, V., Widmaier, F., Guist, S., Schölkopf, B., Büchler, D.

Robot Software Architectures Workshop (RSA) 2023, ICRA, 2023 (techreport)

Abstract

Robotic applications require the integration of various modalities, encompassing perception, control of real robots and possibly the control of simulated environments. While the state-of-the-art robotic software solutions such as ROS 2 provide most of the required features, flexible synchronization between algorithms, data streams and control loops can be tedious. o80 is a versatile C++ framework for robotics which provides a shared memory model and a command framework for real-time critical systems. It enables expert users to set up complex robotic systems and generate Python bindings for scientists. o80's unique feature is its flexible synchronization between processes, including the traditional blocking commands and the novel ``bursting mode'', which allows user code to control the execution of the lower process control loop. This makes it particularly useful for setups that mix real and simulated environments.

arxiv poster link (url) [BibTex]

Berenz, V., Widmaier, F., Guist, S., Schölkopf, B., Büchler, D. Synchronizing Machine Learning Algorithms, Realtime Robotic Control and Simulated Environment with o80 Robot Software Architectures Workshop (RSA) 2023, ICRA, 2023 (techreport)

arxiv poster link (url) [BibTex]

2022

Towards learning mechanistic models at the right level of abstraction

Neitz, A.

University of Tübingen, Germany, November 2022 (phdthesis)

[BibTex]

2022

Neitz, A. Towards learning mechanistic models at the right level of abstraction University of Tübingen, Germany, November 2022 (phdthesis)

[BibTex]

Learning Causal Representations for Generalization and Adaptation in Supervised, Imitation, and Reinforcement Learning

Lu, C.

University of Cambridge, UK, Cambridge, October 2022, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Lu, C. Learning Causal Representations for Generalization and Adaptation in Supervised, Imitation, and Reinforcement Learning University of Cambridge, UK, Cambridge, October 2022, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Learning Time-Continuous Dynamics Models with Gaussian-Process-Based Gradient Matching

Wenk, P.

ETH Zurich, Switzerland, October 2022, CLS PhD Program (phdthesis)

[BibTex]

Wenk, P. Learning Time-Continuous Dynamics Models with Gaussian-Process-Based Gradient Matching ETH Zurich, Switzerland, October 2022, CLS PhD Program (phdthesis)

[BibTex]

Causality, causal digital twins, and their applications

Schölkopf, B.

Machine Learning for Science: Bridging Data-Driven and Mechanistic Modelling (Dagstuhl Seminar 22382), (Editors: Berens, Philipp and Cranmer, Kyle and Lawrence, Neil D. and von Luxburg, Ulrike and Montgomery, Jessica), September 2022 (talk)

link (url) DOI [BibTex]

Schölkopf, B. Causality, causal digital twins, and their applications Machine Learning for Science: Bridging Data-Driven and Mechanistic Modelling (Dagstuhl Seminar 22382), (Editors: Berens, Philipp and Cranmer, Kyle and Lawrence, Neil D. and von Luxburg, Ulrike and Montgomery, Jessica), September 2022 (talk)

link (url) DOI [BibTex]

Methods for Minimizing the Spread of Misinformation on the Web

Tabibian, B.

University of Tübingen, Germany, September 2022 (phdthesis)

[BibTex]

Tabibian, B. Methods for Minimizing the Spread of Misinformation on the Web University of Tübingen, Germany, September 2022 (phdthesis)

[BibTex]

Learning and Using Causal Knowledge: A Further Step Towards a Higher-Level Intelligence

Huang, B.

Carnegie Mellon University, Pittsburgh, USA, July 2022 (phdthesis)

[BibTex]

Huang, B. Learning and Using Causal Knowledge: A Further Step Towards a Higher-Level Intelligence Carnegie Mellon University, Pittsburgh, USA, July 2022 (phdthesis)

[BibTex]

Learning and Using Causal Knowledge: A Further Step Towards a Higher-Level Intelligence

Huang, B.

Carnegie Mellon University, July 2022, external supervision (phdthesis)

[BibTex]

Huang, B. Learning and Using Causal Knowledge: A Further Step Towards a Higher-Level Intelligence Carnegie Mellon University, July 2022, external supervision (phdthesis)

[BibTex]

Variational Inference in Dynamical Systems

Ialongo, A.

University of Cambridge, UK, Cambridge, February 2022, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Ialongo, A. Variational Inference in Dynamical Systems University of Cambridge, UK, Cambridge, February 2022, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Causal Models for Dynamical Systems

Peters, J., Bauer, S., Pfister, N.

In Probabilistic and Causal Inference: The Works of Judea Pearl, pages: 671-690, 1, Association for Computing Machinery, 2022 (inbook)

arXiv DOI [BibTex]

Peters, J., Bauer, S., Pfister, N. Causal Models for Dynamical Systems In Probabilistic and Causal Inference: The Works of Judea Pearl, pages: 671-690, 1, Association for Computing Machinery, 2022 (inbook)

arXiv DOI [BibTex]

Towards Causal Algorithmic Recourse

Karimi, A. H., von Kügelgen, J., Schölkopf, B., Valera, I.

In xxAI - Beyond Explainable AI: International Workshop, Held in Conjunction with ICML 2020, July 18, 2020, Vienna, Austria, Revised and Extended Papers, pages: 139-166, (Editors: Holzinger, Andreas and Goebel, Randy and Fong, Ruth and Moon, Taesup and Müller, Klaus-Robert and Samek, Wojciech), Springer International Publishing, 2022 (inbook)

DOI [BibTex]

Karimi, A. H., von Kügelgen, J., Schölkopf, B., Valera, I. Towards Causal Algorithmic Recourse In xxAI - Beyond Explainable AI: International Workshop, Held in Conjunction with ICML 2020, July 18, 2020, Vienna, Austria, Revised and Extended Papers, pages: 139-166, (Editors: Holzinger, Andreas and Goebel, Randy and Fong, Ruth and Moon, Taesup and Müller, Klaus-Robert and Samek, Wojciech), Springer International Publishing, 2022 (inbook)

DOI [BibTex]

CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations

Salewski, L., Koepke, A. S., Lensch, H. P. A., Akata, Z.

In xxAI - Beyond Explainable AI: International Workshop, Held in Conjunction with ICML 2020, July 18, 2020, Vienna, Austria, Revised and Extended Papers, pages: 69-88, (Editors: Holzinger, Andreas and Goebel, Randy and Fong, Ruth and Moon, Taesup and Müller, Klaus-Robert and Samek, Wojciech), Springer International Publishing, 2022 (inbook)

DOI [BibTex]

Salewski, L., Koepke, A. S., Lensch, H. P. A., Akata, Z. CLEVR-X: A Visual Reasoning Dataset for Natural Language Explanations In xxAI - Beyond Explainable AI: International Workshop, Held in Conjunction with ICML 2020, July 18, 2020, Vienna, Austria, Revised and Extended Papers, pages: 69-88, (Editors: Holzinger, Andreas and Goebel, Randy and Fong, Ruth and Moon, Taesup and Müller, Klaus-Robert and Samek, Wojciech), Springer International Publishing, 2022 (inbook)

DOI [BibTex]

Causality for Machine Learning

Schölkopf, B.

In Probabilistic and Causal Inference: The Works of Judea Pearl, pages: 765-804, 1, Association for Computing Machinery, New York, NY, USA, 2022 (inbook)

arXiv DOI [BibTex]

Schölkopf, B. Causality for Machine Learning In Probabilistic and Causal Inference: The Works of Judea Pearl, pages: 765-804, 1, Association for Computing Machinery, New York, NY, USA, 2022 (inbook)

arXiv DOI [BibTex]

2021

Dynamics of Learning and Learning of Dynamics

Mehrjou, A.

ETH Zürich, Zürich, October 2021 (phdthesis)

DOI [BibTex]

2021

Mehrjou, A. Dynamics of Learning and Learning of Dynamics ETH Zürich, Zürich, October 2021 (phdthesis)

DOI [BibTex]

A Large Scale Brain-Computer Interface for Patients with Neurological Diseases

Hohmann, M.

University of Tübingen, Germany, September 2021 (phdthesis)

[BibTex]

Hohmann, M. A Large Scale Brain-Computer Interface for Patients with Neurological Diseases University of Tübingen, Germany, September 2021 (phdthesis)

[BibTex]

Deep Learning Beyond The Training Distribution

Parascandolo, G.

ETH Zürich, Switzerland, Zürich, September 2021, (CLS Fellowship Program) (phdthesis)

DOI [BibTex]

Parascandolo, G. Deep Learning Beyond The Training Distribution ETH Zürich, Switzerland, Zürich, September 2021, (CLS Fellowship Program) (phdthesis)

DOI [BibTex]

Optimization Algorithms for Machine Learning

Raj, A.

University of Tübingen, Germany, June 2021 (phdthesis)

[BibTex]

Raj, A. Optimization Algorithms for Machine Learning University of Tübingen, Germany, June 2021 (phdthesis)

[BibTex]

Causal Inference in Vision

Meding, K.

Eberhard Karls Universität Tübingen, Tübingen, June 2021 (phdthesis)

[BibTex]

Meding, K. Causal Inference in Vision Eberhard Karls Universität Tübingen, Tübingen, June 2021 (phdthesis)

[BibTex]

Machine Learning Methods for Modeling Synthesizable Molecules

Bradshaw, J.

University of Cambridge, UK, Cambridge, April 2021, (Cambridge-Tübingen-Fellowship) (phdthesis)

DOI [BibTex]

Bradshaw, J. Machine Learning Methods for Modeling Synthesizable Molecules University of Cambridge, UK, Cambridge, April 2021, (Cambridge-Tübingen-Fellowship) (phdthesis)

DOI [BibTex]

2020

Causal Feature Selection in Neuroscience

Mastakouri, A.

University of Tübingen, Germany, December 2020 (phdthesis)

link (url) [BibTex]

2020

Mastakouri, A. Causal Feature Selection in Neuroscience University of Tübingen, Germany, December 2020 (phdthesis)

link (url) [BibTex]

Enforcing and Discovering Structure in Machine Learning

Locatello, F.

ETH Zurich, Switzerland, November 2020, (CLS Fellowship Program) (phdthesis)

[BibTex]

Locatello, F. Enforcing and Discovering Structure in Machine Learning ETH Zurich, Switzerland, November 2020, (CLS Fellowship Program) (phdthesis)

[BibTex]

On the Geometry of Data Representations

Bécigneul, G.

ETH Zurich, Switzerland, September 2020, (CLS Fellowship Program) (phdthesis)

[BibTex]

Bécigneul, G. On the Geometry of Data Representations ETH Zurich, Switzerland, September 2020, (CLS Fellowship Program) (phdthesis)

[BibTex]

Beyond traditional assumptions in fair machine learning

Kilbertus, N.

University of Cambridge, UK, September 2020, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Kilbertus, N. Beyond traditional assumptions in fair machine learning University of Cambridge, UK, September 2020, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Advances in Latent Variable and Causal Models

Rubenstein, P.

University of Cambridge, UK, July 2020, (Cambridge-Tuebingen-Fellowship) (phdthesis)

[BibTex]

Rubenstein, P. Advances in Latent Variable and Causal Models University of Cambridge, UK, July 2020, (Cambridge-Tuebingen-Fellowship) (phdthesis)

[BibTex]

Learning from Multi-Frame Data

Wieschollek, P.

University of Tübingen, Germany, July 2020 (phdthesis)

[BibTex]

Wieschollek, P. Learning from Multi-Frame Data University of Tübingen, Germany, July 2020 (phdthesis)

[BibTex]

Converting to Optimization in Machine Learning: Perturb-and-MAP, Differential Privacy, and Program Synthesis

Balog, M.

University of Cambridge, UK, July 2020, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

Balog, M. Converting to Optimization in Machine Learning: Perturb-and-MAP, Differential Privacy, and Program Synthesis University of Cambridge, UK, July 2020, (Cambridge-Tübingen-Fellowship) (phdthesis)

[BibTex]

2019

Robot Learning for Muscular Systems

Büchler, D.

Technical University Darmstadt, Germany, December 2019 (phdthesis)

link (url) [BibTex]

2019

Büchler, D. Robot Learning for Muscular Systems Technical University Darmstadt, Germany, December 2019 (phdthesis)

link (url) [BibTex]

Multivariate coupling estimation between continuous signals and point processes

Safavi, S., Logothetis, N., Besserve, M.

Neural Information Processing Systems 2019 - Workshop on Learning with Temporal Point Processes, December 2019 (talk)

Talk video link (url) [BibTex]

Safavi, S., Logothetis, N., Besserve, M. Multivariate coupling estimation between continuous signals and point processes Neural Information Processing Systems 2019 - Workshop on Learning with Temporal Point Processes, December 2019 (talk)

Talk video link (url) [BibTex]

Real Time Probabilistic Models for Robot Trajectories

Gomez-Gonzalez, S.

Technical University Darmstadt, Germany, December 2019 (phdthesis)

[BibTex]

Gomez-Gonzalez, S. Real Time Probabilistic Models for Robot Trajectories Technical University Darmstadt, Germany, December 2019 (phdthesis)

[BibTex]

Perception of temporal dependencies in autoregressive motion

Meding, K., Schölkopf, B., Wichmann, F. A.

Perception, 48(2-suppl):141, 42nd European Conference on Visual Perception (ECVP), August 2019 (poster)

link (url) [BibTex]

Meding, K., Schölkopf, B., Wichmann, F. A. Perception of temporal dependencies in autoregressive motion Perception, 48(2-suppl):141, 42nd European Conference on Visual Perception (ECVP), August 2019 (poster)

link (url) [BibTex]

Phenomenal Causality and Sensory Realism

Bruijns, S. A., Meding, K., Schölkopf, B., Wichmann, F. A.

Perception, 48(2-suppl):141, 42nd European Conference on Visual Perception (ECVP), August 2019 (poster)

link (url) [BibTex]

Bruijns, S. A., Meding, K., Schölkopf, B., Wichmann, F. A. Phenomenal Causality and Sensory Realism Perception, 48(2-suppl):141, 42nd European Conference on Visual Perception (ECVP), August 2019 (poster)

link (url) [BibTex]