Project Reproducibility and Simulation avoidance
Science, especially scientific computer simulations aim to be reproducible. HPC simulations as for example done here at HLRS often run into reproducibility issues, caused not only by infrastructural issues such as dark data or backward compatibility. Because of parallelization it can be the case that even bit-wise reproducibility is not achievable. This poses somewhat of a dilemma for simulation science. There is an expectation of strong reproducibility which can in practice only partially be fulfilled. One goal of this project is to shed light on the notion of reproducibility in simulation science, comparing it to similar notions from neighboring fields such as computational statistics. How should reproducibility expectations be balanced with what simulations can realistically deliver? Another question which I try to answer is what kind of reproducibility we should expect from hybrid and surrogate simulations. Currently ML methods, because of their cheaper computational costs are introduced in the simulation pipeline everywhere. They come with their own reproducibility issues, stemming from different sources than those in computer simulations. I try to figure out how these issues interfere and what kind of properties computational problems must have to be amenable to the “ML-treatment”.
Blog
You can find scattered thoughts mostly on the philosophy of computational methods on the workshopping blog I run with Ramón Alvarado.
Scientific interests
- Philosophy of science/philosophy of technology
- Intertheoretical relations in physical theories (reduction, derivation, founding, modularity etc.)
- Computer simulatable physical theories (e.g. LatticeQCD)
- Computational reliabilism
- Constructing artifacts as pragmatic justification of scientific theories
- discrete vs continuous science
- Limits of statistical inference/learning
- Inductive assumptions in approxmative methods
- Machine Learning & the problem of induction
- Kolmogorov complexity as general framework for ML
- theoretical vs. practical limits (e.g. no free lunch theorems vs. FLOPs)
- Science and society
- Why trust science?
- Why trust society?
Work In Progress
Inductive assumptions in ML – often ignored, always required (Abstract)
Working for trust – when easy things become hard (Abstract)
The theory and practice of computational error (Abstract – of a talk with the same title given at IACAP 23)
Recent publications
- How I stopped worrying and learned to love opacity, Chapter for Philosophy of science for machine learning: Core issues and new perspectives (Juan Manuel Durán & Giorgia Pozzi (eds.)), Springer, forthcoming
- Hypothesis/Proposing Explanation in Simulation, Body of Knowledge for Modeling and Simulation, Springer 2023
- Branches of ethics, Body of Knowledge for Modeling and Simulation, Springer 2023
Publications that I especially like:
- Durán, J.M., Formanek, N. Grounds for Trust: Essential Epistemic Opacity and Computational Reliabilism. Minds & Machines 28, 645–666 (2018). https://doi.org/10.1007/s11023-018-9481-6
Recent talks
Slides available upon request.
- Scaling things up! The philosophy of technology at scale (fpet2024, Karlsruhe, September 18th, 24)
- What is overfitting? (philML, Tübingen, September 12th, 24)
- Simulation Avoidance (IACAP24, Eugene, July 9th, 24)
- Is computability enough? (IACAP24, Eugene, July 8th, 24)
- Epicycles Revisited (mrc24, Paris, June 15th, 24)
- Generalization and Overfitting (HLRS, Stuttgart, May 28th, 24)
- Bestätigung durch Konstruktion (HLRS-TUDa Kolloquium, Darmstadt, April 2nd, 24)
- Generalization and the problem of leakage – How not to make a fool out of yourself while using ML, (From Machine Learning to Deep Learning: a concise introduction, HLRS, March 28th, 24)
- LatticeQCD – between approximation and foundation (DPG Frühjahrstagung 24, Berlin, March 20th, 24)
- What is a numerical solution? (Talk in Claus Beisbart‘s philSci seminar, Bern, Nov 21st, 23)
-
The continuum limit in Lattice QCD – what it means and why we need it (Discreteness and Precision in Physics, Paris, Nov 9th, 23)
- The epistemology of approximations in computer intensive science (POCFS, Hong Kong, Oct 11th, 23)
Teaching
- Computerethik (Winter term 2024, Uni Stuttgart)
- Philosophy of Computer Science (Summer term 2024, Uni Stuttgart)
Simulierte Welten
I am supervising two high-school students in the project Simulierte Welten. We are developing a topical model for the PhilosL mailinglist. This model automatically extract topics (i.e. metaphysics, philosophy of science, ethics) from the archives of the mailing list, allows to observe trends in topical distribution and evolution – and correlate topics with other interesting quantities. A more detailed description of the project can be found here (in German).