Jon Williamson

In this chapter I discuss connections between machine learning and the philosophy of science. First I consider the relationship between the two disciplines. There is a clear analogy between hypothesis choice in science and model selection in machine learning. While this analogy has been invoked to argue that the two disciplines are essentially doing the same thing and should merge, I maintain that the disciplines are distinct but related and that there is a dynamic interaction operating between the two: a series of mutually beneficial interactions that changes over time. I will introduce some particularly fruitful interactions, in particular the consequences of automated scientific discovery for the debate on inductivism versus falsificationism in the philosophy of science, and the importance of philosophical work on Bayesian epistemology and causality for contemporary machine learning. I will close by suggesting the locus of a possible future interaction: evidence integration.

1, . . . , n | ≈ ψ ? Here 1, . . . , n, ψ are premisses of some formal language, such as a propositional language or a predicate language. | ≈ is an entailment relation: the entailment holds if all models of the premisses also satisfy the conclusion, where the logic provides some suitable notion of ‘model’ and ‘satisfy’. Proof theory is normally invoked to answer a question of this form: one tries to prove the conclusion from the premisses in a finite sequence of steps, where at each step one invokes an axiom or applies a rule of inference

Russo and Williamson (Int Stud Philos Sci 21(2):157–170, 2007) put forward the thesis that, at least in the health sciences, to establish the claim that C is a cause of E, one normally needs evidence of an underlying mechanism linking C and E as well as evidence that C makes a difference to E. This epistemological thesis poses a problem for most current analyses of causality which, in virtue of analysing causality in terms of just one of mechanisms or difference making, cannot account for the need for the other kind of evidence. Weber (Int Stud Philos Sci 23(2):277–295, 2009) has suggested to the contrary that Giere’s probabilistic analysis of causality survives this criticism. In this paper, we look in detail at the case of medical imaging technology, which, we argue, supports the thesis of Russo and Williamson, and we respond to Weber’s suggestion, arguing that Giere’s account does not survive the criticism