• Evidence in classical statistics
    In Maria Lasonen-Aarnio & Clayton Littlejohn (eds.), The Routledge Handbook of the Philosophy of Evidence, Routledge. 2019.
  •  54
    Statistical Inference as Severe Testing: How to Get beyond the Statistics
    Philosophical Review 130 (1): 185-189. 2021.
  •  69
    Modeling and computer simulations, we claim, should be considered core philosophical methods. More precisely, we will defend two theses. First, philosophers should use simulations for many of the same reasons we currently use thought experiments. In fact, simulations are superior to thought experiments in achieving some philosophical goals. Second, devising and coding computational models instill good philosophical habits of mind. Throughout the paper, we respond to the often implicit objection …Read more
  •  29
    What justifies the use of Bayesian statistics in science? The traditional answer is that Bayesian statistics is simply an instance of orthodox expected utility theory. Thus, Bayesian statistical methods, like principles of utility theory, are justified by norms of individual rationality. In particular, most Bayesians argue that a scientist's credences must satisfy the probability axioms if she adheres to norms of practical and epistemic rationality. We argue that, to justify Bayesian statistics …Read more
  •  280
    Epistemic decision theory (EDT) employs the mathematical tools of rational choice theory to justify epistemic norms, including probabilism, conditionalization, and the Principal Principle, among others. Practitioners of EDT endorse two theses: (1) epistemic value is distinct from subjective preference, and (2) belief and epistemic value can be numerically quantified. We argue the first thesis, which we call epistemic puritanism, undermines the second.
  •  19
    Causal identifiability and piecemeal experimentation
    Synthese 196 (8): 3029-3065. 2019.
    In medicine and the social sciences, researchers often measure only a handful of variables simultaneously. The underlying assumption behind this methodology is that combining the results of dozens of smaller studies can, in principle, yield as much information as one large study, in which dozens of variables are measured simultaneously. Mayo-Wilson :864–874, 2011, Br J Philos Sci 65:213–249, 2013. https://doi.org/10.1093/bjps/axs030) shows that assumption is false when causal theories are inferr…Read more
  •  733
    Scoring Imprecise Credences: A Mildly Immodest Proposal
    Philosophy and Phenomenological Research 92 (1): 55-78. 2016.
    Jim Joyce argues for two amendments to probabilism. The first is the doctrine that credences are rational, or not, in virtue of their accuracy or “closeness to the truth” (1998). The second is a shift from a numerically precise model of belief to an imprecise model represented by a set of probability functions (2010). We argue that both amendments cannot be satisfied simultaneously. To do so, we employ a (slightly-generalized) impossibility theorem of Seidenfeld, Schervish, and Kadane (2012), wh…Read more
  •  765
    Russell on Logicism and Coherence
    Russell: The Journal of Bertrand Russell Studies 31 (1): 63-79. 2011.
    Abstract:According to Quine, Charles Parsons, Mark Steiner, and others, Russell’s logicist project is important because, if successful, it would show that mathematical theorems possess desirable epistemic properties often attributed to logical theorems, such as aprioricity, necessity, and certainty. Unfortunately, Russell never attributed such importance to logicism, and such a thesis contradicts Russell’s explicitly stated views on the relationship between logic and mathematics. This raises the…Read more
  •  100
    Several current debates in the epistemology of testimony are implicitly motivated by concerns about the reliability of rules for changing one’s beliefs in light of others’ claims. Call such rules testimonial norms (tns). To date, epistemologists have neither (i) characterized those features of communities that influence the reliability of tns, nor (ii) evaluated the reliability of tns as those features vary. These are the aims of this paper. I focus on scientific communities, where the transmiss…Read more
  •  451
    The Problem of Piecemeal Induction
    Philosophy of Science 78 (5): 864-874. 2011.
    It is common to assume that the problem of induction arises only because of small sample sizes or unreliable data. In this paper, I argue that the piecemeal collection of data can also lead to underdetermination of theories by evidence, even if arbitrarily large amounts of completely reliable experimental and observational data are collected. Specifically, I focus on the construction of causal theories from the results of many studies (perhaps hundreds), including randomized controlled trials an…Read more
  •  66
    Scientific Collaboration and Collective Knowledge (edited book)
    Oxford University Press. 2017.
    Current scientific research almost always requires collaboration among several (if not several hundred) specialized researchers. When scientists co-author a journal article, who deserves credit for discoveries or blame for errors? How should scientific institutions promote fruitful collaborations among scientists? In this book, leading philosophers of science address these critical questions.
  •  354
    Structural Chaos
    Philosophy of Science 82 (5): 1236-1247. 2015.
    A dynamical system is called chaotic if small changes to its initial conditions can create large changes in its behavior. By analogy, we call a dynamical system structurally chaotic if small changes to the equations describing the evolution of the system produce large changes in its behavior. Although there are many definitions of “chaos,” there are few mathematically precise candidate definitions of “structural chaos.” I propose a definition, and I explain two new theorems that show that a set …Read more
  •  731
    Wisdom of the Crowds vs. Groupthink: Learning in Groups and in Isolation
    with Kevin Zollman and David Danks
    International Journal of Game Theory 42 (3): 695-723. 2013.
    We evaluate the asymptotic performance of boundedly-rational strategies in multi-armed bandit problems, where performance is measured in terms of the tendency (in the limit) to play optimal actions in either (i) isolation or (ii) networks of other learners. We show that, for many strategies commonly employed in economics, psychology, and machine learning, performance in isolation and performance in networks are essentially unrelated. Our results suggest that the appropriateness of various, commo…Read more
  •  30
    Causal Conclusions that Flip Repeatedly and Their Justification
    Proceedings of the Twenty Sixth Conference on Uncertainty in Artificial Intelligence 26 277-286. 2010.
    Over the past two decades, several consistent procedures have been designed to infer causal conclusions from observational data. We prove that if the true causal network might be an arbitrary, linear Gaussian network or a discrete Bayes network, then every unambiguous causal conclusion produced by a consistent method from non-experimental data is subject to reversal as the sample size increases any finite number of times. That result, called the causal flipping theorem, extends prior results to …Read more
  •  974
    In the latter half of the twentieth century, philosophers of science have argued (implicitly and explicitly) that epistemically rational individuals might compose epistemically irrational groups and that, conversely, epistemically rational groups might be composed of epistemically irrational individuals. We call the conjunction of these two claims the Independence Thesis, as they together imply that methodological prescriptions for scientific communities and those for individual scientists might…Read more
  •  92
    Ockham Efficiency Theorem for Stochastic Empirical Methods
    Journal of Philosophical Logic 39 (6): 679-712. 2010.
    Ockham’s razor is the principle that, all other things being equal, scientists ought to prefer simpler theories. In recent years, philosophers have argued that simpler theories make better predictions, possess theoretical virtues like explanatory power, and have other pragmatic virtues like computational tractability. However, such arguments fail to explain how and why a preference for simplicity can help one find true theories in scientific inquiry, unless one already assumes that the truth is …Read more
  •  138
    The Limits of Piecemeal Causal Inference
    British Journal for the Philosophy of Science 65 (2): 213-249. 2014.
    In medicine and the social sciences, researchers must frequently integrate the findings of many observational studies, which measure overlapping collections of variables. For instance, learning how to prevent obesity requires combining studies that investigate obesity and diet with others that investigate obesity and exercise. Recently developed causal discovery algorithms provide techniques for integrating many studies, but little is known about what can be learned from such algorithms. This ar…Read more