David Danks

In this essay, we examine the use of resting state fMRI data for psychological inferences. We argue that resting state studies hold the paired promises of discovering novel functional brain networks, and of avoiding some of the limitations of task-based fMRI. However, we argue that the very features of experimental design that enable resting state fMRI to support exploratory science also generate a novel confound. We argue that seemingly key features of resting state functional connectivity networks may be artefacts resulting from sampling a ‘mixture distribution’ of diverse brain networks active at different times during the scan. We explore the consequences of this ‘mixture view’ for attempts to theorize about the cognitive or psychological functions of resting state networks, as well as the value of exploratory experiments.

Many approaches to evidence amalgamation focus on relatively static information or evidence: the data to be amalgamated involve different variables, contexts, or experiments, but not measurements over extended periods of time. However, much of scientific inquiry focuses on dynamical systems; the system’s behavior over time is critical. Moreover, novel problems of evidence amalgamation arise in these contexts. First, data can be collected at different measurement timescales, where potentially none of them correspond to the underlying system’s causal timescale. Second, missing variables have a significantly different impact on time series measurements than they do in the traditional static setting; in particular, they make causal and structural inference much more difficult. In this paper, we argue that amalgamation should proceed by integrating causal knowledge, rather than at the level of “raw” evidence. We defend this claim by first outlining both of these problems, and then showing that they can be solved only if we operate on causal structures. We therefore must use causal discovery methods that are reliable given these problems. Such methods do exist, but their successful application requires careful consideration of the problems that we highlight.

Research on adaptive rationality has focused principally on inference, judgment, and decision-making that lead to behaviors and actions. These processes typically require cognitive representations as input, and these representations must presumably be acquired via learning. Nonetheless, there has been little work on the nature of, and justification for, adaptively rational learning processes. In this paper, we argue that there are strong reasons to believe that some learning is adaptively rational in the same way as judgment and decision-making. Indeed, overall adaptive rationality can only properly be assessed for pairs of learning and decision processes. We thus present a formal framework for modeling such pairs of cognitive processes, and thereby assessing their adaptive rationality relative to the environment and the agent’s goals. We then use this high-level formal framework on specific cases by demonstrating how natural formal constraints on decision-making can lead to substantive predictions about adaptively rational learning and representation; and characterizing adaptively rational learning for fast-and-frugal one-reason decision-making.

This book explores new findings on the long-neglected topic of theory construction and discovery, and challenges the orthodox, current division of scientific development into discrete stages: the stage of generation of new hypotheses; the stage of collection of relevant data; the stage of justification of possible theories; and the final stage of selection from among equally confirmed theories. The chapters, written by leading researchers, offer an interdisciplinary perspective on various aspects of the processes by which theories rationally should, and descriptively are, built. They address issues such as the role of problem-solving and heuristic reasoning in theory-building; how inferences and models shape the pursuit of scientific knowledge; the relation between problem-solving and scientific discovery; the relative values of the syntactic, semantic, and pragmatic view of theories in understanding theory construction; and the relation between ampliative inferences, heuristic reasoning, and models as a means for building new theories and knowledge. Through detailed arguments and examinations, the volume collectively challenges the orthodox view’s main tenets by characterizing the ways in which the different “stages” are logically, temporally, and psychologically intertwined. As a group, the chapters provide several attempts to answer long-standing questions about the possibility of a unified conceptual framework for building theories and formulating hypotheses.

Learning by artificial intelligence systems-what I will typically call machine learning-has a distinguished history, and the field has experienced something of a renaissance in the past twenty years. Machine learning consists principally of a diverse set of algorithms and techniques that have been applied to problems in a wide range of domains. Any overview of the methods and applications will inevitably be incomplete, at least at the level of specific algorithms and techniques. There are many excellent introductions to the formal and statistical details of machine learning algorithms and techniques available elsewhere. The present chapter focuses on machine learning as a general way of “thinking about the world,” and provides a high-level characterization of the major goals of machine learning. There are a number of philosophical concerns that have been raised about machine learning, but upon closer examination, it is not always clear whether the objections really speak against machine learning specifically. Many seem rather to be directed towards machine learning as a particular instantiation of some more general phenomenon or process. One of the general morals of this chapter is that machine learning is, in many ways, less unusual or peculiar than is sometimes thought

Causal structure learning algorithms have focused on learning in ”batch-mode”: i.e., when a full dataset is presented. In many domains, however, it is important to learn in an online fashion from sequential or ordered data, whether because of memory storage constraints or because of potential changes in the underlying causal structure over the course of learning. In this paper, we present TDSL, a novel causal structure learning algorithm that processes data sequentially. This algorithm can track changes in the generating causal structure or parameters, and requires significantly less memory in realistic settings. We show by simulation that the algorithm performs comparably to batch-mode learning when the causal structure is stationary, and significantly better in non-stationary environments.

Arguments, claims, and discussions about the “level of description” of a theory are ubiquitous in cognitive science. Such talk is typically expressed more precisely in terms of the granularity of the theory, or in terms of Marr’s three levels. I argue that these ways of understanding levels of description are insufficient to capture the range of different types of theoretical commitments that one can have in cognitive science. When we understand these commitments as points in a multi-dimensional space, we find that we must also reconsider our understanding of intertheoretic relations. In particular, we should understand cognitive theories as constraining one another, rather than reducing to one another

Even if one can experiment on relevant factors, learning the causal structure of a dynamical system can be quite difficult if the relevant measurement processes occur at a much slower sampling rate than the “true” underlying dynamics. This problem is exacerbated if the degree of mismatch is unknown. This paper gives a formal characterization of this learning problem, and then provides two sets of results. First, we prove a set of theorems characterizing how causal structures change under undersampling. Second, we develop an algorithm for inferring aspects of the causal structure at the “true” timescale from the causal structure learned from the undersampled data. Research on causal learning in dynamical contexts has largely ignored the challenges of undersampling, but this paper provides a framework and foundation for learning causal structure from this type of complex time series data

Models based on causal capacities, or independent causal influences/mechanisms, are widespread in the sciences. This paper develops a natural mathematical framework for representing such capacities by extending and generalizing previous results in cognitive psychology and machine learning, based on observations and arguments from prior philosophical debates. In addition to its substantial generality, the resulting framework provides a theoretical unification of the widely-used noisy-OR/AND and linear models, thereby showing how they are complementary rather than competing. This unification helps to explain many of the shared cognitive and mathematical properties of those models.

An increasing number of arguments for causal pluralism invoke empirical psychological data. Different aspects of causal cognition—specifically, causal perception and causal inference—are thought to involve distinct cognitive processes and representations, and they thereby distinctively support transference and dependency theories of causation, respectively. We argue that this dualistic picture of causal concepts arises from methodological differences, rather than from an actual plurality of concepts. Hence, philosophical causal pluralism is not particularly supported by the empirical data. Serious engagement with cognitive science reveals that the connection between psychological concepts of causation and philosophical notions is substantially more complicated than is traditionally presumed.

Causal structure learning from time series data is a major scientific challenge. Existing algorithms assume that measurements occur sufficiently quickly; more precisely, they assume that the system and measurement timescales are approximately equal. In many scientific domains, however, measurements occur at a significantly slower rate than the underlying system changes. Moreover, the size of the mismatch between timescales is often unknown. This paper provides three distinct causal structure learning algorithms, all of which discover all dynamic graphs that could explain the observed measurement data as arising from undersampling at some rate. That is, these algorithms all learn causal structure without assuming any particular relation between the measurement and system timescales; they are thus rate-agnostic. We apply these algorithms to data from simulations. The results provide insight into the challenge of undersampling

It is the height of banality to observe that people, not bullets, fight kinetic wars. The machinery of kinetic warfare is obviously relevant to the conduct of each particular act of warfare, but the reasons for, and meanings of, those acts depend critically on the fact that they are done by humans. Any attempt to understand warfare—its causes, strategies, legitimacy, dynamics, and resolutions—must incorporate humans as an intrinsic part, both descriptively and normatively. Humans from general staff to “boots on the ground” play key roles in all aspects of kinetic warfare, and the literature about it reflects this focus. 2 In contrast, many discussions of cyberwarfare and cyber-conflict focus principally on the technical aspects of machines, systems, and data, 3 and human agents are included only as collateral effects, or as loci of moral responsibility

Most learning models assume, either implicitly or explicitly, that the goal of learning is to acquire a complete and veridical representation of the world, but this view assumes away the possibility that pragmatic goals can play a central role in learning. We propose instead that people are relatively frugal learners, acquiring goal-relevant information while ignoring goal-irrelevant features of the environment. Experiment 1 provides evidence that learning is goal-dependent, and that people are relatively frugal when given a specific, practical goal. Experiment 2 investigates possible mechanisms underlying this effect, and finds evidence that people exhibit goal-driven attention allocation, but not goaldriven reasoning. We conclude by examining how frugality can be integrated into Bayesian models of learning

The Rescorla–Wagner model has been a leading theory of animal causal induction for nearly 30 years, and human causal induction for the past 15 years. Recent theories 367) have provided alternative explanations of how people draw causal conclusions from covariational data. However, theoretical attempts to compare the Rescorla–Wagner model with more recent models have been hampered by the fact that the Rescorla–Wagner model is an algorithmic theory, while the more recent theories are all computational. This paper provides a detailed derivation of the long-run behavior of the Rescorla– Wagner model under a wide range of parameters and experimental setups, so that the model can be compared with computational theories. It also shows that the model agrees with competing theories on a wider range of cases than had previously been thought. The paper concludes by showing how recently suggested modifications of the Rescorla–Wagner model impact the long-run behavior of the model

Structure learning algorithms for graphical models have focused almost exclusively on stable environments in which the underlying generative process does not change; that is, they assume that the generating model is globally stationary. In real-world environments, however, such changes often occur without warning or signal. Real-world data often come from generating models that are only locally stationary. In this paper, we present LoSST, a novel, heuristic structure learning algorithm that tracks changes in graphical model structure or parameters in a dynamic, real-time manner. We show by simulation that the algorithm performs comparably to batch-mode learning when the generating graphical structure is globally stationary, and significantly better when it is only locally stationary

Research on human causal learning has largely focused on strength learning, or on computational-level theories; there are few formal algorithmic models of how people learn causal structure from covariations. We introduce a model that learns causal structure in a local manner via prediction-error learning. This local learning is then integrated dynamically into a unified representation of causal structure. The model uses computationally plausible approximations of rational learning, and so represents a hybrid between the associationist and rational paradigms in causal learning research. We conclude by showing that the model provides a good fit to data from a previous experiment

Standard time series structure learning algorithms assume that the measurement timescale is approximately the same as the timescale of the underlying system. In many scientific contexts, however, this assumption is violated: the measurement timescale can be substantially slower than the system timescale. This assumption violation can lead to significant learning errors. In this paper, we provide a novel learning algorithm to extract systemtimescale structure from measurement data that undersample the underlying system. We employ multiple algorithmic optimizations that exploit the problem structure in order to achieve computational tractability. The resulting algorithm is highly reliable at extracting system-timescale structure from undersampled data

Artificial Intelligence (AI) offers numerous opportunities to improve military Intelligence, Surveillance, and Reconnaissance operations. And, modern militaries recognize the strategic value of reducing civilian harm. Grounded in these two assertions we focus on the transformative potential that AI ISR systems have for improving the respect for and protection of humanitarian relief operations. Specifically, we propose that establishing an interface for humanitarian organizations to military AI ISR systems can improve the current state of ad-hoc humanitarian notification systems, which are notoriously unreliable and ineffective for both parties to conflict and humanitarian organizations. We argue that such an interface can improve military awareness and understanding while also ensuring that states better satisfy their international humanitarian law obligations to respect and protect humanitarian relief personnel.