Torsten Wilholt

The purpose of this paper is to review, organize, and analyze disparate kinds of biases that can impact the quality of scientific research. We offer an analysis of what constitutes a bias and then provide a novel taxonomy of biases in science based on the criteria used to individuate them in the literature, i.e., based on the different criteria researchers use to identify biases. We identify five criteria: mechanism, effect, content, stage, and feature. We then conceptualize the impact of different biases using the notion of a ‘research pipeline.’ Furthermore, we identify a type of bias that can permeate the research pipeline as a whole, called ‘systemic bias,’ which includes biases that are likely to be more pervasive and thus more difficult to counteract. We conclude by stressing the importance of classifying biases in ways that are epistemically useful for science.

Although fundamental arguments have been presented to support the value-laden nature of all scientific research, they appear to be difficult to apply to basic research in physics. To explain this, I argue that basic research in physics is, in a very specific respect, often value-laden to a lesser degree. To spell this out, I refer to the different signal-to-noise ratios that can be achieved in different fields of research. I also argue that having a very low degree of value-ladenness in the very specific respect that I identify does not mean that the research is not value-laden at all.

Academic freedom and societal respect for science have been decreasing in the past years in the wake of growing nationalism, authoritarianism, and fundamentalism. Even in liberal democracies, science has been attacked by anti-science movements. One of the reasons for the weakening credibility of scientific knowledge is its exaggerated use in framing policy questions. Conflicts about interests and values are transformed into controversies about the validity and relevance of studies and data. Since scientific knowledge is a foundation of liberal democratic knowledge societies, a refusal to recognize it as a legitimate basis of decision-making undermines democratic deliberation and societal participation. We propose Wissenschaftsreflexion as a specific approach to addressing the challenges posed by the influence of science on political and social affairs and the unfavorable response to this influence by parts of developed knowledge societies. Wissenschaftsreflexion is integrative in collaborating with the various home disciplines of the humanities and the social sciences, and explicitly normative in judging the conditions and limitations of scientific advice and in taking liberal democracies as the basis of rational, fact-based policy decisions. The academic system alone cannot defend the appropriate use of scientific knowledge against unfounded threats. Attacks should be recognized as a general societal and political challenge and not be treated as merely a concern of scientists and the science system. Scientific knowledge, scholarship, and the science system need to be protected against unfounded assaults to be able to fulfill the societal tasks assigned to them in liberal democratic knowledge societies.

ABSTRACT: Scientists have to make trade-offs between different types of error risks when making methodological decisions. It is now widely recognized (and not disputed in this article) that in doing so they must consider how serious the consequences of each error would be. The fact that they must also consider the potential benefits of getting it right is not equally recognized (and explicitly rejected by Heather Douglas). In this article, I argue that scientists need to do both when managing epistemic risks. At the same time, I acknowledge that in some cases it intuitively seems as if considering the consequences of possible errors carries greater moral weight. I explain this intuition by arguing that in these cases the contrast between the seriousness of mistakes and the benefits of getting it right can be linked to the moral asymmetry between action and omission. I examine various reasons that might justify a stronger weighting of the consideration of the consequences of errors in light of the action-omission asymmetry. I conclude that for all but some exceptional cases, such asymmetrical consideration is not called for.

This paper discusses how to deal with research that threatens to cause harm to society—in particular, whether and in what cases bans and moratoria are appropriate. First, it asks what normative resources philosophy of science may draw on to answer such questions. In an effort to presuppose only resources acknowledgeable across different comprehensive worldviews, it is claimed that the aim of credibility provides a good basis for normative reflection. A close analysis reveals an inner tension inherent in the pursuit of credibility, referred to as the paradox of credibility: Although the aim of credibility involves the goal of being trusted, the immediate pursuit of the goal of being trusted as much as possible can run counter to and undermine the pursuit of credibility. From this inner tension, considerations are derived on what it means to uncompromisingly strive for trustworthiness. When applied to the problem of harmful research, it becomes apparent that it is important to distinguish between different types of cases. Some cases allow science to prevent harm while relinquishing credibility in the associated research area. In contrast, other cases demand preserving subject-specific scientific credibility in order to manage potential harm.

In order to select an area of ignorance and make it the target of inquiry, one first has to be aware of one’s own lack of knowledge in this particular area. In this paper, I explore this connection between ignorance and the aims of research. I emphasize the importance of distinguishing between all the things we don’t know—our total ignorance—and the totality of what we know we don’t know—our conscious ignorance. I argue that while our total ignorance may be conceptualized as a set of true propositions that are unknown to us, our conscious ignorance is best understood as a set of questions. This enables us to identify the preconditions that have to be satisfied in order for a question to be an element of our conscious ignorance. The analysis reveals that conscious ignorance is a complex ability that can often require quite an amount of knowledge and competence. Items of conscious ignorance can, of course, differ in many important respects. To stress one of these differences, I introduce the notion of deep ignorance to signify cases in which we not only fail to know the correct answer to a given question, but cannot even name any plausible candidate answers. I argue that items of deep ignorance should be expected to possess particular attractiveness as targets of research (provided they are not entirely intractable). Finally, I suggest that in light of my analysis, some of the strategies of ignorance-mongers that have engaged agnotologists’ interests over the past years can be understood as attempts to undermine not only knowledge, but also conscious ignorance at the same time—or, in cases where that is not possible, to at least counteract the impression that the ignorance in question is deep.

The main thesis of this paper is that when we trust the results of scientific research, that trust is inevitably directed at least in part at collective bodies rather than at single researchers, and that accordingly, reasonable assessments of epistemic trustworthiness in science must attend to these collective bodies. In order to support this claim, I start by invoking the collaborative nature of most of today’s scientific research. I argue that the trustworthiness of a collaborative research group does not supervene on the trustworthiness of its individual members and point out some specific problems for the assessment of epistemic trustworthiness that arise from the specific nature of today’s collaborative research. Next, I argue that the social diffusion of trustworthiness goes even further; we always also need an assessment of the trustworthiness of the respective research community as a whole. Communities, I claim, play an essential role in the epistemic quality management of science. To see why this role is indispensible, we have to appreciate the full complexity of determining what is desirable in a method of inquiry. The relevant features of a method include three different dimensions: the reliability of positive results, the reliability of negative results, and the method’s power. Every methodological choice involves a trade-off between these three dimensions. The right balance between them (the “distribution of inductive risks”, or DIR) depends on value judgments about the costs of false results and the benefits of correct ones. Conventional methodological standards of research communities impose constraints on admissible DIR and thereby harmonize the implicit value judgments. Trusting that the research community has set the limitations on DIR in a suitable way is thus always part of placing our trust in a scientific result.

There is now a general consensus amongst philosophers in the values in science literature that values necessarily play a role in core areas of scientific inquiry. We argue that attention should now be turned from debating the value-free ideal to delineating legitimate from illegitimate influences of values in science, a project we dub “The New Demarcation Problem.” First, we review past attempts to demarcate the uses of values and propose a categorization of the strategies by where they seek to draw legitimacy from. Next, we propose a set of desiderata for what we take to be a satisfactory solution and present a case study where conflicting sets of values clearly impinge on science, but where the legitimacy of their influence is ambiguous. We use these desiderata and the case study to illustrate what we take to be the strengths and weaknesses of current strategies. To be clear, our goal is not to answer the question we pose, but to articulate a framework within which a solution can be judged.

This paper advocates for making epistemic interests a central object of philosophical analysis in epistemology and philosophy of science. It is argued that the importance of epistemic interests derives from their fundamental importance for the notion of objectivity. Epistemic interests are defined as individuated by a set of objectives, each of which represents a dimension of the search for truth. Among these dimensions, specificity, sensitivity, and productivity are discussed in detail. It is argued that the relevance of productivity is often overlooked in debates about the ends and means of science. A definition of the objectivity of inquiry is proposed that takes the notion of epistemic interest as its starting point.

The independence of research is a key strategic issue of modern societies. Dealing with it appropriately poses legal, economic, political, social and cultural problems for society, which have been studied by the corresponding disciplines and are increasingly the subject of reflexive discourses of scientific communities. Unfortunately, problems of independence are usually framed in disciplinary contexts without due consideration of other perspectives’ relevance or possible contributions. To overcome these limitations, we review disciplinary perspectives and findings on the independence of research and identify interdisciplinary prospects that could inform a research programme.

A common complaint against the increasing privatization of research is that research that is conducted with the immediate purpose of producing applicable knowledge will not yield knowledge as valuable as that generated in more curiosity‐driven, academic settings. In this paper, I make this concern precise and reconstruct the rationale behind it. Subsequently, I examine the case of industry research on the giant magnetoresistance effect in the 1990s as a characteristic example of research undertaken under considerable pressure to produce applicable results. The example permits one to arrive at a more optimistic assessment of the epistemic merits of private, application‐driven research. I attempt to specify the conditions that, in this case, advanced the production of interesting and reliable knowledge.

Nominalism (the thesis that there are no abstract objects) faces the task of explaining away the ontological commitments of applied mathematical statements. This paper reviews an argument from the philosophy of logic that focuses on this task and which has been used as an objection to certain specific formulations of nominalism. The argument as it is developed in this paper aims to show that nominalism in general does not have the epistemological advantages its defendants claim it has. I distinguish between two strategies that are available to the nominalist: The Evaluation Programme, which tries to preserve the common truth-values of mathematical statements even if there are no mathematical objects, and Fictionalism, which denies that mathematical sentences have significant truth-values. It is argued that the tenability of both strategies depends on the nominalist's ability to account for the notion of consequence. This is a problem because the usual meta-logical explications of consequence do themselves quantify over mathematical entities. While nominalists of both varieties may try to appeal to a primitive notion of consequence, or, alternatively, to primitive notions of logical or structural possibilities, such measures are objectionable. Even if we are equipped with a notion of either consequence or possibility that is primitive in the relevant sense, it will not be strong enough to account for the consequence relation required in classical mathematics. These examinations are also useful in assessing the possible counter-intuitive appeal of the argument from the philosophy of logic.

This paper offers an explanation of how philosophy of science in the second half of the 20th century came to be so conspicuously silent on the problem of how to explain the applicability of mathematics. It examines the idea of the early logicists that the analyticity of mathematics accounts for its applicability, and how this idea was transformed during Carnap's efforts to establish a consistent and substantial philosophy of mathematics within the larger framework of Logical Empiricism. I argue that at the end point of this development, philosophical discussion of the applicability problem was terminated although important aspects of the logicists' original response to the applicability problem had had to be sacrificed along the way.

When interests and preferences of researchers or their sponsors cause bias in experimental design, data interpretation or dissemination of research results, we normally think of it as an epistemic shortcoming. But as a result of the debate on science and values, the idea that all extra-scientific influences on research could be singled out and separated from pure science is now widely believed to be an illusion. I argue that nonetheless, there are cases in which research is rightfully regarded as epistemologically deficient due to the influence of preferences on its outcomes. I present examples from biomedical research and offer an analysis in terms of social epistemology.

Scientific research that requires space flight has always been subject to comparatively strong external control. Its agenda has often had to be adapted to vacillating political target specifications. Can space scientists appeal to one or the other form of the widely acknowledged principle of freedom of research in order to claim more autonomy? In this paper, the difficult question of autonomy within planned research is approached by examining three arguments that support the principle of freedom of research in differing ways. Each argument has its particular strengths and limitations. Together they serve to demonstrate particular advantages of scientific autonomy, but in the case of space science, their force ultimately remains limited. However, as the arguments highlight the interrelations between scientific autonomy, the democratic process and the collective interest in scientific knowledge, they suggest that a coherent and sustained space science agenda might best be ensured by increasing the transparency of science policy decisions and involving the democratic public

Traditional nomological accounts of scientific explanation have assumed that a good scientific explanation consists in the derivation of the explanandum’s description from theory (plus antecedent conditions). But in more recent philosophy of science the adequacy of this approach has been challenged, because the relation between theory and phenomena in actual scientific practice turns out to be more intricate. This critique is here examined for an explanatory paradigm that was groundbreaking for 20th century physics and chemistry (and their interrelation): Bohr’s first model of the atom and its explanatory relevance for the spectrum of hydrogen. First, the model itself is analysed with respect to the principles and assumptions that enter into its premises. Thereafter, the origin of the model’s explanandum is investigated. It can be shown that the explained “phenomenon” is itself the product of a host of modelling accomplishments that stem from an experimental tradition related to 19th century chemistry, viz. spectroscopy. The relation between theory and phenomenon is thus mediated in a twofold way: by (Bohr’s) theoretical model and a phenomenological model from spectroscopy. In the final section of the paper an account is outlined that nevertheless permits us to acknowledge this important physico-chemical achievement as a case of (nomological) explanation.

Transdisciplinarity includes the assumption that within new institutional settings, scientific research becomes more closely responsive to practical problems and user needs and is therefore often subject to considerable application pressure. This raises the question whether transdisciplinarity affects the epistemic standards and the fruitfulness of research. Case studies show how user-orientation and epistemic innovativeness can be combined. While the modeling involved in all cases under consideration was local and focused primarily on features of immediate practical relevance, it was informed by theoretical insights from basic research. Conversely, industrial research turns out sometimes to produce theoretical understanding. These findings highlight an interactive relationship between science and technology (moderate emergentism), which is distinct from the traditional view of a one-sided dependence of technology on science (cascade model) and from the newly received independence account (emergentism).

The late 19th century debate among German-speaking physicists about theoretical entities is often regarded as foreshadowing the scientific realism debate. This paper brings out differences between them by concentrating on the part of the earlier debate that was concerned with the conceptual consistency of the competing conceptions of matter---{}mainly, but not exclusively, of atomism. Philosophical antinomies of atomism were taken up by Emil Du Bois-Reymond in an influential lecture in 1872. Such challenges to the consistency of atomism had repercussions within the physics community, as can be shown for the examples of Heinrich Hertz and Ludwig Boltzmann. The latter developed a series of counter-arguments, culminating in an ingenious attempt to turn the tables on the critics of atomism and prove the inconsistency of non-atomistic conceptions of nature. Underlying this controversy is a disagreement over specific goals of physical research which was considered crucially relevant to the further course of physical inquiry. It thereby exemplifies an attitude towards the realism issue that can be contrasted with a different, more neutral attitude of construing the realism issue as merely philosophical and indifferent with respect to concrete research programs in physics, which one also occasionally finds expressed in the 19th century controversy and which may be seen as the prevailing attitude of the 20th century debate.

This review presents a summary of Kitcher's book. It also presents some points of criticism: That Kitcher's proposals for a reformed way of organizing scientific research do not take sufficient account of the value of scientific autonomy - in particular, that the importance of political independence grounds a presumption in favor of the autonomy of science that requires a solid consideration before we settle on alternative modes of organization. The review also raises concerns about Kitcher's idea of leaving important decisions to “tutored outsiders”. The notorious framing issues in participatory processes will give disproportionate influence to those who organize the tutoring.

In various debates about science, appeal is made to the freedom of scientific research. A rationale in favor of this freedom is rarely offered. In this paper, two major arguments are reconstructed that promise to lend support to a principle of scientific freedom. According to the epistemological argument, freedom of research is required in order to organize the collective cognitive effort we call science efficiently. According to the political argument, scientific knowledge needs to be generated in ways that are independent of the major political powers because of the important role it plays for the citizens and their capacity to form well-informed political preferences. Both arguments are examined critically in order to identify their strengths and limitations. I argue that the scientific freedom established by both rests on a number of critical preconditions, and that the arguments’ force must be weighed against competing societal interests and values in each case of their application. Appeal to a principle of scientific freedom should therefore never mark the end, but rather the beginning of a public debate about the ends and means of science.

Epistemic trust is crucial for science. This article aims to identify the kinds of assumptions that are involved in epistemic trust as it is required for the successful operation of science as a collective epistemic enterprise. The relevant kind of reliance should involve working from the assumption that the epistemic endeavors of others are appropriately geared towards the truth, but the exact content of this assumption is more difficult to analyze than it might appear. The root of the problem is that methodological decisions in science typically involve a complex trade-off between the reliability of positive results, the reliability of negative results, and the investigation's power. Which balance between these is the ‘correct’ one can only be determined in light of an evaluation of the consequences of all the different possible outcomes of the inquiry. What it means for the investigation to be ‘appropriately geared towards the truth’ thus depends on certain value judgments. I conclude that in the optimal case, trusting someone in her capacity as an information provider also involves a reliance on her having the right attitude towards the possible consequences of her epistemic work. 1 Introduction2 Epistemic Reliance within the Sciences3 Methodological Conventionalism4 Trust in Science5 Conclusions

A recurrent theme in philosophy of science since the early twentieth century is the idea that at least some basic tenets within scientific theories ought to be understood as conventions. Various versions of this idea have come to be grouped together under the label ‘conventionalism’. This chapter presents and discusses some important historical stages in the development of conventionalism. Particular attention is paid to the contributions made by Henri Poincaré, Pierre Duhem and Hans Reichenbach.

Scientific procedures are widely expected to be unbiased, in the sense that they do not single out one specific set of claims about which they yield false results more often than about others. This assumed feature of the practices of science can be called procedural objectivity. I argue that attempts to analyze procedural objectivity on the level of individual rationality fail. The appropriate balance of inductive risks for each scientific investigation hinges upon value judgments for which no binding, ‚neutral‘ standard can be derived from universal principles. I make the case that the perspective of social epistemology offers a much more promising approach to establish a substantial conception of procedural objectivity. I examine two genuinely social elements of the sciences’ procedural objectivity. One consists in conventional standards, which are adopted by research communities in order to facilitate epistemic trust and which impose constraints on methodological choices that affect the balance of inductive risks. The other is constituted by the plurality of approaches within research communities and the mechanism of mutual criticism. Procedural objectivity in science thus becomes understandable as a social phenomenon.

Die philosophische Theorie der Kausalität hat sich bisher stark auf die Analyse des Ursachenidioms „A ist eine Ursache von B“ konzentriert und weitgehend eine entsprechende Relation zwischen Ereignissen als grundlegend für das Phänomen der Kausalität vorausgesetzt. Diese Abhandlung ist ein Plädoyer dafür, die weithin bekannten Schwierigkeiten, die insbesondere in David Lewis’ Umsetzung dieser Strategie zu Tage getreten sind, zum Anlass zu nehmen, die Ursache-Wirkung-Relation als Ausgangspunkt aufzugeben und stattdessen am Begriff des kausalen Einflusses anzusetzen. Außerdem argumentiere ich dafür, dass unter derart veränderten Vorzeichen die bisher eher randständige naturalistische Theorie der Kausalität von Wesley Salmon stark an Attraktivität gewinnt, da sie eine sehr überzeugende Explikation kausaler Einflüsse bereitstellen kann. Der angebliche Nachteil der naturalistischen Theorie, dass sie eine bestimmte physikalische Beschaffenheit der Welt voraussetzt, lässt sich entscheidend relativieren, weil nachgewiesen werden kann, dass auch konkurrierende Explikationen nicht ohne solche Voraussetzungen auskommen

In recent years, the philosophy of Ludwig Boltzmann has become a point of interest within the field of history of philosophy of science. Attention has centred around Boltzmann’s philosophical considerations connected to his defense of atomism in physics. In analysing these considerations, several scholars have attributed a pragmatist stance to Boltzmann. In this paper, I want to argue that, whatever pragmatist traits may be found in Boltzmann’s diverse writings, his defense of atomism in physics can not be analysed this way. In other words, I wish to show that he did not defend atomism as “preferable for its practical virtues”, as has been alleged.1 On the contrary, Boltzmann considered the atomist picture to be indispensable — more precisely, an indispensable prerequisite for making the application of continuous differential equations an understandable enterprise