Mark H. Herman

Cognitive heuristics, as proffered by Daniel Kahneman and Amos Tversky, are reasoning shortcuts that are useful but flawed. For example, the availability heuristic “infers” an event’s probability, not by performing laborious, ideally rational calculations, but by simply assessing the ease with which similar events can be recalled. Cognitive psychologists presume that cognitive heuristics should be identified with a distinct cognitive mechanism. I argue that this is a mistake ultimately stemming from descriptive rational choice theory’s entangling of descriptive and normative theorizing. Such mechanism-identification is a desideratum for kinds used in answering, “How—in a causal-mechanical sense—do we reason?” However, cognitive heuristics befit a different question, namely, “How—in a contrastive sense—do we reason vis-à-vis ideal rationality?” Clarifying cognitive heuristics’ nature and appropriate explanatory expectations can enhance understanding, provide lessons applicable elsewhere, and illuminate an important episode in the history of cognitive psychological science.

The capacity to act in accordance with one’s morality (broadly construed) is constitutive of moral agency. This capacity can be undermined—in whole or in part—by for instance, hypnosis, addiction, or obsessive-compulsion. Another way this capacity can be undermined is through poor moral reasoning. Moral irrationality can frustrate one’s capacity to act in accordance with one’s morality and in turn, stunt one’s moral agency. In a similar respect, improving moral rationality can strengthen this capacity and enhance moral agency. The empirical research program on (non-moral) cognitive debiasing inspires developing techniques to improve our moral rational capacities—i.e., moral debiasing. Yet, moral debiasing presupposes moral biases—that is, systematic moral errors. So, what are moral errors exactly? The pertinent kind is subjective moral errors. Ultimately, A’s φ-ing is a subjective moral error insofar as φ-ing deviates from A’s genuine morality per instrumental subjective moral rationality (ISMR)—i.e., insofar as φ-ing frustrates A+’s morally-relevant ends, wherein A+ is a counterfactual idealization of A upon whom is bestowed those endowments that A considers authoritative under ordinary optimal conditions. The provision of an in-principle standard of subjective moral error lays important theoretical groundwork for future empirical inquiry into subjective moral debiasing.

In this dissertation, I construct scientifically and practically adequate moral analogs of cognitive heuristics and biases. Cognitive heuristics are reasoning “shortcuts” that are efficient but flawed. Such flaws yield systematic judgment errors—i.e., cognitive biases. For example, the availability heuristic infers an event’s probability by seeing how easy it is to recall similar events. Since dramatic events, such as airplane crashes, are disproportionately easy to recall, this heuristic explains systematic overestimations of their probability (availability bias). The research program on cognitive heuristics and biases (e.g., Daniel Kahneman’s work) has been scientifically successful and has yielded useful error-prevention techniques—i.e., cognitive debiasing. I attempt to apply this framework to moral reasoning to yield moral heuristics and biases. For instance, a moral bias of unjustified differences in the treatment of particular animal species might be partially explained by a moral heuristic that dubiously infers animals’ moral status from their aesthetic features. While the basis for identifying judgments as cognitive errors is often unassailable (e.g., per violating laws of logic), identifying moral errors seemingly requires appealing to moral truth, which, I argue, is problematic within science. Such appeals can be avoided by repackaging moral theories as mere “standards-of-interest” (a la non-normative metrics of purportedly right-making features/properties). However, standards-of-interest do not provide authority, which is needed for effective debiasing. Nevertheless, since each person deems their own subjective morality authoritative, subjective morality (qua standard-of-interest and not moral subjectivism) satisfies both scientific and practical concerns. As such, (idealized) subjective morality grounds a moral analog of cognitive biases—namely, subjective moral biases (e.g., committed anti-racists unconsciously discriminating). I also argue that "cognitive heuristic" is defined by its contrast with rationality. Consequently, heuristics explain biases, which are also so defined. However, such contrasting with rationality is causally irrelevant to cognition. This frustrates the presumed usefulness of the kind, heuristic, in causal explanation. As such, in the moral case, I jettison the role of causal explanation and tailor categories solely for contrastive explanation. As such, “moral heuristic” is replaced with "subjective moral fallacy," which is defined by its contrast with subjective morality and explains subjective moral biases. The resultant subjective moral biases and fallacies framework can undergird future empirical research.