There is no doubt that epistemically opaque processes, those whose internal mechanisms cannot be surveyed by agents, are indispensable in many epistemically notable and high-stakes contexts. But when, if ever, can we secure epistemic justification in their uses? This article provides a framework for approaching this problem, particularly in the context of machine learning, by first offering a four-part taxonomy of epistemic opacity made to unify the landscape of distinctions in the current liter…
Read moreThere is no doubt that epistemically opaque processes, those whose internal mechanisms cannot be surveyed by agents, are indispensable in many epistemically notable and high-stakes contexts. But when, if ever, can we secure epistemic justification in their uses? This article provides a framework for approaching this problem, particularly in the context of machine learning, by first offering a four-part taxonomy of epistemic opacity made to unify the landscape of distinctions in the current literature. Using this framework, I develop and criticize Jack Casey’s thesis that an agent's tolerance for opacity is determined by their position in the scientific realism/antirealism debate and show that this correspondence ultimately breaks down. Instead, I argue that this tolerance is determined by an agent’s affinity for an externalist or internalist theory of epistemic justification. Internalists, linked to some kind of accessibility, should be driven toward transparency programs, while externalists, prioritizing truth-conduciveness, can in principle accept opacity outright. Yet, drawing on the current literature on mechanistic interpretability, XAI and computational reliabilism, I then submit that both positions are problematic, and that the most tenable position would be given by a hybrid theory of justification outside of the classical internalist/externalist epistemological paradigm.