•  86
    A Framework for Assurance Audits of Algorithmic Systems
    with Benjamin Lange, Khoa Lam, Borhane Hamelin, Davidovic Jovana, and Shea Brown
    Proceedings of the 2024 Acm Conference on Fairness, Accountability, and Transparency. forthcoming.
    An increasing number of regulations propose the notion of ‘AI audits’ as an enforcement mechanism for achieving transparency and accountability for artificial intelligence (AI) systems. Despite some converging norms around various forms of AI auditing, auditing for the purpose of compliance and assurance currently have little to no agreed upon practices, procedures, taxonomies, and standards. We propose the ‘criterion audit’ as an operationalizable compliance and assurance external audit framewo…Read more
  •  166
    The Structure of Justification
    In Kurt Sylvan, Ernest Sosa, Jonathan Dancy & Matthias Steup (eds.), The Blackwell Companion to Epistemology, . forthcoming.
  •  145
    In this article, we re-examine Pascal’s Mugging, and argue that it is a deeper problem than the St. Petersburg paradox. We offer a way out that is consistent with classical decision theory. Specifically, we propose a “many muggers” response analogous to the “many gods” objection to Pascal’s Wager. When a very tiny probability of a great reward becomes a salient outcome of a choice, such as in the offer of the mugger, it can be discounted on the condition that there are other symmetric, non-salie…Read more
  •  961
    In this paper I argue that, given the way that AI models work and the way that ordinary human rationality works, it is very likely that people are anthropomorphizing AI, with potentially serious consequences. I start with the core idea, recently defended by Thomas Kelly (2022) among others, that bias involves a systematic departure from a genuine standard or norm. I briefly discuss how bias can take on different explicit, implicit, and “truly implicit” (Johnson 2021) forms such as bias by proxy.…Read more
  •  798
    Algorithmic Bias and Risk Assessments: Lessons from Practice
    with Shea Brown, Jovana Davidovic, Benjamin Lange, and Mitt Regan
    Digital Society 1 (1): 1-15. 2022.
    In this paper, we distinguish between different sorts of assessments of algorithmic systems, describe our process of assessing such systems for ethical risk, and share some key challenges and lessons for future algorithm assessments and audits. Given the distinctive nature and function of a third-party audit, and the uncertain and shifting regulatory landscape, we suggest that second-party assessments are currently the primary mechanisms for analyzing the social impacts of systems that incorpora…Read more
  •  354
    The evidence in perception
    In Maria Lasonen-Aarnio & Clayton Littlejohn (eds.), The Routledge Handbook of the Philosophy of Evidence, Routledge. 2024.
    It is commonly thought that we depend fundamentally on the “evidence of the senses” for our empicial beliefs, including and most directly, our beliefs about our local environment, the spatial world around us. The ultimate evidence we have for our perceptual beliefs is provided in some way by perception or perceptual experience. But what is this evidence? There seem to be three main options: external factualism allows that the evidence include facts about the external world; internal factualism t…Read more
  •  1018
    The algorithm audit: Scoring the algorithms that score us
    with Jovana Davidovic and Shea Brown
    Big Data and Society 8 (1). 2021.
    In recent years, the ethical impact of AI has been increasingly scrutinized, with public scandals emerging over biased outcomes, lack of transparency, and the misuse of data. This has led to a growing mistrust of AI and increased calls for mandated ethical audits of algorithms. Current proposals for ethical assessment of algorithms are either too high level to be put into practice without further guidance, or they focus on very specific and technical notions of fairness or transparency that do n…Read more
  •  168
    Unplanned Coordination: Ensemble Improvisation as Collective Action
    with Jennifer Kayle
    Journal of Social Ontology 7 (2): 143-172. 2021.
    The characteristic features of ensemble dance improvisation (EDI) make it an interesting case for theories of intentional collective action. These features include the high degree of freedom enjoyed by each individual, and the lack of fixed hierarchical roles, rigid decision procedures, or detailed plans. In this article, we present a “reductive” approach to collective action, apply it to EDI, and show how the theory enriches our perspective on this practice. We show, with the help of our theory…Read more
  •  1
    Skepticism and the Foundations of Empirical Justification
    Dissertation, University of Washington. 2008.
    A central project of traditional epistemology is to address skeptical questions and concerns regarding the rationality or epistemic justification of our empirical beliefs, especially beliefs regarding the external world, with the aim of understanding what makes it possible for such beliefs to have or lack justification, and of determining how much justification we have. A prominent anti-skeptical view in the history of epistemology, a view I shall call classical foundationalism, can be distingui…Read more
  •  593
    Is Theism Rational?
    In Graham Oppy & Joseph W. Koterski (eds.), Theism and Atheism: Opposing Viewpoints in Philosophy, Macmillan Reference. pp. 119-26. 2019.
    This chapter centers around the question of whether theism is rational. We begin by discussing different theories of rationality, and introducing some importantly related epistemic concepts and controversies. We then consider the possible sources of rational belief in God and argue that even if these provide some positive support, the fact of religious disagreement defeats the rationality of theism.
  •  344
    Skepticism and Spatial Objects
    International Journal for the Study of Skepticism 8 (2): 73-95. 2018.
    I defend external world realism. I assume that the principle of inference to the best explanation is justified: roughly, a hypothesis that provides a better explanation of the total evidence is more probable than one that does not. I argue that the existence of a world of spatial objects provides a systematic explanation of the spatial contents of visual experience, and that it provides a better explanation than traditional skeptical hypotheses. This paper thus pursues the explanationist strateg…Read more
  •  105
    Laurence BonJour and more recently James Beebe have argued that the best way to defend the claim that abduction or inference to the best explanation is epistemically justified is the rationalist view that it is justified a priori. However, rationalism about abduction faces a number of challenges. This chapter focuses on one particular, highly influential objection, that there is no interpretation of probability available which is compatible with rationalism about abduction. The rationalist who w…Read more
  •  1247
    The “problem of memory” in epistemology is concerned with whether and how we could have knowledge, or at least justification, for trusting our apparent memories. I defend an inductive solution—more precisely, an abductive solution—to the problem. A natural worry is that any such solution would be circular, for it would have to depend on memory. I argue that belief in the reliability of memory can be justified from the armchair, without relying on memory. The justification is, roughly, that my ha…Read more
  •  123
    We ordinarily take it as obvious that we acquire knowledge of our world on the basis of sensory perception, and that such knowledge plays a central cognitive and practical role in our lives. Upon reflection, however, it is far from obvious what perception involves and how exactly it contributes to our knowledge. Indeed, skeptical arguments have led some to question whether we have any knowledge, or even rational or justified belief, regarding the world outside our minds. Investigating the natur…Read more
  •  73
    Review of Albert Casullo, Essays on A Priori Knowledge and Justification (review)
    Notre Dame Philosophical Reviews (2014). 2014.
  •  2049
    Classical Foundationalism and Bergmann’s Dilemma for Internalism
    Journal of Philosophical Research 36 391-410. 2011.
    In Justification without Awareness (2006), Michael Bergmann presents a dilemma for internalism from which he claims there is “no escape”: The awareness allegedly required for justification is either strong awareness, which involves conceiving of some justification-contributor as relevant to the truth of a belief, or weak awareness, which does not. Bergmann argues that the former leads to an infinite regress of justifiers, while the latter conflicts with the “clearest and most compelling” motiv…Read more
  •  2884
    Internalist Foundationalism and the Sellarsian Dilemma
    Res Philosophica 90 (2): 171-184. 2013.
    According to foundationalism, some beliefs are justified but do not depend for their justification on any other beliefs. According to access internalism, a subject is justified in believing some proposition only if that subject is aware of or has access to some reason to think that the proposition is true or probable. In this paper I discusses a fundamental challenge to internalist foundationalism often referred to as the Sellarsian dilemma. I consider three attempts to respond to the dilemma –…Read more
  •  481
    In “Compassionate Phenomenal Conservatism” (2007), “Phenomenal Conservatism and the Internalist Intuition” (2006), and Skepticism and the Veil of Perception (2001), Michael Huemer endorses the principle of phenomenal conservatism, according to which appearances or seemings constitute a fundamental source of (defeasible) justification for belief. He claims that those who deny phenomenal conservatism, including classical foundationalists, are in a self-defeating position, for their views cannot be…Read more
  •  8180
    Al-Ghazali (1058-1111) was concerned that early Islamic philosophers were leaning too heavily and uncritically on Aristotelian and Neoplatonic ideas in developing their models of God and His relation to the world. He argued that their views were not only irreligious, but philosophically problematic, and he defended an alternative view aimed at staying closer to the Qur’an and the beliefs of the ordinary Muslim. Ibn Rushd (1126-1198) responded to al-Ghazali’s critique and developed a sophistica…Read more
  •  209