Hamid Seyedsayamdost

In recent years a new discussion on the nature of philosophical expertise has emerged: whether philosophers possess a special kind of expertise, what such expertise would entail, how to measure it, and related concerns. The aim of the present article is to clarify certain related points across these debates in the hope of paving a clearer path forward, by addressing the following. (1) The expertise defense, which seems central to many discussions on methodology and expertise, has been misconstrued at times. (2) Questions of expertise and methodology could be separated more clearly. (3) The study of expertise may be important in its own right; however, there may be good reasons to give priority to methodological concerns. (4) Finally, when viewed in light of methodological concerns, a new project emerges when engaging with recent contributions to the expertise debate. The present article attempts a brief outline of this project.

The field of experimental philosophy has received considerable attention, essentially for producing results that seem highly counter-intuitive and at the same time question some of the fundamental methods used in philosophy. A substantial part of this attention has focused on the role of intuitions in philosophical methodology. One of the major contributions of experimental philosophy on this topic has been concrete evidence in support of intuitional diversity; the idea that intuitions vary systematically depending on variables such as ethnicity, socioeconomic background, or gender. Because of the important implications, these findings have been the subject of extensive debate. Despite the seeming significance of the findings and despite all the debates that the experimental philosophy movement has prompted, what has not been examined systematically is the reproducibility of the results. Instead, the reported findings have been simply accepted as established facts. We set out to replicate a wide range of experiments and surprisingly failed to reproduce many of the reported findings, some of which are from the most cited and attention grabbing papers of the field. We draw two conclusions from our findings. The first is that the instability of intuitions has been exaggerated by experimental philosophers. Intuitions appear to be more uniform across different demographic groups. The argument that intuitions need to be discarded because they depend on arbitrary factors such as ethnicity, socioeconomic background, or gender does not seem tenable anymore. The second conclusion is that experimental philosophy needs a better system to ensure the reproducibility of published findings. The current research-publication system of various empirical fields, especially those employing statistical methods, leads to an overproduction of false-positive findings in the published literature. Unless changes are made to the current research-publication system, this overproduction is likely to continue, in experimental philosophy as well as other disciplines.

In their paper titled “Gender and philosophical intuition,” Buckwalter and Stich argue that the intuitions of women and men differ significantly on various types of philosophical questions. Furthermore, men's intuitions, so the authors claim, are more in line with traditionally accepted solutions of classical problems. This inherent bias, so the argument goes, is one of the factors that leads more men than women to pursue degrees and careers in philosophy. These findings have received a considerable amount of attention and the paper is to appear in the second edition of Experimental Philosophy edited by Knobe and Nichols , which itself is an influential outlet. Given the exposure of these results, we attempted to replicate three of the classes of questions that Buckwalter and Stich review in their paper and for which they report significant differences. We failed to replicate the results using several different sources for data collection (one being identical to the original procedures..

In one of the earlier influential papers in the field of experimental philosophy titled Normativity and Epistemic Intuitions published in 2001, Jonathan M. Weinberg, Shaun Nichols and Stephen Stich reported that respondents answered Gettier type questions differently depending on their ethnic background as well as socioeconomic status. There is currently a debate going on, on the significance of the results of Weinberg et al. (2001) and its implications for philosophical methodology in general and epistemology in specific. Despite the debates, however, to our knowledge, there has not been a replication attempt of the experiments of the original paper. We collected data from four different sources (two on-line and two in-person) to replicate the experiments. Despite several different data sets and in various cases larger sample sizes and hence greater power to detect differences, we failed to detect significant differences between the above-mentioned ethnic and socioeconomic groups. Our results suggest that epistemic intuitions are more robust across ethnic and socioeconomic groups than Weinberg et al. (2001) indicates. Given our data, we believe that the notion of differences in epistemic intuitions among different ethnic and socioeconomic groups that follows from Weinberg et al. (2001) needs to be corrected.