Marika Dawn Warren

Integrating large language models (LLMs) like GPT-4 into medical ethics is a novel concept, and understanding the effectiveness of these models in aiding ethicists with decision-making can have significant implications for the healthcare sector. Thus, the objective of this study was to evaluate the performance of GPT-4 in responding to complex medical ethical vignettes and to gauge its utility and limitations for aiding medical ethicists. Using a mixed-methods, cross-sectional survey approach, a panel of six ethicists assessed LLM-generated responses to eight ethical vignettes. The main outcomes measured were relevance, reasoning, depth, technical and non-technical clarity, as well as acceptability of GPT-4’s responses. The readability of the responses was also assessed. Of the six metrics evaluating the effectiveness of GPT-4’s responses, the overall mean score was 4.1/5. GPT-4 was rated highest in providing technical (4.7/5) and non-technical clarity (4.4/5), whereas the lowest rated metrics were depth (3.8/5) and acceptability (3.8/5). There was poor-to-moderate inter-rater reliability characterised by an intraclass coefficient of 0.54 (95% CI: 0.30 to 0.71). Based on panellist feedback, GPT-4 was able to identify and articulate key ethical issues but struggled to appreciate the nuanced aspects of ethical dilemmas and misapplied certain moral principles. This study reveals limitations in the ability of GPT-4 to appreciate the depth and nuanced acceptability of real-world ethical dilemmas, particularly those that require a thorough understanding of relational complexities and context-specific values. Ongoing evaluation of LLM capabilities within medical ethics remains paramount, and further refinement is needed before it can be used effectively in clinical settings.

Our aim in this article is to define the difficulties that clinical ethics services encounter when they are asked to demonstrate the value a clinical ethics service (CES) could and should have for an institution and those it serves. The topic emerged out of numerous related presentations at the Un- Conference hosted by the Cleveland Clinic in August 2018 that identified challenges of articulating the value of clinical ethics work for hospital administrators. After a review these talks, it was apparent that the field of clinical ethics may be at a crisis of sorts due to increased pressure to provide explicit measures to healthcare institutions to concretely demonstrate that CESs make a valuable difference in healthcare delivery. In this article, we grapple with how to satisfy the need for demonstrable value in a field in which metrics alone may not capture the scope of clinical ethics practice. We suggest that capturing the value of a CES has been difficult because the benefits of ethics consultation may be overt or attributable to the CES, but are often hidden due to the systems-level and process-oriented nature of clinical ethics work. Part of the difficulty in demonstrating the value of CESs is capturing and conveying all of the ways the integration of a CES throughout an institution positively affects patients, families, visitors, healthcare professionals, administrators, and the institution itself. Our aim is to (1) elucidate the multifaceted value added by a CES, including value that tends to be hidden and (2) suggest how to demonstrate value to others in a way that is not simplistic or reductionistic.