James Hastings

Background: The integration of artificial intelligence (AI) into health care has become a crucial element in the digital transformation of health systems worldwide. Despite the potential benefits across diverse medical domains, a significant barrier to the successful adoption of AI systems in health care applications remains the prevailing low user trust in these technologies. Crucially, this challenge is exacerbated by the lack of consensus among experts from different disciplines on the definition of trust in AI within the health care sector. Objective: We aimed to provide the first consensus-based analysis of trust in AI in health care based on an interdisciplinary panel of experts from different domains. Our findings can be used to address the problem of defining trust in AI in health care applications, fostering the discussion of concrete real-world health care scenarios in which humans interact with AI systems explicitly. Methods: We used a combination of framework analysis and a 3-step consensus process involving 18 international experts from the fields of computer science, medicine, philosophy of technology, ethics, and social sciences. Our process consisted of a synchronous phase during an expert workshop where we discussed the notion of trust in AI in health care applications, defined an initial framework of important elements of trust to guide our analysis, and agreed on 5 case studies. This was followed by a 2-step iterative, asynchronous process in which the authors further developed, discussed, and refined notions of trust with respect to these specific cases. Results: Our consensus process identified key contextual factors of trust, namely, an AI system’s environment, the actors involved, and framing factors, and analyzed causes and effects of trust in AI in health care. Our findings revealed that certain factors were applicable across all discussed cases yet also pointed to the need for a fine-grained, multidisciplinary analysis bridging human-centered and technology-centered approaches. While regulatory boundaries and technological design features are critical to successful AI implementation in health care, ultimately, communication and positive lived experiences with AI systems will be at the forefront of user trust. Our expert consensus allowed us to formulate concrete recommendations for future research on trust in AI in health care applications. Conclusions: This paper advocates for a more refined and nuanced conceptual understanding of trust in the context of AI in health care. By synthesizing insights into commonalities and differences among specific case studies, this paper establishes a foundational basis for future debates and discussions on trusting AI in health care.

While genomic and proteomic information describe the overall cellular machinery available to an organism, the metabolic profile of an individual at a given time provides a canvas as to the current physiological state. Concentration levels of relevant metabolites vary under different conditions, in particular, in the presence or absence of different disorders. Metabolite concentrations thus mediate an important link between chemistry and biology, contributing to a systems-wide understanding of biological processes and pathways. However, there are a number of challenges in the ontological representation of such information. Firstly, concentration information is numeric and ranges over continuous values, while ontologies consist of discrete classes. Secondly, ontologies usually model only what is certain, and their logical formalisms are adapted to reasoning from certain axioms to logical deductions, however, the link between chemicals and diseases via concentration levels, like many threshold phenomena, is both uncertain and vague. In this paper we evaluate the representation of this knowledge using a combination of concrete domains and probabilistic reasoning. We parse concentration values from HMDB and create an ontology able to distinguish normal from abnormal concentrations and able to evaluate a probabilistic risk category for the presence of an associated disorder.

Ontologies aim to represent what is general, by means of universal statements. In contrast, dispositional predications capture knowledge about what is likely to happen if a certain set of circumstances obtain, which is crucial in investigative research such as in drug discovery and systems biology, where entities which are constitutionally dissimilar can nevertheless have similar behavior in a biological context. While such dispositional properties are increasingly included in biomedical ontologies, the circumstances under which the dispositions are realized are seldom explicitly modeled, and doing so is problematic due to the necessary restriction to binary relations in OWL ontologies. In this paper we address this shortcoming, focusing on the bioactivity of small molecules at varying levels of concentration within a living organism as our problem domain, although our approach is generalizable to other problems. We discuss the ontological nature and representation of dispositions and their realization; consider the nature of concentrations and their representation; and finally we detail an approach to linking dispositions to the conditions for their realization which regards conditions as triggers for the process in which the disposition is realized.