Integrating artificial intelligence (AI) into medical education poses barriers and opportunities for medical educators. One of those opportunities is content creation for medical ethics assessment. Assessing the performance of AI in generating multiple choice questions (MCQs) in ethics that aligns with United States Medical Licensing Examination (USMLE) is important. The present study evaluates the performance of eight AI models—GPT-4 Turbo, GPT-3.5 Turbo 0125, o1 Mini, o1 Preview, GPT-4, Claude…
Read moreIntegrating artificial intelligence (AI) into medical education poses barriers and opportunities for medical educators. One of those opportunities is content creation for medical ethics assessment. Assessing the performance of AI in generating multiple choice questions (MCQs) in ethics that aligns with United States Medical Licensing Examination (USMLE) is important. The present study evaluates the performance of eight AI models—GPT-4 Turbo, GPT-3.5 Turbo 0125, o1 Mini, o1 Preview, GPT-4, Claude 3.5 Sonnet, Claude 3 Opus, and Gemini—in regard to the relevance, clarity, and accuracy of generated ethics-based MCQs.