phaidra.ustp.at o:7212 DOI 10.60522/o:7212 Chatbot Effectiveness in Health Education: A Comparative Study of Gemini, ChatGPT, and Llama This paper presents a focused analysis of the application of AI-driven chatbots in health education, drawing upon a comparative evaluation of OpenAI’s ChatGPT, Google’s Gemini, and Meta’s Llama. The study examines existing literature on the efficacy of large language models (LLMs) in healthcare, emphasizing their potential and challenges. Through a detailed expert evaluation, the response quality of these chatbots to health-related queries is assessed based on medical correctness, safety, and user satisfaction. Findings from the expert evaluations indicate that while ChatGPT and Gemini consistently deliver responses closely aligned with established medical guidelines, Llama2 shows limitations in clarity and precision. The literature review underscores the rapid advancements in AI technology, yet it also highlights the ongoing concerns about data privacy, response accuracy, and the risk of misinformation in medical contexts. This paper contributes to the growing discourse on integrating AI in healthcare, proposing that while AI chatbots hold promise for enhancing health education and accessibility, careful consideration of their limitations and ethical implications is crucial for their effective deployment. eng Large Language Models AI Healthcare Assessment 2025-07-10T12:09:02.529Z LOMv1.0 Author BEGIN:VCARD VERSION:3.0 N:Kramml;Patrick; FN:Patrick Kramml X-ORCID:https://orcid.org/0009-0007-2984-9461 END:VCARD https://w3id.org/kim/hcrt/scheme https://w3id.org/kim/hcrt/text Textdokument Text LOMv1.0 yes https://creativecommons.org/licenses/by/4.0 application/pdf 964168 https://phaidra.ustp.at/o:7212 https://phaidra.ustp.at/api/object/o:7212/thumbnail LOMv1.0 discipline https://w3id.org/oerbase/vocabs/oefos2012 https://w3id.org/oerbase/vocabs/oefos2012/5 SOCIAL SCIENCES SOZIALWISSENSCHAFTEN https://w3id.org/oerbase/vocabs/oefos2012/508 Media and Communication Sciences Medien- und Kommunikationswissenschaften https://w3id.org/oerbase/vocabs/oefos2012/5080 Media and Communication Sciences Medien- und Kommunikationswissenschaften https://w3id.org/oerbase/vocabs/oefos2012 https://w3id.org/oerbase/vocabs/oefos2012/2 TECHNICAL SCIENCES TECHNISCHE WISSENSCHAFTEN https://w3id.org/oerbase/vocabs/oefos2012/202 Electrical Engineering, Electronics, Information Engineering Elektrotechnik, Elektronik, Informationstechnik https://w3id.org/oerbase/vocabs/oefos2012/2020 Electrical Engineering, Electronics, Information Engineering Elektrotechnik, Elektronik, Informationstechnik https://w3id.org/oerbase/vocabs/oefos2012/202022 Information technology Informationstechnik https://w3id.org/oerbase/vocabs/oefos2012 https://w3id.org/oerbase/vocabs/oefos2012/2 TECHNICAL SCIENCES TECHNISCHE WISSENSCHAFTEN https://w3id.org/oerbase/vocabs/oefos2012/202 Electrical Engineering, Electronics, Information Engineering Elektrotechnik, Elektronik, Informationstechnik https://w3id.org/oerbase/vocabs/oefos2012/2020 Electrical Engineering, Electronics, Information Engineering Elektrotechnik, Elektronik, Informationstechnik https://w3id.org/oerbase/vocabs/oefos2012/202002 Audiovisual media Audiovisuelle Medien https://w3id.org/oerbase/vocabs/oefos2012 https://w3id.org/oerbase/vocabs/oefos2012/6 HUMANITIES GEISTESWISSENSCHAFTEN https://w3id.org/oerbase/vocabs/oefos2012/604 Arts Kunstwissenschaften https://w3id.org/oerbase/vocabs/oefos2012/6040 Arts Kunstwissenschaften