Evaluating the Efficacy of ChatGPT vs. Google Gemini in Generating Patient Education Materials for GLP-1 Receptor Agonists (Semaglutide, Liraglutide, Tirzepatide): A Cross-Sectional Study.

INTRODUCTION: Diabetes management involves using various oral hypoglycemic agents, including new glucagon-like peptide-1 (GLP-1) receptor agonists like semaglutide, tirzepatide, and liraglutide. Artificial intelligence (AI) tools such as ChatGPT (OpenAI, San Francisco, United States) and Google Gemini (Google DeepMind, London, United Kingdom) provide an innovative approach to creating patient education materials, potentially enhancing the accessibility and understanding of medical information. Thus, the study aimed to compare the effectiveness of ChatGPT and Google Gemini in generating patient education brochures for semaglutide, tirzepatide, and liraglutide. Key criteria included readability, similarity, and reliability of the generated content. METHODOLOGY: The cross-sectional study design was conducted in June 2024, involving data collection from ChatGPT-3.5 and Google Gemini. Each AI tool generated educational brochures for the three medications. The responses were evaluated using Flesch-Kincaid readability scores, Quillbot similarity analysis, and a modified DISCERN instrument for reliability assessment. Statistical analysis included univariate t-tests and Pearson's coefficient of correlation via RStudio v4.3.2 (Posit, Boston, United States). RESULTS: ChatGPT generated longer brochures with higher word counts compared to Google Gemini, which had better readability scores. Similarity analysis showed that Google Gemini's content had a higher percentage of overlap. Both AI tools demonstrated high reliability scores, with no significant difference between them. CONCLUSIONS: Google Gemini provided more readable content, while ChatGPT produced slightly more detailed information. Both AI tools were effective in generating reliable patient education materials for GLP-1 receptor agonists. However, future research should incorporate more AI tools and updated versions for comprehensive analysis.