Multidimensional Evaluation of AI-Generated Patient Information on Cone Beam–Computed Tomography

MakaleAçık ErişimScopus SJRQ1
  • SDG 3 · Sağlık ve Kaliteli Yaşam

Özet

This study aimed to conduct a multidimensional evaluation of artificial intelligence (AI) chatbot–generated patient information regarding cone beam–computed tomography (CBCT) in dentistry, with specific focus on readability, informational quality, reliability, and patient-centered suitability. Twenty frequently asked, patient-oriented questions related to CBCT were systematically identified from a public online forum. Each question was submitted to four large language model–based chatbots (ChatGPT-4o, Gemini Advanced, Claude Sonnet 4, and Microsoft Copilot) under standardized conditions. Generated responses were evaluated using validated instruments, including the DISCERN tool and Global Quality Scale (GQS) for information quality and reliability, as well as Flesch Reading Ease, Flesch–Kincaid Grade Level, and Gunning Fog Index for readability. Patient-centeredness was further assessed using PEMAT-Understandability and PEMAT-Actionability scores. Comparative analyses were performed using linear mixed-effects models. Significant differences were observed among chatbots across all evaluated domains (p < 0.05). While advanced models demonstrated higher informational quality and reliability, their responses frequently exceeded recommended health literacy thresholds. Readability, transparency, and actionability varied substantially between platforms. No chatbot consistently met all criteria for optimal patient-directed communication. AI chatbots can provide generally accurate information on CBCT; however, variability in readability, reliability, and educational suitability limits their standalone use for patient education. Careful integration with professional oversight is essential to ensure safe and accessible AI-supported communication in dentomaxillofacial radiology. This study provides the first multidimensional, comparative evaluation of leading AI chatbots in delivering patient-oriented information about cone beam–computed tomography. It shows critical gaps between informational accuracy and health literacy suitability. This study reveals the need for professional oversight when using AI for patient education in dentomaxillofacial radiology.

Anahtar Kelimeler

RDL Kalıcı Bağlantı (PID)
https://rdlopen.rawdatalibrary.net/r/kostu/10641Resmi atıflarda kullanılan kalıcı adres
DOI
https://doi.org/10.1007/s10278-026-01976-2Yayıncı resmi DOI adresi
İndeks kayıtları
Kaydın indeks veri tabanlarındaki sayfası (aktarımda alınan kayıt numarasıyla). Erişim, indeksin kendi koşullarına bağlıdır.
Atıflar
Scopus
0
WoS
0
OpenAlex
0
Her kaynağın kendi saydığı toplam atıf; aktarım ve zenginleştirme sırasında alındı.
Tam Kayıt
AlanDeğerDil
dc.contributor.authorÖçbe, Melisa
dc.contributor.authorAkçay, Hülya Çerçi
dc.contributor.authorSır, Eda
dc.contributor.authorTaş, Çağan
dc.contributor.authorErbalta, Rana
dc.date.accessioned2026-10-27T23:47:42.136272929Z
dc.date.available2026-10-27T23:47:42.136272929Z
dc.date.issued2026
dc.description.abstractThis study aimed to conduct a multidimensional evaluation of artificial intelligence (AI) chatbot–generated patient information regarding cone beam–computed tomography (CBCT) in dentistry, with specific focus on readability, informational quality, reliability, and patient-centered suitability. Twenty frequently asked, patient-oriented questions related to CBCT were systematically identified from a public online forum. Each question was submitted to four large language model–based chatbots (ChatGPT-4o, Gemini Advanced, Claude Sonnet 4, and Microsoft Copilot) under standardized conditions. Generated responses were evaluated using validated instruments, including the DISCERN tool and Global Quality Scale (GQS) for information quality and reliability, as well as Flesch Reading Ease, Flesch–Kincaid Grade Level, and Gunning Fog Index for readability. Patient-centeredness was further assessed using PEMAT-Understandability and PEMAT-Actionability scores. Comparative analyses were performed using linear mixed-effects models. Significant differences were observed among chatbots across all evaluated domains (p < 0.05). While advanced models demonstrated higher informational quality and reliability, their responses frequently exceeded recommended health literacy thresholds. Readability, transparency, and actionability varied substantially between platforms. No chatbot consistently met all criteria for optimal patient-directed communication. AI chatbots can provide generally accurate information on CBCT; however, variability in readability, reliability, and educational suitability limits their standalone use for patient education. Careful integration with professional oversight is essential to ensure safe and accessible AI-supported communication in dentomaxillofacial radiology. This study provides the first multidimensional, comparative evaluation of leading AI chatbots in delivering patient-oriented information about cone beam–computed tomography. It shows critical gaps between informational accuracy and health literacy suitability. This study reveals the need for professional oversight when using AI for patient education in dentomaxillofacial radiology.
dc.description.sponsorshipTürkiye Bilimsel ve Teknolojik Araştırma Kurumu, TUBITAK
dc.identifier.doi10.1007/s10278-026-01976-2
dc.identifier.eissn2948-2933
dc.identifier.issn2948-2933
dc.identifier.pmid42045764
dc.identifier.scopus2-s2.0-105037312475
dc.identifier.urihttps://rdlopen.rawdatalibrary.net/r/kostu/10641
dc.identifier.wosWOS:001751937800001
dc.language.isoen
dc.publisherSpringer Nature
dc.relation.ispartofJournal of Imaging Informatics in Medicine
dc.rightsinfo:eu-repo/semantics/openAccess
dc.subjectArtificial intelligence
dc.subjectCone beam–computed tomography
dc.subjectLarge language models
dc.subjectOral radiology
dc.subject.classificationRadiology, Nuclear Medicine & Medical Imaging
dc.subject.otherComputerized tomography
dc.subject.otherRadiology
dc.subject.otherReliability
dc.subject.otherActionability
dc.subject.otherChatbots
dc.subject.otherCone-beam computed tomography
dc.subject.otherHealth literacy
dc.subject.otherLanguage model
dc.subject.otherLarge language model
dc.subject.otherMulti-dimensional evaluations
dc.subject.otherOral radiology
dc.subject.otherPatient information
dc.subject.otherPatient-oriented
dc.subject.otherArtificial intelligence
dc.titleMultidimensional Evaluation of AI-Generated Patient Information on Cone Beam–Computed Tomography
dc.typeArticle
rdl.citation.openalex0
rdl.citation.scopus0
rdl.citation.wos0
rdl.departmentDepartment of Oral and Maxillofacial Radiology, Faculty of Dentistry, Kocaeli Health and Technology University, Kocaeli, 41275, Turkey
rdl.departmentDepartment of Pedodontics, Faculty of Dentistry, Kocaeli Health and Technology University, Kocaeli, 41275, Turkey
rdl.departmentDepartment of Oral and Maxillofacial Radiology, Faculty of Dentistry, Kocaeli Health and Technology University, Yeniköy Merkez, Ilıca Cd. No:29, Başiskele/Kocaeli, 41275, Turkey
rdl.departmentFaculty of Dentistry, Kocaeli Health and Technology University, Kocaeli, 41275, Turkey
rdl.oa.statushybrid
rdl.oa.urlhttps://link.springer.com/content/pdf/10.1007/s10278-026-01976-2.pdf
rdl.publication.statusinPress
rdl.scopus.quartileQ1
rdl.sdgSDG03
rdl.source.indexSCOPUS
rdl.source.indexWOS
rdl.source.indexPUBMED
rdl.wos.indexScience Citation Index Expanded (SCI-EXPANDED)