| Yazarlar (2) |
Dr. Öğr. Üyesi Aybüke TAYARER
Kırşehir Ahi Evran Üniversitesi Tıp Fakültesi, Türkiye |
Kadir Kangal
Kırşehir Ahi Evran Üniversitesi, Türkiye |
| Özet |
| Introduction In recent years, language models supported by artificial intelligence have been increasingly utilized in healthcare counseling. This study aims to evaluate the reliability and clinical safety of ChatGPT-3.5 by assessing the medical accuracy, content completeness, and communication quality of its responses to pregnancy-related patient scenarios through expert review. Methods Forty clinical scenarios reflecting common pregnancy concerns across all trimesters were developed. These were entered into ChatGPT-3.5, and its responses were independently evaluated by two obstetricians using an 8-item, 5-point Likert scale assessing medical accuracy, misinformation, missing information, urgency perception, referral appropriateness, home care suggestions, harmful recommendations, and language quality. A Global Quality Score (GQS) from 1 to 5 was also assigned. Internal consistency was analyzed using Cronbach's alpha, and inter-rater agreement for GQS was evaluated via Cohen's Kappa after categorization into low, moderate, and high-quality groups. Results ChatGPT's responses demonstrated high internal consistency across evaluation domains (Cronbach's alpha = 0.872). Cohen's Kappa for GQS agreement was 0.15, indicating slight agreement. No misinformation or harmful suggestions were identified. Most responses were medically appropriate, although some contained minor informational gaps. In 90% of the scenarios, evaluators placed responses in the same GQS category. Conclusion ChatGPT-3.5 shows promise as a supportive digital tool for pregnancy-related counseling. However, it is not fully aligned with current ... |
| Anahtar Kelimeler |
| Makale Türü | Özgün Makale |
| Makale Alt Türü | Uluslararası alan indekslerindeki dergilerde yayınlanan tam makale |
| Dergi Adı | Eskisehir Medical Journal, Eskisehir City Hospital |
| Dergi Tarandığı Indeksler | |
| Makale Dili | İngilizce |
| Basım Tarihi | 01-2026 |
| Cilt No | 7 |
| Sayı | 1 |
| Sayfalar | 12 / 17 |
| DOI Numarası | 10.48176/esmj.2025.228 |
| Makale Linki | https://doi.org/10.48176/esmj.2025.228 |
| Atıf Sayıları |
