ChatGPT Can Hallucinate: Dubai Medical College Dean Urges Students to Verify AI Data
<p><strong>Dubai:</strong> Artificial intelligence (AI) is revolutionising education — but with power comes responsibility. A Dubai-based medical college dean has urged students to <strong>verify data generated by AI tools such as ChatGPT</strong>, warning that blind trust in technology could lead to academic and clinical errors.</p><p>Speaking at the <strong>ninth Gulf News Edufair Dubai 2025</strong>, <strong>Dr. Wafaa Al Johani</strong>, Dean of <strong>Batterjee Medical College, Dubai</strong>, highlighted both the promise and pitfalls of AI in higher education.</p><p>“AI, telecommunication, and all kinds of smart technologies are now <strong>mandatory and integral parts of medical education</strong>,” Dr. Al Johani said during a panel titled <i>‘From White Coats to Smart Care: Adapting to a New Era in Medicine’</i>.<br>“But we have to be careful. It has positive and negative sides,” she cautioned, stressing the importance of <strong>academic integrity and ethical AI use</strong>.</p><h3><strong>AI hallucination — a growing concern</strong></h3><p>Dr. Al Johani explained that AI tools are now deeply embedded in healthcare education — from <strong>virtual patient simulations</strong> and <strong>digital anatomy labs</strong> to <strong>AI-assisted diagnostic systems</strong>.</p><p>However, she warned that <strong>generative AI systems like ChatGPT can sometimes produce incorrect or fabricated information</strong>, a phenomenon known as an <strong>“AI hallucination.”</strong></p><p>“If you ask ChatGPT for a treatment plan or a medication regimen, it might give you a drug that’s <strong>no longer in use</strong>. Sometimes it even provides <strong>references that don’t exist</strong>,” she said.</p><p>Her message to students was clear: “You have to <strong>find the source, read the article, and verify the data</strong> before using it in your research or reports.”</p><h3><strong>Integrity and ethics in the AI era</strong></h3><p>According to Dr. Al Johani, the rise of AI means <strong>digital literacy, ethical awareness, and data integrity</strong> are no longer optional — they are <strong>core competencies</strong> for the next generation of healthcare professionals.</p><p>“We are seeing students submit assignments <strong>copied directly from ChatGPT</strong>. This is not learning,” she said.<br>“Students need to understand <strong>data privacy, confidentiality</strong>, and the <strong>ethics of using technology</strong> responsibly.”</p><p>Her comments echoed growing global concerns about the misuse of generative AI in academia, where institutions are struggling to balance innovation with authenticity.</p><h3><strong>Blending smart tools with human learning</strong></h3><p>At Batterjee Medical College, AI is being incorporated responsibly into the curriculum. Students train with <strong>high-fidelity mannequins</strong> and <strong>hybrid simulation models</strong> that combine digital and real patient interactions — bridging the gap between theory and clinical practice.</p><p>“These simulation-based training systems help students make better clinical decisions without risking patient safety,” Dr. Al Johani explained.</p><p>She added that the goal is not to replace human expertise but to <strong>enhance learning through technology</strong>.</p><h3><strong>“AI will never replace humans”</strong></h3><p>Dr. Al Johani also reminded students that AI should be viewed as a <strong>partner, not a threat</strong>.</p><p>“AI will never replace humans. It will replace <strong>those who are unable to use it</strong>,” she said.<br>“So, keep the doors open, stay curious, and keep learning.”</p><p>Her message resonated strongly with the audience, as students and educators alike grapple with how to integrate AI responsibly in classrooms and clinics.</p><h3><strong>Why AI literacy matters</strong></h3><p>Experts at Edufair 2025 agreed that <strong>AI literacy</strong> is becoming a key employability skill across all fields — especially in medicine, where precision and accountability are critical.</p><p>By encouraging <strong>critical thinking, fact-checking, and ethical awareness</strong>, educators like Dr. Al Johani aim to prepare students not just for tomorrow’s hospitals, but for a world where <strong>data drives every decision</strong>.</p><p>“Technology will keep evolving,” she concluded. “But it’s our <strong>human judgment and integrity</strong> that will always define real intelligence.”</p>