October
Tuesday, October 28, 2025
8:00am-9:00am PT
Watch Recording Here
Shreya Shah, MD
Clinical Associate Professor
Stanford University
Title: The Implementation and Evaluation of Generative AI Solutions in Healthcare
Abstract: Generative AI has the potential to enhance healthcare outcomes and patient experience while reducing clinician burden. As healthcare organizations consider integrating these novel AI technologies, it is crucial to ensure appropriate applications that address meaningful healthcare challenges. Rigorous evaluation is essential for any generative AI deployment in clinical practice to understand the potential benefits and challenges, inform iterative improvements for technology developers, and support organizations in scaling these solutions effectively. Our mixed-methods approach to evaluation leverages implementation science and qualitative evaluation frameworks that are adaptable to diverse generative AI applications. We present examples of real-world evaluations of generative AI implementations. Use cases include AI-generated draft replies to patient messages and draft-result comments and to mitigate electronic health record in-basket burden, as well as ambient AI scribes to reduce clinical documentation burden.
Shreya Shah, MD, FACP is a physician leader in healthcare informatics, board certified in clinical informatics and internal medicine. She is a clinician, educator, and researcher, with special interests in artificial intelligence and health IT usability. As a Medical Informatics Director of Primary Care and Population Health for Stanford Medicine, she leads the design, implementation and optimization of health information technology in support of clinicians and patients at Stanford. She is also an Associate Medical Director of the Stanford Healthcare AI Research Team, also known as the "HEA3RT" team, whose vision is to be a global leader in the implementation, evaluation, and teaching of AI in health and health care.