![](/Portals/0/KeyTakeaway28%20%281%29.png)
Join the discussion in the Almanac Community.
In this article, we summarize results of the first-ever survey of Alliance members’ usage of, attitudes toward and concerns about the use of generative AI in CME/CPD. This survey was conducted and analyzed in November–December 2023. In the few months since then, AI has continued to advance at a bewildering pace. Accordingly, we suspect that AI use among Alliance members has continued to evolve. To further assess trends in AI use in CME/CPD, we will be conducting a follow-up survey of the Alliance membership in the fall of 2024.
Methodology and Demographics
Approximately 200 Alliance members responded to the November 2023 survey. The majority (54%) were between 35 to 54 years old, with 29% between 55 to 64. Most respondents (71%) had over a decade of experience in the field, ensuring that our findings represent the perspectives of seasoned professionals. Based on this demographic spread, we are reasonably confident that our findings represent the perspectives of seasoned professionals in the field.
AI Adoption at a Crossroads
The most striking find was a near-even split in AI adoption: 51% of respondents reported using AI for professional purposes, while 49% did not. This even division suggests that our field was at a critical juncture in terms of AI integration at the time of the survey.
For non-users, common reasons included:
- Concerns about the technology
- Lack of familiarity
- Uncertainty about relevance to CME/CPD
- Organizational prohibitions (8% of respondents)
Among AI users, ChatGPT emerged as the dominant tool, with 89% of users reporting experience with it. Other platforms like Bing AI and Bard saw significantly lower adoption rates, at less than 20% each. It's worth noting that at the time of the survey, Microsoft had just begun integrating AI into Office and tools like Copilot were not yet widely available.
Significant Concerns Amid Optimism
While 64% of respondents were optimistic about AI's role in CME/CPD, there were widespread concerns about accuracy (72%), quality (60%) and potential biases (36%) in AI outputs. This highlights the need for guidance and best practices in AI implementation.
Organizational Policies Lagging
Only 21% of respondents reported that their organizations had guidelines for appropriate AI use, suggesting a significant gap between AI adoption and formal governance structures in the CME/CPD field.
Applications and Concerns
Respondents reported diverse applications of AI, including:
- Marketing and communication tasks, such as crafting campaign copy for ads and promotional email blasts
- Assistance with needs assessments, practice gap identification and learning objective development
- Educational content creation, including slides, patient cases, content outlines and assessment questions
- Data analysis and outcomes summarization, such as synthesizing learner data from post-activity surveys
However, concerns were widespread:
- 72% of respondents expressed worries about the accuracy of AI-generated results
- 60% had reservations about output quality
- 51% noted the issue of AI hallucinations
- 36% raised concerns about potential biases in AI outputs
Some respondents expressed more specific concerns. One noted, "There's a risk of over-reliance on AI, which could lead to a degradation of professional skills and expertise." Another worried about "the potential homogenization of educational content if multiple providers rely too heavily on AI for content direction."
Organizational Readiness
The survey revealed a significant gap between AI adoption and organizational preparedness. Only 21% of respondents reported that their organizations had guidelines for appropriate AI use. This discrepancy suggests a need for more robust governance structures as AI integration continues.
One respondent highlighted the challenges of organizational adoption: "We're in the early stages of understanding AI, and it takes time to learn new processes and integrate them into our workflows.”
Future Outlook
Despite the challenges, the overall sentiment toward AI in CME/CPD was predominantly positive. Sixty-four percent of respondents expressed optimism about AI's future role in the field, with 27% neutral and only 9% pessimistic.
Those expressing optimism cited potential benefits such as improved information aggregation, increased productivity and cost and time savings. One enthusiastic respondent noted, "AI has the potential to automate tasks and generate content, freeing us up to focus on higher-level strategic work."
Implications of These Findings
This inaugural survey provides a valuable benchmark for understanding AI's place in CME/CPD as of late 2023. It reveals a field actively engaging with AI, grappling with its potential benefits and challenges. The near even split in adoption, coupled with widespread optimism, suggests we may be on the cusp of more widespread AI integration. However, the concerns raised about accuracy, quality and ethical implications underscore the need for careful consideration as we move forward. The gap between adoption and organizational readiness also highlights an area requiring attention. In the field of CME/CPD, this highlights an urgent need for AI literacy programs for CME/CPD professionals and development of best practices and ethical guidelines for AI use. These are matters we suggest the Alliance is well-suited to address in support of the profession.
For full details on this survey, please review this PDF that comprehensively lays out most of the AI survey questions that were asked.
What’s Next in AI?
The pace of AI development has been astonishingly rapid over the past 6 months. Consider that at the time of the November 2023 survey:
- ChatGPT was the only large language model (LLM) that most of us had ever used, with 89% reporting use. Bing and Bard AI were a distant second and third (less than 20% usage for each). Today, ChatGPT still dominates, but some of us are trying out other LLMs such as Claude from Anthropic and apps like Elicit and Perplexity that attempt to bridge the gap between generative AI and scientific evidence.
- Microsoft had just started to integrate AI into Office. We didn’t even ask about Copilot AI in our survey. Today, many of us are getting Copilot access. Additionally, it seems like nearly every app, everywhere, is getting an AI integration.
- At the time of the survey, video rendering tools like Sora AI and Luna Dream Machine were not available. Today, anyone can generate a remarkably realistic video in minutes by typing in a simple text prompt (here’s our first attempt — a group of physicians interacting with an advanced human body simulation).
As we move forward, it's clear that the Alliance has a crucial role to play in supporting your AI journey. Survey respondents overwhelmingly endorsed the need for AI guidelines, best practices, workshops and case studies. In response, the Alliance has formed an AI Task Force to proactively address these needs and ensure responsible AI integration in our field.
With these advances in mind, we encourage you to participate in the next Alliance AI survey this fall. It’s crucial to understand how the use of generative AI is evolving in our community over time. Your insights will be crucial to characterizing the developments since the initial benchmark survey described in this article.
--
AI Disclosure
ChatGPT was used to process and summarize the write-in survey responses that are discussed in this article.
Acknowledgements
These insights on AI use in CME/CPD were made possible through the efforts of a broad array of Alliance members, including the authors of this article (Andrew Bowser, Andrew Crim, Dustin Ensign and Brian McGowan); members of the Research Committee (Kelsey Caras, Jas Chahal, Sally Haas, Esther Nyarko, Kevin Obholz and Board Liaison Allison Gardner); the PEERS member section (Bethany Banner, Emily Belcher, Tabitha Gai, Don Harting, Anita Misra-Press, R. Michelle [Tyner] Skidmore and Kim Vadas) and Alliance staffers Ashley Barr, Angela Belusik and Danielle Callen. We are especially indebted to Jan Schultz, Immediate Past President of the Alliance, for her leadership and support in the development and execution of this research effort.
![](/Portals/0/Author%20Headshots%20%282%29.png)
Andrew D. Bowser, ELS, CHCP, has been active in the CME/CPD community for more than two decades and is the immediate past chair of the Alliance Research Committee. In that capacity, he led the development of the inaugural survey of AI practices among the Alliance membership. Andrew currently serves on the Alliance AI Task Force, where he is working to help develop Alliance guidelines for the use of AI in CME/CPD.
Brian McGowan, Ph.D., FACEHP, has served in leadership positions in numerous providers and commercial supporters. He is a Fellow of the Alliance (FACEhp), has served on numerous committees, launched the Outcomes Standardization Project, launched and hosted the Alliance Legends Podcast Interview series, and currently hosts the JCEHP Emerging Best Practices in CPD podcast. He recently co-led the development of the inaugural survey of AI practices among the Alliance membership and serves on the Alliance AI Task Force, where he is working to help develop Alliance guidelines for the use of AI in CME/CPD. In 2012 he co-founded ArcheMedX, Inc, a healthcare informatics and e-learning company to apply his research in practice. You can follow him on X (formerly Twitter) (@BrianSMcGowan) and connect with him on LinkedIn.
Andrew Crim, M.Ed., CHCP, FACEHP, is the director of education and professional development for the American College of Osteopathic Obstetricians and Gynecologists (ACOOG). He has more than 27 years’ experience in adult learning and instructional design of continuing education for health professionals, especially for physicians, nurses and pharmacists. He has developed and overseen thousands of continuing education activities for healthcare professionals in North Texas, throughout the state and around the country. His efforts and interests are focused on using education as a catalyst for clinical improvement and increased safety in healthcare. Andy serves on the board of directors of the Alliance for Education in the Health Professions and serves on the accreditation subcommittee of the Texas Medical Association. In May 2024, he was appointed as chair of the Texas Council for Developmental Disabilities by Governor Greg Abbott. Mr. Crim is a Fellow of the Alliance for Education in the Health Professions and his work has been recognized through numerous professional awards, including the ACEHP’s Felch Award for Outstanding Research in CE and the Award for Innovation in the CPD Enterprise. He was also co-author of a peer-reviewed manuscript based on his research.
Dustin Ensign, BSc, CHCP, has been active in the CME/CPD community for more than a decade serving as the program lead for medical education support across a number of small to large pharma, biotech and diagnostics companies. He has been recognized as a distinguished member by the Alliance for Continuing Education in the Health Professions (2023) and as one of the Almanac “Authors of the Year” (2024). He is a member of the Alliance Research Committee and the Alliance Annual Conference Awards Review Committee.