The following is a guest article by Shelli Pavone, Co-Founder and President at Inlightened

In a rapidly shifting healthcare landscape, AI has emerged as a promising tool to boost efficiency, improve care, and reduce costs. Yet, results from a recent survey conducted by our team, as well as other sources such as the much-discussed MIT study, reveal that while many doctors are already using AI, significant gaps remain between its current implementation and full potential. 

For healthcare innovators, these findings present a call to action to design, build, and scale AI tools in lockstep with physicians’ real-world needs and expectations, and to provide guidelines to ensure its effective and responsible execution. 

Physicians Don’t Feel Fully Prepared for AI 

Our survey found that more than half of doctors are already using AI at work for tasks like documentation, billing, chatbots, and diagnostics. Despite those adoption numbers, respondents reported that their organizations are not providing guidance: 38% said their health systems lack any formal policies or protocols for AI use. And, more telling still: only 28% feel prepared to leverage AI’s benefits while also protecting patients from its risks. 

The Role of Physician Accountability Must be Considered 

While 52% believe AI will be an ally in their current role, many also view it as both ally and threat. For those who described it as the latter, 3 out of 4 worry they’ll be held accountable for errors generated by AI tools. For innovators, that means establishing trust early – and demonstrating trustworthy algorithms – to the physicians who will ultimately be using tools to treat patients. Once trust has been compromised, the likelihood of it being used by, and valuable for, physicians on the front lines is greatly reduced.  

What Doctors Need from AI Innovators 

There are five key areas companies can create value as they’re designing new AI tools for healthcare. 

First, build with clinicians in mind. Including physicians in ideation, prototype feedback, and integration planning will help build tools that truly support delivery of care workflow. 

Second, prioritize inclusivity and bias mitigation. Innovators must actively engage diverse stakeholders throughout the process to ensure their tools work equitably across populations.

Third, deliver functional, transparent tools – not just demos. Respondents voiced frustration that AI tools often underdeliver when tested in real clinical settings. Therefore, clear performance benchmarks, limited trial access, and upfront transparency are key. 

Fourth, invest in integration, education, and ongoing support. Doctors are calling for AI tools that integrate into existing EHR systems and workflows, accompanied by education and decision-support features that make their jobs easier, not harder. 

Lastly, create tools that deliver a competitive edge. Of the doctors currently using AI tools, more than 1 out of 4 believe doing so is a competitive advantage, while only 11% claim they have been able to capture more revenue to-date. 

Despite all of the noise when it comes to AI in healthcare, the reality is, 1 out of every 5 physicians report they are behind in their use of AI, representing a vast opportunity – and directive – for innovators. Tools must make sense for them, their staff, and patients. What we saw in the data, and we continue to see anecdotally, is that the companies offering one tool that addresses one pain point will fall behind those that take time to understand doctors’ unique needs and pain points and develop solutions that support patient, provider, and business needs. The innovators and solutions that will stand out are those that provide better tools that reflect doctors’ workflows, anticipate their needs, and help them build trust with patients.

About Shelli Pavone

Shelli Pavone is Co-Founder and President at Inlightened. She has more than 20 years of commercial experience in healthcare and is dedicated to partnering with clinicians and innovators alike to help shape the future of the industry. Shelli was named a Forbes‘ Next 1000 and is a graduate of The Ohio State University, with a BS in Psychology.