At the Healthcare Innovation Summit, discussions centered on ensuring technology serves those providing and receiving care, with leaders stressing the need to address specific clinical issues rather than adopting technology for its own sake. This approach, they argued, ensures meaningful impact in healthcare delivery.
Involving frontline staff and patients in the design and implementation of new tools helps prevent unintended consequences and enhances usability. Agentic AI systems can automate routine tasks and reshape team roles, but require careful risk management, clear boundaries, and human oversight.
Robust cybersecurity, privacy safeguards, and contingency plans are essential as digital ecosystems expand and AI tools handle sensitive data. Measuring the value of innovation over time, with defined success metrics, ensures that new solutions deliver tangible benefits and justify investments.
Pavitra Krishnamani, M.D., of MD Anderson Cancer Center, encouraged attendees to think beyond what technology can do and consider what healthcare organizations actually need it to do. Her work includes bringing people from different disciplines together to explore AI and digital health.
Improving Clinician Experience
At Houston Methodist, leaders are working to reduce the administrative burden on clinicians and improve the care experience. One initiative involves ambient listening technology to support nursing documentation, with the goal of giving nurses more time to focus on patients.
The experience illustrates a challenge that can get lost in discussions about new technology: even a well-intentioned improvement can create unintended consequences when it meets the realities of a busy clinical environment. Leaders need to understand how a new tool affects existing responsibilities, where it adds friction, and what changes would make it genuinely useful.
Treating implementation as an ongoing process, not a one-time decision, is essential. Frontline feedback needs to be part of the process from the beginning, helping health systems refine their approach as they learn what works. Involving the people who will use a technology in shaping how it is implemented is essential to making sure it works in practice and delivers the intended benefits.
As healthcare organizations expand virtual services, they are exploring ways to connect more of the care experience, including home-based services and tools that help clinicians anticipate problems earlier. The larger goal is to make care more responsive to patients’ circumstances, not simply more convenient to deliver.
Related Post: Virtual Care Boosts Clinicians’ Ability to Close Gaps
Autonomous Systems in Healthcare
Jordan Dale, M.D., vice president, CMIO and chief health AI officer at Houston Methodist, described the organization’s use of a voice agent called Zoe in its call center. The system handles routine tasks such as rescheduling appointments autonomously, with monitoring in place. For more consequential interactions, the process can involve a human agent who verifies the information before it moves forward.
This approach illustrates a practical way to approach autonomous systems: match the degree of autonomy to the level of risk. A routine appointment change is different from an interaction in which an error could damage a new patient’s trust or disrupt care. As these technologies become more capable, health systems will need to be increasingly deliberate about where automation makes sense and where human judgment should remain central.
The panelists cautioned against giving AI broad authority before an organization has defined what it should accomplish. Their advice was to start with a narrow use case, specify the desired outcome and success measures, and establish what decisions the system is allowed to make. Organizations also need to consider access permissions, user segmentation, reliable backups, and the ability to intervene when something goes wrong.
Cybersecurity expert Richard Staynings emphasized the importance of understanding what information an AI system can access, how that information is used and retained, which vendors are involved, and what happens if the system is compromised or behaves unexpectedly. Organizations need incident response plans that account for AI-specific risks rather than assuming existing procedures will cover every scenario.
Governance and Cybersecurity
Governance cannot be left to IT and security teams alone. Clinicians, operational leaders, privacy and legal specialists, human resources, and executive decision-makers all have a role in determining how AI should be used and what safeguards are appropriate. Staff members also need enough AI literacy to recognize errors, understand the limits of a tool, and know how to escalate a concern.
When technology fails, patient care still has to continue. The experience of an electronic health record implementation more than two decades ago highlights the importance of having backups, recovery procedures, and contingency plans in place. Richard Staynings’ account of this experience shows that patient care was affected after just seven minutes without the EHR.
As AI becomes more embedded in healthcare workflows, organizations need to think carefully about how they will operate when a system is unavailable, produces unreliable results, or must be taken offline.
Memorial Hermann’s approach to care coordination brings together nurses, social workers, and community health workers to help patients work through the period after a hospital stay and address issues that can interfere with recovery.
Leave a Reply