Translational AI in Critical Care

What we do

In this research, we apply safety assurance frameworks to AI-based clinical decision support tools, to identify and mitigate safety risks that could lead to patient harm.

Why it is important

Establishing confidence in the safety of AI-based clinical decision support systems is important prior to clinical deployment and regulatory approval for systems of increasing autonomy. Our work provide a use case for the systematic safety assurance of AI-based clinical systems, towards the generation of explicit safety evidence, which could be replicated for other AI applications or other clinical contexts, and inform medical device regulatory bodies.

How it can benefit patients

This study provides a use case for the systematic safety assurance of AI-based clinical decision support systems, which has proven to be one of the many hurdles that slow down clinical deployment and assessment of those tools.

Summary of current research

We used expert-defined safety scenarios against which we tested AI-based clinical decision support systems prior to clinical deployment, and compared them to human clinicians’ performance. In the particular case of AI systems based on reinforcement learning (which attempt to maximise rewards), we showed that we could tweak the reward signal to improve reinforcement learning performance within predefined safety constraints.