Strategies for creation of data reserve and stress testing of medical AI products.

Abstract

With the fast development of artificial intelligence (AI) and its applications in medicine, it is often said that the time for intelligent medicine is arriving, if not already have arrived. While there is no doubt that AI-centred intelligent medicine will transform current healthcare, it is necessary to test and re-test medical AI (MAI) products before they are implemented in the real world. From the perspective of ensuring safety, accuracy and efficiency, it is imperative that MAIs undergo stress tests in a systematic and comprehensive manner where stress tests subject MAIs to workloads and environments beyond tests carried out by their developers. In such stress tests, potential bottlenecks or failures of MAIs may be identified and fed back to developers to optimise the products. To avoid bias and ensure fairness, stress tests should be prepared and administered by an independent body.