Will DeepMind’s Breast Cancer Diagnosis AI Replace Specialists?

Demis Hassabis, chief executive officer and co-founder of DeepMind Technologies Ltd., speaks during an event at Google's Kings Cross office in London, U.K., on Tuesday, Nov. 15, 2016. After being criticized for not paying its fair share of British tax, Alphabet Inc.s Google unit is trying to show its a good corporate citizen by offering five hours of free digital skills training to all U.K. residents. Photographer: Simon Dawson/Bloomberg© 2016 Bloomberg Finance LP

Patient data for the DeepMind project was from the UK and the US. Six human radiologists were compared to the computer-based approach for assessing mammograms. The DeepMind team has taken the approach to use artificial intelligence as an assistant, rather than as a replacement for a radiologist, for a few very good reasons. Primarily, it’s hard to get approval to replace doctors with computers. As with Elon Musk’s Neuralink, the road to clinical availability will be a long one.

In order to bring this technology to market, it will likely need to get regulatory approval as a diagnostic medical device and then obtain CE Marking registration. Why a medical device? You may ask yourself why the AI system would be so difficult to gain approval, because, after all, it’s just some software that looks at pictures. Well, breast cancer screening tools, even assistive tools, are highly regulated, as they can lead to very invasive procedures in the case of a false positive, or disease progression in the case of a false negative result. In Europe, the safety and quality standards for medical devices are high, and this means the need for clinical trials, and quality control over many aspects of the project, including the design, development, and even the distribution and installation. It also means broad internal and external audits, and a very tough risk management assessment by outside auditors. Unlike a “me-too product” that can cite a similar device as a predicate, an AI-based system is a one-of-a-kind system than needs to be validated from scratch.

Google is only one of several companies targeting the healthcare market with AI. IBM tried to tackle medical diagnosis head-on with Watson, and although many promising individual results and studies are out there, the medical research community came to feel that the technology overpromised in the demos but under-delivered in everyday clinical application. There are also many students and amateurs working on medical data AI applications. It’s a hot field not limited to Google. And yet, the vast majority of the work in the field remains limited to academic work, because of the high cost and effort of bringing medical AI to market.

A further challenge to bringing DeepMind’s breast cancer screening technology to market is the real risk of fooling an autonomous AI-based medical screening system. In a stunning article filled with fascinating images, a team from Harvard Medical School and MIT presented approaches for fooling this type of AI-based diagnosis system, in their paper “Adversarial Attacks Against Medical Deep Learning Systems”. They found that attempts to fool the system succeeded even when the internal details of the artificial intelligence system was not revealed to the system that fools it. The ability to so completely fool an AI-based system is probably a major factor in the decision to keep humans in the loop, for now. We have seen the same trend in self-driving cars, where the initial promise was full autonomy, but the reality is an increase in driving automation like lane-following and parking assist systems. It’s hard to get people out of the loop in these life-critical applications.

From:forbes.com