Research Area:  Machine Learning

Abstract:

A number of large technology companies have created code-free cloud-based platforms that allow researchers and clinicians without coding experience to create deep learning algorithms. In this study, we comprehensively analyse the performance and featureset of six platforms, using four representative cross-sectional and en-face medical imaging datasets to create image classification models. The mean (s.d.) F1 scores across platforms for all model–dataset pairs were as follows: Amazon, 93.9 (5.4); Apple, 72.0 (13.6); Clarifai, 74.2 (7.1); Google, 92.0 (5.4); MedicMind, 90.7 (9.6); Microsoft, 88.6 (5.3). The platforms demonstrated uniformly higher classification performance with the optical coherence tomography modality. Potential use cases given proper validation include research dataset curation, mobile edge models for regions without internet access, and baseline models against which to compare and iterate bespoke deep learning approaches.

Keywords:  

Author(s) Name:  Edward Korot, Zeyu Guan, Daniel Ferraz, Siegfried K. Wagner, Gongyu Zhang, Xiaoxuan Liu, Livia Faes, Nikolas Pontikos, Samuel G. Finlayson, Hagar Khalid, Gabriella Moraes, Konstantinos Balaskas, Alastair K. Denniston & Pearse A. Keane

Publisher name:  Springer Nature

DOI:  10.1038/s42256-021-00305-2

Volume Information:  volume 3, pages288–298 (2021)

Paper Link:   https://www.nature.com/articles/s42256-021-00305-2