<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.36775.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Opinion Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Proposal of a novel Artificial Intelligence Distribution Service platform for healthcare</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 2 approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>V&#x00e4;&#x00e4;n&#x00e4;nen</surname>
                        <given-names>Antti</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-8870-9692</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Haataja</surname>
                        <given-names>Keijo</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Vehvil&#x00e4;inen-Julkunen</surname>
                        <given-names>Katri</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-6828-8261</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Toivanen</surname>
                        <given-names>Pekka</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>School of Computing, University of Eastern Finland, Kuopio, Pohjois-Savo, FI-70211, Finland</aff>
                <aff id="a2">
                    <label>2</label>Department of Nursing Science, University of Eastern Finland, Kuopio, Pohjois-Savo, FI-70211, Finland</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:antti.vaananen@uef.fi">antti.vaananen@uef.fi</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>26</day>
                <month>3</month>
                <year>2021</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>10</volume>
            <elocation-id>245</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>10</day>
                    <month>2</month>
                    <year>2021</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 V&#x00e4;&#x00e4;n&#x00e4;nen A et al.</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/10-245/pdf"/>
            <abstract>
                <p>In this paper, we focus on presenting a novel AI-based service platform proposal called AIDI (Artificial Intelligence Distribution Interface for healthcare). AIDI proposal is based on our earlier research work in which we evaluated AI-based healthcare services which have been used successfully in practice among healthcare service providers. We have also used our systematic review about AI-based healthcare services benefits in various healthcare sectors. This novel AIDI proposal contains services for health assessment, healthcare evaluation, and cognitive assistant which can be used by researchers, healthcare service provides, clinicians, and consumers. AIDI integrates multiple health databases and data lakes with AI service providers and open access AI algorithms. It also gives healthcare service providers open access to state-of-the-art AI-based diagnosis and analysis services. This paper provides a description of AIDI platform, how it could be developed, what can become obstacles in the development, and how the platform can provide benefits to healthcare when it will be operational in the future.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Artificial Intelligence</kwd>
                <kwd>AI Platform</kwd>
                <kwd>Healthcare AI</kwd>
                <kwd>AI Distribution</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>Digiteknologian TKI-ymparist&#x00f6; project (ERDF, Regional Council of Pohjois-Savo)</funding-source>
                    <award-id>A74338</award-id>
                </award-group>
                <funding-statement>This work was supported by Digiteknologian TKI-ymparist&#x00f6; project (ERDF, Regional Council of Pohjois-Savo) [A74338].</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec1" sec-type="intro">
            <title>1 Introduction</title>
            <p>Implementing Artificial Intelligence (AI) methods in healthcare services is the key element for reducing healthcare costs and improving health outcome. This have been proven in several studies where benefits of AI methods have been compared with the traditional process
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup>. Even if there are proven benefits when implementing methods using AI into healthcare services there are also many issues which need to be taken into account if we would like to see AI to have a breakthrough in the field of healthcare. We need to proceed with AI as one technology of augmented intelligence solution where AI will be helping clinicians and healthcare decision makers providing more accurate diagnosis, predictions, and guidance. We can accept AI as a natural evolution in healthcare information technology (IT) only when all actors can see benefits of AI and these benefits can be identified and approved by all actors in healthcare processes. To provide better chance of success to AI evolution or even &#x201c;revolution&#x201d;, we must provide the possibility to healthcare services developers and researchers to access scientifically studied and validated state-of-the-art AI methods and health information databases to enhance healthcare processes and healthcare outcome. These AI methods and databases should be accessible transparently and without high costs or regulatory barriers. Some companies, such as GE Healthcare, are already working with AI platforms which make quick implementation of proprietary AI algorithms or third-party AI algorithms possible inside one platform
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup>.</p>
            <p>Our novel AIDI platform will be designed to provide easy access interface for healthcare service providers, healthcare IT companies, and researchers for utilizing state-of-the-art third party or self-developed AI methods for specific healthcare use cases. It contains cloud-based AI services which can be integrated to other end user organizations&#x2019; healthcare service platforms with open application programming interfaces (APIs). These AI services can be used by clinicians or other healthcare stakeholders for providing support in decision making. AIDI can be used for new AI methods validation and evaluation purposes. The goal of the state-of-the-art AIDI platform is to provide more accurate and cost-effective diagnosis, predictions to healthcare, and give researchers and developers a platform to validate and evaluate new AI methods.</p>
            <p>The paper is organized as follows. 
                <xref ref-type="sec" rid="sec1">Section 1</xref> provides an overview of the AI benefits in healthcare sector and rationale for the development of AIDI platform. 
                <xref ref-type="sec" rid="sec2">Section 2</xref> gives an architectural and technical overview of AIDI platform. 
                <xref ref-type="sec" rid="sec3">Section 3</xref> discusses use cases, benefits, and issues of AIDI platform development. Finally, 
                <xref ref-type="sec" rid="sec13">Section 4</xref> concludes the paper and sketches some future work.</p>
        </sec>
        <sec id="sec2">
            <title>2 AIDI architecture and technical overview</title>
            <p>In this section we provide an abstract architectural design of AIDI and details of its interfaces, application/software stack, and intended use. 
                <xref ref-type="fig" rid="f1">Figure 1</xref> shows the basic architecture of AIDI containing actual server with data repository interfaces for data repositories and AI service providers, proprietary and public AI methods and algorithms database, and interface for end users. AIDI services will be operated in a cloud environment such as Microsoft Azure or similar.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>Basic architecture of AIDI.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/39838/29b9e779-cc39-496c-ba6a-22f85886c3dc_figure1.gif"/>
            </fig>
            <p>AIDI contains applications, service models, and data interfaces to end users, such as healthcare service development companies and healthcare service providers, researchers, and individuals. AIDI also has data interfaces to health databases, imaging databases, and AI service and algorithm providers. 
                <xref ref-type="fig" rid="f2">Figure 2</xref> shows AIDI technology stack components.</p>
            <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                <label>Figure 2. </label>
                <caption>
                    <title>AIDI technology stack.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/39838/29b9e779-cc39-496c-ba6a-22f85886c3dc_figure2.gif"/>
            </fig>
            <p>AIDI technology is capable of parallel processing of vast amounts of data from multiple data sources and will provide real-time analytics for research purposes and clinical decision making. Technology stack modules will be developed by using basic software development tools and open source software modules. It contains four layers: Front-End, Data Processing, Integration, and Data Storage.</p>
            <p>
                <bold>Front-end</bold> layer consists of web-based user interface (UI) for main application features, such as graphic tools and views of services and applications, selection of databases, analytics tools, and internal or third-party AI methods. Front-end contains also a separate analytics view where end users can see analytics of processed data and implement analysis view to own healthcare services or applications. It can be used by developers and researchers for own AI method testing and evaluation and comparison to other similar AI methods. Moreover, front-end contains UI for integration purposes where end users can configure own data integration settings, provide input data for AI, and implement own AI methods and data repositories. Front-end can be developed with Python and/or with ReactJS and data visualization can be enriched with streaming services visualization tools.</p>
            <p>
                <bold>Data processing</bold> layer includes processing and analyzing methods for training data and user data with AI based processes. Pseudonymization and harmonization provide extra security layer to anonymization and harmonize data which can be received from multiple open or proprietary data lakes or data repositories. Machine learning processor can be used to perform data processing tasks, such as deep learning and supervised/unsupervised learning. Machine vision processor will provide AI, for example, image recognition and feature extraction needs. Natural language processor runs AI methods for language processing tasks, such as content extraction, classification, text generation, and machine translation. For data analysis and processing we can use third-party machine learning platforms, such as OpenAI
                <sup>
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup>, Tensor Flow
                <sup>
                    <xref ref-type="bibr" rid="ref4">4</xref>
                </sup>, IBM Watson
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>
                </sup>, and Azure Cognitive Services
                <sup>
                    <xref ref-type="bibr" rid="ref6">6</xref>
                </sup>, and technologies, such as Python, and AI libraries, such as OpenCV, SciKit Learn, and Pandas.</p>
            <p>
                <bold>Integration layer</bold> contains APIs for external databases, such as radiology imaging services (DICOM standard), hospital information systems (HL7 standard), and other third-party databases and data lakes (XML and JSON messaging formats). External data can be used as teaching data for AI methods. AI services API will provide integration to third-party AI algorithms and services, such as OpenAI, Tensor Flow, IBM Watson, and Azure Cognitive Services. AIDI open API will provide integration technology to end users to upload own data and AI methods to AIDI. For integration and data streaming AIDI can utilize streaming service platforms, such as Google Cloud Dataflow, Apache Kafka, or Amazon Kinesis.</p>
            <p>
                <bold>Data storage layer</bold> has repositories for public and proprietary AI algorithms as well as database for AI teaching data retrieved from external databases or from end user database. End user database is used for maintaining users and organizations in AIDI services. AIDI has also service to import/export virtual machines and databases that AIDI can be easily installed to a cloud service, such as Microsoft Azure or to local server and database if AIDI would be used as proprietary service for specific company or organization use cases.</p>
        </sec>
        <sec id="sec3">
            <title>3 Use cases</title>
            <p>We propose modular AIDI deep learning solution with AIDI&#x2019;s own AI methods and third-party AI methods. As a starting point AIDI will provide AI methods for use cases which are used in prediction, diagnostic, and analytics. Robotic surgery and surgery live monitoring use cases are excluded due to the critical life-threatening nature of these use cases. AIDI solution will be able to analyze high volume data and distributed data and provide diagnosis or analysis from input data in real-time. Catalogue of AI methods can be expanded based on use cases arising from healthcare service providers or healthcare information system developers. We have evaluated that AIDI can include AI services which are explained in sections 3.1-3.9.</p>
            <sec id="sec4">
                <title>3.1 Automatic disease identification/diagnosis</title>
                <p>Efficiency of AI has been identified in eye diseases
                    <sup>
                        <xref ref-type="bibr" rid="ref7">7</xref>
                    </sup>, breast cancer
                    <sup>
                        <xref ref-type="bibr" rid="ref8">8</xref>,
                        <xref ref-type="bibr" rid="ref9">9</xref>
                    </sup>, and skin cancer
                    <sup>
                        <xref ref-type="bibr" rid="ref10">10</xref>
                    </sup> diagnosis when using data mining, natural language processing, and machine vision methods. Furthermore, glucose level prediction is one of the use cases where AI methods have been utilized successfully
                    <sup>
                        <xref ref-type="bibr" rid="ref11">11</xref>
                    </sup>. AI methods can be used for tuberculosis diagnostics
                    <sup>
                        <xref ref-type="bibr" rid="ref12">12</xref>
                    </sup> and prediction of psychosis
                    <sup>
                        <xref ref-type="bibr" rid="ref13">13</xref>
                    </sup>. AIDI platform can implement these studied AI methods to provide direct access to utilize these methods for customers and end users.</p>
            </sec>
            <sec id="sec5">
                <title>3.2 Personalised medicine</title>
                <p>Personalised medicine is tailoring of medical treatment to the individual characteristics of each patient. The approach relies on the understanding of how a person's unique molecular and genetic profile makes them susceptible to certain diseases. Personalised medicine also focuses to provide detection of the diseases at an earlier stage when treatment activities can be applied more effectively
                    <sup>
                        <xref ref-type="bibr" rid="ref14">14</xref>
                    </sup>. AIDI can monitor patient diagnosis and data and based on data provided to pre-trained AI methods AIDI can suggest most effective treatments and/or medication to patient.</p>
            </sec>
            <sec id="sec6">
                <title>3.3 Medication errors and medication non-adherence</title>
                <p>AI methods to detect medication errors and increase medication adherence are used in healthcare sector. AI can be used to create screening system to detect potential medication errors and generate alerts to clinical decision support (CDS) systems and electronic medical record (EMR) systems
                    <sup>
                        <xref ref-type="bibr" rid="ref15">15</xref>
                    </sup>. Machine vision and neural networks have been used efficiently to monitor medication intake by patients to enhance medication adherence. AIDI can provide access to these methods as a service to be utilized by healthcare service providers.</p>
            </sec>
            <sec id="sec7">
                <title>3.4 Identifying candidates for clinical trials</title>
                <p>In clinical trials it is essential to identify potentially eligible patients to create more comprehensive clinical trials with lower costs. AI can be used to help in clinical trial design and to find patterns in large datasets for identifying most suitable patients before clinical trials start and AI can be used also for enabling more effective and accurate monitoring of patients during clinical trials. By using AI methods increase in enrolment in clinical trials has been observed. Furthermore, utilization of AI methods increases identification of eligible patients for clinical trials
                    <sup>
                        <xref ref-type="bibr" rid="ref16">16</xref>
                    </sup>.</p>
            </sec>
            <sec id="sec8">
                <title>3.5 Epidemic outbreak prediction and management</title>
                <p>On-going 2020 Covid-19 pandemic has increased the need to predict the progression of epidemics and pandemics. AI methods can be used for different epidemics by combining and analysing information of spatial spreading and behaviour data of the epidemic. As a result, estimation and prediction of epidemic spreading can be achieved
                    <sup>
                        <xref ref-type="bibr" rid="ref17">17</xref>
                    </sup>. Real-time forecasting of epidemic outbreak with AI have been used in COVID-19 forecasting in China with high accuracy
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>
                    </sup>. Furthermore, AI methods can be used in managing on-going epidemic outbreaks by providing methods for identification of on-going epidemic outbreak, diagnosing and prognosing infections, and identifying possible therapeutic options
                    <sup>
                        <xref ref-type="bibr" rid="ref19">19</xref>
                    </sup>. AIDI methods can provide end users the solutions which utilize data from public and private health databases and data lakes to predict possibility for epidemics.</p>
            </sec>
            <sec id="sec9">
                <title>3.6 Medical image diagnostics</title>
                <p>AI has been used in connection with medical imaging for a long time and the use of AI methods has been extensively studied and proven to surpass human diagnosis in practical clinical work. In the field of medical imaging the AI technologies, such as DNN and DL, can produce remarkable improvement in healthcare outcome and they have proven to provide enhancement in speed, accuracy, and cost reduction in interpretation of medical images
                    <sup>
                        <xref ref-type="bibr" rid="ref20">20</xref>
                    </sup>. Medical image diagnostics can be utilized in healthcare for multiple cases, such as for identifying cardiovascular abnormalities, detecting common eye diseases by optical coherence tomography, detecting musculoskeletal injuries, identifying neurological diseases, identifying thoracic complications, and in oncology for screening common cancers
                    <sup>
                        <xref ref-type="bibr" rid="ref21 ref22 ref23">21&#x2010;23</xref>
                    </sup>. AIDI can provide these validated methods to end users for instant image analysis. Our plan is to provide AI methods for medical image diagnostics as among the first of AIDI services.</p>
            </sec>
            <sec id="sec10">
                <title>3.7 Health monitoring and preventive health</title>
                <p>AI utilization in health monitoring and preventive health consist of solutions for continuous health status monitoring, healthcare assessment tools, and symptom checking solutions which can be used by patients and healthcare professionals periodically or continuously. AI is also commonly used in personal health monitoring and giving personalized suggestions for preventive health based on user parameters, such as activity tracking, nutrition, sleep analysis, weight, body composition, and vital signs, such as blood pressure and blood sugar. Personal health apps are the most common health monitoring solutions which collect data from user smartwatch and smartphone and utilize AI to provide analysis and suggestions for end users. There are also clinical remote monitoring solutions which utilize AI, such as cardiology monitoring, sleep monitoring, and posture monitoring
                    <sup>
                        <xref ref-type="bibr" rid="ref24">24</xref>,
                        <xref ref-type="bibr" rid="ref25">25</xref>
                    </sup>. AIDI can provide periodical/intermittent analytics from the collected data and provide analysis to healthcare services development companies or research organizations.</p>
            </sec>
            <sec id="sec11">
                <title>3.8 Virtual nursing assistants</title>
                <p>Healthcare services utilize AI based virtual nursing assistants in various use cases. By using virtual nursing assistants, hospitals will be able to reduce sudden hospital visits and reduce the load of healthcare professionals. Virtual assistant applications can listen, talk, and give advice/recommendations based on patient conversation, health history and health data of the patient. Common virtual nursing assistant solutions provide pre-diagnosis for patients and healthcare professionals based on the healthcare assessment questionnaire and patient history data before entering the primary care
                    <sup>
                        <xref ref-type="bibr" rid="ref26">26</xref>,
                        <xref ref-type="bibr" rid="ref27">27</xref>
                    </sup>.</p>
            </sec>
            <sec id="sec12">
                <title>3.9 New AI methods evaluation</title>
                <p>AIDI can be used to validate usability of new AI methods. AIDI will contain a growing number of AI methods for healthcare use cases. AIDI also provides access to training data and actual data. New AI methods can be evaluated and validated by comparing new AI method outcome (i.e., identification of accuracy, specificity, or sensitivity) and compare results with previous AI methods results. With this evaluation and validation service third-party AI method developers can create better AI methods which can be utilized in AIDI platform by companies or research organizations. Evaluation can be done by a specific multidisciplinary team and by scoring system in AIDI. This scoring provides end users valuable information about usability of selected AI method in specific use case.</p>
                <p>
                    <bold>As an example of AIDI</bold> we present the process flow of use case where clinicians want to analyse radiology image to identify possible lesion from the image. Steps are explained and shown in 
                    <xref ref-type="fig" rid="f3">Figure 3</xref>:
                    <list list-type="simple">
                        <list-item>
                            <label>1.</label>
                            <p>User sends radiology image to AIDI with information about use case (example case breast cancer analysis).</p>
                        </list-item>
                        <list-item>
                            <label>2.</label>
                            <p>Open API module analyses query and transmits information and asks for details from the user about the use case.</p>
                        </list-item>
                        <list-item>
                            <label>3.</label>
                            <p>AI services API select used AI service from data processing layer and select suitable algorithm from AI algorithm database or from third-party AI methods. In this example, selected service will be Machine Vision Processor and selected AI method is feature extraction.</p>
                        </list-item>
                        <list-item>
                            <label>4.</label>
                            <p>AIDI Machine Vision Processor continuously receives radiology images for diagnosis from imaging databases for AI algorithm training.</p>
                        </list-item>
                        <list-item>
                            <label>5.</label>
                            <p>Machine Vision processor uses training images for data pre-processing, classification, and feature detection.</p>
                        </list-item>
                        <list-item>
                            <label>6.</label>
                            <p>Training data for AI processor is received from RIS/PACS systems as background service and AI algorithms are continuously trained with collected data.</p>
                        </list-item>
                        <list-item>
                            <label>7.</label>
                            <p>Suitable AI algorithm for image analysis is selected and sent to Machine Vision Processor for real-time analysis.</p>
                        </list-item>
                        <list-item>
                            <label>8.</label>
                            <p>Results and findings from image analysis will be sent back to user and will be shown to user in Analytics UI. AI algorithm may also be altered during real-time analysis and sent as new enhanced version of the algorithm into the AIDI database.</p>
                        </list-item>
                        <list-item>
                            <label>9.</label>
                            <p>User will send diagnosis back to AIDI which can be used to improve the used AI algorithm accuracy. AIDI will monitor continuously the user-experienced diagnosis accuracy compared to diagnosis provided by AIDI.</p>
                        </list-item>
                    </list>
                </p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>Automatic image diagnosis - process flow.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/39838/29b9e779-cc39-496c-ba6a-22f85886c3dc_figure3.gif"/>
                </fig>
                <p>
                    <bold>Advantages for actors in healthcare</bold>
                </p>
                <p>When utilizing AIDI in healthcare use cases we can provide immediate benefits for all actors in care process and service development. 
                    <bold>For software and services development,</bold> there is less time used for training AI methods, since AIDI developers can use ready-made AI methods and modify methods and algorithms to meet their own use case specific needs. There is also no need to search for training data for AI algorithms, because AIDI contains interface for training data repositories. 
                    <bold>For healthcare service providers and caregivers,</bold> there is instant prediction, analysis, or pre-diagnosis possibility with the software which utilize AIDI platform features. AIDI can provide enhancement in diagnosis accuracy and diagnosis speed. 
                    <bold>For patients, healthcare customers, and people</bold> who are tracking their wellbeing, AIDI provides accurate and instant diagnosis, prognosis, and predictions based on personal health data and verified and trained AI analytics from large datasets.</p>
                <p>The savings potential when using AI in healthcare is very high. In USA annual savings are expected to be 150 billion USD by 2026
                    <sup>
                        <xref ref-type="bibr" rid="ref28">28</xref>
                    </sup>. When comparing this savings potential to total US healthcare expenditure in 2018 (3600 billion USD with 4,6% annual growth) we expect that US healthcare expenditure will be 5150 billion USD in 2026
                    <sup>
                        <xref ref-type="bibr" rid="ref29">29</xref>
                    </sup>. With these values we evaluate that AI utilization can bring 2,9% reduction in healthcare expenditure in the US. We evaluate that same cost reduction percentage can be achieved also globally.</p>
                <p>AIDI benefits can be presented by the situation where state-of-the-art AI methods are integrated into AIDI and these services are utilized in healthcare in full scale. Benefits can be introduced in values, such as improvement in care outcome, cost reduction in healthcare, quality-of-life improvement among patients, and reduction in workload among healthcare professionals
                    <sup>
                        <xref ref-type="bibr" rid="ref30">30</xref>
                    </sup>.</p>
                <p>For evaluation of AIDI methods in healthcare we also suggest a first version of the weighted scoring system for AI benchmarking. Our novel scoring provides benefit assessment for evaluating the implementation of new AI method in certain healthcare use case. Output is informed as AIscore. Same tool with modified parameter information can be used to evaluate AI method benefits in other business sector use cases. Parameters of the equation are: Scientifically Proven Improvement compared to traditional method (SPI), Training Data Score (TDS), Cost Reduction (CR), Quality-of-Life improvement (QoL), and Workload Reduction (WR). Parameters and weights will be inserted by evaluation team. Evaluation team has researchers and professionals in a particular field of healthcare. Parameter values inform parameter impact, effect, positive outcome, or improvement in certain use case of AI method. For example, parameter SPI can be set by specificity and sensitivity of AI method. Furthermore, parameter TDS can be set by evaluation training data quality and amount of training data parameters for the specific healthcare use case. Parameters CR, QoL and WR will be scored by evaluation team. Each of the parameters will be using weighted coefficient (W
                    <sub>n</sub>) based on the importance of parameter for specific use case. There is also acceptance parameter (AP) expressing whether method can be used for specific use case or not. AIscore will be developed and evaluated in future AIDI research projects.</p>
                <p>By using AIDI and its validation of AI methods by AIscore, we can provide centralized AI distribution and utilization platform where all actors can benefit from effective and evaluated AI services. AIDI platform can also contain sales channel for evaluated AI methods which can be easily adopted for healthcare industry purposes. AI method developers can provide methods through AIDI as &#x201c;Google Play&#x201d; style where AI will be openly available.</p>
                <p>
                    <bold>Concerns of AIDI adoption in healthcare</bold>
                </p>
                <p>Although AI methods in AIDI can provide scientifically proven enhancement in diagnosis and predictions accuracy, we must keep in mind that AIDI will only provide information and guidance for healthcare decision makers. AIDI platform or AI methods overall are not yet allowed to provide direct diagnosis. Healthcare professionals will always be responsible for providing diagnosis and final decision. There are also challenges which can emerge when AIDI services are utilized in healthcare. These issues are market acceptance and end user acceptance. Possible reasons for these issues are arising from the lack of curated healthcare data. Moreover, previous studies show that there might be resistance from healthcare professionals and patients to trust AI based decisions and diagnosis. Furthermore, people think that there is less &#x201c;human touch&#x201d; in care process when AI takes a greater role in healthcare. Moreover, shortage of regulations in AI in healthcare and data privacy can cause challenges. All these issues and challenges should be considered in planning phase of the AIDI project to enable acceptance of AIDI services to all end user groups and to all regulatory authorities.</p>
            </sec>
        </sec>
        <sec id="sec13" sec-type="conclusion">
            <title>4 Conclusion and future work</title>
            <p>Based on our own research work related to AI benefits in healthcare and promising results from other researches in healthcare AI we can conclude that AI is beneficial to all actors in healthcare sectors. This &#x201c;revolution&#x201d; of AI in healthcare has not gone unnoticed by healthcare services development companies. Technology companies are continuously developing and releasing new AI services and even service platforms. Some of the platforms have similarity in AI methods distribution to our AIDI proposal. There are technology giants, such as IBM, Google, Microsoft, General Electric, and Siemens investing and developing AI solutions. We have evaluated that the drivers of the growth in healthcare AI development are based on scientifically proven advantages in care outcome and savings in healthcare costs with AI
                <sup>
                    <xref ref-type="bibr" rid="ref30">30</xref>
                </sup>. These factors have created the very high market growth. Also, other factors driving the market growth are the increasing volume of healthcare data and growing complexities of datasets driving the need for AI, the intensifying need to reduce towering healthcare costs, improving computing power and declining hardware costs, growing number of cross-industry partnerships and collaborations, and rising imbalance between health workforce and patients driving the need for improved healthcare services. Furthermore, one major factor growing the AI market growth is the adoption of AI by multiple pharmaceutical and biotechnology companies across the world. Global healthcare AI market is estimated to grow from 4,9 billion USD (estimated market size in 2020) to 45,2 billion USD in 2026 giving 44,9% of compound annual growth rate for this 6-year period
                <sup>
                    <xref ref-type="bibr" rid="ref31">31</xref>
                </sup>.</p>
            <p>Our future research work will focus on continuing this research with AIDI platform development and its features evaluation with healthcare used cases. First AI services provided by AIDI will concentrate on image diagnostics. This decision is based on our findings during this research where we noticed that healthcare service providers need methods which can easily be implemented into medical imaging and image diagnostics services. AI-based imaging and machine vision methods are widely adopted and accepted by healthcare professionals and companies who develop image diagnostic solutions for healthcare. Furthermore, we will expand AI methods database as well as provide more integrations to training data and third-party AI service providers. We will also analyse business potential and healthcare organizations acceptance of AIDI platform based on the market feedback and implement suitable AI methods for AIDI platform based on market needs. Moreover, we will apply funding for a new scientific project to bring AIDI platform alive.</p>
        </sec>
        <sec id="sec14">
            <title>Data availability</title>
            <p>No data are associated with this article.</p>
        </sec>
    </body>
    <back>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>V&#x00e4;&#x00e4;n&#x00e4;nen</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Haataja</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vehvil&#x00e4;inen-Julkunen</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Survey to healthcare professionals on the practicality of AI services for healthcare.</article-title>
                    <source>

                        <italic toggle="yes">F1000Res</italic>
</source>
                    <year>2020</year>.
                    <pub-id pub-id-type="doi">10.12688/f1000research.23883.1</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="web">
                    <collab>Edison Open AI Orchestrator</collab>:
                    <ext-link ext-link-type="uri" xlink:href="https://www.gehealthcare.com/products/healthcare-it/enterprise-imaging/edison-open-ai-orchestrator">Reference Source</ext-link>accessed 5.10.2020.</mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="web">
                    <collab>OpenAI</collab>:
                    <ext-link ext-link-type="uri" xlink:href="https://openai.com/">Reference Source</ext-link>accessed 3.10.2020</mixed-citation>
            </ref>
            <ref id="ref4">
                <label>4</label>
                <mixed-citation publication-type="web">
                    <collab>TensorFlow</collab>:
                    <ext-link ext-link-type="uri" xlink:href="https://www.tensorflow.org/">Reference Source</ext-link>accessed 1.10.2020</mixed-citation>
            </ref>
            <ref id="ref5">
                <label>5</label>
                <mixed-citation publication-type="web">
                    <collab>IBM Watson Heatlh</collab>:
                    <ext-link ext-link-type="uri" xlink:href="https://www.ibm.com/watson-health">Reference Source</ext-link>accessed 1.10.2020</mixed-citation>
            </ref>
            <ref id="ref6">
                <label>6</label>
                <mixed-citation publication-type="web">
                    <collab>Azure Cognitive Services</collab>:
                    <ext-link ext-link-type="uri" xlink:href="https://azure.microsoft.com/en-us/services/cognitive-services/">Reference Source</ext-link>accessed 1.10.2020</mixed-citation>
            </ref>
            <ref id="ref7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>De Fauw</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ledsam</surname>
                            <given-names>JR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Romera-Paredes</surname>
                            <given-names>B</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Clinically applicable deep learning for diagnosis and referral in retinal disease.</article-title>
                    <source>

                        <italic toggle="yes">Nat Med</italic>
</source>
                    <year>2018</year>;<volume>24</volume>(<issue>9</issue>):<fpage>1342</fpage>.
                    <pub-id pub-id-type="pmid">30104768</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41591-018-0107-6</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>McKinney</surname>
                            <given-names>SM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sieniek</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Godbole</surname>
                            <given-names>V</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>International evaluation of an AI system for breast cancer screening.</article-title>
                    <source>

                        <italic toggle="yes">Nature</italic>
</source>
                    <year>2020</year>;<volume>577</volume>(<issue>7788</issue>):<fpage>89</fpage>&#x2013;<lpage>94</lpage>.
                    <pub-id pub-id-type="pmid">31894144</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41586-019-1799-6</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Patel</surname>
                            <given-names>TA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Puppala</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ogunti</surname>
                            <given-names>RO</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Correlating mammographic and pathologic findings in clinical decision support using natural language processing and data mining methods.</article-title>
                    <source>

                        <italic toggle="yes">Cancer</italic>
</source>
                    <year>2017</year>;<volume>123</volume>(<issue>1</issue>):<fpage>114</fpage>&#x2013;<lpage>121</lpage>.
                    <pub-id pub-id-type="pmid">27571243</pub-id>
                    <pub-id pub-id-type="doi">10.1002/cncr.30245</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Esteva</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kuprel</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Novoa</surname>
                            <given-names>RA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Dermatologist-level classification of skin cancer with deep neural networks.</article-title>
                    <source>

                        <italic toggle="yes">Nature</italic>
</source>
                    <year>2017</year>;<volume>542</volume>:<fpage>115</fpage>&#x2013;<lpage>18</lpage>.
                    <pub-id pub-id-type="pmid">28117445</pub-id>
                    <pub-id pub-id-type="doi">10.1038/nature21056</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <label>11</label>
                <mixed-citation publication-type="web">
                    <collab>ClinicalTrials.gov</collab>:
                    <article-title>Adult accuracy study of the Elite 3 Glucose Censor (E3).</article-title>
                    <ext-link ext-link-type="uri" xlink:href="https://www.clinicaltrials.gov/ct2/show/study/NCT02246582?term=NCT02246582&amp;rank=1&amp;sect=X0123456">Reference Source</ext-link>Accessed 18.7.2020</mixed-citation>
            </ref>
            <ref id="ref12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lakhani</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sundaram</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <article-title>Deep learning at chest radiography: automated classification of pulmonary tuberculosis by using convolutional neural networks.</article-title>
                    <source>

                        <italic toggle="yes">Radiology</italic>
</source>
                    <year>2017</year>;<volume>284</volume>(<issue>2</issue>):<fpage>574</fpage>&#x2013;<lpage>582</lpage>.
                    <pub-id pub-id-type="pmid">28436741</pub-id>
                    <pub-id pub-id-type="doi">10.1148/radiol.2017162326</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Corcoran</surname>
                            <given-names>CM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Carrillo</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fern&#x00e1;ndez-Slezak</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Prediction of psychosis across protocols and risk cohorts using automated language analysis.</article-title>
                    <source>

                        <italic toggle="yes">World Psychiatry</italic>
</source>
                    <year>2018</year>;<volume>17</volume>(<issue>1</issue>):<fpage>67</fpage>&#x2013;<lpage>75</lpage>.
                    <pub-id pub-id-type="pmid">29352548</pub-id>
                    <pub-id pub-id-type="doi">10.1002/wps.20491</pub-id>
                    <pub-id pub-id-type="pmcid">PMC5775133</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <label>14</label>
                <mixed-citation publication-type="web">
                    <article-title>Stratified, personalised or P4 medicine: a new direction for placing the patient at the centre of healthcare and health education.</article-title>
                    <publisher-name>Academy of Medical Sciences</publisher-name>;
                    <ext-link ext-link-type="uri" xlink:href="https://personalizedmedicinecoalition.org/Userfiles/PMC-Corporate/file/pmc_age_of_pmc_factsheet.pdf">Reference Source</ext-link>Accessed 6.10.2020</mixed-citation>
            </ref>
            <ref id="ref15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Schiff</surname>
                            <given-names>GD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Volk</surname>
                            <given-names>LA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Volodarskaya</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Screening for medication errors using an outlier detection system.</article-title>
                    <source>

                        <italic toggle="yes">J Am Med Inform Assoc</italic>
</source>
                    <year>2017</year>;<volume>24</volume>(<issue>2</issue>):<fpage>281</fpage>&#x2013;<lpage>287</lpage>.
                    <pub-id pub-id-type="pmid">28104826</pub-id>
                    <pub-id pub-id-type="doi">10.1093/jamia/ocw171</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7651890</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Calaprice-Whitty</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Galil</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Salloum</surname>
                            <given-names>W</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Improving clinical trial participant prescreening with artificial intelligence (AI): a comparison of the results of AI-assisted vs standard methods in 3 oncology trials.</article-title>
                    <source>

                        <italic toggle="yes">Ther Innov Regul Sci</italic>
</source>
                    <year>2020</year>;<volume>54</volume>(<issue>1</issue>):<fpage>69</fpage>&#x2013;<lpage>74</lpage>.
                    <pub-id pub-id-type="pmid">32008227</pub-id>
                    <pub-id pub-id-type="doi">10.1007/s43441-019-00030-4</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zamiri</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yazdi</surname>
                            <given-names>HS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Goli</surname>
                            <given-names>SA</given-names>
                        </name>
</person-group>:
                    <article-title>Temporal and spatial monitoring and prediction of epidemic outbreaks.</article-title>
                    <source>

                        <italic toggle="yes">IEEE J Biomed Health Inform</italic>
</source>
                    <year>2014</year>;<volume>19</volume>(<issue>2</issue>):<fpage>735</fpage>&#x2013;<lpage>744</lpage>.
                    <pub-id pub-id-type="pmid">25122846</pub-id>
                    <pub-id pub-id-type="doi">10.1109/JBHI.2014.2338213</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7186040</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hu</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ge</surname>
                            <given-names>Q</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jin</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Artificial intelligence forecasting of covid-19 in china.</article-title>
                    <source>

                        <italic toggle="yes">arXiv preprint arXiv</italic>
</source>
                    <year>2020</year>;<volume>2002</volume>:<fpage>07112</fpage>.</mixed-citation>
            </ref>
            <ref id="ref19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bragazzi</surname>
                            <given-names>NL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dai</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Damiani</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>How Big Data and Artificial Intelligence Can Help Better Manage the COVID-19 Pandemic.</article-title>
                    <source>

                        <italic toggle="yes">Int J Environ Res Public Health</italic>
</source>
                    <year>2020</year>;<volume>17</volume>(<issue>9</issue>):<fpage>3176</fpage>.
                    <pub-id pub-id-type="pmid">32370204</pub-id>
                    <pub-id pub-id-type="doi">10.3390/ijerph17093176</pub-id>
                    <pub-id pub-id-type="pmcid">PMC7246824</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Liu</surname>
                            <given-names>X</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Faes</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kale</surname>
                            <given-names>AU</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis.</article-title>
                    <source>

                        <italic toggle="yes">Lancet Digit Health</italic>
</source>
                    <year>2019</year>;<volume>1</volume>(<issue>6</issue>):<fpage>e271</fpage>&#x2013;<lpage>e297</lpage>.
                    <pub-id pub-id-type="pmid">33323251</pub-id>
                    <pub-id pub-id-type="doi">10.1016/S2589-7500(19)30123-2</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>McKinney</surname>
                            <given-names>SM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sieniek</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Godbole</surname>
                            <given-names>V</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>International evaluation of an AI system for breast cancer screening.</article-title>
                    <source>

                        <italic toggle="yes">Nature</italic>
</source>
                    <year>2020</year>;<volume>577</volume>(<issue>7788</issue>):<fpage>89</fpage>&#x2013;<lpage>94</lpage>.
                    <pub-id pub-id-type="pmid">31894144</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41586-019-1799-6</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Esteva</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kuprel</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Novoa</surname>
                            <given-names>RA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Dermatologist-level classification of skin cancer with deep neural networks.</article-title>
                    <source>

                        <italic toggle="yes">Nature</italic>
</source>
                    <year>2017</year>;<volume>542</volume>:<fpage>115</fpage>&#x2013;<lpage>18</lpage>.
                    <pub-id pub-id-type="pmid">28117445</pub-id>
                    <pub-id pub-id-type="doi">10.1038/nature21056</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>De Fauw</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ledsam</surname>
                            <given-names>JR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Romera-Paredes</surname>
                            <given-names>B</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Clinically applicable deep learning for diagnosis and referral in retinal disease.</article-title>
                    <source>

                        <italic toggle="yes">Nat Med</italic>
</source>
                    <year>2018</year>;<volume>24</volume>(<issue>9</issue>):<fpage>1342</fpage>.
                    <pub-id pub-id-type="pmid">30104768</pub-id>
                    <pub-id pub-id-type="doi">10.1038/s41591-018-0107-6</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <label>24</label>
                <mixed-citation publication-type="web">
                    <collab>Digital Health, Samsung</collab>:
                    <ext-link ext-link-type="uri" xlink:href="https://www.sra.samsung.com/digital-health/">Reference Source</ext-link>accessed 22.10.2020</mixed-citation>
            </ref>
            <ref id="ref25">
                <label>25</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hartikainen</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lipponen</surname>
                            <given-names>JA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hiltunen</surname>
                            <given-names>P</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Effectiveness of the Chest Strap Electrocardiogram to Detect Atrial Fibrillation.</article-title>
                    <source>

                        <italic toggle="yes">Am J Cardiol</italic>
</source>
                    <year>2019</year>;<volume>123</volume>(<issue>10</issue>):<fpage>1643</fpage>&#x2013;<lpage>1648</lpage>.
                    <pub-id pub-id-type="pmid">30878151</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.amjcard.2019.02.028</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref26">
                <label>26</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Laranjo</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dunn</surname>
                            <given-names>AG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tong</surname>
                            <given-names>HL</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Conversational agents in healthcare: a systematic review.</article-title>
                    <source>

                        <italic toggle="yes">J Am Med Inform Assoc</italic>
</source>
                    <year>2018</year>;<volume>25</volume>(<issue>9</issue>):<fpage>1248</fpage>&#x2013;<lpage>1258</lpage>.
                    <pub-id pub-id-type="pmid">30010941</pub-id>
                    <pub-id pub-id-type="doi">10.1093/jamia/ocy072</pub-id>
                    <pub-id pub-id-type="pmcid">PMC6118869</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref27">
                <label>27</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chambers</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cantrell</surname>
                            <given-names>AJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Digital and online symptom checkers and health assessment/triage services for urgent health problems: systematic review.</article-title>
                    <source>

                        <italic toggle="yes">BMJ open</italic>
</source>
                    <year>2019</year>;<volume>9</volume>(<issue>8</issue>):<fpage>e027743</fpage>.
                    <pub-id pub-id-type="pmid">31375610</pub-id>
                    <pub-id pub-id-type="doi">10.1136/bmjopen-2018-027743</pub-id>
                    <pub-id pub-id-type="pmcid">PMC6688675</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref28">
                <label>28</label>
                <mixed-citation publication-type="web">
                    <collab>Artificial Intelligence</collab>:
                    <article-title>Healhtcare&#x2019;s new nervous system.</article-title>
                    <source>

                        <italic toggle="yes">Accenture consulting</italic>
</source>
                    <year>2017</year>
                    <ext-link ext-link-type="uri" xlink:href="https://www.accenture.com/_acnmedia/PDF-49/Accenture-Health-Artificial-Intelligence.pdf">Reference Source</ext-link>Accessed 19.9.2020</mixed-citation>
            </ref>
            <ref id="ref29">
                <label>29</label>
                <mixed-citation publication-type="web">
                    <collab>National Health Expenditure Data, Department of Health and Human Services</collab>:<year>2020</year>
                    <ext-link ext-link-type="uri" xlink:href="https://www.cms.gov/Research-Statistics-Data-and-Systems/Statistics-Trends-and-Reports/NationalHealthExpendData/NationalHealthAccountsHistorical">Reference Source</ext-link>Accessed 20.10.2020</mixed-citation>
            </ref>
            <ref id="ref30">
                <label>30</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>V&#x00e4;&#x00e4;n&#x00e4;nen</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Haataja</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Toivanen</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <article-title>A Narrative Review on AI in Healthcare.</article-title>
                    <source>

                        <italic toggle="yes">F1000Res</italic>
</source>
                    <year>2020</year>.</mixed-citation>
            </ref>
            <ref id="ref31">
                <label>31</label>
                <mixed-citation publication-type="web">
                    <article-title>Artificial Intelligence in Healthcare Market, Markets and Markets.</article-title>
                    <ext-link ext-link-type="uri" xlink:href="https://www.marketsandmarkets.com/Market-Reports/artificial-intelligence-healthcare-market-54679303.html#:~:text=%5B%20255%20Pages%20Reports%5D%20The%20global,44.9%25%20during%20the%20forecast%20period">Reference Source</ext-link>Accessed 22.10.2020</mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report97304">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.39838.r97304</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Faggioni</surname>
                        <given-names>Lorenzo</given-names>
                    </name>
                    <xref ref-type="aff" rid="r97304a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-5262-4489</uri>
                </contrib>
                <aff id="r97304a1">
                    <label>1</label>Diagnostic and Interventional Radiology, Department of Translational Research, University of Pisa, Pisa, Italy</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>8</day>
                <month>11</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Faggioni L</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport97304" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.36775.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Interesting, quite exhaustive manuscript aimed at presenting&#x00a0;a novel AI-based service platform proposal called AIDI (Artificial Intelligence Distribution Interface for healthcare).</p>
            <p> I think that it could be further improved as follows: 
                <list list-type="bullet">
                    <list-item>
                        <p>Please avoid mentioning commercial names or companies, unless indispensable to properly describe the data presented (e.g. GE Healthcare in the Introduction, Microsoft Azur at the beginning of Section 2).</p>
                    </list-item>
                    <list-item>
                        <p>The use cases from 3.1 and 3.8 are well structured and give a brief but systematic account of the potential and actual uses of AIDI. However, I would strongly suggest expanding each of them by mentioning the main literature references related to each use case in a dedicated table (reporting article title, first author, publication date, use case topic and a short summary of the methods and main findings). This would add significant value to the manuscript.</p>
                    </list-item>
                    <list-item>
                        <p>Use case 3.6 (Medical image diagnostics). A big contribution of AI in the field of medical imaging that should be mentioned is the possibility not only to detect disease conditions (e.g., cancer), but also to provide insights about patient outcome and eligibility to some given treatments or not (e.g., molecular target therapies). Please elaborate on this.</p>
                    </list-item>
                    <list-item>
                        <p>The paragraph on "Concerns of AIDI adoption in healthcare" is an important one, yet it should be supported by literature references (which are currently lacking at all). Some useful references on this topic include (but are not limited to) include the following: 1) Coppola F., 
                            <italic>et al</italic>, doi&#x00a0;10.3389/fpsyg.2021.710982; 2) Triberti S., 
                            <italic>et al</italic>, doi&#x00a0;10.3389/fpubh.2020.00117</p>
                    </list-item>
                </list>
            </p>
            <p>Is the topic of the opinion article discussed accurately in the context of the current literature?</p>
            <p>Yes</p>
            <p>Are arguments sufficiently supported by evidence from the published literature?</p>
            <p>Partly</p>
            <p>Are all factual statements correct and adequately supported by citations?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn balanced and justified on the basis of the presented arguments?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Radiology, Imaging informatics, Artificial Intelligence</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <back>
            <ref-list>
                <title>References</title>
                <ref id="rep-ref-97304-1">
                    <label>1</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Human, All Too Human? An All-Around Appraisal of the</article-title>.
                        <source>
                            <italic>Front Psychol</italic>
                        </source>.<year>2021</year>;<volume>12</volume>:
                        <elocation-id>10.3389/fpsyg.2021.710982</elocation-id>
                        <fpage>710982</fpage>
                        <pub-id pub-id-type="pmid">34650476</pub-id>
                        <pub-id pub-id-type="doi">10.3389/fpsyg.2021.710982</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-97304-2">
                    <label>2</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>A</article-title>.
                        <source>
                            <italic>Front Public Health</italic>
                        </source>.<year>2020</year>;<volume>8</volume>:
                        <elocation-id>10.3389/fpubh.2020.00117</elocation-id>
                        <fpage>117</fpage>
                        <pub-id pub-id-type="pmid">32411641</pub-id>
                        <pub-id pub-id-type="doi">10.3389/fpubh.2020.00117</pub-id>
                    </mixed-citation>
                </ref>
                <ref id="rep-ref-97304-3">
                    <label>3</label>
                    <mixed-citation publication-type="journal">
                        <person-group person-group-type="author"/>:
                        <article-title>Imaging biomarkers in upper gastrointestinal cancers.</article-title>
                        <source>
                            <italic>BJR Open</italic>
                        </source>.<year>2019</year>;<volume>1</volume>(<issue>1</issue>) :
                        <elocation-id>10.1259/bjro.20190001</elocation-id>
                        <fpage>20190001</fpage>
                        <pub-id pub-id-type="pmid">33178936</pub-id>
                        <pub-id pub-id-type="doi">10.1259/bjro.20190001</pub-id>
                    </mixed-citation>
                </ref>
            </ref-list>
        </back>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report92571">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.39838.r92571</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>J&#x00e4;ntti</surname>
                        <given-names>Marko</given-names>
                    </name>
                    <xref ref-type="aff" rid="r92571a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r92571a1">
                    <label>1</label>CEMIS (Center for Measurement and Information Systems), Kuopio, Finland</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>9</day>
                <month>9</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 J&#x00e4;ntti M</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport92571" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.36775.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This paper aims at developing a service platform AIDI (Artificial Intelligence Distribution Interface for healthcare) and showing its main components. The study focuses on explaining the structure of the artifact that authors have&#x00a0;designed. The main artifact is an AI-based service platform. The structure of the paper is clear and the topic is very up to date and interesting. However, there are several issues that could have been improved.The Authors can consider them as improvement ideas.</p>
            <p> </p>
            <p> 
                <bold>Introduction</bold>&#x00a0;</p>
            <p> The study refers to earlier work but does not provide a clear reference to those studies.&#x00a0;</p>
            <p> "proposal is based on our earlier research work in which we evaluated AI-based healthcare services".&#x00a0; Related to the above mentioned comment, the authors could have positioned their paper to previous academic studies and&#x00a0;results more clearly. What does it mean in terms of this paper? For example, the title of the paper refers&#x00a0;to "novel" platform. Positioning could have helped authors to identify and communicate better the elements that actually are "novel".</p>
            <p> </p>
            <p> There are existing case studies that utilize already cloud &amp; AI services (
                <ext-link ext-link-type="uri" xlink:href="https://protect-us.mimecast.com/s/_HozCzpBnGHGKPozQu4BwMb?domain=customers.microsoft.com">https://customers.microsoft.com/en-us/story/1399290856490209110-region-hovedstaden-health-provider-azure-en-we</ext-link>) and there are academic studies that mention Azure AI (R. Singh and N. Sharma, "Machine Learning based Medical Information Analysis, Estimations and&#x00a0; Approximations over Present Health Research Domain). Therefore, 'novel' parts could have been discussed further.&#x00a0;</p>
            <p> </p>
            <p> 
                <bold>Section 2</bold>
            </p>
            <p> The section 2 describes the basic architecture of AIDI and four layers: Front end, data processing, integration and data storage. From a software development point of view, the selection of these layers is obvious and clear, however,&#x00a0; one should ask 1) why these elements were chosen to be part of the artifact and 2) how the&#x00a0;artifact (and opinions) have been designed /constructed by using the method. Transparency of this design / construction&#x00a0;process is crucially important.</p>
            <p> </p>
            <p> How authors could have addressed this better? If authors continue using a systematic review ("We have also used our systematic review&#x00a0;about AI-based healthcare services") , there are guidelines how to apply the methodology. See for example: 
                <ext-link ext-link-type="uri" xlink:href="https://protect-us.mimecast.com/s/V_cECADQm5UZjmA5LU8V6YG?domain=libguides.library.curtin.edu.au">https://libguides.library.curtin.edu.au/systematic-reviews</ext-link>. Authors are encouraged to look this when they prepare their next systematic reviews.</p>
            <p> </p>
            <p> 
                <bold>Section 3</bold>
            </p>
            <p> Use cases is from a reviewer's perspective the most mature and interesting part of the article focusing on usage scenarios of AIDI platform. Authors cite existing AI and Healthcare-related literature showing the use cases for utilizing AI in healthcare. Literature presented here provides strong support for using AI components for example in predicting and governing pandemic outbreaks and scanning large datasets for identifying &amp; selecting patients for clinical trials.&#x00a0;</p>
            <p> </p>
            <p> Are the conclusions (opinions) drawn balanced and justified on the basis of the presented arguments? Authors could have followed the survey methodology in a more transparent way (defining exclusion/inclusion criteria and showing clearlier where their conclusions are based on?).</p>
            <p> </p>
            <p> There is certainly always place for improvement in papers but as a whole, AI-based healthcare platforms deserve more attention and this paper manages to contribute to the field by describing the architectural elements of AI-powered &#x00a0;healthcare platforms as well as usage scenarios derived from the literature.</p>
            <p>Is the topic of the opinion article discussed accurately in the context of the current literature?</p>
            <p>Yes</p>
            <p>Are arguments sufficiently supported by evidence from the published literature?</p>
            <p>Yes</p>
            <p>Are all factual statements correct and adequately supported by citations?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn balanced and justified on the basis of the presented arguments?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Computer science</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
</article>
