<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article  PUBLIC "-//NLM//DTD Journal Publishing DTD v3.0 20080202//EN" "http://dtd.nlm.nih.gov/publishing/3.0/journalpublishing3.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" dtd-version="3.0" xml:lang="en" article-type="research article"><front><journal-meta><journal-id journal-id-type="publisher-id">OJRad</journal-id><journal-title-group><journal-title>Open Journal of Radiology</journal-title></journal-title-group><issn pub-type="epub">2164-3024</issn><publisher><publisher-name>Scientific Research Publishing</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.4236/ojrad.2021.111003</article-id><article-id pub-id-type="publisher-id">OJRad-107585</article-id><article-categories><subj-group subj-group-type="heading"><subject>Articles</subject></subj-group><subj-group subj-group-type="Discipline-v2"><subject>Physics&amp;Mathematics</subject></subj-group></article-categories><title-group><article-title>
 
 
  The Role of Digital Technology and Artificial Intelligence in Diagnosing Medical Images: A Systematic Review
 
</article-title></title-group><contrib-group><contrib contrib-type="author" xlink:type="simple"><name name-style="western"><surname>Rani</surname><given-names>Ahmad</given-names></name><xref ref-type="aff" rid="aff1"><sub>1</sub></xref></contrib></contrib-group><aff id="aff1"><label>1</label><addr-line>Department of Radiology, King Abdulaziz University, Jeddah, Saudi Arabia</addr-line></aff><pub-date pub-type="epub"><day>07</day><month>02</month><year>2021</year></pub-date><volume>11</volume><issue>01</issue><fpage>19</fpage><lpage>34</lpage><history><date date-type="received"><day>6,</day>	<month>January</month>	<year>2021</year></date><date date-type="rev-recd"><day>2,</day>	<month>March</month>	<year>2021</year>	</date><date date-type="accepted"><day>5,</day>	<month>March</month>	<year>2021</year></date></history><permissions><copyright-statement>&#169; Copyright  2014 by authors and Scientific Research Publishing Inc. </copyright-statement><copyright-year>2014</copyright-year><license><license-p>This work is licensed under the Creative Commons Attribution International License (CC BY). http://creativecommons.org/licenses/by/4.0/</license-p></license></permissions><abstract><p>
 
 
  The provision of up-to-date medical information on digital technology and AI systems in journals, clinical practices, and textbooks informing radiologists about patient care has resulted in faster, more reliable, and cheaper image interpretation. This study reviews 27 articles regarding the application of digital technology and artificial intelligence (AI) in radiological scholarship, looking at the incorporation of electronic health system records, digital radiology imaging databases, IT environments, and machine learning—the latter of which has emerged as the most popular AI approach in modern medicine. This article examines the emerging picture surrounding archiving and communication systems in the implementation phase of AI technologies. It explores the most appropriate clinical requirements for the use of AI systems in practice. Continued development in the integration of automated systems, probing the use of information systems, databases, and records, should result in further progress in radiological theory and practice.
 
</p></abstract><kwd-group><kwd>Artificial Intelligence</kwd><kwd> Machine Learning</kwd><kwd> Radiology</kwd></kwd-group></article-meta></front><body><sec id="s1"><title>1. Introduction</title><p>Providing diverse tools and strategies for radiologists has been described as being akin to supplying patients with a safety net, expert diagnostician, and gatekeeper combined [<xref ref-type="bibr" rid="scirp.107585-ref1">1</xref>]. Extensive advancements made through developments in both artificial intelligence (AI) and modern imaging techniques have overcome many challenges and responsibilities once faced by the radiologist. This progress has involved two main factors: image finding interpretation and medical imaging production [<xref ref-type="bibr" rid="scirp.107585-ref2">2</xref>]. The ability to recognize an image is an important prerequisite for various types of identification, and a traditional human intuitive capacity necessary for recognizing features that differentiate “normal” from “abnormal” images [<xref ref-type="bibr" rid="scirp.107585-ref3">3</xref>]. However, this focus on human interpretation is largely undesirable in medical practice, since image complexity can hinder the predictability of outcomes and render interpretation mistakes more likely [<xref ref-type="bibr" rid="scirp.107585-ref4">4</xref>].</p><p>The idea of using computers and AI for medical imaging stems backs at least to the 1960s [<xref ref-type="bibr" rid="scirp.107585-ref1">1</xref>]. Radiologists at this time exploited the abilities of the emerging computer for retaining large amounts of data [<xref ref-type="bibr" rid="scirp.107585-ref5">5</xref>]. The computer permitted an authentic and explicit quantitative assessment, and helped in the characterization of radiological findings [<xref ref-type="bibr" rid="scirp.107585-ref6">6</xref>]. However, the effectiveness and reliability of computerized image interpretation were only fully realized in recent years, and radiologists have began to adopt the technology. A large number of AI techniques have been used in the context of healthcare disciplines, which has led to various debates among doctors relating to the ethics of AI in various types of medicine, particularly in terms of the risk involved in replacing human physicians with machines [<xref ref-type="bibr" rid="scirp.107585-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.107585-ref8">8</xref>]. In the foreseeable future, machines may probably not replace human physicians, although machines will almost certainly increase the speed and efficiency of clinical assessments. This may permit more reliable and justifiable decision-making, and may even partially replace low-level human decision-making in specific functional areas of healthcare [<xref ref-type="bibr" rid="scirp.107585-ref9">9</xref>]. In practice, recent successful applications of AI in healthcare have been rigorously examined, owing to the widespread availability of digital data and the current ease in applying big data analytical methods [<xref ref-type="bibr" rid="scirp.107585-ref4">4</xref>]. Seminal AI techniques can explain hidden appropriate information that consequently informs clinical decision-making.</p><p>The achievements and advantages of AI and machine learning techniques in the context of healthcare, especially radiology have been widely discussed [<xref ref-type="bibr" rid="scirp.107585-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.107585-ref3">3</xref>] [<xref ref-type="bibr" rid="scirp.107585-ref8">8</xref>] [<xref ref-type="bibr" rid="scirp.107585-ref9">9</xref>]. Machine learning techniques can be used to extract various characteristics from an extensive data set, as well as to gather broad understanding for assisting clinical practice. Learning and self-correcting programs are equipped with algorithms that enhance accuracy based on continuous feedback. However, the provision of up-to-date information from medical journals, clinical practice, medical guidelines, and textbooks are necessary to result in appropriate patient care, and which may be more easily incorporated when using an AI system. Also, diagnostic and therapeutic errors can be reduced through AI, and relevant information can be extracted for developing real-time inferences toward predicting health outcomes and health risk alerts.</p><p>A method for quantifying the frequency and impact of human error in medicine was initially expounded as early as 1949, by Garland [<xref ref-type="bibr" rid="scirp.107585-ref10">10</xref>], where it was noted that radiologists are prone to errors. Indeed, presently, radiologists make approximately 40 million radiological errors per annum worldwide [<xref ref-type="bibr" rid="scirp.107585-ref11">11</xref>], of which, 9.3% are syntactic and semantic errors [<xref ref-type="bibr" rid="scirp.107585-ref12">12</xref>], averaging 1.23 errors per report [<xref ref-type="bibr" rid="scirp.107585-ref13">13</xref>]. In general, accurate diagnoses do not necessary indicate a successful radiological investigation. Lack of experience, time constrains, and technical difficulty in properly viewing huge imaging data may lead to misinterpretation. For instance, the occurrence of notorious laterality errors is a product of mistakes made by a physician about body orientation, or labelling errors by a radiologist. Indeed, errors made by a radiologist can lead to delays or missed diagnosis, which can cause unfavourable patient outcomes. Thus, the application of AI in radiology ensures faster, more reliable, and cheaper image interpretation, utilizing electronic health system records and digital imaging databases [<xref ref-type="bibr" rid="scirp.107585-ref14">14</xref>]. The present review aims to determine the role of AI and other technologies in the daily practice of radiologists, from historical and current perspectives to providing an overview for practicing radiologists, acting as type of roadmap for this technological territory and a provision that can aid practitioners in future advancements.</p></sec><sec id="s2"><title>2. Materials and Methods</title><p>A systematic review design based on PRISMA guidelines by Mohr, et al. [<xref ref-type="bibr" rid="scirp.107585-ref15">15</xref>] was used to examine the role of AI and other technologies for validating medical diagnosis in radiology. It looked at the current available state of the art to suggest advancements for future practice.</p><p>This review has restricted its search to English-language studies and on human subjects. However, no restriction on the initial timeline was selected, therefore, studies published before Dec 2020 were included, as this was the day last search was conducted. Medical images of various modalities, such as mammography or mastography, X-radiation (x-ray), Magnetic Resonnce Imaging (MRI), Ultrasound (US), and Computed tomography (CT), were all incorporated as radiological images. Studies examining AI that combine medical images and other types of clinical data were included. Articles based on clinical settings were included in this review, informing understanding about the use of AI in various radiological imaging and modality settings. No limits were placed on the target population, the intended context for using the model, or the disease outcome of interest. Editorials, letters, comments, conference abstracts and proceedings, and review articles were also included. This review has exhaustively searched PubMed, Cochrane, MEDLINE, and EMBASE databases to identify original research articles that examine the role of AI and machine learning in investigating medical images toward diagnostic decision-making. Also, owing to limited data on the topic, a grey literature search was conducted by incorporating a search through customizing the Google search engine. The complete list of inclusion and exclusion criteria is shown on <xref ref-type="table" rid="table1">Table 1</xref>. The keywords used were “Artificial Intelligence OR Machine learning OR Deep learning” AND “Medical Imaging OR radiological studies” AND “Diagnosis OR Accuracy OR Performance” (<xref ref-type="table" rid="table2">Table 2</xref>). Both published and unpublished studies were searched rigorously before conducted the review to prevent reviewer selection bias and publication bias.</p><p>Initially, after searching all databases, studies were deduplicated using RefWorks. After deduplication, the title and abstracts were read and screened (1<sup>st</sup></p><table-wrap id="table1" ><label><xref ref-type="table" rid="table1">Table 1</xref></label><caption><title> Inclusion and exclusion criteria</title></caption><table><tbody><thead><tr><th align="center" valign="middle" ></th><th align="center" valign="middle" >Inclusion Criteria</th><th align="center" valign="middle" >Exclusion Criteria</th></tr></thead><tr><td align="center" valign="middle" >Population</td><td align="center" valign="middle" >Studies for all age groups and from all populations, including studies from all high-, middle- and low-income countries</td><td align="center" valign="middle" >Studies on animals or non-human object</td></tr><tr><td align="center" valign="middle" >Intervention</td><td align="center" valign="middle" >Medical images and images of different radiological modalities, such as mammography, x-ray, MRI, US, and CT</td><td align="center" valign="middle" >Studies with obsolete radiological technologies or modalities</td></tr><tr><td align="center" valign="middle" >Outcome</td><td align="center" valign="middle" >Studies examining AI that combine medical images and other types of clinical data.</td><td align="center" valign="middle" >Studies reporting patient experiences or narratives</td></tr><tr><td align="center" valign="middle" >Design</td><td align="center" valign="middle" >RCTs, clinical trials, Editorials, letters, comments, conference abstracts and proceedings, and review articles were also included.</td><td align="center" valign="middle" >Qualitative studies</td></tr><tr><td align="center" valign="middle" >Language</td><td align="center" valign="middle" >English</td><td align="center" valign="middle" >All other languages</td></tr><tr><td align="center" valign="middle" >Setting</td><td align="center" valign="middle" >Clinical settings</td><td align="center" valign="middle" >Studies that violated declaration of Helsinki</td></tr><tr><td align="center" valign="middle" >Time period</td><td align="center" valign="middle" >All studies</td><td align="center" valign="middle" >-</td></tr></tbody></table></table-wrap><table-wrap id="table2" ><label><xref ref-type="table" rid="table2">Table 2</xref></label><caption><title> Search queries using keywords</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Search number</th><th align="center" valign="middle" >Search Strategy</th></tr></thead><tr><td align="center" valign="middle" >Search number</td><td align="center" valign="middle" >Searched Items</td></tr><tr><td align="center" valign="middle" >S1</td><td align="center" valign="middle" >Artificial intelligence OR Machine learning OR Deep learning OR Convolutional Network</td></tr><tr><td align="center" valign="middle" >S2</td><td align="center" valign="middle" >Diagnosis OR Diagnostic OR Diagnosing OR Accuracy OR Receiver operating OR Performance</td></tr><tr><td align="center" valign="middle" >S3</td><td align="center" valign="middle" >Radiological Studies OR Mammography OR CT OR CT Scan OR US OR Ultrasound OR MRI or Magnetic Resonance Imaging</td></tr><tr><td align="center" valign="middle" >S4</td><td align="center" valign="middle" >S1 AND S2 AND S3</td></tr></tbody></table></table-wrap><p>screening) based on inclusion and exclusion criteria (<xref ref-type="table" rid="table1">Table 1</xref>). Full texts of the included articles were then obtained and screened (2nd screening) using the same criteria. The two independent reviewers assessed the eligibility criteria of the screened titles and abstracts and later the full text of the search results; non-consensus was resolved by a third reviewer. A Microsoft Excel Sheet was prepared to screen the included and excluded studies. Articles included after a 2nd screening were then screened (3rd screening) for quality analysis using the STROBE checklist [<xref ref-type="bibr" rid="scirp.107585-ref16">16</xref>]. Again, the screening was carried out by two independent reviewers to ensure that the included studies had internal and external validity. The article search procedure is shown on <xref ref-type="table" rid="table3">Table 3</xref>.</p><p>A pre-developed and standardized proforma was used during the data extraction process. First author name, year of publication, study type, methodology of the study and final outcome of the study were extracted and summarized in a table which was then used for data analysis. The outcomes of studies were based on complex mathematical and statistical AI models, which include deep learning</p><table-wrap id="table3" ><label><xref ref-type="table" rid="table3">Table 3</xref></label><caption><title> Result for Search strategy in PubMed</title></caption><table><tbody><thead><tr><th align="center" valign="middle" >Search number</th><th align="center" valign="middle" >Search Strategy</th><th align="center" valign="middle" >Studies Found</th></tr></thead><tr><td align="center" valign="middle" >S1</td><td align="center" valign="middle" >Artificial Intelligence or Machine learning or Deep learning</td><td align="center" valign="middle" >2401</td></tr><tr><td align="center" valign="middle" >S2</td><td align="center" valign="middle" >Medical Imaging or radiological studies</td><td align="center" valign="middle" >94,539</td></tr><tr><td align="center" valign="middle" >S3</td><td align="center" valign="middle" >Diagnosis or Accuracy or Performance</td><td align="center" valign="middle" >553,380</td></tr><tr><td align="center" valign="middle" >S4</td><td align="center" valign="middle" >S1 and S2 and S3</td><td align="center" valign="middle" >27,099</td></tr><tr><td align="center" valign="middle" >S6</td><td align="center" valign="middle" >Language Filter</td><td align="center" valign="middle" >24,246</td></tr><tr><td align="center" valign="middle" >S7</td><td align="center" valign="middle" >Study Design Filter</td><td align="center" valign="middle" >2032</td></tr><tr><td align="center" valign="middle" >S8</td><td align="center" valign="middle" >Species filter</td><td align="center" valign="middle" >2,032</td></tr></tbody></table></table-wrap><p>algorithms that examine medical images, produce magnitudes of medical image data, and provide automated diagnoses of radiological findings. The development of the coding protocol helped to record important data from each screened study. Characteristics were added to the proforma when literature, patterns, or findings required inclusion. The coding was performed by the author, who controlled the inter-rater reliability.</p><p>The percentages of incorporated studies were calculated to perform external validation. The proportions of studies, including diagnostic cohort designs, prospective data collection, and inclusion of multiple institutions, were identified for external validation.</p></sec><sec id="s3"><title>3. Results and Discussions</title><sec id="s3_1"><title>3.1. Search Results</title><p>A total of 4348 studies were yielded from the search process, as shown on the PRISMA flow diagram (<xref ref-type="fig" rid="fig1">Figure 1</xref>). After deduplication, the yield was reduced to 3109 articles. Following screening of title and abstract this was further decreased to 787 articles, and after going through the 2nd stage of the screening process, 31 articles remained. The removal of 756 studies was based on the following criteria: the studies did not report the desired outcome, the radiological aspect was not adequately discussed, or the setting was not clinical. Following a quality analysis, 27 articles were finally included in the review. The data extraction from these articles is shown on <xref ref-type="table" rid="table4">Table 4</xref>.</p></sec><sec id="s3_2"><title>3.2. Inception of AI in Radiology</title><p>In the recent past, digital images and advanced imaging processing techniques were not readily available, even though significant outcomes were accomplished using unique applications of early computers [<xref ref-type="bibr" rid="scirp.107585-ref17">17</xref>]. A type of paradigm shift occurred in computer science during the 1980s, through the invention of the microchip, which allowed scientists to develop systems that can support radiologists in ways previously unimaginable [<xref ref-type="bibr" rid="scirp.107585-ref5">5</xref>]. Following this development, various approaches have been proposed, some having widespread success, such as hypertext, rule-based and case-based reasoning, Bayesian networks [<xref ref-type="bibr" rid="scirp.107585-ref8">8</xref>], and artificial neural networks (ANNs).</p><table-wrap-group id="4"><label><xref ref-type="table" rid="table4">Table 4</xref></label><caption><title> Data extraction for included studies</title></caption><table-wrap id="4_1"><table><tbody><thead><tr><th align="center" valign="middle" >Name of Author</th><th align="center" valign="middle" >Year of Publication</th><th align="center" valign="middle" >Study Type</th><th align="center" valign="middle" >Study Methods</th><th align="center" valign="middle" >Final outcomes</th></tr></thead><tr><td align="center" valign="middle" >Atkinson [<xref ref-type="bibr" rid="scirp.107585-ref1">1</xref>]</td><td align="center" valign="middle" >2016</td><td align="center" valign="middle" >Descriptive Report</td><td align="center" valign="middle" >Discussing myths around AI and its role in hijacking jobs in radiology</td><td align="center" valign="middle" >The activation of AI technologies was found to be one of the most crucial challenges for the user in the initial phases</td></tr><tr><td align="center" valign="middle" >Wong et al. [<xref ref-type="bibr" rid="scirp.107585-ref2">2</xref>]</td><td align="center" valign="middle" >2019</td><td align="center" valign="middle" >Descriptive study</td><td align="center" valign="middle" >Discussion on recent developments in medicine using AI</td><td align="center" valign="middle" >Collaborations for use of AI with radiological assessment are incorporated which can reduce workload of clinical radiologists</td></tr><tr><td align="center" valign="middle" >Mesko [<xref ref-type="bibr" rid="scirp.107585-ref3">3</xref>]</td><td align="center" valign="middle" >2017</td><td align="center" valign="middle" >Editorial</td><td align="center" valign="middle" >Discussing role of AI in precision medicine</td><td align="center" valign="middle" >AI system can be updated by personalized expert knowledge, where both individual observations and images can be utilized as inputs for ANNs</td></tr><tr><td align="center" valign="middle" >Kahn [<xref ref-type="bibr" rid="scirp.107585-ref5">5</xref>]</td><td align="center" valign="middle" >1994</td><td align="center" valign="middle" >Review Article</td><td align="center" valign="middle" >Reviewed AI techniques and its application in radiology</td><td align="center" valign="middle" >Invention of microchips have advanced radiological assessment of medical images</td></tr><tr><td align="center" valign="middle" >Honsy et al. [<xref ref-type="bibr" rid="scirp.107585-ref6">6</xref>]</td><td align="center" valign="middle" >2018</td><td align="center" valign="middle" >Opinion Article</td><td align="center" valign="middle" >Discuss multiple facets of radiology</td><td align="center" valign="middle" >AI methods (deep learning) automatically recognizes complicated patterns in clinical images and provide qualitative assessment.</td></tr><tr><td align="center" valign="middle" >Fazal et al. [<xref ref-type="bibr" rid="scirp.107585-ref7">7</xref>]</td><td align="center" valign="middle" >2018</td><td align="center" valign="middle" >Descriptive study</td><td align="center" valign="middle" >Discussing benefits of AI in radiology</td><td align="center" valign="middle" >Errors in report assessment can be reduced by using AI</td></tr><tr><td align="center" valign="middle" >Schmidt et al. [<xref ref-type="bibr" rid="scirp.107585-ref8">8</xref>]</td><td align="center" valign="middle" >2000</td><td align="center" valign="middle" >Descriptive studies</td><td align="center" valign="middle" >Case-based reasoning was applied in making knowledge-based reasoning</td><td align="center" valign="middle" >Knowledge based system in medical sciences is advanced by hypertext, rule-based and case-based reasoning</td></tr><tr><td align="center" valign="middle" >Brady [<xref ref-type="bibr" rid="scirp.107585-ref11">11</xref>]</td><td align="center" valign="middle" >2017</td><td align="center" valign="middle" >Review article</td><td align="center" valign="middle" >It outlined the errors and discrepancies in radiology, and categorized them to help understand, and contribute, both human- and system-based radiology</td><td align="center" valign="middle" >Humans are not able to account for the many wide-ranging qualitative characteristics in routine medical imaging examinations</td></tr><tr><td align="center" valign="middle" >Ringler et al. [<xref ref-type="bibr" rid="scirp.107585-ref12">12</xref>]</td><td align="center" valign="middle" >2017</td><td align="center" valign="middle" >Retrospective study</td><td align="center" valign="middle" >Reports generated by Syntactic and semantic errors in radiology which were signed by 147 different radiologists from 3 January 2011 through 16 April 2014 were analyzed</td><td align="center" valign="middle" >Extensive medical data is required for moderate ease of retrieval and access in radiology</td></tr><tr><td align="center" valign="middle" >Motyer et al. [<xref ref-type="bibr" rid="scirp.107585-ref13">13</xref>]</td><td align="center" valign="middle" >2016</td><td align="center" valign="middle" >Retrospective study</td><td align="center" valign="middle" >Audit of 378 finalized radiology reports</td><td align="center" valign="middle" >Automation using AI and leveraging big data incorporates a large number of quantitative aspects collaboratively, using an iterative technique</td></tr><tr><td align="center" valign="middle" >Grayev [<xref ref-type="bibr" rid="scirp.107585-ref17">17</xref>]</td><td align="center" valign="middle" >2019</td><td align="center" valign="middle" >Editorial Paper</td><td align="center" valign="middle" >Descriptive</td><td align="center" valign="middle" >Even though significant outcomes were accomplished from the various unique applications of early computers AI has been more advanced in recent years.</td></tr><tr><td align="center" valign="middle" >Daniel et al. [<xref ref-type="bibr" rid="scirp.107585-ref18">18</xref>]</td><td align="center" valign="middle" >2018</td><td align="center" valign="middle" >Descriptive study</td><td align="center" valign="middle" >On use of AI (deep learning) in image based medical diagnosis</td><td align="center" valign="middle" >(AI) can classify retinal images from optical coherence tomography for early diagnosis of retinal diseases</td></tr><tr><td align="center" valign="middle" >Blumke [<xref ref-type="bibr" rid="scirp.107585-ref19">19</xref>]</td><td align="center" valign="middle" >2018</td><td align="center" valign="middle" >Editorial Paper</td><td align="center" valign="middle" >Revision of radiology criteria</td><td align="center" valign="middle" >The weighting of each connection as well as each neuron is used to represent the knowledge base of the system which activates other neurons</td></tr><tr><td align="center" valign="middle" >Pravedello [<xref ref-type="bibr" rid="scirp.107585-ref20">20</xref>]</td><td align="center" valign="middle" >2019</td><td align="center" valign="middle" >Original study</td><td align="center" valign="middle" >The study annotated and adjudicated dataset of chest radiographs to make them publicly available</td><td align="center" valign="middle" >AI learning can train ANNs, based on generic techniques such as clustering, anomaly detection, and association, which are enhanced with each case to assure authentic diagnoses</td></tr></tbody></table></table-wrap><table-wrap id="4_2"><table><tbody><thead><tr><th align="center" valign="middle" >Deyer et al. [<xref ref-type="bibr" rid="scirp.107585-ref21">21</xref>]</th><th align="center" valign="middle" >2019</th><th align="center" valign="middle" >Editorial</th><th align="center" valign="middle" >Discussing application of AI to radiology</th><th align="center" valign="middle" >ANN process allows the continuous progression of the system, learning in a similar way that corresponds with the human brain, but with the benefit of a permanent memory function</th></tr></thead><tr><td align="center" valign="middle" >Schier [<xref ref-type="bibr" rid="scirp.107585-ref22">22</xref>]</td><td align="center" valign="middle" >2018</td><td align="center" valign="middle" >Opinion</td><td align="center" valign="middle" >Providing an alternative view on radiology practice and AI</td><td align="center" valign="middle" >The accuracy rates of ANNs currently surpass human radiologists in narrow-based tasks, such as detecting lung nodule features</td></tr><tr><td align="center" valign="middle" >Stivaros et al. [<xref ref-type="bibr" rid="scirp.107585-ref23">23</xref>]</td><td align="center" valign="middle" >2010</td><td align="center" valign="middle" >Review article</td><td align="center" valign="middle" >Reviews role of decision support systems in radiological assessment</td><td align="center" valign="middle" >Machine learning permits reliable automated detection of lung nodules in CT scans, and pneumonia in chest x-rays</td></tr><tr><td align="center" valign="middle" >Porto Pazos [<xref ref-type="bibr" rid="scirp.107585-ref24">24</xref>]</td><td align="center" valign="middle" >2008</td><td align="center" valign="middle" >Book</td><td align="center" valign="middle" >Use of biological process application in advancement of AI</td><td align="center" valign="middle" >The behaviour of pre-cancerous lesions on CT scans is predicted by means of modeling, or regression, and prevents superfluous invasive examinations, such as biopsy</td></tr><tr><td align="center" valign="middle" >Pesapane et al. [<xref ref-type="bibr" rid="scirp.107585-ref25">25</xref>]</td><td align="center" valign="middle" >2018</td><td align="center" valign="middle" >Narrative review</td><td align="center" valign="middle" >Discusses the role of practicing radiologist in promoting AI in radiology</td><td align="center" valign="middle" >AI will help radiologists in being a multidisciplinary team, be more on forefront with patients and add value to tasks</td></tr><tr><td align="center" valign="middle" >Kamar [<xref ref-type="bibr" rid="scirp.107585-ref26">26</xref>]</td><td align="center" valign="middle" >2016</td><td align="center" valign="middle" >Review paper</td><td align="center" valign="middle" >Considering Human intelligence in AI</td><td align="center" valign="middle" >Electronic health records could improve the success rate of radiologists</td></tr><tr><td align="center" valign="middle" >Fieschi [<xref ref-type="bibr" rid="scirp.107585-ref27">27</xref>]</td><td align="center" valign="middle" >2013</td><td align="center" valign="middle" >Book</td><td align="center" valign="middle" >Discusses expert systems of AI in medicne</td><td align="center" valign="middle" >Radiologists can distinguish themselves by creating AI that does hybrid work through collective intelligence software</td></tr><tr><td align="center" valign="middle" >Danforth et al. [<xref ref-type="bibr" rid="scirp.107585-ref28">28</xref>]</td><td align="center" valign="middle" >2009</td><td align="center" valign="middle" >Project writing</td><td align="center" valign="middle" >Developed a virtual patient simulations system that will help in medical education</td><td align="center" valign="middle" >Intelligence augmentation in radiology is where higher levels of accuracy in diagnosis are achieved through the amalgamation of human radiologists and AI to form hybrid intelligence</td></tr><tr><td align="center" valign="middle" >Thrall et al. [<xref ref-type="bibr" rid="scirp.107585-ref29">29</xref>]</td><td align="center" valign="middle" >2018</td><td align="center" valign="middle" >Descriptive study</td><td align="center" valign="middle" >Discusses opportunities and challenges faced by AI in radiology</td><td align="center" valign="middle" >Value created by AI will measure its role in radiology i.e., by increasing diagnostic certainty, quicker turnaround, improved patient outcomes, and for radiologists a better quality of work life</td></tr><tr><td align="center" valign="middle" >Gillies et al. [<xref ref-type="bibr" rid="scirp.107585-ref30">30</xref>]</td><td align="center" valign="middle" >2016</td><td align="center" valign="middle" >Special report</td><td align="center" valign="middle" >Describes the process of radiomics, its potential power to facilitate better clinical decision making and its challenges; especially in cancer patients</td><td align="center" valign="middle" >It is important to consider aspects such as picture archiving and communication system (PACS), electronic health records, IT environments, and radiology information systems in the implementation phase of AI</td></tr><tr><td align="center" valign="middle" >Prevedello et al. [<xref ref-type="bibr" rid="scirp.107585-ref31">31</xref>]</td><td align="center" valign="middle" >2017</td><td align="center" valign="middle" >Retrospective study</td><td align="center" valign="middle" >AI algorithm performance was tested on a separate dataset containing 35 with noncritical findings, 15 with suspected acute infarct findings, and 50 with hemorrhage, mass effect, or hydrocephalus findings</td><td align="center" valign="middle" >AI (deep learning) is promising for detecting noncontrast-enhanced head CT, whereas, to detect suspected acute infarction required dedicated algorithm. Detection of suspected acute infarct had lower sensitivity compared to hemorrhage, mass effect, or hydrocephalus detection, but showed reasonable performance</td></tr><tr><td align="center" valign="middle" >Hanson [<xref ref-type="bibr" rid="scirp.107585-ref32">32</xref>]</td><td align="center" valign="middle" >2001</td><td align="center" valign="middle" >Review article</td><td align="center" valign="middle" >Databases were searched for articles regarding application of AI in radiographs used in intensive care units</td><td align="center" valign="middle" >Unsupervised learning is one approach that allows automated data curation</td></tr><tr><td align="center" valign="middle" >Kulikowski [<xref ref-type="bibr" rid="scirp.107585-ref33">33</xref>]</td><td align="center" valign="middle" >1988</td><td align="center" valign="middle" >Review article</td><td align="center" valign="middle" >A brief history of articles before 1988 on the use of AI in medicine is reviewed in a systematic way</td><td align="center" valign="middle" >Recent developments in unsupervised learning include different auto-encoders and generative adversarial networks, which are highly effective, where discriminated aspects are learned despite a lack of comprehensive labelling</td></tr></tbody></table></table-wrap></table-wrap-group><p>Since 1943, ANNs have held a dominant position among AI techniques used in modern medicine [<xref ref-type="bibr" rid="scirp.107585-ref18">18</xref>]. The incorporation of ANNs has been one of the most effective and prolific applications of AI in radiological history [<xref ref-type="bibr" rid="scirp.107585-ref6">6</xref>]. ANNs are analogues of neurons in the human brain, comprising an amassed network of highly interconnected computer procedures, which perform parallel computations for data processing, with weighted connections between each node of the network [<xref ref-type="bibr" rid="scirp.107585-ref2">2</xref>]. This weighting results in the activation of other artificial neurons in the network, based on mathematical formulas [<xref ref-type="bibr" rid="scirp.107585-ref19">19</xref>]. The combined weighting of connections, as a product of the whole artificial neuronal structure, is used to represent the knowledge base of the system.</p><p>Supervised learning can be used to train ANNs, through a comparison of expected and actual outcomes. Unsupervised or semi-supervised learning can also train ANNs, based on generic techniques, such as clustering, anomaly detection, and association, which are enhanced with each case to assure authentic diagnoses [<xref ref-type="bibr" rid="scirp.107585-ref20">20</xref>]. ANNs are capable of extrapolating the input data of simple cases to handle more difficult scenarios. Additionally, a system can be updated by personalized expert knowledge, where both individual observations and images can be utilized as inputs [<xref ref-type="bibr" rid="scirp.107585-ref2">2</xref>] [<xref ref-type="bibr" rid="scirp.107585-ref3">3</xref>]. This process allows the continuous progression of a system, learning in a similar way that corresponds with human cognitive developmnet, but with the benefit of a permanent memory function [<xref ref-type="bibr" rid="scirp.107585-ref21">21</xref>]. AI-based computer-aided detected (CAD) programs are the most common application of ANNs in medical imaging. Images are investigated using ANN software to emphasize areas of risk, stimulating additional investigation by a radiologist. ANNs have been successfully applied to the characterization of cancerous tissue, leading to an increase in reading sensitivity, specificity, and accuracy in the detection of cancerous lesions and the recurrence of such phenomena.</p></sec><sec id="s3_3"><title>3.3. Evolution of AI in Radiology: Current Concepts</title><p>The segmentation, staging, and diagnosis of disease are covered within the term “characterization” [<xref ref-type="bibr" rid="scirp.107585-ref18">18</xref>]. These activities are achieved by quantifying the radiological aspects of an abnormality, which include gathering data about internal texture and the size and extent of findings. Humans are not generally able to account for the many wide-ranging qualitative characteristics found in routine medical imaging examinations [<xref ref-type="bibr" rid="scirp.107585-ref11">11</xref>]. This is exacerbated by the inevitable differences between individual interpretations and patient characteristics. By contrast, AI leverages big data that processes a large number of quantitative aspects collaboratively, using iterative techniques [<xref ref-type="bibr" rid="scirp.107585-ref13">13</xref>].</p><p>In the past decade, there have been a number of significant innovations in medical imaging using deep learning techniques for image classification. Deep learning involves computational models that learn data characteristics rapidly from multiple levels. The dominance of deep learning in medical imaging studies has increased as the amount of data available has improved, largely the result of the powerful hardware in current computers. Indeed, the accuracy rates of ANNs now surpass human radiologist performance in narrow-based tasks, such as detecting lung nodule features [<xref ref-type="bibr" rid="scirp.107585-ref22">22</xref>]. Also, machine learning permits reliable automated detection of lung nodules in CT scans and pneumonia in chest x-rays [<xref ref-type="bibr" rid="scirp.107585-ref23">23</xref>]. The behavior of pre-cancerous lesions on CT scans is predicted by means of modeling, or regression, and prevents superfluous invasive examinations, such as biopsy [<xref ref-type="bibr" rid="scirp.107585-ref24">24</xref>]. This has significant potential in population screening for cancer, especially in countries where radiologists may be overworked or lack specialized training.</p><p>The demonstration of technological capabilities and the identification of novel systems in radiology is the first step in devising a strategy for practice, but which, however, may pose a threat to practitioners of other disciplines. For example, other medical practitioners may spend more time with certain patients than radiologists and so might choose to purchase particular AI technologies, and in doing so automatically compete with radiologists for resources [<xref ref-type="bibr" rid="scirp.107585-ref25">25</xref>]. By contrast, in a typical current practical scenario, the use of AI could be highly effective if integrated into the work of many professions and that of their respective colleagues. For example, even the simple analysis of electronic health records may improve the success rate of radiologists [<xref ref-type="bibr" rid="scirp.107585-ref26">26</xref>]. Thus, a strategic objective for radiologists could be to distinguish themselves by creating AI that does hybrid work through collective intelligence software [<xref ref-type="bibr" rid="scirp.107585-ref27">27</xref>].</p><p>Intelligence augmentation is a topical buzzword that often accompanies discourse in AI, such as found at a recent World Economic Forum (2017). Intelligence augmentation in radiology concerns higher levels of accuracy in diagnosis achieved through the amalgamation of human radiologists and AI, forming a hybrid intelligence [<xref ref-type="bibr" rid="scirp.107585-ref28">28</xref>]. It is effective because clusters of AI agents and humans working collectively make more effective predictions compared to AI techniques or humans used independently [<xref ref-type="bibr" rid="scirp.107585-ref26">26</xref>]. This process of evaluation may or may not hold for radiological diagnosis, however, which arguably requires greater scrutiny and validation of peer-reviewed articles. Patient safety standards must also be considered in these systems, while judicial transparency is created through observation of a human radiologist, providing legal accountability [<xref ref-type="bibr" rid="scirp.107585-ref28">28</xref>]. Also, the requirement for precision diagnostics requires additional research into AI approaches. Machine learning may become a leading tool in the future to extrapolate large data sets derived from imaging to evaluate cancer genes, behavior, and response to treatment, enabling radiologists to discover associations between pathogenesis and imaging features of tumors [<xref ref-type="bibr" rid="scirp.107585-ref27">27</xref>]. Also, precision diagnostics can plausibly be integrated for degenerative and chronic diseases, including coronary heart disorders and Alzheimer’s disease, as well as for any disease with imaging and genetic biomarker associations [<xref ref-type="bibr" rid="scirp.107585-ref29">29</xref>].</p><p>While significant progress has been made, machine learning technology is currently quite a way from successful integration into radiology practice. While technologies have been publicly lauded and promoted in specialist disciplines, they have often failed to achieve potential in the implementation phase; indeed, the birth and death of technologies is often labelled the “hype cycle”. One major issue, for instance, is that computing systems are not yet technically fast enough to render outcomes within a clinically appropriate time frame for urgent diagnoses and emergencies, especially if the required technologies are not widely available in medical institutions [<xref ref-type="bibr" rid="scirp.107585-ref29">29</xref>].</p><p>It is important to consider aspects such as picture archiving and communication system (PACS), electronic health records, IT environments, and radiology information systems in the implementation phase of AI [<xref ref-type="bibr" rid="scirp.107585-ref30">30</xref>]. Increasing technological sophistication is based on the acquisition and improvement of hardware, as well as communication between departments and hospitals. If the technology is indispensable, protecting data storage and cloud platforms will become increasingly important [<xref ref-type="bibr" rid="scirp.107585-ref31">31</xref>]. AI applications provide an essential approach in the extraction of latent information from images, and is not hindered by geographical distance with respect to the information source. Current advancements in deep learning and big data have laid the ground for the field of radiomics, involving the use of hundreds of abstract mathematical characteristics of images that can be characterized and interpreted using AI techniques, and also easily integrated with other data, such as that relating to therapeutic outcomes and genomics findings.</p><p>In recent years, there has been an increase in reported workload following the current reliance of hospitals on imaging. Thus, the use of an AI system may be beneficial in reducing daily workload in the radiology department and keeping up-to-date with hospital services [<xref ref-type="bibr" rid="scirp.107585-ref22">22</xref>]. Another crucial role of AI may be to screen for normal plain films and review abnormal films in cancer screening. Similarly, malignancy can be identified through using question-specific AI techniques. However, the use of AI technologies was found to be one of the most crucial challenges for the user in the initial phases of one study [<xref ref-type="bibr" rid="scirp.107585-ref1">1</xref>] [<xref ref-type="bibr" rid="scirp.107585-ref22">22</xref>]. Nevertheless, an AI tool gives independency to health professionals in the reporting of simple scans. AI tools may likely be developed as a way for doctors to incorporate a type of “autopilot” to their daily activities, which may perhaps be innovated upon to produce more complex integrated systems. In the context of neuroimaging, considerations about AI solutions have emerged in various MRI projects, such as the large-scale Human Connectome Project, which aims to access brain connectivity [<xref ref-type="bibr" rid="scirp.107585-ref7">7</xref>] [<xref ref-type="bibr" rid="scirp.107585-ref21">21</xref>].</p></sec></sec><sec id="s4"><title>4. Future Developments</title><p>One of the most central and complicated aspects of AI systems is dealing with the data source itself. Extensive medical data is required for moderate ease of retrieval and access [<xref ref-type="bibr" rid="scirp.107585-ref12">12</xref>]. Millions of medical images are produced each year, since one out of four patients receives a CT examination and one out of ten patients receives an MRI examination [<xref ref-type="bibr" rid="scirp.107585-ref10">10</xref>]. Progress in digital health system protocols worldwide have assured that medical images are electronically handled in a systematic way, permitting the use of appropriate practice for developing and emerging countries.</p><p>A patient cohort selection associated through AI identifies objects through segmentation techniques [<xref ref-type="bibr" rid="scirp.107585-ref34">34</xref>]. This ensures that a well-defined set of criteria is observed in the training data. Furthermore, it assists in mitigating unwanted variation in the data, which is a product of data acquisition principles and imaging protocols, including actual imaging and contrast agent administration across institutions [<xref ref-type="bibr" rid="scirp.107585-ref18">18</xref>].</p><p>The substandard performance of a number of automated and semi-automated segmentation AI programs has perhaps restricted their use in the curatation of data [<xref ref-type="bibr" rid="scirp.107585-ref20">20</xref>] Complications with machine learning have emerged with respect to rare diseases, where automated labeling algorithms are not effective. This issue is exacerbated when a number of human readers lack prior exposure and so are not able to verify unidentified diseases. However, unsupervised learning is an approach that allows automated data curation [<xref ref-type="bibr" rid="scirp.107585-ref32">32</xref>]. Recent developments in unsupervised learning include various auto-encoders and generative adversarial networks; these are highly effective, where discriminated aspects are learned despite a lack of comprehensive labeling [<xref ref-type="bibr" rid="scirp.107585-ref33">33</xref>].</p><p>Unsupervised domain adaptation has been explored recently through the use of adversarial networks for segmenting brain MRI, which permit accuracy and generalizability closer to supervised learning methods [<xref ref-type="bibr" rid="scirp.107585-ref23">23</xref>]. Sparse auto-encoders using an unsupervised approach are also employed for segmenting mammographic textures and breast density. Spatial context information is employed in self-supervised learning to identify body parts in MRI and CT volumes by means of paired CNNs [<xref ref-type="bibr" rid="scirp.107585-ref24">24</xref>]. Unparalleled open-access to labeled medical imaging data is offered by the Cancer Imaging Archive, which allows rapid AI model prototyping and hence reduces the need for comprehensive data curation procedures.</p><p>The use of patient data brings forth ethical concerns with respect to the training of AI systems. Data are not securely connected to state-of-the-art AI systems in medical institutions [<xref ref-type="bibr" rid="scirp.107585-ref28">28</xref>]. However, recently, a stricter privacy policy has been made possible in the US through the Health Insurance Portability and Accountability Act of 1996, which has enforced compliant storage systems. These systems share only the trained model and allow multiple actors to work collaboratively with AI models irrespective of their input data sets [<xref ref-type="bibr" rid="scirp.107585-ref29">29</xref>].</p><p>A decentralized federated learning approach has been used in other contributions to the field. In this system, data remains local during training, but the combination of local updates permits the interpretation of a shared model. The live copies of the shared model result in the desired inference, but reduce privacy concerns and data sharing [<xref ref-type="bibr" rid="scirp.107585-ref33">33</xref>]. Encrypted data train deep learning networks for predicting decryption keys to assure comprehensive confidentiality in the overall process. All these solutions create sustainable data for an AI ecosystem, without undermining privacy and compliance, even though this system is only in an early phase of development [<xref ref-type="bibr" rid="scirp.107585-ref33">33</xref>].</p><p>The advancements made in radiological imaging and diagnosis through AI calibration is an important development of medical practice. However, the full benefit may be in the collaboration of AI with humans. Using AI systems, radiologists can help promote and improve the diagnostic capability of radiological modalities, and in return this can help the advancement of the field. Future studies need to focus on the application of AI in clinical diagnosis using radiological images. Radiologist suggestions and requirements should be considered in the process of AI advancement in radiology, to enable smoother implementation and strengthen clinical practice.</p><p>This study may limit in that it included a language bias, since only data in English was considered. It also had to include grey literature owing to a limitation in the actual quantity of relevant studies; for example, none of the studies used was a randomized control trial. However, as grey literature was also searched in this study, there was no publication bias. Finally, all included studies had high heterogeneity because a meta-analysis was not carried out; the results were synthesized in a narrative manner. Therefore, the limitations associated with narrative review. However, by preventing reviewer selection bias and extensive referencing, the bias related to narrative review was minimized.</p></sec><sec id="s5"><title>5. Conclusion</title><p>The integration of automated systems through information systems and AI is an important prospect for the future of medical imaging. Decision support systems may substantially improve medical practice if integrated into routine clinical functions. A number of different aspects of learned knowledge can be shared through the selection, analysis, and diagnostic interpretation of radiological imaging. This study also found that it was necessary to combine clinical care functions, research, and education to inform radiologists about current technology in the medical imaging community. The computer-based patient record is now an important objective for healthcare administrators that could provide a platform for the integration of clinical information, medical literature, decision support technology, and imaging, and thus markedly improve clinical practice. A valuable contribution can be made in clinical information systems through using decision support systems. These may improve medical care quality through the use of computer-based patient records.</p></sec><sec id="s6"><title>Funding Statement</title><p>The study is self-funded.</p></sec><sec id="s7"><title>Acknowledgements</title><p>The author acknowledges all associated personnel that contributed to the completion of this study.</p></sec><sec id="s8"><title>Conflicts of Interest</title><p>The study has no competing interests.</p></sec><sec id="s9"><title>Cite this paper</title><p>Ahmad, R. (2021) The Role of Digital Technology and Artificial Intelligence in Diagnosing Medical Images: A Systematic Review. Open Journal of Radiology, 11, 19-34. https://doi.org/10.4236/ojrad.2021.111003</p></sec><sec id="s10"><title>Abbreviations</title><p>(AI) Artificial Intelligence;</p><p>(PRISMA) Preferred Reporting Items for Systematic Reviews and Meta-Analyses;</p><p>(MRI) Magnetic Resonance Imaging;</p><p>(US) Ultrasound;</p><p>(CT) Computerized Tomography;</p><p>(STROBE) Strengthening the Reporting of OBservational Studies in Epidemiology;</p><p>(ANNs) Artificial Neural Networks;</p><p>(CAD) Computer-Aided Design;</p><p>(PACS) Picture Archiving and Communication System.</p></sec></body><back><ref-list><title>References</title><ref id="scirp.107585-ref1"><label>1</label><mixed-citation publication-type="other" xlink:type="simple">Winsberg, F., Elkin, M., Macy Jr., J., Bordaz, V. and Weymouth, W. (1967) Detection of Radiographic Abnormalities in Mammograms by Means of Optical Scanning and Computer Analysis. Radiology, 89, 211-215.  
https://doi.org/10.1148/89.2.211</mixed-citation></ref><ref id="scirp.107585-ref2"><label>2</label><mixed-citation publication-type="other" xlink:type="simple">Kulikowski, C.A. (1988) Artificial Intelligence in Medical Consultation Systems: A Review. IEEE Engineering in Medicine and Biology Magazine, 7, 34-39.  
https://doi.org/10.1109/51.1972</mixed-citation></ref><ref id="scirp.107585-ref3"><label>3</label><mixed-citation publication-type="other" xlink:type="simple">Hanson, C.W. and Marshall, B.E. (2001) Artificial Intelligence Applications in the Intensive Care Unit. Critical Care Medicine, 29, 427-435.  
https://doi.org/10.1097/00003246-200102000-00038</mixed-citation></ref><ref id="scirp.107585-ref4"><label>4</label><mixed-citation publication-type="other" xlink:type="simple">Prevedello, L.M., Erdal, B.S., Ryu, J.L., Little, K.J., Demirer, M., Qian, S. and White, R.D. (2017) Automated Critical Test Findings Identification and Online Notification System Using Artificial Intelligence in Imaging. Radiology, 285, 923-931.  
https://doi.org/10.1148/radiol.2017162664</mixed-citation></ref><ref id="scirp.107585-ref5"><label>5</label><mixed-citation publication-type="other" xlink:type="simple">Gillies, R.J., Kinahan, P.E. and Hricak, H. (2016) Radiomics: Images Are More than Pictures, They Are Data. Radiology, 278, 563-577.  
https://doi.org/10.1148/radiol.2015151169</mixed-citation></ref><ref id="scirp.107585-ref6"><label>6</label><mixed-citation publication-type="other" xlink:type="simple">Thrall, J.H., Li, X., Li, Q., Cruz, C., Do, S., Dreyer, K. and Brink, J. (2018) Artificial Intelligence and Machine Learning in Radiology: Opportunities, Challenges, Pitfalls, and Criteria for Success. Journal of the American College of Radiology, 15, 504-508.  
https://doi.org/10.1016/j.jacr.2017.12.026</mixed-citation></ref><ref id="scirp.107585-ref7"><label>7</label><mixed-citation publication-type="other" xlink:type="simple">Danforth, D.R., Procter, M., Chen, R., Johnson, M. and Heller, R. (2009) Development of Virtual Patient Simulations for Medical Education. 3D Virtual Worlds for Health and Healthcare Journal of Virtual Worlds Research, 2.  
https://doi.org/10.4101/jvwr.v2i2.707</mixed-citation></ref><ref id="scirp.107585-ref8"><label>8</label><mixed-citation publication-type="other" xlink:type="simple">Fiesch, M. (2013) Artificial Intelligence in Medicine: Expert Systems. Springer, Berlin.</mixed-citation></ref><ref id="scirp.107585-ref9"><label>9</label><mixed-citation publication-type="other" xlink:type="simple">Kamar, E. (2016) Directions in Hybrid Intelligence: Complementing AI Systems with Human Intelligence. Proceedings of the 25th International Joint Conference on Artificial Intelligence, New York, 9-15 July 2016, 4070-4073.</mixed-citation></ref><ref id="scirp.107585-ref10"><label>10</label><mixed-citation publication-type="other" xlink:type="simple">Pesapane, F., Codari, M. and Sardanelli, F. (2018) Artificial Intelligence in Medical Imaging: Threat or Opportunity? Radiologists Again at the Forefront of Innovation in Medicine. European Radiology Experimental, 2, 35.  
https://doi.org/10.1186/s41747-018-0061-6</mixed-citation></ref><ref id="scirp.107585-ref11"><label>11</label><mixed-citation publication-type="other" xlink:type="simple">Porto Pazos, A.B. and Pazos Sierra, A. (2008) Advancing Artificial Intelligence through Biological Process Applications. In: Medical Information Science Reference, IGI Global, New York, 231-249. https://doi.org/10.4018/978-1-59904-996-0</mixed-citation></ref><ref id="scirp.107585-ref12"><label>12</label><mixed-citation publication-type="other" xlink:type="simple">Stivaros, S.M., Gledson, A., Nenadic, G., Zeng, X.J., Keane, J. and Jackson, A. (2010) Decision Support Systems for Clinical Radiological Practice—Towards the Next Generation. The British Journal of Radiology, 83, 904-914.  
https://doi.org/10.1259/bjr/33620087</mixed-citation></ref><ref id="scirp.107585-ref13"><label>13</label><mixed-citation publication-type="other" xlink:type="simple">Schier, R. (2018) Artificial Intelligence and the Practice of Radiology: An Alternative View. Journal of the American College of Radiology, 15, 1004-1007.  
https://doi.org/10.1016/j.jacr.2018.03.046</mixed-citation></ref><ref id="scirp.107585-ref14"><label>14</label><mixed-citation publication-type="other" xlink:type="simple">Deyer, T. and Doshi, A. (2019) Application of Artificial Intelligence to Radiology. Annals of Translational Medicine, 7, 230. https://doi.org/10.21037/atm.2019.05.79</mixed-citation></ref><ref id="scirp.107585-ref15"><label>15</label><mixed-citation publication-type="other" xlink:type="simple">Prevedello, L.M., Halabi, S.S., Shih, G., Wu, C.C., Kohli, M.D., Chokshi, F.H., Erickson, B.J., Kalpathy-Cramer, J., Andriole, K.P. and Flanders, A.E. (2019) Challenges Related to Artificial Intelligence Research in Medical Imaging and the Importance of Image Analysis Competitions. Radiology: Artificial Intelligence, 1, e180031.  
https://doi.org/10.1148/ryai.2019180031</mixed-citation></ref><ref id="scirp.107585-ref16"><label>16</label><mixed-citation publication-type="other" xlink:type="simple">Bluemke, D.A. (2018) Radiology: Responding to Rapid Changes in Our Field. Radiological Society of North America, Oak Brook, 288.  
https://doi.org/10.1148/radiol.2018184013</mixed-citation></ref><ref id="scirp.107585-ref17"><label>17</label><mixed-citation publication-type="other" xlink:type="simple">Ting, D.S., Liu, Y., Burlina, P., Xu, X., Bressler, N.M. and Wong, T.Y. (2018) AI for Medical Imaging Goes Deep. Nature Medicine, 24, 539-540.  
https://doi.org/10.1038/s41591-018-0029-3</mixed-citation></ref><ref id="scirp.107585-ref18"><label>18</label><mixed-citation publication-type="other" xlink:type="simple">Grayev, A. (2019) Artificial Intelligence in Radiology: Resident Recruitment Help or Hindrance? Academic Radiology, 26, 699-700.  
https://doi.org/10.1016/j.acra.2019.01.005</mixed-citation></ref><ref id="scirp.107585-ref19"><label>19</label><mixed-citation publication-type="other" xlink:type="simple">Cuschieri, S. (2019) The STROBE Guidelines. Saudi Journal of Anaesthesia, 13, S31.  
https://doi.org/10.4103/sja.SJA_543_18</mixed-citation></ref><ref id="scirp.107585-ref20"><label>20</label><mixed-citation publication-type="other" xlink:type="simple">Moher, D., Liberati, A., Tetzlaff, J., Altman, D.G. and The PRISMA Group (2009) Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. Annals of Internal Medicine, 151, 264-269.  
https://doi.org/10.7326/0003-4819-151-4-200908180-00135</mixed-citation></ref><ref id="scirp.107585-ref21"><label>21</label><mixed-citation publication-type="other" xlink:type="simple">Waite, S., Scott, J.M., Legasto, A., Kolla, S., Gale, B. and Krupinski, E.A. (2017) Systemic Error in Radiology. American Journal of Roentgenology, 209, 629-639.  
https://doi.org/10.2214/AJR.16.17719</mixed-citation></ref><ref id="scirp.107585-ref22"><label>22</label><mixed-citation publication-type="other" xlink:type="simple">Motyer, R.E., Liddy, S., Torreggiani, W.C. and Buckley, O. (2016) Frequency and Analysis of Non-Clinical Errors Made in Radiology Reports Using the National Integrated Medical Imaging System Voice Recognition Dictation Software. Irish Journal of Medical Science (1971-), 185, 921-927.  
https://doi.org/10.1007/s11845-016-1507-6</mixed-citation></ref><ref id="scirp.107585-ref23"><label>23</label><mixed-citation publication-type="other" xlink:type="simple">Ringler, M.D., Goss, B.C. and Bartholmai, B.J. (2017) Syntactic and Semantic Errors in Radiology Reports Associated with Speech Recognition Software. Health Informatics Journal, 23, 3-13. https://doi.org/10.1177/1460458215613614</mixed-citation></ref><ref id="scirp.107585-ref24"><label>24</label><mixed-citation publication-type="other" xlink:type="simple">Brady, A.P. (2017) Error and Discrepancy in Radiology: Inevitable or Avoidable? Insights into Imaging, 8, 171-182. https://doi.org/10.1007/s13244-016-0534-1</mixed-citation></ref><ref id="scirp.107585-ref25"><label>25</label><mixed-citation publication-type="other" xlink:type="simple">Garland, L.H. (1949) On the Scientific Evaluation of Diagnostic Procedures: Presidential Address Thirty-Fourth Annual Meeting of the Radiological Society of North America. Radiology, 52, 309-328. https://doi.org/10.1148/52.3.309</mixed-citation></ref><ref id="scirp.107585-ref26"><label>26</label><mixed-citation publication-type="other" xlink:type="simple">Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H. and Wang, Y. (2017) Artificial Intelligence in Healthcare: Past, Present and Future. Stroke and Vascular Neurology, 2, 230-243.  
https://doi.org/10.1136/svn-2017-000101</mixed-citation></ref><ref id="scirp.107585-ref27"><label>27</label><mixed-citation publication-type="other" xlink:type="simple">Schmidt, R. and Gierl, L. (2000) Case-Based Reasoning for Medical Knowledge-Based Systems. Studies in Health Technology and Informatics, 77, 720-725.</mixed-citation></ref><ref id="scirp.107585-ref28"><label>28</label><mixed-citation publication-type="other" xlink:type="simple">Fazal, M.I., Patel, M.E., Tye, J. and Gupta, Y. (2018) The Past, Present and Future Role of Artificial Intelligence in Imaging. European Journal of Radiology, 105, 246-250. https://doi.org/10.1016/j.ejrad.2018.06.020</mixed-citation></ref><ref id="scirp.107585-ref29"><label>29</label><mixed-citation publication-type="other" xlink:type="simple">Hosny, A., Parmar, C., Quackenbush, J., Schwartz, L.H. and Aerts, H.J. (2018) Artificial Intelligence in Radiology. Nature Reviews Cancer, 18, 500-510.  
https://doi.org/10.1038/s41568-018-0016-5</mixed-citation></ref><ref id="scirp.107585-ref30"><label>30</label><mixed-citation publication-type="other" xlink:type="simple">Kahn Jr., C.E. (1994) Artificial Intelligence in Radiology: Decision Support Systems. Radiographics, 14, 849-861. https://doi.org/10.1148/radiographics.14.4.7938772</mixed-citation></ref><ref id="scirp.107585-ref31"><label>31</label><mixed-citation publication-type="other" xlink:type="simple">Liew, C. (2018) The Future of Radiology Augmented with Artificial Intelligence: A Strategy for Success. European Journal of Radiology, 102, 152-156.  
https://doi.org/10.1016/j.ejrad.2018.03.019</mixed-citation></ref><ref id="scirp.107585-ref32"><label>32</label><mixed-citation publication-type="other" xlink:type="simple">Mesko, B. (2017) The Role of Artificial Intelligence in Precision Medicine. Expert Review of Precision Medicine and Drug Development, 2, 239-241.  
https://doi.org/10.1080/23808993.2017.1380516</mixed-citation></ref><ref id="scirp.107585-ref33"><label>33</label><mixed-citation publication-type="other" xlink:type="simple">Wong, S.H., Al-Hasani, H., Alam, Z. and Alam, A. (2019) Artificial Intelligence in Radiology: How Will We Be Affected? European Radiology, 29, 141-143.  
https://doi.org/10.1007/s00330-018-5644-3</mixed-citation></ref><ref id="scirp.107585-ref34"><label>34</label><mixed-citation publication-type="other" xlink:type="simple">Atkinson, R.D. (2016) “It’s Going to Kill Us!” And Other Myths about the Future of Artificial Intelligence. Information Technology &amp; Innovation Foundation.  
http://www2.itif.org/2016-myths-machine-learning.pdf</mixed-citation></ref></ref-list></back></article>