<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="systematic-review" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.127732.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Systematic Review</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Towards achieving lightweight intrusion detection systems in Internet of Things, the role of incremental machine learning: A systematic literature review</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 not approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Agbedanu</surname>
                        <given-names>Promise Ricardo</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-2522-891X</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Musabe</surname>
                        <given-names>Richard</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Rwigema</surname>
                        <given-names>James</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Gatare</surname>
                        <given-names>Ignace</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Maginga</surname>
                        <given-names>Theofrida Julius</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Amenyedzi</surname>
                        <given-names>Destiny Kwabla</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>African Centre of Excellence in Internet of Things, University of Rwanda, Kigali, Rwanda</aff>
                <aff id="a2">
                    <label>2</label>Rwanda Polytechnic, Kigali, Rwanda</aff>
                <aff id="a3">
                    <label>3</label>College of Science and Technology, University of Rwanda, Kigali, Rwanda</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:ricardopromise@gmail.com">ricardopromise@gmail.com</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>24</day>
                <month>11</month>
                <year>2022</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2022</year>
            </pub-date>
            <volume>11</volume>
            <elocation-id>1377</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>2</day>
                    <month>11</month>
                    <year>2022</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Agbedanu PR et al.</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/11-1377/pdf"/>
            <abstract>
                <p>While the benefits of IoT cannot be overstated, its computational constraints make it challenging to deploy security methodologies that have been deployed in traditional computing systems. The benefits and computational constraints have made IoT systems attractive to cyber-attacks. One way to mitigate these attacks is to detect them. In this study, a Systematic Literature Review (SLR) has been conducted to analyze the role of incremental machine learning in achieving lightweight intrusion detection for IoT systems. The study analyzed existing incremental machine learning approaches used in designing intrusion detection systems for IoT ecosystems, emphasizing the incremental methods used in detecting intrusions, the datasets used to evaluate these methods, and how the method achieves lightweight status. The SLR outlined the contributions of each study, focusing on their strengths and gaps, the datasets used, and the incremental machine learning model used. This study revealed that incremental learning approaches in detecting intrusion in IoT systems are in their infant stage. Over 12 years, from 2010 to 2022, a total of 21 studies were carried out in IDSs using incremental machine learning, with 8 studies carried out in IoT systems. In addition to reviewing the literature, we offer suggestions for improving existing solutions and achieving lightweight IDS for IoT systems. We also discussed some problems with making lightweight IDS for IoT systems and areas where more research could be done in the future.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Internet of Things</kwd>
                <kwd>Incremental Machine Learning</kwd>
                <kwd>Online Machine Learning</kwd>
                <kwd>Intrusion Detection System</kwd>
                <kwd>Anomaly Detection</kwd>
                <kwd>Network Security</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>PASET Regional Scholarship and Innovation Fund</funding-source>
                </award-group>
                <award-group id="fund-2">
                    <funding-source>Google PhD Fellowship Program</funding-source>
                </award-group>
                <funding-statement>This work was supported by the PASET Regional Scholarship and Innovation Fund and Google PhD Fellowship Program.</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>The past three decades have seen a massive paradigm shift in computing technology. This shift is mainly due to increased computing power and communication speed. The latter has enabled us to develop intelligent devices that can communicate with each other. These intelligent devices make up the Internet of Things (IoT) ecosystem. The IoT ecosystem is deployed in cities, healthcare, energy, agriculture, transportation, and industries. Moreover, the internet of things has become a household name because of its numerous benefits to the various domains it has been applied to. However, these benefits have made the IoT ecosystem attractive to cyber attackers. Over the years, security methodologies like encryption, authentication, data confidentiality, access control, and privacy have been proposed by several researchers to ensure security in IoT environments. Despite these security solutions, IoT systems are still vulnerable and highly susceptible to cyber-attacks. An alternative approach to fighting these attacks is to detect them using Intrusion Detection Systems (IDS). In traditional computer networks, IDS monitors the network&#x2019;s activities. Although the concept of intrusion detection has been well explored in traditional computing and network systems as far back as the 1980s, the idea is in its infant stage in IoT security
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>
                </sup>. The computational constraints of IoT systems make it practically impossible to implement traditional IDS in IoT environments. Although many IDS solutions have been proposed, most use offline or batch machine learning models. This situation makes these models computationally expensive and difficult to deploy on IoT devices. An alternative to the above-mentioned the approach is to build IDS that learn from data streams, which can produce IDS with minimal computational usage. In this paper, the authors seek to present a systematic review of incremental ML-based IDS in IoT systems. Several surveys and review articles have been done in IDS for IoT. But to the best of our knowledge, none of these surveys or SLRs focuses on the role of incremental machine learning and how they can lead to lightweight IDS that are suitable for the IoT ecosystem. This study covers work done using incremental ML to develop IDS for IoT systems from 2010 to 2022. The period from 2010 to 2022 was adopted for this study because we wanted to analyze the research trend of incremental ML-based IDS in IoT systems since 2010. We used the methods identified by 
                <xref ref-type="bibr" rid="ref-2">2</xref>,
                <xref ref-type="bibr" rid="ref-3">3</xref> to conduct our studies. This work differs from other existing studies by exploring how incremental machine learning methods achieve lightweight IDS that fit into the computational constraint nature of IoT systems. The study further considers some of the general potential problems facing the implementation of IDS in IoT environments. A total of 168 studies were returned based on our search criteria, but eight (8) studies were found to be IoT-based after applying our formulated inclusion and exclusion criteria. However, because the number was small, we decided to include studies that satisfied the inclusion criteria but were not IoT-based, which yielded 13 studies. This brought the total number of studies considered in this SLR to 21. However, most of our analyses were primarily focused on IoT-based studies since this study&#x2019;s objective. The primary contributions of our study are as follows:</p>
            <list list-type="bullet">
                <list-item>
                    <p>Conducting a comprehensive systematic literature review of incremental ML methods in designing IDS for IoT systems.</p>
                </list-item>
                <list-item>
                    <p>This work also provides a detailed analysis and discussion of how incremental ML models could effectively fit into real-time IDSs for IoT systems.</p>
                </list-item>
                <list-item>
                    <p>Furthermore, the study analyzes the strengths and weaknesses of the IoT-based articles considered in this systematic literature review.</p>
                </list-item>
                <list-item>
                    <p>This work also identifies the most critical problems with IDS research in IoT systems and suggests future research.</p>
                </list-item>
            </list>
            <p>The following is how the paper is structured. Sections 2 and 3 discuss related works and the research methodology employed. Sections 4 and 5 discuss the findings, challenges, and future research directions. Section 6 discusses validity threats, while Section 7 discusses the study&#x2019;s conclusion.</p>
        </sec>
        <sec>
            <title>Related works</title>
            <p>This section presents some survey and review papers that are closely related to our study. We considered existing survey and review studies focusing on intrusion detection in IoT systems for the past five years, 2017&#x2013;2022. We considered the past five years because most surveys and SLRs for IoT-based intrusion detection systems that are of interest to our study were done during this period.</p>
            <p>During their investigation, 
                <xref ref-type="bibr" rid="ref-4">4</xref> conducted a comprehensive survey of the latest intrusion detection systems designed specifically for IoT systems. The study focused on the methods, features, and methods implemented in each study while providing insights into the various architectures used in IoT and some emerging vulnerabilities. The authors also looked at factors that affect the performance of IDS in intelligent environments. Some factors identified were detection accuracy, false positive rate, energy consumption, processing time, and the overall performance overhead.</p>
            <p>In their research, 
                <xref ref-type="bibr" rid="ref-5">5</xref> also presented a review of IDS for IoT environments, focusing on the techniques and deployment strategies used by each of the studies included in their work. The authors also considered the validation strategies and the datasets used in the respective works covered in their studies. Moreover, the study discussed some challenges facing intrusion detection in IoT systems.</p>
            <p>In their work, 
                <xref ref-type="bibr" rid="ref-6">6</xref> presented a survey that captures the practices and challenges facing intrusion detection systems in the internet of things. Benkhelifa 
                <italic toggle="yes">et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup> considered various IDS solutions used in IoT environments in their work. Each solution identified in the study was considered an improvement strategy to improve the detection methods.</p>
            <p>Mishra 
                <italic toggle="yes">et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="ref-7">7</xref>
                </sup> presented a study that compares models that detect and prevent distributed denial of service attacks. The study also discussed the different classifications of methods, models, and datasets used to build IDS. The study also looked at research challenges in IDS and proposed some solutions to mitigate these challenges. The authors presented some areas that can be considered studies for the future.</p>
            <p>In their study, 
                <xref ref-type="bibr" rid="ref-8">8</xref> provided an overview of the current security challenges of the IoT and how these challenges can be solved using IDS. The study also explored future challenges in IoT and how they can be addressed using intrusion detection.</p>
            <p>In a similar study, 
                <xref ref-type="bibr" rid="ref-9">9</xref> presented a review of machine learning-based intrusion detection systems in IoT environments, discussing various Machine Learning (ML) approaches used in designing IDS with emphasis on their advantages and disadvantages. The authors concluded their study by looking at some of the research challenges and possible future direction for work around IDS in IoT.</p>
            <p>Arshad 
                <italic toggle="yes">et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="ref-10">10</xref>
                </sup> conducted a comprehensive study on existing intrusion detection systems for IoT systems using three parameters, namely, computational overhead, energy consumption, and privacy implications. The study also identified some open challenges that exist in the area of their study.</p>
            <p>In another study, 
                <xref ref-type="bibr" rid="ref-11">11</xref> conducted a systematic review of the literature to examine existing works in anomaly-based intrusion detection that use deep  learning techniques. The study also  discussed the challenges faced  by DL-based anomaly detection in the IoT domain and some areas that can be considered for future work.</p>
            <p>Similarly, 
                <xref ref-type="bibr" rid="ref-1">1</xref> conducted a survey of intrusion detection in IoT environments with a focus on the detection methods, placement strategy, security threats, and validation strategy.</p>
            <p>Seyfollahi 
                <italic toggle="yes">et al</italic>.
                <sup>
                    <xref ref-type="bibr" rid="ref-12">12</xref>
                </sup> reviewed machine learning techniques used in designing intrusion detection systems for the Low-Power and Lossy Networks (RPL) protocol. The study also identified open issues and challenges related to their study&#x2019;s domain.</p>
            <p>In their study, 
                <xref ref-type="bibr" rid="ref-13">13</xref> showed an overview of intrusion detection systems for IoT networks and presented some suggestions for future work that could help make IoT networks more secure.</p>
            <p>Chaabouni 
                <italic toggle="yes">et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="ref-14">14</xref>
                </sup> also conducted a survey that sought to classify IoT security threats and challenges. The study analyzed and compared the state-of-the-art NIDS in the context of IoT networks. The study considered the architecture, detection methodologies, validation strategies, and deployed algorithms.</p>
            <p>Saranya 
                <italic toggle="yes">et al.</italic>
                <sup>
                    <xref ref-type="bibr" rid="ref-15">15</xref>
                </sup> evaluated the performance analysis of machine learning models used in the design of IDS for IoT systems. Besides the fact that none of the surveys or SLRs considered incremental ML-based IDSs in their studies, these studies had other gaps which have been considered in our study.</p>
            <p>A summary of the related literature is shown in 
                <xref ref-type="table" rid="T1">Table 1</xref> below.</p>
            <table-wrap id="T1" orientation="portrait" position="anchor">
                <label>Table 1. </label>
                <caption>
                    <title>Summary of Related Literature.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Studies</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Type of
                                <break/>Study</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Year of
                                <break/>Publication</th>
                            <th align="left" colspan="1" rowspan="1" valign="top">Research Gap</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>1</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-1">1</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Survey</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2017</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The study did not report on the strengths and weaknesses  of  the  papers  considered  in  the
                                <break/>study.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>2</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-14">14</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Survey</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2019</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The study did not report on the strengths and weaknesses  of  the  papers  considered  in  the
                                <break/>study.
                                <break/>The study also did not report on how these IDSs methodologies impact IoT resources.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>3</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-15">15</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2020</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The primary objective of the study is not focused on IoT environment.
                                <break/>The study did not report on the strengths and weaknesses of the papers considered in the
                                <break/>study.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>4</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-12">12</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Survey</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2021</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The study is focused on IDSs for RPL routing protocol.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>5</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-11">11</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Survey</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2021</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The study only considered anomaly-based IDSs in IoT that uses deep learning approaches.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>6</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-10">10</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2020</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The study did not report on the strengths and weaknesses  of  the  papers  considered  in  the
                                <break/>study.
                                <break/>The study also did not report the impact these IDSs methodologies have on IoT devices.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>7</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-9">9</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2020</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The study did not report on the strengths and weaknesses  of  the  papers  considered  in  the
                                <break/>study.
                                <break/>The study also did not report the impact these IDSs methodologies have on IoT devices.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>8</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-8">8</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2019</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The  study  did  not  analyse  the  strengths  and weaknesses of the papers selected for the study.
                                <break/>The study also did not report the impact these IDSs methodologies have on IoT devices.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>9</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-7">7</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2021</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The study did not report the impact these IDSs methodologies have on IoT devices.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>10</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-6">6</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2018</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The study focuses only on the architectural design and detection approaches used in
                                <break/>Intrusion Detection Systems.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>11</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-5">5</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2021</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The  study  did  not  analyse  the  strengths  and weaknesses of the papers selected for the study.
                                <break/>The study also did not report the impact these IDSs methodologies have on IoT devices.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>12</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-4">4</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2018</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The   study   primary   focuses   on   the   general overview of IDS without considering the specific
                                <break/>challenges IoT based IDS faces.
                                <break/>The study did not analyse the strengths and weaknesses of the papers selected for the study.
                                <break/>The study also did not report the impact these IDSs methodologies have on IoT devices.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <bold>13</bold>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">
                                <xref ref-type="bibr" rid="ref-13">13</xref>
                            </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Review</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">2019</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The  study  did  not  analyse  the  strengths  and weaknesses of the papers selected for the study.
                                <break/>The study also did not report the impact these IDSs methodologies have on IoT devices.</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
        </sec>
        <sec>
            <title>Research method</title>
            <p>In this section, we outlined this study&#x2019;s method deployed by 
                <xref ref-type="bibr" rid="ref-2">2</xref>,
                <xref ref-type="bibr" rid="ref-3">3</xref>. We used general principles in conducting systematic reviews. The methodology proposed by 
                <xref ref-type="bibr" rid="ref-2">2</xref> and 
                <xref ref-type="bibr" rid="ref-3">3</xref> has five steps as follows:</p>
            <list list-type="bullet">
                <list-item>
                    <p>The formulation of crucial research questions.</p>
                </list-item>
                <list-item>
                    <p>The formulation of the search process</p>
                </list-item>
                <list-item>
                    <p>The formulation of the general criteria for the selection of articles.</p>
                </list-item>
                <list-item>
                    <p>The data extraction process, and</p>
                </list-item>
                <list-item>
                    <p>The execution of analysis and classification</p>
                </list-item>
            </list>
            <sec>
                <title>Research questions</title>
                <p>The following four research questions were considered in selecting the various papers used in this study.</p>
                <list list-type="bullet">
                    <list-item>
                        <p>RQ1: What is the primary contribution of the paper?</p>
                    </list-item>
                    <list-item>
                        <p>RQ2: What incremental or online machine learning algorithm was used in this study?</p>
                    </list-item>
                    <list-item>
                        <p>RQ3:  How does the proposed method handle data, feature, or concept drift?</p>
                    </list-item>
                    <list-item>
                        <p>RQ4: How do the proposed IDS handle the computational constraints of IoT systems?</p>
                    </list-item>
                </list>
                <p>RQ1 focuses on the primary contribution of each of the papers considered in our study. We looked at studies that used incremental or online machine-learning approaches to deploy intrusion detection in IoT environments. The goal is to provide readers and researchers with an overview of the problem and how it is addressed.</p>
                <p>RQ2 examines which incremental or online machine-learning algorithm was used in each study.</p>
                <p>RQ3 focuses on how the method proposed in RQ2 handles data, feature, or concept drift. Static models are generated by machine learning using historical data. However, once in production, ML models become unreliable, obsolete, and degrade over time. Changes in data distribution may occur during production, resulting in biased predictions. User behavior may have changed compared to the baseline data used to train the model, or there may have been additional factors in real-world interactions that influenced the predictions. Data drift is a significant cause of model accuracy deterioration over time.</p>
                <p>The fourth research question (RQ4) aims to answer how the methods or models proposed in each of the studies handle the computation constraints of IoT devices. One limitation of IoT devices is their limited computational resources, which is one reason why traditional IDS cannot be deployed in IoT environments. It is in this regard that we looked at how each study handled the resource constraints of IoT systems while building an IDS for the same environment.</p>
            </sec>
            <sec>
                <title>Protocol and phases of the study</title>
                <p>This work was conducted using the guidelines stipulated in the Preferred Reporting Items for SLRs and Meta-Analyses (PRISMA)
                    <sup>
                        <xref ref-type="bibr" rid="ref-16">16</xref>
                    </sup>. To suite the guidelines proposed by PRISMA to Computer Science, we incorporated the PRISMA guidelines with the guidelines proposed by Kitchenham
                    <sup>
                        <xref ref-type="bibr" rid="ref-17">17</xref>
                    </sup>. 
                    <xref ref-type="fig" rid="f1">Figure 1</xref> below shows the flow diagram of inclusion  and exclusion process.</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>PRISMA flow diagram
                            <sup>
                                <xref ref-type="bibr" rid="ref-18">18</xref>
                            </sup>.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/140269/524b4422-a190-4382-9252-bead809944f7_figure1.gif"/>
                </fig>
            </sec>
            <sec>
                <title>Inclusion and exclusion criteria</title>
                <p>In this study, we considered articles published in peer-reviewed journals.  In order for an article to be included in our study, it must fulfill seven criteria, which are elaborated on in 
                    <xref ref-type="table" rid="T2">Table 2</xref>.</p>
                <table-wrap id="T2" orientation="portrait" position="anchor">
                    <label>Table 2. </label>
                    <caption>
                        <title>Inclusion and exclusion criteria.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Criteria</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Justification</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study must not be a review or survey paper but an
                                    <break/>original research paper</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Review and surveys papers will not fully answer our research questions.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The proposed IDS must use incremental or online
                                    <break/>machine learning methods and must either be deployed
                                    <break/>in IoT environments or non IoT based environment.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study seeks to analyse incremental ML based IDS in IoT. Therefore,
                                    <break/>papers included in the study must use incremental ML approach to
                                    <break/>solve IDS problems in IoT systems.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The article must be written in English</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The English language was the common medium of communication for
                                    <break/>all authors involved in this study.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">4</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The  IDS  model  proposed  must be evaluated using a real
                                    <break/>world dataset or network traffic</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study intends to inform readers about the applicability of the
                                    <break/>proposed solutions, which can be accomplished when these solutions
                                    <break/>are properly evaluated.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">5</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study must be a full-length paper</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Short papers like abstracts may not cover all the important aspects of
                                    <break/>a study. Some details of proposed solutions could be left out as well
                                    <break/>evaluation details.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study should have been published from 2010 to
                                    <break/>2022</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The period considered for this SLR was from 2010 to 2022.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">7</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study has to be published in a peer reviewed
                                    <break/>journal and must not be a conference proceeding</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Journal articles are rigorously peer reviewed.</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec>
                <title>Quality assessment criteria</title>
                <p>To eliminate bias and to make our study easily reproducible, we used a quality assessment criteria procedure based on 
                    <xref ref-type="bibr" rid="ref-17">17</xref>. Quality assessment criteria play a vital role in conducting systematic literature reviews. The concept of quality assessment criteria (QAC) is to use a process that improves the criteria for selecting research papers. The QAC was deployed using a set of quality assessment questions (QAQs). The QAQs were used to create a checklist against which we compared each paper to ensure that it met the QAC and answered our RQs. If a study answers a question from the QAC checklist, we mark it as "Yes," and if it doesn&#x2019;t, it is marked "No." However, some papers partially answer some of the questions in the QAC. Such criteria are "P" to represent a partial response. Scores were assigned to each of the questions considered in the QAC. A "Yes" answer is worth one point, a "No" answer is worth zero points, and a "P" answer is worth 0.5 points. Each paper is evaluated against the QA, and the marks are summed. After awarding the mark to each QA, we decided to select papers whose summation was above 2.5. The value of 3.0 was chosen because we did not want to include papers that partially (50%) answered the quality assessment questions formulated for this study. 
                    <xref ref-type="table" rid="T3">Table 3</xref> and 
                    <xref ref-type="table" rid="T4">Table 4</xref> below show the quality assessment questions and the quality evaluation results we used in this study.</p>
                <table-wrap id="T3" orientation="portrait" position="anchor">
                    <label>Table 3. </label>
                    <caption>
                        <title>Quality assessment questions.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Number</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Quality Assessment Questions (QAQ)</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">QA 1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Are  the  research&#x2019;s  goals  or  objectives  clearly stated?</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">QA 2</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Is there any response to the posed RQs in the paper?</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">QA 3</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Is there any connection between the objectives, methodology, experimentation, and conclusion?</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">QA 4</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Is there an experimental validation in the study to answer the research question?</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">QA 5</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Are  the  study&#x2019;s  findings  compared  to  other works?</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <table-wrap id="T4" orientation="portrait" position="anchor">
                    <label>Table 4. </label>
                    <caption>
                        <title>Quality evaluation of the selected studies.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Study</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">QA1</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">QA2</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">QA3</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">QA4</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">QA5</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Total Score</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>1</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-19">19</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>2</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-20">20</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>3</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-21">21</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>4</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-22">22</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">P</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>5</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-23">23</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>6</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-24">24</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">P</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>7</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-25">25</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>8</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-26">26</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>9</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-27">27</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>10</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-28">28</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>11</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-29">29</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">P</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>12</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-30">30</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>13</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-31">31</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>14</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-32">32</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>15</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-33">33</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>16</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-34">34</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">5.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>17</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-35">35</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">P</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>18</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-36">36</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">P</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">P</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>19</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-37">37</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>20</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-38">38</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">P</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>21</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-39">39</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">P</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Yes</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">4.5</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec>
                <title>Information sources and selection process</title>
                <p>We manually searched for the articles included in this study in research six databases. The databases considered in this study are as follows;</p>
                <list list-type="bullet">
                    <list-item>
                        <p>IEEE Xplore</p>
                    </list-item>
                    <list-item>
                        <p>ScienceDirect</p>
                    </list-item>
                    <list-item>
                        <p>Wiley</p>
                    </list-item>
                    <list-item>
                        <p>ACM Digital Library</p>
                    </list-item>
                    <list-item>
                        <p>MDPI</p>
                    </list-item>
                    <list-item>
                        <p>Springer</p>
                    </list-item>
                </list>
                <p>The search process involved five keywords: incremental learning, online machine learning, internet of things, intrusion detection, and anomaly detection. The keywords were connected using the words "
                    <bold>AND</bold>" and "
                    <bold>OR</bold>." Generally, the search terms were framed as "Internet of Things 
                    <bold>AND</bold> Incremental Learning 
                    <bold>AND</bold> Intrusion Detection 
                    <bold>OR</bold> Anomaly Detection 
                    <bold>OR</bold> Online Machine Learning. The search terms were targeted at the author&#x2019;s keywords provided in the paper.</p>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <p>In this section, we present the results of the systematic literature review carried out.</p>
            <sec>
                <title>Publications by journal</title>
                <p>In 
                    <xref ref-type="table" rid="T5">Table 5</xref>, we looked at the research databases considered in our studies and the number of articles published in each journal during the period considered in our study before applying the inclusion and exclusion criteria. The search results returned a total of 159 articles. IEEE Xplore returned 68 results, Science Direct, returned 21 results, and Wiley returned 8 results. MDPI, Springer, and ACM returned 8, 44, and 10 results, respectively. 
                    <xref ref-type="table" rid="T6">Table 6</xref> shows the number of articles considered in this study after applying our quality assessment criteria. A total of twenty-two (22) articles were selected from the six databases after applying the inclusion and exclusion criteria. IEEE Xplore had nine (9) publications, ScienceDirect had seven (7) publications meeting the QA criteria, MDPI had three (3) papers, Wiley had three (3) papers, and Springer and ACM Digital Library had 0 papers each.</p>
                <table-wrap id="T5" orientation="portrait" position="anchor">
                    <label>Table 5. </label>
                    <caption>
                        <title>Publications by journal before applying inclusion and exclusion criteria.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Journal</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Number  of 
                                    <break/>Publications</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>1</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">IEEE</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">68</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>2</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Science Direct</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">21</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>3</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Wiley</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">8</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>4</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MDP1</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">8</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>5</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Springer</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">44</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>6</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">ACM</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">10</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <table-wrap id="T6" orientation="portrait" position="anchor">
                    <label>Table 6. </label>
                    <caption>
                        <title>Publications by Journal after applying inclusion and exclusion criteria.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Journal</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Number  of
                                    <break/>Publications</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>1</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">IEEE</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>2</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Science Direct</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">6</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>3</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">MDPI</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>4</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Wiley</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>5</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Springer</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>6</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">ACM</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec>
                <title>Contributions of each study</title>
                <p>The parameters considered in determining the contribution of a study are how these studies handle drift adaption, the lightweight status of models, the running time of models, and the memory consumption of models. The parameters considered for the contribution of the studies are shown in 
                    <xref ref-type="fig" rid="f1">Figure 1</xref> below.</p>
                <p>In 
                    <xref ref-type="table" rid="T7">Table 7</xref>, we presented the contributions of each study based on the area of drift adaption, the lightweight status of models, the running time of models, and the memory consumption of models. Only the 8 IoT-based studies were considered in this analysis. Two of the eight (8) studies deployed solutions that could handle drifts in either data or concepts. Eight out of the nine studies focused on designing lightweight models. We also looked at how each of the studies handled computational complexity. Four (4) out of the eight (8) studies reported time complexity, while only two out of the eight (8) studies reported the space complexity of their proposed model. None of the eight IoT-based studies reports on the energy consumption of their proposed model.</p>
                <table-wrap id="T7" orientation="portrait" position="anchor">
                    <label>Table 7. </label>
                    <caption>
                        <title>Contributions of each IoT based study.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Study</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Drift
                                    <break/>adaption</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Lightweight 
                                    <break/>model</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Model running
                                    <break/> time</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Memory
                                    <break/> consumption</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Energy
                                    <break/> consumption</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Computational
                                    <break/> complexity</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>1</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-26">26</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>2</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-30">30</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>3</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-29">29</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>4</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-28">28</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>5</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-39">39</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>6</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-27">27</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>7</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-31">31</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>8</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-21">21</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x2713;</td>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top"/>
                                <td align="left" colspan="1" rowspan="1" valign="top">&#x00a0;</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec>
                <title>Strength and weakness of each study</title>
                <p>In 
                    <xref ref-type="table" rid="T8">Table 8</xref> and 
                    <xref ref-type="table" rid="T9">Table 9</xref>, we presented a summary of the strengths and weaknesses of the IoT-based intrusion detection studies are considered in our study. We chose to report on the strengths and weaknesses of the IoT-based IDSs because that is the core of our studies.</p>
                <table-wrap id="T8" orientation="portrait" position="anchor">
                    <label>Table 8. </label>
                    <caption>
                        <title>Strength and weakness of each study.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Study</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Models used</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Strengths</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Weakness</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>1</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-26">26</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Incremental Support Vector
                                    <break/>Machine</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">This article is unique in that it employs classifier
                                    <break/> selection to determine whether the one-class SVM
                                    <break/> classification is reasonably reliable.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study did not report on how the
                                    <break/> proposed method would impact on
                                    <break/> the computational resource of cyber-
                                    <break/>physical systems.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>2</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-30">30</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Online sequential Extreme
                                    <break/> learning machine Recursive
                                    <break/> least squares based
                                    <break/> classifiers Ensemble
                                    <break/>  learning</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The   research   presents   a general-purpose, online
                                    <break/> learning, decentralized anomaly detection
                                    <break/> framework with a diverse set of local anomaly
                                    <break/> detection algorithms and computational
                                    <break/> resources that are compatible with the stringent
                                    <break/> limitations of embedded platforms commonly
                                    <break/> used in WSNs.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Although the study used a simulator
                                    <break/> to calculate the computational
                                    <break/> complexity of the various methods,
                                    <break/> it did not report the actual CPU
                                    <break/> and memory consumption of their
                                    <break/> proposed model.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>3</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-29">29</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Online Deep Learning
                                    <break/> Principal Component
                                    <break/> Analysis</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Using a deep neural network that adjusts neural
                                    <break/> network sizes dynamically based on the Hedge
                                    <break/> weighting mechanism. As new data becomes
                                    <break/> available, the goal is to encourage continuous
                                    <break/> learning and model adaptation.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Even though the study&#x2019;s primary
                                    <break/> focus is detection intrusion under
                                    <break/> data and concept drifts, it is
                                    <break/> important to report how the method
                                    <break/> used to detect drifts affects the
                                    <break/> model&#x2019;s memory and training time.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>4</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-27">27</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Convolutional Neural
                                    <break/> Network</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">To reduce the overhead on the centralized edge
                                    <break/> classifier, a distributed IDS concept is proposed,
                                    <break/> resulting in the shortest possible latency between
                                    <break/> the pre-processing and decision-making phases.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study reported on the time complexity of the method used. The space
                                    <break/> complexity wasn&#x2019;t reported.
                                    <break/>The dataset used for the
                                    <break/> experimental validation is a non IoT-
                                    <break/>based dataset.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>5</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-31">31</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Adaptive Random Forest
                                    <break/> Hoeffding  Adaptive Tree</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Using an incremental learning approach to detect
                                    <break/> botnet attacks in IoT environments.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study did not report on time
                                    <break/> and memory consumption of the
                                    <break/> proposed method.
                                    <break/>The study did not report the
                                    <break/> framework and libraries used to build
                                    <break/> the proposed model.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>6</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-28">28</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Light Gradient Boosting
                                    <break/> Machine Optimized Adaptive
                                    <break/> and Sliding Windowing
                                    <break/> Particle Swarm Optimization</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study proposed Optimized Adaptive Sliding 
                                    <break/>Windowing (OASW), a novel drift adaptation
                                    <break/> method, to address the problem of concept
                                    <break/> drifting.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study only focused on binary
                                    <break/>classification.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>7</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-39">39</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Online incremental  Support
                                    <break/> Vector Data Description
                                    <break/> Adaptive Sequential Extreme
                                    <break/> Learning Machine</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">On IIoT devices, a lightweight NIDS based on
                                    <break/> an online incremental Support Vector Data
                                    <break/> Description anomaly detection system and an
                                    <break/> Adaptive Sequential Extreme Learning Machine
                                    <break/> on a multi-access edge computing server is
                                    <break/> proposed.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The  proposed  method&#x2019;s  time  and
                                    <break/> memory consumption were not
                                    <break/> reported in the study.</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <table-wrap id="T9" orientation="portrait" position="anchor">
                    <label>Table 9. </label>
                    <caption>
                        <title>Strength and weakness of each study.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Study</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Models used</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Strengths</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Weakness</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>8</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-21">21</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Online Growing
                                    <break/>Random Trees</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The study proposes an iterative anomaly detection method
                                    <break/> for data streams based on tree ensembles. This unsupervised
                                    <break/> technique adds a tree growth procedure that can incorporate new
                                    <break/> data information into the existing model on a continuous basis.</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">The  proposed  method&#x2019;s  time  and
                                    <break/> memory consumption were not
                                    <break/> reported in the study.</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec>
                <title>Datasets used for validation</title>
                <p>This study also considered the datasets used for experimental validation in the 8 IoT-based papers considered in this work. The datasets used in the IoT-based studies include N-BaIoT, NSL-KDD, KDD CUP 99, UNSW-NB15, IoTID20 and DS2OS traffic trace datasets. The rest are Intel Lab, sensorscope, and the secure water treatment dataset. Among the datasets used, N-BaIoT, Intel Lab, UNSW-NB15, and IoTID20 are datasets based on IoT traffic. 
                    <xref ref-type="table" rid="T10">Table 10</xref> shows the summary of the datasets used in each study.</p>
                <table-wrap id="T10" orientation="portrait" position="anchor">
                    <label>Table 10. </label>
                    <caption>
                        <title>Dataset Used for validation.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Dataset</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Papers</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Count</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>N-BaIoT</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-31">31</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>NSL-KDD</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-28">28</xref>, 
                                    <xref ref-type="bibr" rid="ref-27">27</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>KDD CUP 99</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-27">27</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>UNSW-NB15</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-39">39</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>IoTID20</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-28">28</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>DS2OS traffic traces</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-29">29</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Intel Lab</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-30">30</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Sensorscope</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-30">30</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>Secure Water Treatment</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <xref ref-type="bibr" rid="ref-21">21</xref>, 
                                    <xref ref-type="bibr" rid="ref-26">26</xref>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec>
                <title>Number of publications per year</title>
                <p>In this subsection, we analyzed the number of publications per year using our established quality assessment criteria. The number of publications per year is shown in 
                    <xref ref-type="table" rid="T11">Table 11</xref>. From 
                    <xref ref-type="table" rid="T11">Table 11</xref> below, no publication met the criteria of our studies in the years 2010, 2012, 2016, and 2018. The years 2011, 2014, 2017, and 2019 recorded one publication each. The highest number of publications was recorded in 2020, when nine (9) publications were recorded. There were 2 publications in 2013 and 2021, and 3 publications in 2022. Drawing our attention to the IoT-based studies, there was one (1) publication in 2015, two (2) publications in 2020, 3 publications in 2021, and 2 publications in 2022.</p>
                <table-wrap id="T11" orientation="portrait" position="anchor">
                    <label>Table 11. </label>
                    <caption>
                        <title>Publication by Year.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">SN</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Year of 
                                    <break/>Publication</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Number of 
                                    <break/>Publications</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>1</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2010</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>2</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2011</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>3</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2012</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>4</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2013</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>5</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2014</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>6</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2015</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>7</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2016</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>8</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2017</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>9</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2018</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">0</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>10</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2019</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>11</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2020</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">9</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>12</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2021</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">
                                    <bold>13</bold>
                                </td>
                                <td align="left" colspan="1" rowspan="1" valign="top">2022</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">3</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
        </sec>
        <sec>
            <title>Challenges and directions for future work</title>
            <p>In this section, we present some challenges we identified based on the analysis of our study. To begin with, we found out that 2 of the IoT-based studies used datasets (NSL-KDD and KDD CUP 99) that are no longer relevant when designing modern-day  IDS.</p>
            <p>Additionally, these datasets are non-IoT-based. Therefore, we recommend that future work use datasets from IoT environments to build and evaluate IDS for IoT systems. Secondly, from our studies, we discovered that seven (7) studies out of the 8 IoT-based studies designed lightweight IDS for IoT systems. However, only one reported on the proposed system&#x2019;s memory consumption, and three (3) reported on the running time of the proposed methods. Only one study reported the computational complexity of the model used in designing their proposed IDS.</p>
            <p>Additionally, in designing lightweight IDSs for IoT systems, parameters such as time and space complexity and power consumption of the proposed IDS should be evaluated. The portability of an IoT-based IDS is as important as its accuracy, precision, or recall. Therefore, we propose that future work include a performance matrix that measures the time and space complexity and power consumption of the proposed methods. Additionally, none of the IoT-based studies considered in this work deployed the proposed IDS on an IoT device. It is crucial not only to model IDSs for IoT ecosystems but these IDS models should be deployed on IoT devices. Deploying these models on real devices will help to evaluate parameters such as space complexity and energy consumption. Deployment models on real devices help to evaluate the model&#x2019;s performance on drift adaptation and determine the model&#x2019;s accuracy in production environments. We recommend that future studies on IDS for IoT systems incorporate model deployment on physical devices to evaluate how these models will perform in production environments.</p>
            <p>Concept Drift in Machine Learning refers to a situation in which the statistical properties of the target variable change over time. In other words, the meaning of the input data used to train the model has changed significantly over time, but the model in production is unaware of the change and thus cannot make accurate predictions. Although incremental machine learning has the advantage of detecting concept drifts, only 2 out of 8 IoT-based studies considered in this work considered concept drift adaption in their studies. Network traffic is usually dynamic, and attackers try to circumvent IDSs by changing the attack signatures of knowns, which leads to a change in the target variable. Future IDSs for the IoT ecosystem must focus on how to build IDSs that can detect drifts and learn from those drifts with minimal human intervention.</p>
            <p>Furthermore, the datasets used in the IoT-based studies and most datasets used in modeling IDSs are imbalanced, which gives these models higher accuracy but lower precision. To solve this challenge, more studies can be conducted on creating balanced datasets from IoT systems. Moreover, unlike traditional computing IDSs, which primarily focus on detection speed, precision, and accuracy, IDSs for the IoT ecosystem need a balance between accuracy, speed, precision, lightweight, and low energy consumption. Therefore, researchers must look at these parameters holistically to ensure that proposed IDSs for IoT systems can be deployed in such environments. It is recommended that future work in this domain should focus on using models that are not computationally intensive in designing IDSs for IoT systems.</p>
            <p>Finally, the results from the various experimental validations done in IoT-based studies considered in this SLR show that incremental learning is capable of achieving the lightweight IDS status that most IDS problems in IoT systems seek to attain. However, more studies need to be done using the approach mentioned above in the IoT ecosystem to determine the viability of incremental learning to solve the problem of high speed, high accuracy, low energy, and minimal space complexity IDS for IoT systems.</p>
        </sec>
        <sec>
            <title>Threats to validity of the study</title>
            <p>Validity threats hampered the data extraction process and the quality assessment of the papers chosen for this SLR protocol. Using the threats identified by 
                <xref ref-type="bibr" rid="ref-40">40</xref>, we divided the threats into validity. Internal, external, construct, and conclusion validity are the threats identified by 
                <xref ref-type="bibr" rid="ref-40">40</xref>. Each of the threats is briefly described in the preceding paragraphs.</p>
            <list list-type="bullet">
                <list-item>
                    <p>
                        <bold>Internal validity:</bold> This threat focuses on implementing the SLR protocol, which includes search terms, the data extraction process, the method used for the research, and quality assessment criteria.</p>
                </list-item>
                <list-item>
                    <p>
                        <bold>Construct validity:</bold> Construct validity is related to how search strings are constructed, the formulation of research questions, the online databases selected, and the inclusion and exclusion criteria. The search string used in this study was comprehensively formulated to answer the formulated research questions.</p>
                </list-item>
                <list-item>
                    <p>
                        <bold>External validity:</bold> External validity focuses on the degree that the SLR results reflect the topic under review. We mitigated this threat by repeating the procedure used in our study.</p>
                </list-item>
                <list-item>
                    <p>
                        <bold>Conclusion validity:</bold> The nature of SLR makes it not possible to capture all relevant studies that answer the formulated research questions. There is a probability that some papers were missed. Using inclusion and exclusion criteria lessens the gravity of personal bias and subjectivity.</p>
                </list-item>
            </list>
            <sec>
                <title>Limitations of our study</title>
                <p>We will discuss some of the study&#x2019;s limitations in this section. The research focused on a few carefully selected but highly referenced databases in the field of study. We admit that, like most SLRs, we had difficulty locating all of the papers associated with this study. We also admit that some papers were left out due to the difficulty in identifying all papers related to this study. The method used in this study is meant to help us with our research on incremental machine learning-based intrusion detection in IoT systems.</p>
                <p>This study&#x2019;s analysis is limited to incremental machine learning-based intrusion detection systems on the internet of things and does not represent the complete analysis of the individual papers. We made every effort in this regard to analyzing the papers presented in this work in order to provide answers to the research questions posed in this study.</p>
            </sec>
        </sec>
        <sec sec-type="conclusions">
            <title>Conclusion</title>
            <p>This study comprehensively analyzed incremental machine learning-based intrusion detection systems in the internet of things. The aim of the study was to help us understand existing work in the domain of our study and provide suggestions on how future work in IDS for IoT systems can be enhanced. The Internet of Things (IoT) has not only become a household name through its application in smart homes but has also been used in domains like agriculture, healthcare, transportation, and cities and grid systems. Whereas the advantages of IoT cannot be downplayed; its computational constraints make it difficult to deploy security methodologies that have been deployed in traditional computing systems. The study examined the existing state-of-the-art incremental machine learning approaches used to design lightweight intrusion detection systems for IoT environments, as well as the datasets used and how these studies are designing IDS without overburdening IoT device computational resources. As the number of things connected to the internet increases, researchers must use various methods to ensure the security of these things. The application of ML and DL in intrusion detection has proven to be an effective mitigation strategy on traditional computers, and the trend of current research shows that it will become an effective mitigation strategy in detecting intrusions in IoT environments.</p>
        </sec>
    </body>
    <back>
        <sec sec-type="data-availability">
            <title>Data availability</title>
            <sec>
                <title>Underlying data</title>
                <p>All data underlying the results are available as part of the article and no additional source data are required.</p>
            </sec>
            <sec>
                <title>Reporting guidelines</title>
                <p>The completed PRISMA checklist of this study is found on a public repository with details as below: Figshare: PRISMA checklist for &#x2019;
                    <italic toggle="yes">Towards achieving lightweight intrusion detection systems in Internet of Things, the role of incremental machine learning:  A systematic literature review</italic>&#x2019;, 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.6084/m9.figshare.21436152.v1">https://doi.org/10.6084/m9.figshare.21436152.v1</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-41">41</xref>
                    </sup>.</p>
                <p>Data are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).</p>
            </sec>
        </sec>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zarpel&#x00e3;o</surname>
                            <given-names>BB</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Miani</surname>
                            <given-names>RS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kawakani</surname>
                            <given-names>CT</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A survey of intrusion detection in internet of things.</article-title>
                    <source>

                        <italic toggle="yes">J Netw Comput Appl.</italic>
</source>
                    <year>2017</year>;<volume>84</volume>:<fpage>25</fpage>&#x2013;<lpage>37</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.jnca.2017.02.009</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <collab>Staffs Keele</collab>,
                    <etal/>
                    <article-title>Guidelines for performing systematic literature reviews in software engineering.</article-title>Technical report, Technical report, ver. 2.3 ebse technical report. ebse,<year>2007</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.elsevier.com/__data/promis_misc/525444systematicreviewsguide.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Petersen</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Vakkalanka</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kuzniarz</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <article-title>Guidelines for conducting systematic mapping studies in software engineering: An update.</article-title>
                    <source>

                        <italic toggle="yes">Inf Softw Technol.</italic>
</source>
                    <year>2015</year>;<volume>64</volume>:<fpage>1</fpage>&#x2013;<lpage>18</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.infsof.2015.03.007</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Elrawy</surname>
                            <given-names>MF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Awad</surname>
                            <given-names>AI</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hamed</surname>
                            <given-names>HFA</given-names>
                        </name>
</person-group>:
                    <article-title>Intrusion detection systems for iot-based smart environments: a survey.</article-title>
                    <source>

                        <italic toggle="yes">J Cloud Comp.</italic>
</source>
                    <year>2018</year>;<volume>7</volume>(<issue>1</issue>):<fpage>21</fpage>.
                    <pub-id pub-id-type="doi">10.1186/s13677-018-0123-6</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Khraisat</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Alazab</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>A critical review of intrusion detection systems in the internet of things: techniques, deployment strategy, validation strategy, attacks, public datasets and challenges.</article-title>
                    <source>

                        <italic toggle="yes">Cybersecur.</italic>
</source>
                    <year>2021</year>;<volume>4</volume>(<issue>1</issue>):<fpage>18</fpage>.
                    <pub-id pub-id-type="doi">10.1186/s42400-021-00077-7</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Benkhelifa</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Welsh</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hamouda</surname>
                            <given-names>W</given-names>
                        </name>
</person-group>:
                    <article-title>A critical review of practices and challenges in intrusion detection systems for iot: Toward universal and resilient systems.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Communications Surveys &amp; Tutorials.</italic>
</source>
                    <year>2018</year>;<volume>20</volume>(<issue>4</issue>):<fpage>3496</fpage>&#x2013;<lpage>3509</lpage>.
                    <pub-id pub-id-type="doi">10.1109/COMST.2018.2844742</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mishra</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pandya</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Internet of things applications, security challenges, attacks, intrusion detection, and future visions: A systematic review.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Access.</italic>
</source>
                    <year>2021</year>;<volume>9</volume>:<fpage>59353</fpage>&#x2013;<lpage>59377</lpage>.
                    <pub-id pub-id-type="doi">10.1109/ACCESS.2021.3073408</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hajiheidari</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wakil</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Badri</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Intrusion detection systems in the internet of things: A comprehensive investigation.</article-title>
                    <source>

                        <italic toggle="yes">Computer Networks.</italic>
</source>
                    <year>2019</year>;<volume>160</volume>:<fpage>165</fpage>&#x2013;<lpage>191</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.comnet.2019.05.014</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Asharf</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Moustafa</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Khurshid</surname>
                            <given-names>H</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A review of intrusion detection systems using machine and deep learning in internet of things: challenges, solutions and future directions.</article-title>
                    <source>

                        <italic toggle="yes">Electronics.</italic>
</source>
                    <year>2020</year>;<volume>9</volume>(<issue>7</issue>):<fpage>1177</fpage>.
                    <pub-id pub-id-type="doi">10.3390/electronics9071177</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Arshad</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Azad</surname>
                            <given-names>MA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Amad</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A review of performance, energy and privacy of intrusion detection systems for iot.</article-title>
                    <source>

                        <italic toggle="yes">Electronics.</italic>
</source>
                    <year>2020</year>;<volume>9</volume>(<issue>4</issue>):<fpage>629</fpage>.
                    <pub-id pub-id-type="doi">10.3390/electronics9040629</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alsoufi</surname>
                            <given-names>MA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Razak</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Md Siraj</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Anomaly-based intrusion detection systems in iot using deep learning: A systematic literature review.</article-title>
                    <source>

                        <italic toggle="yes">Appl Sci.</italic>
</source>
                    <year>2021</year>;<volume>11</volume>(<issue>18</issue>):<fpage>8383</fpage>.
                    <pub-id pub-id-type="doi">10.3390/app11188383</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Seyfollahi</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ghaffari</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>A review of intrusion detection systems in rpl routing protocol based on machine learning for internet of things applications.</article-title>
                    <source>

                        <italic toggle="yes">Wirel Commun Mob Comput.</italic>
</source>
                    <year>2021</year>;<volume>2021</volume>.
                    <pub-id pub-id-type="doi">10.1155/2021/8414503</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ali Khan</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Herrmann</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <article-title>Recent advancements in intrusion detection systems for the internet of things.</article-title>
                    <source>

                        <italic toggle="yes">Security and Communication Networks.</italic>
</source>
                    <year>2019</year>;<volume>2019</volume>.
                    <pub-id pub-id-type="doi">10.1155/2019/4301409</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chaabouni</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mosbah</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zemmari</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Network intrusion detection for iot security based on learning techniques.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Communications Surveys &amp; Tutorials.</italic>
</source>
                    <year>2019</year>;<volume>21</volume>(<issue>3</issue>):<fpage>2671</fpage>&#x2013;<lpage>2701</lpage>.
                    <pub-id pub-id-type="doi">10.1109/COMST.2019.2896380</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Saranya</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sridevi</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Deisy</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Performance analysis of machine learning algorithms in intrusion detection system: A review.</article-title>
                    <source>

                        <italic toggle="yes">Procedia Comput Sci.</italic>
</source>
                    <year>2020</year>;<volume>171</volume>:<fpage>1251</fpage>&#x2013;<lpage>1260</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.procs.2020.04.133</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Liberati</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Altman</surname>
                            <given-names>DG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tetzlaff</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The prisma statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration.</article-title>
                    <source>

                        <italic toggle="yes">J Clin Epidemiol.</italic>
</source>
                    <year>2009</year>;<volume>62</volume>(<issue>10</issue>):<fpage>e1</fpage>&#x2013;<lpage>e34</lpage>.
                    <pub-id pub-id-type="pmid">19631507</pub-id>
                    <pub-id pub-id-type="doi">10.1016/j.jclinepi.2009.06.006</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kitchenham</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Charters</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Guidelines for performing systematic literature reviews in software engineering.</article-title>
                    <year> 2007</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://userpages.uni-koblenz.de/~laemmel/esecourse/slides/slr.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Page</surname>
                            <given-names>MJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>McKenzie</surname>
                            <given-names>JE</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bossuyt</surname>
                            <given-names>PM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The prisma 2020 statement: an updated guideline for reporting systematic reviews.</article-title>
                    <source>

                        <italic toggle="yes">Syst Rev.</italic>
</source>
                    <year>2021</year>;<volume>10</volume>(<issue>1</issue>):<fpage>89</fpage>.
                    <pub-id pub-id-type="pmid">33781348</pub-id>
                    <pub-id pub-id-type="doi">10.1186/s13643-021-01626-4</pub-id>
                    <pub-id pub-id-type="pmcid">8008539</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gao</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Chai</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zhang</surname>
                            <given-names>B</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Research on network intrusion detection based on incremental extreme learning machine and adaptive principal component analysis.</article-title>
                    <source>

                        <italic toggle="yes">Energies.</italic>
</source>
                    <year>2019</year>;<volume>12</volume>(<issue>7</issue>):<fpage>1223</fpage>.
                    <pub-id pub-id-type="doi">10.3390/en12071223</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Qaiwmchi</surname>
                            <given-names>NAH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Amintoosi</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mohajerzadeh</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Intrusion detection system based on gradient corrected online sequential extreme learning machine.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Access.</italic>
</source>
                    <year>2020</year>;<volume>9</volume>:<fpage>4983</fpage>&#x2013;<lpage>4999</lpage>.
                    <pub-id pub-id-type="doi">10.1109/ACCESS.2020.3047933</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Liu</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hu</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kang</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Unsupervised anomaly detection for network data streams in industrial control systems.</article-title>
                    <source>

                        <italic toggle="yes">Information.</italic>
</source>
                    <year>2020</year>;<volume>11</volume>(<issue>2</issue>):<fpage>105</fpage>.
                    <pub-id pub-id-type="doi">10.3390/info11020105</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Darem</surname>
                            <given-names>AA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ghaleb</surname>
                            <given-names>FA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Al-Hashmi</surname>
                            <given-names>AA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An adaptive behavioral-based incremental batch learning malware variants detection model using concept drift detection and sequential deep learning.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Access.</italic>
</source>
                    <year>2021</year>;<volume>9</volume>:<fpage>97180</fpage>&#x2013;<lpage>97196</lpage>.
                    <pub-id pub-id-type="doi">10.1109/ACCESS.2021.3093366</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-23">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tang</surname>
                            <given-names>Y</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Li</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>An online network intrusion detection model based on improved regularized extreme learning machine.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Access.</italic>
</source>
                    <year>2021</year>;<volume>9</volume>:<fpage>94826</fpage>&#x2013;<lpage>94844</lpage>.
                    <pub-id pub-id-type="doi">10.1109/ACCESS.2021.3093313</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-24">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wu</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gao</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cui</surname>
                            <given-names>L</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An incremental learning method based on dynamic ensemble rvm for intrusion detection.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Transactions on Network and Service Management.</italic>
</source>
                    <year>2021</year>;<volume>19</volume>(<issue>1</issue>):<fpage>671</fpage>&#x2013;<lpage>685</lpage>.
                    <pub-id pub-id-type="doi">10.1109/TNSM.2021.3102388</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-25">
                <label>25</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Baldini</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Amerini</surname>
                            <given-names>I</given-names>
                        </name>
</person-group>:
                    <article-title>Online distributed denial of service (ddos) intrusion detection based on adaptive sliding window and morphological fractal dimension.</article-title>
                    <source>

                        <italic toggle="yes">Computer Networks.</italic>
</source>
                    <year>2022</year>;<volume>210</volume>:<fpage>108923</fpage>.
                    <pub-id pub-id-type="doi">10.1016/j.comnet.2022.108923</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-26">
                <label>26</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Reis</surname>
                            <given-names>LHA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Piedrahita</surname>
                            <given-names>AM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rueda</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Unsupervised and incremental learning orchestration for cyber-physical security.</article-title>
                    <source>

                        <italic toggle="yes">Transactions on emerging telecommunications technologies.</italic>
</source>
                    <year>2020</year>;<volume>31</volume>(<issue>7</issue>):<fpage>e4011</fpage>.
                    <pub-id pub-id-type="doi">10.1002/ett.4011</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-27">
                <label>27</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tabassum</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Erbad</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mohamed</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Privacy-preserving distributed ids using incremental learning for iot health systems.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Access.</italic>
</source>
                    <year>2021</year>;<volume>9</volume>:<fpage>14271</fpage>&#x2013;<lpage>14283</lpage>.
                    <pub-id pub-id-type="doi">10.1109/ACCESS.2021.3051530</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-28">
                <label>28</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Yang</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shami</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>A lightweight concept drift detection and adaptation framework for iot data streams.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Internet of Things Magazine.</italic>
</source>
                    <year>2021</year>;<volume>4</volume>(<issue>2</issue>):<fpage>96</fpage>&#x2013;<lpage>101</lpage>.
                    <pub-id pub-id-type="doi">10.1109/IOTM.0001.2100012</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-29">
                <label>29</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wahab</surname>
                            <given-names>OA</given-names>
                        </name>
</person-group>:
                    <article-title>Intrusion detection in the iot under data and concept drifts: Online deep learning approach.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Internet Things J.</italic>
</source>
                    <year>2022</year>;<volume>9</volume>(<issue>20</issue>):<fpage>19706</fpage>&#x2013;<lpage>19716</lpage>.
                    <pub-id pub-id-type="doi">10.1109/JIOT.2022.3167005</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-30">
                <label>30</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bosman</surname>
                            <given-names>HHWJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Iacca</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tejada</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Ensembles of incremental learners to detect anomalies in ad hoc sensor networks.</article-title>
                    <source>

                        <italic toggle="yes">Ad Hoc Netw.</italic>
</source>
                    <year>2015</year>;<volume>35</volume>:<fpage>14</fpage>&#x2013;<lpage>36</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.adhoc.2015.07.013</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-31">
                <label>31</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shao</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yuan </surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>Y</given-names>
                        </name>
</person-group>:
                    <article-title>Adaptive online learning for iot botnet detection.</article-title>
                    <source>

                        <italic toggle="yes">Information Sciences.</italic>
</source>
                    <year>2021</year>;<volume>574</volume>:<fpage>84</fpage>&#x2013;<lpage>95</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.ins.2021.05.076</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-32">
                <label>32</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Martindale</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ismail</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Talbert</surname>
                            <given-names>DA</given-names>
                        </name>
</person-group>:
                    <article-title>Ensemble-based online machine learning algorithms for network intrusion detection systems using streaming data.</article-title>
                    <source>

                        <italic toggle="yes">Information.</italic>
</source>
                    <year>2020</year>;<volume>11</volume>(<issue>6</issue>):<fpage>315</fpage>.
                    <pub-id pub-id-type="doi">10.3390/info11060315</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-33">
                <label>33</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Yi</surname>
                            <given-names>Y</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wu</surname>
                            <given-names>JS</given-names>
                        </name>

                        <name name-style="western">
                            <surname> Xu</surname>
                            <given-names>W</given-names>
                        </name>
</person-group>:
                    <article-title>Incremental svm based on reserved set for network intrusion detection.</article-title>
                    <source>

                        <italic toggle="yes">Expert Syst Appl.</italic>
</source>
                    <year>2011</year>;<volume>38</volume>(<issue>6</issue>):<fpage>7698</fpage>&#x2013;<lpage>7707</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.eswa.2010.12.141</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-34">
                <label>34</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Data</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Aritsugi</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>T-dfnn: An incremental learning algorithm for intrusion detection systems.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Access.</italic>
</source>
                    <year>2021</year>;<volume>9</volume>:<fpage>154156</fpage>&#x2013;<lpage>154171</lpage>.
                    <pub-id pub-id-type="doi">10.1109/ACCESS.2021.3127985</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-35">
                <label>35</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chitrakar</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Huang</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>Selection of candidate support vectors in incremental svm for network intrusion detection.</article-title>
                    <source>

                        <italic toggle="yes">Comput Secur.</italic>
</source>
                    <year>2014</year>;<volume>45</volume>:<fpage>231</fpage>&#x2013;<lpage>241</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.cose.2014.06.006</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-36">
                <label>36</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jiang</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sui</surname>
                            <given-names>Y</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cao</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>An incremental decision tree algorithm based on rough sets and its application in intrusion detection.</article-title>
                    <source>

                        <italic toggle="yes">Artif Intell Rev.</italic>
</source>
                    <year>2013</year>;<volume>40</volume>(<issue>4</issue>):<fpage>517</fpage>&#x2013;<lpage>530</lpage>.
                    <pub-id pub-id-type="doi">10.1007/s10462-011-9293-z</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-37">
                <label>37</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tsai</surname>
                            <given-names>CW</given-names>
                        </name>
</person-group>:
                    <article-title>Incremental particle swarm optimisation for intrusion detection.</article-title>
                    <source>

                        <italic toggle="yes">IET networks.</italic>
</source>
                    <year>2013</year>;<volume>2</volume>(<issue>3</issue>):<fpage>124</fpage>&#x2013;<lpage>130</lpage>.
                    <pub-id pub-id-type="doi">10.1049/iet-net.2012.0209</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-38">
                <label>38</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Noorbehbahani</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fanian</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mousavi</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An incremental intrusion detection system using a new semi-supervised stream classification method.</article-title>
                    <source>

                        <italic toggle="yes">Int J Commun Syst.</italic>
</source>
                    <year>2017</year>;<volume>30</volume>(<issue>4</issue>):<fpage>e3002</fpage>.
                    <pub-id pub-id-type="doi">10.1002/dac.3002</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-39">
                <label>39</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gyamfi</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jurcut</surname>
                            <given-names>AD</given-names>
                        </name>
</person-group>:
                    <article-title>Novel online network intrusion detection system for industrial iot based on oi-svdd and as-elm.</article-title>
                    <source>

                        <italic toggle="yes">IEEE Internet Things J.</italic>
</source>
                    <year>2022</year>.
                    <pub-id pub-id-type="doi">10.1109/JIOT.2022.3172393</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-40">
                <label>40</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wohlin</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>Guidelines for snowballing in systematic literature studies and a replication in software engineering.</article-title>In:
                    <source>

                        <italic toggle="yes">Proceedings of the 18th international conference on evaluation and assessment in software engineering.</italic>
</source>
                    <year>2014</year>;<fpage>1</fpage>&#x2013;<lpage>10</lpage>.
                    <pub-id pub-id-type="doi">10.1145/2601248.2601268</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-41">
                <label>41</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Agbedanu</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Musabe</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rwigema</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Towards achievi ng lightweight intrusion detection systems in Internet of Things, the role of incremental machine learning: A systematic literature review.</article-title>
                    <italic toggle="yes">figshare</italic>. Online resource.<year>2022</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.6084/m9.figshare.21436152.v2">http://www.doi.org/10.6084/m9.figshare.21436152.v2</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report171434">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.140269.r171434</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Soe</surname>
                        <given-names>Yan Naung</given-names>
                    </name>
                    <xref ref-type="aff" rid="r171434a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r171434a1">
                    <label>1</label>Department of Electrical and Information Engineering, Universitas Gadjah Mada, Yogyakarta, Special Region of Yogyakarta, Indonesia</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>15</day>
                <month>5</month>
                <year>2023</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2023 Soe YN</copyright-statement>
                <copyright-year>2023</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport171434" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.127732.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>reject</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The authors conducted a review for the lightweight purpose of IoT-based introduction detection systems. It is interesting, but the following concerns have to be addressed. 
                <list list-type="bullet">
                    <list-item>
                        <p>Many typos are found.</p>
                    </list-item>
                    <list-item>
                        <p>In the abstract, you mentioned that your review is based on the 21 IDS research works. It is not enough to review a specific work. There are many related works in recent years. More references are necessary.&#x00a0;</p>
                        <p> </p>
                        <p> In Table-5, the authors listed the sources/publishers of their references. Many lightweight IoT-IDS could be easily found by exploring these publishers' web sources. E.g., the authors can explore many articles in their sources, like 
                            <ext-link ext-link-type="uri" xlink:href="https://www.mdpi.com/search?q=Lightweight+IoT+IDS">MDPI</ext-link>, 
                            <ext-link ext-link-type="uri" xlink:href="https://dl.acm.org/action/doSearch?fillQuickSearch=false&amp;target=advanced&amp;expand=dl&amp;field1=AllField&amp;text1=lightweight+IoT+IDS">ACM Digital Library</ext-link>, and so on.</p>
                        <p> </p>
                        <p> In Table-6, why can &#x201c;only zero article in ACM&#x201d; be considered as your quality assessment criteria?</p>
                    </list-item>
                    <list-item>
                        <p>According to the title and abstract, you focus on the lightweight purpose in the detection systems, but you mentioned only 7 lightweight models.</p>
                        <p> </p>
                        <p> Also, you have to check them again, are these really lightweight systems?&#x00a0;The authors organized some lightweight models in Table 8, even if the referenced works are not deeply checked, the question arises, how could some of them be lightweight? E.g., in Table 8, in the reference [30], how it would be lightweight with computational complexity? And also, the reference [28], is it lightweight with memory consumption?</p>
                    </list-item>
                    <list-item>
                        <p>According to your abstract, you mentioned that you analyzed the systems regarding 4 kinds of criteria. But your research questions almost did not reflect them. In addition, these are not also correct.&#x00a0;In the abstract, the authors described "The study analyzed 1) existing incremental machine learning approaches used in designing intrusion detection systems for IoT ecosystems, 2) emphasizing the incremental methods used in detecting intrusions, 3) the datasets used to evaluate these methods, and 4) how the method achieves lightweight status.</p>
                        <p> </p>
                        <p> In the "Research questions" section, the authors generated 4-questions, such as RQ1: What is the primary contribution of the paper? RQ2: What incremental or online machine learning algorithm was used in this study? RQ3: How does the proposed method handle data, feature, or concept drift? RQ4: How does the proposed IDS handle the computational constraints of IoT systems?</p>
                        <p> </p>
                        <p> Is there any relation between these two parts? More importantly, even showing these facts in these parts, there is no significant explanation in this review, especially on the lightweight purpose. If so, why did the authors put the important concern in IoT-IDS, "lightweight/handling the computational constraints" in these parts, such as the title, abstract, and research questions?</p>
                    </list-item>
                    <list-item>
                        <p>According to your references list, you put many published reviews and survey works. It would be better if you study them again how to arrange the contents in the review works.</p>
                    </list-item>
                    <list-item>
                        <p>The citation styles are also different. E.g., the reference numbers 7 and 8. Other references are also facing the same issue. In addition, the reference indexing style in tables is confusing.</p>
                    </list-item>
                    <list-item>
                        <p>In the conclusion, you describe that you analyzed comprehensively ML-based intrusion detection systems. However, in the current version, the manuscript seems just a report that you have studied.</p>
                    </list-item>
                </list> The overall comment is that you have to improve your manuscript significantly, to be following the style of review works, to be focusing on the facts in the title and abstract, and be arranged as a well-structured manuscript.</p>
            <p>Are the rationale for, and objectives of, the Systematic Review clearly stated?</p>
            <p>Partly</p>
            <p>Is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are sufficient details of the methods and analysis provided to allow replication by others?</p>
            <p>No</p>
            <p>Are the conclusions drawn adequately supported by the results presented in the review?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>IoT, Cyber-security, Machine Learning</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.</p>
        </body>
    </sub-article>
</article>
