<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.12278.2</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                    <subj-group>
                        <subject>Science &amp; Medical Education</subject>
                    </subj-group>
                    <subj-group>
                        <subject>Web and Social Media</subject>
                    </subj-group>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>The evaluation of a virtual education system based on the DeLone and McLean model: &#x00a0;A path analysis</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 2; peer review: 3 approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Mahmoodi</surname>
                        <given-names>Zohreh</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-7868-6941</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Esmaelzadeh- Saeieh</surname>
                        <given-names>Sara</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Lotfi</surname>
                        <given-names>Razieh</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Baradaran Eftekhari</surname>
                        <given-names>Monir</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Akbari Kamrani</surname>
                        <given-names>Mahnaz</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <xref ref-type="aff" rid="a4">4</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Mehdizadeh Tourzani</surname>
                        <given-names>Zahra</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Salehi</surname>
                        <given-names>Katayoun</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Non-communicable Disease Research Center, Alborz University of Medical Sciences, Karaj, Iran</aff>
                <aff id="a2">
                    <label>2</label>Department of Midwifery School of Nursing and Midwifery, Alborz University of Medical Sciences, Karaj, Iran</aff>
                <aff id="a3">
                    <label>3</label>Undersecretary for Research &amp; Technology, Ministry of Health and Medical Education, Tehran, Iran</aff>
                <aff id="a4">
                    <label>4</label>Social Determinant of Health Research Center, Alborz University of Medical Sciences, Karaj, Iran</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:zohrehmahmoodi2011@gmail.com">zohrehmahmoodi2011@gmail.com</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>25</day>
                <month>9</month>
                <year>2017</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2017</year>
            </pub-date>
            <volume>6</volume>
            <elocation-id>1631</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>19</day>
                    <month>6</month>
                    <year>2026</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2017 Mahmoodi Z et al.</copyright-statement>
                <copyright-year>2017</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/6-1631/pdf"/>
            <abstract>
                <p>
                    <bold>Background</bold>: The Internet has dramatically influenced the introduction of virtual education. Virtual education is a term that involves online education and e-learning. This study was conducted to evaluate a virtual education system based on the DeLone and McLean model.</p>
                <p>
                    <bold>Methods</bold>: This descriptive analytical study was conducted using the census method on all the students of the Nursing and Midwifery Department of Alborz University of Medical Sciences who had taken at least one online course in 2016-2017. Data were collected using a researcher-made questionnaire based on the DeLone and McLean model in six domains and then analyzed in SPSS-16 and LISREL-8.8 using the path analysis.</p>
                <p>
                    <bold>Results</bold>: The goodness of fit indices (GFI) of the model represent the desirability and good fit of the model, and the rational nature of the adjusted relationships between the variables based on a conceptual model (GFI = 0.98; RMSEA = 0.014).The results showed that system quality has the greatest impact on the net benefits of the system through both direct and indirect paths (&#x03b2;=0.52), service quality through the indirect path (&#x03b2;=0.03) and user satisfaction through the direct path (&#x03b2;=0.73).</p>
                <p>
                    <bold>Conclusions</bold>: According to the results, system quality has the greatest overall impact on the net benefits of the system, both directly and indirectly by affecting user satisfaction and the intention to use. System quality should therefore be further emphasized, to use these systems more efficiently.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>virtual education</kwd>
                <kwd>evaluation</kwd>
                <kwd>path analysis</kwd>
                <kwd>model</kwd>
                <kwd>DeLone and Mclean</kwd>
                <kwd>education</kwd>
                <kwd>system</kwd>
                <kwd>e-learning</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
        <notes>
            <sec sec-type="version-changes">
                <label>Revised</label>
                <title>Amendments from Version 1</title>
                <p>In response to the referees' reports, Table 1 has been revised to correct the participants' percentage age and subgroups of sex.</p>
            </sec>
        </notes>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>Information and communication technology (ICT) has attracted the attention of scientific circles and organizations over recent years, with a focus on knowledge and rationality, and in order to efficiently employ the power of thinking, transfer repetitive tasks to machines and remove communication constraints. This attention means that virtual education or e-learning is now considered a major achievement of ICT, and has caused a number of scientific, research and cultural advances
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>
                </sup>.</p>
            <p>Clarke and Mayer define e-learning as presenting content through digital devices such as computers and cellphones, in order to improve learning
                <sup>
                    <xref ref-type="bibr" rid="ref-2">2</xref>
                </sup>. Using this method, learning takes place in a virtual environment in which learners interact with their peers, instructors and educational equipment in a non-traditional environment. In the virtual learning environment, the educational content is offered to the students through software, multimedia resources, the Internet and video conferencing, and the students communicate with their instructors, peers and other people or resources with the help of a computer, in order to carry out individual and group learning activities
                <sup>
                    <xref ref-type="bibr" rid="ref-3">3</xref>,
                    <xref ref-type="bibr" rid="ref-4">4</xref>
                </sup>. One of the benefits of this approach is the full-time and pervasive access to educational resources, reduced transportation time and costs for the students, the expansion of education for all at a much lower cost, the ease of access to multiple and diverse educational resources, the possibility of learning at any time and place and the possibility to learn from the instructor at any time and place
                <sup>
                    <xref ref-type="bibr" rid="ref-5">5</xref>
                </sup>. In spite of these benefits, implementing this form of education without analyzing whether the courses held have been adequately effective may lead to the failure of these courses as a means of education
                <sup>
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup>. One of the best and most-cited models used to evaluate the success of information systems is the DeLone and McLean model. This model measures the success of information systems by measuring six variables, including information quality, system quality, intention to use, user satisfaction, service quality and net benefits (
                <xref ref-type="fig" rid="f1">Figure 1</xref>). The success of a virtual medical education system is multidimensional and can be associated with system quality, information quality and service quality, which are the prerequisites of three other key structures, namely user satisfaction, intention to use and net benefits, which measure the effects of using the system after it is implemented
                <sup>
                    <xref ref-type="bibr" rid="ref-7">7</xref>
                </sup>. The evaluation of the courses held is one of the most important tasks of any organization and this need is twice as important in universities as they are considered a hub for research. The present study was conducted to evaluate the virtual education system implemented at the Nursing and Midwifery Department of Alborz University of Medical Sciences, based on the DeLone and McLean model using a path analysis.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>Figure 1. </label>
                <caption>
                    <title>The DeLone and McLean updated theoretical model
                        <sup>
                            <xref ref-type="bibr" rid="ref-15">15</xref>
                        </sup>.</title>
                </caption>
                <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/13811/3572fac5-45c5-443d-bcda-085195d40d6c_figure1.gif"/>
            </fig>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <sec>
                <title>Study design</title>
                <p>This descriptive analytical study was conducted at the Nursing and Midwifery Department of Alborz University of Medical Sciences in Alborz, Iran, during the 2016&#x2013;2017 academic years.</p>
                <p>
                    <bold>
                        <italic toggle="yes">Study participants.</italic>
                    </bold> All the undergraduate and graduate nursing and midwifery students who had taken at least one online course (n=127) were enrolled in the study through census sampling.</p>
            </sec>
            <sec>
                <title>Data collection</title>
                <p>Data were collected using a researcher-made questionnaire based on the DeLone and McLean model (
                    <xref ref-type="other" rid="SF1">Supplementary File 1</xref>). The questionnaire was designed after a review of the literature and the relevant tools available, and was split into two sections:</p>
                <p>(1) The socio-demographic details of the students (gender, age, field of study and marital status),</p>
                <p>(2) System evaluation questions in six domains, including system quality (5 items), service quality (5 items), information quality (3 items), intention to use (3 items), user satisfaction (3 items) and net benefits (4 items), which were then scored based on a 5-point Likert scale (&#x2018;Totally disagree&#x2019; = 1 to &#x2018;Totally agree&#x2019; = 5).</p>
                <p>Once designed, the questionnaire was quantitatively and qualitatively validated using the face and content validity methods. For determining the face validity, the questionnaire was distributed among 15 students; for determining the content validity, it was distributed among ten faculty members in fields of nursing, reproductive health and management and they were asked to provide their feedback. All participants gave written consent for publication of potentially identifiable data. The reliability of the questionnaire was assessed using a test-retest with a two-week interval, and by measuring its Cronbach&#x2019;s alpha coefficient.</p>
            </sec>
            <sec sec-type="methods">
                <title>Procedures</title>
                <p>The study began after obtaining the necessary permissions and a code of ethics from the university Ethics Committee (Abzums.Rec.1395.121). First, the eligible undergraduate and graduate nursing and midwifery students who had taken at least one online course in the 2016&#x2013;2017 academic year were listed with the help of the Student Affairs Office. Arrangements were then made with this office in order to attend the online classes. At the final ten minutes of each class, the researcher went online and explained the objectives of the study, and obtained written consent from the students and provided them with the questionnaire to fill out.</p>
                <p>The fit of a path analysis conceptual model (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>) was assessed in this study in order to determine the correlation between the variables used to evaluate the virtual education system. The path analysis method is a generalization of simple regression that shows not only the direct effects, but also the indirect effects and the effects of each of the variables on the dependent variables, and the results of such a study can be used to provide a rational interpretation of the observed relationships and correlations. The data obtained in this study were analyzed in LISREL version 8 software.</p>
            </sec>
        </sec>
        <sec sec-type="results">
            <title>Results</title>
            <p>A total of 127 undergraduate and graduate students of the Nursing and Midwifery Department of Alborz University of Medical Sciences were recruited for this study. The mean age of the participants was 27.29 &#x00b1; 1.5 years and the most frequent age group was 20&#x2013;25 (49.6%). The majority of the participants were female (68.5%) and married (50.4%) (
                <xref ref-type="table" rid="T1">Table 1</xref>).</p>
            <table-wrap id="T1" orientation="portrait" position="anchor">
                <label>Table 1. </label>
                <caption>
                    <title>Frequency distribution of participant characteristics.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="left" colspan="2" rowspan="1">variable</th>
                            <th align="center" colspan="1" rowspan="1" valign="top">f</th>
                            <th align="center" colspan="1" rowspan="1" valign="top">%</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="6" valign="top">age</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">20&#x2013;25</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">63</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">49.7</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1" valign="top">25&#x2013;30</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">12</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">9.4</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1" valign="top">30&#x2013;35</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">24</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">18.9</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1" valign="top">35&#x2013;40</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">12</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">9.4</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="1" rowspan="1" valign="top">&gt;40</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">16</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">12.6</td>
                        </tr>
                        <tr>
                            <td align="center" colspan="3" rowspan="1" valign="top">Mean=27.2992&#x00b1;1.519</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="2" valign="top">sex</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">female</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">87</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">68.5</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">male</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">40</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">31.5</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="4" valign="top">Marriage
                                <break/>statues</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">single</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">64</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">50.4</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">marriage</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">61</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">48.0</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">divorce</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">.8</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">widow</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">1</td>
                            <td align="center" colspan="1" rowspan="1" valign="top">.8</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <sec>
                <title>Validity assessment</title>
                <p>Based on the findings of the quantitative part of the face validity assessment, the impact score of all the items was between 2.4 and 3.3. Since the values were all more than 1.5, all the items remained in the questionnaire in this stage. In the content validity assessment stage, the content validity ratio (CVR) of all the items was between 0.63 and 0.8 and exceeded 0.62; the content validity index (CVI) of the items was also between 0.76 and 1 and exceeded 0.7. As a result, no items were removed from the questionnaire in this stage either. The Content Validity Index average (S-CVI/Ave) of the questionnaire was calculated as 96.37% (&#x00b1;0.65). The Cronbach&#x2019;s alpha coefficient of the researcher-made questionnaire was 0.762, and the test-retest correlation coefficient with a two-week interval was 0.712.The questionnaire was thus approved for extensive research.</p>
            </sec>
            <sec>
                <title>Path analysis</title>
                <p>To perform the path analysis, the correlation between the variables was investigated using the bivariate analysis. The net benefits of the system was the variable that had the highest correlation with user satisfaction (r = 0.81) and system quality (R = 0.72); (
                    <xref ref-type="table" rid="T2">Table 2</xref>).</p>
                <table-wrap id="T2" orientation="portrait" position="anchor">
                    <label>Table 2. </label>
                    <caption>
                        <title>The correlation between the variables used in the evaluation of the education system.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th colspan="1" rowspan="1"/>
                                <th align="center" colspan="1" rowspan="1">Quality of
                                    <break/>system</th>
                                <th align="center" colspan="1" rowspan="1">Quality of
                                    <break/>Information</th>
                                <th align="center" colspan="1" rowspan="1">Quality of
                                    <break/>service</th>
                                <th align="center" colspan="1" rowspan="1">Intention to
                                    <break/>use total</th>
                                <th align="center" colspan="1" rowspan="1">Satisfaction</th>
                                <th align="center" colspan="1" rowspan="1">Usefulness</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Quality of
                                    <break/>system</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.545**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.572**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.611**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.707**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.726**</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Quality of
                                    <break/>Information</td>
                                <td colspan="1" rowspan="1"/>
                                <td align="right" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.404**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.389**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.468**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.524**</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">quality of
                                    <break/>service</td>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td align="right" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.527**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.454**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.444**</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Intention to
                                    <break/>use</td>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td align="right" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.643**</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.615**</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">satisfaction </td>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td align="right" colspan="1" rowspan="1" valign="top">1</td>
                                <td align="right" colspan="1" rowspan="1" valign="top">.815**</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">usefulness</td>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1"/>
                                <td align="right" colspan="1" rowspan="1" valign="top">1</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>In the path analysis, the effects of variables including system quality, information quality, service quality, intention to use and user satisfaction were investigated for their usefulness (
                    <xref ref-type="fig" rid="f2">Figure 2</xref>).</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>The full empirical path model for the effects of the variables used in the evaluation of the education system.</title>
                        <p>QS: quality of system, QI: Quality of information, QKH: Quality of service, SA: satisfactory, MO: Intention to use, US: usefulness.</p>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/13811/3572fac5-45c5-443d-bcda-085195d40d6c_figure2.gif"/>
                </fig>
                <p>According to the results, the goodness of fit indices (GFI) of the model showed the desirability and good fit of the model and the rational nature of the adjusted relationships between the variables based on the conceptual model. As a result, the fitted model was not significantly different from the conceptual model (
                    <xref ref-type="table" rid="T3">Table 3</xref>).</p>
                <table-wrap id="T3" orientation="portrait" position="anchor">
                    <label>Table 3. </label>
                    <caption>
                        <title>Goodness of fit indices for the model (N=127).</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1">Model index</th>
                                <th align="left" colspan="1" rowspan="1">X
                                    <sup>2</sup>
                                </th>
                                <th align="left" colspan="1" rowspan="1">df</th>
                                <th align="left" colspan="1" rowspan="1">p</th>
                                <th align="left" colspan="1" rowspan="1">GFI</th>
                                <th align="left" colspan="1" rowspan="1">CFI</th>
                                <th align="left" colspan="1" rowspan="1">RMSEA</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1">0.05</td>
                                <td colspan="1" rowspan="1">1</td>
                                <td colspan="1" rowspan="1">0.82</td>
                                <td colspan="1" rowspan="1">0.98</td>
                                <td colspan="1" rowspan="1">0.95</td>
                                <td colspan="1" rowspan="1">0.014</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>According to the path diagram, user satisfaction (&#x03b2; = 0.73) was the variable that had the greatest impact on usefulness in the direct path and service quality (&#x03b2; = 0.03) the greatest impact in the indirect path. The only variable that had an impact through both the direct and indirect paths was system quality (&#x03b2; = 0.52).</p>
                <p>According to the results, net benefits will be greater when the system is in a favorable condition in terms of these variables. 
                    <xref ref-type="table" rid="T4">Table 4</xref> shows the direct, indirect and overall effects of the noted variables on usefulness.</p>
                <table-wrap id="T4" orientation="portrait" position="anchor">
                    <label>Table 4. </label>
                    <caption>
                        <title>The path coefficients for the variables used in the evaluation of the education system.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="2" valign="top">Predictor variables</th>
                                <th align="center" colspan="3" rowspan="1">Effects</th>
                                <th align="left" colspan="1" rowspan="2" valign="top">t-value</th>
                                <th align="left" colspan="1" rowspan="2" valign="top">R
                                    <sup>2</sup>
                                </th>
                                <th align="left" colspan="1" rowspan="2" valign="top">Errorvar</th>
                            </tr>
                            <tr>
                                <th align="left" colspan="1" rowspan="1">Direct</th>
                                <th align="left" colspan="1" rowspan="1">Indirect</th>
                                <th align="left" colspan="1" rowspan="1">Total</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td colspan="1" rowspan="1">Quality of system</td>
                                <td colspan="1" rowspan="1">0.22</td>
                                <td colspan="1" rowspan="1">0.3066</td>
                                <td colspan="1" rowspan="1">0.5266</td>
                                <td colspan="1" rowspan="1">2.98</td>
                                <td colspan="1" rowspan="5" valign="middle">0.72</td>
                                <td colspan="1" rowspan="5" valign="middle">0.44</td>
                            </tr>
                            <tr>
                                <td colspan="1" rowspan="1">Quality of information</td>
                                <td colspan="1" rowspan="1">0.08</td>
                                <td colspan="1" rowspan="1">-</td>
                                <td colspan="1" rowspan="1">0.08</td>
                                <td colspan="1" rowspan="1">2.31</td>
                            </tr>
                            <tr>
                                <td colspan="1" rowspan="1">Quality of service</td>
                                <td colspan="1" rowspan="1">-</td>
                                <td colspan="1" rowspan="1">0.0308</td>
                                <td colspan="1" rowspan="1">0.0308</td>
                                <td colspan="1" rowspan="1">-</td>
                            </tr>
                            <tr>
                                <td colspan="1" rowspan="1">Intention to use</td>
                                <td colspan="1" rowspan="1">0.11</td>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1">0.19</td>
                                <td colspan="1" rowspan="1">2.01</td>
                            </tr>
                            <tr>
                                <td colspan="1" rowspan="1">satisfactory</td>
                                <td colspan="1" rowspan="1">0.73</td>
                                <td colspan="1" rowspan="1"/>
                                <td colspan="1" rowspan="1">0.73</td>
                                <td colspan="1" rowspan="1">5.9</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <supplementary-material id="DS0" orientation="portrait" position="float" xlink:href="https://f1000researchdata.s3.amazonaws.com/datasets/12278/eedcc7f1-e597-4cca-a2f5-c8d46ac100ee_Dataset_1.xlsx">
                    <label>Raw data obtained from the questionnaire based on the DeLone and McLean model</label>
                    <caption>
                        <p>Gender, 1-female, 2-male; job, 1-student; marriage, 1-single, 2-married, 3-divorced, 4-widowed; education, 1-dipolma, 2-BS, 3-MS; subject, 1-medicine, 2-pharmacy, 3-dentistry, 4-nursing, 5-midwifery, 6-MS in consultation; QS1-5, question on quality of the system; QI1-5, question on quality of information; QH1-3, question on quality of service; M1-3, question on intention to use; S1-3, question on satisfaction; u1-4, question on usefulness.</p>
                    </caption>
                </supplementary-material>
            </sec>
        </sec>
        <sec sec-type="discussion">
            <title>Discussion</title>
            <p>Today, e-learning has become a growing trend and an important strategy for promoting education in all major countries of the world.</p>
            <p>According to the findings of the study, system quality was the only variable that affected the benefits and usefulness of the virtual education system through both the direct and indirect paths. According to the DeLone and McLean model, system quality refers to aspects of the information system itself, such as data reception speed, easy access, system authenticity, responsiveness, flexibility and user-friendliness
                <sup>
                    <xref ref-type="bibr" rid="ref-8">8</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref-11">11</xref>
                </sup>. These findings are consistent with the results obtained by P&#x00e9;rez-Mira (2010) and Boroufar 
                <italic toggle="yes">et al</italic>. (2014), who found that system quality has a positive impact on the benefits and usefulness of the system. According to their findings, system quality can be both encouraging and discouraging for the use of the system. They further argued that creating a quality e-learning system by increasing learner satisfaction has a positive effect on usefulness and benefits
                <sup>
                    <xref ref-type="bibr" rid="ref-12">12</xref>,
                    <xref ref-type="bibr" rid="ref-13">13</xref>
                </sup>. Chiu 
                <italic toggle="yes">et al</italic>. (2005) also found that quality and motivation are two key factors that affect user satisfaction and continued use of virtual education. Machado 
                <italic toggle="yes">et al</italic>. (2014) found that increased use has a direct relationship with increased system quality, and argued that people are encouraged to use virtual education systems that are user-friendly
                <sup>
                    <xref ref-type="bibr" rid="ref-11">11</xref>
                </sup>.</p>
            <p>Of the variables exerting their effects only through one path, service quality had the greatest impact on benefits and usefulness by indirectly affecting the intention to use. According to the DeLone and McLean model, service quality is essential for implementing information systems and depends on the performance of the service providers, which require training in sales and customer support. In the present study, service quality was found to affect the net benefits and usefulness of the system by indirectly affecting learner&#x2019;s intention. This finding is consistent with the results of a study by Boroufar 
                <italic toggle="yes">et al</italic>. (2014), who found that service quality indirectly affects the net benefits and usefulness of a system by affecting user satisfaction. Kazemi and Nematollahi (2014) also found that if web-based learning meets the needs of the learners, they will be motivated and satisfied, and this motivation and satisfaction will then make the learners continue using the system
                <sup>
                    <xref ref-type="bibr" rid="ref-14">14</xref>
                </sup>.</p>
            <p>Of the variables that directly affect the benefits of using the system, user satisfaction was the most effective. According to the DeLone and McLean model, user satisfaction refers to the response of the individual who uses the information system, such as overall satisfaction, enjoyable experiences and overall success. Chang 
                <italic toggle="yes">et al</italic>. (2011) also found that the learners&#x2019; level of satisfaction has the greatest direct effect on net benefits (7 The term &#x2018;net benefits&#x2019; refers to the main benefits achieved by user&#x2019;s increased use and satisfaction
                <sup>
                    <xref ref-type="bibr" rid="ref-8">8</xref>&#x2013;
                    <xref ref-type="bibr" rid="ref-11">11</xref>
                </sup>. The satisfaction of the users of a system plays a large role in the success and continued use of a system
                <sup>
                    <xref ref-type="bibr" rid="ref-8">8</xref>
                </sup>. In the present study, student satisfaction was affected by system quality and service quality. These results are consistent with the results obtained by Bauk 
                <italic toggle="yes">et al</italic>., who also found that user satisfaction is an effective measure of the contradictions between the expectations before and the perceived performance after receiving the education. User satisfaction is affected by system quality while it affects the net benefits of the system. P&#x00e9;rez-Mira B (2010), however, found different results and stated that despite there being relationship between user satisfaction and net benefits, there are no significant relationships between these two variables when entered into a path analysis model, which could be due to the lack of sufficient variation in measuring the satisfaction variable
                <sup>
                    <xref ref-type="bibr" rid="ref-13">13</xref>
                </sup>.</p>
            <sec>
                <title>Limitations</title>
                <p>A major limitation of this study lies in the lack of variability with regard to the courses offered through the virtual education system, which were limited to the Nursing and Midwifery Department of Alborz University of Medical Sciences.</p>
            </sec>
        </sec>
        <sec sec-type="conclusions">
            <title>Conclusions</title>
            <p>According to the results, system quality has the greatest overall impact on net benefits through both the direct and indirect paths by affecting user satisfaction and intention to use. The continued use of virtual education systems and the more efficient use of these systems therefore requires special attention to system quality, which involves speed of data transfer, ease of access, system authenticity, responsiveness, flexibility and user-friendliness.</p>
        </sec>
        <sec>
            <title>Data availability</title>
            <p>The data referenced by this article are under copyright with the following copyright statement: Copyright: &#x00ef;&#x00bf;&#x00bd; 2017 Mahmoodi Z et al.</p>
            <p>Data associated with the article are available under the terms of the Creative Commons Zero "No rights reserved" data waiver (CC0 1.0 Public domain dedication).
                <ext-link ext-link-type="uri" xlink:href="http://creativecommons.org/publicdomain/zero/1.0/"/>
            </p>
            <p>
                <bold>Dataset 1: Raw data obtained from the questionnaire based on the DeLone and McLean model.</bold> Gender, 1-female, 2-male; job, 1-student; marriage, 1-single, 2-married, 3-divorced, 4-widowed; education, 1-dipolma, 2-BS, 3-MS; subject, 1-medicine, 2-pharmacy, 3-dentistry, 4-nursing, 5-midwifery, 6-MS in consultation; QS1-5, question on quality of the system; QI1-5, question on quality of information; QH1-3, question on quality of service; M1-3, question on intention to use; S1-3, question on satisfaction; u1-4, question on usefulness. doi, 
                <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5256/f1000research.12278.d175011">10.5256/f1000research.12278.d175011</ext-link>
                <sup>
                    <xref ref-type="bibr" rid="ref-16">16</xref>
                </sup>
            </p>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgments</title>
            <p>We would like to express our gratitude to the Research Deputy for funding, Clinical Research Development Unit of Kamali Hospital of Alborz University of Medical Sciences for counseling this study and all the persons who participated in the project.</p>
        </ack>
        <sec id="SM1" sec-type="supplementary-material">
            <title>Supplementary material</title>
            <p id="SF1">Supplementary File 1: Questionnaire based on the Delone and McLean model.</p>
            <p>
                <ext-link ext-link-type="uri" xlink:href="https://f1000researchdata.s3.amazonaws.com/supplementary/12278/ef18fddd-5224-4cca-9b35-b588b027e330.docx">Click here to access the data</ext-link>.</p>
        </sec>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Faregzadeh</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kashi</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>An Evaluation Of Virtual Education Methods And Tools To Improve Teaching Quality From the point of view of the Faculty Members of Islamic Azad University of Khodabandeh.</article-title>
                    <source>

                        <italic toggle="yes">Quarterly Journal Of New Approach In Educational Administration.</italic>
</source>
                    <year>2014</year>;<volume>5</volume>(<issue>17</issue>):<fpage>121</fpage>&#x2013;<lpage>52</lpage>.
                    <ext-link ext-link-type="uri" xlink:href="http://en.journals.sid.ir/ViewPaper.aspx?ID=382255">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Clark</surname>
                            <given-names>RC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mayer</surname>
                            <given-names>RE</given-names>
                        </name>
</person-group>:
                    <article-title>E-learning and the science of instruction: Proven guidelines for consumers and designers of multimedia learning</article-title>. John Wiley &amp; Sons;<year>2016</year>.
                    <pub-id pub-id-type="doi">10.1002/9781118255971</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Cooper</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>E-learning in the World</article-title>. London: Falmer;<year>2004</year>.</mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Paola Torres Maldonado</surname>
                            <given-names>U</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Feroz Khan</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Moon</surname>
                            <given-names>J</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>E-learning motivation and educational portal acceptance in developing countries.</article-title>
                    <source>

                        <italic toggle="yes">Online Inform Rev.</italic>
</source>
                    <year>2011</year>;<volume>35</volume>(<issue>1</issue>):<fpage>66</fpage>&#x2013;<lpage>85</lpage>.
                    <pub-id pub-id-type="doi">10.1108/14684521111113597</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Acton</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Halonen</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Conboy</surname>
                            <given-names>K</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>DeLone &amp; McLean success model as a descriptive tool in evaluating the use of a virtual learning environment</article-title>.<year>2009</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://aran.library.nuigalway.ie/bitstream/handle/10379/222/OLKC2009_4DRaijaHalonen.pdf?sequence=1&amp;isAllowed=y">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Fatehi Vajargah</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pardakhtchi</surname>
                            <given-names>MH</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>EFFECTIVENESS evaluation of virtual learning courses in high education system of IRAN (Case of Ferdowsi University).</article-title>
                    <source>

                        <italic toggle="yes">Inform Commun Technol Educ Sci.</italic>
</source>
                    <year>2011</year>;<volume>1</volume>(<issue>4</issue>):<fpage>5</fpage>&#x2013;<lpage>21</lpage>.
                    <ext-link ext-link-type="uri" xlink:href="http://en.journals.sid.ir/ViewPaper.aspx?ID=261860">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chang</surname>
                            <given-names>HC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Liu</surname>
                            <given-names>CF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hwang</surname>
                            <given-names>HG</given-names>
                        </name>
</person-group>:
                    <article-title>Exploring nursing e-learning systems success based on information system success model.</article-title>
                    <source>

                        <italic toggle="yes">Comput Inform Nurs.</italic>
</source>
                    <year>2011</year>;<volume>29</volume>(<issue>12</issue>):<fpage>741</fpage>&#x2013;<lpage>7</lpage>.
                    <pub-id pub-id-type="pmid">21543971</pub-id>
                    <pub-id pub-id-type="doi">10.1097/NCN.0b013e31821a1651</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bauk</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>&#x0160;&#x0107;epanovi&#x0107;</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kopp</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Estimating Students&#x2019; Satisfaction with Web Based Learning System in Blended Learning Environment.</article-title>
                    <source>

                        <italic toggle="yes">Educ Res Int.</italic>
</source>
                    <year>2014</year>;<volume>2014</volume>.
                    <pub-id pub-id-type="doi">10.1155/2014/731720</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Halonen</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Acton</surname>
                            <given-names>T</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Golden</surname>
                            <given-names>W</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>DeLone &amp; McLean success model as a descriptive tool in evaluating a virtual learning environment</article-title>.<year>2006</year>.</mixed-citation>
            </ref>
            <ref id="ref-10">
                <label>10</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lagazian</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nazemi</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dadmand</surname>
                            <given-names>F</given-names>
                        </name>
</person-group>:
                    <article-title>Evaluation of the success of Financial Information System of Ferdowsi University of Mashhad using Delon and McLean's Modified Model.</article-title>
                    <source>

                        <italic toggle="yes">Iran J Inform Proc Mag.</italic>
</source>
                    <year>2012</year>;<volume>27</volume>(<issue>3</issue>):<fpage>577</fpage>&#x2013;<lpage>96</lpage>.</mixed-citation>
            </ref>
            <ref id="ref-11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Machado-Da-Silva</surname>
                            <given-names>FN</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Meirelles</surname>
                            <given-names>FdS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Filenga</surname>
                            <given-names>D</given-names>
                        </name>
</person-group>:
                    <article-title>Student Satisfaction Process in Virtual Learning System: Considerations Based in Information and Service Quality from Brazil's Experience.</article-title>
                    <source>

                        <italic toggle="yes">Turkish Online Journal of Distance Education.</italic>
</source>
                    <year>2014</year>;<volume>15</volume>(<issue>3</issue>):<fpage>122</fpage>&#x2013;<lpage>42</lpage>.
                    <pub-id pub-id-type="doi">10.17718/tojde.52605</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <label>12</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Boroufar</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sadeghy</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shokohyar</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Assess the success of e-learning system in the insurance system: Using a modified version Delon and McLean.</article-title>
                    <source>

                        <italic toggle="yes">Journal of E-learning University.</italic>
</source>
                    <year>2014</year>;<volume>1</volume>(<issue>6</issue>):<fpage>71</fpage>&#x2013;<lpage>84</lpage>(persian).</mixed-citation>
            </ref>
            <ref id="ref-13">
                <label>13</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>P&#x00e9;rez-Mira</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <article-title>Validity of Delone and Mclean&#x2019;s model of information systems success at the web site level of analysis</article-title>. Northwestern State University;<year>2010</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://digitalcommons.lsu.edu/cgi/viewcontent.cgi?article=4530&amp;context=gradschool_dissertations">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kazemi</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nematollahi</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>A Proposed Model for Sustainable Education in E-learning: the Effective Factors.</article-title>
                    <source>

                        <italic toggle="yes">Interdisciplinary Journal of Virtual Learning in Medical Sciences.</italic>
</source>
                    <year>2014</year>;<volume>5</volume>(<issue>2</issue>):<fpage>79</fpage>&#x2013;<lpage>86</lpage>(persian).
                    <ext-link ext-link-type="uri" xlink:href="http://ijvlms.ir/online/browse.php?a_code=A-10-6-141&amp;sid=1&amp;slc_lang=en">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zaied</surname>
                            <given-names>ANH</given-names>
                        </name>
</person-group>:
                    <article-title>An integrated success model for evaluating information system in public sectors.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Emerging Trends in Computing and Information Sciences.</italic>
</source>
                    <year>2012</year>;<volume>3</volume>(<issue>6</issue>):<fpage>814</fpage>&#x2013;<lpage>25</lpage>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.cisjournal.org/journalofcomputing/archive/vol3no6/vol3no6_1.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mahmoodi</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Esmaelzadeh-Saeieh</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lotfi</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Dataset 1 in: The evaluation of a virtual education system based on the DeLone and McLean model: A path analysis.</article-title>
                    <source>

                        <italic toggle="yes">F1000Research.</italic>
</source>
                    <year>2017</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://dx.doi.org/10.5256/f1000research.12278.d175011">Data Source</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report25649">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.13292.r25649</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Amini</surname>
                        <given-names>Laila</given-names>
                    </name>
                    <xref ref-type="aff" rid="r25649a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r25649a1">
                    <label>1</label>Faculty of Nursing and Midwifery, Iran University of Medical Sciences, Tehran, Iran</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>20</day>
                <month>9</month>
                <year>2017</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2017 Amini L</copyright-statement>
                <copyright-year>2017</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport25649" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.12278.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>
                <list list-type="bullet">
                    <list-item>
                        <p>The total percentage of age in table is not 100% please correct</p>
                    </list-item>
                    <list-item>
                        <p>Please change subgroups of sex in table 1 to male and female&#x00a0; or&#x00a0; women and men</p>
                    </list-item>
                    <list-item>
                        <p>And marital statues change to married, divorced,...</p>
                    </list-item>
                    <list-item>
                        <p>Introduction and discussion parts are not supported with enough documents and it is better researchers&#x00a0;review more references in their article</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <sub-article article-type="response" id="comment3043-25649">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Mahmoodi</surname>
                            <given-names>Zohreh</given-names>
                        </name>
                        <aff>Assistant Professor, Non-communicable Disease Research Center ,Alborz University of Medical Sciences, Karaj, Iran, Iran</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>20</day>
                    <month>9</month>
                    <year>2017</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Editor thank you for your decision.</p>
                <p>&#x00a0; 
                    <list list-type="bullet">
                        <list-item>
                            <p>The total percentage of age in table is not 100% please correct</p>
                        </list-item>
                    </list> Answer: It was corrected 
                    <list list-type="bullet">
                        <list-item>
                            <p>Please change subgroups of sex in table 1 to male and female&#x00a0; or&#x00a0; women and men</p>
                        </list-item>
                    </list> Answer: It was corrected 
                    <list list-type="bullet">
                        <list-item>
                            <p>Introduction and discussion parts are not supported with enough documents and it is better researchers&#x00a0;review more references in their article</p>
                        </list-item>
                    </list> Answer: I reviewed it again</p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report25972">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.13292.r25972</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Shojaee</surname>
                        <given-names>Parisa</given-names>
                    </name>
                    <xref ref-type="aff" rid="r25972a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r25972a1">
                    <label>1</label>Social Determinants Of Health Research Center, University of Social Welfare and Rehabilitation Sciences, Tehran, Iran</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>13</day>
                <month>9</month>
                <year>2017</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2017 Shojaee P</copyright-statement>
                <copyright-year>2017</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport25972" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.12278.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>"...Student Affairs Office. Arrangements were then made with this office in order to attend the online classes. 
                <bold>At the final ten minutes of each class</bold>, the researcher went online and explained the objectives of the study, and obtained written consent from the students and provided them with the questionnaire to fill out."</p>
            <p> </p>
            <p> In my opinion, the completion time of the questionnaire was not suitable due to the stress of the exam. More exact details should be explained about the path analysis for readers of this paper.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Partly</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <sub-article article-type="response" id="comment3026-25972">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Mahmoodi</surname>
                            <given-names>Zohreh</given-names>
                        </name>
                        <aff>Assistant Professor, Non-communicable Disease Research Center ,Alborz University of Medical Sciences, Karaj, Iran, Iran</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>14</day>
                    <month>9</month>
                    <year>2017</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Editor Thanks for your decision and your reviewer comments.</p>
                <p>1-In my opinion, the completion time of the questionnaire was not suitable due to the stress of the exam. More exact details should be explained about the path analysis for readers of this paper.</p>
                <p>Answer:The questionnaire was complete at the end of each class so the sentence &#x00a0;'
                    <bold>At the final ten minutes of each class' </bold>means at the end of class not the exam time.</p>
                <p>Regards.</p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report25652">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.13292.r25652</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Ahmadi Doulabi</surname>
                        <given-names>Mahboubeh</given-names>
                    </name>
                    <xref ref-type="aff" rid="r25652a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-9862-0480</uri>
                </contrib>
                <aff id="r25652a1">
                    <label>1</label>Department of Midwifery and Reproductive Health, School of Nursing and Midwifery, Shahid Beheshti University of Medical Sciences, Tehran, Iran</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>7</day>
                <month>9</month>
                <year>2017</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2017 Ahmadi Doulabi M</copyright-statement>
                <copyright-year>2017</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport25652" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.12278.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>Accurate design and complete execution, key points are the main strength of this study.</p>
            <p> </p>
            <p> The research topic is new and very interesting. However, it requires to answer some question. 
                <list list-type="order">
                    <list-item>
                        <p>Why was this project only in the Nursing and Midwifery faculty?</p>
                    </list-item>
                    <list-item>
                        <p>Why did they use this model for evaluation?</p>
                    </list-item>
                </list>
            </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
        <sub-article article-type="response" id="comment3003-25652">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Mahmoodi</surname>
                            <given-names>Zohreh</given-names>
                        </name>
                        <aff>Assistant Professor, Non-communicable Disease Research Center ,Alborz University of Medical Sciences, Karaj, Iran, Iran</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>7</day>
                    <month>9</month>
                    <year>2017</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Dear Editor Thanks for your decision and your reviewer comments.</p>
                <p>Comments for the Author:</p>
                <p>
                    <italic>1- Why was this project only in the Nursing and Midwifery faculty?</italic>
                </p>
                <p>Answer: We did it in Nursing and Midwifery Department only because, the courses offered through the virtual education system, were limited to this Department and this subject was not presented in other department of Alborz University of Medical Sciences. I wrote it in limitation part.</p>
                <p>
                    <italic>2- Why did they use this model for evaluation?</italic>
                </p>
                <p>Answer: One of the best and most-cited models used to evaluate the success of information systems is the DeLone and McLean model. This model measures the success of information systems by measuring six variables, including information quality, system quality, and intention to use, user satisfaction, service quality and net benefits</p>
            </body>
        </sub-article>
    </sub-article>
</article>
