<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="other" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.73311.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Study Protocol</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Post-pandemic e-learning: a pre-protocol to assess the integration of mobile VR and its effect on VARK learning styles</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 3 approved with reservations]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Manzoor</surname>
                        <given-names>Shahida Raihan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-7227-7530</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Mohd-Isa</surname>
                        <given-names>Wan-Noorshahida</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-9060-0250</uri>
                    <xref ref-type="corresp" rid="c2">b</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Dollmat</surname>
                        <given-names>Khairi Shazwan</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="corresp" rid="c3">c</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Faculty of Computing and Informatics, Multimedia University, Cyberjaya, Selangor, 63100, Malaysia</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:raihan_shahida@yahoo.com">raihan_shahida@yahoo.com</email>
                </corresp>
                <corresp id="c2">
                    <label>b</label>
                    <email xlink:href="mailto:wan.noorshahida.isa@mmu.edu.my">wan.noorshahida.isa@mmu.edu.my</email>
                </corresp>
                <corresp id="c3">
                    <label>c</label>
                    <email xlink:href="mailto:shazwan.dollmat@mmu.edu.my">shazwan.dollmat@mmu.edu.my</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>2</day>
                <month>11</month>
                <year>2021</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>10</volume>
            <elocation-id>1106</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>14</day>
                    <month>10</month>
                    <year>2021</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Manzoor SR et al.</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/10-1106/pdf"/>
            <abstract>
                <p>
                    <bold>Background:</bold> The Covid-19 pandemic has resulted in an abrupt but accelerated shift to e-learning worldwide. Education in a post-pandemic world has to amalgamate the advantages of e-learning with important pedagogical goals associated with in-person teaching. Although various advanced technologies are present at our fingertips today, we are still unable to use their full potential in teaching and learning. In this regard, mobile VR technology is both cost-efficient, versatile and engaging for students. Developing countries have more smartphone users than developed&#x00a0;countries, implying that developing countries, like Malaysia, should utilize mobile or cellphones more significantly. With that in mind, we propose here a pre-protocol to investigate learner motivation and levels of engagement for e-learning with smartphone-integrated VR, based on their VARK (Visual, Auditory, Read/Write, Kinesthetic) learning styles.</p>
                <p>
                    <bold>Proposed methodology:</bold> This study intends to use a minimum sample of 30 students from the same age group under the K-12 (particularly grade 9-12) belonging to STEM curriculum. The 
                    <ext-link ext-link-type="uri" xlink:href="https://arvr.google.com/cardboard/">Google Cardboard</ext-link> VR set will be used as the prime technology for its affordability, easy build feature and variety of available vendors. A mixed-method (survey and activity log/tracking) for data collection is suggested to find the degree of engagement and motivation of the learners&#x2019; learning in the mobile VR-assisted e-learning context. The students will be taught a topic using the mobile VR and then be assessed through simple classroom quizzes to assess how well they grasped the concept. The data collected through activity logs (while teaching the topic in mobile VR) and questionnaires will be mapped to each individual learner and organized in a data repository. Further visualization, analysis and investigation will be performed using Smart PLS, Python or R language.</p>
                <p/>
                <p>
                    <bold>Conclusions:</bold> The study aims to provide context for smartphone and software companies to develop technologies that could facilitate learner engagement during the post-pandemic state.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>E-Learning</kwd>
                <kwd>Mobile VR</kwd>
                <kwd>Learning Style</kwd>
                <kwd>Post- pandemic Education</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1">
                    <funding-source>TM R&amp;D</funding-source>
                    <award-id>MMUE/190022</award-id>
                </award-group>
                <funding-statement>This work was supported by TM R&amp;D Grant [Grant ID MMUE/190022].</funding-statement>
                <funding-statement>
                    <italic>The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.</italic>
                </funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec1" sec-type="intro">
            <title>Introduction</title>
            <p>Since the Covid-19 pandemic broke out in 2020, e-learning has become a new standard worldwide. A staggering number of educational institution closures took place in 192 countries, as reported by the International Labour Organization (ILO), resulting in 91.4% of enrolled learners being affected.
                <sup>
                    <xref ref-type="bibr" rid="ref1">1</xref>
                </sup> To tackle these circumstances, a number of educational institutions had been forced to abruptly adopt full online learning measures.</p>
            <p>One of the sectors that is being heavily affected by these measures is the education sector, particularly school students. According to a survey conducted by RAND Corporation, teachers of virtual classrooms need more overall instructional support compared to teachers teaching in physical classrooms, in terms of tailoring content, engaging students, academically advancing them and measuring their progress.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup> Access to digital devices and the internet was a concern too.
                <sup>
                    <xref ref-type="bibr" rid="ref2">2</xref>
                </sup>
            </p>
            <p>Numerous educators often use smartphones for e-learning in many parts of the world. Because of the perceived utility of mobile phones, learners in such contexts may suffice without a computer to access e-learning materials.
                <sup>
                    <xref ref-type="bibr" rid="ref3">3</xref>
                </sup>
                <sup>,</sup>
                <sup>
                    <xref ref-type="bibr" rid="ref4">4</xref>
                </sup> Yet, uses of mobiles for learning are mostly limited among tertiary-level students. According to Darko-Adjei,
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>
                </sup> learners were not prepared for the integration of mobile phones in the learning context, especially in Malaysian schools. Moreover, there is a lack of awareness of its potential power of innovation in the education system.
                <sup>
                    <xref ref-type="bibr" rid="ref5">5</xref>
                </sup>
            </p>
            <p>In addition to that, traditional e-learning tends to face challenges in retaining learner motivation and keeping them engaged, as well as certain limitations in explaining abstract scientific concepts to different types of learners. According to Stovall,
                <sup>
                    <xref ref-type="bibr" rid="ref6">6</xref>
                </sup> in the context of web-based learning systems, &#x201c;a student&#x2019;s degree of engagement in educational learning is lower than that in traditional education systems&#x201d;. As cited in Hartnetter,
                <sup>
                    <xref ref-type="bibr" rid="ref17">17</xref>
                </sup> e-learners are frequently expected to be further naturally motivated as the learning environment depends heavily on their interest, self-drive, and intrinsic motivation to evoke student engagement.</p>
            <p>In reality, some regard the technology used as intrinsically motivating since it offers a range of properties acknowledged as essential in the development of intrinsic motivation, notably, novelty, challenge, fantasy and curiosity.
                <sup>
                    <xref ref-type="bibr" rid="ref7">7</xref>
                </sup> The study proposed here intends to investigate learners&#x2019; motivation and levels of engagement for e-learning with smartphone-integrated VR for the K-12 student cohort in Malaysian schools. Accordingly, it will provide recommendations for smartphone and software companies to develop technologies integrating various learning styles that could facilitate learning engagement during the post-pandemic state.</p>
        </sec>
        <sec id="sec2">
            <title>Literature review</title>
            <sec id="sec3">
                <title>VARK learning style</title>
                <p>The learning styles of an individual pertain to his or her ability to effectively understand and absorb information.
                    <sup>
                        <xref ref-type="bibr" rid="ref8">8</xref>
                    </sup> In terms of student-centric learning, it is essential to accommodate all students with different learning preferences. Many teachers believe that teaching according to individual style can help improve learners&#x2019; performance.
                    <sup>
                        <xref ref-type="bibr" rid="ref24">24</xref>
                    </sup> Mirza and Khurshid
                    <sup>
                        <xref ref-type="bibr" rid="ref8">8</xref>
                    </sup> identified the learning modalities of health professional students and suggested that student motivation is positively enhanced when students recognized their learning styles. The study by Good 
                    <italic toggle="yes">et al.</italic>
                    <sup>
                        <xref ref-type="bibr" rid="ref24">24</xref>
                    </sup> also suggested that VARK (Visual, Aural, Read/write, Kinesthetic) is a significant teaching tool and also helps enhance performance.</p>
                <p>Mirza and Khurshid
                    <sup>
                        <xref ref-type="bibr" rid="ref8">8</xref>
                    </sup> have stated that VARK (Visual, Auditory, Reader/Writer and Kinesthetic) is the most accepted teaching model that categorizes learners with respect to their sensory characteristics. It is one of the earliest and most popular learner style tools developed by Fleming and Mills.
                    <sup>
                        <xref ref-type="bibr" rid="ref19">19</xref>
                    </sup> According to these researchers, the success of the model stems from its authenticity, usability, and the array of learning resources available to complement it.</p>
            </sec>
            <sec id="sec4">
                <title>E-learning and its effectiveness</title>
                <p>The term e-learning or electronic learning originated in the mid-1990s when the Internet began to gather momentum.
                    <sup>
                        <xref ref-type="bibr" rid="ref20">20</xref>
                    </sup> The two core elements of e-learning include computer-based learning as well as web-based learning.
                    <sup>
                        <xref ref-type="bibr" rid="ref9">9</xref>
                    </sup>
                </p>
                <p>Researchers have developed a number of models to guide e-learning research and e-learning effectiveness. By studying and synthesizing previous models of e-learning research from management, information systems, education, sociology and psychology, Johnson and Brown
                    <sup>
                        <xref ref-type="bibr" rid="ref10">10</xref>
                    </sup> concluded that e-learning outcomes are influenced by multiple processes and inputs. They proposed a model to summarize the literature consisting of five inputs: organizational context, technology, design/pedagogy, instructions and trainee or learner traits. The study by Johnson and Brown focuses more on 
                    <italic toggle="yes">technology</italic> as an input and influencing factor in the learning process. The sub focuses under 
                    <italic toggle="yes">technology</italic> are reliability, usefulness, ease of use and media richness (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>).</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>A model of e-learning influences and its effectiveness.</title>
                    </caption>
                    <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/76954/681881a6-b42d-4715-875f-590330aba62d_figure1.gif"/>
                </fig>
            </sec>
            <sec id="sec5">
                <title>Mobile learning</title>
                <p>Mobile learning is an integral part of e-learning. As cited by Basak 
                    <italic toggle="yes">et al.</italic>,
                    <sup>
                        <xref ref-type="bibr" rid="ref9">9</xref>
                    </sup> Behera stated that mobile learning or m-learning is correlated with mobile computing and e-learning. According to Sanchez-Prieto 
                    <italic toggle="yes">et al.</italic>,
                    <sup>
                        <xref ref-type="bibr" rid="ref18">18</xref>
                    </sup> mobile learning is a learning environment that is closely related to e-learning, belonging to a separate typology, where the process of teaching, as well as learning, would have a digital dimension (
                    <xref ref-type="fig" rid="f2">Figure 2</xref>).</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>Relationship between e-learning (electronic learning), m-learning (mobile learning), and d-learning (digital learning).</title>
                    </caption>
                    <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/76954/681881a6-b42d-4715-875f-590330aba62d_figure2.gif"/>
                </fig>
            </sec>
            <sec id="sec6">
                <title>VR in education and learner engagement</title>
                <p>Virtual reality (VR) is a computer-generated rendering of a 3D world or image that can be communicated in a relatively natural or tactile manner by a human wearing special electronic devices (headgear with an incorporated display inside or accessories equipped with sensors). VR provides 3D digital worlds featuring sophisticated ways of interaction that can motivate students to understand more completely. Its truly interactive learning environment has the power to improve the learning process and skill acquisition.
                    <sup>
                        <xref ref-type="bibr" rid="ref12">12</xref>
                    </sup> Previous research has shown that the use of VR technologies will help to motivate the learning process by allowing students to experience &#x2018;natural phenomena&#x2019; while being safe from the real-world consequences.
                    <sup>
                        <xref ref-type="bibr" rid="ref12">12</xref>
                    </sup> In other words, the incorporation of VR allows new educational opportunities to emerge.</p>
                <p>Teachers frequently encounter issues concerning student engagement with teaching materials.
                    <sup>
                        <xref ref-type="bibr" rid="ref22">22</xref>
                    </sup> Higher levels of engagement with learning activities can be achieved if the virtual world is more interactive. For instance, debates are typically effective at involving learners in subjects needing critical thinking,
                    <sup>
                        <xref ref-type="bibr" rid="ref21">21</xref>
                    </sup> but they are less suitable for learning factual science subjects like physics or chemistry. VR may be particularly useful for those subjects where a spatial arrangement is important or there are dynamic changes.</p>
                <p>VR can enhance engagement and improve retention, as students get to learn through experience, which is necessary for STEM subjects. VR also influences the students&#x2019; spatial ability for real-time visualization, which are crucial skills in the engineering field. Students can explore &#x201c;the use of advanced holographic technologies to bring virtual 3D building components to life&#x201d; [
                    <xref ref-type="bibr" rid="ref11">11</xref>, para 3]. The implications of VR require investment in resources and technical equipment. Hence there is a need for educational institutions to start with &#x201c;cheaper alternatives and small mobile devices first&#x201d; [
                    <xref ref-type="bibr" rid="ref11">11</xref>, para 5].</p>
                <p>
                    <italic toggle="yes">VR and learner motivation</italic>
                </p>
                <p>Many professions, including medical science, engineering, architecture, product development, and geology, have used VR to study and visualize abstract concepts.
                    <sup>
                        <xref ref-type="bibr" rid="ref25">25</xref>
                    </sup> According to previous research, utilizing VR technology as a teaching tool enhances learners' grasp on the concept, test scores as well as learning motivation while lowering training costs and experimental risks. Employing VR in instruction can potentially increase student learning motivation and positively enhance student performance.
                    <sup>
                        <xref ref-type="bibr" rid="ref26">26</xref>
                    </sup> However, there is a paucity of studies on the impact of mobile VR on student motivation in STEM courses.</p>
                <p>
                    <italic toggle="yes">Mobile VR</italic>
                </p>
                <p>Although VR has been available for a long time, the associated technology required to access it has been prohibitively expensive, heavy and high battery/power consumption. VR apps have been able to proliferate into the general market because of mobile VR headsets, which are essentially eyewear that can support a smartphone.
                    <sup>
                        <xref ref-type="bibr" rid="ref13">13</xref>
                    </sup>
                </p>
                <p>With a number of available ways to experiment with VR content, headsets, video and apps, this tool has the potential to become yet another method in an educator's repertoire for assisting learners in understanding critical theories and mastering a range of concepts. As smartphones with integrated video capability became widely available, the influence of what could be shared and generated in the classroom has improved significantly. VR technology is essentially the first phase leading to the advancement of interactive learning,
                    <sup>
                        <xref ref-type="bibr" rid="ref1">1</xref>
                    </sup> and mobile VR adds accessibility and cost-efficiency to that advancement.</p>
            </sec>
        </sec>
        <sec id="sec7">
            <title>Proposed methodology</title>
            <sec id="sec8">
                <title>Hypotheses and framework</title>
                <p>Based on the above review of literature, the following hypotheses are proposed for this study:
                    <statement id="state1">
                        <label>H1:</label>
                        <p>Visual learners have the highest level of engagement in a mobile VR environment.</p>
                    </statement>
                    <statement id="state2">
                        <label>H2:</label>
                        <p>Auditory learners have the highest level of engagement in a mobile VR environment.</p>
                    </statement>
                    <statement id="state3">
                        <label>H3:</label>
                        <p>Kinesthetic learners have the highest level of engagement in a mobile VR environment.</p>
                    </statement>
                    <statement id="state4">
                        <label>H4:</label>
                        <p>Reader/Writer has the least engagement in a mobile VR environment.</p>
                    </statement>
                    <statement id="state5">
                        <label>H5:</label>
                        <p>Visual learners have the highest level of motivation in a mobile VR environment.</p>
                    </statement>
                    <statement id="state6">
                        <label>H6:</label>
                        <p>Auditory learners have the highest level of motivation in a mobile VR environment.</p>
                    </statement>
                    <statement id="state7">
                        <label>H7:</label>
                        <p>Kinesthetic learners have the highest level of motivation in a mobile VR environment.</p>
                    </statement>
                    <statement id="state8">
                        <label>H8:</label>
                        <p>Reader/Writer learners are least motivated to learn in a mobile VR environment.</p>
                    </statement>
                </p>
                <p>The literature review shows that VR is swiftly becoming a household word, thanks to the recent boom of VR-compatible devices. Despite having a significant impact on student engagement and performance, mobile VR is greatly neglected in education. The proposed framework considers factors such as learning styles of learners and technology used to teach in order to measure the motivation and engagement of students belonging to the K-12 group (
                    <xref ref-type="fig" rid="f3">Figure 3</xref>).</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>Figure 3. </label>
                    <caption>
                        <title>Process flow of the proposed framework.</title>
                    </caption>
                    <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/76954/681881a6-b42d-4715-875f-590330aba62d_figure3.gif"/>
                </fig>
            </sec>
            <sec id="sec9">
                <title>Sample selection</title>
                <p>A minimum cluster of 30 students from the same age group under the K-12 curriculum should be selected for the pilot study to be statistically significant. It is very important that the students be selected from a definite age group, preferably high schoolers (grade 9-12), and course, preferably STEM curriculum, as different age groups may produce different results. In addition, the study includes surveys in multiple levels; it&#x2019;s desired that they be filled in with proper understanding of the questions being asked. High schoolers are young adults that fit the mentioned criteria. During the sample selection, diverse VARK learner types should be included in an even ratio to avoid a biased outcome and a healthy ratio of male to female should be considered to avoid skewing the results. This could be ensured with the &#x201c;VARK LS Questionnaire&#x201d; stage mentioned in 
                    <xref ref-type="fig" rid="f3">Figure 3</xref>.</p>
            </sec>
            <sec id="sec10">
                <title>Device selection</title>
                <p>The most appropriate device for this study is 
                    <ext-link ext-link-type="uri" xlink:href="https://arvr.google.com/cardboard/">Google Cardboard</ext-link>, as it is affordable, easy-to-build and has numerous vendors. It also supports both Android and iOS-based mobile devices. The VR devices (Google Cardboard) are to be acquired and distributed by the research team whereas the mobile devices can be the students&#x2019; own devices. A list of students&#x2019; existing mobile phones can be produced before initiating the test to ensure a smooth execution.</p>
            </sec>
            <sec id="sec11">
                <title>Training and content design</title>
                <p>Although most young learners are familiar with VR and can rapidly pick up technology usage or its trends, the teachers or instructors may need to get a better understanding of the possible uses and integration of the existing mobile VR software in the curriculum. Coming up with suitable educational content may require some training or professional help. This can be ensured by allowing time to the educators to explore the technology first and look though the manuals and tutorials available online. Then they can communicate their concerns or areas of difficulty and training/troubleshooting with the help of 
                    <ext-link ext-link-type="uri" xlink:href="https://developers.google.com/cardboard/community">Google cardboard community</ext-link> can be arranged. For activity logs to be tracked, students will be taught a topic (in line with their study curriculum) using mobile VR technology which will be accompanied by a simple quiz to gauge how well the students understood the topic and how well they retained that information. This process should be repeated several times over the period of one semester to investigate the patterns over a decent time span. The design of the content should be appropriate for the age group, relevant to the topic, and have the ability to be supported by existing mobile VR software such as 
                    <ext-link ext-link-type="uri" xlink:href="https://sites.google.com/tcsnc.org/tcs-g-expeditions/google-expeditions-app">Expeditions</ext-link>, 
                    <ext-link ext-link-type="uri" xlink:href="https://store.steampowered.com/app/396030/InCell_VR/">InCell VR</ext-link>, 
                    <ext-link ext-link-type="uri" xlink:href="https://store.steampowered.com/app/468820/Titans_of_Space_PLUS/">Titans of space</ext-link>, and 
                    <ext-link ext-link-type="uri" xlink:href="https://play.google.com/store/apps/details?id=com.google.android.vr.home&amp;hl=en&amp;gl=US">Google Daydream</ext-link>. These VR software are some of the most well-established and widely used platforms for educational purposes with a variety of existing materials.</p>
            </sec>
            <sec id="sec12">
                <title>Data collection</title>
                <p>A mixed-method for data collection will be conducted to find the degree of engagement and motivation the learners learning in the mobile VR-assisted e-learning context.</p>
                <p>A questionnaire method will be utilized as the first method to collect learner motivation and engagement-related data.
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Measuring motivation: the questionnaire developed by Vallerand 
                                <italic toggle="yes">et al.</italic>
                                <sup>
                                    <xref ref-type="bibr" rid="ref15">15</xref>
                                </sup> known as EME [(&#x00c9;chelle de Motivation en &#x00c9;ducation (Measure of Motivation towards Education)], which comprises seven subscales measuring &#x201c;three different kinds of intrinsic motivation and three different kinds of extrinsic motivation&#x201d;.
                                <sup>
                                    <xref ref-type="bibr" rid="ref16">16</xref>
                                </sup>
                            </p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>Measuring engagement: the Student Engagement (SE) survey developed by Ahlfeldt 
                                <italic toggle="yes">et al.</italic>
                                <sup>
                                    <xref ref-type="bibr" rid="ref23">23</xref>
                                </sup> will be used that emphasizes the concepts of &#x201c;cooperative learning, cognitive-level, and personal skills development, encompassing four, five, and five items respectively&#x201d;. The three concepts are answerable on a four-point Likert scale, with 4 &#x2013; very often, 3 &#x2013; often, 2 &#x2013; occasionally, and 1 &#x2013; never. The aim of SE was to build an instrument that would be fast and easy to administer in class and which would measure student engagement.</p>
                        </list-item>
                    </list>
                </p>
                <p>A system log or activity log tracking will be used as the second method to collect data regarding engagement. Some of the system logs parameters proposed to be collected in this study are shown in 
                    <xref ref-type="table" rid="T1">Table 1</xref>.</p>
                <table-wrap id="T1" orientation="portrait" position="float">
                    <label>Table 1. </label>
                    <caption>
                        <title>Variables to be tracked from activity logs.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Variable name</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Units of measurement</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Time spent on each content</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Seconds</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Time spent to complete a task</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Seconds</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Number of correct answers</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Count</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Number of wrong answers</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Count</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Number of attempts</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Count</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Number of questions asked</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Count</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Types of questions asked</td>
                                <td align="left" colspan="1" rowspan="1" valign="top">Syntax</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec id="sec13">
                <title>Data analysis</title>
                <p>The data collected through activity logs and questionnaires will be mapped to each individual learner correctly. Further visualization, analysis and investigation will be performed using Smart PLS, Python or R language to summarize the main characteristics of the data collected. Various methods of clustering, regression and correlation heatmaps will be applied to have an improved understanding of the relationships of the variables, detect patterns, spot anomalies, and test the hypothesis and other assumptions. Principal component analysis (PCA) will be explored to understand which attributes contribute most to the variance of each model. The Panda and Seaborn libraries in Python are very powerful in terms of data visualization and assessing correlation.</p>
            </sec>
        </sec>
        <sec id="sec14" sec-type="discussion">
            <title>Discussion</title>
            <p>Many studies related to the use of mobile VR in the context of education have been carried out in recent years. These studies vary in terms of education level, course type, teaching environment, level of immersion, and more. There is however a lack of work that includes learning style frameworks in terms of using mobile VR for e-learning.</p>
            <p>Pauschenwein 
                <italic toggle="yes">et al.</italic> researched game-based learning elements that are economically priced and highly mobile VR systems with an enhanced feeling of immersion in the virtual environment and sound didactical scenarios.
                <sup>
                    <xref ref-type="bibr" rid="ref27">27</xref>
                </sup> The study focused on the method of making VR more affordable and widely used in practical studies but not so much on its potential in the field of e-learning. A pilot study carried out by Raya 
                <italic toggle="yes">et al.</italic> compared mobile VR technology with conventional video content on a tablet device for teaching. The study was done on 56 high school learners looking into the effects of immersion and the induction of positive emotion while learning social science courses. The findings indicated that while delivering educational content, knowledge retention is heavily influenced by the immersive condition. Also, short-term participants of the study exhibited better retention when there were positive emotional induction and high immersion. Unlike our proposed study that integrates learning style element into the mobile VR and analyses its influences, this research focused on manipulating emotions, its impacts on knowledge retention, and high immersion as a potential technology in enhancing the influence of emotions.
                <sup>
                    <xref ref-type="bibr" rid="ref28">28</xref>
                </sup>
            </p>
            <p>G&#x00fc;ray and K&#x0131;smet
                <sup>
                    <xref ref-type="bibr" rid="ref29">29</xref>
                </sup> proposed a model to integrate VR or AR (Augmented Reality) technologies in building construction education. Their proposed model highlighted the advantages of the creative use of VR/AR tools through integrating the Building Information Modelling tools in distance learning particularly during the Covid-19 pandemic conditions, but the VR/AR technology mentioned was not mobile supported and rather desktop based. One of the latest works done by Sprenger and Schwaninger
                <sup>
                    <xref ref-type="bibr" rid="ref30">30</xref>
                </sup> shed light on the technology acceptance of e-learning and mobile VR based on a three months usage. The voluntary participants were 94 students from a university in Northwestern Switzerland, studying the course &#x201c;General Psychology 1&#x201d;. The results suggested that the acceptance of mobile VR was very low compared to technologies like classroom response system, e-lectures, and classroom chat. Based on the theory of course alignment and examinations, the study revealed that students focused more on exam preparation rather than enjoying the process of learning. Apart from oversimplified VR content causing an underwhelming experience for some learners, the VR technology not having much relevance with the exam questions was also noted as one of the reasons for mobile VR having a low score on the spectrum of technology acceptance. The findings of the study re-emphasize the importance of selecting a proper learner age group and study level as well as an understanding of learner motivation and learning style while deploying a learning technology, which our conceptual model is greatly focusing on.</p>
        </sec>
        <sec id="sec15" sec-type="conclusion">
            <title>Conclusion</title>
            <p>Past research highlights the relationship between different learning styles and VR but there is very little research on the latter&#x2019;s subbranch known as mobile VR and its usage in terms of e-learning. The conceptual framework is expected to bring the required focus on mobile VR and its potential usage in e-learning which is expected to greatly aid K-12 students belonging to more practical-oriented disciplines of study or those with a more visual or kinesthetic learning style. The framework allows an integration between e-learning and mobile VR supported by the principles of VARK learning styles. Its purpose is to enhance the motivation and engagement of e-learners by better understanding multiple learning styles in a mobile VR environment.</p>
            <p>VR is considered one of the technology pillars of industry 4.0 or the fourth industrial revolution.
                <sup>
                    <xref ref-type="bibr" rid="ref13">13</xref>
                </sup> To introduce this fascinating innovation into classrooms, educators and facilitators should investigate the training needed to make it into a regularly used learning instrument. Although the idea of VR to some may appear as very advanced, in reality, it is quite similar to technology used in common social media apps, such as Instagram and Snapchat, home decor apps, such as Ikea Place, and gaming apps, such as Pok&#x00e9;mon Go. Learning about mobile VR and its impact is a perfect place to start for educators who want to make their online teaching space VR-friendly.</p>
            <p>Although the advantages of VR in teaching and learning are universal for a broad range of courses and learner types, the best integration approach differs from institution to institution as well as from class to class. Integrating mobile VR in terms of e-learning, on the other hand, is certainly achievable with the proper resources and knowledge on how VR will improve students' understanding and enthusiasm for learning. While the incorporation of VR technology in education is certain to enhance learning in almost every educational setting, the implementation approach does not demand to be radical.
                <sup>
                    <xref ref-type="bibr" rid="ref14">14</xref>
                </sup>
            </p>
            <p>There are challenges on traditional VR to pedagogical practice and theories such as cost, equipment usability, and fear of technology,
                <sup>
                    <xref ref-type="bibr" rid="ref11">11</xref>
                </sup> hence the education administrators need to jointly work together with the smartphone companies and VR product developers for its personalized, cost-effective implication at the post-pandemic stage to facilitate the process of e-learning.</p>
        </sec>
        <sec id="sec16">
            <title>Data availability</title>
            <p>No data is associated with this article.</p>
        </sec>
        <sec id="sec17">
            <title>Grant information</title>
            <p>This work was supported by TM R&amp;D Grant [Grant ID MMUE/190022].</p>
        </sec>
    </body>
    <back>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <label>1</label>
                <mixed-citation publication-type="other">
                    <collab>ILO (International Labour Organisation)</collab>:
                    <article-title>COVID-19 and the Education Sector.</article-title>
                    <year>2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.ilo.org/wcmsp5/groups/public/---ed_dialogue/---sector/documents/briefingnote/wcms_742025.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Schwartz</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Survey: Teachers and Students Are Struggling With Online Learning.</article-title>
                    <source>

                        <italic toggle="yes">Educ. Week.</italic>
</source>
                    <year>2020</year>.
 Accessed on 14 June 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://www.edweek.org/teaching-learning/survey-teachers-and-students-are-struggling-with-online-learning/2020/11">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pullen</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Swabey</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Abadooz</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Malaysian university students&#x2019; use of mobile phones for study.</article-title>
                    <source>

                        <italic toggle="yes">Australian Educ. Com.</italic>
</source>
                    <year>2020</year>;<volume>30</volume>(<issue>1</issue>).</mixed-citation>
            </ref>
            <ref id="ref4">
                <label>4</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ismail</surname>
                            <given-names>I</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bokhare</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Azizan</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Teaching via mobile phone: A case study on Malaysian teachers&#x2019; technology acceptance and readiness.</article-title>
                    <source>

                        <italic toggle="yes">J. Educ. Online.</italic>
</source>
                    <year>2013</year>;<volume>10</volume>(<issue>1</issue>):<fpage>1</fpage>&#x2013;<lpage>38</lpage>.
                    <pub-id pub-id-type="doi">10.9743/JEO.2013.1.3</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <label>5</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Darko-Adjei</surname>
                            <given-names>N</given-names>
                        </name>
</person-group>:
                    <article-title>The use and effect of smartphones in students' learning activities: Evidence from the University of Ghana, Legon.</article-title>
                    <year>2019</year>.</mixed-citation>
            </ref>
            <ref id="ref6">
                <label>6</label>
                <mixed-citation publication-type="other">
                    <collab>Stovall</collab>:
                    <article-title>Engagement and online learning. UIS community of practice for e-learning.</article-title>
                    <year>2016</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://otel.uis.edu/copel/EngagementandOnlineLearning.ppt">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref7">
                <label>7</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lepper</surname>
                            <given-names>MR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Malone</surname>
                            <given-names>TW</given-names>
                        </name>
</person-group>:
                    <chapter-title>Intrinsic motivation and instructional effectiveness in computer-based education</chapter-title>.
                    <person-group person-group-type="editor">

                        <name name-style="western">
                            <surname>Snow</surname>
                            <given-names>RE</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Farr</surname>
                            <given-names>MJ</given-names>
                        </name>
</person-group>, editors.
                    <source>

                        <italic toggle="yes">Aptitude, learning, and instruction: Vol. 3. Conative and affective process analyses.</italic>
</source>
                    <publisher-loc>Hillsdale, NJ</publisher-loc>:
                    <publisher-name>Lawrence Erlbaum</publisher-name>;<year>1987</year>; pp.<fpage>255</fpage>&#x2013;<lpage>286</lpage>.</mixed-citation>
            </ref>
            <ref id="ref8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mirza</surname>
                            <given-names>MA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Khurshid</surname>
                            <given-names>K</given-names>
                        </name>
</person-group>:
                    <article-title>Impact of VARK Learning Model at Tertiary Level Education.</article-title>
                    <source>

                        <italic toggle="yes">Int. J. Educa. Pedagogical Sci.</italic>
</source>
                    <year>2020</year>;<volume>14</volume>(<issue>5</issue>):<fpage>359</fpage>&#x2013;<lpage>366</lpage>.</mixed-citation>
            </ref>
            <ref id="ref9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Basak</surname>
                            <given-names>KS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wotto</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Belanger</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <article-title>E-learning, M-learning and D-learning: Conceptual definition and comparative analysis.</article-title>
                    <source>

                        <italic toggle="yes">E-Learning and Digital Media.</italic>
</source>
                    <year>2018</year>;<volume>15</volume>(<issue>4</issue>):<fpage>191</fpage>&#x2013;<lpage>216</lpage>.
                    <pub-id pub-id-type="doi">10.1177/2042753018785180</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <label>10</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Johnson</surname>
                            <given-names>RD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Brown</surname>
                            <given-names>KG</given-names>
                        </name>
</person-group>:
                    <article-title>E-learning.</article-title>
                    <year>2017</year>.</mixed-citation>
            </ref>
            <ref id="ref11">
                <label>11</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Oigara</surname>
                            <given-names>JN</given-names>
                        </name>
</person-group>:
                    <chapter-title>Integrating virtual reality tools into classroom instruction</chapter-title>.
                    <source>

                        <italic toggle="yes">Handbook of research on mobile technology, constructivism, and meaningful learning.</italic>
</source>
                    <publisher-name>IGI Global</publisher-name>;<year>2018</year>; pp.<fpage>147</fpage>&#x2013;<lpage>159</lpage>.</mixed-citation>
            </ref>
            <ref id="ref12">
                <label>12</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rafidi</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>Bringing Learning to Life. New Straits Times.</article-title>
                    <year>2020, February</year>.
 Accessed on 12 June 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://www.nst.com.my/education/2020/02/562767/bringing-learning-life">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <label>13</label>
                <mixed-citation publication-type="other">
                    <collab>TechTarget Contributor</collab>:
                    <article-title>VR headset (virtual reality headset).</article-title>
                    <year>2016</year>.
 Accessed on 12 June 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://whatis.techtarget.com/definition/VR-headset-virtual-reality-headset">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <label>14</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Brodheim</surname>
                            <given-names>T</given-names>
                        </name>
</person-group>:
                    <article-title>The Pathway to Integrating Virtual Reality in Education.</article-title>
                    <year>2017, March</year>.
 Accessed on 10 June 2021.
                    <ext-link ext-link-type="uri" xlink:href="https://insights.samsung.com/2017/03/03/the-pathway-to-integrating-virtual-reality-in-education/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Vallerand</surname>
                            <given-names>RJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Blais</surname>
                            <given-names>MR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bri&#x00e8;re</surname>
                            <given-names>NM</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Construction et validation de l&#x2019;&#x00e9;chelle de motivation en &#x00e9;ducation (EME) (Construction and validation of the Motivation towards Education Scale).</article-title>
                    <source>

                        <italic toggle="yes">Revue canadienne des sciences du comportement/Canadian Journal of Behavioural Science.</italic>
</source>
                    <year>1989</year>;<volume>21</volume>(<issue>3</issue>):<fpage>323</fpage>&#x2013;<lpage>349</lpage>.
                    <pub-id pub-id-type="doi">10.1037/h0079855</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref16">
                <label>16</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kubischta</surname>
                            <given-names>F</given-names>
                        </name>
</person-group>:
                    <article-title>Engagement and Motivation: Questioning students on study-motivation, engagement and study strategies.</article-title>
                    <year>2014</year>.</mixed-citation>
            </ref>
            <ref id="ref17">
                <label>17</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hartnetter</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <chapter-title>The importance of motivation in online learning</chapter-title>.
                    <source>

                        <italic toggle="yes">Motivation in online education.</italic>
</source>
                    <publisher-loc>Singapore</publisher-loc>
                    <publisher-name>Springer</publisher-name>;<year>2016</year>; pp.<fpage>5</fpage>&#x2013;<lpage>32</lpage>.</mixed-citation>
            </ref>
            <ref id="ref18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>S&#x00e1;nchez-Prieto</surname>
                            <given-names>JC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Olmos-Miguel&#x00e1;&#x00f1;ez</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Garc&#x00ed;a-Pe&#x00f1;alvo</surname>
                            <given-names>FJ</given-names>
                        </name>
</person-group>:
                    <article-title>Informal tools in formal contexts: Development of a model to assess the acceptance of mobile technologies among teachers.</article-title>
                    <source>

                        <italic toggle="yes">Comput. Hum. Behav.</italic>
</source>
                    <year>2016</year>;<volume>55</volume>:<fpage>519</fpage>&#x2013;<lpage>528</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.chb.2015.07.002</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <label>19</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Fleming</surname>
                            <given-names>ND</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mills</surname>
                            <given-names>CE</given-names>
                        </name>
</person-group>:
                    <article-title>Not Another Inventory, Rather a Catalyst for Reflection.</article-title>
                    <year>1992</year>.</mixed-citation>
            </ref>
            <ref id="ref20">
                <label>20</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Garrison</surname>
                            <given-names>DR</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">E-Learning in the 21st Century: A Framework for Research and Practice.</italic>
</source>
                    <publisher-name>Taylor &amp; Francis</publisher-name>;<year>2011</year>.</mixed-citation>
            </ref>
            <ref id="ref21">
                <label>21</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Allcoat</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>M&#x00fc;hlenen</surname>
                            <given-names>A</given-names>
                            <prefix>von</prefix>
                        </name>
</person-group>:
                    <article-title>Learning in virtual reality: Effects on performance, emotion and engagement.</article-title>
                    <source>

                        <italic toggle="yes">Res. Learn. Technol.</italic>
</source>
                    <year>2018</year>;<volume>26</volume>.
                    <pub-id pub-id-type="doi">10.25304/rlt.v26.2140</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref22">
                <label>22</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Christopoulos</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Conrad</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Shukla</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Increasing student engagement through virtual interactions: How?</article-title>
                    <source>

                        <italic toggle="yes">Virtual Reality.</italic>
</source>
                    <year>2018</year>;<volume>22</volume>:<fpage>353</fpage>&#x2013;<lpage>369</lpage>.
                    <pub-id pub-id-type="doi">10.1007/s10055-017-0330-3</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <label>23</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ahlfeldt</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mehta</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sellnow</surname>
                            <given-names>T</given-names>
                        </name>
</person-group>:
                    <article-title>Measurement and analysis of student engagement in university classes where varying levels of PBL methods of instruction are in use.</article-title>
                    <source>

                        <italic toggle="yes">High. Educ. Res. Dev.</italic>
</source>
                    <year>2005</year>;<volume>24</volume>(<issue>1</issue>):<fpage>5</fpage>&#x2013;<lpage>20</lpage>.
                    <pub-id pub-id-type="doi">10.1080/0729436052000318541</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <label>24</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Good</surname>
                            <given-names>JP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ramos</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>D'Amore</surname>
                            <given-names>DC</given-names>
                        </name>
</person-group>:
                    <article-title>Learning style preferences and academic success of preclinical allied health students.</article-title>
                    <source>

                        <italic toggle="yes">J. Allied Health.</italic>
</source>
                    <year>2013 Winter</year>;<volume>42</volume>(<issue>4</issue>):<fpage>81</fpage>&#x2013;<lpage>90</lpage>.</mixed-citation>
            </ref>
            <ref id="ref25">
                <label>25</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tudor</surname>
                            <given-names>AD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Minocha</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Collins</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mobile virtual reality for environmental education.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Virtual Studies.</italic>
</source>
                    <year>2018</year>;<volume>9</volume>(<issue>2</issue>):<fpage>25</fpage>&#x2013;<lpage>36</lpage>.</mixed-citation>
            </ref>
            <ref id="ref26">
                <label>26</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lund</surname>
                            <given-names>BD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wang</surname>
                            <given-names>T</given-names>
                        </name>
</person-group>:
                    <article-title>Effect of Virtual Reality on Learning Motivation and Academic Performance: What Value May VR Have for Library Instruction?.</article-title>
                    <source>

                        <italic toggle="yes">Kansas Library Association College and University Libraries Section Proceedings.</italic>
</source>
                    <year>2019</year>;<volume>9</volume>(<issue>1</issue>):<fpage>4</fpage>.
                    <pub-id pub-id-type="doi">10.4148/2160-942X.1073</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref27">
                <label>27</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Pauschenwein</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sandtner</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Behmel</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>VR-Simulation in education From Full mission to Mobile VR-Simulators. Mobile Game-Based Simulator for welding training.</article-title>
                    <source>

                        <italic toggle="yes">Proceedings of the International Workshop for Interactive Computer Aided Learning, Villach.</italic>
</source>
                    <year>2006</year>; pp.<fpage>1</fpage>&#x2013;<lpage>11</lpage>.</mixed-citation>
            </ref>
            <ref id="ref28">
                <label>28</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Olmos-Raya</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ferreira-Cavalcanti</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Contero</surname>
                            <given-names>M</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mobile virtual reality as an educational platform: A pilot study on the impact of immersion and positive emotion induction in the learning process.</article-title>
                    <source>

                        <italic toggle="yes">EURASIA Journal of Mathematics, Science and Technology Education.</italic>
</source>
                    <year>2018</year>;<volume>14</volume>(<issue>6</issue>):<fpage>2045</fpage>&#x2013;<lpage>2057</lpage>.</mixed-citation>
            </ref>
            <ref id="ref29">
                <label>29</label>
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>G&#x00fc;ray</surname>
                            <given-names>TS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>K&#x0131;smet</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <article-title>Model Proposal for Integrating VR/AR Technologies in Building Construction Project in Architecture Education During Covid-19.</article-title>
                </mixed-citation>
            </ref>
            <ref id="ref30">
                <label>30</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sprenger</surname>
                            <given-names>DA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Schwaninger</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Technology acceptance of four digital learning technologies (classroom response system, classroom chat, e-lectures, and mobile virtual reality) after three months&#x2019; usage.</article-title>
                    <source>

                        <italic toggle="yes">Int. J. Educ. Technol. High. Educ.</italic>
</source>
                    <year>2021</year>;<volume>18</volume>(<issue>1</issue>):<fpage>1</fpage>&#x2013;<lpage>17</lpage>.
                    <pub-id pub-id-type="doi">10.1186/s41239-021-00243-4</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report122923">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.76954.r122923</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Lim</surname>
                        <given-names>Kenneth Y. T.</given-names>
                    </name>
                    <xref ref-type="aff" rid="r122923a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-3756-6625</uri>
                </contrib>
                <aff id="r122923a1">
                    <label>1</label>Office of Education Research, National Institute of Education, Singapore, Singapore</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>14</day>
                <month>2</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Lim KYT</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport122923" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.73311.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This manuscript is a study protocol and will be reviewed as such.</p>
            <p> </p>
            <p> The rationale for the protocol is justified in terms of current socio-economic contexts and the review of literature emerges from the rationale. I also find coherence between the review of literature, research questions, and the proposed methodology.</p>
            <p> </p>
            <p> The protocol proposed essentially seeks to investigate learner engagement and motivation with mobile VR from a theoretically-grounded perspective in the context of (a) the on-going pandemic and (b) the high prevalence of mobile technological penetration in relatively less economically developed countries.</p>
            <p> </p>
            <p> In this regard, I offer only the following suggestions for improvement:</p>
            <p> </p>
            <p> (a) In the review of literature, you refer to VARK variously as a "model" and a "tool". Please be consistent in how you perceive and refer to it.</p>
            <p> </p>
            <p> (b) I feel that such the outcomes of such a study - once carried out - would be only as strong as the curricular materials developed for the chosen technology (Google Cardboard). I would therefore like the authors to elaborate more on this, and not just content themselves to the three sentences beginning respectively with "Coming up with suitable...", "This can be ensured by...", and "Then they can communicate their concerns...".</p>
            <p>Is the study design appropriate for the research question?</p>
            <p>Yes</p>
            <p>Is the rationale for, and objectives of, the study clearly described?</p>
            <p>Yes</p>
            <p>Are sufficient details of the methods provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Are the datasets clearly presented in a useable and accessible format?</p>
            <p>Not applicable</p>
            <p>Reviewer Expertise:</p>
            <p>the learning sciences, learning with VR / AR / XR, learning with mobile technology, learning during the COVID-19 pandemic, curriculum design and development</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment8244-122923">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Manzoor</surname>
                            <given-names>Shahida</given-names>
                        </name>
                        <aff>MULTIMEDIA UNIVERSITY, Malaysia</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>15</day>
                    <month>5</month>
                    <year>2022</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Thank you, Dr. Kenneth Y. T. Lim for taking out the time to review the article. The suggestions/comments have been addressed as follows:</p>
                <p> </p>
                <p> a) 
                    <italic>Changed</italic> VARK framework/tool&gt;model for consistency.</p>
                <p> </p>
                <p> b) The current study is to be carried out by utilizing existing VR software and study curriculum to understand its (current software's + curriculums') influence better and aims to later aid in the development of curriculum (new) based on the findings. 
                    <italic>Suggestions made for this article have been added in the Future Work (section).</italic>
                </p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report98843">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.76954.r98843</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Tunku Ahmad</surname>
                        <given-names>Tunku Badariah</given-names>
                    </name>
                    <xref ref-type="aff" rid="r98843a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <contrib contrib-type="author">
                    <name>
                        <surname>Nordin</surname>
                        <given-names>Mohamad Sahari</given-names>
                    </name>
                    <xref ref-type="aff" rid="r98843a2">2</xref>
                    <role>Co-referee</role>
                </contrib>
                <aff id="r98843a1">
                    <label>1</label>Department of Curriculum &amp; Instruction, Kulliyyah of Education, International Islamic University Malaysia, Kuala Lumpur, Malaysia</aff>
                <aff id="r98843a2">
                    <label>2</label>International Islamic University Malaysia, Selangor, Malaysia</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>3</day>
                <month>2</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Tunku Ahmad TB and Nordin MS</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport98843" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.73311.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>
                <bold>Summary of Feedback</bold>
            </p>
            <p> </p>
            <p> 1. The researchers/authors need to align the title with the research objectives and the constructs of interest (learner engagement and motivation). How do the authors define engagement and motivation?</p>
            <p> </p>
            <p> 2. The present hypotheses appear to contradict one another, and should instead appear as follows:</p>
            <p> </p>
            <p> 
                <bold>H1</bold>: The effect of the VR intervention on learner engagement will vary significantly by learning style.</p>
            <p> 
                <bold>H2</bold>: The effect of the VR intervention on learner motivation will vary significantly by learning style.</p>
            <p> </p>
            <p> 3. VARK learning styles are the moderator variable because the research aims to examine if the VR effects on learner engagement and motivation would vary significantly by the respondents' style of learning (i.e. whether they have&#x00a0;a visual, auditory, reader/writer and kinesthetic learning style). In other words, you may find the results as such: The VR application increased students' learning engagement significantly for all groups, but its impact on students with visual and auditory learning styles was significantly greater, as an example, at Cohen's d = 0.87 and d = 0.91, respectively.</p>
            <p> </p>
            <p> 4. A sample of 30 respondents is too small to test the hypotheses or run PCA/SEM on the data. The general rule is to have 5 to 10 respondents for every questionnaire item. For example, if the questionnaires have a total of 20 items, so the minimum sample needed is 20 x 5 = 100 (at least) or 20 x 10 = 200 respondents. PCA will not run if the minimum sample requirement is not met.</p>
            <p> </p>
            <p> 5. Revisit the techniques of data analysis. SEM appears to be most appropriate for addressing the research objectives (while treating VARK as the moderator variable), on the condition that the sample size is large enough.</p>
            <p> </p>
            <p> See Annotated Manuscript for Further Remarks.&#x00a0;
                <ext-link ext-link-type="uri" xlink:href="https://f1000researchdata.s3.amazonaws.com/supplementary/73311/8047b5da-7165-4c21-9a47-177351dd26a9.pdf">https://f1000researchdata.s3.amazonaws.com/supplementary/73311/8047b5da-7165-4c21-9a47-177351dd26a9.pdf</ext-link>.</p>
            <p>Is the study design appropriate for the research question?</p>
            <p>Yes</p>
            <p>Is the rationale for, and objectives of, the study clearly described?</p>
            <p>Partly</p>
            <p>Are sufficient details of the methods provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Are the datasets clearly presented in a useable and accessible format?</p>
            <p>Not applicable</p>
            <p>Reviewer Expertise:</p>
            <p>Pedagogical Studies, Web 2.0 tools, technology acceptance</p>
            <p>We confirm that we have read this submission and believe that we have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however we have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report115777">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.76954.r115777</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Baharum</surname>
                        <given-names>Aslina</given-names>
                    </name>
                    <xref ref-type="aff" rid="r115777a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-3910-5646</uri>
                </contrib>
                <aff id="r115777a1">
                    <label>1</label>Faculty of Computing and Informatics, Universiti Malaysia Sabah, Kota Kinabalu, Malaysia</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>2</day>
                <month>2</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Baharum A</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport115777" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.73311.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This paper proposed a pre-protocol to investigate learner motivation and levels of engagement for e-learning with smartphone-integrated VR, based on their VARK (Visual, Auditory, Read/Write, Kinesthetic) learning styles. However, the paper needs to be improved for better presentation: 
                <list list-type="order">
                    <list-item>
                        <p>The findings of the paper should be added to the abstract.</p>
                    </list-item>
                    <list-item>
                        <p>Furthermore, no method is given. Authors should tell the reader how and what method(s) were used to get their findings. What was the proposed methodology, the authors should also give&#x00a0;examples, and explain what&#x00a0;systematic review has been used etc.</p>
                    </list-item>
                    <list-item>
                        <p>No data has been collected since this paper only provides the proposed method, but using method such as systematic review, data from the Literature Review&#x00a0;can be extracted. Justification for the proposed method should included as well.</p>
                    </list-item>
                    <list-item>
                        <p>In the conclusion, authors should suggest&#x00a0;future works they recommend for further examination, for example, the process for verifying and validating the proposed instrument or method, or data collection, based&#x00a0;on the limitations of the study.&#x00a0;</p>
                    </list-item>
                </list>
            </p>
            <p>Is the study design appropriate for the research question?</p>
            <p>Yes</p>
            <p>Is the rationale for, and objectives of, the study clearly described?</p>
            <p>Yes</p>
            <p>Are sufficient details of the methods provided to allow replication by others?</p>
            <p>No</p>
            <p>Are the datasets clearly presented in a useable and accessible format?</p>
            <p>No</p>
            <p>Reviewer Expertise:</p>
            <p>User experience</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment8243-115777">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Manzoor</surname>
                            <given-names>Shahida</given-names>
                        </name>
                        <aff>MULTIMEDIA UNIVERSITY, Malaysia</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>15</day>
                    <month>5</month>
                    <year>2022</year>
                </pub-date>
            </front-stub>
            <body>
                <p>Thank you, Dr. Aslina Baharum for taking out the time to review the article. The suggestions/comments have been addressed as follows:</p>
                <p> </p>
                <p> 1.&#x00a0;As this is a 
                    <italic>conceptual study/Study protocol</italic>, only 
                    <italic>what kind of results are expected</italic> have been discussed and mentioned in the abstract.</p>
                <p> </p>
                <p> 2.&#x00a0;Narrative review has been used for this study, which synthesizes primary studies and explores this through description rather than statistics. (mentioned in the literature review)</p>
                <p> </p>
                <p> 3. The methodology suggested for the proposed framework is derived and synthesized from the literature review. (mentioned in 
                    <italic>discussion section&#x00a0;</italic>+ 
                    <italic>literature review section</italic>)</p>
                <p> </p>
                <p> 4. 
                    <italic>Future work</italic> has been added (newly) in the conclusion section.</p>
            </body>
        </sub-article>
    </sub-article>
</article>
