<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.72860.3</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Enhancing innovative delivery in schools using design thinking</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 3; peer review: 2 approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Gopinathan</surname>
                        <given-names>Sharmini</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-5156-5605</uri>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Kaur</surname>
                        <given-names>Anisha Haveena</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Investigation</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Ramasamy</surname>
                        <given-names>Kanesaraj</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-2780-6069</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Raman</surname>
                        <given-names>Murali</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a3">3</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Faculty of Management, Multimedia University, Cyberjaya, Selangor, 63000, Malaysia</aff>
                <aff id="a2">
                    <label>2</label>Faculty of Computing &amp; Informatics, Multimedia University, Cyberjaya, Selangor, 63000, Malaysia</aff>
                <aff id="a3">
                    <label>3</label>Research &amp; Innovation, Asia Pacific University, Jalan Teknologi 5, Taman Teknologi Malaysia, 57000, Malaysia</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:sharmini.gopinathan@mmu.edu.my">sharmini.gopinathan@mmu.edu.my</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>10</day>
                <month>1</month>
                <year>2022</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2021</year>
            </pub-date>
            <volume>10</volume>
            <elocation-id>927</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>4</day>
                    <month>1</month>
                    <year>2022</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Gopinathan S et al.</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/10-927/pdf"/>
            <abstract>
                <p>The pandemic has created challenges in all sectors of the economy and education. Traditional teaching approaches seem futile in the new context, thus the need to constantly reinvent the delivery to meet the fast-paced changes in the education domain. Hence, Design Thinking (DT) is an alternative approach that might be useful in the given context. DT is known to be a human-centric approach to innovative problem-solving processes. DT could be employed in the delivery process to develop twenty-first-century skills and enhance creativity and innovation, in an attempt to identify alternative solutions. The study explores the role of design thinking (DT) in the form of empathy, thinking process, gamified lessons and curriculum enhancement, which leads to innovative delivery among teachers. It enhances and facilitates innovative content delivery by leveraging creativity. The study targeted 131 teachers, whereby 61 are primary school teachers and 70 are secondary school teachers. A questionnaire constituting of 23 close-ended questions using the 5-point Likert scale was used to collect data. Data was analyzed using SmartPLS to establish relationships between DT and Innovative Delivery in schools. The data was further analyzed to seek co-relations between the DT steps and the successful transformation of content delivery by teachers. The study established a framework for the application of design thinking for teachers as the primary support in developing activities for their students. It shows that thinking process, gamifying lessons and curriculum enhancement have positive significance in innovative delivery, whereas empathy did not show a significant positive relationship. The outcome of this study will help fill the gap towards creating an interesting method of delivery in schools and constantly innovating the method to suit the evolving generation. This insight is crucial for the Ministry of Education and policymakers to enhance teachers&#x2019; ability to innovatively deliver content to students.</p>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Design thinking</kwd>
                <kwd>innovative teaching</kwd>
                <kwd>21st-century teaching</kwd>
                <kwd>Malaysian schools</kwd>
                <kwd>innovative delivery</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
        <notes>
            <sec sec-type="version-changes">
                <label>Revised</label>
                <title>Amendments from Version 2</title>
                <p>A few minor adjustments in terms of grammar as well as rephrasing sentences to ensure consistent flow.</p>
            </sec>
        </notes>
    </front>
    <body>
        <sec sec-type="intro">
            <title>Introduction</title>
            <p>We are living in unprecedented times. The COVID-19 pandemic coupled with the continuous onslaught of digital technologies has acerbated the level of volatility, uncertainty, complexity, and ambiguity, across various sectors. The education sector is not spared and remains a target for greater industrial shifts and repositioning in the context of remaining relevant. To this end, even schools are subject to changes&#x2014;failure to innovate and offer the state of curriculum and pedagogy puts extreme pressure on students in their quest to become employable at later parts of life. As such, to ensure the education systems keep abreast with changes, strategic and practical shifts in the delivery of educational content is crucial. Failure to do so could result in longer term socioeconomic consequences.</p>
            <p>In this paper, we posit that innovative delivery of educational content is required to ensure students can truly benefit from the learning outcomes set out in schools. Therefore, we propose precursors such as having empathy, rejuvenated thinking process, curriculum enhancement and gamification of lessons that can lead to innovative delivery of lessons. This includes examining the role of design thinking (DT) in generating innovative delivery of educational content.</p>
            <p>There are various definitions of design thinking. According to Oxford Languages
                <sup>
                    <xref ref-type="bibr" rid="ref-1">1</xref>
                </sup>, the word &#x2018;design&#x2019;, a noun, refers to &#x201c;a plan or drawing produced to show the look and function or workings of a building, garment, or other objects before it is made&#x201d;. This definition implies that &#x2018;design&#x2019; relates to any form of idea that is put forth either in the form of sketch, model, or better still as a full-blown prototype before the final product or model is developed. The second word, &#x2018;thinking&#x2019;, a noun, refers to &#x201c;the process of considering or reasoning about something,&#x201d; according to Oxford Languages
                <sup>
                    <xref ref-type="bibr" rid="ref-2">2</xref>
                </sup>. The keywords based on this definition are reasoning and process. DT therefore can be defined as a systematic or a structured approach to developing something, initially as a model or prototype, before a final version is built. We need to understand nevertheless that when people build or develop something, it is often done to solve a real-world problem. As such, DT is often defined as a systematic and structured approach to solving a problem based on design.</p>
            <p>The inherent ideas beneath DT are not new. Nevertheless, DT presents an organised way of including innovative thinking and creativity in organisations. To be able to derive the inspirational values of DT, highly specific tools and techniques are used that are usually presented in a simplified manner. DT is able to solve problems using a user-centric collaborative method
                <sup>
                    <xref ref-type="bibr" rid="ref-3">3</xref>
                </sup>. Stanford University&#x2019;s design school (dSchool) established a five-step DT process
                <sup>
                    <xref ref-type="bibr" rid="ref-4">4</xref>
                </sup>, which is summarised in 
                <xref ref-type="table" rid="T1">Table 1</xref>.</p>
            <table-wrap id="T1" orientation="portrait" position="anchor">
                <label>Table 1. </label>
                <caption>
                    <title>Phases of design thinking based on the understanding of Stanford School.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="center" colspan="1" rowspan="1" valign="top">DT Phase</th>
                            <th align="center" colspan="1" rowspan="1" valign="top">Brief Explanation</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Empathy</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The most vital step in DT. Design thinkers are given a design challenge to understand the emotional attachment and pain
                                <break/>points of customers towards a problem or challenge. The findings from this step will naturally lead to the second step called
                                <break/>&#x2018;define&#x2019;. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Define</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">This step requires design thinkers to focus on getting deep into the problem from the customer&#x2019;s viewpoint. They will
                                <break/>then spend some time to come up with specific perspectives. In addition, they will also suggest some game-changing
                                <break/>propositions to the problem based on insights or intuitions. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Ideate</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">This step allows design thinkers to come up with as many ideas as they can in order to address the issue or problem which
                                <break/>has been defined. Ideate is similar to brainstorming sessions.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Prototype</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The step where ideas are translated into tangible manifestations. The prototype may not necessarily be a tangible product
                                <break/>as it could also be a simulation, campaign, or mockup (this depends on the challenge at hand). </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="top">Test </td>
                            <td align="left" colspan="1" rowspan="1" valign="top">This final step in DT emphasises on the importance of pitching the idea to indemnified target groups. This is followed by
                                <break/>the gathering of feedback. The solution is either launched to the market or is reworked until it is deemed to be suitable for
                                <break/>market launch. </td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
            <p>The interest in applying DT in school settings has seen a dramatic growth over the years. However, empirical research in the education context, specifically for schools, is limited and not much attention has been given when it comes to the importance of including DT as a component of a teacher&#x2019;s toolkit
                <sup>
                    <xref ref-type="bibr" rid="ref-5">5</xref>,
                    <xref ref-type="bibr" rid="ref-6">6</xref>
                </sup>. DT when institutionalised as an inherent culture in schools, could lead to innovative teaching and learning processes. Specifically, DT has the potential to cultivate empathy, lead to a growth mindset (new thinking processes), and lead to curriculum enhancement in the form of gamified learning.</p>
            <sec>
                <title>Empathy</title>
                <p>Empathy as a core of every DT project, one outcome of successful DT applications is the ability to encourage a culture that gives everybody a chance to express themselves freely. Empathy in the classroom context refers to the teacher-student interaction. Empathy shows the connection of what a teacher thinks or knows about their students and what they do to provide the necessary response to the students&#x2019; needs
                    <sup>
                        <xref ref-type="bibr" rid="ref-7">7</xref>
                    </sup>. This is also needed as teachers are the ones who arrange learning experiences for their students. Teachers are able to do so by providing feedback to their students. According to Mueller and Dweck
                    <sup>
                        <xref ref-type="bibr" rid="ref-8">8</xref>
                    </sup>, students who are praised and given feedback based on their efforts (instead of intelligence) are more likely to show an interest in mastery and tend to seek challenges when attempting to achieve their learning goals. These students can think out of the box as they are under the impression that their performances can be improved
                    <sup>
                        <xref ref-type="bibr" rid="ref-9">9</xref>
                    </sup>.</p>
            </sec>
            <sec>
                <title>Thinking process</title>
                <p>Innovative and creative thinking is the product of DT&#x2019;s ideation. The thinking process closely relates to the Growth Mindset Theory by Dweck
                    <sup>
                        <xref ref-type="bibr" rid="ref-10">10</xref>
                    </sup>. Students with a growing mindset tend to learn through persistence, failure, and different strategies. Additionally, students are able to overcome challenges given to them by practicing and using setbacks as a form of motivation. Implementation of innovative teaching strategies such as collaborative learning, using real-life problems to address issues, and experimentation also contribute to the thinking process
                    <sup>
                        <xref ref-type="bibr" rid="ref-11">11</xref>
                    </sup>. According to the Cambridge Learning Attributes Guide
                    <sup>
                        <xref ref-type="bibr" rid="ref-12">12</xref>
                    </sup>, the thinking process is a powerful tool which not only requires knowledge and understanding of a subject matter but also the students&#x2019; willingness to question it. By ensuring that students are provided with materials that enable them to challenge the subject matter they will be able to express their own understanding and opinions on it.</p>
            </sec>
            <sec>
                <title>Gamifying lessons</title>
                <p>Prototyping in DT leads to a new form of learning, which in this context refers to gamification. Gamifying lessons enables teachers to establish a casual learning environment whereby students are able to challenge themselves via fun online games
                    <sup>
                        <xref ref-type="bibr" rid="ref-13">13</xref>
                    </sup>. According to Hakak 
                    <italic toggle="yes">et al</italic>.
                    <sup>
                        <xref ref-type="bibr" rid="ref-14">14</xref>
                    </sup>, students are given tasks or &#x201c;missions&#x201d; with varying levels of difficulty and they are required to complete them within a short time frame. They are also given the chance to repeat the &#x201c;mission&#x201d; if they fail to achieve the goal. This allows students to analyse and correct the mistakes made, which in turn encourages them to build a positive attitude towards learning
                    <sup>
                        <xref ref-type="bibr" rid="ref-15">15</xref>
                    </sup>. Eleftheria 
                    <italic toggle="yes">et al</italic>.
                    <sup>
                        <xref ref-type="bibr" rid="ref-16">16</xref>
                    </sup> believe that the use of gamification provides students with a comprehensive understanding of the subject being taught and it increases their engagement and enjoyment in the learning process.</p>
            </sec>
            <sec>
                <title>Curriculum enhancement</title>
                <p>Curriculum enhancement is the product of testing from DT. The materials provided in an enhanced curriculum should allow students to deeply reflect the topic at hand and provide them with the opportunities to make connections between other subjects and topics as well
                    <sup>
                        <xref ref-type="bibr" rid="ref-12">12</xref>
                    </sup>. Additionally, the curriculum should look beyond testing. Assessments in the form of evaluating students&#x2019; points of view and their observations are important as this shows the process of their progression
                    <sup>
                        <xref ref-type="bibr" rid="ref-17">17</xref>
                    </sup>. Teachers are also advised to consider implementing more group work and interactive lessons which builds on what students already know. From there, students are able to apply existing knowledge and add value to new knowledge.</p>
                <p>As such, this paper aims to answer the following research questions:</p>
                <list list-type="bullet">
                    <list-item>
                        <label>1.</label>
                        <p>Is there a relationship between DT and innovative delivery of teaching content in schools, specifically using the stage called empathy?</p>
                    </list-item>
                    <list-item>
                        <label>2.</label>
                        <p>In addition to DT and empathy, what role does new thinking process, curriculum enhancement and gamification of lessons play towards similar aspirations?</p>
                    </list-item>
                </list>
                <p>Hence, the fulcrum of the study&#x2019;s objectives is:</p>
                <list list-type="bullet">
                    <list-item>
                        <label>1.</label>
                        <p>To determine if DT in the form of empathy leads to innovative delivery of curriculum.</p>
                    </list-item>
                    <list-item>
                        <label>2.</label>
                        <p>To examine if DT can lead to new forms of thinking processes, gamified lessons and curriculum enhancement,thus leading to innovative delivery of curriculum.</p>
                    </list-item>
                </list>
            </sec>
        </sec>
        <sec sec-type="methods">
            <title>Methods</title>
            <p>This research is purely quantitative whereby online survey was used as a means of data collection. 
                <xref ref-type="table" rid="T2">Table 2</xref> depicts the design elements used for this study. Questionnaires were carefully prepared with the anonymity of the respondents safe guarded (
                <ext-link ext-link-type="uri" xlink:href="https://figshare.com/articles/dataset/SPSS_Survey_Data_for_Enhancing_Innovative_Delivery_Using_Design_Thinking/14871879">See underlying data</ext-link>)
                <sup>
                    <xref ref-type="bibr" rid="ref-18">18</xref>
                </sup>. This was ensured as no personal data identifiers were collected. Additionally, an ethics approval was obtained before recruiting participants for the survey. From primary and secondary Malaysian schools, 200 teachers were invited to participate, however only 131 teachers responded. 61 respondents were primary school teachers and 70 respondents were secondary school teachers. The items were adopted and adapted from various theories and previous studies conducted by Mueller and Dweck
                <sup>
                    <xref ref-type="bibr" rid="ref-8">8</xref>
                </sup>, Dweck
                <sup>
                    <xref ref-type="bibr" rid="ref-10">10</xref>
                </sup>, Hakak 
                <italic toggle="yes">et al</italic>.
                <sup>
                    <xref ref-type="bibr" rid="ref-14">14</xref>
                </sup>, Eleftheria 
                <italic toggle="yes">et al</italic>.
                <sup>
                    <xref ref-type="bibr" rid="ref-16">16</xref>
                </sup> and Gipps
                <sup>
                    <xref ref-type="bibr" rid="ref-17">17</xref>
                </sup>. They were measured using the 5-point Likert scale, ranging from strongly disagree (1 points) to strongly agree (5 points). The odd Likert scale to give the survey respondents a choice to respond neutrally, was included. This was done to obtain evidence about a theme by adding a neutral response option for the respondents to select, should they refrain from selecting an answer from the two extreme choices. The scale offers five answer options. 
                <xref ref-type="table" rid="T2">Table 2</xref> depicts the research design components and their respective rationalizations.</p>
            <table-wrap id="T2" orientation="portrait" position="anchor">
                <label>Table 2. </label>
                <caption>
                    <title>Research design elements.</title>
                </caption>
                <table content-type="article-table" frame="hsides">
                    <thead>
                        <tr>
                            <th align="center" colspan="1" rowspan="1" valign="top">Research Design
                                <break/>Component</th>
                            <th align="center" colspan="1" rowspan="1" valign="top">Description</th>
                            <th align="center" colspan="1" rowspan="1" valign="top">Rationalisation</th>
                        </tr>
                    </thead>
                    <tbody>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Nature of Study</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Exploratory</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">The premise of this research is to determine whether design thinking leads to innovative delivery of
                                <break/>lessons, especially in primary and secondary schools in Malaysia, as there is inadequate research in
                                <break/>this particular domain of study.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Role of Theory</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">To test the
                                <break/>theory</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">A deductive approach was employed for this study to test the hypothetical framework, namely the
                                <break/>role of empathy, thinking process, curriculum enhancement and gamifying lessons in enhancing
                                <break/>innovative delivery.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Sampling Process</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Purposive
                                <break/>sampling</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">A list of all primary and secondary public schools under the Ministry of Education Malaysia was attained
                                <break/>by the researchers. The schools for this research were chosen based on Excel's RAND (random)
                                <break/>function. The contact information of the teachers from the selected schools were attained from the
                                <break/>National Union of the Teaching Profession (NUTP) as well as from the headmasters of those schools. </td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Data Collection
                                <break/>Technique</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Surveys</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">Due to the current COVID-19 outbreak, the questionnaire was prepared using Google Forms and
                                <break/>was distributed to the primary and secondary public-school teachers via email, WhatsApp, and social
                                <break/>media. A minimum of 129 respondents are required as per the G*Power analysis, 131 responses
                                <break/>were collected at the end of the data collection period of one month. After data cleaning was
                                <break/>conducted, there were no representation of teachers from the states of Perlis and Johore as well as
                                <break/>the Federal Territory of Labuan. The teachers were not reachable/contactable due to the Movement
                                <break/>Control Order (MCO) implemented by the government of Malaysia to curb the spread of COVID-19.
                                <break/>Thus, there were no representatives from these states.</td>
                        </tr>
                        <tr>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Researcher
                                <break/>Interference</td>
                            <td align="left" colspan="1" rowspan="1" valign="middle">Minimal</td>
                            <td align="left" colspan="1" rowspan="1" valign="top">There was minimal interference to the work nature and teacher activities by the researchers during
                                <break/>the distribution and collection of questionnaires.</td>
                        </tr>
                    </tbody>
                </table>
            </table-wrap>
        </sec>
        <sec>
            <title>Data analysis</title>
            <p>The data for this study was analysed using the 
                <ext-link ext-link-type="uri" xlink:href="https://www.smartpls.com/smartpls2/download">SmartPLS 3 software</ext-link> as it is able to perform analyses of inter-relationships between variables, whereby single or multiple regressions can be stated.</p>
            <sec>
                <title>Measurement model evaluation</title>
                <p>The measurement model evaluation is required to affirm the reliability and validity of the research model. The data attained from the questionnaires (
                    <ext-link ext-link-type="uri" xlink:href="https://figshare.com/articles/dataset/SPSS_Survey_Data_for_Enhancing_Innovative_Delivery_Using_Design_Thinking/14871879">See underlying data</ext-link>)
                    <sup>
                        <xref ref-type="bibr" rid="ref-18">18</xref>
                    </sup> were used to structure the measurement model of this study (
                    <xref ref-type="fig" rid="f1">Figure 1</xref>)</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>Figure 1. </label>
                    <caption>
                        <title>Measurement model depicting the latent variables and their respective indicators.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/114839/e6b112a3-bd3a-4e8e-a1ab-71b09f176ef6_figure1.gif"/>
                </fig>
                <p>Indicator reliability is assessed by ensuring that the factor loadings for each item is above 0.708. However, there is a satisfactory threshold whereby the values of each item do not necessarily have to be above 0.708. 
                    <xref ref-type="table" rid="T3">Table 3</xref> affirms that the loadings for the majority of items fall within the satisfactory value, thus indicator reliability is present. Internal consistency reliability is determined by the composite reliability (CR). As depicted in 
                    <xref ref-type="table" rid="T2">Table 2</xref>, the CR values for each construct are well above the 0.70 threshold, hence this affirms that the internal consistency reliability is satisfactory. Convergent validity is determined by the Average Variance Extracted (AVE). The AVE values for each construct must be above 0.50. The AVE for each construct in 
                    <xref ref-type="table" rid="T2">Table 2</xref> is well above 0.50 and this signifies a satisfactory level of convergent validity for the study.</p>
                <table-wrap id="T3" orientation="portrait" position="anchor">
                    <label>Table 3. </label>
                    <caption>
                        <title>Factor loadings, Average Variance Extracted and composite reliability of each construct.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="center" colspan="1" rowspan="1" valign="top">Constructs</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Items</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Loadings</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">AVE</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">CR</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Curriculum Enhancement</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">CE1</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.647</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.503</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.833</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">CE2</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.744</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">CE3</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.812</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">CE4</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.724</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">CE5</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.598</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Empathy</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">E1</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.704</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.528</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.846</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">E2</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.541</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">E3</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.774</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">E4</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.755</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">E5</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.825</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Gamifying Lessons</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">GL1</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.734</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.658</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.885</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">GL2</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.831</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">GL3</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.852</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">GL4</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.823</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Thinking Process</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">TP1</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.839</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.595</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.853</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">TP2</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.747</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">TP3</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.831</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">TP4</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.652</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Innovative Delivery</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">ID1</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.659</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.58</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.873</td>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">ID2</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.777</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">ID3</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.776</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle">ID4</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.764</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle"> </td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">ID5</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.823</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"> </td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"> </td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <fn>
                            <p>AVE: Average Variance Extracted; CR: Composite Reliability</p>
                        </fn>
                    </table-wrap-foot>
                </table-wrap>
                <p>Discriminant validity is evaluated according to the Fornell and Larcker criterion, whereby an item must show a stronger loading on its own construct when compared to other constructs. 
                    <xref ref-type="table" rid="T4">Table 4</xref> affirms that each item has a stronger loading on its own construct, therefore, discriminant validity is fulfilled.</p>
                <table-wrap id="T4" orientation="portrait" position="anchor">
                    <label>Table 4. </label>
                    <caption>
                        <title>Discriminant validity matrix.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="center" colspan="1" rowspan="1" valign="top">Constructs</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">1</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">2</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">3</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">4</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">5</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Curriculum Enhancement</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.709</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Empathy</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.623</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.726</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Gamifying Lessons</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.540</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.483</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.811</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Innovative Delivery</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.684</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.595</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.666</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.762</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle"/>
                            </tr>
                            <tr>
                                <td align="center" colspan="1" rowspan="1" valign="middle">Thinking Process</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.701</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.697</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.492</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.657</td>
                                <td align="center" colspan="1" rowspan="1" valign="middle">0.771</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
            </sec>
            <sec>
                <title>Structural model evaluation</title>
                <p>The structural model evaluation is conducted to determine whether the hypotheses are supported by the data attained from the analysis. The structural model depicted in 
                    <xref ref-type="fig" rid="f2">Figure 2</xref> is attained after a non-parametric bootstrapping using a sample of 5,000 was conducted. Before assessing the path coefficient of this study, the coefficient of determination (R
                    <sup>2</sup>) is explained. The value of R
                    <sup>2</sup> for this study is 0.627, which falls under the moderate category. This means that 62.7% of the total variance in Innovative Delivery is explained by Empathy, Thinking Process, Curriculum Enhancement and Gamifying Lessons.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>Figure 2. </label>
                    <caption>
                        <title>Structural model attained after evaluating the measurement model.</title>
                    </caption>
                    <graphic orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/114839/e6b112a3-bd3a-4e8e-a1ab-71b09f176ef6_figure2.gif"/>
                </fig>
                <p>The path coefficient for this study is depicted in 
                    <xref ref-type="table" rid="T5">Table 5</xref>. For the beta value to make an impact to the research model, the value must be at least 0.1 whereas the t-statistic has to be greater than 1.645 in order for it to be significant. 
                    <xref ref-type="table" rid="T3">Table 3</xref> confirms that curriculum enhancement, gamifying lessons and thinking process have a significant positive influence in enhancing innovative delivery. However, empathy does not have a significant positive influence in enhancing innovative delivery.</p>
                <table-wrap id="T5" orientation="portrait" position="anchor">
                    <label>Table 5. </label>
                    <caption>
                        <title>Beta value, t-statistics, p-value, and hypothesis decision.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="center" colspan="1" rowspan="1" valign="top">Constructs</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Beta</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">T-Statistic</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">P-Value</th>
                                <th align="center" colspan="1" rowspan="1" valign="top">Decision</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Curriculum Enhancement --&gt; Innovative Delivery</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.268</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.842</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.005</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">Supported</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Empathy --&gt; Innovative Delivery</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.108</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.962</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.336</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">Not Supported</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Gamifying Lessons --&gt; Innovative Delivery</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.396</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">3.917</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.000</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">Supported</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="top">Thinking Process --&gt; Innovative Delivery</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.204</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">2.116</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">0.034</td>
                                <td align="center" colspan="1" rowspan="1" valign="top">Supported</td>
                            </tr>
                        </tbody>
                    </table>
                    <table-wrap-foot>
                        <fn>
                            <p>T-value significant at &#x2265;1.645; P-value is significant at &lt; 0.05</p>
                        </fn>
                    </table-wrap-foot>
                </table-wrap>
            </sec>
        </sec>
        <sec sec-type="discussion | conclusion">
            <title>Discussion and conclusion</title>
            <p>The study showed that the thinking process, gamifying lessons, and curriculum enhancement have positive significance for innovative delivery. However, the variable empathy was not supported and did not show a positive significant relationship. The absence of empathy among teachers can affect the educational process adversely. Empathy is a method of associating with others that shows you can comprehend that they are encountering something significant, even though you may not understand precisely how it feels for them
                <sup>
                    <xref ref-type="bibr" rid="ref-19">19</xref>
                </sup>. Empathy is an essential advantage that can assist teachers by enhancing the driving factors on students&#x2019; behaviour. Thus, the link between teachers&#x2019; empathy and innovative teaching is essential and since the hypothesis for this study pertaining to empathy is not supported, it means that the Malaysian teachers who participated in this study predominantly lack empathy, which indirectly creates a large gap or power distance between students and the teachers themselves. Additionally, it affects the learning experience of the students as well. This could provide insights to the Malaysian Ministry of Education to equip teachers with Design Thinking and other skills that leads to constant evolution and innovation in delivering these dry and boring topics. The current pandemic has made students more productive, independent, and proactive in being responsible for their learning. As such, the overall results of the Sijil Pelajaran Malaysia (SPM) 2020 or the Malaysian Certificate of Education, which is a national examination taken by all fifth-form secondary school students in Malaysia. have shown a sharp rise in passing and grades as compared to previous years
                <sup>
                    <xref ref-type="bibr" rid="ref-20">20</xref>
                </sup>. This also indicates that teachers are no longer seen as mere content providers and knowledge givers, but as facilitators and support during difficult times. The lack of empathy among teachers must be addressed if teachers are exposed to DT workshops during their formal training and periodically as part of their learning development programme. The outcome of this study shows the aspects which need to be addressed by the Ministry of Education as well as the teachers in Malaysia. In addition, the outcome of this study may also assist in producing teachers who are well rounded in terms of mastering various teaching skills.</p>
        </sec>
        <sec>
            <title>Ethics approval</title>
            <p>The Research Ethics Committee (REC) of Multimedia University has granted the ethics approval for this research with the approval number EA2232021. </p>
        </sec>
        <sec>
            <title>Data availability</title>
            <sec>
                <title>Underlying data</title>
                <p>Figshare: Enhancing innovative delivery in schools using design thinking</p>
                <p>DOI: 
                    <ext-link ext-link-type="uri" xlink:href="https://figshare.com/articles/dataset/SPSS_Survey_Data_for_Enhancing_Innovative_Delivery_Using_Design_Thinking/14871879">10.6084/m9.figshare.14871879</ext-link>
                    <sup>
                        <xref ref-type="bibr" rid="ref-18">18</xref>
                    </sup>.</p>
                <p>This project contains the following underlying data:</p>
                <p>Data file 1. The data attained from the questionnaire. This file is to be opened using the SPSS software.</p>
                <p>Data file 2. Questionnaire used for this research.</p>
                <p>Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/publicdomain/zero/1.0/">Creative Commons Zero "No rights reserved" data waiver</ext-link> (CC0 1.0 Public domain dedication).</p>
            </sec>
        </sec>
    </body>
    <back>
        <ack>
            <title>Acknowledgments</title>
            <p>The authors would like to express their gratitude towards the respondents (teachers) who participated in the survey.</p>
        </ack>
        <ref-list>
            <ref id="ref-1">
                <label>1</label>
                <mixed-citation publication-type="journal">
                    <collab>Oxford University Press</collab>:
                    <article-title>Design.</article-title>Retrieved from Lexico:<year>2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.lexico.com/definition/design">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-2">
                <label>2</label>
                <mixed-citation publication-type="journal">
                    <collab>Oxford University Press</collab>:
                    <article-title>Thinking</article-title>. Retrieved from Lexico:<year>2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.lexico.com/definition/thinking">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-3">
                <label>3</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Naiman</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <article-title>Design Thinking as a Strategy for Innovation.</article-title>Retrieved from The European Business Review:<year>2019</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.europeanbusinessreview.com/design-thinking-as-a-strategy-for-innovation/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-4">
                <label>4</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Meinel</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Leifer</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Plattner</surname>
                            <given-names>H</given-names>
                        </name>
</person-group>:
                    <article-title>Design Thinking: Understand-Improve-Apply.</article-title>Heidelberg: Springer,<year>2011</year>.
                    <pub-id pub-id-type="doi">10.1007/978-3-642-13757-0</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-5">
                <label>5</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Diefenthaler</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Moorhead</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Speicher</surname>
                            <given-names>S</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Thinking &amp; Acting Like a Designer: How design thinking supports innovation in K-12 education. Annette Diefenthaler Laura Moorhead Sandy Speicher Charla Bear Deirdre Cerminaro RR.1.2017</article-title>. World Innovation Summit for Education,<year>2017</year>.</mixed-citation>
            </ref>
            <ref id="ref-6">
                <label>6</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Parker</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Cruz</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gachago</surname>
                            <given-names>D</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Design Thinking for Challenges and Change in K&#x2013;12 and Teacher Education.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Cases in Educational Leadership.</italic>
</source>
                    <year>2020</year>;<volume>24</volume>(<issue>1</issue>):<fpage>3</fpage>&#x2013;<lpage>14</lpage>.
                    <pub-id pub-id-type="doi">10.1177/1555458920975467</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-7">
                <label>7</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Warren</surname>
                            <given-names>CA</given-names>
                        </name>
</person-group>:
                    <article-title>Empathy, Teacher Dispositions, and Preparation for Culturally Responsive Pedagogy.</article-title>
                    <source>

                        <italic toggle="yes">J Teach Educ.</italic>
</source>
                    <year>2017</year>;<volume>69</volume>(<issue>2</issue>):<fpage>169</fpage>&#x2013;<lpage>183</lpage>.
                    <pub-id pub-id-type="doi">10.1177/0022487117712487</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-8">
                <label>8</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mueller</surname>
                            <given-names>CM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dweck</surname>
                            <given-names>CS</given-names>
                        </name>
</person-group>:
                    <article-title>Praise for intelligence can undermine children's motivation and performance.</article-title>
                    <source>

                        <italic toggle="yes">J Pers Soc Psychol. </italic>
</source>
                    <year>1998</year>;<volume>75</volume>(<issue>1</issue>):<fpage>33</fpage>&#x2013;<lpage>52</lpage>.
                    <pub-id pub-id-type="pmid">9686450</pub-id>
                    <pub-id pub-id-type="doi">10.1037//0022-3514.75.1.33</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-9">
                <label>9</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Burnett</surname>
                            <given-names>PC</given-names>
                        </name>
</person-group>:
                    <article-title>Teacher Praise and Feedback and Students' Perceptions of the Classroom Environment.</article-title>
                    <source>

                        <italic toggle="yes">Educational Psychology: An International Journal of Experimental Educational Psychology.</italic>
</source>
                    <year>2002</year>;<volume>22</volume>(<issue>1</issue>):<fpage>5</fpage>&#x2013;<lpage>16</lpage>.
                    <pub-id pub-id-type="doi">10.1080/01443410120101215</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-10">
                <label>10</label>
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Dweck</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>Mindset: The New Psychology of Success.</article-title>New York: Ballantine Books,<year>2007</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://psylearners.psychotechservices.com/2018/07/mindset-new-psychology-of-success-book.html">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-11">
                <label>11</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Anderson</surname>
                            <given-names>RT</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Neri</surname>
                            <given-names>L</given-names>
                        </name>
</person-group>:
                    <article-title>Reliability-Centered Maintenance: Management and Engineering Methods.</article-title>Essex: Elsevier Science Publishers Ltd,<year>1990</year>.
                    <pub-id pub-id-type="doi">10.1007/978-94-009-0757-7</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-12">
                <label>12</label>
                <mixed-citation publication-type="book">
                    <collab>Cambridge</collab>:
                    <article-title>Developing the Cambridge learner attributes.</article-title>Retrieved from Cambridge International:<year>2011</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.cambridgeinternational.org/support-and-training-for-schools/teaching-cambridge-at-your-school/cambridge-learner-attributes/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-13">
                <label>13</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gopinathan</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Raman</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Subbarao</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The Role of Blended Learnning Technologies in Enhancing Student Engagement in Theory Dominant Subjects.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Creative Multimedia.</italic>
</source>
                    <year>2020</year>;<volume>1</volume>(<issue>1</issue>):<fpage>64</fpage>&#x2013;<lpage>69</lpage>.
                    <pub-id pub-id-type="doi">10.33093/ijcm.2020.1.X1.6</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-14">
                <label>14</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hakak</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Noor</surname>
                            <given-names>NFM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ayub</surname>
                            <given-names>MN</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Cloud-assisted gamification for education and learning &#x2013; Recent advances and challenges.</article-title>
                    <source>

                        <italic toggle="yes">Computers &amp; Electrical Engineering.</italic>
</source>
                    <year>2019</year>;<volume>74</volume>:<fpage>22</fpage>&#x2013;<lpage>34</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.compeleceng.2019.01.002 </pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-15">
                <label>15</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nah</surname>
                            <given-names>FFH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zeng</surname>
                            <given-names>Q</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Telaprolu</surname>
                            <given-names>VR</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Gamification of Education: A Review of Literature.</article-title>
                    <source>

                        <italic toggle="yes">International Conference on HCI in Business.</italic>
</source>
                    <year>2014</year>;<volume>8527</volume>:<fpage>401</fpage>&#x2013;<lpage>409</lpage>.
                    <pub-id pub-id-type="doi">10.1007/978-3-319-07293-7_39</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-16">
                <label>16</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Eleftheria</surname>
                            <given-names>CA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Charikleia</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Iason</surname>
                            <given-names>CG</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>An innovative augmented reality educational platform using Gamification to enhance lifelong learning and cultural education</article-title>.
                    <italic toggle="yes">IISA 2013: Fourth International Conference on Information, Intelligence, Systems and Applications.</italic>Piraeus: Institute of Electrical and Electronics Engineers (IEEE),<year>2013</year>.
                    <pub-id pub-id-type="doi">10.1109/IISA.2013.6623724</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-17">
                <label>17</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gipps</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>Beyond Testing: Towards a Theory of Educational Assessment.</article-title>London: Routledge,<year>2011</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.routledge.com/Beyond-Testing-Classic-Edition-Towards-a-theory-of-educational-assessment/Gipps/p/book/9780415689564">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-18">
                <label>18</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Gopinathan</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kaur</surname>
                            <given-names>AH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ramasamy</surname>
                            <given-names>RK</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>SPSS Survey Data for Enhancing Innovative Delivery Using Design Thinking</article-title>.
                    <source>

                        <italic toggle="yes">figshare.</italic>
</source>Dataset.<year>2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="http://www.doi.org/10.6084/m9.figshare.14871879.v1">http://www.doi.org/10.6084/m9.figshare.14871879.v1</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref-19">
                <label>19</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Peck</surname>
                            <given-names>NF</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Maude</surname>
                            <given-names>SP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Brotherson</surname>
                            <given-names>MJ</given-names>
                        </name>
</person-group>:
                    <article-title>Understanding preschool teachers&#x2019; perspectives on empathy: A qualitative inquiry.</article-title>
                    <source>

                        <italic toggle="yes">Early Child Educ J.</italic>
</source>
                    <year>2015</year>;<volume>43</volume>(<issue>3</issue>):<fpage>169</fpage>&#x2013;<lpage>79</lpage>.
                    <pub-id pub-id-type="doi">10.1007/s10643-014-0648-3</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref-20">
                <label>20</label>
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chung</surname>
                            <given-names>N</given-names>
                        </name>
</person-group>:
                    <article-title>2020 SPM results best in past 5 years.</article-title>Retrieved from Free Malaysia Today,<year>2021</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.freemalaysiatoday.com/category/nation/2021/06/10/2020-spm-results-best-in-past-5-years/">Reference Source</ext-link>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report119249">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.114839.r119249</article-id>
            <title-group>
                <article-title>Reviewer response for version 3</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Carvalho</surname>
                        <given-names>Paulo SIme&#x00e3;o</given-names>
                    </name>
                    <xref ref-type="aff" rid="r119249a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-5381-955X</uri>
                </contrib>
                <aff id="r119249a1">
                    <label>1</label>Physics and Astronomy Department, Science Education Unit, Faculty of Sciences, University of Porto, Porto, Portugal</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>11</day>
                <month>1</month>
                <year>2022</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2022 Carvalho PS</copyright-statement>
                <copyright-year>2022</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport119249" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.72860.3"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>I have no further comments to make concerning this paper. In my point of view, it is now approved for indexing.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Physics education</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report101527">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.79753.r101527</article-id>
            <title-group>
                <article-title>Reviewer response for version 2</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Carvalho</surname>
                        <given-names>Paulo SIme&#x00e3;o</given-names>
                    </name>
                    <xref ref-type="aff" rid="r101527a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-5381-955X</uri>
                </contrib>
                <aff id="r101527a1">
                    <label>1</label>Physics and Astronomy Department, Science Education Unit, Faculty of Sciences, University of Porto, Porto, Portugal</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>15</day>
                <month>12</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Carvalho PS</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport101527" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.72860.2"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The authors improved the content of the paper&#x00a0;a lot by making adequate changes to the text.</p>
            <p> </p>
            <p> However, I still find some items that must be clarified (page numbers refer to the pdf version of the article). 
                <list list-type="bullet">
                    <list-item>
                        <p>Page 5, right column, line 20: still concerning the statement &#x201c;alpha level of 0.05&#x201d;. If this information concerns a significance level as the authors claim, then the legend of Table 5 should mention it. Moreover, this alpha level is not introduced or explained in the text, so additional information is lacking.</p>
                    </list-item>
                    <list-item>
                        <p>Page 8, left column, line 3-6: although the sentence &#x201c;Students don&#x2019;t feel attracted to the old method of teaching, as such based on the lack of empathy and inadequacy of skills to innovate delivery make it even worse&#x201d; has been introduced to improve the writing. it sounds strange and confusing. Authors must rewrite it carefully to clarify what they want to say.</p>
                    </list-item>
                </list> </p>
            <p> Minor changes: 
                <list list-type="bullet">
                    <list-item>
                        <p>Abstract, line 23: instead of &#x201c;The study showed&#x201d; I suggest &#x201c;It shows&#x201d;, because the words &#x201c;The study&#x201d; are repeated twice very closely.</p>
                    </list-item>
                    <list-item>
                        <p>Page 8, left column, line 6-7: the sentence &#x201c;Ministry of Education Malaysia&#x201d; should be changed to Malaysian Ministry of Education.</p>
                    </list-item>
                </list> In conclusion:</p>
            <p> </p>
            <p> I believe the paper is interesting for discussion about the influence of several parameters to innovative delivery in schools, taking for a particular example primary and secondary teachers of Malaysia.</p>
            <p> </p>
            <p> I think some minor but important issues should be clarified by the authors, before I can approve the paper for indexing.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>NA</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment7593-101527">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Gopinathan</surname>
                            <given-names>Sharmini</given-names>
                        </name>
                        <aff>Multimedia University, Malaysia</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>17</day>
                    <month>12</month>
                    <year>2021</year>
                </pub-date>
            </front-stub>
            <body>
                <p>(Page numbers refer to the pdf version of the article)</p>
                <p> </p>
                <p> 1. Page 5, right column, line 20: still concerning the statement &#x201c;alpha level of 0.05&#x201d;. If this information concerns a significance level as the authors claim, then the legend of Table 5 should mention it. Moreover, this alpha level is not introduced or explained in the text, so additional information is lacking.</p>
                <p> </p>
                <p> 
                    <italic>- Since the alpha level is not introduced/explained in the text, we have decided to remove it. The statement has been changed to &#x201c;the t-statistic has to be greater than 1.645&#x201d; (in order to maintain consistency just like the statement mentioning the beta value).</italic>
                </p>
                <p>
                    <italic> &#x00a0;</italic>
                </p>
                <p> 2. Page 8, left column, line 3-6: although the sentence &#x201c;Students don&#x2019;t feel attracted to the old method of teaching, as such based on the lack of empathy and inadequacy of skills to innovate delivery make it even worse&#x201d; has been introduced to improve the writing. it sounds strange and confusing. Authors must rewrite it carefully to clarify what they want to say.</p>
                <p> </p>
                <p> 
                    <italic>- We meant to say that the lack of empathy from the teachers who participated in the survey affects the learning experience of the students as well (apart from it indirectly creating a large gap/power distance between students and teachers). Thus, we have reworded it to say:</italic>
                </p>
                <p> 
                    <italic>&#x201c;Thus, the link between teachers&#x2019; empathy and innovative teaching is essential and since the hypothesis for this study pertaining to empathy is not supported, it means that the Malaysian teachers who participated in this study predominantly lack empathy, which indirectly creates a large gap or power distance between students and the teachers themselves. Additionally, it affects the learning experience of the students as well.&#x201d;</italic>
                </p>
                <p> </p>
                <p> 3.&#x00a0;Abstract, line 23: instead of &#x201c;The study showed&#x201d; I suggest &#x201c;It shows&#x201d;, because the words &#x201c;The study&#x201d; are repeated twice very closely.</p>
                <p> </p>
                <p> 
                    <italic>- We have amended it, as recommended.</italic>
                </p>
                <p>
                    <italic> &#x00a0;</italic>
                </p>
                <p> 4. Page 8, left column, line 6-7: the sentence &#x201c;Ministry of Education Malaysia&#x201d; should be changed to Malaysian Ministry of Education.</p>
                <p> </p>
                <p> 
                    <italic>- We have amended it, as recommended.</italic>
                </p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report101528">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.79753.r101528</article-id>
            <title-group>
                <article-title>Reviewer response for version 2</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Samsudin</surname>
                        <given-names>Achmad</given-names>
                    </name>
                    <xref ref-type="aff" rid="r101528a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-3564-6031</uri>
                </contrib>
                <aff id="r101528a1">
                    <label>1</label>Department of Physics Education, Universitas Pendidikan Indonesia, Bandung, Indonesia</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>3</day>
                <month>12</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Samsudin A</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport101528" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.72860.2"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>It's according to the suggestion.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Science education, conception, conceptual change, misconception in physics, development of models, media, and instruments</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report95938">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.76468.r95938</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Samsudin</surname>
                        <given-names>Achmad</given-names>
                    </name>
                    <xref ref-type="aff" rid="r95938a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0003-3564-6031</uri>
                </contrib>
                <aff id="r95938a1">
                    <label>1</label>Department of Physics Education, Universitas Pendidikan Indonesia, Bandung, Indonesia</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>15</day>
                <month>11</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Samsudin A</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport95938" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.72860.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>
                <underline>Abstract</underline>
            </p>
            <p> </p>
            <p> Explain in the abstract section the research questions used and the result.</p>
            <p> Describe the number of teachers for each school (primary and secondary schools).</p>
            <p> Describe what survey instruments were used? Open/close-ended, how many questions, using a Likert scale or something like that, etc.</p>
            <p> </p>
            <p> 
                <underline>Introduction</underline>
            </p>
            <p> </p>
            <p> Is there any previous research that discusses something similar? And what is the novelty of this research? Explain in this section.</p>
            <p> Add citations for your opinion. Is it necessary to use innovative delivery to benefit from learning outcomes?</p>
            <p> In the fulcrum of the study&#x2019;s objectives, this section should serve as an answer to a research question, but why are the numbers different? It should only be the same number of research questions.</p>
            <p> </p>
            <p> 
                <underline>Methods</underline>
            </p>
            <p> </p>
            <p> Put the design in the abstract.</p>
            <p> For respondents, describe the number of teachers for each school (primary and secondary schools).</p>
            <p> Explain why the&#x00a0;
                <ext-link ext-link-type="uri" xlink:href="https://www.smartpls.com/smartpls2/download">SmartPLS 3 software</ext-link>&#x00a0;is used in this study. If necessary add citations to strengthen it.</p>
            <p> Note in Table 1, there are 5 DT Phases (of course this section is an indicator in this study). However, why in Figure 1 do only 4 of the 5 phases exist? The missing piece is "Prototype", why is that?</p>
            <p> Same for Figure 2,&#x00a0;why do only 4 of the 5 phases exist? The missing piece is "Prototype", why is that?</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Yes</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Yes</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Science education, conception, conceptual change, misconception in physics, development of models, media, and instruments</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment7489-95938">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Gopinathan</surname>
                            <given-names>Sharmini</given-names>
                        </name>
                        <aff>Multimedia University, Malaysia</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>23</day>
                    <month>11</month>
                    <year>2021</year>
                </pub-date>
            </front-stub>
            <body>
                <p>
                    <bold>
                        <underline>Abstract</underline>
                    </bold>
                </p>
                <p> </p>
                <p> 1.&#x00a0;Explain in the abstract section the research questions used and the result.</p>
                <p> </p>
                <p> 
                    <italic>- Included in the abstract, as recommended.</italic>
                </p>
                <p> </p>
                <p> 2. Describe the number of teachers for each school (primary and secondary schools).</p>
                <p> </p>
                <p> 
                    <italic>- The number of teachers for each school has been added, as recommended. 61 of the respondents are primary school teachers and 70 of the respondents are secondary school teachers.</italic>
                </p>
                <p> </p>
                <p> 3. Describe what survey instruments were used? Open/close-ended, how many questions, using a Likert scale or something like that, etc.</p>
                <p> </p>
                <p> 
                    <italic>- The description of the instrument has been added. Questionnaire was used and there were 23 close-ended questions. A 5-point Likert scale was used.</italic>
                </p>
                <p> </p>
                <p> 
                    <bold>
                        <underline>Introduction</underline>
                    </bold>
                </p>
                <p> </p>
                <p> 1.&#x00a0;Is there any previous research that discusses something similar? And what is the novelty of this research? Explain in this section. Add citations for your opinion.</p>
                <p> </p>
                <p> 
                    <italic>- We have included an explanation about DT in the education context, specifically in schools, whereby there is limited empirical research.</italic>
                </p>
                <p> </p>
                <p> 2. Is it necessary to use innovative delivery to benefit from learning outcomes?</p>
                <p> </p>
                <p> 
                    <italic>- Yes, this is much needed in the Malaysian context, especially with the sudden transition from face-to-face teaching to online teaching due to the pandemic. Teachers and schools are finding new and innovative ways to deliver their learning outcomes.</italic>
                    <italic> &#x00a0;</italic>
                </p>
                <p> </p>
                <p> 3.&#x00a0;In the fulcrum of the study&#x2019;s objectives, this section should serve as an answer to a research question, but why are the numbers different? It should only be the same number of research questions.</p>
                <p> </p>
                <p> 
                    <italic>- We have amended the research objectives to suit the research questions. The research objectives are as follows:</italic> 
                    <list list-type="bullet">
                        <list-item>
                            <p>
                                <bold>
                                    <italic>1.</italic>
                                </bold>
                                <italic> To determine if DT in the form of empathy leads to innovative delivery of curriculum.</italic>
                            </p>
                        </list-item>
                        <list-item>
                            <p>
                                <bold>
                                    <italic>2.</italic>
                                </bold>
                                <italic> To examine if DT can lead to new forms of thinking processes, gamified lessons and curriculum enhancement, thus leading to innovative delivery of curriculum.</italic>
                            </p>
                        </list-item>
                    </list> </p>
                <p> 
                    <bold>
                        <underline>Methods</underline>
                    </bold>
                </p>
                <p> </p>
                <p> 1.&#x00a0;Put the design in the abstract.</p>
                <p> </p>
                <p> 
                    <italic>- Added. Included the use of questionnaire, number of questions and the Likert scale used.</italic>
                </p>
                <p> </p>
                <p> 2. For respondents, describe the number of teachers for each school (primary and secondary schools).</p>
                <p> </p>
                <p> 
                    <italic>- The number of teachers for each school have been added, as recommended. 61 of the respondents are primary school teachers and 70 of the respondents are secondary school teachers.</italic>
                </p>
                <p> </p>
                <p> 3. Explain why the SmartPLS 3 software is used in this study. If necessary add citations to strengthen it.</p>
                <p> </p>
                <p> 
                    <italic>- SmartPLS 3 software was used as it is able to analyse inter-relationships between variables, whereby single/multiple regressions can be stated (Hair et al., 2011).</italic>
                    <italic> </italic>
                </p>
                <p> </p>
                <p> 4. Note in Table 1, there are 5 DT Phases (of course this section is an indicator in this study). However, why in Figure 1 do only 4 of the 5 phases exist? The missing piece is "Prototype", why is that? Same for Figure 2, why do only 4 of the 5 phases exist? The missing piece is "Prototype", why is that?</p>
                <p> </p>
                <p> 
                    <italic>- As per the Introduction section, &#x201c;Prototype&#x201d; falls under the sub-section &#x201c;Gamifying Lessons&#x201d;. We have described it as such: &#x201c;Prototyping in DT leads to a new form of learning, which in this context refers to gamification&#x201d;.</italic>
                </p>
                <p>
                    <italic> </italic>
                </p>
                <p>
                    <italic> 
                        <underline>References&#x00a0;</underline>
                    </italic>
                </p>
                <p> Hair, J. F., Ringle, C. M., &amp; Sarstedt, M. (2011). PLS-SEM: Indeed a silver bullet.&#x00a0;
                    <italic>Journal of Marketing theory and Practice</italic>,&#x00a0;
                    <italic>19</italic>(2), 139-152. DOI:&#x00a0;
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.2753/MTP1069-6679190202">10.2753/MTP1069-6679190202</ext-link>
                </p>
            </body>
        </sub-article>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report95936">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.76468.r95936</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Carvalho</surname>
                        <given-names>Paulo SIme&#x00e3;o</given-names>
                    </name>
                    <xref ref-type="aff" rid="r95936a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-5381-955X</uri>
                </contrib>
                <aff id="r95936a1">
                    <label>1</label>Physics and Astronomy Department, Science Education Unit, Faculty of Sciences, University of Porto, Porto, Portugal</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>26</day>
                <month>10</month>
                <year>2021</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2021 Carvalho PS</copyright-statement>
                <copyright-year>2021</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport95936" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.72860.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The paper describes the role of design thinking that can lead to innovative teaching among teachers. In particular, it presents a study that seeks how several variables such as empathy, thinking process, gamifying lessons and curriculum enhancement, may have positive significance for innovative delivery. The study targeted 131 teachers from primary and secondary schools in Malaysia.</p>
            <p> </p>
            <p> I find this paper has great interest for teachers, although it concerns only Malaysian ones. The case cannot be extrapolated to other countries, but undoubtedly points out to real educational problems that should be seen very seriously by decision makers.</p>
            <p> </p>
            <p> Concerning the sample, it is not clear how many of those 131 teachers were from primary school and secondary school. As far as I know, the teaching goals, the contact hours and the involvement of teachers with their students may not be exactly the same for both categories of teacher, therefore the authors should provide separate analysis for both samples &#x2013; even if, at the end, they conclude the results are equivalent.</p>
            <p> </p>
            <p> There are some issues that could be clarified by the authors (page numbers refer to the pdf version): 
                <list list-type="order">
                    <list-item>
                        <p>In page 3, line 4 (Introduction), left column, the acronym VUCA is not used in the paper. I suggest to remove it, unless there is a specific reason to keep it.</p>
                    </list-item>
                    <list-item>
                        <p>Page 4, line 4, left column: I would say that not only collaborative, but also cooperative learning should be recommended, as the latter involves students in the responsibility for&#x00a0;finding solutions to the problems.</p>
                    </list-item>
                    <list-item>
                        <p>Page 5, line 13, right column: instead of &#x201c;the loadings for each item fall within the satisfactory value&#x201d;, I suggest it should be added "for the majority of items" because as the authors recognize, there are some items that do not fulfill that condition.</p>
                    </list-item>
                    <list-item>
                        <p>Page 4, figure 1, empathy variables: why is the sequence, from top to bottom, different from the other design components? i.e., why not E1; E2; E3; E4; E5 ? The same comment applies to Figure 2.</p>
                    </list-item>
                    <list-item>
                        <p>Page 6, line 12, right column: alpha value, or p-value?</p>
                    </list-item>
                    <list-item>
                        <p>Page 6, line 32-33, right column: the sentence &#x201c;Malaysian teachers in predominantly primary and secondary schools lack empathy&#x201d; is somehow exaggerated. This study is based only in 131 responses, which do not represent, in any way, Malaysian teachers. The authors cannot make such a generalization. This sentence MUST be reformulated to the local validity of this study.</p>
                    </list-item>
                    <list-item>
                        <p>Page 6, line 36-38, right column: I don't see a direct correlation between the results obtained and the conclusion that &#x201c;This situation further enhances inability to deliver dry and uninteresting teaching and learning material&#x201d;. The authors should discuss better how they figure out such a correlation derived from their definition of Empathy. Their extrapolation is very broad and I don't think it has support in this investigation. Perhaps the authors want to rephrase it as a possibility that might occur, but not as an affirmative statement.</p>
                    </list-item>
                    <list-item>
                        <p>Page 6, table 2, line 5: item &#x201c;CE4&#x201d; seems to be &#x201c;CE5&#x201d;.</p>
                    </list-item>
                    <list-item>
                        <p>Finally, the reference list seems adequate to the study reported, and the English is of high quality.</p>
                    </list-item>
                </list> </p>
            <p> In conclusion:</p>
            <p> </p>
            <p> I believe the paper is interesting for discussion about the influence of several parameters to innovative delivery in schools, taking for a particular example primary and secondary teachers in Malaysia. However, some topics could be clarified and generalizations should be avoided because the study is not vast enough.</p>
            <p> </p>
            <p> So, I recommend this paper for indexing, but the authors must correct some errors and clarify the items mentioned first.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Yes</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>I cannot comment. A qualified statistician is required.</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Yes</p>
            <p>Reviewer Expertise:</p>
            <p>Physics education; teacher training in phusics; digital educational resources; experimental work</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
        <sub-article article-type="response" id="comment7488-95936">
            <front-stub>
                <contrib-group>
                    <contrib contrib-type="author">
                        <name>
                            <surname>Gopinathan</surname>
                            <given-names>Sharmini</given-names>
                        </name>
                        <aff>Multimedia University, Malaysia</aff>
                    </contrib>
                </contrib-group>
                <author-notes>
                    <fn fn-type="conflict">
                        <p>
                            <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                    </fn>
                </author-notes>
                <pub-date pub-type="epub">
                    <day>23</day>
                    <month>11</month>
                    <year>2021</year>
                </pub-date>
            </front-stub>
            <body>
                <p>(Page numbers refer to the pdf version of the article)</p>
                <p> </p>
                <p> 1. In page 3, line 4 (Introduction), left column, the acronym VUCA is not used in the paper. I suggest to remove it, unless there is a specific reason to keep it.</p>
                <p> </p>
                <p> 
                    <italic>-The acronym VUCA has been removed as it is not used in the paper.</italic>
                </p>
                <p> 
                    <italic>&#x00a0;</italic>
                </p>
                <p> 2. Page 4, line 4, left column: I would say that not only collaborative, but also cooperative learning should be recommended, as the latter involves students in the responsibility for&#x00a0;finding solutions to the problems.</p>
                <p> </p>
                <p> 
                    <italic>- A very good recommendation by the reviewer. However, as the statement was attained from a citation, we are not able to add it in the sentence as it will not reflect what was originally interpreted/meant by the author (of the citation). We shall take note of cooperative learning for future studies.</italic>
                </p>
                <p> 
                    <italic>&#x00a0;</italic>
                </p>
                <p> 3. Page 5, line 13, right column: instead of &#x201c;the loadings for each item fall within the satisfactory value&#x201d;, I suggest it should be added "for the majority of items" because as the authors recognize, there are some items that do not fulfil that condition.</p>
                <p> </p>
                <p> 
                    <italic>-&#x00a0;&#x201c;Each item&#x201d; has been replaced with &#x201c;for the majority of items&#x201d;, as recommended.</italic>
                </p>
                <p> 
                    <italic>&#x00a0;</italic>
                </p>
                <p> 4. Page 4, figure 1, empathy variables: why is the sequence, from top to bottom, different from the other design components? i.e., why not E1; E2; E3; E4; E5 ? The same comment applies to Figure 2.</p>
                <p> </p>
                <p> 
                    <italic>-&#x00a0;The sequence was automatically generated by the SmartPLS 3.0 software. As the figures were directly taken from the (measurement and structural) models generated by the software, we have decided to not alter it and retain the sequence the way it is.</italic>
                </p>
                <p> 
                    <italic>&#x00a0;</italic>
                </p>
                <p>
                    <italic> 5.&#x00a0;</italic>Page 6, line 12, right column: alpha value, or p-value?</p>
                <p> </p>
                <p> 
                    <italic>-&#x00a0;Alpha value (significance level).</italic>
                </p>
                <p> 
                    <italic>&#x00a0;</italic>
                </p>
                <p> 6. Page 6, line 32-33, right column: the sentence &#x201c;Malaysian teachers in predominantly primary and secondary schools lack empathy&#x201d; is somehow exaggerated. This study is based only in 131 responses, which do not represent, in any way, Malaysian teachers. The authors cannot make such a generalization. This sentence MUST be reformulated to the local validity of this study.</p>
                <p> </p>
                <p> 
                    <italic>-&#x00a0;The sentence has been changed to &#x201c;</italic>
                    <italic>Thus, the link between teachers&#x2019; empathy and innovative teaching is essential and since the hypothesis for this study pertaining to empathy is not supported, it means that the Malaysian teachers who participated in this study predominantly lack empathy, which indirectly creates a large gap or power distance between students and the teachers themselves&#x201d;</italic>
                    <italic>. This was done to avoid generalisation of the whole population.</italic>
                </p>
                <p> 
                    <italic>&#x00a0;</italic>
                </p>
                <p> 7. Page 6, line 36-38, right column: I don't see a direct correlation between the results obtained and the conclusion that &#x201c;This situation further enhances inability to deliver dry and uninteresting teaching and learning material&#x201d;. The authors should discuss better how they figure out such a correlation derived from their definition of Empathy. Their extrapolation is very broad and I don't think it has support in this investigation. Perhaps the authors want to rephrase it as a possibility that might occur, but not as an affirmative statement.</p>
                <p> </p>
                <p> 
                    <italic>-&#x00a0;Rephrased as suggested by the reviewer.</italic>
                </p>
                <p>
                    <italic> &#x00a0;</italic>
                </p>
                <p> 8. Page 6, table 2, line 5: item &#x201c;CE4&#x201d; seems to be &#x201c;CE5&#x201d;.</p>
                <p> </p>
                <p> 
                    <italic>-&#x00a0;CE4 has been changed to CE5.</italic>
                </p>
                <p> 
                    <italic>&#x00a0;</italic>
                </p>
                <p> 9. Finally, the reference list seems adequate to the study reported, and the English is of high quality.</p>
                <p> </p>
                <p> 
                    <italic>-&#x00a0;Thank you.</italic>
                </p>
                <p> </p>
                <p> 10.&#x00a0;Concerning the sample, it is not clear how many of those 131 teachers were from primary school and secondary school. As far as I know, the teaching goals, the contact hours and the involvement of teachers with their students may not be exactly the same for both categories of teacher, therefore the authors should provide separate analysis for both samples &#x2013; even if, at the end, they conclude the results are equivalent.</p>
                <p> </p>
                <p> 
                    <italic>-&#x00a0;61 of the respondents are primary school teachers and the remaining 70 respondents are secondary school teachers. As this is not a comparison study between primary and secondary school teachers, we have decided to retain the current analysis as is it.</italic>
                    <italic> </italic>
                </p>
            </body>
        </sub-article>
    </sub-article>
</article>
