<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.177673.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>Unlocking Problem-Solving Skills in STEM Education: A Bibliometric Review of Teaching Trends for Science Education Majors</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 not approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Manasikana</surname>
                        <given-names>Oktaffi</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Funding Acquisition</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Project Administration</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Software</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <uri content-type="orcid">https://orcid.org/0009-0001-9712-7889</uri>
                    <xref ref-type="aff" rid="a1">1</xref>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Saputro</surname>
                        <given-names>Sulistyo</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Muzzazinah</surname>
                        <given-names>Mzzazinah</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Universitas Sebelas Maret, Surakarta, Central Java, Indonesia</aff>
                <aff id="a2">
                    <label>2</label>Universitas Hasyim Asy'ari Tebuireng, Jombang, Jawa Timur, Indonesia</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:sulistyo_s@staff.uns.ac.id">sulistyo_s@staff.uns.ac.id</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>27</day>
                <month>3</month>
                <year>2026</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2026</year>
            </pub-date>
            <volume>15</volume>
            <elocation-id>442</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>9</day>
                    <month>2</month>
                    <year>2026</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2026 Manasikana O et al.</copyright-statement>
                <copyright-year>2026</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/15-442/pdf"/>
            <abstract>
                <sec>
                    <title>Background</title>
                    <p>Research on problem-solving skills has become an increasingly prominent topic within STEM education. However, existing studies are dispersed across disciplines, pedagogical approaches, and research contexts, making it difficult to identify dominant research trends, thematic structures, and collaboration patterns. A systematic bibliometric mapping is therefore required to clarify the intellectual landscape of problem-solving research in STEM education.</p>
                </sec>
                <sec>
                    <title>Methods</title>
                    <p>This study employed a bibliometric research design using publications indexed in the Scopus database. Articles and conference proceedings published between 2010 and 2025 were retrieved using predefined search queries related to STEM education and problem-solving. After applying inclusion and exclusion criteria, a final dataset of 37 publications was analyzed. Bibliometric techniques were used to examine publication trends, influential authors and journals, geographical distribution, co-authorship networks, and keyword co-occurrence patterns. Data visualization was conducted using bibliometric software.</p>
                </sec>
                <sec>
                    <title>Results</title>
                    <p>The findings show a gradual increase in research output on problem-solving within STEM education, with a notable rise after 2018. Keyword co-occurrence analysis reveals several dominant thematic clusters associated with STEM education, problem-solving skills, and higher education contexts. Co-authorship analysis indicates expanding international collaboration among authors and institutions across multiple regions.</p>
                </sec>
                <sec>
                    <title>Conclusions</title>
                    <p>This bibliometric review provides a structured overview of the development, thematic organization, and collaboration patterns of problem-solving research in STEM education. The results offer a data-driven reference for identifying research gaps and supporting future bibliometric and empirical investigations in this field.</p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>STEM Education</kwd>
                <kwd>Problem-Solving Skills</kwd>
                <kwd>21st Century Skills</kwd>
                <kwd>Higher Education</kwd>
            </kwd-group>
            <funding-group>
                <award-group id="fund-1" xlink:href="https://doi.org/10.13039/501100014538">
                    <funding-source>Lembaga Pengelola Dana Pendidikan</funding-source>
                </award-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec5" sec-type="intro">
            <title>Introduction</title>
            <p>STEM education (Science, Technology, Engineering, and Mathematics) plays a crucial role in preparing future generations to tackle the increasingly complex challenges of a rapidly evolving world. It goes beyond just mastering technical knowledge. STEM education also fosters essential skills such as problem-solving, critical thinking, and creativity, which are vital in today&#x2019;s modern workforce.</p>
            <p>By combining various disciplines, STEM education enables students to grasp the interconnections between different fields, fostering a comprehensive approach to solving problems (
                <xref ref-type="bibr" rid="ref15">Daleure, 2017</xref>; 
                <xref ref-type="bibr" rid="ref16">Dan &amp; Gary, 2018</xref>). These skills are crucial for identifying problems, analyzing their causes, and formulating effective solutions. Additionally, STEM education fosters the development of collaboration and communication skills
                <bold>,
</bold> which are also essential in solving problems as part of a team. Collaborative projects and reflective practices in STEM education promote teamwork, communication, and critical thinking, all of which are crucial for successful problem-solving (
                <xref ref-type="bibr" rid="ref13">Chan &amp; Nagatomo, 2023</xref>; 
                <xref ref-type="bibr" rid="ref19">Garcia-Suarez et al., 2024</xref>; 
                <xref ref-type="bibr" rid="ref32">Metpattarahiran, 2021</xref>).</p>
            <p>With STEM education, students not only learn foundational theories but also develop the skills to solve real-world problems encountered in everyday life or in professional environments. This cross-disciplinary approach is highly effective in fostering creative and flexible thinking. These skills are essential for addressing the complex challenges of the modern world (
                <xref ref-type="bibr" rid="ref18">English &amp; Lehmann, 2024</xref>).</p>
            <p>This makes STEM education highly relevant in supporting technological innovation and economic growth. The problem-solving skills taught through STEM education help individuals think creatively and adapt quickly to changes. It also equips students for careers in STEM sectors, as well as other industries that demand STEM-related skills, boosting their employability and competitiveness in the global market (
                <xref ref-type="bibr" rid="ref34">Nasereddin et al., 2014</xref>; 
                <xref ref-type="bibr" rid="ref38">Ragusa, 2012</xref>).</p>
            <p>In the 21st century, STEM education provides students with the skills required for the 21st-century workforce, including critical thinking, creativity, communication, and collaboration (
                <xref ref-type="bibr" rid="ref18">English &amp; Lehmann, 2024</xref>; 
                <xref ref-type="bibr" rid="ref22">Hanson &amp; Lucas, 2024</xref>; 
                <xref ref-type="bibr" rid="ref32">Metpattarahiran, 2021</xref>). Therefore, STEM education plays an irreplaceable role in shaping individuals who are capable of addressing and solving problems efficiently and creatively, ultimately driving progress in both economic and social domains. This highlights the relevance of these skills in the 21st century for fostering innovation and economic growth (
                <xref ref-type="bibr" rid="ref1">Abdi et al., 2024</xref>; 
                <xref ref-type="bibr" rid="ref2">Aboudahr et al., 2024</xref>; 
                <xref ref-type="bibr" rid="ref26">Ilma et al., 2023</xref>).</p>
            <p>This bibliometric analysis aims to uncover trends, patterns, and key themes in research on STEM education and problem-solving skills, highlighting how these areas have evolved and their impact on educational practices. The analysis seeks to identify emerging trends in STEM education, such as the growing interest in STEM since 2014, as well as the widespread use of various research methodologies, including quantitative, qualitative, and mixed methods (
                <xref ref-type="bibr" rid="ref10">Bozkurt et al., 2019</xref>).</p>
            <p>A key emphasis is on exploring how STEM education aids in the development of problem-solving skills. This involves evaluating the effectiveness of various teaching strategies and approaches, such as project-based learning and problem-based learning, in improving students' problem-solving capabilities (
                <xref ref-type="bibr" rid="ref17">Dilla &amp; Turpin, 2021</xref>; 
                <xref ref-type="bibr" rid="ref46">Zeeshan et al., 2021</xref>). By examining various teaching methodologies and their effectiveness in fostering critical thinking and problem-solving abilities, the study seeks to provide insights into how STEM education prepares students for the modern workforce, supporting innovation, economic growth, and adaptability in real-world challenges.</p>
            <p>The bibliometric analysis offers valuable insights into the evolving trends in STEM education and problem-solving skills. It highlights the growing interest in STEM education, the shift in research methodologies, and the increasing need for innovative teaching approaches to enhance problem-solving abilities. The findings will contribute to advancing educational practices, supporting technological innovation, and fostering economic growth and adaptability in real-world challenges (
                <xref ref-type="bibr" rid="ref32">Metpattarahiran, 2021</xref>). To ensure transparency and early dissemination of findings, a preprint version of this bibliometric study has been made publicly available (
                <xref ref-type="bibr" rid="ref30">Manasikana et al., 2025</xref>).</p>
            <p>STEM (Science, Technology, Engineering, and Mathematics) education aims to equip students with essential skills for the 21st century, including problem-solving abilities. This review synthesizes findings from recent studies to understand how STEM education fosters problem-solving skills.</p>
            <sec id="sec6">
                <title>Integration of 21st-century skills and STEM</title>
                <p>STEM education, particularly through Project-Oriented Problem-Based Learning (PoPBL), significantly enhances students' 21st-century skills. These skills include problem-solving, creative thinking, collaboration, and communication (
                    <xref ref-type="bibr" rid="ref5">AlAli, 2024</xref>). By immersing students in real-life problem-solving experiences, this pedagogical approach helps improve their proficiency in these critical skills.</p>
                <p>The incorporation of 21st-century skills into STEM education has become a key element in contemporary educational curricula. This approach not only aims to improve students' academic proficiency in science, technology, engineering, and mathematics, but also focuses on developing essential skills that equip them to face real-world challenges. Effective integration of these skills can significantly enhance students' abilities in collaboration, creativity, critical thinking, and communication the &#x201c;4Cs&#x201d; which are crucial for success in the modern world (
                    <xref ref-type="bibr" rid="ref21">Hamdu et al., 2020</xref>; 
                    <xref ref-type="bibr" rid="ref23">Hasanah et al., 2021</xref>; 
                    <xref ref-type="bibr" rid="ref25">Hussin et al., 2019</xref>; 
                    <xref ref-type="bibr" rid="ref28">Lian et al., 2021</xref>).</p>
                <p>Research highlights that when STEM education is delivered through project-based learning, it creates an environment where students engage in creative and critical thinking, enabling them to effectively address complex problems. For example, robotics education demonstrates how STEM can be practically applied, fostering skills like problem-solving and teamwork (
                    <xref ref-type="bibr" rid="ref8">Arafat et al., 2024</xref>; 
                    <xref ref-type="bibr" rid="ref25">Hussin et al., 2019</xref>). In addition, collaborative projects promote peer communication, enhancing social skills that are increasingly important in both academic and professional environments (
                    <xref ref-type="bibr" rid="ref36">Perdana et al., 2021</xref>).</p>
                <p>Furthermore, effective teaching methods that support the inclusion of 21st-century skills within STEM disciplines have shown promising outcomes. Research suggests that teachers who implement innovative teaching strategies can significantly influence students' attitudes toward STEM, preparing them for future challenges (
                    <xref ref-type="bibr" rid="ref7">Altuni&#x015f;ik &amp; Uzun, 2023</xref>; 
                    <xref ref-type="bibr" rid="ref41">Temel, 2023</xref>; 
                    <xref ref-type="bibr" rid="ref45">Xu &amp; Zhou, 2022</xref>). This is especially important as the global workforce now requires individuals who are not only technically proficient but also skilled in interpersonal communication and critical thinking.</p>
                <p>Globally, educational frameworks like the Partnership for 21st Century Skills (P21) emphasize the importance of integrating these competencies into curricula (
                    <xref ref-type="bibr" rid="ref39">Rosdiana et al., 2020</xref>; 
                    <xref ref-type="bibr" rid="ref44">Wulandari &amp; Putri, 2024</xref>). Aligning curricular goals with the demands of today&#x2019;s economy and the complexity of societal issues reflects growing recognition among educators and policymakers of the significance of this integration. Consequently, teacher professional development programs are vital in providing educators with the strategies necessary to cultivate these skills effectively (
                    <xref ref-type="bibr" rid="ref4">Akmar et al., 2021</xref>; 
                    <xref ref-type="bibr" rid="ref31">Mayes &amp; Rittschof, 2021</xref>; 
                    <xref ref-type="bibr" rid="ref35">Nazifah &amp; Asrizal, 2022</xref>).</p>
                <p>Integrating 21st-century skills into STEM education enhances academic learning while preparing students for the future needs of society and the workforce. The evidence strongly supports the notion that this integration can lead to better student outcomes across multiple areas, including academic achievement and the development of social skills. Ongoing research and practical applications in this area will continue to reveal effective ways to combine these critical educational components.</p>
                <p>Previous studies have examined various aspects of STEM education and problem-solving, including instructional design, technology integration, assessment approaches, and interdisciplinary learning contexts. These studies collectively illustrate the breadth of research themes associated with problem-solving in STEM education. This study are strictly based on the 37 Scopus-indexed publications included in the final dataset.</p>
            </sec>
            <sec id="sec7">
                <title>Research questions</title>
                <p>To systematically map the research landscape of problem-solving within STEM education, this bibliometric study addresses the following research questions:</p>
                <p>

                    <bold>RQ1.</bold> How has the volume of publications on problem-solving in STEM education evolved over the period 2010&#x2013;2025?</p>
                <p>

                    <bold>RQ2.</bold> Who are the most influential authors, journals, and publications in research on problem-solving within STEM education, based on bibliometric indicators?</p>
                <p>

                    <bold>RQ3.</bold> What are the dominant thematic clusters and research foci emerging from keyword co-occurrence analysis in the literature on problem-solving in STEM education?</p>
                <p>

                    <bold>RQ4.</bold> How are collaboration patterns structured among authors, institutions, and countries in research on problem-solving within STEM education?</p>
                <p>A preprint version of this article has been deposited in an open-access repository (
                    <xref ref-type="bibr" rid="ref30">Manasikana et al., 2025</xref>).</p>
            </sec>
        </sec>
        <sec id="sec8">
            <title>Methodology</title>
            <sec id="sec9">
                <title>Data collection</title>
                <p>For this bibliometric analysis, the data was collected exclusively from Scopus, a leading database for peer-reviewed literature. Scopus was chosen due to its extensive and rigorous indexing of high-quality academic journals, conference papers, and book chapters across various disciplines, particularly in the fields of science, technology, engineering, and mathematics (STEM). This makes Scopus an ideal source for gathering relevant publications on STEM education and problem-solving skills (
                    <xref ref-type="bibr" rid="ref1">Abdi et al., 2024</xref>; 
                    <xref ref-type="bibr" rid="ref2">Aboudahr et al., 2024</xref>).</p>
                <p>The time frame for the publications analyzed spans the past 15 years (2010-2025), chosen to capture the most relevant and up-to-date research trends in STEM education and problem-solving abilities. This extended period provides a thorough examination of the evolution of research in these fields, taking into account shifts in pedagogical practices, the increasing integration of technology in STEM education, and the growing emphasis on problem-solving skills in educational curricula (
                    <xref ref-type="bibr" rid="ref24">Husaeni &amp; Nandiyanto, 2023</xref>).</p>
                <p>By focusing on Scopus and this 15-year time frame, the study ensures a comprehensive and relevant dataset that reflects the latest trends and patterns in STEM education research, providing a solid foundation for understanding the evolution of STEM education over time.</p>
            </sec>
            <sec id="sec10">
                <title>Search strategy</title>
                <p>The bibliographic data for this study were retrieved from the Scopus database. The search was conducted in March 2025 using the TITLE-ABS-KEY fields to ensure comprehensive coverage of relevant publications. The search strategy combined keywords related to STEM education and problem-solving, as detailed in the following query strings:
                    <list list-type="bullet">
                        <list-item>
                            <label>&#x2022;</label>
                            <p>&#x201c;STEM education&#x201d; AND &#x201c;problem-solving&#x201d; AND &#x201c;higher education&#x201d;</p>
                        </list-item>
                        <list-item>
                            <label>&#x2022;</label>
                            <p>&#x201c;STEM education&#x201d; AND &#x201c;problem-solving skills&#x201d;</p>
                        </list-item>
                    </list>
                </p>
                <p>The initial search retrieved a total of 159 records. The dataset was subsequently refined by applying the following inclusion criteria:
                    <list list-type="order">
                        <list-item>
                            <label>(1)</label>
                            <p>publications indexed in Scopus,</p>
                        </list-item>
                        <list-item>
                            <label>(2)</label>
                            <p>published between 2010 and 2025,</p>
                        </list-item>
                        <list-item>
                            <label>(3)</label>
                            <p>written in English, and</p>
                        </list-item>
                        <list-item>
                            <label>(4)</label>
                            <p>classified as journal articles or conference proceedings.</p>
                        </list-item>
                    </list>
                </p>
                <p>Records such as editorials, book chapters, notes, and non-peer-reviewed documents were excluded. After the screening and refinement process, the final dataset consisted of 37 publications, which formed the basis for the bibliometric analysis.</p>
            </sec>
            <sec id="sec11">
                <title>Inclusion&#x2013;Exclusion criteria</title>
                <p>A structured search strategy was applied to identify publications addressing problem-solving within STEM education. Searches were conducted in the Scopus database using predefined query strings applied to the TITLE-ABS-KEY fields. The search focused on terms representing STEM education and problem-solving in higher education contexts.</p>
                <p>The initial search yielded 159 records. These records were screened in several stages. First, document types were filtered to retain only journal articles and conference proceedings, excluding editorials, book chapters, notes, and other non-peer-reviewed materials. Second, publications were limited to those written in English and published between 2010 and 2025. Third, duplicate records were identified and removed.</p>
                <p>Following this screening process, the remaining publications were assessed for relevance based on their titles and abstracts. Studies that did not explicitly address STEM education and problem-solving were excluded. After applying all inclusion and exclusion criteria, a final dataset of 37 publications was retained for bibliometric analysis.</p>
                <p>This stepwise refinement ensured that the dataset was both methodologically consistent and directly aligned with the objectives of the bibliometric mapping.</p>
            </sec>
            <sec id="sec12">
                <title>Analysis tools</title>
                <p>For this bibliometric analysis, several tools were utilized to process and visualize the data collected from Scopus. VOSviewer was used to map co-authorship networks, co-citations, and keyword co-occurrence, providing insights into research trends and key relationships in the STEM education field. It helped visualize clusters of related topics and identify influential studies. Utilize bibliometric software tools such as VOSviewer and bibliometrix for analyzing and visualizing data. These tools assist in mapping research trends, identifying collaboration networks, and analyzing citation patterns (
                    <xref ref-type="bibr" rid="ref6">Alfonzo et al., 2014</xref>; 
                    <xref ref-type="bibr" rid="ref29">Lim et al., 2024</xref>).</p>
                <p>Microsoft Excel was employed for organizing and cleaning the data, using pivot tables and basic statistical functions to summarize trends such as publication frequency and the geographical distribution of research. Additionally, Publish or Perish was used to gather citation metrics, such as h-index and citation counts, which helped assess the academic impact of key papers and authors. The combination of these tools allowed for a comprehensive analysis of the trends, patterns, and themes in STEM education and problem-solving research over the last 15 years, enabling the identification of key contributors, influential research, and emerging trends in the field.</p>
            </sec>
            <sec id="sec13">
                <title>Criteria</title>
                <p>Define the inclusion and exclusion criteria for selecting articles, such as publication years, types of documents, and language (
                    <xref ref-type="bibr" rid="ref20">Giang et al., 2024</xref>; 
                    <xref ref-type="bibr" rid="ref26">Ilma et al., 2023</xref>). The inclusion and exclusion criteria for selecting articles were established to ensure that only the most relevant and high-quality studies were included in this bibliometric analysis. These criteria were applied to filter the articles retrieved from the Scopus database, focusing on the most impactful and pertinent research on STEM education and problem-solving skills. Utilize bibliometric indicators to assess productivity (quantity indicators), quality (quality indicators), and the structural relationships (structural indicators) between publications, authors, and research domains (
                    <xref ref-type="bibr" rid="ref12">Carlos et al., 2024</xref>; 
                    <xref ref-type="bibr" rid="ref42">Val&#x00e9;rie &amp; Pierre, 2010</xref>).</p>
            </sec>
        </sec>
        <sec id="sec14" sec-type="results">
            <title>Results</title>
            <sec id="sec15">
                <title>Publication trends in STEM education and problem-solving skills (2011-2025)</title>
                <p>The bibliometric analysis shows an overall increase in the number of publications addressing problem-solving within STEM education between 2011 and 2025. As presented in 
                    <xref ref-type="table" rid="T1">
Table 1</xref>, publication output remained relatively low during the period from 2011 to 2017, followed by a noticeable increase beginning in 2018. The highest number of publications was recorded in 2024. Data for 2025 represent partial records at the time of data retrieval.</p>
                <table-wrap id="T1" orientation="portrait" position="float">
                    <label>
Table 1. </label>
                    <caption>
                        <title>Year-wise distribution of publications on problem-solving in STEM education.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Year</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Number of publications</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2011</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2012</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">4</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2013</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">6</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2014</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2015</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">1</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2016</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">3</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2017</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">7</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2018</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">13</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2019</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">11</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2020</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">12</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2021</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">18</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2022</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">20</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2023</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">33</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2024</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">51</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">2025</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">9 (partial)</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>
                    <xref ref-type="table" rid="T1">
Table 1</xref> presents the annual distribution of publications, while 
                    <xref ref-type="fig" rid="f1">
Figure 1</xref> provides a graphical representation of these trends. Together, the table and figure illustrate a rising volume of scholarly output on problem-solving in STEM education over the analyzed period.</p>
                <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                    <label>
Figure 1. </label>
                    <caption>
                        <title>Annual publication trends of research on problem-solving in STEM education from 2011 to 2025 based on Scopus-indexed publications.</title>
                    </caption>
                    <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/195930/d97d421e-d2b9-4683-968f-8d7eac378eb4_figure1.gif"/>
                </fig>
            </sec>
            <sec id="sec16">
                <title>Highly cited papers</title>
                <p>Citation analysis identifies several publications with relatively high citation counts within the dataset. Among the most cited publications are 
                    <italic toggle="yes">The Online Challenge to Higher Education</italic> by W.B. Bonvillian (24 citations), 
                    <italic toggle="yes">Maker Culture and Its Potential for STEM Education</italic> by R. Tabar&#x00e9;s (17 citations), and 
                    <italic toggle="yes">Integration of Mobile Learning into Complex Problem Solving</italic> by E. Shchedrina (16 citations). These publications represent frequently referenced works within the literature on problem-solving in STEM education.</p>
            </sec>
            <sec id="sec17">
                <title>Geographical distribution</title>
                <p>The geographical distribution of publications indicates contributions from multiple regions worldwide. Research output originates predominantly from the United States, several European countries, and parts of Asia, reflecting the international scope of studies on problem-solving within STEM education.</p>
                <p>
                    <xref ref-type="table" rid="T2">
Table 2</xref>: summarizes the regional distribution of key journals and conference outlets associated with the analyzed publications, while 
                    <xref ref-type="fig" rid="f2">Figure 2</xref> visualizes the geographical spread of research activity across regions.</p>
                <table-wrap id="T2" orientation="portrait" position="float">
                    <label>
Table 2. </label>
                    <caption>
                        <title>Geographical distribution of key journals and conferences related to problem-solving in STEM education.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Region</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Key journals/Conferences</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">
Countries represented</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>United States</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">ASEE Annual Conference and Exposition, IEEE Global Engineering Education Conference</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">U.S. (predominantly)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Europe</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Journal of Physics: Conference Series, Education Sciences</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">United Kingdom, Germany, France, etc.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Asia</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">IEEE journals and conferences</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">China, Japan, India, etc.</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Global/International</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Proceedings - Frontiers in Education Conference, Education Sciences</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Worldwide contributions</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>
Figure 2. </label>
                    <caption>
                        <title>Keyword co-occurrence network for publications retrieved using the query &#x201c;STEM education&#x201d; AND &#x201c;problem-solving&#x201d; AND &#x201c;higher education&#x201d;.</title>
                        <p>Node size represents keyword frequency, and links indicate co-occurrence relationships.</p>
                    </caption>
                    <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/195930/d97d421e-d2b9-4683-968f-8d7eac378eb4_figure2.gif"/>
                </fig>
            </sec>
            <sec id="sec18">
                <title>Top journals and institutions</title>
                <p>The bibliometric analysis identifies several journals and institutions that appear frequently within the dataset. Journals such as 
                    <italic toggle="yes">Journal of Engineering Education</italic>, 
                    <italic toggle="yes">IEEE Transactions on Education</italic>, 
                    <italic toggle="yes">Thinking Skills and Creativity</italic>, 
                    <italic toggle="yes">Journal of Physics: Conference Series</italic>, and 
                    <italic toggle="yes">Education Sciences</italic> serve as recurring publication outlets for research related to problem-solving in STEM education.</p>
                <p>Similarly, institutions including the Massachusetts Institute of Technology, Stanford University, the University of California, Berkeley, the University of Cambridge, and the National University of Singapore are associated with multiple publications in the dataset. Their repeated occurrence indicates their presence within the scholarly network of research on problem-solving in STEM education.</p>
                <p>
                    <xref ref-type="table" rid="T3">
Table 3</xref> summarizes the leading journals and institutions that frequently appear in publications on problem-solving within STEM education.</p>
                <table-wrap id="T3" orientation="portrait" position="float">
                    <label>
Table 3. </label>
                    <caption>
                        <title>Leading journals and institutions in STEM education research related to problem-solving.</title>
                    </caption>
                    <table content-type="article-table" frame="hsides">
                        <thead>
                            <tr>
                                <th align="left" colspan="1" rowspan="1" valign="top">Category</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Top journals</th>
                                <th align="left" colspan="1" rowspan="1" valign="top">Top institutions</th>
                            </tr>
                        </thead>
                        <tbody>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>STEM Education Focus</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Journal of Engineering Education, IEEE Transactions on Education, Thinking Skills and Creativity, Journal of Physics: Conference Series, Education Sciences</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Massachusetts Institute of Technology (MIT), Stanford University, University of California, Berkeley, University of Cambridge, National University of Singapore (NUS)</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Problem-Solving Focus</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Journal of Engineering Education, IEEE Transactions on Education, Thinking Skills and Creativity</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">MIT, Stanford University, University of California, Berkeley, University of Cambridge, NUS</td>
                            </tr>
                            <tr>
                                <td align="left" colspan="1" rowspan="1" valign="middle">
                                    <bold>Global Reach</bold>
</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">Education Sciences, Journal of Physics: Conference Series, Thinking Skills and Creativity</td>
                                <td align="left" colspan="1" rowspan="1" valign="middle">MIT, Stanford University, University of Cambridge, University of California, Berkeley, NUS</td>
                            </tr>
                        </tbody>
                    </table>
                </table-wrap>
                <p>The leading journals and institutions highlighted above play a pivotal role in shaping research and advancements in STEM education, especially in relation to problem-solving skills. Journals such as the Journal of Engineering Education and IEEE Transactions on Education are critical platforms for disseminating innovative teaching methods that enhance students' analytical and problem-solving abilities. Similarly, institutions like MIT, Stanford University, and University of Cambridge are at the forefront of developing educational frameworks and curricula that prioritize problem-solving skills. Their research and innovations continue to influence global STEM education practices, providing valuable insights into how to cultivate problem-solving abilities in students across disciplines.</p>
                <p>This global perspective, as seen through the leading journals and institutions, underscores the importance of collaboration and innovation in addressing the challenges of STEM education and enhancing problem-solving capabilities among future generations of scientists, engineers, and educators.</p>
            </sec>
        </sec>
        <sec id="sec19" sec-type="discussion">
            <title>Discussion</title>
            <sec id="sec20">
                <title>Thematic patterns in STEM problem-solving research</title>
                <p>Keyword co-occurrence analysis was conducted to identify thematic relationships within the literature on problem-solving in STEM education, as shown in 
                    <xref ref-type="fig" rid="f2">
Figures 2</xref> and 
                    <xref ref-type="fig" rid="f3">3</xref>. The analysis maps the relationships among frequently occurring keywords and illustrates how research topics are interconnected within the field
                    <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                        <label>
Figure 3. </label>
                        <caption>
                            <title>Keyword co-occurrence network for publications retrieved using the query &#x201c;STEM education&#x201d; AND &#x201c;problem-solving skills&#x201d;.</title>
                            <p>Clusters represent dominant thematic areas in the literature.</p>
                        </caption>
                        <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/195930/d97d421e-d2b9-4683-968f-8d7eac378eb4_figure3.gif"/>
                    </fig>
.</p>
                <p>The keyword networks show clusters of frequently co-occurring terms, indicating recurring thematic associations within the literature. These patterns reflect the structure of research topics discussed in studies on problem-solving within STEM education.</p>
            </sec>
            <sec id="sec21">
                <title>Author collaboration networks in STEM</title>
                <p>Co-authorship network analysis was performed to examine collaboration patterns among authors contributing to research on problem-solving in STEM education, as illustrated in 
                    <xref ref-type="fig" rid="f4">
Figures 4</xref> and 
                    <xref ref-type="fig" rid="f5">5</xref>. Each node in the network represents an author, while the links indicate co-authored publications within the dataset.</p>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>
Figure 4. </label>
                    <caption>
                        <title>Co-authorship network based on publications retrieved using the query &#x201c;STEM education&#x201d; AND &#x201c;problem-solving&#x201d; AND &#x201c;higher education&#x201d;.</title>
                        <p>Nodes represent authors, and links indicate collaborative relationships.</p>
                    </caption>
                    <graphic id="gr4" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/195930/d97d421e-d2b9-4683-968f-8d7eac378eb4_figure4.gif"/>
                </fig>
                <fig fig-type="figure" id="f5" orientation="portrait" position="float">
                    <label>
Figure 5. </label>
                    <caption>
                        <title>Co-authorship network based on publications retrieved using the query &#x201c;STEM education&#x201d; AND &#x201c;problem-solving skills&#x201d;, illustrating collaboration patterns among contributing authors.</title>
                    </caption>
                    <graphic id="gr5" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/195930/d97d421e-d2b9-4683-968f-8d7eac378eb4_figure5.gif"/>
                </fig>
                <p>The co-authorship collaboration network among authors is illustrated in 
                    <xref ref-type="fig" rid="f5">
Figure 5</xref>.</p>
            </sec>
            <sec id="sec22">
                <title>Institutional and country collaborations</title>
                <p>Beyond individual researchers, institutional and country-level collaborations also play a crucial role in advancing STEM education. The co-authorship networks in 
                    <xref ref-type="fig" rid="f3">
Figure 3</xref> and 
                    <xref ref-type="fig" rid="f4">
Figure 4</xref> not only reveal connections between authors but also suggest patterns of institutional and national involvement in these collaborations. By examining the partnerships between institutions and countries, we can identify the most collaborative entities and their contributions to global STEM education efforts.</p>
                <p>For example, institutions from countries with strong STEM research programs often form strategic alliances, which are reflected in the co-authorship networks. Countries such as the United States, Germany, and Japan are frequently at the forefront of STEM education initiatives, contributing to an expanding network of international collaboration in STEM. Similarly, institutions in emerging economies, such as those in Indonesia or India, are forming partnerships with established institutions in the West, enhancing the exchange of knowledge and resources.</p>
                <p>These institutional and country-level collaborations not only foster innovation but also help distribute the benefits of STEM education globally. As Aboudahr et al. (
                    <xref ref-type="bibr" rid="ref2">Aboudahr et al., 2024</xref>) and Khalil et al. (
                    <xref ref-type="bibr" rid="ref27">Khalil et al., 2024</xref>) emphasize, these global partnerships play a critical role in addressing worldwide challenges, from climate change to technological advancements in healthcare.</p>
            </sec>
            <sec id="sec23">
                <title>Educational strategies: Project-based and inquiry-based learning</title>
                <p>Educational strategies, particularly project-based learning (PBL) and inquiry-based learning, are essential in developing problem-solving abilities among STEM students. However, no specific articles from the dataset were found that directly address these strategies within the context of STEM education. Nevertheless, the importance of these educational strategies is well-documented, where PBL and inquiry-based methods have been shown to enhance student engagement, foster teamwork, and improve critical thinking and problem-solving skills. These strategies offer real-world contexts in which students can apply their knowledge, encouraging them to find solutions to complex problems. Effective teaching methods like project-based learning (PBL) and inquiry-based learning that foster problem-solving abilities (
                    <xref ref-type="bibr" rid="ref3">Adikayanti &amp; Retnawati, 2022</xref>; 
                    <xref ref-type="bibr" rid="ref20">Giang et al., 2024</xref>; 
                    <xref ref-type="bibr" rid="ref26">Ilma et al., 2023</xref>).</p>
            </sec>
            <sec id="sec24">
                <title>Technological integration in STEM education</title>
                <p>Technological integration has become an indispensable aspect of STEM education, significantly enhancing students' problem-solving skills. The redesign of online proctored exams in STEM learning provides a platform to integrate technology, enabling educators to assess problem-solving skills more effectively in virtual environments (
                    <xref ref-type="bibr" rid="ref33">Mitra, 2023</xref>). Furthermore, the role of digital tools in developing engineering skills has been highlighted as critical in supporting problem-solving through technology (
                    <xref ref-type="bibr" rid="ref11">Caratozzolo, 2022</xref>). Immersive technology not only aids in teaching but also improves the assessment of students' problem-solving capabilities by offering real-time feedback and interactive learning experiences (
                    <xref ref-type="bibr" rid="ref14">Chiu, 2022</xref>). Studies have further emphasized the role of technology in enhancing STEM education and problem-solving skills, demonstrating the positive impact of digital tools and immersive technologies on student learning outcomes (
                    <xref ref-type="bibr" rid="ref9">Awaji et al., 2025</xref>; 
                    <xref ref-type="bibr" rid="ref40">Sahito &amp; Wassan, 2024</xref>; 
                    <xref ref-type="bibr" rid="ref43">Vinu Varghese &amp; Renumol, 2021</xref>).</p>
            </sec>
            <sec id="sec25">
                <title>Assessment and evaluation in STEM</title>
                <p>Finally, the theme of assessment and evaluation is crucial in measuring the development of problem-solving skills in STEM education. Technology integration within STEM education influences problem-solving assessments, allowing for more accurate tracking of student progress and providing valuable insights into their problem-solving approaches (
                    <xref ref-type="bibr" rid="ref11">Caratozzolo, 2022</xref>). Moreover, immersive technology enhances the evaluation process by offering interactive methods to assess students' understanding and their ability to solve complex problems (
                    <xref ref-type="bibr" rid="ref14">Chiu, 2022</xref>). Further research has emphasized the importance of developing effective methods for assessing problem-solving skills in STEM education, which are essential for evaluating students' competencies and ensuring their readiness to tackle real-world challenges (
                    <xref ref-type="bibr" rid="ref37">Priemer et al., 2020</xref>; 
                    <xref ref-type="bibr" rid="ref43">Vinu Varghese &amp; Renumol, 2021</xref>).</p>
            </sec>
            <sec id="sec26">
                <title>Influential authors and institutions</title>
                <p>The most influential authors in the field, based on citation counts, include W.B. Bonvillian, who has amassed 24 citations, making him a key figure in analyzing the challenges and opportunities of higher education in the digital era. R. Tabar&#x00e9;s, with 17 citations, has also played a significant role in advancing the conversation about maker culture as a critical component of STEM education. Other notable contributors include E. Shchedrina, with 16 citations, and M.H. Muhammad Hafizi, who has 7 citations. These authors have been instrumental in shaping research methodologies in STEM education, particularly in the integration of technology into teaching and learning processes. Their collective work continues to influence the development of problem-solving skills in STEM education by emphasizing innovative, technology-driven solutions. This group of researchers is at the forefront of pushing the boundaries of STEM education, driving new approaches to teaching and fostering creative, problem-solving strategies.</p>
            </sec>
            <sec id="sec27">
                <title>Future research directions</title>
                <p>

                    <bold>Gaps in literature</bold>
                </p>
                <p>Although STEM education research has made considerable progress, there are several gaps in the literature that warrant further exploration. A key gap is the lack of empirical studies assessing the effectiveness of specific teaching methods in improving problem-solving skills within STEM education. Most current research focuses on theoretical frameworks, with limited longitudinal studies examining the long-term impact of emerging technologies in STEM education. Additionally, the efficacy of mobile learning and immersive technologies, such as Augmented Reality (AR) and Virtual Reality (VR), in enhancing students' problem-solving abilities across diverse educational contexts remains underexplored. Future research should focus on providing more empirical evidence to assess the outcomes of these approaches in real-world settings, particularly to understand how they can be integrated into different educational systems and cultures.</p>
                <p>

                    <bold>Recommendations</bold>
                </p>
                <p>To address these gaps, future research should prioritize integrating emerging technologies, such as Artificial Intelligence (AI) and AR, into STEM education to further support the development of problem-solving and critical thinking skills. Additionally, exploring interdisciplinary approaches that combine STEM with other fields, such as the arts, social sciences, and humanities, can offer a more holistic view of problem-solving. By incorporating diverse perspectives, research in this area can foster not only technical and scientific skills but also creative, adaptive, and ethical thinking. Such interdisciplinary research could help prepare students for complex, real-world challenges by promoting a broader and more integrated skill set, essential for navigating the complexities of the 21st century.</p>
            </sec>
        </sec>
        <sec id="sec28" sec-type="conclusion">
            <title>Conclusion</title>
            <sec id="sec29">
                <title>Summary of findings</title>
                <p>This bibliometric review has provided valuable insights into the evolving trends and patterns in STEM education and its role in developing problem-solving skills. The analysis highlights a significant increase in research activity from 2018 onwards, reflecting a growing global interest in enhancing STEM education to equip students with essential problem-solving abilities. Key findings include the rising importance of integrating 21st-century skills, such as creativity, critical thinking, collaboration, and communication, into STEM curricula. Furthermore, the shift towards innovative teaching methodologies, such as project-based and inquiry-based learning, has proven effective in fostering problem-solving capabilities. Notably, mobile learning and immersive technologies have become key themes in recent research, showing promise in enhancing students' cognitive flexibility and problem-solving skills in STEM contexts.</p>
            </sec>
            <sec id="sec30">
                <title>Implications</title>
                <p>The findings of this review have several important implications for educators, policymakers, and researchers. For educators, the integration of emerging technologies, such as AI and AR, offers new avenues for enhancing problem-solving skills in STEM education. Educators should consider adopting interdisciplinary approaches that blend STEM with other fields, such as the arts or social sciences, to provide students with a more holistic education. For policymakers, there is a clear need for continued support for STEM programs that prioritize the development of critical thinking and problem-solving skills. This may involve investing in teacher professional development and encouraging the adoption of innovative teaching strategies. Researchers are encouraged to explore the gaps identified in the literature, such as the need for more empirical studies on the effectiveness of specific teaching methods and technologies in enhancing problem-solving abilities. Further research should also investigate the long-term impact of these methods on students' preparedness for real-world challenges.</p>
                <p>In conclusion, STEM education plays an irreplaceable role in preparing students to solve complex, real-world problems. As research continues to expand in this area, it will be essential to focus on the integration of advanced technologies, interdisciplinary teaching methods, and a comprehensive approach to problem-solving that prepares students for the dynamic challenges of the 21st century.</p>
            </sec>
        </sec>
        <sec id="sec31">
            <title>Ethics, consent to participate, and consent to publish</title>
            <p>This study is a bibliometric analysis based on secondary data obtained from publicly available bibliographic records. It does not involve human participants, personal data, or experimental procedures. Therefore, ethics approval, consent to participate, and consent to publish are not applicable.</p>
        </sec>
    </body>
    <back>
        <sec id="sec34" sec-type="data-availability">
            <title>Data availability</title>
            <p>The datasets generated and analyzed during this study are publicly available in the Zenodo repository at 
                <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5281/zenodo.18428074">https://doi.org/10.5281/zenodo.18428074</ext-link> (
                <xref ref-type="bibr" rid="ref30">Manasikana et al., 2025</xref>)</p>
            <p>The dataset includes bibliographic records retrieved from the Scopus database and the data files used for bibliometric and network analyses.</p>
            <p>The data are shared under the 
                <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International (CC BY 4.0) license</ext-link>.</p>
        </sec>
        <ack>
            <title>Acknowledgments</title>
            <p>The authors acknowledge the Indonesian Education Scholarship program administered by BPI, PPAPT Kemdiktisaintek, and the Indonesia Endowment Fund for Education (LPDP), Ministry of Finance of the Republic of Indonesia. At the time of publication, this work is being considered for funding support under this program.</p>
        </ack>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Abdi</surname>
                            <given-names>AI</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Omar</surname>
                            <given-names>AM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mahdi</surname>
                            <given-names>AO</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Tracing the evolution of STEM education: a bibliometric analysis.</article-title>
                    <source>

                        <italic toggle="yes">Frontiers in Education.</italic>
</source>
                    <year>2024</year>;<volume>9</volume>.
                    <pub-id pub-id-type="doi">10.3389/feduc.2024.1457938</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref2">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Aboudahr</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Aslam</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hua</surname>
                            <given-names>LU</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mapping the global landscape of STEM education: a bibliometric analysis using Scopus database.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Evaluation and Research in Education.</italic>
</source>
                    <year>2024</year>;<volume>13</volume>(<issue>6</issue>):<fpage>4225</fpage>&#x2013;<lpage>4236</lpage>.
                    <pub-id pub-id-type="doi">10.11591/ijere.v13i6.28687</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Adikayanti</surname>
                            <given-names>L</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Retnawati</surname>
                            <given-names>H</given-names>
                        </name>
</person-group>:
                    <article-title>Is project-based learning integrated to STEM can improve creativity and problem-solving skills in mathematics learning?.</article-title>
                    <source>

                        <italic toggle="yes">AIP Conference Proceedings.</italic>
</source>
                    <year>2022</year>;<volume>2575</volume>.
                    <pub-id pub-id-type="doi">10.1063/5.0110811</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Akmar</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nadhirah</surname>
                            <given-names>NY</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tasneem</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Design and Development EduPocket A+.</article-title>
                    <source>

                        <italic toggle="yes">Momentum Physics Education Journal.</italic>
</source>
                    <year>2021</year>;<fpage>94</fpage>&#x2013;<lpage>100</lpage>.
                    <pub-id pub-id-type="doi">10.21067/mpej.v5i1.5700</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>AlAli</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>ENHANCING 21ST CENTURY SKILLS THROUGH INTEGRATED STEM EDUCATION USING PROJECT-ORIENTED PROBLEM-BASED LEARNING.</article-title>
                    <source>

                        <italic toggle="yes">Geojournal of Tourism and Geosites.</italic>
</source>
                    <year>2024</year>;<volume>53</volume>(<issue>2</issue>):<fpage>421</fpage>&#x2013;<lpage>430</lpage>.
                    <pub-id pub-id-type="doi">10.30892/gtg.53205-1217</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Alfonzo</surname>
                            <given-names>PM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sakraida</surname>
                            <given-names>TJ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Hastings-Tolsma</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Bibliometrics: Visualizing the impact of nursing research.</article-title>
                    <source>

                        <italic toggle="yes">Online J. Nurs. Inform.</italic>
</source>
                    <year>2014</year>;<volume>18</volume>(<issue>1</issue>).</mixed-citation>
            </ref>
            <ref id="ref7">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Altuni&#x015f;ik</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Uzun</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>The Effect of Problem-Based STEM Implementations on Pre-Service Science Teachers&#x2019; Views on STEM Education.</article-title>
                    <year>2023</year>;<fpage>58</fpage>&#x2013;<lpage>81</lpage>.
                    <pub-id pub-id-type="doi">10.58637/egebad.1392248</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Arafat</surname>
                            <given-names>MH</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Budiyanto</surname>
                            <given-names>CW</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yuana</surname>
                            <given-names>RA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Implementation of Integrated STEM Learning in Educational Robotics Towards 21st Century Skills: A Systematic Review.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Education in Mathematics Science and Technology.</italic>
</source>
                    <year>2024</year>;<volume>12</volume>(<issue>5</issue>):<fpage>1127</fpage>&#x2013;<lpage>1141</lpage>.
                    <pub-id pub-id-type="doi">10.46328/ijemst.4271</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Awaji</surname>
                            <given-names>BM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Khalil</surname>
                            <given-names>I</given-names>
                        </name>

                        <name name-style="western">
                            <surname>AL-Zahrani, A.</surname>
                        </name>
</person-group>:
                    <article-title>A Bibliometrics Study of Two Decades of Geogebra Research in Mathematics Education.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Educational and Social Research.</italic>
</source>
                    <year>2025</year>;<volume>15</volume>(<issue>1</issue>):<fpage>130</fpage>&#x2013;<lpage>150</lpage>.
                    <pub-id pub-id-type="doi">10.36941/jesr-2025-0011</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bozkurt</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ucar</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Durak</surname>
                            <given-names>G</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The current state of the art in STEM research: A systematic review study.</article-title>
                    <source>

                        <italic toggle="yes">Cypriot J. Educ. Sci.</italic>
</source>
                    <year>2019</year>;<volume>14</volume>(<issue>3</issue>):<fpage>374</fpage>&#x2013;<lpage>383</lpage>.
                    <pub-id pub-id-type="doi">10.18844/cjes.v14i3.3447</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Caratozzolo</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <chapter-title>EXPLORING ENGINEERING SKILLS DEVELOPMENT THROUGH A COMPARISON OF INSTITUTIONAL PRACTICES IN MEXICO AND SCOTLAND.</chapter-title>
                    <source>

                        <italic toggle="yes">SEFI 2022-50th Annual Conference of the European Society for Engineering Education, Proceedings.</italic>
</source>
                    <year>2022</year>; pp.<fpage>1878</fpage>&#x2013;<lpage>1883</lpage>.
                    <pub-id pub-id-type="doi">10.5821/conference-9788412322262.1291</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref12">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Carlos</surname>
                            <given-names>MD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Josue</surname>
                            <given-names>RD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Carla</surname>
                            <given-names>SC</given-names>
                        </name>
</person-group>:
                    <article-title>Bibliometric studies. An option to develop research in surgery and related disciplines.</article-title>
                    <source>

                        <italic toggle="yes">Revista de Cirugia.</italic>
</source>
                    <year>2024</year>;<volume>76</volume>(<issue>2</issue>):<fpage>147</fpage>&#x2013;<lpage>156</lpage>.
                    <pub-id pub-id-type="doi">10.35687/s2452-454920240021890</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref13">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chan</surname>
                            <given-names>M-N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nagatomo</surname>
                            <given-names>D</given-names>
                        </name>
</person-group>:
                    <article-title>Research of problem-solving ability development through STEM education with design for disaster projects.</article-title>
                    <source>

                        <italic toggle="yes">AIP Conference Proceedings.</italic>
</source>
                    <year>2023</year>;<volume>2685</volume>.
                    <pub-id pub-id-type="doi">10.1063/5.0111726</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref14">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chiu</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <article-title>Analyzing Student Problem-Solving With MAtCH.</article-title>
                    <source>

                        <italic toggle="yes">Frontiers in Education.</italic>
</source>
                    <year>2022</year>;<volume>6</volume>.
                    <pub-id pub-id-type="doi">10.3389/feduc.2021.769042</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref15">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Daleure</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>:
                    <chapter-title>Explaining the AMST model: Using arts, maths, science, and technology in an upgraded problem-based learning approach.</chapter-title>
                    <source>

                        <italic toggle="yes">WMSCI 2017-21st World Multi-Conference on Systemics, Cybernetics and Informatics, Proceedings.</italic>
</source>
                    <year>2017</year>;<volume>1</volume>:<fpage>16</fpage>&#x2013;<lpage>19</lpage>.</mixed-citation>
            </ref>
            <ref id="ref16">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Dan</surname>
                            <given-names>ZS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Gary</surname>
                            <given-names>WKW</given-names>
                        </name>
</person-group>:
                    <chapter-title>Teachers&#x2019; perceptions of professional development in integrated STEM education in primary schools.</chapter-title>
                    <source>

                        <italic toggle="yes">IEEE Global Engineering Education Conference, EDUCON, 2018-April.</italic>
</source>
                    <year>2018</year>;<fpage>472</fpage>&#x2013;<lpage>477</lpage>.
                    <pub-id pub-id-type="doi">10.1109/EDUCON.2018.8363268</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref17">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Dilla</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Turpin</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <article-title>Teaching Problem Solving to Undergraduate STEM Students: A Systematic Literature Review.</article-title>
                    <source>

                        <italic toggle="yes">Communications in Computer and Information Science.</italic>
</source>
                    <year>2021</year>;<volume>1518</volume>:<fpage>72</fpage>&#x2013;<lpage>87</lpage>.
                    <pub-id pub-id-type="doi">10.1007/978-3-030-92858-2_5</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref18">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>English</surname>
                            <given-names>LD</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lehmann</surname>
                            <given-names>T</given-names>
                        </name>
</person-group>:
                    <chapter-title>Ways of thinking in STEM-based problem solving: Teaching and learning in a new era.</chapter-title>
                    <source>

                        <italic toggle="yes">Ways of Thinking in STEM-based Problem Solving: Teaching and Learning in a New Era.</italic>
</source>
                    <year>2024</year>.
                    <pub-id pub-id-type="doi">10.4324/9781003404989</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Garcia-Suarez</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Curiel-Enriquez</surname>
                            <given-names>IM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Turner-Escalante</surname>
                            <given-names>JE</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <chapter-title>Building an Inclusive STEM Future: Engineering Students Empower over 1200 Students by Designing Innovative Workshops Fostering Women&#x2019;s Participation in Engineering.</chapter-title>
                    <source>

                        <italic toggle="yes">IEEE Global Engineering Education Conference, EDUCON.</italic>
</source>
                    <year>2024</year>.
                    <pub-id pub-id-type="doi">10.1109/EDUCON60312.2024.10578674</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref20">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Giang</surname>
                            <given-names>NTC</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Anh</surname>
                            <given-names>NTQ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dao</surname>
                            <given-names>TT</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A Systematic Review of Problem-Solving Skill Development for Students in STEM Education.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Learning, Teaching and Educational Research.</italic>
</source>
                    <year>2024</year>;<volume>23</volume>(<issue>5</issue>):<fpage>1</fpage>&#x2013;<lpage>20</lpage>.
                    <pub-id pub-id-type="doi">10.26803/ijlter.23.5.1</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hamdu</surname>
                            <given-names>G</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lidinillah</surname>
                            <given-names>DAM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nopianti</surname>
                            <given-names>GS</given-names>
                        </name>
</person-group>:
                    <article-title>4C&#x2019;s Skills Performance Assessment in STEM Learning in Elementary School.</article-title>
                    <source>

                        <italic toggle="yes">Univ. J. Educ. Res.</italic>
</source>
                    <year>2020</year>;<volume>8</volume>(<issue>12A</issue>):<fpage>7668</fpage>&#x2013;<lpage>7675</lpage>.
                    <pub-id pub-id-type="doi">10.13189/ujer.2020.082553</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref22">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hanson</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Lucas</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <chapter-title>Global creative disruption and implications for STEM-based problem solving and learning.</chapter-title>
                    <source>

                        <italic toggle="yes">Ways of Thinking in STEM-based Problem Solving: Teaching and Learning in a New Era.</italic>
</source>
                    <year>2024</year>; pp.<fpage>29</fpage>&#x2013;<lpage>46</lpage>.
                    <pub-id pub-id-type="doi">10.4324/9781003404989-3</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hasanah</surname>
                            <given-names>SS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Permanasari</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Riandi</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>The Effectiveness of the Teacher Professional Development Program in Implementing Curriculum 2013 in the Framework of STEM Education.</article-title>
                    <year>2021</year>.
                    <pub-id pub-id-type="doi">10.2991/assehr.k.210715.081</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Husaeni</surname>
                            <given-names>DNA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nandiyanto</surname>
                            <given-names>ABD</given-names>
                        </name>
</person-group>:
                    <article-title>Bibliometric computational mapping analysis of Science, Technology, Engineering, and Mathematics (STEM) education using VOSviewer (from 2012 to 2022).</article-title>
                    <source>

                        <italic toggle="yes">Progress in Education.</italic>
</source>
                    <year>2023</year>;<volume>76</volume>:<fpage>183</fpage>&#x2013;<lpage>201</lpage>.</mixed-citation>
            </ref>
            <ref id="ref25">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Hussin</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Jiea</surname>
                            <given-names>PY</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rosly</surname>
                            <given-names>RNR</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Integrated 21st Century Science, Technology, Engineering, Mathematics (Stem) Education Through Robotics Project-Based Learning.</article-title>
                    <source>

                        <italic toggle="yes">Humanities &amp; Social Sciences Reviews.</italic>
</source>
                    <year>2019</year>;<volume>7</volume>(<issue>2</issue>):<fpage>204</fpage>&#x2013;<lpage>211</lpage>.
                    <pub-id pub-id-type="doi">10.18510/hssr.2019.7222</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref26">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ilma</surname>
                            <given-names>AZ</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wilujeng</surname>
                            <given-names>I</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Widowati</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A Systematic Literature Review of STEM Education in Indonesia (2016-2021): Contribution to Improving Skills in 21st Century Learning.</article-title>
                    <source>

                        <italic toggle="yes">Pegem Egitim ve Ogretim Dergisi.</italic>
</source>
                    <year>2023</year>;<volume>13</volume>(<issue>2</issue>):<fpage>134</fpage>&#x2013;<lpage>146</lpage>.
                    <pub-id pub-id-type="doi">10.47750/pegegog.13.02.17</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref27">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Khalil</surname>
                            <given-names>IA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zahrani</surname>
                            <given-names>AAL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Awaji</surname>
                            <given-names>B</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mapping the Future of Innovation: A Bibliometric Analysis of STEM Education Trends in K-12.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Learning, Teaching and Educational Research.</italic>
</source>
                    <year>2024</year>;<volume>23</volume>(<issue>8</issue>):<fpage>76</fpage>&#x2013;<lpage>97</lpage>.
                    <pub-id pub-id-type="doi">10.26803/ijlter.23.8.5</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref28">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lian</surname>
                            <given-names>Y</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Tsang</surname>
                            <given-names>KK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zhang</surname>
                            <given-names>Y</given-names>
                        </name>
</person-group>:
                    <article-title>The Construction and Sustainability of Teachers&#x2019; Positive Emotions Toward STEM Educational Work.</article-title>
                    <source>

                        <italic toggle="yes">Sustainability.</italic>
</source>
                    <year>2021</year>;<volume>13</volume>(<issue>11</issue>):<fpage>5769</fpage>.
                    <pub-id pub-id-type="doi">10.3390/su13115769</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref29">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Lim</surname>
                            <given-names>WM</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kumar</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Donthu</surname>
                            <given-names>N</given-names>
                        </name>
</person-group>:
                    <article-title>How to combine and clean bibliometric data and use bibliometric tools synergistically: Guidelines using metaverse research.</article-title>
                    <source>

                        <italic toggle="yes">J. Bus. Res.</italic>
</source>
                    <year>2024</year>;<volume>182</volume>.
                    <pub-id pub-id-type="doi">10.1016/j.jbusres.2024.114760</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref30">
                <mixed-citation publication-type="data">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Manasikana</surname>
                            <given-names>OA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Saputro</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Muzzazinah</surname>
                        </name>
</person-group>:
                    <data-title>Dataset for: Unlocking Problem-Solving Skills in STEM Education: A Bibliometric Review of Teaching Trends for Science Education Majors.</data-title>
                    <source>

                        <italic toggle="yes">Zenodo.</italic>
</source>
                    <year>2025</year>.
                    <pub-id pub-id-type="doi">10.5281/zenodo.18428074</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref31">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mayes</surname>
                            <given-names>RL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rittschof</surname>
                            <given-names>KA</given-names>
                        </name>
</person-group>:
                    <article-title>Development of Interdisciplinary STEM Impact Measures of Student Attitudes and Reasoning.</article-title>
                    <source>

                        <italic toggle="yes">Frontiers in Education.</italic>
</source>
                    <year>2021</year>;<volume>6</volume>.
                    <pub-id pub-id-type="doi">10.3389/feduc.2021.631684</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref32">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Metpattarahiran</surname>
                            <given-names>C</given-names>
                        </name>
</person-group>:
                    <article-title>STEM Education for Developing Undergraduates&#x2019; 21st Century Skills.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Multidisciplinary in Social Sciences.</italic>
</source>
                    <year>2021</year>;<volume>17</volume>(<issue>3</issue>):<fpage>82</fpage>&#x2013;<lpage>87</lpage>.</mixed-citation>
            </ref>
            <ref id="ref33">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Mitra</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>Redesign of online proctored exams for STEM learners in higher education institutions: proposal for incorporating higher-order thinking skills and democratic pedagogy via OPERHOT platform.</article-title>
                    <source>

                        <italic toggle="yes">FEMS Microbiol. Lett.</italic>
</source>
                    <year>2023</year>;<volume>370</volume>.
                    <pub-id pub-id-type="doi">10.1093/femsle/fnad074</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref34">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nasereddin</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Clark</surname>
                            <given-names>TK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Konak</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <chapter-title>Using virtual machines in a K-12 Outreach program to increase interest in information security fields.</chapter-title>
                    <source>

                        <italic toggle="yes">ISEC 2014-4th IEEE Integrated STEM Education Conference.</italic>
</source>
                    <year>2014</year>.
                    <pub-id pub-id-type="doi">10.1109/ISECon.2014.6891039</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref35">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nazifah</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Asrizal</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>The Effect of STEM Integrated Modules on Knowledge and Students&#x2019; 21st Century Skill in Science and Physics Learning: A Meta Analysis.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Progressive Sciences and Technologies.</italic>
</source>
                    <year>2022</year>;<volume>34</volume>(<issue>1</issue>):<fpage>441</fpage>.
                    <pub-id pub-id-type="doi">10.52155/ijpsat.v34.1.4527</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref36">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Perdana</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Apriani</surname>
                            <given-names>A-N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Richardo</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Elementary Students&#x2019; Attitudes Towards STEM and 21st-Century Skills.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Evaluation and Research in Education (Ijere).</italic>
</source>
                    <year>2021</year>;<volume>10</volume>(<issue>3</issue>):<fpage>1080</fpage>.
                    <pub-id pub-id-type="doi">10.11591/ijere.v10i3.21389</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref37">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Priemer</surname>
                            <given-names>B</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Eilerts</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Filler</surname>
                            <given-names>A</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A framework to foster problem-solving in STEM and computing education.</article-title>
                    <source>

                        <italic toggle="yes">Res. Sci. Technol. Educ.</italic>
</source>
                    <year>2020</year>;<volume>38</volume>(<issue>1</issue>):<fpage>105</fpage>&#x2013;<lpage>130</lpage>.
                    <pub-id pub-id-type="doi">10.1080/02635143.2019.1600490</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref38">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ragusa</surname>
                            <given-names>G</given-names>
                        </name>
</person-group>:
                    <chapter-title>Teacher training and student inquiry and science literacy: Linking teacher intervention to students&#x2019; outcomes in STEM courses in middle and high school classes.</chapter-title>
                    <source>

                        <italic toggle="yes">ASEE Annual Conference and Exposition, Conference Proceedings.</italic>
</source>
                    <year>2012</year>.</mixed-citation>
            </ref>
            <ref id="ref39">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rosdiana</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Sumarni</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Siswanto</surname>
                            <given-names>B</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Implementation of 21st Century Learning Through Lesson Study.</article-title>
                    <year>2020</year>.
                    <pub-id pub-id-type="doi">10.2991/assehr.k.200323.041</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref40">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Sahito</surname>
                            <given-names>Z</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wassan</surname>
                            <given-names>SH</given-names>
                        </name>
</person-group>:
                    <article-title>Literature Review on STEM Education and Its Awareness among Teachers: An Exploration of Issues and Problems with Their Solutions.</article-title>
                    <source>

                        <italic toggle="yes">SAGE Open.</italic>
</source>
                    <year>2024</year>;<volume>14</volume>(<issue>1</issue>).
                    <pub-id pub-id-type="doi">10.1177/21582440241236242</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref41">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Temel</surname>
                            <given-names>H</given-names>
                        </name>
</person-group>:
                    <article-title>Investigation of the Relationship Between Elementary School Mathematics Teacher Candidates&#x2019; Attitudes Towards STEM Education and Their Proficiency Perceptions of 21st Century Skills.</article-title>
                    <source>

                        <italic toggle="yes">Uluda&#x011f; &#x00dc;niversitesi E&#x011f;itim Fak&#x00fc;ltesi Dergisi.</italic>
</source>
                    <year>2023</year>;<volume>36</volume>(<issue>1</issue>):<fpage>150</fpage>&#x2013;<lpage>173</lpage>.
                    <pub-id pub-id-type="doi">10.19171/uefad.1147025</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref42">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Val&#x00e9;rie</surname>
                            <given-names>D</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pierre</surname>
                            <given-names>AG</given-names>
                        </name>
</person-group>:
                    <article-title>Bibliometric idicators: Quality masurements of sientific publication.</article-title>
                    <source>

                        <italic toggle="yes">Radiology.</italic>
</source>
                    <year>2010</year>;<volume>255</volume>(<issue>2</issue>):<fpage>342</fpage>&#x2013;<lpage>351</lpage>.
                    <pub-id pub-id-type="doi">10.1148/radiol.09090626</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref43">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Vinu Varghese</surname>
                            <given-names>VV</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Renumol</surname>
                            <given-names>VG</given-names>
                        </name>
</person-group>:
                    <chapter-title>Assessment methods and interventions to develop computational thinking - A literature review.</chapter-title>
                    <source>

                        <italic toggle="yes">2021 International Conference on Innovative Trends in Information Technology, ICITIIT 2021.</italic>
</source>
                    <year>2021</year>.
                    <pub-id pub-id-type="doi">10.1109/ICITIIT51526.2021.9399606</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref44">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wulandari</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Putri</surname>
                            <given-names>DIRA</given-names>
                        </name>
</person-group>:
                    <article-title>Analysis of Students&#x2019; Attitudes Towards Stem and 21st Century Skills in Elementary School From a Gender Perspective.</article-title>
                    <source>

                        <italic toggle="yes">Abjadia International Journal of Education.</italic>
</source>
                    <year>2024</year>;<volume>9</volume>(<issue>1</issue>):<fpage>267</fpage>&#x2013;<lpage>278</lpage>.
                    <pub-id pub-id-type="doi">10.18860/abj.v9i1.27159</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref45">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Xu</surname>
                            <given-names>S-R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zhou</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>The Effect of Students&#x2019; Attitude Towards Science, Technology, Engineering, and Mathematics on 21st Century Learning Skills: A Structural Equation Model.</article-title>
                    <source>

                        <italic toggle="yes">J. Balt. Sci. Educ.</italic>
</source>
                    <year>2022</year>;<volume>21</volume>(<issue>4</issue>):<fpage>706</fpage>&#x2013;<lpage>719</lpage>.
                    <pub-id pub-id-type="doi">10.33225/jbse/22.21.706</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref46">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Zeeshan</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Watanabe</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Neittaanmaki</surname>
                            <given-names>P</given-names>
                        </name>
</person-group>:
                    <chapter-title>Problem-solving skill development through STEM learning approaches.</chapter-title>
                    <source>

                        <italic toggle="yes">Proceedings - Frontiers in Education Conference, FIE, 2021-Octob.</italic>
</source>
                    <year>2021</year>.
                    <pub-id pub-id-type="doi">10.1109/FIE49875.2021.9637226</pub-id>
                </mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report488665">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.195930.r488665</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Huang</surname>
                        <given-names>Yueh Min</given-names>
                    </name>
                    <xref ref-type="aff" rid="r488665a1">1</xref>
                    <role>Referee</role>
                </contrib>
                <aff id="r488665a1">
                    <label>1</label>National Cheng Kung University, tanian, Taiwan</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>12</day>
                <month>6</month>
                <year>2026</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2026 Huang YM</copyright-statement>
                <copyright-year>2026</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport488665" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.177673.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>reject</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This manuscript examines an important and timely topic: problem-solving skills in STEM education. A bibliometric review could make a useful contribution by identifying publication trends, influential sources, thematic clusters, and collaboration patterns. However, in its current form, I do not consider the manuscript scientifically sound, because there are substantial inconsistencies in the dataset, insufficient methodological transparency, and several conclusions that are not adequately supported by the presented evidence. My main concerns are detailed below. 
                <list list-type="order">
                    <list-item>
                        <p>Critical inconsistency in the number of publications analysed</p>
                    </list-item>
                </list> The Methods section states that the initial Scopus search retrieved 159 records and that the final dataset consisted of 37 publications. However, the annual counts in Table 1 (2011&#x2013;2025: 2, 4, 6, 2, 1, 3, 7, 13, 11, 12, 18, 20, 33, 51, 9) add up to 192 publications. This number is neither the initial search result of 159 nor the final dataset of 37. Moreover, 192 exceeds the number of records reportedly obtained before screening, which makes it difficult to understand how this figure relates to the stated selection workflow.</p>
            <p> This discrepancy raises serious concerns regarding the validity and reproducibility of the publication-trend analysis, particularly because Table 1 and Figure 1 constitute the core evidence for RQ1. The authors should clarify whether Table 1 and Figure 1 were based on the initial records, the final screened dataset, a combination of search results, or another data source. A complete PRISMA or PRISMA-ScR flow diagram should be provided, including the number of records removed at each stage, such as document type, language, duplicates, and title/abstract relevance screening. The authors should also provide the final list of the 37 included publications and revise every table, figure, and interpretation so that all counts are internally consistent. 
                <list list-type="order">
                    <list-item>
                        <p>Figures do not clearly align with the reported dataset size</p>
                    </list-item>
                </list> The co-authorship network in Figure 5 appears to contain a large and dense set of author nodes, whereas the keyword co-occurrence maps in Figures 2 and 3 are very sparse, with only a small number of terms. The apparent mismatch between the scale of the co-authorship network and the sparsity of the keyword maps warrants further explanation. At present, it is not clear whether all visualisations were generated from the same final dataset of 37 publications.</p>
            <p> For each VOSviewer map, the authors should report the exact dataset used, the counting method, the minimum occurrence and citation thresholds, clustering resolution, and the resulting number of nodes, links, and total link strength. These details are necessary for readers to verify whether all visualisations derive from the same final dataset and whether the reported network structures are reproducible. 
                <list list-type="order">
                    <list-item>
                        <p>Figure reference errors</p>
                    </list-item>
                </list> The cross-referencing of figures is internally inconsistent. The text states that Figure 2 visualises the geographical spread of research activity across regions, but Figure 2 is actually a keyword co-occurrence network. In addition, the section on institutional and country collaborations refers to &#x201c;the co-authorship networks in Figure 3 and Figure 4,&#x201d; although Figure 3 is also a keyword co-occurrence network; only Figure 4 is a co-authorship network. These errors make it difficult to follow which figures correspond to which analyses. All figure callouts should be carefully checked and corrected. 
                <list list-type="order">
                    <list-item>
                        <p>Several research questions are only partially answered</p>
                    </list-item>
                </list> Several research questions are not fully addressed by the presented results. For example, RQ2 asks about the most influential authors, journals, and publications, yet the manuscript does not provide comprehensive ranking tables or clear bibliometric indicators such as citation counts, publication counts, local citations, global citations, or h-index values. Similarly, RQ4 focuses on collaboration patterns among authors, institutions, and countries, but the manuscript mainly provides visualisations without reporting supporting network statistics such as cluster structure, total link strength, or country-level collaboration indicators.</p>
            <p> To answer the stated research questions more convincingly, the authors should provide quantitative tables and network metrics that directly correspond to each RQ. 
                <list list-type="order">
                    <list-item>
                        <p>Claims about leading journals, institutions, and countries lack supporting data</p>
                    </list-item>
                </list> Table 3 lists institutions such as MIT, Stanford University, UC Berkeley, the University of Cambridge, and the National University of Singapore as top institutions. However, no publication counts, citation counts, frequencies, or link-strength indicators are provided. Therefore, it is difficult to determine whether these rankings were derived from the analysed dataset. Similarly, the geographical section uses broad statements such as &#x201c;predominantly from the United States&#x201d; and claims that countries such as the United States, Germany, and Japan are frequently at the forefront, yet no country-level publication table or country co-authorship map is provided.</p>
            <p> These claims should be replaced or supported with transparent quantitative indicators, including publication counts, citation counts, total link strength, and collaboration metrics. Without such data, the conclusions regarding leading institutions and geographical distribution remain insufficiently supported. 
                <list list-type="order">
                    <list-item>
                        <p>Discussion exceeds what the bibliometric data can support</p>
                    </list-item>
                </list> Large parts of the Discussion read as a general literature review rather than an interpretation of the bibliometric findings. The manuscript discusses project-based learning, inquiry-based learning, technology integration, immersive technologies, AI, AR, VR, and assessment. However, these themes are not clearly shown to have emerged from the reported keyword clusters or other bibliometric indicators. The manuscript also states that no specific articles from the dataset directly addressed some of these strategies, yet these topics are then discussed at length using sources outside the dataset.</p>
            <p> The authors should clearly separate findings derived from the analysed dataset from broader contextual literature. If these themes are intended to represent bibliometric findings, the authors should show how they emerged from the keyword co-occurrence analysis, thematic clusters, or citation patterns. Otherwise, the Discussion risks becoming a narrative review rather than an interpretation of bibliometric results. 
                <list list-type="order">
                    <list-item>
                        <p>Incomplete methodological reporting and residual template text</p>
                    </list-item>
                </list> The method is not reproducible as currently written. The authors should provide the full Scopus query string, the exact search date, the duplicate-removal procedure, the inclusion and exclusion numbers at each stage, software versions, and the analysis parameters for VOSviewer and bibliometrix. Although bibliometrix is listed as one of the analytical tools, the manuscript does not clearly indicate which outputs or indicators were generated using this software. Although Publish or Perish and h-index are mentioned, h-index values are not reported in the Results.</p>
            <p> In addition, the &#x201c;Criteria&#x201d; subsection contains imperative, template-like wording, such as &#x201c;Define the inclusion and exclusion criteria...&#x201d; and &#x201c;Utilize bibliometric indicators...&#x201d;. This reads as placeholder or instructional text rather than a description of the actual methods used. This section should be rewritten as a precise methodological account in past tense.</p>
            <p> Minor issues</p>
            <p> First, the time frame is inconsistent. The Methods state 2010&#x2013;2025, whereas Table 1 and the Results begin in 2011. The Introduction also refers to growth &#x201c;since 2014,&#x201d; while the Abstract emphasises a rise &#x201c;after 2018.&#x201d; These statements should be made consistent.</p>
            <p> Second, the search is reported as conducted in March 2025, yet the article was published in 2026 and includes 2025 as partial data. The authors should clarify the retrieval date and explain whether the 2025 data are complete or partial.</p>
            <p> Third, the keyword maps appear insufficiently cleaned. Terms such as &#x201c;current state&#x201d; and &#x201c;future research direction&#x201d; are not meaningful bibliometric keywords. The authors should conduct keyword cleaning, synonym merging, and removal of generic terms before generating co-occurrence maps.</p>
            <p> Strengths</p>
            <p> The topic is relevant and timely. The research questions are clearly stated, and the manuscript addresses an area of potential interest to STEM education researchers. The authors also state that the dataset has been deposited in Zenodo under a CC BY 4.0 license, which is a positive step toward transparency. The ethics statement is appropriate for a bibliometric study based on publicly available records.</p>
            <p> Overall assessment</p>
            <p> The current version cannot be approved. To make the article scientifically sound, the authors must at minimum: resolve the dataset inconsistency involving 159, 37, and 192 records; regenerate or revise all tables and figures using a single, clearly defined dataset; provide a transparent and reproducible methodology, including the full search query, PRISMA-style flow diagram, software parameters, and list of included records; support all bibliometric claims with quantitative indicators; correct the figure references; and revise the Discussion and Conclusion so that they do not exceed the evidence provided by the bibliometric analysis.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Not applicable</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Partly</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>No</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>No</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>No</p>
            <p>Reviewer Expertise:</p>
            <p>STEM education; educational technology; learning analytics; technology-enhanced learning; problem-solving skills in education.</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.</p>
        </body>
    </sub-article>
</article>
