<?xml version="1.0" encoding="UTF-8"?><!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.2 20190208//EN" "http://jats.nlm.nih.gov/publishing/1.2/JATS-journalpublishing1.dtd"><article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" article-type="research-article" dtd-version="1.2" xml:lang="en">
    <front>
        <journal-meta>
            <journal-id journal-id-type="pmc">F1000Research</journal-id>
            <journal-title-group>
                <journal-title>F1000Research</journal-title>
            </journal-title-group>
            <issn pub-type="epub">2046-1402</issn>
            <publisher>
                <publisher-name>F1000 Research Limited</publisher-name>
                <publisher-loc>London, UK</publisher-loc>
            </publisher>
        </journal-meta>
        <article-meta>
            <article-id pub-id-type="doi">10.12688/f1000research.174999.1</article-id>
            <article-categories>
                <subj-group subj-group-type="heading">
                    <subject>Research Article</subject>
                </subj-group>
                <subj-group>
                    <subject>Articles</subject>
                </subj-group>
            </article-categories>
            <title-group>
                <article-title>The Impact of Blended Training Professional Development Programs on the Competence of Vocational Teachers: A Kirkpatrick Model Approach</article-title>
                <fn-group content-type="pub-status">
                    <fn>
                        <p>[version 1; peer review: 1 approved with reservations, 1 not approved]</p>
                    </fn>
                </fn-group>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Herawati</surname>
                        <given-names>Erma</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Original Draft Preparation</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Martono</surname>
                        <given-names>Trisno</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Sudarno</surname>
                        <given-names>Sudarno</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="yes">
                    <name>
                        <surname>Noviani</surname>
                        <given-names>Leny</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Supervision</role>
                    <role content-type="http://credit.niso.org/">Validation</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <xref ref-type="corresp" rid="c1">a</xref>
                    <xref ref-type="aff" rid="a1">1</xref>
                </contrib>
                <contrib contrib-type="author" corresp="no">
                    <name>
                        <surname>Yansyah</surname>
                        <given-names>Fikri</given-names>
                    </name>
                    <role content-type="http://credit.niso.org/">Conceptualization</role>
                    <role content-type="http://credit.niso.org/">Data Curation</role>
                    <role content-type="http://credit.niso.org/">Formal Analysis</role>
                    <role content-type="http://credit.niso.org/">Methodology</role>
                    <role content-type="http://credit.niso.org/">Resources</role>
                    <role content-type="http://credit.niso.org/">Visualization</role>
                    <role content-type="http://credit.niso.org/">Writing &#x2013; Review &amp; Editing</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-7845-5246</uri>
                    <xref ref-type="aff" rid="a2">2</xref>
                </contrib>
                <aff id="a1">
                    <label>1</label>Sebelas Maret University Faculty of Teacher Training and Education, Surakarta, Central Java, Indonesia</aff>
                <aff id="a2">
                    <label>2</label>Universitas Islam Negeri Raden Fatah Palembang, Palembang, South Sumatra, Indonesia</aff>
            </contrib-group>
            <author-notes>
                <corresp id="c1">
                    <label>a</label>
                    <email xlink:href="mailto:lenynoviani@staff.uns.ac.id">lenynoviani@staff.uns.ac.id</email>
                </corresp>
                <fn fn-type="conflict">
                    <p>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>5</day>
                <month>2</month>
                <year>2026</year>
            </pub-date>
            <pub-date pub-type="collection">
                <year>2026</year>
            </pub-date>
            <volume>15</volume>
            <elocation-id>195</elocation-id>
            <history>
                <date date-type="accepted">
                    <day>2</day>
                    <month>1</month>
                    <year>2026</year>
                </date>
            </history>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2026 Herawati E et al.</copyright-statement>
                <copyright-year>2026</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access article distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <self-uri content-type="pdf" xlink:href="https://f1000research.com/articles/15-195/pdf"/>
            <abstract>
                <sec>
                    <title>Background</title>
                    <p>The study is intended to assess the effects of the professional development program on the competence of vocational teachers, which is implemented by the Directorate General of Vocational Education, Ministry of Primary and Secondary Education in Indonesia (MoPSE) from 2020 to 2023. The study aimed to gather teachers&#x2019; perspectives on their perceptions of motivation, skills, values, and attitudes following the training program. The participants engaged in three cycles of training development programs. This study will regard the levels of the Kirkpatrick model as equivalent, without any hierarchical distinction.</p>
                </sec>
                <sec>
                    <title>Method</title>
                    <p>The research employed a quantitative design utilising a longitudinal approach. The three stages of Kirkpatrick assessment were utilised to assess the program&#x2019;s impacts, progressing from level 1 to level 3. The data is gathered by a survey method with a Likert-scale questionnaire. A total of 944 educators engaged in this survey. They originated from 34 provinces in Indonesia. The data was evaluated utilising percentage data analysis.</p>
                </sec>
                <sec>
                    <title>Result</title>
                    <p>The results indicated that, across level 1 - reaction, level 2 - skill, and level 3 - values and attitudes, the majority of participants fell within the positive spectrum (strongly agree and agree). The level of concordance among all assessed indices exceeded 90%. The conducted training programs were highly acceptable to the majority of participants. The participants believe that the training significantly enhances their motivation and skills, positively influencing their values and attitudes.</p>
                </sec>
                <sec>
                    <title>Conclusion</title>
                    <p>The results indicate that the programs had significant effects on the participants. Such initiatives should not be executed as one-time interventions but rather as components of a continuous, systematic strategy designed to enhance vocational teachers&#x2019; competencies over time.</p>
                </sec>
            </abstract>
            <kwd-group kwd-group-type="author">
                <kwd>Blended training</kwd>
                <kwd>teachers&#x2019; professional development</kwd>
                <kwd>vocational teachers</kwd>
                <kwd>teachers&#x2019; competence</kwd>
                <kwd>Kirkpatrick model</kwd>
            </kwd-group>
            <funding-group>
                <funding-statement>The author(s) declared that no grants were involved in supporting this work.</funding-statement>
            </funding-group>
        </article-meta>
    </front>
    <body>
        <sec id="sec5" sec-type="intro">
            <title>Introduction</title>
            <p>Teachers&#x2019; professional development has long been acknowledged as a crucial factor in enhancing educational quality (
                <xref ref-type="bibr" rid="ref9">Farabi, Bahar &amp; Agam, 2025</xref>; 
                <xref ref-type="bibr" rid="ref27">Revina et al. 2023</xref>; 
                <xref ref-type="bibr" rid="ref4">Bolt, 2012</xref>). It is a continuous process of learning, training, and reflection designed to enhance a teacher&#x2019;s knowledge, abilities, and proficiency in their work (
                <xref ref-type="bibr" rid="ref1">AbdulRab, 2023</xref>; 
                <xref ref-type="bibr" rid="ref10">Germuth, 2018</xref>). Additionally, it is also essential for enhancing student outcomes, since it provides educators with new skills, updates them on teaching trends and technology, and improves their instructional efficacy (
                <xref ref-type="bibr" rid="ref29">Salmer&#x00f3;n Aroca, Moreno Abell&#x00e1;n, &amp; Mart&#x00ed;nez de Miguel L&#x00f3;pez, 2023</xref>). In the absence of professional development, educators may experience diminished confidence in addressing new classroom difficulties due to a lack of exposure to contemporary teaching methodologies, research, and resources (
                <xref ref-type="bibr" rid="ref19">Jones &amp; Macpherson, 2021</xref>).</p>
            <p>In Indonesia, teachers&#x2019; professional development programs have been implemented for decades utilising diverse methodologies, concepts, and designs traceable to the 1970s (
                <xref ref-type="bibr" rid="ref9">Farabi, Bahar &amp; Agam, 2025</xref>; 
                <xref ref-type="bibr" rid="ref27">Revina et al., 2023</xref>; 
                <xref ref-type="bibr" rid="ref28">Revina et al., 2020</xref>; 
                <xref ref-type="bibr" rid="ref39">Tanang &amp; Abu, 2014</xref>). Presently, the teacher development programs are based on Law Number 14 of 2005, which seeks to enhance teachers&#x2019; pedagogical and professional competencies (
                <xref ref-type="bibr" rid="ref15">Government of the Republic of Indonesia, 2005</xref>). The government is implementing a program known as teachers&#x2019; certification to enhance their competency (
                <xref ref-type="bibr" rid="ref35">Purnamansyah, 2018</xref>). It emphasises instructors&#x2019; deficiencies in subject area expertise and pedagogical competencies (
                <xref ref-type="bibr" rid="ref27">Revina et al., 2023</xref>; 
                <xref ref-type="bibr" rid="ref28">Revina et al., 2020</xref>).</p>
            <p>Scholarly debates frequently arise on the efficacy and consequences of teachers&#x2019; professional development in Indonesia. Policy scholars such as 
                <xref ref-type="bibr" rid="ref28">Revina et al. (2020)</xref> and 
                <xref ref-type="bibr" rid="ref27">Revina et al. (2023)</xref> focus on teachers&#x2019; professional development, which, despite prolonged efforts, exhibits stagnation and minimal impact on the quality of both instructors and pupils (
                <xref ref-type="bibr" rid="ref28">Revina et al., 2020</xref>). Conversely, 
                <xref ref-type="bibr" rid="ref35">Purnamansyah (2018)</xref> discovered that certified teachers who succeed in the competency test exhibit professional proficiency, encompassing subject mastery and ongoing professional advancement through reflective practice, thereby indicating the efficacy of the government program for teacher professional development. 
                <xref ref-type="bibr" rid="ref24">Rasmitadila et al. (2025)</xref> indicated that engagement in teachers&#x2019; professional development programs enhances the competencies of practicing teachers and fosters their ongoing professional development. Moreover, educators&#x2019; professional growth significantly influences student performance (
                <xref ref-type="bibr" rid="ref25">Rahmi and Rassanjani, 2025</xref>).</p>
            <p>Nevertheless, numerous studies frequently overlook the teachers&#x2019; personal viewpoints regarding their needs and compensation. The evaluation method frequently regards teachers merely as objects of study (see 
                <xref ref-type="bibr" rid="ref7">Costa and Ceccim, 2022</xref>). Research conducted by 
                <xref ref-type="bibr" rid="ref28">Revina et al. (2020)</xref> and 
                <xref ref-type="bibr" rid="ref27">Revina et al. (2023)</xref> examines the contributions of instructors to educational quality and student outcomes. 
                <xref ref-type="bibr" rid="ref35">Purnamansyah (2018)</xref> and 
                <xref ref-type="bibr" rid="ref24">Rasmitadila et al. (2025)</xref> examine their contributions to the outcomes of teachers&#x2019; assessments. As a result, the recommendations frequently emphasise the methodology, design, and actions to be taken about the educators that disregard the teachers&#x2019; point of view of what they actually perceived from the program and what they expect for their future career (e.g., 
                <xref ref-type="bibr" rid="ref30">Setiadi &amp; Muhafidin, 2024</xref>; 
                <xref ref-type="bibr" rid="ref42">Wongso, Aida, &amp; Habibi, 2024</xref>; 
                <xref ref-type="bibr" rid="ref5">Chambers-Ju, Beatty, &amp; Pramana, 2022</xref>). Therefore, it is essential to undertake a complete study that emphasises instructors&#x2019; perspectives.</p>
            <p>This study will examine the effects of teachers&#x2019; professional development from the teachers&#x2019; perspectives. The objective is to ascertain instructors&#x2019; sentiments regarding their attitudes, values, motivation, and skills following participation in professional development therefore Kirkpatrick Model approach was applied (
                <xref ref-type="bibr" rid="ref21">Kirkpatrick &amp; Kirkpatrick, 2006</xref>). Further, this study will examine the perspectives of vocational high school teachers in Indonesia who participated in the government-conducted teacher development program based on longitudinal surveys conducted over four years from 2020 to 2023. Given that teachers&#x2019; development is an ongoing process, monitoring it over the years will provide valuable data for future policymakers to consider in their policy design (
                <xref ref-type="bibr" rid="ref38">Tamkin, Yarnall, &amp; Kerrin, 2002</xref>).</p>
            <p>The study is significant to be conducted as the study which employed the Kirkpatrick Model with a longitudinal approach that focuses on teachers&#x2019; perspectives is rarely to be carried out. The study from 
                <xref ref-type="bibr" rid="ref27">Revina et al. (2023)</xref> focuses on the development of the teachers&#x2019; development program via documentation, interviews and observation that measure all of the results to national development. Meanwhile, 
                <xref ref-type="bibr" rid="ref25">Rahmi and Rassanjani (2025)</xref> measure the management, pedagogy, educational practices, and assessment methodologies using a qualitative approach, via systematic review analysis to assess the effectiveness of the program. Thus, the past studies strongly encouraged the researchers to conduct the present study.</p>
            <p>The research data is obtained from the participants who enrolled in a government-sponsored professional development program under the The Directorate General of Vocational Education Ministry of Primary and Secondary Education in Indonesia (MoPSE) from 2020 to 2023. All participants underwent a systematic training program comprising online and offline instruction, internships, and coaching across three training cycles. The program aims to enhance the professional development of educators in the domains of business and tourism. The programs involved vocational high school teachers throughout Indonesia.</p>
            <p>Ultimately, addressing the deficiency in existing literature regarding the effects of teachers&#x2019; professional development in Indonesia exclusively from the teachers&#x2019; viewpoints. This study seeks to ascertain instructors&#x2019; perspectives following training activities including attitudes, values, motivation, and skills. The professional development occurred from 2020 to 2023. Consequently, the research utilises a longitudinal data gathering methodology. This study is anticipated to provide insights for future policy creation that incorporates the perspectives of vocational teachers.</p>
            <sec id="sec6">
                <title>Vocational teachers&#x2019; professional development in Indonesia</title>
                <p>The vocational education policy in Indonesia is governed by several legal instruments and strategic planning documents, including the National Education System Law No. 20 of 2003, the Labour Law No. 13 of 2003, and Presidential Instruction No. 9 of 2016 regarding the Revitalisation of Vocational High Schools (SMK). The primary objective of these policies is to enhance the alignment of vocational education with labour market requirements via a Public&#x2013;Private Partnership (PPP) model and the principle of link and match (
                    <xref ref-type="bibr" rid="ref13">Government of the Republic of Indonesia, 2016</xref>; 
                    <xref ref-type="bibr" rid="ref16">Government of the Republic of Indonesia, 2003a</xref>; 
                    <xref ref-type="bibr" rid="ref17">Government of the Republic of Indonesia, 2003b</xref>). The government underscores the significance of vocational education as educational entities proficient in generating graduates equipped with technical, management, and interpersonal abilities that correspond with national and worldwide industry advancements (
                    <xref ref-type="bibr" rid="ref41">UNESCO-UNEVOC, 2020</xref>).</p>
                <p>The Ministry of Primary and Secondary Education (Kemendikdasmen) offers pre-service and in-service training programs to facilitate competency development for vocational teachers. These initiatives are underpinned by national regulations, notably Ministerial Regulation No. 3/2021, which stipulates the function of Vocational Teacher Quality Assurance Development Centres (BB/BPPMPV) in competency enhancement alongside Ministerial Regulations No. 16/2007 and No. 143/2014, which formally establish collaborative teacher development forums via KKG and MGMP. Activities encompass teacher competency certification, qualification enhancement training, competency-based training, and train-the-trainer programs aimed at augmenting teachers&#x2019; capacity to impart skills pertinent to current demands (
                    <xref ref-type="bibr" rid="ref11">Government of the Republic of Indonesia, 2021</xref>; 
                    <xref ref-type="bibr" rid="ref12">Government of the Republic of Indonesia, 2017</xref>; 
                    <xref ref-type="bibr" rid="ref14">Government of the Republic of Indonesia, 2007</xref>; 
                    <xref ref-type="bibr" rid="ref17">Government of the Republic of Indonesia, 2003b</xref>).</p>
            </sec>
            <sec id="sec7">
                <title>Debates on teachers&#x2019; professional development in Indonesia</title>
                <p>Academics hold varying viewpoints regarding the state of professional development in Indonesia. Scholars are polarised; some concur that professional development in Indonesia positively influences teachers, while others disagree. Researchers such as 
                    <xref ref-type="bibr" rid="ref27">Revina et al. (2023)</xref>, 
                    <xref ref-type="bibr" rid="ref2">Arif et al. (2022)</xref>, and 
                    <xref ref-type="bibr" rid="ref28">Revina et al. (2020)</xref> discovered that professional development for teachers in Indonesia is unlikely to significantly affect their competencies and attitudes. On a larger scale, they discovered that the kids&#x2019; academic outcomes are deficient, perhaps due to the shortcomings of the teachers&#x2019; professional development program in Indonesia. Contrary to this, research by 
                    <xref ref-type="bibr" rid="ref25">Rahmi and Rassanjani (2025)</xref> indicates that the teachers&#x2019; professional development program in Indonesia positively influences teachers&#x2019; instructional delivery, self-esteem, and students&#x2019; academic outcomes. The study corroborates the findings of 
                    <xref ref-type="bibr" rid="ref24">Rasmitadila et al. (2025)</xref> that the professional development program for teachers in Indonesia enhances their proficiency. It also significantly influences teachers&#x2019; motivation (
                    <xref ref-type="bibr" rid="ref20">Kholifah et al., 2024</xref>; 
                    <xref ref-type="bibr" rid="ref36">Purwanti &amp; Zarger, 2025</xref>). Furthermore, 
                    <xref ref-type="bibr" rid="ref18">Herda et al. (2024)</xref> discovered that the teachers&#x2019; development program could influence instructors&#x2019; views. Ultimately, there is a divergent outcome that underscores the need of conducting this study.</p>
            </sec>
        </sec>
        <sec id="sec8" sec-type="methods">
            <title>Method</title>
            <p>In light of the research purpose, the study utilised a quantitative methodology within a longitudinal design. It refers to a methodology in which researchers gather and analyse quantitative data within a singular study to attain an in-depth understanding of the research problem, using repeated observations of the same individuals over a lengthy period (
                <xref ref-type="bibr" rid="ref32">Shorten &amp; Smith, 2017</xref>; 
                <xref ref-type="bibr" rid="ref33">Plano Clark et al., 2014</xref>). Furthermore, 
                <xref ref-type="bibr" rid="ref6">Creswell (2018)</xref> asserts that quantitative research is a process that produces numerical data suitable for statistical analysis. The connotation process can be delineated in 
                <xref ref-type="fig" rid="f1">Figure 1</xref>.</p>
            <fig fig-type="figure" id="f1" orientation="portrait" position="float">
                <label>
Figure 1. </label>
                <caption>
                    <title>Research design.</title>
                </caption>
                <graphic id="gr1" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/192946/1494b019-8689-4754-a5d1-7c4b29c3d69c_figure1.gif"/>
            </fig>
            <p>The study will utilise the evaluation approach proposed by Kirkpatrick (
                <xref ref-type="bibr" rid="ref21">Kirkpatrick and Kirkpatrick, 2006</xref>). This study will test only three levels, specifically level 1, level two and level three. In level 1 - reaction, we evaluate motivation; in level 2 - learning, we assess skills; and in level 3, we examine values and attitudes. Numerous researchers critique the hierarchical placement of the level (e.g., 
                <xref ref-type="bibr" rid="ref26">Reio et al., 2017</xref>; 
                <xref ref-type="bibr" rid="ref3">Bates, 2004</xref>). Consequently, we see all levels as structural elements of equal significance to the effects of the participants, thus circumventing the hierarchical positioning of these levels.</p>
            <sec id="sec9">
                <title>Research participants</title>
                <p>This study&#x2019;s participants consisted of vocational high school educators in Indonesia. They were instructing in business and tourism, particularly in marketing. The method of participant selection employed convenient sampling, relying on data availability (
                    <xref ref-type="bibr" rid="ref37">Taherdoost, 2016</xref>). The research included 944 instructors as respondents, comprising 28.87% male teachers (273) and 72.13% female teachers (671). The participants originated from 34 provinces in Indonesia. The majority of participants originate from West Java, Central Java, and East Java, comprising approximately 40% of the total. The intricate construction is illustrated in 
                    <xref ref-type="fig" rid="f2">
Figure 2</xref>. They participated in the professional development programs administered by The Directorate General of Vocational Education under the Ministry of Primary and Secondary Education in Indonesia (MoPSE) from 2020 to 2023. They engaged in three training cycles that encompassed online and offline instruction, internships, and coaching.</p>
                <fig fig-type="figure" id="f2" orientation="portrait" position="float">
                    <label>
Figure 2. </label>
                    <caption>
                        <title>Participant distribution by province.</title>
                    </caption>
                    <graphic id="gr2" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/192946/1494b019-8689-4754-a5d1-7c4b29c3d69c_figure2.gif"/>
                </fig>
                <p>

                    <bold>

                        <italic toggle="yes">Data collection</italic>
</bold>
                </p>
                <p>This study utilised a survey method for data collection. It gathers data from chosen individuals using questionnaires to comprehend their perspectives, behaviours, and personal characteristics (
                    <xref ref-type="bibr" rid="ref34">Ponto, 2015</xref>). This methodology is appropriate for extensive research that effectively gathers data (
                    <xref ref-type="bibr" rid="ref6">Creswell, 2018</xref>). The study participants completed an online survey following their involvement in the training program. The questionnaire employed a Likert scale methodology. 
                    <xref ref-type="bibr" rid="ref22">Koo and Yang (2025)</xref> describe a Likert scale as a measurement instrument intended to assess individuals&#x2019; perspectives by offering statements and requesting them to rate their level of agreement or disagreement using a series of ordered response alternatives. Consequently, it is pertinent to the objectives and design of this study. The participants completed both quantitative and qualitative enquiries and statements. All questionnaire items were derived from The Directorate General of Vocational Education, Ministry of Primary and Secondary Education in Indonesia (MoPSE) for the Upskilling and Reskilling Program (
                    <xref ref-type="bibr" rid="ref8">Directorate General of Vocational Education, 2020</xref>).</p>
                <p>

                    <bold>

                        <italic toggle="yes">Data analysis</italic>
</bold>
                </p>
                <p>The study utilised a quantitative methodology involving surveys, and the data will be analysed through percentage data analysis. Percentage data analysis entails transforming raw values into percentages to standardise outcomes, facilitating data comparison and proportion identification (
                    <xref ref-type="bibr" rid="ref31">Shapiro, 2008</xref>). Furthermore, colour coding and visualisation will be utilised to enhance comprehension of the data. The analysed data will be further validated against pertinent prior studies, established frameworks, and theories.</p>
                <p>Statistical Percentage Formula:
                    <disp-formula id="e1">

                        <mml:math display="block">
                            <mml:mi>P</mml:mi>
                            <mml:mrow>
                                <mml:mo stretchy="true">(</mml:mo>
                                <mml:mi>x</mml:mi>
                                <mml:mo stretchy="true">)</mml:mo>
                            </mml:mrow>
                            <mml:mo>=</mml:mo>
                            <mml:mrow>
                                <mml:mo stretchy="true">(</mml:mo>
                                <mml:mfrac>
                                    <mml:mi>x</mml:mi>
                                    <mml:mrow>
                                        <mml:msubsup>
                                            <mml:mo>&#x2211;</mml:mo>
                                            <mml:mrow>
                                                <mml:mi>i</mml:mi>
                                                <mml:mo>=</mml:mo>
                                                <mml:mn>1</mml:mn>
                                            </mml:mrow>
                                            <mml:mi>n</mml:mi>
                                        </mml:msubsup>
                                        <mml:msub>
                                            <mml:mi>x</mml:mi>
                                            <mml:mi>i</mml:mi>
                                        </mml:msub>
                                    </mml:mrow>
                                </mml:mfrac>
                                <mml:mo stretchy="true">)</mml:mo>
                            </mml:mrow>
                            <mml:mo>&#x00d7;</mml:mo>
                            <mml:mn>100</mml:mn>
                            <mml:mo>%</mml:mo>
                        </mml:math>
</disp-formula>
                </p>
                <p>Where:</p>
                <p>

                    <inline-formula>

                        <mml:math display="inline">
                            <mml:mi>x</mml:mi>
                            <mml:mo>=</mml:mo>
                        </mml:math>
</inline-formula> count of the category of interest</p>
                <p>

                    <inline-formula>

                        <mml:math display="inline">
                            <mml:msubsup>
                                <mml:mo>&#x2211;</mml:mo>
                                <mml:mrow>
                                    <mml:mi>i</mml:mi>
                                    <mml:mo>=</mml:mo>
                                    <mml:mn>1</mml:mn>
                                </mml:mrow>
                                <mml:mi>n</mml:mi>
                            </mml:msubsup>
                            <mml:msub>
                                <mml:mi>x</mml:mi>
                                <mml:mi>i</mml:mi>
                            </mml:msub>
                        </mml:math>
</inline-formula> = total number of observations (the whole)</p>
                <p>

                    <inline-formula>

                        <mml:math display="inline">
                            <mml:mi>n</mml:mi>
                        </mml:math>
</inline-formula> = number of categories</p>
                <p>Adapted from 
                    <xref ref-type="bibr" rid="ref40">Triola (2020)</xref>
                </p>
                <p>

                    <bold>

                        <italic toggle="yes">Validity and reliability</italic>
</bold>
                </p>
                <p>We employ an expert judgement technique to guarantee the quality and dependability of the data. This approach enables researchers to authenticate the validity and reliability of the procedure and data analysis through expert consultation (
                    <xref ref-type="bibr" rid="ref23">Nguni et al., 2024</xref>). This study involved consultation with a minimum of two specialists, and based on analytical considerations, the data and the analysis procedure are deemed legitimate and credible.</p>
                <p>

                    <bold>Ethical considerations</bold>
                </p>
                <p>All of the research processes have followed the protocol and procedures which were mandated by the letter of decree number 008/UN27.02/HK/2016 from the Governing Body of Universitas Sebelas Maret. The participant data, including names, institutions, and any identifiable information, is eliminated during the data cleaning and analysis process. Consent was obtained from participants when they agreed and submitted their data and took part in the study process at the end of the questionnaire form. Thus, the participants gave the written consent. Ultimately, all procedures were performed in accordance with the ethical standards of the Declaration of Helsinki, ensuring respect for participants&#x2019; rights and adherence to the authors&#x2019; ethical responsibilities.</p>
                <p>

                    <bold>Findings</bold>
                </p>
                <p>Following a thorough analysis of the study&#x2019;s data, the findings of instructors&#x2019; viewpoints post-training&#x2014;encompassing motivation, skills, values and attitudes acquired throughout professional development from 2020 to 2023&#x2014;will be provided. This study will evaluate each component individually to enhance the clarity of the information. The findings will guide the outcomes of the data analysis.</p>
                <p>

                    <bold>

                        <italic toggle="yes">Level 1: Teachers&#x2019; Motivations Post Training Program</italic>
</bold>
                </p>
                <p>This study evaluated motivation, a fundamental psychological driver of individuals&#x2019; actions and aspirations. A four-point Likert scale, spanning from strongly disagree to strongly agree, was utilised to assess participants&#x2019; degrees of agreement with various assertions. The gathered responses indicate a markedly favourable trend. On average, over 98% of participants chose responses within the affirmative range (agree and strongly agree), signifying a substantial motivational enhancement subsequent to their involvement in the professional development sessions.</p>
                <p>The motivation to participate in future professional development events was exceptionally high. Approximately 76.65% of respondents indicated strong agreement, while 27.67% stated agreement with their readiness to participate in future professional development programs. A limited percentage of teachers opted to disagree or strongly disagree, constituting a statistically insignificant minority. A similar trend was noted in participants&#x2019; motivation to learn following the completion of the program. Approximately 74.65% showed strong agreement, while 23.36% conveyed agreement, indicating that the training effectively enhanced their participation in learning activities. A small subset&#x2014;approximately 2%&#x2014;expressed dissatisfaction or strong disagreement, suggesting that the training did not significantly improve their motivation.</p>
                <p>Overall, despite a minor percentage of adverse responses, the evidence robustly suggests that the majority of participants experienced heightened motivation subsequent to their involvement in the program. The findings indicate that the teacher development program was seen as advantageous and motivated educators to seek continuous professional enhancement. A more comprehensive distribution of replies is illustrated in 
                    <xref ref-type="fig" rid="f3">
Figure 3</xref>.</p>
                <fig fig-type="figure" id="f3" orientation="portrait" position="float">
                    <label>
Figure 3. </label>
                    <caption>
                        <title>Teachers&#x2019; motivation post training program.</title>
                    </caption>
                    <graphic id="gr3" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/192946/1494b019-8689-4754-a5d1-7c4b29c3d69c_figure3.gif"/>
                </fig>
                <p>

                    <bold>

                        <italic toggle="yes">Level 2: Teachers&#x2019; Skills Post Training Program</italic>
</bold>
                </p>
                <p>The study participants were also requested to assess their perceived skills enhancement following their involvement in the teachers&#x2019; development programs, utilising a four-point Likert scale with the options: strongly disagree, disagree, agree, and highly agree. The assessment concentrated on several fundamental characteristics deemed vital in professional education: creativity and innovation, pedagogical skills, communication, conflict management, decision-making, adaptation, and coaching.</p>
                <p>The analysis of the responses reveals an overall favourable trend. The majority of educators reported enhancements in nearly all assessed domains, with overall agreement rates surpassing 90%. Specifically, communication was identified as the most enhanced competence, with respondents primarily selecting and expressing strong agreement. Creativity, creativity, and decision-making received substantial endorsement. Notwithstanding the predominantly favourable distribution, the data nevertheless indicates regions of worry. Approximately 10% of respondents indicated dissent concerning enhancements in conflict management, signifying an ongoing necessity for techniques to address interpersonal or classroom tensions. Approximately 7% of participants indicated no substantial improvement in coaching skills. These findings underscore potential deficiencies in the existing framework of the training modules. Addressing these deficiencies may necessitate more focused interventions, such as practical simulations, prolonged mentorship sessions, or subsequent courses aimed at reinforcing behavioural competences. Although the descriptive results suggest a largely positive view of the program&#x2019;s impact, the existence of a significant number of teachers who did not observe progress indicates the necessity for more evaluation. A more thorough analysis of these perceptions is shown in 
                    <xref ref-type="fig" rid="f4">
Figure 4</xref>.</p>
                <fig fig-type="figure" id="f4" orientation="portrait" position="float">
                    <label>
Figure 4. </label>
                    <caption>
                        <title>Teachers&#x2019; skills post training program.</title>
                    </caption>
                    <graphic id="gr4" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/192946/1494b019-8689-4754-a5d1-7c4b29c3d69c_figure4.gif"/>
                </fig>
                <p>

                    <bold>

                        <italic toggle="yes">Level 3: Teachers&#x2019; Values Post Trainings Program</italic>
</bold>
                </p>
                <p>A crucial sign of a professional development program&#x2019;s performance is its impact on participants&#x2019; values and behavioural inclinations. This study analysed participants&#x2019; values to see if the training enhanced their readiness to implement their new knowledge within their institutional contexts. Two value-oriented factors were examined: the goal to disseminate information among colleagues and the intention to interact within their educational communities.</p>
                <p>The results indicate a primarily favourable trend. A significant majority of participants expressed positive sentiments (agree and strongly agree), indicating that the training not only improved their skills but also cultivated a sense of duty about knowledge sharing and professional teamwork. Almost all participants expressed a willingness to collaborate with colleagues to promote school-level improvement efforts.</p>
                <p>A comparable inclination was noted about their goal to disseminate knowledge acquired during the course. Approximately 31.11% of respondents strongly concurred, while 62.84% felt that they were inclined to share their acquired knowledge with coworkers. Approximately 5% of participants expressed disagreement or strong disagreement, suggesting they did not perceive the program as a catalyst for information sharing. Despite the relatively tiny percentage, its existence necessitates attention, as it may indicate contextual obstacles such as a deficient collaborative school culture, limitations in personal confidence, or a perceived lack of relevance of the topic within peer situations. These criteria underscore that skill enhancement alone may be inadequate; the institutional environment is also essential in determining whether teachers feel empowered to participate in collaborative activities.</p>
                <p>Notwithstanding this modest category of adverse feedback, the comprehensive data unequivocally indicates that the program promoted values consistent with a collaborative culture and knowledge-sharing. The comprehensive distribution of these responses is illustrated in 
                    <xref ref-type="fig" rid="f5">
Figure 5</xref>.</p>
                <fig fig-type="figure" id="f5" orientation="portrait" position="float">
                    <label>
Figure 5. </label>
                    <caption>
                        <title>Teachers&#x2019; values post training program.</title>
                    </caption>
                    <graphic id="gr5" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/192946/1494b019-8689-4754-a5d1-7c4b29c3d69c_figure5.gif"/>
                </fig>
                <p>

                    <bold>

                        <italic toggle="yes">Level 4: Teachers&#x2019; Attitudes Post Trainings Program</italic>
</bold>
                </p>
                <p>The results demonstrate that the training program significantly enhanced participants&#x2019; attitudes. The exceptionally elevated degree of consensus (about 98%). This study assessed opinions towards professional etiquette and collaborative efforts. The study examines the participants&#x2019; levels of agreement or disagreement with the statement concerning the attitudes they were expected to adopt following their participation in the professional development program.</p>
                <p>Regarding professional decorum, 42.76% expressed strong agreement, while 55.59% indicated agreement. The participants exhibit strong consensus regarding the professional attitudes acquired as educators after completing the curriculum. Approximately 1% of the participants express significant disagreement or disagreement with the assertion that the program lacks an influence on their professional development.</p>
                <p>Subsequently, regarding the collaborative movement, around 39.64% of participants strongly concur, while 59.11% feel that alignment with their peers in their surroundings is necessary. In this research evaluation, participants reported that the program influenced their attitudes towards collective movements.</p>
                <p>The results indicate that the training program significantly influenced participants&#x2019; attitudes, establishing professional etiquette and collaborative momentum as essential factors for school growth. Nonetheless, ongoing surveillance is advised to guarantee that these attitudinal improvements result in enduring practice over time. The comprehensive information can be found in 
                    <xref ref-type="fig" rid="f6">
Figure 6</xref>.</p>
                <fig fig-type="figure" id="f6" orientation="portrait" position="float">
                    <label>
Figure 6. </label>
                    <caption>
                        <title>Teachers&#x2019; attitudes post training program.</title>
                    </caption>
                    <graphic id="gr6" orientation="portrait" position="float" xlink:href="https://f1000research-files.f1000.com/manuscripts/192946/1494b019-8689-4754-a5d1-7c4b29c3d69c_figure6.gif"/>
                </fig>
            </sec>
        </sec>
        <sec id="sec10" sec-type="discussion">
            <title>Discussion</title>
            <p>This study utilised the Kirkpatrick evaluation model to evaluate the perceived impact of a national professional development program on vocational educators throughout Indonesia. Instead of perceiving the model as hierarchical, the study regarded each level as equally significant in representing various dimensions of impact.</p>
            <p>Participants exhibited considerable enthusiasm for the training program, as evidenced by their high levels of agreement regarding their willingness to attend similar programs in the future. The results indicate that the program successfully cultivated positive emotional responses and conveyed the importance of continuous professional development. The perceived significance of the content, the practical nature of instructional delivery, and its alignment with educators&#x2019; pedagogical needs are likely key factors influencing participants&#x2019; responses. These findings align with evidence presented by 
                <xref ref-type="bibr" rid="ref20">Kholifah et al. (2024)</xref> and 
                <xref ref-type="bibr" rid="ref36">Purwanti &amp; Zarger (2025)</xref>, who recognised increased teacher motivation as a consistent result of engaging in professional development.</p>
            <p>Educators indicated significant enhancements in the fundamental skills evaluated, especially in communication, creativity and innovation, and decision-making. These competences pertain to the cognitive and practical aspects of teaching practice and are crucial in vocational settings where instructional clarity, adaptive reasoning, and innovation are needed for industry-relevant education. Significantly, fewer respondents indicated minimal improvements in conflict management and coaching skills&#x2014;domains that typically necessitate prolonged practice, mentorship, and feedback for enhancement. This pattern corresponds with 
                <xref ref-type="bibr" rid="ref24">Rasmitadila et al. (2025)</xref> and 
                <xref ref-type="bibr" rid="ref25">Rahmi and Rassanjani (2025)</xref>, who noted skill enhancements post-training, although contradicts 
                <xref ref-type="bibr" rid="ref27">Revina et al. (2023)</xref>, who discovered that teacher professional development frequently does not result in significant competency improvement. Additionally, 
                <xref ref-type="bibr" rid="ref45">Yansyah and Dwintan (2024)</xref> also suggest considering the diversity of participants, including their geographical context, particularly those from rural areas.</p>
            <p>Educators also indicated favourable changes in professional values and dispositions. The program promoted a culture of collective growth through strong intentions to collaborate and share knowledge, rather than focussing on isolated individual improvement. Heightened dedication to professional etiquette and initiatives for school enhancement further signifies behavioural internalisation, implying that training results were regarded not solely as cognitive advancements but as professional standards. A minority expressed dissent, likely due to school-level constraints, leadership dynamics, or time pressures, rather than the ineffectiveness of the program. These findings are consistent with 
                <xref ref-type="bibr" rid="ref25">Rahmi &amp; Rassanjani (2025)</xref> and 
                <xref ref-type="bibr" rid="ref18">Herda et al. (2024)</xref>, but contrast with 
                <xref ref-type="bibr" rid="ref2">Arif et al. (2022)</xref>, who identified a minimal attitudinal effect from professional development.</p>
            <p>Participants primarily situated themselves within the affirmative spectrum regarding motivation, learning, and behavioural domains (agree and strongly agree). The results demonstrate that the training enhanced teachers&#x2019; skills and influenced their professional identity and collaborative approach (
                <xref ref-type="bibr" rid="ref1">AbdulRab, 2023</xref>; 
                <xref ref-type="bibr" rid="ref29">Salmer&#x00f3;n Aroca, Moreno Abell&#x00e1;n, &amp; Mart&#x00ed;nez de Miguel L&#x00f3;pez, 2023</xref>; 
                <xref ref-type="bibr" rid="ref10">Germuth, 2018</xref>). These results highlight the significance of continuous, iterative professional development over isolated interventions. Programs that emphasise relevance, practical skill development, and collaborative culture can produce effects that transcend individual educators and foster school-wide enhancement.</p>
        </sec>
        <sec id="sec11" sec-type="conclusion">
            <title>Conclusion</title>
            <p>This study investigates the impact of the vocational teacher development program in Indonesia on teachers&#x2019; competences. The study employed a three-level Kirkpatrick evaluation framework within a longitudinal design, resulting in a four-year assessment of participants&#x2019; experiences and outcomes. The results demonstrate that the majority of educators expressed favourable views towards the program. Significant enhancements were noted in their motivation and professional competencies, including alterations in values and attitudes&#x2014;indicative of the program&#x2019;s substantial influence. The study underscores the need for continuous professional development opportunities for educators. Participants showed eagerness for forthcoming training and a belief that the skills gained from the program influenced their professional attitudes. Consequently, it is advisable that such initiatives be executed not as singular interventions, but as components of a sustained, systematic strategy designed to enhance vocational teachers&#x2019; competencies over time.</p>
            <sec id="sec12">
                <title>Limitation and future research suggestion</title>
                <p>This study is a comprehensive analysis conducted solely from the teachers&#x2019; perspective. Thus, the results are confined to self-reported impressions and experiences, lacking validation from external evaluators or other stakeholders. Subsequent research should utilise many methodological approaches, including direct classroom observations, tracer studies to evaluate impacts on students&#x2019; career paths, and assessments involving supervisors and school administrators. Integrating these supplementary viewpoints and methodologies would facilitate a more thorough evaluation of the program&#x2019;s efficacy and yield a deeper comprehension of its enduring results.</p>
            </sec>
        </sec>
    </body>
    <back>
        <sec id="sec15" sec-type="data-availability">
            <title>Data availability</title>
            <p>

                <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.6084/m9.figshare.30925796">https://doi.org/10.6084/m9.figshare.30925796</ext-link> (
                <xref ref-type="bibr" rid="ref43">Yansyah, et al., 2025a</xref>). Data are available under the terms of the 
                <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
            <sec id="sec16">
                <title>Extended data</title>
                <p>Questionnaire: 
                    <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.6084/m9.figshare.30926021">https://doi.org/10.6084/m9.figshare.30926021</ext-link> (
                    <xref ref-type="bibr" rid="ref44">Yansyah, et al., 2025b</xref>). Data are available under the terms of the 
                    <ext-link ext-link-type="uri" xlink:href="https://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International license</ext-link> (CC-BY 4.0).</p>
            </sec>
        </sec>
        <ref-list>
            <title>References</title>
            <ref id="ref1">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>AbdulRab</surname>
                            <given-names>HMA</given-names>
                        </name>
</person-group>:
                    <article-title>Teacher professional development in the 21st century.</article-title>
                    <source>

                        <italic toggle="yes">African Journal of Education and Practice.</italic>
</source>
                    <year>2023</year>;<volume>9</volume>(<issue>4</issue>):<fpage>39</fpage>&#x2013;<lpage>50</lpage>.</mixed-citation>
            </ref>
            <ref id="ref2">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Arif</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pramana</surname>
                            <given-names>RP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rarasati</surname>
                            <given-names>N</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <source>

                        <italic toggle="yes">Nurturing learning culture among teachers: Demand-driven teacher professional development and the development of teacher learning culture in Jakarta, Indonesia (RISE Working Paper Series 22/117).</italic>
</source>
                    <publisher-name>RISE &amp; SMERU Research Institute</publisher-name>;<year>2022</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://rise.smeru.or.id/sites/default/files/publication/Nurturing%20Learning%20Culture%20among%20Teachers%20Indonesia.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref3">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bates</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <article-title>A critical analysis of evaluation practice: The Kirkpatrick model and the principle of beneficence.</article-title>
                    <source>

                        <italic toggle="yes">Eval. Program Plann.</italic>
</source>
                    <year>2004</year>;<volume>27</volume>(<issue>3</issue>):<fpage>341</fpage>&#x2013;<lpage>347</lpage>.
                    <pub-id pub-id-type="doi">10.1016/j.evalprogplan.2004.04.011</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref4">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Bolt</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <chapter-title>Professional development: Then and now.</chapter-title>
                    <source>

                        <italic toggle="yes">IADIS International Conference on Cognition and Exploratory Learning in Digital Age (CELDA 2012).</italic>
</source>
                    <year>2012</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://files.eric.ed.gov/fulltext/ED542831.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref5">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Chambers-Ju</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Beatty</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pramana</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Exploring the politics of expertise: The Indonesian Teachers&#x2019; Union and education policy, 2005-2020 (RISE Working Paper No. 22/101).</italic>
</source>
                    <publisher-name>RISE Programme</publisher-name>;<year>2022</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://riseprogramme.org/sites/default/files/2022-07/Exploring_Politics_Expertise_Indonesian_Teachers_Union_Education_Policy_2005-2020.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref6">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Creswell</surname>
                            <given-names>JW</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Qualitative inquiry &amp; research design: Choosing among five approaches.</italic>
</source>
                    <publisher-loc>London</publisher-loc>:
                    <publisher-name>Sage</publisher-name>;<year>2018</year>.</mixed-citation>
            </ref>
            <ref id="ref7">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Costa</surname>
                            <given-names>C d S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Ceccim</surname>
                            <given-names>RB</given-names>
                        </name>
</person-group>:
                    <article-title>Teachers&#x2019; health and research: subject or object, seldom as affect.</article-title>
                    <source>

                        <italic toggle="yes">Educ. Pesqui., S&#x00e3;o Paulo.</italic>
</source>
                    <year>2022</year>;<volume>48</volume>:<fpage>e242423</fpage>.
                    <pub-id pub-id-type="doi">10.1590/S1678-4634202248242423eng</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref8">
                <mixed-citation publication-type="book">
                    <collab>Directorate General of Vocational Education</collab>:
                    <source>

                        <italic toggle="yes">User guide for the SIMPKB application for the Upskilling and Reskilling Program for Vocational High School Teachers.</italic>
</source>
                    <publisher-name>Ministry of Education and Culture</publisher-name>;<year>2020</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://bantuan.simpkb.id/books/simpkb-upskill-vokasi-smk/simpkb-upskill-vokasi-smk.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref9">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Farabi</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bahar</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Agam</surname>
                            <given-names>AA</given-names>
                        </name>
</person-group>:
                    <article-title>Teacher professional development in the 21st century: A cross-national analysis of policy and practice.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Education and Social Science.</italic>
</source>
                    <year>2025</year>;<volume>2</volume>(<issue>1</issue>):<fpage>25</fpage>&#x2013;<lpage>31</lpage>.
                    <pub-id pub-id-type="doi">10.70716/jess.v2i1.200</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref10">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Germuth</surname>
                            <given-names>AA</given-names>
                        </name>
</person-group>:
                    <article-title>
                        <italic toggle="yes">Professional development that changes teaching and improves learning.</italic>
                    </article-title>
                    <source>

                        <italic toggle="yes">Journal of Interdisciplinary Teacher Leadership.</italic>
</source>
                    <year>2018</year>;<volume>2</volume>(<issue>1</issue>).
                    <ext-link ext-link-type="uri" xlink:href="https://files.eric.ed.gov/fulltext/EJ1315523.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref11">
                <mixed-citation publication-type="book">
                    <collab>Government of the Republic of Indonesia</collab>:
                    <source>

                        <italic toggle="yes">Regulation of the Minister of Education and Culture of the Republic of Indonesia Number 3 Year 2021 concerning the Organization and Work Procedures of Vocational Education Quality Assurance Development Centers (BPPMPV).</italic>
</source>
                    <publisher-name>Ministry of Education and Culture</publisher-name>;<year>2021</year>.</mixed-citation>
            </ref>
            <ref id="ref12">
                <mixed-citation publication-type="book">
                    <collab>Government of the Republic of Indonesia</collab>:
                    <source>

                        <italic toggle="yes">Government Regulation of the Republic of Indonesia Number 19 Year 2017 concerning Teachers (Amendment to Government Regulation Number 74 Year 2008).</italic>
</source>
                    <publisher-name>Ministry of State Secretariat</publisher-name>;<year>2017</year>.</mixed-citation>
            </ref>
            <ref id="ref13">
                <mixed-citation publication-type="book">
                    <collab>Government of the Republic of Indonesia</collab>:
                    <source>

                        <italic toggle="yes">Presidential Instruction Number 9 Year 2016 on the Revitalization of Vocational High Schools.</italic>
</source>
                    <publisher-name>Cabinet Secretariat</publisher-name>;<year>2016</year>.</mixed-citation>
            </ref>
            <ref id="ref14">
                <mixed-citation publication-type="book">
                    <collab>Government of the Republic of Indonesia</collab>:
                    <source>

                        <italic toggle="yes">Regulation of the Minister of National Education of the Republic of Indonesia Number 16 Year 2007 concerning Academic Qualification Standards and Teacher Competence.</italic>
</source>
                    <publisher-name>Ministry of National Education</publisher-name>;<year>2007</year>.</mixed-citation>
            </ref>
            <ref id="ref15">
                <mixed-citation publication-type="book">
                    <collab>Government of the Republic of Indonesia</collab>:
                    <source>

                        <italic toggle="yes">Law of the Republic of Indonesia Number 14 Year 2005 on Teachers and Lecturers.</italic>
</source>
                    <publisher-name>Ministry of State Secretariat</publisher-name>;<year>2005</year>.</mixed-citation>
            </ref>
            <ref id="ref16">
                <mixed-citation publication-type="book">
                    <collab>Government of the Republic of Indonesia</collab>:
                    <source>

                        <italic toggle="yes">Law of the Republic of Indonesia Number 20 Year 2003 on the National Education System.</italic>
</source>
                    <publisher-name>Ministry of State Secretariat</publisher-name>;<year>2003a</year>.</mixed-citation>
            </ref>
            <ref id="ref17">
                <mixed-citation publication-type="book">
                    <collab>Government of the Republic of Indonesia</collab>:
                    <source>

                        <italic toggle="yes">Law of the Republic of Indonesia Number 13 Year 2003 on Manpower.</italic>
</source>
                    <publisher-name>Ministry of State Secretariat</publisher-name>;<year>2003b</year>.</mixed-citation>
            </ref>
            <ref id="ref18">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Herda</surname>
                            <given-names>RK</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Widodo</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Damayanto</surname>
                            <given-names>A</given-names>
                        </name>
</person-group>:
                    <article-title>EFL teacher professional development: Exploring perspectives and dominant efforts in teaching integrated English skills.</article-title>
                    <source>

                        <italic toggle="yes">MEXTESOL Journal.</italic>
</source>
                    <year>2024</year>;<volume>48</volume>(<issue>4</issue>):<fpage>Article n4</fpage>.
                    <pub-id pub-id-type="doi">10.61871/mj.v48n4-2</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref19">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Jones</surname>
                            <given-names>K</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Macpherson</surname>
                            <given-names>R</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">The Teaching Life: Professional Learning and Career Progression.</italic>
</source>
                    <publisher-name>John Catt Publishing Ltd.</publisher-name>;<year>2021</year>.</mixed-citation>
            </ref>
            <ref id="ref20">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kholifah</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Nurtanto</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mutohhari</surname>
                            <given-names>F</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The mediating role of motivation and professional development in determining teacher performance in vocational schools.</article-title>
                    <source>

                        <italic toggle="yes">Cogent Education.</italic>
</source>
                    <year>2024</year>;<volume>11</volume>(<issue>1</issue>).
                    <pub-id pub-id-type="doi">10.1080/2331186X.2024.2421094</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref21">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Kirkpatrick</surname>
                            <given-names>DL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kirkpatrick</surname>
                            <given-names>JD</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Evaluating training programs: The four levels.</italic>
</source>
                    <publisher-name>Berrett-Koehler</publisher-name>;
                    <edition>3rd ed</edition>
                    <year>2006</year>.</mixed-citation>
            </ref>
            <ref id="ref22">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Koo</surname>
                            <given-names>M</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yang</surname>
                            <given-names>S-W</given-names>
                        </name>
</person-group>:
                    <article-title>Likert-Type Scale.</article-title>
                    <source>

                        <italic toggle="yes">Encyclopedia.</italic>
</source>
                    <year>2025</year>;<volume>5</volume>(<issue>1</issue>):<fpage>18</fpage>.
                    <pub-id pub-id-type="doi">10.3390/encyclopedia5010018</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref23">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Nguni</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kandel</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bell</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Mapping the International Health Regulations monitoring and evaluation framework: An expert consultation, triangulation crosswalk and quantitative analysis.</article-title>
                    <source>

                        <italic toggle="yes">BMJ Glob. Health.</italic>
</source>
                    <year>2024</year>;<volume>9</volume>(<issue>6</issue>):<fpage>1</fpage>&#x2013;<lpage>8</lpage>.
                    <pub-id pub-id-type="pmid">38843899</pub-id>
                    <pub-id pub-id-type="doi">10.1136/bmjgh-2023-013675</pub-id>
                    <pub-id pub-id-type="pmcid">PMC11163593</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref24">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rasmitadila</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rachmadtullah</surname>
                            <given-names>R</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Prasetyo</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Professional development for Indonesian elementary school teachers: Increased competency and sustainable teacher development programs.</article-title>
                    <source>

                        <italic toggle="yes">F1000Res.</italic>
</source>
                    <year>2025</year>;<volume>13</volume>:<fpage>1375</fpage>.
                    <pub-id pub-id-type="doi">10.12688/f1000research.156946.2</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref25">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Rahmi</surname>
                            <given-names>I</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rassanjani</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Enhancing teacher quality in Indonesia: The impact of teacher professional development on achieving Sustainable Development Goal 4.c.</article-title>
                    <source>

                        <italic toggle="yes">Social Sciences &amp; Humanities Open.</italic>
</source>
                    <year>2025</year>;<volume>12</volume>:<fpage>102123</fpage>.
                    <pub-id pub-id-type="doi">10.1016/j.ssaho.2025.102123</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref26">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Reio</surname>
                            <given-names>TG</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Rocco</surname>
                            <given-names>TS</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Smith</surname>
                            <given-names>DH</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>A critique of Kirkpatrick&#x2019;s evaluation model.</article-title>
                    <source>

                        <italic toggle="yes">New Horizons in Adult Education &amp; Human Resource Development.</italic>
</source>
                    <year>2017</year>;<volume>29</volume>(<issue>2</issue>):<fpage>35</fpage>&#x2013;<lpage>53</lpage>.
                    <pub-id pub-id-type="doi">10.1002/nha3.20178</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref27">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Revina</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pramana</surname>
                            <given-names>RP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Bjork</surname>
                            <given-names>C</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Replacing the old with the new: Long-term issues of teacher professional development reforms in Indonesia.</article-title>
                    <source>

                        <italic toggle="yes">Asian Education and Development Studies.</italic>
</source>
                    <year>2023</year>;<volume>12</volume>(<issue>1</issue>):<fpage>262</fpage>.
                    <pub-id pub-id-type="doi">10.1108/AEDS-12-2022-0148</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref28">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Revina</surname>
                            <given-names>S</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Pramana</surname>
                            <given-names>RP</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Fillaili</surname>
                            <given-names>R</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <source>

                        <italic toggle="yes">Systemic constraints facing teacher professional development in a middle-income country: Indonesia&#x2019;s experience over four decades (RISE Working Paper 20/054).</italic>
</source>
                    <publisher-name>RISE Programme</publisher-name>;<year>2020</year>.</mixed-citation>
            </ref>
            <ref id="ref29">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Salmer&#x00f3;n Aroca</surname>
                            <given-names>JA</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Moreno Abell&#x00e1;n</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Mart&#x00ed;nez de Miguel L&#x00f3;pez</surname>
                            <given-names>S</given-names>
                        </name>
</person-group>:
                    <article-title>Teachers&#x2019; professional development and intelligent ways of coping with it: A systematic review in elementary and middle school education.</article-title>
                    <source>

                        <italic toggle="yes">J. Intelligence.</italic>
</source>
                    <year>2023</year>;<volume>11</volume>(<issue>1</issue>):<fpage>1</fpage>.
                    <pub-id pub-id-type="pmid">36662131</pub-id>
                    <pub-id pub-id-type="doi">10.3390/jintelligence11010001</pub-id>
                    <pub-id pub-id-type="pmcid">PMC9862909</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref30">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Setiadi</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Muhafidin</surname>
                            <given-names>D</given-names>
                        </name>
</person-group>:
                    <article-title>The effectiveness of teacher certification policy in addressing the teacher crisis in Indonesia.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Science and Society.</italic>
</source>
                    <year>2024</year>;<volume>6</volume>(<issue>2</issue>):<fpage>861</fpage>&#x2013;<lpage>873</lpage>.</mixed-citation>
            </ref>
            <ref id="ref31">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shapiro</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <chapter-title>Percentage frequency distribution.</chapter-title>
                    <source>

                        <italic toggle="yes">Encyclopedia of survey research methods.</italic>
</source>
                    <publisher-name>Sage Publications, Inc.</publisher-name>;<year>2008</year>; pp.<fpage>578</fpage>&#x2013;<lpage>578</lpage>.
                    <pub-id pub-id-type="doi">10.4135/9781412963947.n372</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref32">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Shorten</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Smith</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>Mixed methods research: expanding the evidence base.</article-title>
                    <source>

                        <italic toggle="yes">Evid. Based Nurs.</italic>
</source>
                    <year>2017</year>;<volume>20</volume>(<issue>3</issue>):<fpage>74</fpage>&#x2013;<lpage>75</lpage>.
                    <pub-id pub-id-type="doi">10.1136/eb-2017-102699</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref33">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Plano Clark</surname>
                            <given-names>VL</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Anderson</surname>
                            <given-names>N</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Wertz</surname>
                            <given-names>JA</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Conceptualizing Longitudinal Mixed Methods Designs: A Methodological Review of Health Sciences Research: A Methodological Review of Health Sciences Research.</article-title>
                    <source>

                        <italic toggle="yes">J. Mixed Methods Res.</italic>
</source>
                    <year>2014</year>;<volume>9</volume>(<issue>4</issue>):<fpage>297</fpage>&#x2013;<lpage>319</lpage>.
                    <pub-id pub-id-type="doi">10.1177/1558689814543563</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref34">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Ponto</surname>
                            <given-names>J</given-names>
                        </name>
</person-group>:
                    <article-title>Understanding and evaluating survey research.</article-title>
                    <source>

                        <italic toggle="yes">J. Adv. Pract. Oncol.</italic>
</source>
                    <year>2015</year>;<volume>6</volume>(<issue>2</issue>):<fpage>168</fpage>&#x2013;<lpage>171</lpage>.
                    <pub-id pub-id-type="doi">10.6004/jadpro.2015.6.2.8</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref35">
                <mixed-citation publication-type="journal">
                    <collab>Purnamansyah</collab>:
                    <article-title>Program sertifikasi sebagai upaya dalam meningkatkan profesionalisme guru (Studi kasus di SMK 2 dan SMA 3 Muhammadiyah Surakarta).</article-title>
                    <source>

                        <italic toggle="yes">Jurnal Muara Pendidikan.</italic>
</source>
                    <year>2018</year>;<volume>3</volume>(<issue>2</issue>):<fpage>169</fpage>&#x2013;<lpage>182</lpage>.</mixed-citation>
            </ref>
            <ref id="ref36">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Purwanti</surname>
                            <given-names>A</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Zarger</surname>
                            <given-names>AA</given-names>
                        </name>
</person-group>:
                    <article-title>The Influence of Certification on Teachers&#x2019; Motivation and Teachers&#x2019; Performance.</article-title>
                    <source>

                        <italic toggle="yes">PPSDP International Journal of Education.</italic>
</source>
                    <year>2025</year>;<volume>4</volume>(<issue>1</issue>):<fpage>144</fpage>&#x2013;<lpage>149</lpage>.
                    <pub-id pub-id-type="doi">10.59175/pijed.v4i1.400</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref37">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Taherdoost</surname>
                            <given-names>H</given-names>
                        </name>
</person-group>:
                    <article-title>Sampling methods in research methodology: How to choose a sampling technique for research.</article-title>
                    <source>

                        <italic toggle="yes">International Journal of Academic Research in Management.</italic>
</source>
                    <year>2016</year>;<volume>5</volume>(<issue>2</issue>):<fpage>18</fpage>&#x2013;<lpage>27</lpage>.</mixed-citation>
            </ref>
            <ref id="ref38">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tamkin</surname>
                            <given-names>P</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Yarnall</surname>
                            <given-names>J</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Kerrin</surname>
                            <given-names>M</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Kirkpatrick and beyond: A review of models of training evaluation (IES Report 392).</italic>
</source>
                    <publisher-name>Institute for Employment Studies</publisher-name>;<year>2002</year>.
                    <ext-link ext-link-type="uri" xlink:href="https://www.employment-studies.co.uk/system/files/resources/files/392.pdf">Reference Source</ext-link>
                </mixed-citation>
            </ref>
            <ref id="ref39">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Tanang</surname>
                            <given-names>H</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Abu</surname>
                            <given-names>B</given-names>
                        </name>
</person-group>:
                    <article-title>Teacher professionalism and professional development practices in South Sulawesi, Indonesia.</article-title>
                    <source>

                        <italic toggle="yes">Journal of Curriculum and Teaching.</italic>
</source>
                    <year>2014</year>;<volume>3</volume>(<issue>2</issue>):<fpage>25</fpage>&#x2013;<lpage>42</lpage>.
                    <pub-id pub-id-type="doi">10.5430/jct.v3n2p25</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref40">
                <mixed-citation publication-type="book">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Triola</surname>
                            <given-names>MF</given-names>
                        </name>
</person-group>:
                    <source>

                        <italic toggle="yes">Elementary statistics.</italic>
</source>
                    <publisher-name>Pearson</publisher-name>;
                    <edition>13th ed. </edition>
                    <year>2020</year>.</mixed-citation>
            </ref>
            <ref id="ref41">
                <mixed-citation publication-type="book">
                    <collab>UNESCO-UNEVOC</collab>:
                    <source>

                        <italic toggle="yes">TVET country profiles: Indonesia.</italic>
</source>
                    <publisher-name>UNESCO-UNEVOC International Centre for Technical and Vocational Education and Training</publisher-name>;<year>2020</year>.</mixed-citation>
            </ref>
            <ref id="ref42">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Wongso</surname>
                            <given-names>C</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Aidia</surname>
                            <given-names>SR</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Habibi</surname>
                            <given-names>MZ</given-names>
                        </name>
</person-group>:
                    <article-title>
                        <italic toggle="yes">Evaluating the effectiveness of teacher training programs on curriculum implementation in Indonesian secondary schools.</italic>
                    </article-title>
                    <source>

                        <italic toggle="yes">International Journal of Educational Evaluation and Policy Analysis.</italic>
</source>
                    <year>2024</year>;<volume>1</volume>(<issue>2</issue>):<fpage>20</fpage>&#x2013;<lpage>27</lpage>.
                    <pub-id pub-id-type="doi">10.62951/ijeepa.v1i2.75</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref43">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Yansyah</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Herwati</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Martono</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>The Impact of Blended Training Professional Development Programs on the Competence of Vocational Teachers: A Kirkpatrick Model Approach (Version 1).</article-title>
                    <source>

                        <italic toggle="yes">figshare.</italic>
</source>
                    <year>2025a</year>.
                    <pub-id pub-id-type="doi">10.6084/m9.figshare.30925796.v1</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref44">
                <mixed-citation publication-type="other">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Yansyah</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Herwati</surname>
                            <given-names>E</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Martono</surname>
                            <given-names>T</given-names>
                        </name>

                        <etal/>
</person-group>:
                    <article-title>Training Evaluation Questionnaire (Version 1).</article-title>
                    <source>

                        <italic toggle="yes">figshare.</italic>
</source>
                    <year>2025b</year>.
                    <pub-id pub-id-type="doi">10.6084/m9.figshare.30926021.v1</pub-id>
                </mixed-citation>
            </ref>
            <ref id="ref45">
                <mixed-citation publication-type="journal">
                    <person-group person-group-type="author">

                        <name name-style="western">
                            <surname>Yansyah</surname>
                            <given-names>F</given-names>
                        </name>

                        <name name-style="western">
                            <surname>Dwintan</surname>
                            <given-names>DA</given-names>
                        </name>
</person-group>:
                    <article-title>A social capital study: Rural teachers&#x2019; voices concerning the implementation of Indonesian curricula.</article-title>
                    <source>

                        <italic toggle="yes">Teorija in praksa.</italic>
</source>
                    <year>2024</year>;<volume>61</volume>(<issue>2</issue>).</mixed-citation>
            </ref>
        </ref-list>
    </back>
    <sub-article article-type="reviewer-report" id="report459122">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.192946.r459122</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>B&#x00fc;kki</surname>
                        <given-names>Eszter</given-names>
                    </name>
                    <xref ref-type="aff" rid="r459122a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0002-8283-0088</uri>
                </contrib>
                <aff id="r459122a1">
                    <label>1</label>Budapest University of Technology and Economics, Budapest, Hungary</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>17</day>
                <month>3</month>
                <year>2026</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2026 B&#x00fc;kki E</copyright-statement>
                <copyright-year>2026</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport459122" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.174999.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>reject</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>This manuscript investigates the perceived impact of a national blended professional development (PD) programme on Indonesian vocational teachers using the Kirkpatrick evaluation model. While the topic is relevant and the dataset is large, the paper in its current form is not suitable for indexing. The main concerns are outlined below.</p>
            <p> </p>
            <p> 
                <bold>Originality and conceptual issues</bold>
            </p>
            <p> While the title seems to suggest that the study explores the impact of blended PD programmes in general, it analyses data from one specific PD programme, and the generalisation of its findings is not substantiated. Therefore, the paper is best conceptualized as an impact analysis of a specific PD programme, however, this programme is described only in very general terms. Readers are told that it involved "online and offline instruction, internships, and coaching across three training cycles," but no further detail is given about content, duration, structure, or pedagogical approach. Without this information, the originality of the study is dubious, the findings are difficult to contextualise, and the questionnaire items are difficult to interpret.</p>
            <p> </p>
            <p> As a major conceptual concern, it is not clear - and not explained by the authors - why a focus on teachers' subjective perceptions would constitute a methodological advance over prior work measuring objective outcomes such as student achievement or competency assessments.</p>
            <p> </p>
            <p> A more substantive engagement with the reported conflicting findings in the prior literature, including attention to differences in methodology, context, and outcomes across studies, would considerably strengthen the Introduction and situate the study's contribution more clearly.&#x200b;</p>
            <p> </p>
            <p> 
                <bold>Methodological issues</bold>
            </p>
            <p> A fundamental methodological concern is the mismatch between the study's stated design and its actual implementation. The abstract and methods describe a "longitudinal approach" and the conclusion refers to a "four-year assessment," yet the findings are drawn from a single measurement point with no pre-test and no repeated observations of the same individuals over time. This is not a longitudinal design in any conventional sense, and these claims must be corrected throughout the manuscript.</p>
            <p> </p>
            <p> The conceptual transparency of the instrument is problematic. The exact wording of the questionnaire items is not presented in the paper itself, and while the questionnaire is accessible via an external link, this does not fully resolve the problem: the questionnaire is organised into thematic blocks (Skill Development, School Effectiveness, Work Culture &amp; Ethics, Collaboration &amp; Mentoring, and Continuous Growth) that do not map straightforwardly onto the four constructs (motivation, skills, values, and attitudes) reported in the Findings section. &#x00a0;Furthermore, since the content of the PD programme is not described in sufficient detail anywhere in the paper, many individual items remain difficult to interpret even when the questionnaire is consulted directly. The authors should either present the questionnaire items in full as an appendix, or at minimum provide a clear and explicit mapping between instrument blocks and the theoretical constructs they are intended to operationalize, along with a proper description of the source document and its original function.</p>
            <p> </p>
            <p> There is also an inconsistency between the Methods section, which states that three Kirkpatrick levels (1&#x2013;3) are assessed, and the Findings section, which reports results at four levels (motivation, skills, values, and attitudes). The paper should either align the framing in the Methods with the actual analysis or explain clearly why four levels are reported.</p>
            <p> </p>
            <p> The paper describes the sampling as "convenient," based on data availability. However, if the study aims to evaluate the impact of this specific PD programme, the relevant population is the set of all participants in that programme. In that case, the authors need to report the total size of this population, clarify what proportion of them are included in the sample, and explain how "chosen individuals" were selected. If selection was purposive, the criteria and rationale should be stated. Without this information, it is not possible to assess the representativeness of the sample.</p>
            <p> </p>
            <p> The authors state that validity and reliability were ensured through expert consultation. While expert judgement is an appropriate method for establishing content validity, it does not guarantee reliability. Reliability in the psychometric sense requires evidence of internal consistency (e.g., Cronbach's alpha) or test-retest stability. The authors should report these statistics or acknowledge this as a limitation.</p>
            <p> </p>
            <p> Explanations of basic methodological concepts such as Likert scale and percentage analysis may be unnecessary for the target readership.</p>
            <p> </p>
            <p> Figure 2 presents the distribution of participants by province, but the relevance of this distribution to the research questions is not discussed. If regional variation is not part of the analysis, this figure should be removed or its purpose clarified.</p>
            <p> </p>
            <p> 
                <bold>Contextual clarity</bold>
            </p>
            <p> Several terms and abbreviations specific to the Indonesian educational context are used without explanation. The abbreviations KKG and MGMP are introduced without being defined. The "competency test" mentioned in relation to Purnamansyah (2018) is not explained. A brief contextualisation of the Indonesian PD system would make the paper more accessible to an international readership.</p>
            <p> </p>
            <p> 
                <bold>Further minor issues</bold> 
                <list list-type="bullet">
                    <list-item>
                        <p>The term "intricate construction" is used where "sample distribution by region" is apparently intended.</p>
                    </list-item>
                    <list-item>
                        <p>The use of terms such as "statistically insignificant minority" and "significant majority" is misleading, as statistical significance refers to a specific inferential concept and should not be used loosely in a descriptive context.</p>
                    </list-item>
                    <list-item>
                        <p>There is a repeated word in the discussion of Level 2 skills: "Creativity, creativity, and decision-making".</p>
                    </list-item>
                    <list-item>
                        <p>Non-English references should give the original title first, followed by an English translation in brackets.</p>
                    </list-item>
                </list> The manuscript does not include a declaration about this, but occasional inflated evaluative language and typographical signs suggest some use of AI.</p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>No</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>No</p>
            <p>Reviewer Expertise:</p>
            <p>Education, VET</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to state that I do not consider it to be of an acceptable scientific standard, for reasons outlined above.</p>
        </body>
    </sub-article>
    <sub-article article-type="reviewer-report" id="report456270">
        <front-stub>
            <article-id pub-id-type="doi">10.5256/f1000research.192946.r456270</article-id>
            <title-group>
                <article-title>Reviewer response for version 1</article-title>
            </title-group>
            <contrib-group>
                <contrib contrib-type="author">
                    <name>
                        <surname>Abelha</surname>
                        <given-names>Marta</given-names>
                    </name>
                    <xref ref-type="aff" rid="r456270a1">1</xref>
                    <role>Referee</role>
                    <uri content-type="orcid">https://orcid.org/0000-0001-7105-3722</uri>
                </contrib>
                <aff id="r456270a1">
                    <label>1</label>Universidade Aberta, Lisboa, Portugal</aff>
            </contrib-group>
            <author-notes>
                <fn fn-type="conflict">
                    <p>
                        <bold>Competing interests: </bold>No competing interests were disclosed.</p>
                </fn>
            </author-notes>
            <pub-date pub-type="epub">
                <day>4</day>
                <month>3</month>
                <year>2026</year>
            </pub-date>
            <permissions>
                <copyright-statement>Copyright: &#x00a9; 2026 Abelha M</copyright-statement>
                <copyright-year>2026</copyright-year>
                <license xlink:href="https://creativecommons.org/licenses/by/4.0/">
                    <license-p>This is an open access peer review report distributed under the terms of the Creative Commons Attribution Licence, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</license-p>
                </license>
            </permissions>
            <related-article ext-link-type="doi" id="relatedArticleReport456270" related-article-type="peer-reviewed-article" xlink:href="10.12688/f1000research.174999.1"/>
            <custom-meta-group>
                <custom-meta>
                    <meta-name>recommendation</meta-name>
                    <meta-value>approve-with-reservations</meta-value>
                </custom-meta>
            </custom-meta-group>
        </front-stub>
        <body>
            <p>The manuscript entitled 
                <italic>&#x201c;The Impact of Blended Training Professional Development Programs on the Competence of Vocational Teachers: A Kirkpatrick Model Approach&#x201d;</italic> investigates the perceived impact of a national blended professional development program implemented between 2020 and 2023 for vocational teachers in Indonesia.</p>
            <p> Using a quantitative longitudinal design, the study analyses teachers&#x2019; perceptions regarding motivation, skills, values, and attitudes following participation in three training cycles. The evaluation framework is based on the Kirkpatrick Model, considering Levels 1&#x2013;3 (reaction, learning/skills, and values/attitudes). Data were collected through a Likert-scale survey administered to 944 vocational teachers across 34 Indonesian provinces.</p>
            <p> The findings indicate highly positive participant perceptions, suggesting that the training program enhanced motivation, professional competencies, and collaborative attitudes. The authors conclude that professional development initiatives should be implemented as continuous and systematic programs rather than isolated interventions.</p>
            <p> </p>
            <p> 1.&#x00a0;The manuscript is generally well structured and clearly written, with coherent organisation across sections. Relevant literature on teacher professional development and Indonesian educational policy is cited.</p>
            <p> However, the literature review relies predominantly on national or regional studies. Greater engagement with broader international research on professional development effectiveness and training evaluation models would strengthen the theoretical positioning and enhance the manuscript&#x2019;s international relevance.</p>
            <p> 
                <underline>Recommendation</underline>: authors should expand the discussion by incorporating recent international empirical and meta-analytic studies on teacher professional development and blended learning evaluation.</p>
            <p> 2.&#x00a0;The quantitative longitudinal design is appropriate for examining perceived impacts over time. The large sample size and nationwide participation strengthen the robustness of the study. The adaptation of the Kirkpatrick Model is conceptually justified and consistently applied.</p>
            <p> 3.&#x00a0;The methodological procedures are generally described; however, some details necessary for replication remain limited.</p>
            <p> In particular: questionnaire development and validation procedures require clearer explanation; reliability indicators (e.g., Cronbach&#x2019;s alpha) are not sufficiently reported; data collection timing across training cycles could be described more precisely.</p>
            <p> 
                <underline>Required improvement: </underline>provide additional methodological detail regarding instrument validation, reliability measures, and survey administration procedures.</p>
            <p> 4.&#x00a0;The use of percentage analysis is acceptable for descriptive evaluation of participant perceptions. Nevertheless, reliance exclusively on descriptive statistics limits analytical depth.</p>
            <p> Given the longitudinal nature of the dataset, more robust statistical analyses (e.g., comparative or inferential analysis across training cycles or demographic groups) would substantially strengthen the findings.</p>
            <p> 
                <underline>Recommendation</underline>: consider including inferential statistics or trend analyses to support stronger claims regarding program impact.</p>
            <p> 5.&#x00a0;The authors provide access to datasets and extended materials through publicly available repositories, supporting transparency and reproducibility.</p>
            <p> 6.&#x00a0;The conclusions are broadly aligned with the reported findings. However, the study relies entirely on self-reported perceptions, which limits causal interpretation. The manuscript occasionally presents results in ways that may suggest objective improvement in competencies, whereas the data reflect perceived improvements only.</p>
            <p> 
                <underline>Required improvement:</underline> the authors should more explicitly acknowledge the perceptual nature of the data and moderate claims regarding program effectiveness.</p>
            <p> </p>
            <p> The manuscript addresses a relevant and timely topic and benefits from a large-scale longitudinal dataset. With revisions aimed at strengthening methodological transparency, analytical depth, and critical discussion, the study can make a valuable contribution to research on teacher professional development and training evaluation. Minor language editing is recommended to improve readability and consistency.</p>
            <p> </p>
            <p> </p>
            <p>Is the work clearly and accurately presented and does it cite the current literature?</p>
            <p>Partly</p>
            <p>If applicable, is the statistical analysis and its interpretation appropriate?</p>
            <p>Partly</p>
            <p>Are all the source data underlying the results available to ensure full reproducibility?</p>
            <p>Yes</p>
            <p>Is the study design appropriate and is the work technically sound?</p>
            <p>Yes</p>
            <p>Are the conclusions drawn adequately supported by the results?</p>
            <p>Partly</p>
            <p>Are sufficient details of methods and analysis provided to allow replication by others?</p>
            <p>Partly</p>
            <p>Reviewer Expertise:</p>
            <p>Teacher Education; Professional Development; Higher Education; Educational Research; Teaching and Learning</p>
            <p>I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.</p>
        </body>
    </sub-article>
</article>
