Trends in the Psychometric Characteristics of NECO Mathematics Senior School Certificate Examination Over a Period of Five Years (2020-2024) among Osun State Candidates, Nigeria

Introduction

Large-scale national public exams play a crucial strategic role in a country’s education system, particularly when certification, school transfers, or access to additional educational resources depend on exam outcomes. In Nigeria, the National Examinations Council (NECO) Senior School Certificate Examination (SSCE) Mathematics is considered a high-stakes assessment, used to obtain secondary school completion certificates, secure admission to tertiary institutions, and signal for the labour market. Consequently, the analysis of NECO Mathematics scores and the credibility of decision-making processes that depend on these scores across various such sessions are largely contingent on the examination’s psychometric quality. The characteristics of large-scale assessments that are common targets of evaluation are item difficulty, item discrimination, test reliability, and item bias from the psychometric perspective. Item difficulty refers to the proportion of candidates who can provide correct answers to an item. In contrast, item discrimination refers to the extent to which an item can distinguish between individuals of high and low ability. Reliability assesses the consistency of scores, whereas bias analysis examines whether differentially functioning test items are equivalent across subgroups (e.g., gender, school type, or location). All these indices collectively provide empirical evidence for the validity, fairness, and technical soundness of any examination.^1,2

There has been growing concern among educational stakeholders in Nigeria over the past decade, driven by inconsistent student performance in public examinations, particularly in Mathematics. These inconsistencies could indicate disparities in instructional quality, curriculum coverage, or learner readiness, but they could also be due to inconsistencies in item quality and in the test-construction process. Empirical studies conducted in the past decade have shown that public examination items in Nigeria sometimes exhibit disparities in difficulty distribution, weak discrimination parameters, and occasional DIF, making scores from one year to the next incomparable.^3,4

In contemporary research, trend analysis plays a vital role in the measurement literature, rather than merely single-year statistical analyses. The psychometric characteristics of examinations may change over time and may be necessary for assessment purposes. In the last decade, this has involved determining whether all essential characteristics of an examination remain fixed or exhibit systematic drift in difficulty, reliability, or bias. This also contains substantive discussions of high-stakes examinations such as NECO SSCE, which underscore the importance of hours in nurturing public trust and shaping government actions, particularly in international educational achievement comparisons.^5,6

In Osun State, where Mathematics performance has remained a key policy concern, a systematic examination of psychometric trends provides valuable evidence for educational planning, test-development reforms, and accountability. Understanding how item characteristics have evolved from 2020 to 2024 can inform NECO’s item-writing practices, guide teacher preparation strategies, and support policymakers in interpreting examination outcomes more cautiously. Consequently, this study investigates trends in the psychometric characteristics of NECO SSCE Mathematics over five years, with a focus on candidates in Osun State, Nigeria.

The theoretical attributes of test items and test forms that provide empirically supported evidence of the quality, credibility, and fairness of measurement in educational assessments are the psychometric qualities. Fundamental to large-scale public examinations, as well as to ensuring that test scores adequately and reliably reflect the true abilities of examinees in the area of focus, is the evaluation of psychometric properties. This evaluation is a key component in the introduction, quality control, and scoring of high-stakes examinations such as national benchmark exams. One of the most widely studied psychometric indices is item difficulty, which measures the proportion of examinees who answer a given item or question correctly. A difficulty index can help explore whether test items are well aligned with the examination population and curriculum expectations. An item that is too easy or too difficult hardly contributes to good metric measurement and may distort score distributions and undermine test validity. A well-constructed public examination generally contains items applied in three different levels of difficulty-easy, moderate, and difficult- to ensure an optimal precision of measurement across the ability continuum.^7,8 Item discrimination, closely related to question difficulty, is the extent to which an item differentiates between examinees with high and low background performance. Discrimination indices indicate the measurement quality of an item with respect to its reliability and overall test validity. When the discrimination coefficient for a given item is high, it provides a strong signal to the rank ordering of candidates around an ability point. However, low-discriminative items may introduce waiving-along noise and may also prevent an item’s associated ability level from being inferred.^9,10 Reliability is another crucial psychometric property that denotes the consistency and stability of test scores across items, forms, or administrations. In the case of public examinations, internal consistency indices, like KR-20 or Cronbach’s alpha, are widely applied to estimate the degree to which conversation among the various test items about the target construct can be. According to,^11,12 adequate reliability is a prerequisite for valid interpretation of scores, particularly for consequential decisions, such as certification and admission, that attach social consequences to an individual’s performance.

Over the past 10 years, studies have indicated that the psychometric properties of public examinations in Nigeria vary from year to year. Previous studies have analysed the NECO and WAEC Mathematics exams, noting that although the overall difficulty levels are sometimes similar across the two organizations, the discrimination indices vary significantly across test versions and years, indicating potential issues with item quality and calibration.¹³¹⁴ also reported similar findings in the content-specific analysis of the NECO examinations, with some items exhibiting weak discrimination and low psychometric capacity despite not being particularly difficult.

The current results highlight the importance of conducting regular psychometric evaluations and monitoring item parameters in public examinations. Tracking methodologies make it possible to detect fluctuations in psychometric quality; however, comparability of results across examinations collapses within-cohort examinations, since the general large-scale examination system that provides so much information would lose its credibility. Awareness and assessment of the psychometric characteristics over and across examination years, therefore, remains the key concern of any test producer, policy developer, or educational measurement specialist.

The National Examinations Council (NECO) was established as an alternative national examining body in Nigeria, tasked with conducting credible, valid, and reliable public examinations. Questions about the quality and comparability of NECO examinations, particularly in high-stakes subjects such as mathematics and the English language, have attracted sustained scholarly attention since their inception. As a result, a considerable body of empirical research seeks to ascertain and critique the psychometric characteristics of NECO test items under the frameworks afforded by Classical Test Theory (CTT) and Item Response Theory (IRT). Several studies conducted in the last decade have designed NECO examination items across subject areas, with a major focus on item difficulty, discrimination, dimensionality, and model–data fit. Using IRT-based approaches, researchers reported that some NECO multiple-choice test forms did not fully meet the unidimensional assumption and exhibited local item dependence and misfitting items in certain administrations. In fact,³ in their psychometric study of the NECO English Language item, found discrepancies in item parameter estimates and instances of poor item fit, pointing to the weaknesses in item calibration and pretesting procedures and raising the urgency for continuous psychometric scrutiny on NECO examinations to ensure measurement precision and construct validity.

Empirical assessments in Mathematics have identified mixed psychometric relations across years. A comparison of Mathematics items from NECO and the West African Examination Council (WAEC) indicates that the two tests exhibit similar difficulty across administrations. Still, NECO Mathematics items, unlike WAEC Mathematics items, display higher within-test discrimination variability. Thus, the variability in the extent of discrimination would raise concerns about the uniformity of measurement standards and the stability of score interpretation over time.¹

Beyond item quality, research is increasingly focusing on fairness and bias in NECO examinations.¹⁵ demonstrated, through their Differential Item Functioning (DIF) analyses, that some of the mathematics items in the NECO examinations were functioning differently across subgroups defined by gender, school type (public versus private), and location (urban versus rural), while controlling for candidates’ overall ability. This differential functioning poses a threat to score equating and may systematically favour or disadvantage particular individuals or groups, thereby invalidating any decision-making based on examination results.^16,17

Research comparing differential item functioning (DIF) indices frequently links deviations from uni-dimensionality to the presence of item bias. For instance, when a math exam clearly assesses both mathematical reasoning and language skills simultaneously, or when other test-taking techniques are employed, item parameters become less predictable and differences among subgroups become more apparent. Thus,^18,6 opined that the very idea of fairness becomes inchoate when the issues of test validity and measurement model are not carefully considered, and myriad empirical conditions, of which substantive-parameter tuning continues to mount, are not carefully considered.

Evidence from the literature indicates that the NECO examinations are a noteworthy asset to national assessment and certification; however, psychometric challenges persist. The evidence demands routine item analysis, longitudinal monitoring of item parameters, and thoroughgoing bias validation to be integrated as cardinal components of NECO quality assurance activities. It is imperative that these issues be addressed up front, particularly in mathematics examinations, where problems of psychometric quality can distort the interpretation of students’ competence and may yield ill-informed decisions regarding educational policies.

Research objectives

The main goal of this study is to examine how the psychometric properties of Mathematics in the NECO SSCE have evolved from 2020 to 2024 for candidates in Osun State, utilizing Classical Test Theory as the analytical framework. The specific objectives of the study are to:

Results

Research Question 1: What is the trend observed in the difficulty indices of NECO SSCE Mathematics multiple-choice items from 2020 to 2024 among Osun State candidates?

The proportion of candidates who answered each item correctly was used to calculate the item’s difficulty index (p-value) for each examination year. The mean value obtained across all items for each year was computed. The results are presented in Table 1.

Table 1 presents the average item difficulty indices for the NECO Senior School Certificate Examination (SSCE) Mathematics test from 2020 to 2024. The mean item difficulty index (p¯) indicates the percentage of test takers who answered items correctly; higher values indicate easier items, whereas lower values indicate harder items. According to the results, the 2020 NECO Mathematics exam exhibited the greatest mean difficulty index (p¯ = 0.83), implying that the entire set of questions was accessible and straightforward for Osun State students. The data demonstrate that most candidates from that year were successful in answering most test questions. The mean difficulty index for 2021 was 0.70, indicating a test of moderate difficulty, even though the assessment items maintained their appropriate range for large-scale testing. In 2022, item difficulty increased slightly to 0.74, indicating that assessment items from that year were easier to solve than those from 2021. The 2023 examination recorded a further increase in difficulty index to 0.80, indicating that the mathematics items were again largely easy for candidates. The 2024 examination showed a substantial decrease, with a mean difficulty index of 0.65, indicating that this assessment required greater effort from students than in previous years. However, it remained at moderate difficulty levels. The five-year period shows a nonlinear progression, with alternating patterns of test difficulty across examination years. The test forms maintained a consistent level of difficulty, yet their average-difficulty assessments showed irregularities, resulting in testing problems that needed to be resolved across different assessment periods. Score fluctuations between different years require systematic item pretesting and difficulty-balancing methods to establish consistent standards for the NECO Mathematics exams.

Research Question 2: How do the NECO SSCE Mathematics items’ discrimination indices vary across the five examination years (2020–2024)?

Table 2 displays the progression of the average item discrimination indices for the NECO SSCE Mathematics exam from 2020 to 2024. The mean discrimination index, calculated using the point-biserial correlation coefficient (rpbis), reflects the extent to which test items distinguish between top-performing and lower-performing students. Higher discrimination values indicate that test items are of higher quality, which helps to correctly rank candidates. The 2020 and 2021 exams produced identical mean discrimination indices of 0.27, indicating moderate tracking ability. The test items from these two years successfully differentiated between candidates with higher and lower abilities, although their effectiveness fell short of the 0.30 benchmark, which defines highly effective test items. The 2022 mean discrimination index rose to 0.29, which indicated a small improvement in item discrimination that approached the standard for high-quality multiple-choice items. The mean discrimination index decreased to 0.25 in 2023, indicating reduced discriminatory power compared with earlier years. The 2023 examination showed reduced effectiveness because a greater number of test items failed to distinguish between high-and low-performing students. The 2024 examination showed a substantial increase in the mean discrimination index, which reached 0.36 and indicated good to very good discrimination power. The 2024 test items were more effective than in previous years at differentiating candidates by ability level. The item discrimination indices exhibit trend patterns over their five-year span, oscillating rather than showing regular development; the data indicate improvements in 2024 after moderate discrimination in previous years. The 2024 data show a significant rise, indicating that either item construction standards improved or items were better evaluated for candidates’ actual skill levels. The annual fluctuations observed by researchers indicate that NECO Mathematics examinations require regular item evaluation and quality assurance procedures to maintain consistent examination performance across years.

Research Question 3: What is the extent to which the reliability coefficients of the NECO SSCE Mathematics examinations remain consistent across the years 2020 to 2024?

Table 3 presents the KR-20 statistics for the test batteries of the NECO Senior School Certificate Examination (SSCE) Mathematics over five successive years of administration, from 2020 to 2024. Results for the official outcome indicate that reliability was maintained for the NECO Mathematics exams throughout the five years. More succinctly, KR-20 coefficients were similarly high across all five years: 0.90 in 2020, 0.88 in 2021, 0.87 in 2022, 0.89 in 2023, and 0.90 in 2024. In all cases, values exceeded the minimum acceptable reliability of 0.70, and a majority exceeded 0.90, suggesting high internal consistency. Any mild undulations observed over the year were largely unaddressed, remaining below the required limit, indicating generally consistent, homogeneous functions across items. With KR-20 recovery to.90 in 2024, lying high in its range similar to 2024, our inference regarding the consistency of test construction and the administration of quality assurance processes was justified for NECO by fortuitous excellence.

The item difficulty indices for NECO SSCE Mathematics items from 2020 to 2024 are presented in Table 4.

The study uses 60 multiple-choice items each academic year, yielding 300 items across the five testing years. The item difficulty indices range from 0.00 to 1.00 over the five years, with higher values indicating easier assessment materials. The average item difficulty across five years was 0.73 (SD = 0.20), indicating that the NECO SSCE Mathematics assessment materials were of moderate difficulty for students. The data indicate that a considerable number of students answered most test questions correctly during the period examined. The difference in item difficulty over the five years was then assessed using a One-Way Analysis of variance. The result is presented in Table 5.

Table 5 presents the results of a one-way Analysis of Variance (ANOVA), which tested whether the NECO SSCE Mathematics item difficulty means differed significantly across examination years from 2020 to 2024. The computed F ratio (F_{(4, 7,749)} = 5.206) was statistically significant at the. 05 level implies that the average item difficulty indices across the five years of examination were statistically significant. In other words, the difficulty levels of NECO SSCE Mathematics test items were not constant in the set range of years of 2020 to 2024, or at least one year’s average item difficulty was statistically significantly different from that of the others. Thus, a Scheffe test was conducted to determine where the difference lies. The results are presented in Table 6.

Table 6 presents the Scheffe post hoc analysis of item difficulty indices for the mathematics examination in the NECO SSCE for the years 2020–2024. The results indicate that, in the vast majority of pairwise comparisons across the exam years, p-values did not reach the 0.05 significance level. This indicates a general category of item-difficulty consistency over those years. However, a statistically significant difference was observed between the 2023 and 2024 examinations: the mean difference in item difficulty between the two years was estimated at 0.15225 (p = 0.002). This indicates a significant difference in item difficulty between the two years. A positive mean difference indicates that the items of 2023 were relatively easier than the 2024 items (or, otherwise, the 2024 items were harder than the 2023 items).

Table 7 presents descriptive statistics of items’ discrimination indices for the NECO SSCE Mathematics for each of the five years from 2020 to 2024. Each year’s examination comprised 60 multiple-choice items, for a total of 300 items analyzed over the five years. The average item discrimination indices ranged from 0.2546 (2023) to 0.3559 (2024). Specifically, 2020 and 2021 had average item discrimination values of 0.2723 and 0.2744, respectively, indicating moderate discrimination, whereas 2022 had a mean item discrimination of 0.2861, indicating a slight improvement in discrimination quality. In 2023, with an average discrimination of 0.2546, items exhibited the lowest differentiation, indicating weaker differentiation power that year. The highest mean discrimination value across all years was 2024, with an average of 0.3559, indicating a substantial improvement in item quality and in items’ ability to differentiate among candidates of varying ability levels.

According to Table 8, the one-way ANOVA results indicate the possible presence of significant differences in the average discrimination indices for NECO SSCE Mathematics examinations taken between 2020 and 2024. The F-test yielded a significant F-statistic (F = 5.375; p < 0.05). A significant ANOVA result indicates that item discrimination quality differs across at least one year.

Following the detection of a statistically significant source, a Scheffe pairwise comparison was conducted to identify the specific years with notable differences. The results are presented in Table 9.

Table 9 shows that the year-to-year pairwise analyses yielded few significant results, as indicated by p-values >0.05. Specifically, comparisons between 2020 and 2021, 2020 and 2022, 2022 and 2023, 2021 and 2022, 2021 and 2023, and 2022 and 2023 revealed no significant differences, indicating that test difficulty was stable over time. However, significant differences were observed on the other hand within the 2024 examination year and most of the previous years: significant differences were observed between 2020 and 2024 (Mean Difference = −0.08358, p = .017), 2021 and 2024 (Mean Difference = −0.08156, p = .022), and 2023 and 2024 (Mean Difference = −0.10130, p = .002). This indicated that items in the 2024 examination were significantly more difficult than those in 2020, 2021, and 2023, as indicated by negative mean differences when each year was contrasted with 2024.

Discussion

The research evaluated changes in psychometric properties of the NECO Senior School Certificate Examination SSCE Mathematics during the five-year period from 2020 to 2024, which tested students from Osun State. The study evaluated changes in psychometric properties of the NECO Senior School Certificate Examination SSCE Mathematics during the five-year period from 2020 to 2024, which tested students from Osun State.

The item difficulty analysis showed that NECO SSCE Mathematics questions had an average difficulty which remained within acceptable CTT limits (p ≈ 0.30–0.80). The descriptive results showed that item difficulty remained stable between 2020 and 2023 until it experienced a significant change in 2024, which ANOVA and Scheffé post-hoc analysis confirmed. The NECO examination established a standard difficulty level which it maintained throughout most years, but the 2024 test showed a clear break from this established pattern. Variations in item difficulty across years of testing are common in large-scale assessments because they reflect changes in educational programs, test developers’ understanding of learning objectives, and the determination of assessment standards, according to.¹⁹ The significant difference involving the 2024 items implies a possible recalibration of examination standards, which, while not inherently problematic, underscores the importance of systematic equating and longitudinal monitoring to ensure comparability of scores across years.^20,21

The study found notable variations in item discrimination outcomes when assessed over five separate testing intervals. The NECO Mathematics items achieved good performance in student ability testing because their mean discrimination indices reached acceptable limits which extended to value 0.20. The results showed year-to-year variation in testing results which reached their peak in 2024 when the highest average discrimination value was achieved. The evidence from recent years shows that testing organizations now give better priority to item testing standards which leads to improved assessment results through better testing writing and testing assessment and testing review methods. Assessments for high-stakes testing require high discrimination indices because those indices improve test score interpretation.⁹ The assessment results show negative discrimination values across multiple years because approximately 10 percent of assessment items did not perform properly because of test item confusion and mistaken answer keys and test item content that did not match test objectives. Developing assessment systems need to conduct regular post-examination item evaluation because previous studies have shown similar results in their research on public examination systems.^22,14

The KR-20 reliability coefficients obtained for the five examination years ranged from 0.87 to 0.90. This range of reliability coefficients confirmed that all test administrations achieved high internal consistency. Manual comparison of the coefficients revealed only minimal year-to-year differences which remained below 0.02. The overall coefficient range between two years was 0.03. The NECO SSCE Mathematics examination maintained consistent measurement accuracy throughout its testing period because these variations stayed within psychometrically nonessential limits. The NECO SSCE Mathematics examination maintained consistent measurement accuracy throughout its testing period because these variations stayed within psychometrically nonessential limits. The test construction practices and test length requirements together with item assessment of the core construct for the test demonstrate reliable assessment through their high reliability coefficients. The study showed stable results which matched the expected standards for large-scale assessments because assessment reliability should remain stable across different testing conditions.

Conclusion

The study investigated the psychometric evolution of the NECO Senior School Certificate Examination (SSCE) Mathematics test over a five-year period starting from 2020 to 2024 for candidates in Osun State through the application of Classical Test Theory. The research results demonstrate that examination items in high-stakes public assessments maintain consistent quality while exhibiting different levels of performance. The study concludes that NECO SSCE Mathematics test demonstrates strong psychometric properties which show particular excellence in testing reliability. The examination requires continuous systematized monitoring of item difficulty and discrimination assessment which will enable fair testing and consistent evaluation of academic performance across different years.

Ethical approval

Ethical approval was not required for this study as it involved secondary analysis of anonymized examination data with no direct involvement of human participants.