Assessing the students’ evaluations of educational quality (SEEQ) questionnaire in Oman higher education

2.1 Study design

The Students’ Evaluations of Educational Quality (SEEQ) Questionnaire (Marsh & Roche, 1993) is used in this quantitative research to assess educational quality from the students’ viewpoint. The study was conducted at Muscat College from January to March 2024.

Collecting numerical data for statistical analysis is a fundamental aspect of the quantitative technique, facilitating the identification of correlations and patterns within the dataset (Creswell & Creswell, 2017). The research aimed to contribute to the broader discourse on assessing higher education by gathering data on student evaluations of course quality (Hancock & Algozzine, 2016).

2.2 Sample size calculation and sampling method

A total of 278 students are needed to be surveyed to achieve a 95% confidence interval, a 5% significance level, and 80% power. The participants were selected by a simple randomization process. The participants were chosen through a simple randomization process at the course level. Completion is based upon checking the registration department for a comprehensive list of Muscat College students. Simple randomization implemented at the course level helped to choose the participants. All students registered in the specified courses were asked to take part after a random sample of the courses Muscat College offers throughout the study term was chosen. Five hundred fifty students completed the survey. The response rate was 91.7%, with 550 out of 600 individuals participating.

2.3 Participants

In the current study, 550 students from three different departments at Muscat College participated by completing the questionnaires (SEEQ) distributed to them. The participants averaged 20 years old, with a 2.54-year standard deviation.

2.4 Ethical approval

The ethical approval was received by Muscat College’s Research Ethical Committee under the reference MC/RC/1/2024, dated January 2024. Prior authorization was obtained before starting the search. Because the study only required completing a non-invasive, anonymous survey (SEEQ) measuring student assessments of educational quality, which had been approved by the research committee, all participants provided oral permission before they were contacted. Participants were told that their participation in this research was founded on the principles of confidentiality and autonomy, and that they might withdraw from the study at any moment.

2.5 Data collection procedures

The Students’ Evaluations of Educational Quality (SEEQ) Questionnaire was used for data collecting; the chosen sample of students received paper-based questionnaires. The scheduled hour for the questionnaire administration was set; the teacher stayed outside the classroom to provide an objective environment while students were completing the surveys. Following completion of the surveys, a chosen student collected them, sealed them in an envelope, and handed the envelope to the authors. Students were advised that the teacher would not get any direct comments from the assessments, therefore ensuring the privacy of their answers. Three months, from January 2024 to March 2024, defined the data collecting period. Following the ethical standards set by the college, all completed surveys accompanied with signed informed permission forms.

2.6 Measures

The Students’ Evaluations of Educational Quality (SEEQ) questionnaire was the tool used (Marsh, 1982). The SEEQ consists of thirty items that measure eight dimensions under consideration, one of which measures the subject’s overall evaluation. The SEEQ consists of the following dimensions: breadth of coverage, assessment, assignments, learning value, teacher enthusiasm, organization, group interaction, individual rapport, and overall rating (Marsh, 1982). Each component is rated on a five-point Likert scale: strongly disagree, disagree, neutral, agree, and strongly agree (Marsh, 1982). The tool’s developer, Professor Herbert March, was contacted personally and granted permission to be used for study (Marsh, 1982). The author translated SEEQ into Arabic prior to the study, and the instrument was then translated back into English by a bilingual expert who has experience in this area.

Discrepancies that were identified were rectified in the Omani version of the instrument after the bilingual expert and the authors conducted a comparison between the two editions of the instrument (the original and the re-translated version). Subsequently, a preliminary test was administered to a selected group of students and colleagues to evaluate the reliability of the translated SEEQ. Modifications were implemented to improve the semantic significance of some words in Arabic.

2.7 Data analysis

The SEEQ scale was validated using a combination of alternate methods and data analysis. An evaluation of the internal consistency of the scale and its three subscales was conducted using Cronbach’s alpha statistics. The structure of the SEEQ factors was examined using confirmatory factor analyses (CFAs) in AMOS v26, which is a structural equation modeling program. The model was evaluated using fit indices that are often used in the discipline (Blunch, 2008). The Tucker-Lewis index (TLI), goodness-of-fit index (GFI), comparative fit index (CFI), and Chi-Square (χ²) are among the measures. Fit indices of CFI, GFI, and TLI exceeding 0.90 and RMSEA below 0.08 are generally considered acceptable (Bentler, 1990).

3.1 Reliability of internal consistency

To determine the internal consistency reliability of each SEEQ scale, Cronbach’s alpha was used. The output was assessed using the corrected item-total correlation or alpha if an item was omitted (Field, 2013). The reliability (alpha) coefficients for the eight 30-item SEEQ scales are presented in Table 1.

3.2 Confirmatory factor analysis

Confirmatory factor analysis (CFA) is the most suitable technique for cross validating the factor structure of a test, as per Byrne (2001). Using the AMOS version 26.0 statistical tool, a covariance matrix (Figure 1) was used to evaluate the validity of the item allocation to the eight SEEQ measures (IBM Corp, 2024a). The eight-factor structure proposed for the original scale has been confirmed by the Arabic version of SEEQ’s acceptable CFA indices (Figure 1).

Figure 1. The measurement model for SEEQ.

Ethical approval

The ethical approval was received by Muscat College’s Research Ethical Committee under the reference MC/RC/1/2024, dated January 2024. Prior authorization was obtained before starting the search. The nature of the research and the little risk involved led to oral consent instead than written permission. Participants in the research had to complete a non-invasive, anonymous survey (Students’ Evaluations of Educational Quality - SEEQ), which only gauges their opinions of educational quality. Written consent was believed to be not required given the low-risk nature of the survey and its anonymous form. The research committee authorized the oral consent procedure as well as the SEEQ tool. All participants provided oral permission before they were contacted. Participants were told that their participation in this research was founded on the principles of confidentiality and autonomy, and that they might withdraw from the study at any moment.

Consent statement

All participants gave informed consent to be interviewed orally. The college’s ethics committee accepted this method. The source of the informants was who agreed that the data were provided for research purpose and that the data can be published. They also consented that the data were provided for research anonymously without having distorted scientific meaning.

I declare that the data provided is true and can be accounted for.