ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Data Note
Revised

University students dataset related to achievement, classroom practices, perceptions and attitudes of multimedia-based learning quantum physics

[version 2; peer review: 2 approved, 1 approved with reservations]
PUBLISHED 12 Feb 2024
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

Abstract

This dataset presents data collected to assess teaching and learning of quantum physics at the University of Rwanda - College of Education (UR-CE), Rwanda. Data were collected between August and November 2019 as the baseline, and between January and April 2022 under a quasi-experimental design. Three sets of data were collected. The first set was about students’ performance and conceptual understanding collected before and after teaching intervention (lecture method or multimedia-aided approach) using mainly Quantum Physics Conceptual Survey (QPCS). The second set documented classroom practices during teaching and learning using the Classroom Observation Protocol for Undergraduate STEM (COPUS). The last set is comprised of the data related to lecturers’ and students’ perceptions before teaching and learning quantum physics and students’ attitudes after learning Quantum physics. The Quantum Physics Attitude Test (QPAT) was mainly used to collect these data. The dataset is important to education stakeholders because university managers can visualize the status of teaching and learning outcomes, lecturers can reflect on the study, and researchers can use the data to analyze various independent variables.

Keywords

Dataset, Conceptual understanding, Rwanda, Student academic achievement, Student attitude, Quantum mechanics, Quantum physics, University students.

Revised Amendments from Version 1

In this new version, all reviewers' comments were addressed by using tracking changes. The fist sentence of introduction was revised and appropriate citation was added. In methods , sample used during piloting research instruments was amended. In references, three new references was added. The link showing all manuscripts published related to the data was added in the last part of this article.

See the authors' detailed response to the review by Nicolas Labrosse
See the authors' detailed response to the review by Peter C. Samuels

Introduction

The education system in Rwanda has seen many transitions, including after the 1994 Genocide Against the Tutsi.1 In 2008, Rwanda transitioned from French to English as a language of instruction at all levels of education2; in 2012, a policy for 12 years of basic education was adopted,3 and in 2013 the public higher education institutions were merged into a single University of Rwanda.4 Several studies have so far documented learning of physics57 after a competence-based curriculum was implemented in secondary schools in 2016.8 Few people have chosen the direction of higher learning institutions.9 However, few of them focused on teaching and learning practices of quantum physics at the university level. Quantum mechanics is a discipline that is introduced by quantum physics, and quantum physics is a set of principles used to explain the behavior of matter and energy. Thus, these two terms were used interchangeably in this manuscript and served as a focus of data collection. This branch of physics consists of many important phenomena in nature despite the difficulty faced by students to interpret various concepts1012 such as blackbody radiation, the photoelectric effect, Compton Effect, the wave aspects of particles, De Broglie’s hypothesis, diffraction and interferences, the model of the atom, uncertainty relations, the wave function, and Schrodinger Equations. Therefore, this served as a motivation for researchers to investigate the teaching and learning of quantum physics at the University of Rwanda – College of Education (UR-CE). Before the implementation of the intervention, a baseline study was conducted. This baseline study aimed to determine the prime indicators of current teaching methodologies and students’ perceptions of quantum physics for quality knowledge delivery at the University of Rwanda College of Education.10 For this study, attitude tests (Quantum Physics Attitude Test, QPAT) for students and Educators were used. These research instruments were designed and validated by university experts in science education. We piloted them on 30 physics students and two educators from the University of Kibungo, Rwanda.10 These participants were not part of this study.

Methods

Research design and method of data collection

The study was quasi-experimentally designed.13 Before data collection was initiated, ethical clearance was applied to and approved and provided by the Unit of Research and Innovation, University of Rwanda-College of Education. Lecturers were briefed on required teaching approaches, and students and physics lecturers were informed of voluntary participation. The study was conducted at UR-CE in the department of Mathematics, Science, and Physical Education (MSPE) with groups of second-year undergraduate students from Mathematics-Physics-Education (MPE), Physics-Chemistry-Education (PCE) and Physics-Geography-Education (PGE) combinations assigned to experimental and control groups. Teaching intervention was delivered from 28 January to 1 April 2022. Lecturers in Quantum Physics were agreed to help the respective groups to understand the subject. Thus, while traditional lecture group or lecture class were taught using marker and whiteboard and PowerPoint presentations, the experimental group or multimedia class was taught using animations, PhET simulations, and YouTube videos. Animation introduced a concept while teaching with multimedia to engage students. Before playing a simulation or a video, students were given prediction questions to help them predict the outcomes of the experiment. Before intervention (December 2021), a pre-test was administered using an adapted Quantum Physics Conceptual Survey (QPCS).14 It was adapted because it was not used alone, as it lacks some elements taught in the UR-CE Quantum Mechanics module. Researchers added some questions (see Table 1) about blackbody radiation from textbooks and total energy, and the probability of finding a particle from the Quantum Mechanics Conceptual Survey (QMCS).15 This decision was advice from four university physics lecturers who validated the test’s content.

Table 1. Arrangement of achievement test items.

Total numberNumbering in the testCorrect answersSources
1Q1CQuestions from textbooks
2Q2A
3Q3B
4Q4B
5Q1AQuestions from QPCS
6Q2B
7Q3D
8Q4D
9Q5D
10Q6A
11Q7A
12Q8B
13Q9A
14Q10C
15Q11C
16Q12A
17Q13B
18Q14C
19Q15C
20Q16B
21Q17C
22Q18A
23Q19A
24Q20D
25Q21D
26Q22A
27Q23D
28Q24B
29Q1BQuestions from QMCS
30Q2B
31Q3C
32Q4D

We used a test-retest method on a sample of 30 physics students for checking reliability and the internal consistency revealed a high Cronbach alpha coefficient (a = 0.718) of 32 QPCS items used.16 The first author and her trained assistants made follow-ups by doing classroom observations to see whether there were any challenges during the intervention. After six weeks of teaching, the post-test was also given to all participants to examine if the multimedia intervention had some effects on students’ conceptual understanding. We used the Classroom Observation Protocol for Undergraduate STEM (COPUS) developed by Northern American researchers.17 This protocol comprises 12 codes for instructor activities, 13 codes for student activities, and three codes for student engagement. Before data collection, interrater reliability were obtained between each of the two pairs of classroom observers. Student codes generated a Kappa value of 0.652, instructor codes 0.805, and student participation codes generated 0.625. These values are considered very high in inter-observer reliability.18

The Quantum Physics Attitude Test (QPAT) was adapted from the Evaluation Questionnaire for Computer Simulations (EQCS)19 and designed based on the literature review, daily teaching experiences, and students’ group discussions. The formulated 29 questions were content validated by five university experts in research, and the final QPAT comprised 24 items. The test had four sections: (i) College students’ perceptions of quantum physics concepts, (ii) Use of multimedia in teaching and learning quantum physics, (iii) Students’ feelings towards learning quantum physics, and (iv) the extent students recommend the actions to be taken in improving teaching and learning quantum physics. The test was implemented after getting a 0.74 reliability of internal consistency.10 We also need to note that while achievement data were collected before and after the intervention, classroom observation data were collected during the teaching and learning period; however, students’ attitude data were collected after teaching and learning follow-up, and the staff and students’ perceptions before teaching and learning activity.

Description of dataset

This dataset comprises five Excel files and five pdf files. These pdf files are research tools used to collect data, while these Excel files are data files. The first file is students’ achievements (named: Data Related to Academic Achievement 2022). This file has four sheets. (1) Pre-test of the Control group, (2) Post-test of the Control group, (3) Pre-test of the Treatment group, and (4) Post-test of the Treatment group. In the sheet, the first column shows the study combination as mentioned in the above section and the second column consists of serial number (s/n). From the third column or column-C to column-HA, the students’ answer choices for each of the 32 questions are entered. Correct answers are presented above each question. From column-AK to column-PB, each question is marked. The same analysis as that in Ref. 20 was adopted. The formula used was “= IF (EXACT (E18, E$15),1,0). This means we matched the answer of the first students on row-18 and column-C with the expected answer on row-15 and column-C on the first question. The dollar sign was used to avoid the formula to shift the rows down. If the answers matched, the software assigned one mark, and a zero otherwise. We summed these scores up in column-BR and computed their respective percentage in column-BS. A total of 385 undergraduate students participated in the pre- and post-tests.

Below the data, the number of students who chose a certain answer was computed (see row-198 and column-C) using the “COUNTIF” function. After this, a percentage was computed. Likewise, the sum and corresponding percentage were calculated under the assigned marks (see row-199 and column-AK).

The second data file (named “Data related to baseline study_Post teaching and learning Quantum Physics_2022”) presents the students’ and educators’ perceptions of teaching methodologies used while teaching quantum physics. It contains two sheets with quantitative and qualitative data collected from students who have previously learned quantum physics and educators who taught this course in past years. Thus, this was used for the baseline study, where we investigated the impact of current teaching methodologies and teaching staff and students’ perceptions of quantum physics for a quality knowledge delivery system.10

The third and four files are related to classroom observation data. One comprises data for the control group (named: Data related to Classroom Observation 2022_Control group), while the other comprises data for the experimental group (Data related to Classroom Observation 2022_Experimental group). These files have four sheets each. The first sheet contains raw data, the second sheet presents the meaning of codes used in the first sheet, the third sheet present analyzed data by activity, and the fourth sheet present analyzed data by time interval. Data were entered in a way that when an activity was observed, a mark of “1” was entered and when an activity was not observed, an empty space is left. The intervention was carried out for 80 minutes per week for weeks. For this reason, the first column (or column A) consists of two-minute time intervals of observed activities, and column AF shows the week (weeks 1-6). Rows 14 and 15 show the codes or observed activities, while the sum and total of observed activities are computed at the end of the table of activities. These sums are used to plot the activities graph (see sheet 3) as they do not consider time intervals. Thus, the proposition of each activity is calculated based on all activities. That is why all activities’ occurrence add up to 100. On the other hand, when considering activities and the sometimes time interval, the computed proportions of activities do not add up to 100. They can go beyond (see sheet 4). This was computed referring to the total intervals calculated in column AE. A Classroom Observation Protocol for Undergraduate STEM (COPUS) tools was used to collect and analyse data.17

The fourth file data file (named “Data Related to Students Attitude_Post assessement 2022”) presents the students’ perceptions on multimedia usage in teaching and learning quantum physics attitude. It contains five sheets. The first sheet explains the codes or assigned numbers used in the second and fourth sheets. The second sheet (Experimental group_QPAT) and the third sheet (Experimental_G_QPAT-Open Q) contain quantitative and qualitative data, respectively. Likewise, the fourth sheet (Control group_QPAT) and the fifth sheet (Control_G_QPAT_Open Q) contain quantitative and qualitative data, respectively. This was done to ease the visualization of data since the attitude test contained both closed and open questions. Thus, quantitative data from closed-question items were put in a separate sheet, and qualitative data from open-ended question items were put in their separate sheets. 385 undergraduate students who have completed the learning of quantum physics using either lecture or multimedia application methods participated in the survey. The reason why fewer students attended the attitude test than those who attended the achievement test may be that the achievement test was performed on paper while the attitude test was performed online. The questions under the “Student feelings towards learning Quantum physics” were answered using five scales. Strongly agree (5), Agree (4), Neutral (3), Disagree (2), and Strongly disagree (1). Therefore to analyze such data, a COUNTIF function was again employed as in the achievement test.

Comments on this article Comments (1)

Version 2
VERSION 2 PUBLISHED 12 Feb 2024
Revised
Version 1
VERSION 1 PUBLISHED 03 Jan 2023
Discussion is closed on this version, please comment on the latest version above.
  • Author Response 13 Apr 2024
    Pascasie Nyirahabimana, African Center of Excellence for Innovative Teaching and Learning Mathematics and Science (ACEITLMS), University of Rwanda College of Education (UR-CE), Kayonza, Rwanda
    13 Apr 2024
    Author Response
    All reviewers' comments were addressed by the authors of this articles and the revised version was submitted. Thanks a lot Peter C. Samuels and Nicolas Labrosse for your constructive feedback ... Continue reading
  • Discussion is closed on this version, please comment on the latest version above.
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Nyirahabimana P, Minani E, Nduwingoma M and Kimeza I. University students dataset related to achievement, classroom practices, perceptions and attitudes of multimedia-based learning quantum physics [version 2; peer review: 2 approved, 1 approved with reservations]. F1000Research 2024, 12:4 (https://doi.org/10.12688/f1000research.128013.2)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 2
VERSION 2
PUBLISHED 12 Feb 2024
Revised
Views
7
Cite
Reviewer Report 11 Apr 2024
Wade Naylor, National School of Education, Faculty of Education and Arts, Australian Catholic University, Brisbane, Australia;  University of Johannesburg, Auckland Park, Gauteng, South Africa 
Approved
VIEWS 7
This data note uses four different inventories at the University of Rwanda - College of Education (UR-CE) in 2022: the Quantum Physics Conceptual Survey (QPCS); the Classroom Observation Protocol for Undergraduate STEM (COPUS) and the Quantum Physics Attitude Test (QPAT). ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Naylor W. Reviewer Report For: University students dataset related to achievement, classroom practices, perceptions and attitudes of multimedia-based learning quantum physics [version 2; peer review: 2 approved, 1 approved with reservations]. F1000Research 2024, 12:4 (https://doi.org/10.5256/f1000research.162481.r260496)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
7
Cite
Reviewer Report 20 Feb 2024
Nicolas Labrosse, University of Glasgow, Glasgow, Scotland, UK 
Approved
VIEWS 7
No ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Labrosse N. Reviewer Report For: University students dataset related to achievement, classroom practices, perceptions and attitudes of multimedia-based learning quantum physics [version 2; peer review: 2 approved, 1 approved with reservations]. F1000Research 2024, 12:4 (https://doi.org/10.5256/f1000research.162481.r246076)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Version 1
VERSION 1
PUBLISHED 03 Jan 2023
Views
20
Cite
Reviewer Report 08 Nov 2023
Nicolas Labrosse, University of Glasgow, Glasgow, Scotland, UK 
Approved
VIEWS 20
This data note provides information necessary to review and analyse the data collected by the authors. The method of data collection is well described. 

A few more details on the teaching interventions and their pedagogical motivations would ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Labrosse N. Reviewer Report For: University students dataset related to achievement, classroom practices, perceptions and attitudes of multimedia-based learning quantum physics [version 2; peer review: 2 approved, 1 approved with reservations]. F1000Research 2024, 12:4 (https://doi.org/10.5256/f1000research.140564.r214701)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 13 Apr 2024
    Pascasie Nyirahabimana, African Center of Excellence for Innovative Teaching and Learning Mathematics and Science (ACEITLMS), University of Rwanda College of Education (UR-CE), Kayonza, Rwanda
    13 Apr 2024
    Author Response
    Thank you so much . I agree with your comment. For more details, please check all publications related to these data on the following link: https://bit.ly/3TTAFdN
    Competing Interests: No competing interests were disclosed.
COMMENTS ON THIS REPORT
  • Author Response 13 Apr 2024
    Pascasie Nyirahabimana, African Center of Excellence for Innovative Teaching and Learning Mathematics and Science (ACEITLMS), University of Rwanda College of Education (UR-CE), Kayonza, Rwanda
    13 Apr 2024
    Author Response
    Thank you so much . I agree with your comment. For more details, please check all publications related to these data on the following link: https://bit.ly/3TTAFdN
    Competing Interests: No competing interests were disclosed.
Views
27
Cite
Reviewer Report 18 Jan 2023
Peter C. Samuels, Business School, Birmingham City University, Birmingham, UK 
Approved with Reservations
VIEWS 27
The datasets are definitely useful, and much effort has gone into organising them. The rationale is clear in the introduction. The method is also clearly presented. The description of the datasets is clear and helpful.

However, there ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Samuels PC. Reviewer Report For: University students dataset related to achievement, classroom practices, perceptions and attitudes of multimedia-based learning quantum physics [version 2; peer review: 2 approved, 1 approved with reservations]. F1000Research 2024, 12:4 (https://doi.org/10.5256/f1000research.140564.r158997)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
  • Author Response 13 Apr 2024
    Pascasie Nyirahabimana, African Center of Excellence for Innovative Teaching and Learning Mathematics and Science (ACEITLMS), University of Rwanda College of Education (UR-CE), Kayonza, Rwanda
    13 Apr 2024
    Author Response
    Thank you so much for your constructive feedback. The response on some issues raised are here below:
    1. The 1994 Rwandan genocide is known outside of Rwanda as the 1994 Genocide ... Continue reading
COMMENTS ON THIS REPORT
  • Author Response 13 Apr 2024
    Pascasie Nyirahabimana, African Center of Excellence for Innovative Teaching and Learning Mathematics and Science (ACEITLMS), University of Rwanda College of Education (UR-CE), Kayonza, Rwanda
    13 Apr 2024
    Author Response
    Thank you so much for your constructive feedback. The response on some issues raised are here below:
    1. The 1994 Rwandan genocide is known outside of Rwanda as the 1994 Genocide ... Continue reading

Comments on this article Comments (1)

Version 2
VERSION 2 PUBLISHED 12 Feb 2024
Revised
Version 1
VERSION 1 PUBLISHED 03 Jan 2023
Discussion is closed on this version, please comment on the latest version above.
  • Author Response 13 Apr 2024
    Pascasie Nyirahabimana, African Center of Excellence for Innovative Teaching and Learning Mathematics and Science (ACEITLMS), University of Rwanda College of Education (UR-CE), Kayonza, Rwanda
    13 Apr 2024
    Author Response
    All reviewers' comments were addressed by the authors of this articles and the revised version was submitted. Thanks a lot Peter C. Samuels and Nicolas Labrosse for your constructive feedback ... Continue reading
  • Discussion is closed on this version, please comment on the latest version above.
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.