Interactive Learning System for Learning Calculus

Background IT tools has brought a new perspective to collaborative learning where students do not just sit in a chair and swallow lecture content but instead participate in creating and sharing knowledge. However, calculus learning augmented reality application has limitation in promoting a human collaboration in learning. Purpose This research develops an interactive application for learning calculus that promotes human-system interaction via augmented reality (AR) and human-human interaction through chat functions. The study examines the effect of both interactivities on learning experience and how that learning experience affects the performance of learning. Methods The research adopted a quasi-experimental study design and pre-post test data analysis to evaluate the effect of interactivities on learning experience and consequently the effect of learning experience on learning performance. The subjects were exposed to the developed application for learning the calculus chapter “Solid of Revolution” in a controlled environment. The study validated its research framework through partial least squares path modelling and tested three hypotheses via pre-and post-test evaluation. Conclusions The results found that both interactivities affect learning experience positively; human-human interactivity has a higher impact than the human-system interactivity. It was also found that learning performance as part of the learning experience increased from pre-test to post-test.


Introduction
In traditional classroom environments, there exists a problem with student participation. 1 It is also stated that the traditional method is inefficient as it is mostly spoon-feeding, and students' analytical processes are absent due to a lack of peer interaction. 26][7][8][9][10] Calculus is one of the core subjects in computer science studies.Malaysian students pursuing diplomas and degrees in Information Technology take calculus subjects that include differentiation, and integration.[13] In understanding the revolution of solids around an axis, visualization of the solid in-question is very important.Spatially related 3D images cannot be drawn on a 2D board or projected over a computer.These hinder students in visualizing the solid and result in difficulties in conceptualizing the concept.After consulting with the subject teacher on what the student struggle most in learning calculus, it was suggested that students face difficulties in understanding solid of revolution through traditional classroom method as it requires 3D visualization.8][19] Under the theory of learner constructing their knowledge Lev Vygotsky theorized that learning occurs through personalization and socialization. 20So it is crucial to provide the function to interact among the learners.Unfortunately, majority of the AR learning application only focused on providing content visualization resulting in not a holistic application in learning that promote both type of interaction. 14,15,21,22As such, developing an interactive AR application that facilitates both human-human and human-system interactivities and assists in conceptualizing and understanding math better is needed.
Interactive technology has made learning more personalized and kept students engaged through various applications. 23his paper also suggested that interactive technology can make learning more active, and intensive for students where students can communicate easily with each-others and also with the teacher. 23Recently implementation of Augmented Reality (AR) in pedagogy has been adopted by many researchers where the emphasis has mainly been kept on 3D visualization.Many have implemented AR in geometry for school students 14,19,24 while some others implemented it for calculus. 12,13In both cases, the authors have focused on the immersive learning experience through AR but no humanhuman interaction function was provided.This research aims to develops an augmented reality application that promotes interaction and spatial visualization for learning calculus and evaluates the effect of the interactive learning system on the performance of learning.

Literature review
Implementation of interactive learning systems in class to engage students in learning has become a common focus in the pedagogical arena.A system that promotes interpersonal interaction and provides a sense of others' presence can be considered as an interactive system. 4

Interactivity
In an attempt to increase class interactivity different types of technologies have been implemented in class.These can be categorized as synchronous and asynchronous mediums of interaction. 25Synchronous is used as a medium of interaction during class specially in carrying out in class discussion, whereas asynchronous is for facilitating learning remotely that may happen after the class.Interactive whiteboards, 2 and virtual-reality-based systems for learning language 4 are used in synchronous learning.AR-based interactive book 5 is a tool used in asynchronous learning.On the other hand, REVISED Amendments from Version 1 We have revised the manuscript carefully based on all the comments and issues raised in the objectives, literature review, methodology, research design and procedures used in this study, measurement instruments and data analysis techniques.Additionally, the discussion section has been rewritten to explain the study results and aligned with the research objectives.Furthermore, Figure 1 has been updated to correct the typo 'Casual' to 'Causal'.Figure 2 has been updated with the addition of H1, H2, and H3.interactivity can also be categorized as human-system and human-human, as technologies are allowing both in a learning environment. 3The framework for interactive learning application is developed based on these two types of interactions.Human-human interactivity is further divided into teacher-student and student-student interactivity.Past studies in Table 1 shows promoted interactivities by different studies.These studies focused primarily on human-system interactivity while a few provided human-human interactivities.
AR has become a trending technology in the pedagogical sector to provide students with an immersive experience.AR provides a real and virtual experience together to allow users real-time interaction. 163D representation of a virtual object in a real environment can make learning more engaging as it provides a visual learning experience.This can be helpful to the majority of students as studies have found that there are more visual learners compared to auditory or kinesthetics learners. 26Besides, haptic interaction happens when users are allowed to interact with the 3D object through AR technology 27 which also address kinesthetics learners as they learn through physical involvement.Past studies in Table 2 depicts the interactivities promoted by different AR studies.
From the past studies depicted in Table 2, five papers adopted mobility in their AR system except the three that were desktop-based.Table 2 depicts that most systems solely focused on interactivity through AR and not implementing any human-human interactivity.

Learning Experience
Learning experience can be defined as the experience a learner goes through while learning content set by an institution. 28ncluding active engagement and collaboration as a part of it affects learning performances. 29,30Furthermore, implementation of technology in class affects the learning experience positively.

Research Design and Participants
This study conducted a pre-assessment evaluation of the respondents' knowledge, skills, or understanding in the AR area related to the system before they started using it. 32One of the numerous forms of quasi-experimental design is pre-and post-test research."Quasi" refers to something that resembles experimental study.Studies evaluating a curriculum for education, a treatment system or a simulation training commonly apply pre-and post-test evaluation. 33Since this study is to compare students' learning experiences and academic performance before and after using the AR system, a pre-and post-test quasi-experimental research method was chosen.
Convenience sampling is a nonprobability or non-random sampling in which it is able to conveniently reach and recruit members of the target population for the study. 34Usually, convenience samples of university students are used in academic surveys. 35Since the respondents were students from a Malaysian university taking Calculus subject, a nonprobability convenience sampling method was used for this study.
Sample size calculation was done by following the 10 times rule, where the sample size is required to be 10 times larger than the maximum number of structural paths directed towards a latent variable. 36As such the minimum sample for this study is supposed to be larger than 20 as two paths are directed towards the latent variable.The sample size for this research was 59, but after eliminating missing data and straight-line answers the data was analyzed from 55 respondents.
Quantitative research designs include quasi-experiments, true experiments, causal-comparative research, surveys research and experiments research.Quantitative research is likely to test theories by investigating the relationships among variables. 37Therefore, the primary research method for this study was quantitative.
Structural equation modeling (SEM) combines multiple regression and factor analysis.It is employed to examine the relationships between a group of observable variables and latent concepts.There are two main types of the SEM.In this study, instead of using the traditional Covariance-Based-SEM (CB-SEM), Partial Least Squares-SEM (PLS-SEM).PLS-SEM is chosen to analyze the data based on its capability to handle complex models and small sample sizes.Data analysis using PLS-SEM was employed by defining clear research objectives and hypotheses, data preparation, structural model analysis, hypotheses testing, structural model assessment and predictive accuracy, effect size and relevance evaluation. 36LS-SEM is often chosen for longitudinal studies due to its effectiveness in handling small sample sizes, which are common in these studies, especially when compared to cross-sectional studies. 36gure 1 illustrates the research design of this study.

Research framework
This research has identified two types of interactivities, human-human and human-system.Figure 2 depicts the research framework of this study.An interactive learning system based on AR was developed.Human-system and human-human interactivities were included as part of application functions.Human-system interaction was promoted by haptic interaction based on markerbased AR technology whereas human-human interactivity was implemented through a function of discussion platform.
The framework was developed to find how these two interactivities affect the learning experience, the first dependent variable, and lastly how the learning experience incurred by the promoted interactivities affects students' academic performance.
This study hypothesizes: H1: Human-system interaction is positively associated with students' learning experience.
H2: Human-human interaction is positively associated with students' learning experience.
H3: Improvement of learning experience improves the performance of learning.

Survey Design and Procedures
This research was conducted into three phases.In the first phase, data were collected from students through a prequestionnaire and a quiz before using the application, in the second phase, they used the application and explored AR, and lastly, in the third phase, post-test data were collected through same questionnaire.
Figure 3 shows students exploring the AR function of the application.Figure 3. Implementation of AR system in class.
The survey questionnaire was divided into three segments.Section (A) was demographic questions; section (B) was for evaluating the two independent variables, section (C) for measuring the learning performance.
Section A comprises of six questions regarding participants' general information that included gender, ethnicity, age and whether they have used any educational AR application before or not.All the questions in this section were self-designed.
Section B evaluates the variables of the research framework comprised of self-developed and adopted questions from multiple sources.Independent variable, human-human interaction measurement questions were formed based on the idea of peer-peer interaction and student-teacher interaction (Table 3).How interactive technology promotes both types of interactivities in class was also examined by another study that targeted the usage of clickers in a classroom. 3r the second independent variable human-system interaction, the questions were adopted 38 and depicted in Table 4.
The idea of human-system interaction is based on how satisfied the users are with using a particular system.For this purpose, this study has adopted the measurement items used in terms of suitability to the task or how efficient it is in performing the intended tasks, controllability, suitability for learning the usage of the application, and how well the system is for self-descriptiveness. 38 The learning experience variable was evaluated based on the adopted questionnaire from 31 shown in Table 5.In their study, they measured learning motivation as part of AR learning experience.Motivation has been measured by a developed model of attention, relevance, confidence, and satisfaction. 39The self-developed questionnaire listed in Table 6.All the questions for the aforementioned variables were measured through 5-point Likert scale.
Section C was developed by a calculus subject expert in evaluating learning performance via a quiz.The quiz included five True/False and one formative questions on solid of revolution chapter.The quiz was used in pre-and post-test evaluation for measuring learning performance factor.To avoid question biases, the same questions were used.Order of true-false questions were changed to make sure students did not just follow the similar pattern of answer from the pre-test.

Data analysis techniques
This study conducted two types of analysis through Smart PLS 3.0 and SPSS 22 (IBM SPSS Statistics, RRID: SCR_019096) for conducting structural model assessment and pre-and post-test comparison of variables respectively.
R is an open-source alternative software (R Project for Statistical Computing, RRID: SCR_001905) for Smart PLS.

Demographic profile
This study collected 55 valid responses from the selected sample of 59 students from a Malaysian private university (Table 7).Out of 55 respondents, 46 were male (83.6%) while 9 were female constituting 16.4% of total respondents.The result is in line with other research findings as the gender ratio significantly skews towards males in the technology field. 40,41Among the three main ethnicity groups 43 students were Chinese (78.2%), followed by six Malay and six Indians constituting 10.9% each.As the sample was from pre-university students, the age range was from 18-22.The majority of students were 19 years old (60%) where 18 and 22 were the smallest age groups, constituting 3.6 % each.Students' experience of using similar types of applications in learning provides an indication of whether users are experienced in using this type of application or not.It is found that the students scored the same grades in this preassessment, indicating that they had the same initial level of understanding in the studied area before using the system.

Inferential statistics
The study adopted a PLS_SEM approach to maximize the variance of the defined framework's endogenous construct. 42tructural model analysis was used to test the hypotheses along with its predictive accuracy and effect size.All the constructs were measured with five or more indicators.As the model is reflective, the constructs are reflective too."Internal consistency reliability", "convergent validity" and "Discriminant Validity" are the three criteria used to assess the constructs. 37

Internal consistent reliability
To evaluate the same source biasedness coefficient variation, Internal consistency reliability is used to investigate the reliability of indicators that measure a latent variable.From Table 8, each construct satisfied the criteria of composite reliability (CR) of ≥ 0.700. 43As such it can be concluded that the constructs met the internal consistency reliability criteria.All the self-developed questions under human-human interaction variables satisfied the reliability as the loading is >0.600. 36For the three self-developed questions (LE 10, LE11, and LE12) under learning experience variable two of the questions LE11, LE12 also satisfy this criterion.

Convergent validity
Convergent validity is measured by the indicator of Average Variance Extracted (AVE) and factor loading. 43 AVE indicates what percentage of the variance of a construct is defined by a marker. 43Acceptable value of AVE for each construct must be ≥ 0.500.From the AVE value depicted in Table 8, all constructs satisfied the convergent validity criteria.Factor loading of each indicator ≥ 0.6 is acceptable. 44

Discriminant validity
Discriminant validity is measured by the Fornell and Larcker Criterion (FLC), cross-loading comparison and HTMT technique. 36FLC indicates that the square roots of AVEs for the reflective constructs must be larger than the correlation for all other constructs diagonally.Table 9 shows that all constructs satisfied FLC criteria, where the square roots of AVEs for the reflective constructs of HHI (0.751), HSI (0.726) and LE (0.711) satisfied this criteria.
From Table 10 of cross loading, all indicators load high on their own constructs compared to others.This confirms that the constructs are distinct from each other indicating discriminant validity as a result.All the items including the selfdeveloped questions satisfy this validity criteria.
HTMT mechanism of assessing discriminant validity requires the value of HTMT to be lower than 0.850 for stringent criterion and 0.900 for conservative criterion. 36From Table 11, all the constructs satisfy the above criteria confirming discriminant validity thereof.
From all the criteria of confirmatory factorial analysis, the research model is adequately fitting to be accepted.As such this designated measurement model with specified latent variables has been analyzed with SEM criteria.

Structural Model Assessment
Path analysis was performed to find the hypothesized relationship.The results for collinearity assessment and hypothesis are shown in Table 12.Both latent variables Human-Human Interaction (HHI) and Human-System Interaction (HSI) have positive effects on Learning Experience (LE).The variance inflation factor (VIF) results in Table 12 show that the lateral multicollinearity meets the criteria of being above the threshold of 0.2 and below the threshold of 5, implying collinearity was not an issue in the structural model. 43study by 43 suggested that for a one-tailed test "t-values" for a significant level of five per cent (α = 0.05) are required to be greater than 1.645.The result indicated that both exogenous constructs HHI and HSI have a "t-value" of >1.645 for a Predictive accuracy, effect size and relevance "Predictive accuracy" is evaluated through the "coefficient of determination, R 2 ".R 2 values imply the predictive power of exogenous constructs over endogenous ones.From the analysis construct LE's R 2 value is found as 0.576 which means exogenous constructs substantially explain 57.6% of LE's variance as predictive power can be considered as substantial if it is greater than 0.260. 45Although 43 has stated R 2 value less than 0.670 is moderate.
To evaluate the effect size of exogenous constructs Cohen's f 2 value was obtained from the model analysis. 45stated that the f 2 value of 0.350 is considered a substantial effect whereas 0.150 is considered moderate.From Table 12 it can be seen that the HHI construct has a substantial effect on LE (0.463) and HSI has a moderate effect (0.157).
In addition, the Q 2 value of endogenous construct LE was found at 0.269 indicating moderate "predictive relevance". 43esides, as the Q 2 value is larger than 0, it can be concluded that HHI and HIS exogenous constructs have "predictive relevance" for the endogenous construct LE. 46 Pre-test post-test For understanding the significance of pre-and post-test performance of student paired sample t-test was carried out and the result is shown in Table 13.From Table 13 it can be concluded that there is a significant relationship between the results of the pre-and post-tests as the P<0.050. 32The post-test mean implies that students' performance results in the post-test are higher than the pre-test one signifying a positive improvement in the performance of learning.

Discussion
The study aims to develop an augmented reality application that promotes interaction and spatial visualization for learning calculus and evaluates the effect of the interactive learning system on the performance of learning.Humanhuman interaction is evaluated as part of the chat function of application and human-system interaction is analyzed as part of augmented reality implementation through mobile application.
The first hypothesis was accepted as human-system interactivity positively affected the learning experience factor.As this study developed an augmented reality application for learning calculus, here human-system interaction is related to the interactivity promoted by the augmented reality application.Studies implementing augmented reality in improving learning experience founds that the didactic experience of this technology make students more engaged and hence providing an enriched learning experience. 12,14,16,21,27This study has also found that among the human-system interaction all students univocally cancelled out disagreement that it provided them with real world 3D object feelings.
The study using similar questionnaire have also found that it has significant impact on the learning experience in general and motivation in particular. 39So, the result of this study is aligned with the prior relevant studies.
The second hypothesis result found that human-human interaction significantly influences learning experience.The implication from this hypothesis acceptance indicate that learning experience is shaped by human-human interaction which can comes from student-teacher or student-student.In the study design both student-teacher and student-student interaction facilities were provided via application chat function.So, it can be said that both type of human-human interactions are associated positively with learning experience.This result is in line with the findings where both types of interaction led to learning satisfaction. 472][3] In addition to that another study has also claimed that learning confidence as part of learning experience has also increased through interaction with peers and teachers. 1From the findings of these research, it can be concluded that the result of human-human interaction affecting learning experience is in line with existing research.
The third hypothesis of the study was tested by using paired sample "t-test" where learning performance' means were compared from 'pre-test' to 'post-test' scenario.The result shows that there is significant relation between the score and "post-test" mean is higher than the 'pre-test' one.Other studies have also found that learning experience as result of human-system and human-human interactivity increase learning performance. 3,15,47So, it can be claimed that in terms of hypothesis acceptance, this study is in line with existing literature.

Conclusions
The role of interactivity in the learning experience has been established by many studies before, but implementing both human-human and human-system interactivities in an augmented reality application was overdue.This research had done exactly that and analyzed the effectiveness of the research framework by using PLS.From the results, it can be concluded that the model was fit to analyze the research framework with substantial predictive accuracy and a moderate effect size of the exogenous variable with a moderate relevance on endogenous variable LE.All three hypotheses are confirmed as P values for all three are at a satisfactory level.These results imply that human-human and human-system interactions positively affect learning experience and performance of learning as a result of an enhanced learning experience.

Ethical considerations and consent
All the procedures performed in this study involving human participants were in adherence to the ethical policies of the University as approved by the Technology Transfer Office of Multimedia University under ethical approval number: EA0702021.
Written consent was also obtained from all individual participants involved in the study.Personal data from individuals was promised to be kept confidential and strictly restricted for use in this study only.

Lukman Hakim Muhaimin
Universitas Pendidikan Indonesia, Bandung, Indonesia The study design, methodology, data interpretation, and conclusion sections are appropriate and effectively convey the research intent.I understand the researcher focuses here on discussing interactive media, with implicit reference to AR in the title.However, I suggest adding a discussion on the theories related to AR and linking them with interactive learning within the theoretical framework section.Furthermore, I recommend including a brief depiction of the interactive media (such as displaying images) to enhance the readers' visualization.
Lastly, I'd like to inquire: If these media were removed from the process of understanding calculus concepts, would students still be able to grasp those concepts?I hope the media developed by the researcher serves as an extended cognition, not merely a teaching aid that, if removed, would leave students unable to understand mathematical concepts.

Are sufficient details of methods and analysis provided to allow replication by others? Yes
If applicable, is the statistical analysis and its interpretation appropriate?I cannot comment.A qualified statistician is required.

Are all the source data underlying the results available to ensure full reproducibility? Yes
Are the conclusions drawn adequately supported by the results?

Is the work clearly and accurately presented and does it cite the current literature? Yes
Is the study design appropriate and is the work technically sound?Yes

If applicable, is the statistical analysis and its interpretation appropriate? Yes
Are all the source data underlying the results available to ensure full reproducibility?Yes

Are the conclusions drawn adequately supported by the results? Yes
Competing Interests: No competing interests were disclosed.

Introduction:
In this section, explanations related to the following things need to be explained to construct a more complete research motivation: What problems are still encountered in the application of learning media based on 3D visualization with AR technology? 1.
What systems currently exist to support learning calculus using AR and what are their weaknesses? 2.
What are the existing systems that support visualization and interaction and what are the problems with these systems? 3.

Literature study:
The paper needs to include an explanation of the following points to add clarity to the problem and state-of-the-art research on learning using visualization: Utilization of AR technology in calculus learning.1.
Various interaction models exist in learning applications and their advantages and disadvantages.

2.
Why visualization systems must be supported by human-human interaction in learning applications?

3.
What prevents current AR applications from providing student-student and teacher-student interaction? 4.

Methodology:
To ensure the homogeneity of the sample, it was mentioned in the paper that none of the students had ever used AR applications before.However, the student's initial level of understanding in the area studied before they used the provided AR applications is unknown.Different starting points have the potential to provide different endpoints as well.

Discussion:
In the discussion section, the author should not only emphasize the findings obtained from the statistical approach that has been carried out.A more in-depth study to find out what aspects make human-human interaction give better student performance results than human-system interaction needs to be presented with comparisons from previous studies.
Using previous studies as a reference in the discussion/comparison of research results will provide clarity on the contribution of research in this field of study.

Are sufficient details of methods and analysis provided to allow replication by others? Partly
If applicable, is the statistical analysis and its interpretation appropriate?I cannot comment.A qualified statistician is required.

Are the conclusions drawn adequately supported by the results? Partly
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: My research interest is in software engineering education, software visualization, and project management.

I confirm that I have read this submission and believe that I have an appropriate level of
expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.
Author Response 02 Feb 2024

Sook Ling Lew
Comment 1: This research explores the benefits of human interaction in interactive learning systems with visualization through augmented reality.The subject exposed is calculus on the topic "Revolution of Solids".The research compares the impact of human-system interaction support with human-human interaction support on student learning experiences.In this paper, the author presents information that is quite valuable, however, several important things need to be detailed to get a more comprehensive point of view.Response 1: We have revised the manuscript carefully based on all the comments and issues raised.Although there are some studies that have addressed the issues of student interaction with the system there is still a lack of teacher-student or student-student interaction in interactive learning systems [1, 2, 3].Many systems have promoted a single type of interactivity [4, 5, 6, 7, 8, 9, 10].Literature Review -Interactivity -Paragraph 1: Past studies in Table 1 shows promoted interactivities by different studies.These studies focused primarily on human-system interactivity while a few provided human-human interactivity.Literature Review -Interactivity -Paragraph 2: Past studies in Table 2 depicts that most systems solely focused on interactivity through AR and not implementing any human-human interactivity.
(2) Lacking Spatial Visualization Introduction -Paragraph 2: Application of integration is one of the chapters in Calculus that requires spatial visualization and the 2D medium of the traditional classroom does not provide a proper solution [11, 12, 13].Introduction -Paragraph 3: After consulting with the subject teacher on what the student struggle most in learning calculus, it was suggested that students face difficulties in understanding solid of revolution through traditional classroom method as it requires 3D visualization.The existing interactive methods proposed to overcome these problems are included as: AR based interactive book [5] is a tool used in asynchronous learning.Past studies in Table 1 shows promoted interactivities by different studies.These studies focused primarily on human-system interactivity while a few provided human-human interactivity.

Introduction -Paragraph 4:
Advantages of the existing methods are included as: Interactive technology has made learning more personalized and kept students engaged through various applications [23].This paper also suggested that interactive technology can make learning more active, and intensive for students where students can communicate easily with each-others and also with the teacher [23].

Disadvantages of the existing methods are included as:
Recently implementation of Augmented Reality (AR) in pedagogy has been adopted by many researchers where the emphasis has mainly been kept on 3D visualization.Many have implemented AR in geometry for school students [14, 19, 24] while some other implemented it for calculus [12, 13].In both cases the authors have focused on the immersive learning experience through AR but no human-human interaction function was provided.
Comment 4: What are the existing systems that support visualization and interaction and what are the problems with these systems?Response 4: Introduction -Paragraph 3: Although researchers have implemented AR to assist in visualization, they are mainly focused on human-system interaction, either through haptic or non-haptic interaction [14,  15, 16, 17].Besides, agility is another issue that some systems could not addresses as they are desktop-based systems [17, 18, 19].Under the theory of learner constructing their knowledge Lev Vygotsky theorized that learning occurs through personalization and socialization [20].So it is crucial to provide the function to interact among the learners.
Comment 5: Literature study: The paper needs to include an explanation of the following points to add clarity to the problem and state-of-the-art research on learning using visualization: Utilization of AR technology in calculus learning.Response 5: Advantages of the existing methods are included as: Interactive technology has made learning more personalized and kept students engaged through various applications [23].This paper also suggested that interactive technology can make learning more active, and intensive for students where students can communicate easily with each-others and also with the teacher [23].

Disadvantages of the existing methods are included as:
Recently implementation of Augmented Reality (AR) in pedagogy has been adopted by many researchers where the emphasis has mainly been kept on 3D visualization.Many have implemented AR in geometry for school students [14, 19, 24] while some other implemented it for calculus [12, 13].In both cases the authors have focused on the immersive learning experience through AR but no human-human interaction function was provided.
Comment 6: Various interaction models exist in learning applications and their advantages and disadvantages.Response 6: Under the theory of learner constructing their knowledge Lev Vygotsky theorized that learning occurs through personalization and socialization [20] .So it is crucial to provide the function to interact among the learners.Unfortunately, majority of the AR learning application only focused on providing content visualization resulting in not a holistic application in learning that promote both type of interaction [14, 15, 21, 22].
Comment 7: Why visualization systems must be supported by human-human interaction in learning applications?Response 7: Under the theory of learner constructing their knowledge Lev Vygotsky theorized that learning occurs through personalization and socialization [20] .So it is crucial to provide the function to interact among the learners.
Comment 8: What prevents current AR applications from providing student-student and teacher-student interaction?Response 8: The current AR applications emphasized on immersive learning experience through AR that lacking in providing student-student and teacher-student interaction.The information is included as follows: Recently implementation of Augmented Reality (AR) in pedagogy has been adopted by many researchers where the emphasis has mainly been kept on 3D visualization.Many have implemented AR in geometry for school students [14, 19, 24] while some other implemented it for calculus [12, 13].In both cases the authors have focused on the immersive learning experience through AR but no human-human interaction function was provided.

Comment 9: Methodology:
To ensure the homogeneity of the sample, it was mentioned in the paper that none of the students had ever used AR applications before.However, the student's initial level of understanding in the area studied before they used the provided AR applications is unknown.Different starting points have the potential to provide different endpoints as well.Response 9: Homogeneity of the sample is included as follows: Methods-Research Design and Participants This study conducted a pre-assessment evaluation of the respondents' knowledge, skills, or understanding in the AR area related to the system before they started using it [32].
Descriptive Statistics-Demographic Profile It is found that the students scored the same grades in this pre-assessment, indicating that they had the same initial level of understanding in the studied area before using the system.
Comment 10: Discussion: In the discussion section, the author should not only emphasize the findings obtained from the statistical approach that has been carried out.A more in-depth study to find out what aspects make human-human interaction give better student performance results than human-system interaction needs to be presented with comparisons from previous studies.Response 10: The discussion was rewritten with comparisons from previous studies as follows: The study aims to develop an augmented reality application that promotes interaction and spatial visualization for learning calculus and evaluates the effect of the interactive learning system on the performance of learning.Human-human interaction is evaluated as part of the chat function of application and human-system interaction is analysed as part of augmented reality implementation through mobile application.
The first hypothesis was accepted as human-system interactivity positively affected the learning experience factor.As this study developed an augmented reality application for learning calculus, here human-system interaction is related to the interactivity promoted by the augmented reality application.Studies implementing augmented reality in improving learning experience founds that the didactic experience of this technology make students more engaged and hence providing an enriched learning experience [12, 14, 16, 21, 27].This study has also found that among the human-system interaction all students univocally cancelled out disagreement that it provided them with real world 3D object feelings.The study using similar questionnaire have also found that it has significant impact on the learning experience in general and motivation in particular [39].So, the result of this study is aligned with the prior relevant studies.
The second hypothesis result found that human-human interaction significantly influences learning experience.The implication from this hypothesis acceptance indicate that learning experience is shaped by human-human interaction which can comes from student-teacher or student-student.In the study design both student-teacher and student-student interaction facilities were provided via application chat function.So, it can be said that both type of human-human interactions are associated positively with learning experience.This result is in line with the findings where both types of interaction led to learning satisfaction [47].Another study found that human-human interactivity increases learning engagement [1, 2, 3].In addition to that another study has also claimed that learning confidence as part of learning experience has also increased through interaction with peers and teachers [1].From the findings of these research, it can be concluded that the result of human-human interaction affecting learning experience is in line with existing research.
The third hypothesis of the study was tested by using paired sample "t-test" where learning performance means were compared from 'pre-test' to 'post-test scenario.The result shows that there is significant relation between the score and "post-test" mean is higher than the 'pre-test' one.Other studies have also found that learning experience as result of humansystem and human-human interactivity increase learning performance [3, 15, 47].So, it can be claimed that in terms of hypothesis acceptance, this study is in line with existing literature.

Introduction
This section should include the following information: What are the existing problems in learning Calculus?

○
Why is "Revolution of Solids" proposed in this research?
○ A discussion on the design and development of the interactive methods should be presented here.
Participants -this study uses quasi-experimental design, the participants should be assigned into control and experimental group.This information is not available.How did you assign participants into these groups?How did you select the participants for this study?
For measurement items, what are the scales used in this study?Please list the sources.For the self-developed items, reliability and validity tests should be conducted and reported.
What is the structural equation modelling (SEM)?Why is SEM used in this research?How did you conduct the data analysis?You should also discuss the data analysis for longitudinal study using SEM.

Results
As the measurement items were adopted from many different sources, instrument reliability and validity tests using Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) should be conducted and reported.
For self-developed items, procedures to establish instrument reliability and validity should be presented.
The result section needs to do a major revision with appropriate analyses.Please include relevant Table(s) with appropriate details such as paired t test results, significant value, etc. for each of the test conducted.

Discussions
The author(s) should discuss/relate/compare the findings with prior relevant studies.Please also explain how the results in this study relate to previous findings, whether in support, contradiction, or simply as added data.The discussion should be aligned with the research objectives.

Additional comments:
Page 5, figure 1. Research design -Causal not casual relationship

○
The development of research hypotheses is missing.

○
Did not justify the adopted questionnaire.

○
Did not specify the questions for the quiz.Are the same or different sets of questions used for pre and post?How many questions?

○
Did not mention if measurement model and structural model were assessed based on data collected in the first phase or the third phase?

○
Ensure consistency in reporting the number of decimals throughout the manuscript (including in Tables).

Sook Ling Lew
Comment 1: In this paper, the authors introduced the interactive learning system for learning Calculus.There is a great deal of good work in this paper.However, it does require a significant overall revision to make the best of this and present the work in a clear and well-structured way, particularly on the literature review, the methodology, the research design and procedures used in this study, measurement instruments and data analysis techniques to achieve the research objectives.Additionally, the discussion section is not exhaustive to provide good attempt to explain many of the study results.In fact, the discussion is not aligned with the research objectives.
Response 1: We have revised the manuscript carefully based on all the comments and issues raised.
Comment 2: Abstract Background -the problems of the interactive system are not clear.The authors should point out the existing problems of the interactive system in learning mathematics, particularly in learning Calculus.Please include the main objective(s) or research question(s) of this study in this section.The research objectives/research questions are not clear.Response 2: Existing problems of the interactive system in learning mathematics, particularly in learning Calculus are added as follows: However, calculus learning augmented reality application has limitation in promoting a human collaboration in learning.
The main objective is included in Purpose and Introduction: This research develops an augmented reality application that promotes interaction and spatial visualization for learning calculus and evaluates the effect of the interactive learning system on the performance of learning.Lacking Human-Human interactivity.Although there are some studies that have addressed the issues of student interaction with the system there is still a lack of teacher-student or student-student interaction in interactive learning systems [1, 2, 3].Many systems have promoted a single type of interactivity [4, 5, 6, 7, 8, 9, 10].Past studies in Table 1 shows promoted interactivities by different studies.These studies focused primarily on human-system interactivity while a few provided human-human interactivity.Past studies in Table 2 depicts that most systems solely focused on interactivity through AR and not implementing any human-human interactivity.

Lacking Spatial Visualization
Application of integration is one of the chapters in Calculus that requires spatial visualization and the 2D medium of the traditional classroom does not provide a proper solution [11, 12, 13].After consulting with the subject teacher on what the student struggle most in learning calculus, it was suggested that students face difficulties in understanding solid of revolution through traditional classroom method as it requires 3D visualization.
Comment 5: Why "Revolution of Solids" is proposed in this research?Response 5: The reasons of "Revolution of Solids" are included as follows: In understanding revolution of solids around an axis, visualization of the solid in-question is very important.Spatially related 3D images cannot be drawn on a 2D board or projected over a computer.These hinder students in visualizing the solid and result in difficulties in conceptualizing the concept.
After consulting with the subject teacher on what the student struggle most in learning calculus, it was suggested that students face difficulties in understanding solid of revolution through traditional classroom method as it requires 3D visualization.
Comment 6: Why interactive approach is proposed to overcome these problems?Response 6: The reasons of interactive approach are included as follows: Although researchers have implemented AR to assist in visualization, they are mainly focused on human-system interaction, either through haptic or non-haptic interaction [14,  15, 16, 17].Besides, agility is another issue that some systems could not addresses as they are desktop-based systems [17, 18, 19].Under the theory of learner constructing their knowledge Lev Vygotsky theorized that learning occurs through personalization and socialization [20].So it is crucial to provide the function to interact among the learners.Unfortunately, majority of the AR learning application only focused on providing content visualization resulting in not a holistic application in learning that promote both type of interaction [14, 15, 21, 22].As such, developing an interactive AR application that facilitates both human-human and human-system interactivities and assists in conceptualizing and understanding math better is needed.Recently implementation of Augmented Reality (AR) in pedagogy has been adopted by many researchers where the emphasis has mainly been kept on 3D visualization.Many have implemented AR in geometry for school students [14, 19, 24] while some other implemented it for calculus [12, 13].In both cases the authors have focused on the immersive learning experience through AR but no human-human interaction function was provided.
Comment 9: How are the proposed interactive methods (augmented reality and chat functions) able to solve the existing problem in learning Revolution of Solids?Response 9: Introduction -Paragraph 3 So, it is crucial to provide the function to interact among the learners.Unfortunately, majority of the AR learning application only focused on providing content visualization resulting in not a holistic application in learning that promote both type of interactions.The interactive methods (augmented reality and chat functions) are proposed as follows: 1. AR -to implement Spatial Visualization 2. Chat -to improve Human-Human interactivity.
Comment 10: Please include the main objective(s)/ research questions of this study in this section.Response 10: Main objectives are included as follows: This research aims to develop an interactive AR application for learning calculus that promotes human-system interaction via AR and human-human interaction through chat functions.
Comment 11: Include a brief description of the methodology and system used in this study.Response 11: A brief description of the methodology and system used in this study are included as follows: Pre-test and post-test data from students learning calculus in the classroom using the AR interactive learning system were gathered using a questionnaire and a quiz to evaluate the impact of the developed AR system.Comment 12: Literature review/Background study In this section, discussion on the following should be included: Major problems in learning calculus (visualization) Response 12: Discussion on the major problems in learning calculus (visualization) are included as follows: 1.
Lacking Human-Human interactivity.

2.
Lacking Spatial Visualization Comment 13: How are the interactive activities able to solve the existing problem in learning calculus?Response 13: Under the theory of learner constructing their knowledge Lev Vygotsky theorized that learning occurs through personalization and socialization [20].So, it is crucial to provide the function to interact among the learners.Unfortunately, majority of the AR learning application only focused on providing content visualization resulting in not a holistic application in learning that promote both type of interaction [14, 15, 21, 22].
Comment 14: What are the existing interactive methods proposed to overcome these problems?Should discuss the advantages and disadvantages of the existing methods.Response 14: The existing interactive methods proposed to overcome these problems are included as: AR based interactive book [5] is a tool used in asynchronous learning.Past studies in Table 1 shows promoted interactivities by different studies.These studies focused primarily on human-system interactivity while a few provided human-human interactivity.
Advantages of the existing methods are included as: Interactive technology has made learning more personalized and kept students engaged through various applications [23].This paper also suggested that interactive technology can make learning more active, and intensive for students where students can communicate easily with each-others and also with the teacher [23].
Disadvantages of the existing methods are included as: Recently implementation of Augmented Reality (AR) in pedagogy has been adopted by many researchers where the emphasis has mainly been kept on 3D visualization.Many have implemented AR in geometry for school students [14, 19, 24] while some other implemented it for calculus [12, 13].In both cases the authors have focused on the immersive learning experience through AR but no human-human interaction function was provided.
Comment 15: What are the major issues of the existing interactive methods?Response 15: Unfortunately, majority of the AR learning application only focused on providing content visualization resulting in not a holistic application in learning that promote both type of interaction [14, 15, 21, 22].Past studies in  [37].Therefore, the primary research method for this study was quantitative.
Comment 19: A discussion on the design and development of the interactive methods should be presented here.Response 19: A discussion on the design and development of the interactive methods is included as follows: Interactivity can also be categorized as human-system and human-human, as technologies are allowing both in a learning environment [3].The framework for interactive learning application is developed based on these two types of interactions.
Comment 20: Participants -this study uses quasi-experimental design, the participants should be assigned into control and experimental group.This information is not available.How did you assign participants into these groups?How did you select the participants for this study?For measurement items, what are the scales used in this study?Please list the sources.For the self-developed items, reliability and validity tests should be conducted and reported.Response 20: Additional information of participants is added in Research Design and Participants as follows: One of the numerous forms of quasi-experimental design is pre-and post-test research."Quasi" refers to something that resembles experimental study.Studies evaluating a curriculum for education, a treatment system or a simulation training commonly apply preand post-test evaluation [33].Since this study is to compare students' learning experiences and academic performance before and after using the AR system, a pre-and post-test quasi-experimental research method was chosen.Convenience sampling is a nonprobability or non-random sampling in which it is able to conveniently reach and recruit members of the target population for the study [34].Usually, convenience samples of university students are used in academic surveys [35].Since the respondents were students from a Malaysian university taking Calculus subject, a nonprobability convenience sampling method was used for this study.
For measurement items, the scales used in this study are included in Survey Design and Procedures -Section B as follows: All the questions for the aforementioned variables were measured through 5-point Likert scale.
For the self-developed items, reliability and validity tests were conducted and included in Internal consistent reliability, as follows: All the self-developed questions under human-human interaction variables satisfied the reliability as the loading is >0.6 [33].For the three self-developed questions (LE 10, LE11, and LE12) under learning experience variable two of the questions LE11, LE12 also satisfy this criterion.
Comment 21: What is the structural equation modelling (SEM)?Why is SEM used in this research?How to conduct the data analysis?You should also discuss the data analysis for longitudinal study using SEM.
Response 21: Structural equation modeling (SEM) combines multiple regression and factor analysis.It is employed to examine the relationships between a group of observable variables and latent concepts.There are two main types of the SEM.In this study, instead of using the traditional Covariance-Based-SEM (CB-SEM), Partial Least Squares-SEM (PLS-SEM).PLS-SEM is chosen to analyze the data based on its capability to handle complex models and small sample sizes.Data analysis using PLS-SEM was employed by defining clear research objectives and hypotheses, data preparation, structural model analysis, hypotheses testing, structural model assessment and predictive accuracy, effect size and relevance evaluation [36].PLS-SEM is often chosen for longitudinal studies due to its effectiveness in handling small sample sizes, which are common in these studies, especially when compared to crosssectional studies [36].

Comment 22: Results
As the measurement items were adopted from many different sources, instrument reliability and validity tests using Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) should be conducted and reported.Response 22: CB-SEM and PLS-SEM are two widely accepted second generation data analysis approaches.PLS-SEM is used to analyze the data as the objective of the study is to confirm the hypotheses to explain the relationship between the exogenous and endogenous constructs for the following reasons [39]: PLS-SEM can be applied for exploratory research-when "theory is less developed".PLS-SEM can handle complex cause-effect structural models.Additionally, data characteristics, such as small sample size and non-normal data, can be some of the reasons to choose PLS-SEM.
Comment 23: For self-developed items, procedures to establish instrument reliability and validity should be presented.Response 23: For the self-developed items, reliability and validity tests were conducted and included in Internal consistency reliability, as follows: All the self-developed questions under human-human interaction variables satisfied the reliability as the loading is >0.6 [33].For the three self-developed questions (LE 10, LE11, and LE12) under learning experience variable two of the questions LE11, LE12 also satisfy this criterion.
Comment 24: The result section needs to do a major revision with appropriate analyses.Please include relevant Table(s) with appropriate details such as paired t test results, significant value, etc. for each of the test conducted.Response 24: Tables 8 to 13 are included to report the results of paired t test results, significant value and other tests conducted.
Comment 25: Discussions The author(s) should discuss/relate/compare the findings with prior relevant studies.Please also explain how the results in this study relate to previous findings, whether in support, contradiction, or simply as added data.The discussion should be aligned with the research objectives.Response 25: The discussion was rewritten with comparisons from previous studies and aligned with the research objectives as follows: The study aims to develop an augmented reality application that promotes interaction and spatial visualization for learning calculus and evaluates the effect of the interactive learning system on the performance of learning.Human-human interaction is evaluated as part of the chat function of application and human-system interaction is analysed as part of augmented reality implementation through mobile application.
The first hypothesis was accepted as human-system interactivity positively affected the learning experience factor.As this study developed an augmented reality application for learning calculus, here human-system interaction is related to the interactivity promoted by the augmented reality application.Studies implementing augmented reality in improving learning experience founds that the didactic experience of this technology make students more engaged and hence providing an enriched learning experience [12, 14, 16, 21, 27].This study has also found that among the human-system interaction all students univocally cancelled out disagreement that it provided them with real world 3D object feelings.The study using similar questionnaire have also found that it has significant impact on the learning experience in general and motivation in particular [39].So, the result of this study is aligned with the prior relevant studies.
The second hypothesis result found that human-human interaction significantly influences learning experience.The implication from this hypothesis acceptance indicate that learning experience is shaped by human-human interaction which can comes from student-teacher or student-student.In the study design both student-teacher and student-student interaction facilities were provided via application chat function.So, it can be said that both type of human-human interactions are associated positively with learning experience.This result is in line with the findings where both types of interaction led to learning satisfaction [47].Another study found that human-human interactivity increases learning engagement [1, 2, 3].In addition to that another study has also claimed that learning confidence as part of learning experience has also increased through interaction with peers and teachers [1].From the findings of these research, it can be concluded that the result of human-human interaction affecting learning experience is in line with existing research.The third hypothesis of the study was tested by using paired sample "t-test" where learning performance' means were compared from 'pre-test' to 'post-test scenario.The result shows that there is significant relation between the score and "post-test" mean is higher than the 'pre-test' one.Other studies have also found that learning experience as result of humansystem and human-human interactivity increase learning performance [3, 15, 47].So, it can be claimed that in terms of hypothesis acceptance, this study is in line with existing literature.The development of research hypotheses is missing.

2.
Did not justify the adopted questionnaire.

3.
Did not specify the questions for the quiz.Are the same or different sets of questions used for pre and post?How many questions?

4.
Did not mention if measurement model and structural model were assessed based 5.
The benefits of publishing with F1000Research: Your article is published within days, with no editorial bias • You can publish traditional articles, null/negative results, case reports, data notes and more • The peer review process is transparent and collaborative • Your article is indexed in PubMed after passing peer review • Dedicated customer support at every stage • For pre-submission enquiries, contact research@f1000.com

Comment 2 :
Introduction:In this section, explanations related to the following things need to be explained to construct a more complete research motivation: What problems are still encountered in the application of learning media based on 3D visualization with AR technology?Response 2: The problems are included as follows:(1) Lacking Human-Human interactivity.Introduction -Paragraph 1:

Comment 3 :
What systems currently exist to support learning calculus using AR and what are their weaknesses?Response 3: Literature Review -Interactivity -Paragraph 1:

Comment 3 :Comment 4 :
Introduction This section should include the following information: Response 3: The existing problems in learning Calculus are included Introduction -Paragraph 1, 2, 3, Literature Review -Interactivity -Paragraph 1 & Paragraph 2; as follows: What are the existing problems in learning Calculus?Response 4: 1.

Comment 7 :
What are the existing interactive methods have been proposed to solve Mathematics problem in particular Calculus (Revolution of Solids)?Response 7: The existing interactive methods are focused on providing content visualization and included in the Introduction as follows:

Comment 8 :
What are the weaknesses of the existing interactive methods in solving mathematics (Calculus-Revolution of Solids) problems?Response 8: The weaknesses of the existing interactive methods are included in Introduction -Paragraph 4 as follows:

Table 1 .
Interactivities of different studies.

Table 3 .
Questionnaire of human-human interactivity factor.

Table 4 .
Questionnaire of human-system interactivity factor.

Table 5 .
Questionnaire of learning experience factor.
21It was a pleasure to work on such a well-designed lessonIfelt good to interact with AR object 22 It was a pleasure to work on such a well-designed lesson I enjoyed the audio visual content so much that I would like to know more about this topic 23 It was a pleasure to work on such a well-designed lesson I felt good after sharing information through discussion platform Table 6.Self-developed questionnaire of learning experience factor.No Self-developed 24 Video of object formulation through revolution of solid has deepen my understanding 25 AR object has facilitated in visualizing the solid better

Table 8 .
Convergent validity and composite reliability.

Table 12 .
Collinearity assessment and hypothesis test.

Table 13 .
Pre and post test analysis of performance.
Table 2 depicts that most systems solely focused on interactivity through AR and not implementing any human-human interactivity.We have re-arranged the sub-sections with the suggested sections such as Study design and procedures, Research Framework, Survey Design and Procedures and Data Analysis Techniques in Methodology.Comment 18: Study design and procedures -you should discuss the choice of quantitative research method in this research, what is the quasi-experimental design?Why is quasiexperimental design used in this research?What are the procedures to conduct this research?Response 18: The reason of Quantitative research method was used are added in Research Design and Participants as follows: Quantitative research designs include quasi-experiments, true experiments, causalcomparative research, surveys research and experiments research.Quantitative research is likely to test theories by investigating the relationships among variables