Reliability of ankle dorsiflexor muscle strength, rate of force development, and tibialis anterior electromyography after stroke

Sharon Olsen; Denise Taylor; Imran Khan Niazi; Grant Mawston; Usman Rashid; Gemma Alder; Verna Stavric; Rasmus Bach Nedergaard; Nada Signal

doi:10.12688/f1000research.132415.2

Home Browse Reliability of ankle dorsiflexor muscle strength, rate of force development,...

ALL Metrics

Views

Downloads

Get PDF

Get XML

Export

▬

✚

Brief Report

Revised

Reliability of ankle dorsiflexor muscle strength, rate of force development, and tibialis anterior electromyography after stroke

[version 2; peer review: 1 approved, 2 approved with reservations]

Sharon Olsen¹, Denise Taylor¹, Imran Khan Niazi^1-3, [...] Grant Mawston¹, Usman Rashid¹, Gemma Alder¹, Verna Stavric¹, Rasmus Bach Nedergaard^4,5, Nada Signal¹

Sharon Olsen¹, Denise Taylor¹, [...] Imran Khan Niazi^1-3, Grant Mawston¹, Usman Rashid¹, Gemma Alder¹, Verna Stavric¹, Rasmus Bach Nedergaard^4,5, Nada Signal¹

PUBLISHED 04 Jun 2024

Author details Author details

¹ Health and Rehabilitation Research Institute, Auckland University of Technology, Auckland, New Zealand
² Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
³ Centre for Chiropractic Research, New Zealand College of Chiropractic, Auckland, New Zealand
⁴ Department of Clinical Medicine, Aalborg University, Aalborg, Denmark
⁵ Mech-Sense, Aalborg University Hospital, Aalborg, Denmark

Sharon Olsen
Roles: Conceptualization, Data Curation, Investigation, Methodology, Project Administration, Validation, Writing – Original Draft Preparation, Writing – Review & Editing

Denise Taylor
Roles: Conceptualization, Methodology, Resources, Supervision, Writing – Review & Editing

Imran Khan Niazi
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Resources, Software, Supervision, Writing – Review & Editing

Grant Mawston
Roles: Methodology, Software, Writing – Review & Editing

Usman Rashid
Roles: Formal Analysis, Writing – Review & Editing

Gemma Alder
Roles: Methodology, Writing – Review & Editing

Verna Stavric
Roles: Methodology, Writing – Review & Editing

Rasmus Bach Nedergaard
Roles: Investigation, Methodology, Software, Writing – Review & Editing

Nada Signal
Roles: Conceptualization, Methodology, Resources, Supervision, Writing – Review & Editing

OPEN PEER REVIEW

REVIEWER STATUS

Abstract

Background

Measures of hemiparetic ankle dorsiflexor muscle strength and rate of force development (RFD) are often used to determine the efficacy of rehabilitation interventions after stroke. However, evidence supporting the reliability of these measures is limited. This brief report provides a secondary analysis investigating the between-session reliability of isometric ankle dorsiflexor muscle strength, rate of force development (RFD), and tibialis anterior electromyography (TA EMG), in people with chronic stroke.

Method

Participants (n=15) completed three maximal isometric contractions of the ankle dorsiflexor muscles as fast as possible using a rigid dynamometer. Tests were repeated seven days later. Outcomes included ankle dorsiflexor isometric maximal voluntary contraction (MVC), RFD in the first 200ms (RFD200ms), time to reach 90% MVC, and peak TA EMG. Data were analysed for 13 participants using intra-class correlation coefficients (ICC) and standard error of the measure percentage (SEM%).

Results

Reliability was higher when analysing the mean of three trials rather than the best of three trials. There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92, 0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60, 0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53, 0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48, 0.92], SEM% 24%).

Conclusion

The findings raise concerns about the reliability of measures of rapid force production in the dorsiflexor muscles after stroke. Given the functional significance of the ankle dorsiflexors, larger studies should be conducted to further investigate these concerns and explore reliable methods for measuring rapid force production in the hemiparetic dorsiflexor muscles.

Keywords

muscle strength, maximal voluntary contraction, muscle power, rate of force development, electromyogram, outcome measure, reliability, stroke

Corresponding author: Sharon Olsen

Competing interests: No competing interests were disclosed.

Grant information: This research received no external funding. Article professing charges were funded by the New Zealand College of Chiropractic.

Copyright: © 2024 Olsen S et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

How to cite: Olsen S, Taylor D, Niazi IK et al. Reliability of ankle dorsiflexor muscle strength, rate of force development, and tibialis anterior electromyography after stroke [version 2; peer review: 1 approved, 2 approved with reservations]. F1000Research 2024, 12:423 (https://doi.org/10.12688/f1000research.132415.2) First published: 20 Apr 2023, 12:423 (https://doi.org/10.12688/f1000research.132415.1) Latest published: 04 Jun 2024, 12:423 (https://doi.org/10.12688/f1000research.132415.2)

Revised Amendments from Version 1

The revised manuscript takes a more conservative approach to the interpretation of the findings given the small sample size, and more clearly identifies the strengths/limitations of the study and the need for further research.

See the authors' detailed response to the review by George Koumantakis
See the authors' detailed response to the review by Vassilios Panoutsakopoulos

Introduction

Ankle dorsiflexor impairments are common after stroke¹ affecting both muscle strength (the force exerted during a single maximal effort) and muscle power (the ability to exert force over a short time).² Impaired strength of the hemiparetic dorsiflexor muscles is associated with reduced walking endurance,³^,⁴ walking speed,¹^,⁵^,⁶ functional mobility,⁷ and community integration.⁴ Impaired dorsiflexor muscle power or rapid force production may limit the ability to react quickly during perturbations⁸^,⁹ and contribute to falling.¹⁰^,¹¹ Rapid force production requires recruitment of a large number of motor units as well as a high motor unit firing frequency, both of which are impaired in the hemiparetic dorsiflexor muscles after stroke.⁹ This results from central deficits, which reduce neural input to the motor neuron pool, but is also limited by peripheral changes, such as the reduction in the size of type 2a muscle fibres in the hemiparetic tibialis anterior¹² and soft tissue stiffness and spasticity in the antagonist plantarflexor muscles.¹³ Due to their key role in lower limb function, measures of dorsiflexor muscle strength, power, and rate of force development (RFD), are commonly used to determine the efficacy of rehabilitation interventions¹⁴^,¹⁵ and thus, their reliability should be considered.

Muscle strength can be measured isokinetically or isometrically through a maximal voluntary contraction (MVC) using rigid gold-standard dynamometry.¹⁶^,¹⁷^,¹⁸ Isokinetic MVCs involve muscle contraction against accommodating resistance through the joints range of movement at a constant velocity, whereas isometric MVCs involve muscle contraction against stationary resistance at a set joint angle.¹⁹ Between-session reliability of isokinetic dorsiflexor MVCs in the hemiparetic limb ranges from moderate to excellent with ICCs ranging from 0.84 [95% CI (confidence interval) 0.52 to 0.96]²⁰ to 0.98.²¹ However, isokinetic testing requires the ability to dorsiflex through full range at a given speed, thus excluding those with more severe stroke who are unable to do so.²² Isometric dorsiflexor MVCs, tested with rigid dynamometry, can be recorded in people with more severe hemiparesis, but have demonstrated only moderate between-session reliability (ICC 0.71).²³ Alongside dorsiflexor MVC measures, it is common to concurrently record surface electromyography (EMG) of the tibialis anterior (TA) as a measure of motor unit activity. While TA EMG peak amplitude has been shown to be highly reliable in healthy adults within a session,²⁴ it’s between-session reliability after stroke is only moderate (ICC 0.67).²³

Rapid force production and muscle power in the hemiparetic limb has been measured using several outcomes⁹^,²⁵^–²⁷ including the RFD. The between-session reliability of dorsiflexor peak RFD measured with hand-held dynamometry (HHD) was good to excellent (ICC 0.92, 95% CI 0.83 to 0.96)²⁸ in people with stroke who could walk unaided. However, this HHD method had poor concurrent validity against gold-standard dynamometry,²⁹ suggesting the reliability of RFD should be assessed using a rigid dynamometry system.

To address these limitations, this brief report will provide a reliability analysis that was performed on a dataset from an experimental study, where baseline measures of ankle dorsiflexor strength and RFD were collected twice, seven days apart.¹⁵ This analysis aimed to determine the between-session reliability of isometric ankle dorsiflexor MVC, ankle dorsiflexor muscle RFD in the first 200ms (RFD200ms), time to reach 90% peak force, and TA EMG, in people with chronic stroke.

Methods

Study design

This observational study utilised baseline measurement data that had been collected in an experimental study.¹⁵ Baseline measures were collected on two occasions, seven days apart. The null hypothesis was that the outcome measures are not reliable (intra-class correlation coefficient (ICC) < 0.5).

Setting

The study was conducted in a research laboratory at the Auckland University of Technology, Auckland, New Zealand.

Participants

The 15 participants were adults, more than 6 months post stroke, with hemiparesis affecting ankle dorsiflexion movement. The sample size was based on that required for the broader experimental study.¹⁵ Exclusion criteria were significant cognitive/perceptual/communication deficits, cerebellar stroke, inability to produce ankle dorsiflexor force against the dynamometer, or medical conditions that would impact safety or protocol completion.¹⁵ Written informed consent, ethical approval (Health and Disability Ethics Committees 17/NTB/80), and trial registration were completed (ACTRN12617000838314).

Measurement outcomes

The measurement outcomes were: isometric ankle dorsiflexor peak MVC, ankle dorsiflexor muscle RFD in the first 200ms (RFD200ms), time to reach 90% MVC (Time to 90% MVC), and peak TA EMG.

Measurement procedures

Detailed procedures have been published elsewhere.¹⁵^,³⁰ Participants sat with their hemiparetic leg in a rigid purpose-built ankle dorsiflexion/plantarflexion dynamometer with the foot plate angled 25° into plantarflexion, knee flexion ≈50°, straps/guards at the hips, knee, ankle, metatarsals and toes,³¹ and EMG electrodes over the TA muscle in accordance with SENIAM guidelines (seniam.org). Following two submaximal practices, participants performed three isometric dorsiflexor MVCs; each lasted a duration of 4 to 5 seconds and a 2-minute rest was given between each MVC. Participants were instructed to “pull as fast and hard as possible” and received loud verbal encouragement and real-time visual feedback. Instructions were provided by the same researcher at both sessions. Force signals were amplified (×200, 500, or 1000 depending on amplitude) (Forza, OT Bioelettronica, Italy). EMG data was amplified (×500) (AMT-8, Bortec Biomedical, Canada). Force and EMG data were sampled at 1961Hz using a data acquisition board (Micro 1401, CED, UK) and Spike2 software (CED, UK). Procedures were replicated for the second session.

Data processing

MVC amplitudes²³ were calculated as the difference between the mean baseline signal (500ms window) and the peak amplitude, in Spike2 software (CED, UK). For other measures, data was exported into LabVIEW 2017 software (National Instruments, United States) and the force data was filtered using a zero-phase shift 15 Hz low-pass 4^th order filter.²⁹^,³² Movement onset was automatically identified where the signal exceeded the mean baseline signal by 3 SDs, and then confirmed visually by a single researcher. The baseline window and the onset threshold could be individualised by the researcher to ensure the onset was identified correctly for each contraction. RFD200ms³²^,³³ was determined by dividing force at 200ms by time. Time taken to reach 90% of peak force was also determined.²⁶^,³⁴ TA EMG data was band-pass filtered (10–500 Hz). The root mean square (RMS) of the EMG signal was calculated 1-s either side of the peak force, and peak amplitude²⁴ of the RMS signal was determined. All measures were calculated for each of the three contractions, then exported into Microsoft Excel (version 16.35, Microsoft Corporation, US) where the mean of three trials and the best of three trials were calculated.

Statistical analysis

Data were imported into R for reliability analysis (R version 4.1.1³⁵). Data normality was evaluated with the Shapiro-Wilk test. The intra-class correlation coefficient (ICC (2, 1), absolute agreement) from a 2-way random effects model was calculated, as were the standard error of measurement (SEM) and the SEM%. Correlation coefficients were interpreted as excellent (≥ 0.90), good (0.75–0.89), moderate (0.50–0.74) and poor (<0.50) based on their ICC and their lower bound 95% CI.³⁶^,³⁷

Results

Participants

Data for two participants were excluded due to failure to correctly complete the protocol; this was because one participant was not able to consistently follow the task instructions and another participant was observed falling asleep during the protocol. Therefore, the analysis included 13 participants (male n=6, mean age 68.5±10.6 years, mean 6.0±5.4 years post-stroke, left hemiparesis n=10). EMG data was missing for one further participant. Participants presented with a range of lower limb weakness, from mild to severe, and used a variety of outdoor mobility aids (unaided n = 4, quad or walking stick n = 5, walking frame n = 2, wheelchair n = 2) suggesting a range of walking abilities.

Reliability analysis

The reliability analysis is reported in Table 1. MVC measures demonstrated excellent reliability, with the mean of three trials displaying slightly higher reliability (ICC 0.97 [95% CI 0.92, 0.99]) than the best of three trials (ICC 0.97 [95% CI 0.90, 0.99]). For TA EMG data, the ICCs were in the good range but the lower bound 95% CIs were in the moderate range (ICC 0.86 [95% CI 0.60, 0.06]). For measures of rapid force production, when using the mean of three trials, the Time to 90% MVC and RFD200ms had ICCs in the good range, but the lower bound 95% CIs were in the moderate range for Time to 90% MVC (ICC 0.80 [95% CI 0.53, 0.93]) and in the poor range for RFD200ms (ICC 0.0.79 [95% CI 0.48, 0.92]). Both measures of rapid force production demonstrated very low lower-bound CIs when only the best trial was analysed (Table 1).

Table 1. Reliability of all outcomes between test 1 and test 2.

	Test 1	Test 2	ICC (2,1) [95% CI]	SEM	SEM%
MVC_MEAN (N)	139±65	145±66	0.97 [0.92, 0.99]	10	7
MVC_BEST (N)	146±67	151±66	0.97 [0.90, 0.99]	12	8
TA EMG_MEAN (V)	0.19±0.13	0.18±0.12	0.86 [0.60, 0.96]	0.05	25
TA EMG_BEST (V)	0.21±0.14	0.19±0.12	0.86 [0.60, 0.96]	0.05	23
RFD200ms_MEAN (N/s)	267±160	246±123	0.79 [0.48, 0.92]	65	24
RFD200ms_BEST (N/s)	313±198	297±137	0.61 [0.17, 0.86]	106	34
Time to 90% MVC_MEAN (s)	1.46±0.76	1.64±0.82	0.80 [0.53, 0.93]	0.3	23
Time to 90% MVC_BEST (s)	2.04±1.14	2.33±1.45	0.52 [0.00, 0.82]	0.9	44

Discussion

This is the first study to show excellent between-session reliability of isometric (rather than isokinetic) dorsiflexor MVCs in people with stroke (MVC_MEAN ICC 0.97 [95% CI 0.92, 0.99]). Our results were comparable with those of Eng et al.²¹ using an isokinetic MVC. Importantly, the isometric method proposed here can be applied to people with more severe lower limb weakness. Our MVC reliability results were superior to the isometric MVC results of Klarner and colleagues who found moderate between-session reliability (ICC 0.71) for hemiparetic dorsiflexor MVCs over three sessions, with a similar sample size (n=12).²³ They analysed the best of only two trials, rather than the three trials used in this study, and did not describe any system to strap the toes as recommended to reduce measurement variability³¹; this may have lowered their ICC. Our reliability findings for TA EMG, which represent motor unit recruitment at the peak of the MVC, demonstrated lower reliability, with a good ICC and the lower bound 95% CI in the moderate range (TA EMG_MEAN ICC 0.86 [95% CI 0.60, 0.96). Alongside an SEM% of 23-25%, this suggests that TA EMG is prone to greater biological and/or measurement variability than peak force measures. Interestingly, as with the MVC data, our TA EMG data appeared more reliable than that previously reported (ICC 0.67) in sample of 12 people with chronic stroke.²³

This study is also the first to report on the reliability of RFD or rapid force production of the hemiparetic dorsiflexor muscles using a rigid dynamometer. While the ICCs were in the good range when three trials were analysed, the lower bound of the 95% CI of the ICCs indicated reliability could be only moderate for Time to 90% MVC_MEAN (ICC 0.80 [95% CI 0.53, 0.93]) and poor for RFD200ms_MEAN (ICC 0.79 [95% CI 0.48, 0.92]). These findings were inferior to those of Mentiplay and colleagues who used HHD to measure hemiparetic dorsiflexor RFD (ICC 0.92 [95% CI 0.83, 0.96], n=28).²⁸ Several factors may have contributed to these contrasting findings. Mentiplay et al’s participants could walk unaided, whereas our sample had variable lower limb impairment; they also measured the ankle in neutral,²⁸ whereas we positioned the ankle in ≈25° plantarflexion based on the optimum position for producing dorsiflexion force³⁸ and reducing the impact of antagonist muscle tone.³² Data processing methods also differed between the studies. Mentiplay and colleagues HHD method sampled force data at only 40 Hz,²⁸^,²⁹ much lower than recommended,³²^,³⁹ and then interpolated this to equate 1000 Hz, which may have increased reliability. Our study analysed RFD in the first 200ms, whereas Mentiplay et al.²⁸ scanned successive 200ms windows to find the peak RFD, a method that excludes movement onset and any associated artefacts or issues with identifying onset.²⁹ This very early force generation is particularly relevant for people with stroke who have lower motor unit discharge rates⁹^,⁴⁰ and may be more functionally important than maximal muscle strength or power, especially under circumstances where a rapid response is required (e.g., to prevent falling).⁴¹ Thus, while measuring RFD later in the movement may be more reliable,²⁸^,²⁹ this measure may lack ecological validity. This concern is supported by the poor concurrent validity of the HHD RFD method against gold-standard dynamometry.²⁹ Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing,³² and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.

Strengths and limitations

A key strength of this study was the application of an isometric MVC procedure that could be completed by people with more severe stroke. This enabled enrolment of a broad sample with a range of lower limb weakness and functional walking ability, increasing the generalisability of findings to a wider stroke population. Other methodological strengths included positioning of the ankle to optimise dorsiflexion force³⁸ and fixation of the toes to reduce measurement variability.³¹ In addition, our approach to measuring RFD enabled evaluation of the very early force production (0-200ms) which has not been evaluated previously in the hemiparetic dorsiflexor muscles. Further research could explore the reliability of other time windows. The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies³⁶ but comparable with other studies in this field.²⁰^,²¹^,²³ To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI³⁶^,³⁷ and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.

Conclusions

This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilises gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation.

Ethical considerations

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Health and Disability Ethics Committees (17/NTB/80).

Data availability

Ethical approval for data sharing has not been obtained. Requests for access to the data can be made to the corresponding author by providing the reason for the request and the benefits of data sharing, so that ethical approval can be sought.

References

1. Dorsch S, Ada L, Sorial T, Fanayan E: The Relationship Between Strength of the Affected Leg and Walking Speed After Stroke Varies According to the Level of Walking Disability: A Systematic Review. Phys Ther. 2021; 101(12). PubMed Abstract | Publisher Full Text
2. Bushman BA: Embracing Physical Activity: A Complete Exercise Program. ACSM's Complete Guide to Fitness & Health. 2nd ed.Bushman BA, editor. Human Kinetics: Champaign, Illinois; 2017; pp. 19–36.
3. Ng SS, Hui-Chan CW: Contribution of ankle dorsiflexor strength to walking endurance in people with spastic hemiplegia after stroke. Arch. Phys. Med. Rehabil. 2012; 93: 1046–1051. Publisher Full Text
4. Kwong PWH, Ng SSM, Chung RCK, et al.: A structural equation model of the relationship between muscle strength, balance performance, walking endurance and community integration in stroke survivors. PLoS One. 2017; 12(10): e0185807. PubMed Abstract | Publisher Full Text | Free Full Text
5. Mentiplay BF, Adair B, Bower KJ, et al.Associations between lower limb strength and gait velocity following stroke: a systematic review. Brain Inj. 2015; 29(4); 409–422. PubMed Abstract | Publisher Full Text
6. Mentiplay BF, Williams G, Tan D, et al.: Gait Velocity and Joint Power Generation After Stroke: Contribution of Strength and Balance. Am. J. Phys. Med. Rehabil. 2019; 98(10); 841–849. PubMed Abstract | Publisher Full Text
7. Ng SS, Hui-Chan CW: Ankle dorsiflexor, not plantarflexor strength, predicts the functional mobility of people with spastic hemiplegia. J. Rehabil. Med. 2013; 45: 541–545. Publisher Full Text
8. de Kam D , Roelofs JMB, Bruijnes AKBD, et al.: The next step in understanding impaired reactive balance control in people with stroke: The role of defective early automatic postural responses. Neurorehabil. Neural Repair. 2017; 31: 708–716. PubMed Abstract | Publisher Full Text | Free Full Text
9. Chou LW, Palmer JA, Binder-Macleod S, et al.: Motor unit rate coding is severely impaired during forceful and fast muscular contractions in individuals post stroke. J. Neurophysiol. 2013; 109: 2947–2954. PubMed Abstract | Publisher Full Text | Free Full Text
10. Marigold DS, Eng JJ: Altered timing of postural reflexes contributes to falling in persons with chronic stroke. Exp. Brain Res. 2006; 171: 459–468. PubMed Abstract | Publisher Full Text | Free Full Text
11. Lomborg SD, Dalgas U, Hvid LG: The importance of neuromuscular rate of force development for physical function in aging and common neurodegenerative disorders – a systematic review. J. Musculoskelet. Neuronal Interact. 2022; 22(4): 562–586. PubMed Abstract
12. Noguchi KS, McLeod JC, Phillips SM, et al.: Differences in Skeletal Muscle Fiber Characteristics Between Affected and Nonaffected Limbs in Individuals With Stroke: A Scoping Review. Phys. Ther. 2023; 103(12). PubMed Abstract | Publisher Full Text
13. Azzollini V, Dalise S, Chisari C: How Does Stroke Affect Skeletal Muscle? State of the Art and Rehabilitation Perspective. Front. Neurol. 2021; 12: 797559. PubMed Abstract | Publisher Full Text | Free Full Text
14. Simpson D, Ehrensberger M, Horgan F, et al.: Unilateral dorsiflexor strengthening with mirror therapy to improve motor function after stroke: A pilot randomized study. Physiother. Res. Int. 2019; 24: e1792. PubMed Abstract | Publisher Full Text
15. Olsen S, Signal N, Niazi IK, et al.: Peripheral electrical stimulation paired with movement-related cortical potentials improves isometric muscle strength and voluntary activation following stroke. Front. Hum. Neurosci. 2020; 14: 156. PubMed Abstract | Publisher Full Text | Free Full Text
16. Stark T, Walker B, Phillips JK, et al.: Hand-held dynamometry correlation with the gold standard isokinetic dynamometry: a systematic review. PM&R. 2011; 3: 472–479. PubMed Abstract | Publisher Full Text
17. Hirano M, Katoh M, Gomi M, et al.: Validity and reliability of isometric knee extension muscle strength measurements using a belt-stabilized hand-held dynamometer: a comparison with the measurement using an isokinetic dynamometer in a sitting posture. J. Phys. Ther. Sci. 2020; 32: 120–124. PubMed Abstract | Publisher Full Text | Free Full Text
18. Chamorro C, Armijo-Olivo S, De la Fuente C, et al.: Absolute Reliability and Concurrent Validity of Hand Held Dynamometry and Isokinetic Dynamometry in the Hip, Knee and Ankle Joint: Systematic Review and Meta-analysis. Open Med (Wars). 2017; 12: 359–375. PubMed Abstract | Publisher Full Text | Free Full Text
19. Drouin JM, Valovich-mcLeod TC, Shultz SJ, et al.: Reliability and validity of the Biodex system 3 pro isokinetic dynamometer velocity, torque and position measurements. Eur. J. Appl. Physiol. 2004; 91(1): 22–29. PubMed Abstract | Publisher Full Text
20. Pohl PS, Startzell JK, Duncan PW, et al.: Reliability of lower extremity isokinetic strength testing in adults with stroke. Clin. Rehabil. 2000; 14: 601–607. PubMed Abstract | Publisher Full Text
21. Eng JJ, Kim CM, MacIntyre DL: Reliability of lower extremity strength measures in persons with chronic stroke. Arch. Phys. Med. Rehabil. 2002; 83: 322–328. PubMed Abstract | Publisher Full Text | Free Full Text
22. Bohannon RW: Isokinetic testing of muscle strength of older individuals post-stroke: An integrative review. Isokinet. Exerc. Sci. 2020; 28: 303–316. Publisher Full Text
23. Klarner T, Barss TS, Sun Y, et al.: Reliability of multiple baseline measures for locomotor retraining after stroke. Replace, Repair, Restore, Relieve: Bridging Clinical and Engineering Solutions in Neurorehabilitation. Proceedings of the 2nd International Conference on NeuroRehabilitation. Jensen W, Andersen OK, Akay M, editors. Aalborg, Denmark: Springer; 2014; pp. 479–486.
24. Ruiz Munoz M, Gonzalez-Sanchez M, Cuesta-Vargas AI: Tibialis anterior analysis from functional and architectural perspective during isometric foot dorsiflexion: A cross-sectional study of repeated measures. J. Foot Ankle Res. 2015; 8: 74. PubMed Abstract | Publisher Full Text | Free Full Text
25. Fimland MS, Moen PM, Hill T, et al.: Neuromuscular performance of paretic versus non-paretic plantar flexors after stroke. Eur. J. Appl. Physiol. 2011; 111: 3041–3049. PubMed Abstract | Publisher Full Text | Free Full Text
26. Canning CG, Ada L, O’Dwyer N: Slowness to develop force contributes to weakness after stroke. Arch. Phys. Med. Rehabil. 1999; 80: 66–70. PubMed Abstract | Publisher Full Text
27. Stavric VA, McNair PJ: Optimizing muscle power after stroke: a cross-sectional study. J. Neuroeng. Rehabil. 2012; 9: 67. PubMed Abstract | Publisher Full Text | Free Full Text
28. Mentiplay BF, Tan D, Williams G, et al.: Assessment of isometric muscle strength and rate of torque development with hand-held dynamometry: Test-retest reliability and relationship with gait velocity after stroke. J. Biomech. 2018; 75: 171–175. PubMed Abstract | Publisher Full Text
29. Mentiplay BF, Perraton LG, Bower KJ, et al.: Assessment of lower limb muscle strength and power using hand-held and fixed dynamometry: a reliability and validity study. PLoS One. 2015; 10: e0140822. PubMed Abstract | Publisher Full Text | Free Full Text
30. Olsen S, Signal N, Niazi IK, et al.: Reliability of tibialis anterior muscle voluntary activation using the interpolated twitch technique and the central activation ratio in people with stroke. Brain Sci. 2021; 11. PubMed Abstract | Publisher Full Text | Free Full Text
31. Siddiqi A, Arjunan SP, Kumar D: Improvement of isometric dorsiflexion protocol for assessment of tibialis anterior muscle strength. MethodsX. 2015; 2: 107–111. PubMed Abstract | Publisher Full Text | Free Full Text
32. Maffiuletti NA, Aagaard P, Blazevich AJ, et al.: Rate of force development: Physiological and methodological considerations. Eur. J. Appl. Physiol. 2016; 116: 1091–1116. PubMed Abstract | Publisher Full Text | Free Full Text
33. Prieske O, Wick D, Granacher U: Intrasession and intersession reliability in maximal and explosive isometric torque production of the elbow flexors. J. Strength Cond. Res. 2014; 28: 1771–1777. PubMed Abstract | Publisher Full Text
34. Viitasalo JT, Komi PV: Force-time characteristics and fiber composition in human leg extensor muscles. Eur. J. Appl. Physiol. 1978; 40: 7–15. PubMed Abstract | Publisher Full Text
35. R Core Team: R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2018. Reference Source
36. Koo TK, Li MY: A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 2016; 15: 155–163. PubMed Abstract | Publisher Full Text | Free Full Text
37. Munro B: Statistical methods for health care research. Lippincott Williams & Wilkins. 2005.
38. Marsh E, Sale D, Mcomas AJ, et al.: Influence of joint position on ankle dorsiflexion in humans. J. Appl. Physiol. Respir. Environ. Exerc. Physiol. 1981; 51: 160–167. Publisher Full Text
39. Kozinc Ž, Smajla D, Šarabon N: The rate of force development scaling factor: a review of underlying factors, assessment methods and potential for practical applications. Eur. J. Appl. Physiol. 2022; 122: 861–873. PubMed Abstract | Publisher Full Text
40. Freire B, Dias CP, Oliveira LS, et al.: Rate of force development and torque production assessment in spastic stroke survivors. Revista Brasileira de Cineantropometria e Desempenho Humano. 2015; 17: 328. Publisher Full Text
41. Suetta C, Aagaard P, Rosted A, et al.: Training-induced changes in muscle CSA, muscle strength, EMG, and rate of force development in elderly subjects after long-term unilateral disuse. J. Appl. Physiol. 2004; 97: 1954–1961. PubMed Abstract | Publisher Full Text

Comments on this article Comments (0)

Version 2

VERSION 2 PUBLISHED 20 Apr 2023

Author details Author details

Sharon Olsen
Roles: Conceptualization, Data Curation, Investigation, Methodology, Project Administration, Validation, Writing – Original Draft Preparation, Writing – Review & Editing

Denise Taylor
Roles: Conceptualization, Methodology, Resources, Supervision, Writing – Review & Editing

Imran Khan Niazi
Roles: Conceptualization, Funding Acquisition, Investigation, Methodology, Resources, Software, Supervision, Writing – Review & Editing

Grant Mawston
Roles: Methodology, Software, Writing – Review & Editing

Usman Rashid
Roles: Formal Analysis, Writing – Review & Editing

Gemma Alder
Roles: Methodology, Writing – Review & Editing

Verna Stavric
Roles: Methodology, Writing – Review & Editing

Rasmus Bach Nedergaard
Roles: Investigation, Methodology, Software, Writing – Review & Editing

Nada Signal
Roles: Conceptualization, Methodology, Resources, Supervision, Writing – Review & Editing

Competing interests

No competing interests were disclosed.

Grant information

This research received no external funding. Article professing charges were funded by the New Zealand College of Chiropractic.

Article Versions (2)

version 2

Revised

Published: 04 Jun 2024, 12:423

https://doi.org/10.12688/f1000research.132415.2

version 1

Published: 20 Apr 2023, 12:423

https://doi.org/10.12688/f1000research.132415.1

© 2024 Olsen S et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Download

Export To

metrics

	Views	Downloads
F1000Research	-	-
PubMed Central Data from PMC are received and updated monthly.	-	-

Citations

SEE MORE DETAILS

CITE

how to cite this article

Olsen S, Taylor D, Niazi IK et al. Reliability of ankle dorsiflexor muscle strength, rate of force development, and tibialis anterior electromyography after stroke [version 2; peer review: 1 approved, 2 approved with reservations]. F1000Research 2024, 12:423 (https://doi.org/10.12688/f1000research.132415.2)

NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.

track

receive updates on this article

Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?

Key to Reviewer Statuses VIEW HIDE

ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested

Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.

Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions

Version 2

VERSION 2

PUBLISHED 04 Jun 2024

Revised

Views

Reviewer Report 22 Aug 2024

Ramachandran Sivakumar, Sri Ramachandra Medical College and Research Institute, Chennai, Tamil Nadu, India

Approved with Reservations

https://doi.org/10.5256/f1000research.162800.r310093

The study seems to be a offshoot of a larger study (?) based on the statement - "Detailed procedures have been published elsewhere".
The MVC was produced using instruction to pull as fast and hard as possible, a loud verbal encouragement and real-time visual feedback. This procedure raises concern for generalizing the reproducibility. The encouragement and real time visual feedback are not common in clinical settings.
RFD is measured in first 200ms. Justification for duration window need to be added. This method has been mentioned as strength of the study.

What is best value for 90% of peak force?, is the time taken in the trail with maximum peak force or trial with minimum time to reach 90% of peak force? In view of looking at ability to produce peak force to tackle real life scenarios requiring quick force production, the best timing must be the shortest time at which 90% force reached.

The reliability could also be influenced by difference in functional levels of the participants.
ICC used is appropriate, however, other statistical elements and presentations has to be commented by a statistician.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Partly
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Partly
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: Stroke rehabilitation, Posture control assessment and training.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

CITE

Report a concern

Respond or Comment

Views

Reviewer Report 27 Jun 2024

George Koumantakis, Physiotherapy, University of West Attica, Athens, Attiki, Greece

Approved

https://doi.org/10.5256/f1000research.162800.r286314

I have no further comments to make, as the authors have taken into consideration all my previous suggestions and have meticulously corrected the initial version of the manuscript. All changes and additions are clearly reflected in the current manuscript version. ... Continue reading

CITE

Report a concern

Respond or Comment

Version 1

VERSION 1

PUBLISHED 20 Apr 2023

Views

Reviewer Report 18 Sep 2023

Vassilios Panoutsakopoulos, Aristotle University of Thessaloniki, Thessaloniki, Greece

Approved with Reservations

https://doi.org/10.5256/f1000research.145331.r202687

The submitted manuscript comprises a test-retest reliability study. There are some topics that need to be addressed.

General comments:

Address the comments mentioned by Reviewer 1 (George Koumantakis).

The submitted manuscript comprises a test-retest reliability study. There are some topics that need to be addressed.

General comments:

Address the comments mentioned by Reviewer 1 (George Koumantakis).
It is recommended to provide, where appropriate, up-to-date references; only a quarter (8/32) of the cited literature was published in the last 5 years.
State the hypothesis of the study.
Study Design: it would be of interest to provide results of the unaffected lower limb for comparison.
Calculation of RFD200ms: what is the rationale to extract this parameter as the force at the time-instant 200 ms after the onset divided by 200? Could the time derivative of the force data provide an alternative insight regarding the RFD?
Further elaboration of the neuromuscular mechanisms tested in the study could provide additional context in the Discussion.
Provide the strengths and the limitations of the study.
The conclusions partly replicate the final part of the Discussion. It is suggested to include recommendations for practical use.

Specific comments:

Introduction:

“the ability to exert force over a short time”: this is the definition of power; it is proposed to delete this phrase.
“Muscle strength can be measured isokinetically or isometrically”: Clarification is needed.

Materials and Methods:

Participants: elaborate on the inclusion criteria.
Measurement procedures: specify the duration of the 4-5 s isometric dorsiflexor MVCs.

Results:

Table 1: it is suggested to use subscript rather than superscript characters.

Discussion:

See the respective General Comments.

Is the work clearly and accurately presented and does it cite the current literature?

Partly
Is the study design appropriate and is the work technically sound?

Partly
Are sufficient details of methods and analysis provided to allow replication by others?

Partly
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Partly

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: sports biomechanics, force measurements, range of motion measurements, aquatic therapy

CITE

Report a concern

Author Response 29 Aug 2024

Sharon Olsen, HRRI, Auckland University of Technology, Auckland, New Zealand

29 Aug 2024

Author Response

2.1 Address the comments mentioned by Reviewer 1 (George Koumantakis).

Response: We have addressed Reviewer 1’s comments.

2.2 It is recommended to provide, where appropriate, up-to-date references; only ... Continue reading 2.1 Address the comments mentioned by Reviewer 1 (George Koumantakis).

Response: We have addressed Reviewer 1’s comments.

2.2 It is recommended to provide, where appropriate, up-to-date references; only a quarter (8/32) of the cited literature was published in the last 5 years.

Response: Thank you for suggesting we review our reference list. We have reviewed the references and amended the manuscript to include some additional references and recent systematic reviews (Azzollini et al., 2021; Chamorro et al., 2017; Dorsch et al., 2021; Kwong et al., 2017; Lomborg et al., 2022; Mentiplay et al., 2015; Mentiplay et al., 2019; Noguchi et al., 2023).

Whilst many references in the manuscript are older than 5 years, all references are relevant and representative of the small body of literature in this field. Such references are essential to our understanding of tibialis anterior muscle structure and function in healthy adults (Marsh et al., 1981; Ruiz Munoz et al., 2015; Siddiqi et al., 2015) and stroke populations (Fimland et al., 2011; Freire et al., 2015), and provide a review of previous studies investigating the reliability of hemiparetic muscle strength and rapid force production which began in the early 2000s (Eng et al., 2002; Pohl et al., 2000) and has not grown much since (Klarner et al., 2014; Mentiplay et al., 2018).

2.3 State the hypothesis of the study.

Response: We have added the null hypothesis on line 95.
“The null hypothesis was that the outcome measures are not reliable (intra-class correlation coefficient (ICC) < 0.5).”

2.4 Study Design: it would be of interest to provide results of the unaffected lower limb for comparison.

Response: We agree this would be helpful. However, due to the time already allocation to complete the experimental protocol and the burden it put on people with chronic stroke, it was not deemed feasible to collect data for the unaffected limb in this clinical population.

2.5 Calculation of RFD200ms: what is the rationale to extract this parameter as the force at the time-instant 200 ms after the onset divided by 200? Could the time derivative of the force data provide an alternative insight regarding the RFD?

Response: In response to the reviewer's query on the rationale for calculating RFD200ms, we chose this method to assess the initial burst of force generation capability, which is crucial for many functional movements in stroke survivors. We also investigated Time to 90% MVC. Both methods offer a straightforward comparison of early force development. Regarding the suggestion to use the time derivative of the force data as an alternative method. Calculating the time derivative of the force/time curve would provide information about the peak RFD in the early part of the contraction. However, peak RFD in small epochs is sensitive to unsystematic variations in the signal and provides peak RFD at an inconsistent time point which is considered a less comprehensive and less standardised approach to measuring RFD (Maffiuletti et al., 2016). We acknowledge that other methods for data processing may offer deeper insights into the rising force/time curve, for example, measuring RFD at multiple time points, or measuring the impulse of the force/time curve (Maffiuletti et al., 2016). However, these methods would require more complex data processing methods, which may be less feasible in clinical contexts. To acknowledge the need to explore alternative methods for data processing, we have made the following amendments to the discussion.

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

2.6 Further elaboration of the neuromuscular mechanisms tested in the study could provide additional context in the Discussion.

Response: To give greater context, we have added the following information to the introduction.
Line 9
“Rapid force production requires recruitment of a large number of motor units as well as a high motor unit firing frequency, both of which are impaired in the hemiparetic dorsiflexor muscles after stroke.⁶This results from central deficits, which reduce neural input to the motor neuron pool, but is also limited by peripheral changes, such as the reduction in the size of type 2a muscle fibres in the hemiparetic tibialis anterior (Noguchi et al., 2023) and soft tissue stiffness and spasticity in the antagonist plantarflexor muscles (Azzollini et al., 2021).”

2.7 Provide the strengths and the limitations of the study.
Response: Thank you for this suggestion. We have added a section on strength and limitations to the discussion.

Line 302
Strengths and limitations
“A key strength of this study was the application of an isometric MVC procedure that could be completed by people with more severe stroke. This enabled enrolment of a broad sample with a range of lower limb weakness and functional walking ability, increasing the generalisability of findings to a wider stroke population. Other methodological strengths included positioning of the ankle to optimise dorsiflexion force ²⁹ and fixation of the toes to reduce measurement variability. ²³ In addition, our approach to measuring RFD enabled evaluation of the very early force production (0-200ms) which has not been evaluated previously in the hemiparetic dorsiflexor muscles. Further research could explore the reliability of other time windows. The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15}To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI ²⁸(Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

2.8 The conclusions partly replicate the final part of the Discussion. It is suggested to include recommendations for practical use.

Response: Thank you for this suggestion. Please find below our amended conclusion.

Line 363
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilises gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation."

2.9 Introduction: “the ability to exert force over a short time”: this is the definition of power; it is proposed to delete this phrase.

Response: It was our intention to define muscle power to ensure this concept was clear at the outset. We have put the definition in brackets to make it clear that this sentence refers to only two concepts.

Line 2
“Ankle dorsiflexor impairments are common after stroke ¹affecting both muscle strength (the force exerted during a single maximal effort) and muscle power (the ability to exert force over a short time).”

2.10 Introduction: “Muscle strength can be measured isokinetically or isometrically”: Clarification is needed.

Response: Thank you for this prompt. We have provided clarification in the manuscript as follows.

Line 65
“Isokinetic MVCs involve muscle contraction against accommodating resistance through the joints range of movement at a constant velocity, whereas isometric MVCs involve muscle contraction against stationary resistance at a set joint angle (Drouin et al., 2004).”

2.11 Participants: elaborate on the inclusion criteria.

Response: The eligibility criteria have been provided below with some additional clarification.

“The 15 participants were adults, more than 6 months post stroke, with hemiparesis affecting ankle dorsiflexion movement. The sample size was based on that required for the broader experimental study. ⁹Exclusion criteria were significant cognitive/perceptual/communication deficits, cerebellar stroke, inability to produce ankle dorsiflexor force against the dynamometer, or medical conditions that would impact safety or protocol completion. ⁹”

In addition, we have provided further information about the impairment and function of participants in the results section.
“Participants presented with a range of lower limb weakness, from mild to severe, and used a variety of outdoor mobility aids (unaided n = 4, quad or walking stick n = 5, walking frame n = 2, wheelchair n = 2) suggesting a range of walking abilities.”

2.12 Measurement procedures: specify the duration of the 4-5 s isometric dorsiflexor MVCs.

Response: The duration was 4 to 5 seconds. We have written this more clearly in the manuscript.

Line 117
“Following two submaximal practices, participants performed three isometric dorsiflexor MVCs; each lasted a duration of 4 to 5 seconds and a 2-minute rest was given between each MVC.”

2.13 Results Table 1: it is suggested to use subscript rather than superscript characters.

Response: We have changed these outcomes to subscript as suggested.
2.1 Address the comments mentioned by Reviewer 1 (George Koumantakis).

Response: We have addressed Reviewer 1’s comments.

2.2 It is recommended to provide, where appropriate, up-to-date references; only a quarter (8/32) of the cited literature was published in the last 5 years.

Response: Thank you for suggesting we review our reference list. We have reviewed the references and amended the manuscript to include some additional references and recent systematic reviews (Azzollini et al., 2021; Chamorro et al., 2017; Dorsch et al., 2021; Kwong et al., 2017; Lomborg et al., 2022; Mentiplay et al., 2015; Mentiplay et al., 2019; Noguchi et al., 2023).

Whilst many references in the manuscript are older than 5 years, all references are relevant and representative of the small body of literature in this field. Such references are essential to our understanding of tibialis anterior muscle structure and function in healthy adults (Marsh et al., 1981; Ruiz Munoz et al., 2015; Siddiqi et al., 2015) and stroke populations (Fimland et al., 2011; Freire et al., 2015), and provide a review of previous studies investigating the reliability of hemiparetic muscle strength and rapid force production which began in the early 2000s (Eng et al., 2002; Pohl et al., 2000) and has not grown much since (Klarner et al., 2014; Mentiplay et al., 2018).

2.3 State the hypothesis of the study.

Response: We have added the null hypothesis on line 95.
“The null hypothesis was that the outcome measures are not reliable (intra-class correlation coefficient (ICC) < 0.5).”

2.4 Study Design: it would be of interest to provide results of the unaffected lower limb for comparison.

Response: We agree this would be helpful. However, due to the time already allocation to complete the experimental protocol and the burden it put on people with chronic stroke, it was not deemed feasible to collect data for the unaffected limb in this clinical population.

2.5 Calculation of RFD200ms: what is the rationale to extract this parameter as the force at the time-instant 200 ms after the onset divided by 200? Could the time derivative of the force data provide an alternative insight regarding the RFD?

Response: In response to the reviewer's query on the rationale for calculating RFD200ms, we chose this method to assess the initial burst of force generation capability, which is crucial for many functional movements in stroke survivors. We also investigated Time to 90% MVC. Both methods offer a straightforward comparison of early force development. Regarding the suggestion to use the time derivative of the force data as an alternative method. Calculating the time derivative of the force/time curve would provide information about the peak RFD in the early part of the contraction. However, peak RFD in small epochs is sensitive to unsystematic variations in the signal and provides peak RFD at an inconsistent time point which is considered a less comprehensive and less standardised approach to measuring RFD (Maffiuletti et al., 2016). We acknowledge that other methods for data processing may offer deeper insights into the rising force/time curve, for example, measuring RFD at multiple time points, or measuring the impulse of the force/time curve (Maffiuletti et al., 2016). However, these methods would require more complex data processing methods, which may be less feasible in clinical contexts. To acknowledge the need to explore alternative methods for data processing, we have made the following amendments to the discussion.

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

2.6 Further elaboration of the neuromuscular mechanisms tested in the study could provide additional context in the Discussion.

Response: To give greater context, we have added the following information to the introduction.
Line 9
“Rapid force production requires recruitment of a large number of motor units as well as a high motor unit firing frequency, both of which are impaired in the hemiparetic dorsiflexor muscles after stroke.⁶This results from central deficits, which reduce neural input to the motor neuron pool, but is also limited by peripheral changes, such as the reduction in the size of type 2a muscle fibres in the hemiparetic tibialis anterior (Noguchi et al., 2023) and soft tissue stiffness and spasticity in the antagonist plantarflexor muscles (Azzollini et al., 2021).”

2.7 Provide the strengths and the limitations of the study.
Response: Thank you for this suggestion. We have added a section on strength and limitations to the discussion.

Line 302
Strengths and limitations
“A key strength of this study was the application of an isometric MVC procedure that could be completed by people with more severe stroke. This enabled enrolment of a broad sample with a range of lower limb weakness and functional walking ability, increasing the generalisability of findings to a wider stroke population. Other methodological strengths included positioning of the ankle to optimise dorsiflexion force ²⁹ and fixation of the toes to reduce measurement variability. ²³ In addition, our approach to measuring RFD enabled evaluation of the very early force production (0-200ms) which has not been evaluated previously in the hemiparetic dorsiflexor muscles. Further research could explore the reliability of other time windows. The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15}To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI ²⁸(Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

2.8 The conclusions partly replicate the final part of the Discussion. It is suggested to include recommendations for practical use.

Response: Thank you for this suggestion. Please find below our amended conclusion.

Line 363
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilises gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation."

2.9 Introduction: “the ability to exert force over a short time”: this is the definition of power; it is proposed to delete this phrase.

Response: It was our intention to define muscle power to ensure this concept was clear at the outset. We have put the definition in brackets to make it clear that this sentence refers to only two concepts.

Line 2
“Ankle dorsiflexor impairments are common after stroke ¹affecting both muscle strength (the force exerted during a single maximal effort) and muscle power (the ability to exert force over a short time).”

2.10 Introduction: “Muscle strength can be measured isokinetically or isometrically”: Clarification is needed.

Response: Thank you for this prompt. We have provided clarification in the manuscript as follows.

Line 65
“Isokinetic MVCs involve muscle contraction against accommodating resistance through the joints range of movement at a constant velocity, whereas isometric MVCs involve muscle contraction against stationary resistance at a set joint angle (Drouin et al., 2004).”

2.11 Participants: elaborate on the inclusion criteria.

Response: The eligibility criteria have been provided below with some additional clarification.

“The 15 participants were adults, more than 6 months post stroke, with hemiparesis affecting ankle dorsiflexion movement. The sample size was based on that required for the broader experimental study. ⁹Exclusion criteria were significant cognitive/perceptual/communication deficits, cerebellar stroke, inability to produce ankle dorsiflexor force against the dynamometer, or medical conditions that would impact safety or protocol completion. ⁹”

In addition, we have provided further information about the impairment and function of participants in the results section.
“Participants presented with a range of lower limb weakness, from mild to severe, and used a variety of outdoor mobility aids (unaided n = 4, quad or walking stick n = 5, walking frame n = 2, wheelchair n = 2) suggesting a range of walking abilities.”

2.12 Measurement procedures: specify the duration of the 4-5 s isometric dorsiflexor MVCs.

Response: The duration was 4 to 5 seconds. We have written this more clearly in the manuscript.

Line 117
“Following two submaximal practices, participants performed three isometric dorsiflexor MVCs; each lasted a duration of 4 to 5 seconds and a 2-minute rest was given between each MVC.”

2.13 Results Table 1: it is suggested to use subscript rather than superscript characters.

Response: We have changed these outcomes to subscript as suggested.
Competing Interests: No competing interests were disclosed. Close
Report a concern
Respond or Comment

COMMENTS ON THIS REPORT

Author Response 29 Aug 2024

Sharon Olsen, HRRI, Auckland University of Technology, Auckland, New Zealand

29 Aug 2024

Author Response

2.1 Address the comments mentioned by Reviewer 1 (George Koumantakis).

Response: We have addressed Reviewer 1’s comments.

2.2 It is recommended to provide, where appropriate, up-to-date references; only ... Continue reading 2.1 Address the comments mentioned by Reviewer 1 (George Koumantakis).

Response: We have addressed Reviewer 1’s comments.

2.2 It is recommended to provide, where appropriate, up-to-date references; only a quarter (8/32) of the cited literature was published in the last 5 years.

Response: Thank you for suggesting we review our reference list. We have reviewed the references and amended the manuscript to include some additional references and recent systematic reviews (Azzollini et al., 2021; Chamorro et al., 2017; Dorsch et al., 2021; Kwong et al., 2017; Lomborg et al., 2022; Mentiplay et al., 2015; Mentiplay et al., 2019; Noguchi et al., 2023).

Whilst many references in the manuscript are older than 5 years, all references are relevant and representative of the small body of literature in this field. Such references are essential to our understanding of tibialis anterior muscle structure and function in healthy adults (Marsh et al., 1981; Ruiz Munoz et al., 2015; Siddiqi et al., 2015) and stroke populations (Fimland et al., 2011; Freire et al., 2015), and provide a review of previous studies investigating the reliability of hemiparetic muscle strength and rapid force production which began in the early 2000s (Eng et al., 2002; Pohl et al., 2000) and has not grown much since (Klarner et al., 2014; Mentiplay et al., 2018).

2.3 State the hypothesis of the study.

Response: We have added the null hypothesis on line 95.
“The null hypothesis was that the outcome measures are not reliable (intra-class correlation coefficient (ICC) < 0.5).”

2.4 Study Design: it would be of interest to provide results of the unaffected lower limb for comparison.

Response: We agree this would be helpful. However, due to the time already allocation to complete the experimental protocol and the burden it put on people with chronic stroke, it was not deemed feasible to collect data for the unaffected limb in this clinical population.

2.5 Calculation of RFD200ms: what is the rationale to extract this parameter as the force at the time-instant 200 ms after the onset divided by 200? Could the time derivative of the force data provide an alternative insight regarding the RFD?

Response: In response to the reviewer's query on the rationale for calculating RFD200ms, we chose this method to assess the initial burst of force generation capability, which is crucial for many functional movements in stroke survivors. We also investigated Time to 90% MVC. Both methods offer a straightforward comparison of early force development. Regarding the suggestion to use the time derivative of the force data as an alternative method. Calculating the time derivative of the force/time curve would provide information about the peak RFD in the early part of the contraction. However, peak RFD in small epochs is sensitive to unsystematic variations in the signal and provides peak RFD at an inconsistent time point which is considered a less comprehensive and less standardised approach to measuring RFD (Maffiuletti et al., 2016). We acknowledge that other methods for data processing may offer deeper insights into the rising force/time curve, for example, measuring RFD at multiple time points, or measuring the impulse of the force/time curve (Maffiuletti et al., 2016). However, these methods would require more complex data processing methods, which may be less feasible in clinical contexts. To acknowledge the need to explore alternative methods for data processing, we have made the following amendments to the discussion.

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

2.6 Further elaboration of the neuromuscular mechanisms tested in the study could provide additional context in the Discussion.

Response: To give greater context, we have added the following information to the introduction.
Line 9
“Rapid force production requires recruitment of a large number of motor units as well as a high motor unit firing frequency, both of which are impaired in the hemiparetic dorsiflexor muscles after stroke.⁶This results from central deficits, which reduce neural input to the motor neuron pool, but is also limited by peripheral changes, such as the reduction in the size of type 2a muscle fibres in the hemiparetic tibialis anterior (Noguchi et al., 2023) and soft tissue stiffness and spasticity in the antagonist plantarflexor muscles (Azzollini et al., 2021).”

2.7 Provide the strengths and the limitations of the study.
Response: Thank you for this suggestion. We have added a section on strength and limitations to the discussion.

Line 302
Strengths and limitations
“A key strength of this study was the application of an isometric MVC procedure that could be completed by people with more severe stroke. This enabled enrolment of a broad sample with a range of lower limb weakness and functional walking ability, increasing the generalisability of findings to a wider stroke population. Other methodological strengths included positioning of the ankle to optimise dorsiflexion force ²⁹ and fixation of the toes to reduce measurement variability. ²³ In addition, our approach to measuring RFD enabled evaluation of the very early force production (0-200ms) which has not been evaluated previously in the hemiparetic dorsiflexor muscles. Further research could explore the reliability of other time windows. The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15}To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI ²⁸(Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

2.8 The conclusions partly replicate the final part of the Discussion. It is suggested to include recommendations for practical use.

Response: Thank you for this suggestion. Please find below our amended conclusion.

Line 363
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilises gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation."

2.9 Introduction: “the ability to exert force over a short time”: this is the definition of power; it is proposed to delete this phrase.

Response: It was our intention to define muscle power to ensure this concept was clear at the outset. We have put the definition in brackets to make it clear that this sentence refers to only two concepts.

Line 2
“Ankle dorsiflexor impairments are common after stroke ¹affecting both muscle strength (the force exerted during a single maximal effort) and muscle power (the ability to exert force over a short time).”

2.10 Introduction: “Muscle strength can be measured isokinetically or isometrically”: Clarification is needed.

Response: Thank you for this prompt. We have provided clarification in the manuscript as follows.

Line 65
“Isokinetic MVCs involve muscle contraction against accommodating resistance through the joints range of movement at a constant velocity, whereas isometric MVCs involve muscle contraction against stationary resistance at a set joint angle (Drouin et al., 2004).”

2.11 Participants: elaborate on the inclusion criteria.

Response: The eligibility criteria have been provided below with some additional clarification.

“The 15 participants were adults, more than 6 months post stroke, with hemiparesis affecting ankle dorsiflexion movement. The sample size was based on that required for the broader experimental study. ⁹Exclusion criteria were significant cognitive/perceptual/communication deficits, cerebellar stroke, inability to produce ankle dorsiflexor force against the dynamometer, or medical conditions that would impact safety or protocol completion. ⁹”

In addition, we have provided further information about the impairment and function of participants in the results section.
“Participants presented with a range of lower limb weakness, from mild to severe, and used a variety of outdoor mobility aids (unaided n = 4, quad or walking stick n = 5, walking frame n = 2, wheelchair n = 2) suggesting a range of walking abilities.”

2.12 Measurement procedures: specify the duration of the 4-5 s isometric dorsiflexor MVCs.

Response: The duration was 4 to 5 seconds. We have written this more clearly in the manuscript.

Line 117
“Following two submaximal practices, participants performed three isometric dorsiflexor MVCs; each lasted a duration of 4 to 5 seconds and a 2-minute rest was given between each MVC.”

2.13 Results Table 1: it is suggested to use subscript rather than superscript characters.

Response: We have changed these outcomes to subscript as suggested.
2.1 Address the comments mentioned by Reviewer 1 (George Koumantakis).

Response: We have addressed Reviewer 1’s comments.

2.2 It is recommended to provide, where appropriate, up-to-date references; only a quarter (8/32) of the cited literature was published in the last 5 years.

Response: Thank you for suggesting we review our reference list. We have reviewed the references and amended the manuscript to include some additional references and recent systematic reviews (Azzollini et al., 2021; Chamorro et al., 2017; Dorsch et al., 2021; Kwong et al., 2017; Lomborg et al., 2022; Mentiplay et al., 2015; Mentiplay et al., 2019; Noguchi et al., 2023).

Whilst many references in the manuscript are older than 5 years, all references are relevant and representative of the small body of literature in this field. Such references are essential to our understanding of tibialis anterior muscle structure and function in healthy adults (Marsh et al., 1981; Ruiz Munoz et al., 2015; Siddiqi et al., 2015) and stroke populations (Fimland et al., 2011; Freire et al., 2015), and provide a review of previous studies investigating the reliability of hemiparetic muscle strength and rapid force production which began in the early 2000s (Eng et al., 2002; Pohl et al., 2000) and has not grown much since (Klarner et al., 2014; Mentiplay et al., 2018).

2.3 State the hypothesis of the study.

Response: We have added the null hypothesis on line 95.
“The null hypothesis was that the outcome measures are not reliable (intra-class correlation coefficient (ICC) < 0.5).”

2.4 Study Design: it would be of interest to provide results of the unaffected lower limb for comparison.

Response: We agree this would be helpful. However, due to the time already allocation to complete the experimental protocol and the burden it put on people with chronic stroke, it was not deemed feasible to collect data for the unaffected limb in this clinical population.

2.5 Calculation of RFD200ms: what is the rationale to extract this parameter as the force at the time-instant 200 ms after the onset divided by 200? Could the time derivative of the force data provide an alternative insight regarding the RFD?

Response: In response to the reviewer's query on the rationale for calculating RFD200ms, we chose this method to assess the initial burst of force generation capability, which is crucial for many functional movements in stroke survivors. We also investigated Time to 90% MVC. Both methods offer a straightforward comparison of early force development. Regarding the suggestion to use the time derivative of the force data as an alternative method. Calculating the time derivative of the force/time curve would provide information about the peak RFD in the early part of the contraction. However, peak RFD in small epochs is sensitive to unsystematic variations in the signal and provides peak RFD at an inconsistent time point which is considered a less comprehensive and less standardised approach to measuring RFD (Maffiuletti et al., 2016). We acknowledge that other methods for data processing may offer deeper insights into the rising force/time curve, for example, measuring RFD at multiple time points, or measuring the impulse of the force/time curve (Maffiuletti et al., 2016). However, these methods would require more complex data processing methods, which may be less feasible in clinical contexts. To acknowledge the need to explore alternative methods for data processing, we have made the following amendments to the discussion.

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

2.6 Further elaboration of the neuromuscular mechanisms tested in the study could provide additional context in the Discussion.

Response: To give greater context, we have added the following information to the introduction.
Line 9
“Rapid force production requires recruitment of a large number of motor units as well as a high motor unit firing frequency, both of which are impaired in the hemiparetic dorsiflexor muscles after stroke.⁶This results from central deficits, which reduce neural input to the motor neuron pool, but is also limited by peripheral changes, such as the reduction in the size of type 2a muscle fibres in the hemiparetic tibialis anterior (Noguchi et al., 2023) and soft tissue stiffness and spasticity in the antagonist plantarflexor muscles (Azzollini et al., 2021).”

2.7 Provide the strengths and the limitations of the study.
Response: Thank you for this suggestion. We have added a section on strength and limitations to the discussion.

Line 302
Strengths and limitations
“A key strength of this study was the application of an isometric MVC procedure that could be completed by people with more severe stroke. This enabled enrolment of a broad sample with a range of lower limb weakness and functional walking ability, increasing the generalisability of findings to a wider stroke population. Other methodological strengths included positioning of the ankle to optimise dorsiflexion force ²⁹ and fixation of the toes to reduce measurement variability. ²³ In addition, our approach to measuring RFD enabled evaluation of the very early force production (0-200ms) which has not been evaluated previously in the hemiparetic dorsiflexor muscles. Further research could explore the reliability of other time windows. The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15}To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI ²⁸(Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

2.8 The conclusions partly replicate the final part of the Discussion. It is suggested to include recommendations for practical use.

Response: Thank you for this suggestion. Please find below our amended conclusion.

Line 363
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilises gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation."

2.9 Introduction: “the ability to exert force over a short time”: this is the definition of power; it is proposed to delete this phrase.

Response: It was our intention to define muscle power to ensure this concept was clear at the outset. We have put the definition in brackets to make it clear that this sentence refers to only two concepts.

Line 2
“Ankle dorsiflexor impairments are common after stroke ¹affecting both muscle strength (the force exerted during a single maximal effort) and muscle power (the ability to exert force over a short time).”

2.10 Introduction: “Muscle strength can be measured isokinetically or isometrically”: Clarification is needed.

Response: Thank you for this prompt. We have provided clarification in the manuscript as follows.

Line 65
“Isokinetic MVCs involve muscle contraction against accommodating resistance through the joints range of movement at a constant velocity, whereas isometric MVCs involve muscle contraction against stationary resistance at a set joint angle (Drouin et al., 2004).”

2.11 Participants: elaborate on the inclusion criteria.

Response: The eligibility criteria have been provided below with some additional clarification.

“The 15 participants were adults, more than 6 months post stroke, with hemiparesis affecting ankle dorsiflexion movement. The sample size was based on that required for the broader experimental study. ⁹Exclusion criteria were significant cognitive/perceptual/communication deficits, cerebellar stroke, inability to produce ankle dorsiflexor force against the dynamometer, or medical conditions that would impact safety or protocol completion. ⁹”

In addition, we have provided further information about the impairment and function of participants in the results section.
“Participants presented with a range of lower limb weakness, from mild to severe, and used a variety of outdoor mobility aids (unaided n = 4, quad or walking stick n = 5, walking frame n = 2, wheelchair n = 2) suggesting a range of walking abilities.”

2.12 Measurement procedures: specify the duration of the 4-5 s isometric dorsiflexor MVCs.

Response: The duration was 4 to 5 seconds. We have written this more clearly in the manuscript.

Line 117
“Following two submaximal practices, participants performed three isometric dorsiflexor MVCs; each lasted a duration of 4 to 5 seconds and a 2-minute rest was given between each MVC.”

2.13 Results Table 1: it is suggested to use subscript rather than superscript characters.

Response: We have changed these outcomes to subscript as suggested.
Competing Interests: No competing interests were disclosed. Close
Report a concern

Views

Reviewer Report 11 Aug 2023

George Koumantakis, Physiotherapy, University of West Attica, Athens, Attiki, Greece

Approved with Reservations

https://doi.org/10.5256/f1000research.145331.r191140

This is a well-conducted test-retest reliability study. The authors know the correct statistical methods to report such a study. Minor issues are present, and these are highlighted to improve this work.

The authors should mention in their Abstract the respective SEM values as well.

The authors correctly make adequate links to the clinical utility of this study, as strength and rate of force development in the ankle dorsiflexors form part of participants’ gait improvement post-stroke.

Under ‘Participants’, the sample size (n=15), which eventually was n=13, is not adequately explained. Koo & Li (2016), pg. 158, suggest a sample of n=30 as adequate for a reliability study. The best you can do is add this to the limitations of your study.

It is unclear how many raters were in this study; please clarify.

Correct the characterization of ICCs, based not only on the lower limit of the ICC 95% CI but on the whole range of the CI, as suggested by Koo and Li (2016), pg. 161. Please correct throughout.

The EMG acquisition and analysis are correctly reported.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Partly
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Partly

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: Reliability, validity, questionnaires, musculoskeletal, physiotherapy, physical therapy, rehabilitation, EMG, functional assessment

CITE

Report a concern

Author Response 29 Aug 2024

Sharon Olsen, HRRI, Auckland University of Technology, Auckland, New Zealand

29 Aug 2024

Author Response

1.1 This is a well-conducted test-retest reliability study. The authors know the correct statistical methods to report such a study. Minor issues are present, and these are highlighted to improve ... Continue reading 1.1 This is a well-conducted test-retest reliability study. The authors know the correct statistical methods to report such a study. Minor issues are present, and these are highlighted to improve this work

Response: Thank you for your encouraging feedback.

1.2 The authors should mention in their Abstract the respective SEM values as well.

Response: Thank you for this suggestion. We have added the SEM% values to the abstract results below.

Abstract results: “Reliability was higher when analysing the mean of three trials rather than the best of three trials. There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92, 0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60, 0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53, 0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48, 0.92], SEM% 24%).”

1.3 The authors correctly make adequate links to the clinical utility of this study, as strength and rate of force development in the ankle dorsiflexors form part of participants’ gait improvement post-stroke.

Response: Thank you for this encouraging feedback.

1.4 Under ‘Participants’, the sample size (n=15), which eventually was n=13, is not adequately explained. Koo & Li (2016), pg. 158, suggest a sample of n=30 as adequate for a reliability study. The best you can do is add this to the limitations of your study.

Response: Thank you for raising this concern. While other reliability studies in this field of stroke research have been conducted with similarly small samples (Eng et al., 2002; Klarner et al., 2014; Pohl et al., 2000), we agree that there is a risk of being underpowered. Therefore, we have amended the manuscript and discussed the sample size in the new limitations section copied below and made recommendations for further research in a larger sample.

Strengths and limitations: Line 302
…"The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15} To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI (Koo & Li, 2016; Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

In addition, we have also provided sample sizes of other research in the discussion to aid in the interpretation.
Line 262 "... Our MVC reliability results were superior to the isometric MVC results of Klarner and colleagues who found moderate between-session reliability (ICC 0.71) for hemiparetic dorsiflexor MVCs over three sessions, with a similar sample size (n=12). ^15 "
Line 267 "...as with the MVC data, our TA EMG data appeared more reliable than that previously reported (ICC 0.67) in sample of 12 people with chronic stroke. ¹⁵”

Furthermore, we have provided further explanation about the 2 dropouts in the results section.
Line 156 "Data for two participants were excluded due to failure to correctly complete the protocol; this was because one participant was not able to consistently follow the task instructions and another participant was observed falling asleep during the protocol.”

In addition to these amendments related to the sample size and study power, we have revised our approach to the interpretation of the ICCs to take a more conservative approach – these amendments are detailed in question 1.6 which raised the issue of ICC interpretation. Please see 1.6.

1.5 It is unclear how many raters were in this study; please clarify.

Response: Thank you for raising this question. This paper investigates between-session reliability, rather than inter-rater reliability. The aim of the paper is stated at the end of the introduction. “This analysis aimed to determine the between-session reliability of isometric ankle dorsiflexor MVC, ankle dorsiflexor muscle RFD in the first 200ms (RFD200ms), time to reach 90% peak force, and TA EMG, in people with chronic stroke.”
In response to your question, we have clarified in the manuscript that the same researcher provided verbal instructions at the two measurement sessions, and that the visual inspection of data was completed by a single researcher.

Line 119
“Participants were instructed to “pull as fast and hard as possible” and received loud verbal encouragement and real-time visual feedback. Instructions were provided by the same researcher at both sessions.”
Line 131
“Movement onset was automatically identified where the signal exceeded the mean baseline signal by 3 SDs, and then confirmed visually by a single researcher. The baseline window and the onset threshold could be individualised by the researcher to ensure the onset was identified correctly for each contraction.”

1.6 Correct the characterization of ICCs, based not only on the lower limit of the ICC 95% CI but on the whole range of the CI, as suggested by Koo and Li (2016), pg. 161. Please correct throughout.

Response: Thank you for raising this. We had chosen to interpret ICCs based on the lower bound of the 95% CI as a conservative approach which considers the sample is not a random sample of the population (Munro, 2005). However, given our sample was small (which we have discussed in 1.4 above), we agree that the full range should be considered and have amended the manuscript to take a more conservative approach to interpretation of the findings and clarified when we are interpreting the ICC or its lower bound 95% confidence interval. Relevant amendments to the abstract, discussion and conclusion are copied below.

Abstract
“Results: …There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92-0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60-0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53-0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48-0.92], SEM% 24%).
Conclusion: The findings raise concerns about the reliability of measures of rapid force production in the dorsiflexor muscles after stroke. Given the functional significance of the ankle dorsiflexors, larger studies should be conducted to further investigate these concerns and explore reliable methods for measuring rapid force production in the hemiparetic dorsiflexor muscles.”

Results - Reliability analysis
The reliability analysis is reported in Table 1. MVC measures demonstrated excellent reliability, with the mean of three trials displaying slightly higher reliability (ICC 0.97 [95% CI 0.92, 0.99]) than the best of three trials (ICC 0.97 [95% CI 0.90, 0.99]). For TA EMG data, the ICCs were in the good range but the lower bound 95% CIs were in the moderate range (ICC 0.86 [95% CI 0.60, 0.06]). For measures of rapid force production, when using the mean of three trials, the Time to 90% MVC and RFD200ms had ICCs in the good range, but the lower bound 95% CIs were in the moderate range for Time to 90% MVC (ICC 0.80 [95% CI 0.53, 0.93]) and in the poor range for RFD200ms (ICC 0.0.79 [95% CI 0.48, 0.92]). Both measures of rapid force production demonstrated very low lower-bound CIs when only the best trial was analysed (Table 1).
Please note we have removed the interpretation column in Table 1, and instead provided this in the text to enable interpretation of both the ICC and its confidence interval.

Discussion
Line 267
“…Our reliability findings for TA EMG, which represent motor unit recruitment at the peak of the MVC, demonstrated lower reliability, with a good ICC and the lower bound 95% CI in the moderate range (TA EMG _MEAN ICC 0.86 [95% CI 0.60, 0.96). Alongside an SEM% of 23-25%, this suggests that TA EMG is prone to greater biological and/or measurement variability than peak force measures.”

Line 274
“…This study is also the first to report on the reliability of RFD or rapid force production of the hemiparetic dorsiflexor muscles using a rigid dynamometer. While the ICCs were in the good range when three trials were analysed, the lower bound of the 95% CI of the ICCs indicated reliability could be only moderate for Time to 90% MVC _MEAN (ICC 0.80 [95% CI 0.53, 0.93]) and poor for RFD200ms _MEAN (ICC 0.79 [95% CI 0.48, 0.92]).”

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

Conclusions
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilise gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation.”

1.7 The EMG acquisition and analysis are correctly reported.

Response: Thank you.

1.8 Are the conclusions drawn adequately supported by the results? Partly

Response: Thank you for indicating this. We have amended our conclusion with a more cautious approach to interpretation and based on Reviewer 2’s feedback, we have added implications for researchers and clinicians. The conclusions have been copied above in 1.6.
1.1 This is a well-conducted test-retest reliability study. The authors know the correct statistical methods to report such a study. Minor issues are present, and these are highlighted to improve this work

Response: Thank you for your encouraging feedback.

1.2 The authors should mention in their Abstract the respective SEM values as well.

Response: Thank you for this suggestion. We have added the SEM% values to the abstract results below.

Abstract results: “Reliability was higher when analysing the mean of three trials rather than the best of three trials. There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92, 0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60, 0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53, 0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48, 0.92], SEM% 24%).”

1.3 The authors correctly make adequate links to the clinical utility of this study, as strength and rate of force development in the ankle dorsiflexors form part of participants’ gait improvement post-stroke.

Response: Thank you for this encouraging feedback.

1.4 Under ‘Participants’, the sample size (n=15), which eventually was n=13, is not adequately explained. Koo & Li (2016), pg. 158, suggest a sample of n=30 as adequate for a reliability study. The best you can do is add this to the limitations of your study.

Response: Thank you for raising this concern. While other reliability studies in this field of stroke research have been conducted with similarly small samples (Eng et al., 2002; Klarner et al., 2014; Pohl et al., 2000), we agree that there is a risk of being underpowered. Therefore, we have amended the manuscript and discussed the sample size in the new limitations section copied below and made recommendations for further research in a larger sample.

Strengths and limitations: Line 302
…"The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15} To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI (Koo & Li, 2016; Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

In addition, we have also provided sample sizes of other research in the discussion to aid in the interpretation.
Line 262 "... Our MVC reliability results were superior to the isometric MVC results of Klarner and colleagues who found moderate between-session reliability (ICC 0.71) for hemiparetic dorsiflexor MVCs over three sessions, with a similar sample size (n=12). ^15 "
Line 267 "...as with the MVC data, our TA EMG data appeared more reliable than that previously reported (ICC 0.67) in sample of 12 people with chronic stroke. ¹⁵”

Furthermore, we have provided further explanation about the 2 dropouts in the results section.
Line 156 "Data for two participants were excluded due to failure to correctly complete the protocol; this was because one participant was not able to consistently follow the task instructions and another participant was observed falling asleep during the protocol.”

In addition to these amendments related to the sample size and study power, we have revised our approach to the interpretation of the ICCs to take a more conservative approach – these amendments are detailed in question 1.6 which raised the issue of ICC interpretation. Please see 1.6.

1.5 It is unclear how many raters were in this study; please clarify.

Response: Thank you for raising this question. This paper investigates between-session reliability, rather than inter-rater reliability. The aim of the paper is stated at the end of the introduction. “This analysis aimed to determine the between-session reliability of isometric ankle dorsiflexor MVC, ankle dorsiflexor muscle RFD in the first 200ms (RFD200ms), time to reach 90% peak force, and TA EMG, in people with chronic stroke.”
In response to your question, we have clarified in the manuscript that the same researcher provided verbal instructions at the two measurement sessions, and that the visual inspection of data was completed by a single researcher.

Line 119
“Participants were instructed to “pull as fast and hard as possible” and received loud verbal encouragement and real-time visual feedback. Instructions were provided by the same researcher at both sessions.”
Line 131
“Movement onset was automatically identified where the signal exceeded the mean baseline signal by 3 SDs, and then confirmed visually by a single researcher. The baseline window and the onset threshold could be individualised by the researcher to ensure the onset was identified correctly for each contraction.”

1.6 Correct the characterization of ICCs, based not only on the lower limit of the ICC 95% CI but on the whole range of the CI, as suggested by Koo and Li (2016), pg. 161. Please correct throughout.

Response: Thank you for raising this. We had chosen to interpret ICCs based on the lower bound of the 95% CI as a conservative approach which considers the sample is not a random sample of the population (Munro, 2005). However, given our sample was small (which we have discussed in 1.4 above), we agree that the full range should be considered and have amended the manuscript to take a more conservative approach to interpretation of the findings and clarified when we are interpreting the ICC or its lower bound 95% confidence interval. Relevant amendments to the abstract, discussion and conclusion are copied below.

Abstract
“Results: …There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92-0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60-0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53-0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48-0.92], SEM% 24%).
Conclusion: The findings raise concerns about the reliability of measures of rapid force production in the dorsiflexor muscles after stroke. Given the functional significance of the ankle dorsiflexors, larger studies should be conducted to further investigate these concerns and explore reliable methods for measuring rapid force production in the hemiparetic dorsiflexor muscles.”

Results - Reliability analysis
The reliability analysis is reported in Table 1. MVC measures demonstrated excellent reliability, with the mean of three trials displaying slightly higher reliability (ICC 0.97 [95% CI 0.92, 0.99]) than the best of three trials (ICC 0.97 [95% CI 0.90, 0.99]). For TA EMG data, the ICCs were in the good range but the lower bound 95% CIs were in the moderate range (ICC 0.86 [95% CI 0.60, 0.06]). For measures of rapid force production, when using the mean of three trials, the Time to 90% MVC and RFD200ms had ICCs in the good range, but the lower bound 95% CIs were in the moderate range for Time to 90% MVC (ICC 0.80 [95% CI 0.53, 0.93]) and in the poor range for RFD200ms (ICC 0.0.79 [95% CI 0.48, 0.92]). Both measures of rapid force production demonstrated very low lower-bound CIs when only the best trial was analysed (Table 1).
Please note we have removed the interpretation column in Table 1, and instead provided this in the text to enable interpretation of both the ICC and its confidence interval.

Discussion
Line 267
“…Our reliability findings for TA EMG, which represent motor unit recruitment at the peak of the MVC, demonstrated lower reliability, with a good ICC and the lower bound 95% CI in the moderate range (TA EMG _MEAN ICC 0.86 [95% CI 0.60, 0.96). Alongside an SEM% of 23-25%, this suggests that TA EMG is prone to greater biological and/or measurement variability than peak force measures.”

Line 274
“…This study is also the first to report on the reliability of RFD or rapid force production of the hemiparetic dorsiflexor muscles using a rigid dynamometer. While the ICCs were in the good range when three trials were analysed, the lower bound of the 95% CI of the ICCs indicated reliability could be only moderate for Time to 90% MVC _MEAN (ICC 0.80 [95% CI 0.53, 0.93]) and poor for RFD200ms _MEAN (ICC 0.79 [95% CI 0.48, 0.92]).”

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

Conclusions
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilise gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation.”

1.7 The EMG acquisition and analysis are correctly reported.

Response: Thank you.

1.8 Are the conclusions drawn adequately supported by the results? Partly

Response: Thank you for indicating this. We have amended our conclusion with a more cautious approach to interpretation and based on Reviewer 2’s feedback, we have added implications for researchers and clinicians. The conclusions have been copied above in 1.6.
Competing Interests: No competing interests were disclosed. Close
Report a concern
Respond or Comment

COMMENTS ON THIS REPORT

Author Response 29 Aug 2024

Sharon Olsen, HRRI, Auckland University of Technology, Auckland, New Zealand

29 Aug 2024

Author Response

1.1 This is a well-conducted test-retest reliability study. The authors know the correct statistical methods to report such a study. Minor issues are present, and these are highlighted to improve ... Continue reading 1.1 This is a well-conducted test-retest reliability study. The authors know the correct statistical methods to report such a study. Minor issues are present, and these are highlighted to improve this work

Response: Thank you for your encouraging feedback.

1.2 The authors should mention in their Abstract the respective SEM values as well.

Response: Thank you for this suggestion. We have added the SEM% values to the abstract results below.

Abstract results: “Reliability was higher when analysing the mean of three trials rather than the best of three trials. There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92, 0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60, 0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53, 0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48, 0.92], SEM% 24%).”

1.3 The authors correctly make adequate links to the clinical utility of this study, as strength and rate of force development in the ankle dorsiflexors form part of participants’ gait improvement post-stroke.

Response: Thank you for this encouraging feedback.

1.4 Under ‘Participants’, the sample size (n=15), which eventually was n=13, is not adequately explained. Koo & Li (2016), pg. 158, suggest a sample of n=30 as adequate for a reliability study. The best you can do is add this to the limitations of your study.

Response: Thank you for raising this concern. While other reliability studies in this field of stroke research have been conducted with similarly small samples (Eng et al., 2002; Klarner et al., 2014; Pohl et al., 2000), we agree that there is a risk of being underpowered. Therefore, we have amended the manuscript and discussed the sample size in the new limitations section copied below and made recommendations for further research in a larger sample.

Strengths and limitations: Line 302
…"The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15} To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI (Koo & Li, 2016; Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

In addition, we have also provided sample sizes of other research in the discussion to aid in the interpretation.
Line 262 "... Our MVC reliability results were superior to the isometric MVC results of Klarner and colleagues who found moderate between-session reliability (ICC 0.71) for hemiparetic dorsiflexor MVCs over three sessions, with a similar sample size (n=12). ^15 "
Line 267 "...as with the MVC data, our TA EMG data appeared more reliable than that previously reported (ICC 0.67) in sample of 12 people with chronic stroke. ¹⁵”

Furthermore, we have provided further explanation about the 2 dropouts in the results section.
Line 156 "Data for two participants were excluded due to failure to correctly complete the protocol; this was because one participant was not able to consistently follow the task instructions and another participant was observed falling asleep during the protocol.”

In addition to these amendments related to the sample size and study power, we have revised our approach to the interpretation of the ICCs to take a more conservative approach – these amendments are detailed in question 1.6 which raised the issue of ICC interpretation. Please see 1.6.

1.5 It is unclear how many raters were in this study; please clarify.

Response: Thank you for raising this question. This paper investigates between-session reliability, rather than inter-rater reliability. The aim of the paper is stated at the end of the introduction. “This analysis aimed to determine the between-session reliability of isometric ankle dorsiflexor MVC, ankle dorsiflexor muscle RFD in the first 200ms (RFD200ms), time to reach 90% peak force, and TA EMG, in people with chronic stroke.”
In response to your question, we have clarified in the manuscript that the same researcher provided verbal instructions at the two measurement sessions, and that the visual inspection of data was completed by a single researcher.

Line 119
“Participants were instructed to “pull as fast and hard as possible” and received loud verbal encouragement and real-time visual feedback. Instructions were provided by the same researcher at both sessions.”
Line 131
“Movement onset was automatically identified where the signal exceeded the mean baseline signal by 3 SDs, and then confirmed visually by a single researcher. The baseline window and the onset threshold could be individualised by the researcher to ensure the onset was identified correctly for each contraction.”

1.6 Correct the characterization of ICCs, based not only on the lower limit of the ICC 95% CI but on the whole range of the CI, as suggested by Koo and Li (2016), pg. 161. Please correct throughout.

Response: Thank you for raising this. We had chosen to interpret ICCs based on the lower bound of the 95% CI as a conservative approach which considers the sample is not a random sample of the population (Munro, 2005). However, given our sample was small (which we have discussed in 1.4 above), we agree that the full range should be considered and have amended the manuscript to take a more conservative approach to interpretation of the findings and clarified when we are interpreting the ICC or its lower bound 95% confidence interval. Relevant amendments to the abstract, discussion and conclusion are copied below.

Abstract
“Results: …There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92-0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60-0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53-0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48-0.92], SEM% 24%).
Conclusion: The findings raise concerns about the reliability of measures of rapid force production in the dorsiflexor muscles after stroke. Given the functional significance of the ankle dorsiflexors, larger studies should be conducted to further investigate these concerns and explore reliable methods for measuring rapid force production in the hemiparetic dorsiflexor muscles.”

Results - Reliability analysis
The reliability analysis is reported in Table 1. MVC measures demonstrated excellent reliability, with the mean of three trials displaying slightly higher reliability (ICC 0.97 [95% CI 0.92, 0.99]) than the best of three trials (ICC 0.97 [95% CI 0.90, 0.99]). For TA EMG data, the ICCs were in the good range but the lower bound 95% CIs were in the moderate range (ICC 0.86 [95% CI 0.60, 0.06]). For measures of rapid force production, when using the mean of three trials, the Time to 90% MVC and RFD200ms had ICCs in the good range, but the lower bound 95% CIs were in the moderate range for Time to 90% MVC (ICC 0.80 [95% CI 0.53, 0.93]) and in the poor range for RFD200ms (ICC 0.0.79 [95% CI 0.48, 0.92]). Both measures of rapid force production demonstrated very low lower-bound CIs when only the best trial was analysed (Table 1).
Please note we have removed the interpretation column in Table 1, and instead provided this in the text to enable interpretation of both the ICC and its confidence interval.

Discussion
Line 267
“…Our reliability findings for TA EMG, which represent motor unit recruitment at the peak of the MVC, demonstrated lower reliability, with a good ICC and the lower bound 95% CI in the moderate range (TA EMG _MEAN ICC 0.86 [95% CI 0.60, 0.96). Alongside an SEM% of 23-25%, this suggests that TA EMG is prone to greater biological and/or measurement variability than peak force measures.”

Line 274
“…This study is also the first to report on the reliability of RFD or rapid force production of the hemiparetic dorsiflexor muscles using a rigid dynamometer. While the ICCs were in the good range when three trials were analysed, the lower bound of the 95% CI of the ICCs indicated reliability could be only moderate for Time to 90% MVC _MEAN (ICC 0.80 [95% CI 0.53, 0.93]) and poor for RFD200ms _MEAN (ICC 0.79 [95% CI 0.48, 0.92]).”

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

Conclusions
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilise gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation.”

1.7 The EMG acquisition and analysis are correctly reported.

Response: Thank you.

1.8 Are the conclusions drawn adequately supported by the results? Partly

Response: Thank you for indicating this. We have amended our conclusion with a more cautious approach to interpretation and based on Reviewer 2’s feedback, we have added implications for researchers and clinicians. The conclusions have been copied above in 1.6.
1.1 This is a well-conducted test-retest reliability study. The authors know the correct statistical methods to report such a study. Minor issues are present, and these are highlighted to improve this work

Response: Thank you for your encouraging feedback.

1.2 The authors should mention in their Abstract the respective SEM values as well.

Response: Thank you for this suggestion. We have added the SEM% values to the abstract results below.

Abstract results: “Reliability was higher when analysing the mean of three trials rather than the best of three trials. There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92, 0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60, 0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53, 0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48, 0.92], SEM% 24%).”

1.3 The authors correctly make adequate links to the clinical utility of this study, as strength and rate of force development in the ankle dorsiflexors form part of participants’ gait improvement post-stroke.

Response: Thank you for this encouraging feedback.

1.4 Under ‘Participants’, the sample size (n=15), which eventually was n=13, is not adequately explained. Koo & Li (2016), pg. 158, suggest a sample of n=30 as adequate for a reliability study. The best you can do is add this to the limitations of your study.

Response: Thank you for raising this concern. While other reliability studies in this field of stroke research have been conducted with similarly small samples (Eng et al., 2002; Klarner et al., 2014; Pohl et al., 2000), we agree that there is a risk of being underpowered. Therefore, we have amended the manuscript and discussed the sample size in the new limitations section copied below and made recommendations for further research in a larger sample.

Strengths and limitations: Line 302
…"The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15} To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI (Koo & Li, 2016; Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

In addition, we have also provided sample sizes of other research in the discussion to aid in the interpretation.
Line 262 "... Our MVC reliability results were superior to the isometric MVC results of Klarner and colleagues who found moderate between-session reliability (ICC 0.71) for hemiparetic dorsiflexor MVCs over three sessions, with a similar sample size (n=12). ^15 "
Line 267 "...as with the MVC data, our TA EMG data appeared more reliable than that previously reported (ICC 0.67) in sample of 12 people with chronic stroke. ¹⁵”

Furthermore, we have provided further explanation about the 2 dropouts in the results section.
Line 156 "Data for two participants were excluded due to failure to correctly complete the protocol; this was because one participant was not able to consistently follow the task instructions and another participant was observed falling asleep during the protocol.”

In addition to these amendments related to the sample size and study power, we have revised our approach to the interpretation of the ICCs to take a more conservative approach – these amendments are detailed in question 1.6 which raised the issue of ICC interpretation. Please see 1.6.

1.5 It is unclear how many raters were in this study; please clarify.

Response: Thank you for raising this question. This paper investigates between-session reliability, rather than inter-rater reliability. The aim of the paper is stated at the end of the introduction. “This analysis aimed to determine the between-session reliability of isometric ankle dorsiflexor MVC, ankle dorsiflexor muscle RFD in the first 200ms (RFD200ms), time to reach 90% peak force, and TA EMG, in people with chronic stroke.”
In response to your question, we have clarified in the manuscript that the same researcher provided verbal instructions at the two measurement sessions, and that the visual inspection of data was completed by a single researcher.

Line 119
“Participants were instructed to “pull as fast and hard as possible” and received loud verbal encouragement and real-time visual feedback. Instructions were provided by the same researcher at both sessions.”
Line 131
“Movement onset was automatically identified where the signal exceeded the mean baseline signal by 3 SDs, and then confirmed visually by a single researcher. The baseline window and the onset threshold could be individualised by the researcher to ensure the onset was identified correctly for each contraction.”

1.6 Correct the characterization of ICCs, based not only on the lower limit of the ICC 95% CI but on the whole range of the CI, as suggested by Koo and Li (2016), pg. 161. Please correct throughout.

Response: Thank you for raising this. We had chosen to interpret ICCs based on the lower bound of the 95% CI as a conservative approach which considers the sample is not a random sample of the population (Munro, 2005). However, given our sample was small (which we have discussed in 1.4 above), we agree that the full range should be considered and have amended the manuscript to take a more conservative approach to interpretation of the findings and clarified when we are interpreting the ICC or its lower bound 95% confidence interval. Relevant amendments to the abstract, discussion and conclusion are copied below.

Abstract
“Results: …There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92-0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60-0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53-0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48-0.92], SEM% 24%).
Conclusion: The findings raise concerns about the reliability of measures of rapid force production in the dorsiflexor muscles after stroke. Given the functional significance of the ankle dorsiflexors, larger studies should be conducted to further investigate these concerns and explore reliable methods for measuring rapid force production in the hemiparetic dorsiflexor muscles.”

Results - Reliability analysis
The reliability analysis is reported in Table 1. MVC measures demonstrated excellent reliability, with the mean of three trials displaying slightly higher reliability (ICC 0.97 [95% CI 0.92, 0.99]) than the best of three trials (ICC 0.97 [95% CI 0.90, 0.99]). For TA EMG data, the ICCs were in the good range but the lower bound 95% CIs were in the moderate range (ICC 0.86 [95% CI 0.60, 0.06]). For measures of rapid force production, when using the mean of three trials, the Time to 90% MVC and RFD200ms had ICCs in the good range, but the lower bound 95% CIs were in the moderate range for Time to 90% MVC (ICC 0.80 [95% CI 0.53, 0.93]) and in the poor range for RFD200ms (ICC 0.0.79 [95% CI 0.48, 0.92]). Both measures of rapid force production demonstrated very low lower-bound CIs when only the best trial was analysed (Table 1).
Please note we have removed the interpretation column in Table 1, and instead provided this in the text to enable interpretation of both the ICC and its confidence interval.

Discussion
Line 267
“…Our reliability findings for TA EMG, which represent motor unit recruitment at the peak of the MVC, demonstrated lower reliability, with a good ICC and the lower bound 95% CI in the moderate range (TA EMG _MEAN ICC 0.86 [95% CI 0.60, 0.96). Alongside an SEM% of 23-25%, this suggests that TA EMG is prone to greater biological and/or measurement variability than peak force measures.”

Line 274
“…This study is also the first to report on the reliability of RFD or rapid force production of the hemiparetic dorsiflexor muscles using a rigid dynamometer. While the ICCs were in the good range when three trials were analysed, the lower bound of the 95% CI of the ICCs indicated reliability could be only moderate for Time to 90% MVC _MEAN (ICC 0.80 [95% CI 0.53, 0.93]) and poor for RFD200ms _MEAN (ICC 0.79 [95% CI 0.48, 0.92]).”

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

Conclusions
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilise gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation.”

1.7 The EMG acquisition and analysis are correctly reported.

Response: Thank you.

1.8 Are the conclusions drawn adequately supported by the results? Partly

Response: Thank you for indicating this. We have amended our conclusion with a more cautious approach to interpretation and based on Reviewer 2’s feedback, we have added implications for researchers and clinicians. The conclusions have been copied above in 1.6.
Competing Interests: No competing interests were disclosed. Close
Report a concern

Comments on this article Comments (0)

Version 2

VERSION 2 PUBLISHED 20 Apr 2023

Open Peer Review

Reviewer Status

Reviewer Reports

	Invited Reviewers
	1	2	3
Version 2 (revision) 04 Jun 24	read		read
Version 1 20 Apr 23	read	read

George Koumantakis, University of West Attica, Athens, Greece
Vassilios Panoutsakopoulos, Aristotle University of Thessaloniki, Thessaloniki, Greece
Ramachandran Sivakumar, Sri Ramachandra Medical College and Research Institute, Chennai, India

Comments on this article

All Comments(0)

Add a comment

Browse by related subjects

Back to all reports

Reviewer Report

6 Views

22 Aug 2024 | for Version 2

Ramachandran Sivakumar, Sri Ramachandra Medical College and Research Institute, Chennai, Tamil Nadu, India

6 Views Cite this report Responses(0)

Approved With Reservations

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Partly
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Partly
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Stroke rehabilitation, Posture control assessment and training.

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

10 Views

27 Jun 2024 | for Version 2

George Koumantakis, Physiotherapy, University of West Attica, Athens, Attiki, Greece

10 Views Cite this report Responses(0)

Approved

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Reliability, validity, questionnaires, musculoskeletal, physiotherapy, physical therapy, rehabilitation, EMG, functional assessment

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

15 Views

18 Sep 2023 | for Version 1

Vassilios Panoutsakopoulos, Aristotle University of Thessaloniki, Thessaloniki, Greece

15 Views Cite this report Responses(1)

Approved With Reservations

The submitted manuscript comprises a test-retest reliability study. There are some topics that need to be addressed.

General comments:

Address the comments mentioned by Reviewer 1 (George Koumantakis).
It is recommended to provide, where appropriate, up-to-date references; only a quarter (8/32) of the cited literature was published in the last 5 years.
State the hypothesis of the study.
Study Design: it would be of interest to provide results of the unaffected lower limb for comparison.
Calculation of RFD200ms: what is the rationale to extract this parameter as the force at the time-instant 200 ms after the onset divided by 200? Could the time derivative of the force data provide an alternative insight regarding the RFD?
Further elaboration of the neuromuscular mechanisms tested in the study could provide additional context in the Discussion.
Provide the strengths and the limitations of the study.
The conclusions partly replicate the final part of the Discussion. It is suggested to include recommendations for practical use.

Specific comments:

Introduction:

“the ability to exert force over a short time”: this is the definition of power; it is proposed to delete this phrase.
“Muscle strength can be measured isokinetically or isometrically”: Clarification is needed.

Materials and Methods:

Participants: elaborate on the inclusion criteria.
Measurement procedures: specify the duration of the 4-5 s isometric dorsiflexor MVCs.

Results:

Table 1: it is suggested to use subscript rather than superscript characters.

Discussion:

See the respective General Comments.

Is the work clearly and accurately presented and does it cite the current literature?

Partly
Is the study design appropriate and is the work technically sound?

Partly
Are sufficient details of methods and analysis provided to allow replication by others?

Partly
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Partly

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

sports biomechanics, force measurements, range of motion measurements, aquatic therapy

Respond to this report

Responses (1)

Author Response

29 Aug 2024

Sharon Olsen, HRRI, Auckland University of Technology, Auckland, New Zealand

2.1 Address the comments mentioned by Reviewer 1 (George Koumantakis).

Response: We have addressed Reviewer 1’s comments.

2.2 It is recommended to provide, where appropriate, up-to-date references; only a quarter (8/32) of the cited literature was published in the last 5 years.

Response: Thank you for suggesting we review our reference list. We have reviewed the references and amended the manuscript to include some additional references and recent systematic reviews (Azzollini et al., 2021; Chamorro et al., 2017; Dorsch et al., 2021; Kwong et al., 2017; Lomborg et al., 2022; Mentiplay et al., 2015; Mentiplay et al., 2019; Noguchi et al., 2023).

Whilst many references in the manuscript are older than 5 years, all references are relevant and representative of the small body of literature in this field. Such references are essential to our understanding of tibialis anterior muscle structure and function in healthy adults (Marsh et al., 1981; Ruiz Munoz et al., 2015; Siddiqi et al., 2015) and stroke populations (Fimland et al., 2011; Freire et al., 2015), and provide a review of previous studies investigating the reliability of hemiparetic muscle strength and rapid force production which began in the early 2000s (Eng et al., 2002; Pohl et al., 2000) and has not grown much since (Klarner et al., 2014; Mentiplay et al., 2018).

2.3 State the hypothesis of the study.

Response: We have added the null hypothesis on line 95.
“The null hypothesis was that the outcome measures are not reliable (intra-class correlation coefficient (ICC) < 0.5).”

2.4 Study Design: it would be of interest to provide results of the unaffected lower limb for comparison.

Response: We agree this would be helpful. However, due to the time already allocation to complete the experimental protocol and the burden it put on people with chronic stroke, it was not deemed feasible to collect data for the unaffected limb in this clinical population.

2.5 Calculation of RFD200ms: what is the rationale to extract this parameter as the force at the time-instant 200 ms after the onset divided by 200? Could the time derivative of the force data provide an alternative insight regarding the RFD?

Response: In response to the reviewer's query on the rationale for calculating RFD200ms, we chose this method to assess the initial burst of force generation capability, which is crucial for many functional movements in stroke survivors. We also investigated Time to 90% MVC. Both methods offer a straightforward comparison of early force development. Regarding the suggestion to use the time derivative of the force data as an alternative method. Calculating the time derivative of the force/time curve would provide information about the peak RFD in the early part of the contraction. However, peak RFD in small epochs is sensitive to unsystematic variations in the signal and provides peak RFD at an inconsistent time point which is considered a less comprehensive and less standardised approach to measuring RFD (Maffiuletti et al., 2016). We acknowledge that other methods for data processing may offer deeper insights into the rising force/time curve, for example, measuring RFD at multiple time points, or measuring the impulse of the force/time curve (Maffiuletti et al., 2016). However, these methods would require more complex data processing methods, which may be less feasible in clinical contexts. To acknowledge the need to explore alternative methods for data processing, we have made the following amendments to the discussion.

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

2.6 Further elaboration of the neuromuscular mechanisms tested in the study could provide additional context in the Discussion.

Response: To give greater context, we have added the following information to the introduction.
Line 9
“Rapid force production requires recruitment of a large number of motor units as well as a high motor unit firing frequency, both of which are impaired in the hemiparetic dorsiflexor muscles after stroke.⁶This results from central deficits, which reduce neural input to the motor neuron pool, but is also limited by peripheral changes, such as the reduction in the size of type 2a muscle fibres in the hemiparetic tibialis anterior (Noguchi et al., 2023) and soft tissue stiffness and spasticity in the antagonist plantarflexor muscles (Azzollini et al., 2021).”

2.7 Provide the strengths and the limitations of the study.
Response: Thank you for this suggestion. We have added a section on strength and limitations to the discussion.

Line 302
Strengths and limitations
“A key strength of this study was the application of an isometric MVC procedure that could be completed by people with more severe stroke. This enabled enrolment of a broad sample with a range of lower limb weakness and functional walking ability, increasing the generalisability of findings to a wider stroke population. Other methodological strengths included positioning of the ankle to optimise dorsiflexion force ²⁹ and fixation of the toes to reduce measurement variability. ²³ In addition, our approach to measuring RFD enabled evaluation of the very early force production (0-200ms) which has not been evaluated previously in the hemiparetic dorsiflexor muscles. Further research could explore the reliability of other time windows. The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15}To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI ²⁸(Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

2.8 The conclusions partly replicate the final part of the Discussion. It is suggested to include recommendations for practical use.

Response: Thank you for this suggestion. Please find below our amended conclusion.

Line 363
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilises gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation."

2.9 Introduction: “the ability to exert force over a short time”: this is the definition of power; it is proposed to delete this phrase.

Response: It was our intention to define muscle power to ensure this concept was clear at the outset. We have put the definition in brackets to make it clear that this sentence refers to only two concepts.

Line 2
“Ankle dorsiflexor impairments are common after stroke ¹affecting both muscle strength (the force exerted during a single maximal effort) and muscle power (the ability to exert force over a short time).”

2.10 Introduction: “Muscle strength can be measured isokinetically or isometrically”: Clarification is needed.

Response: Thank you for this prompt. We have provided clarification in the manuscript as follows.

Line 65
“Isokinetic MVCs involve muscle contraction against accommodating resistance through the joints range of movement at a constant velocity, whereas isometric MVCs involve muscle contraction against stationary resistance at a set joint angle (Drouin et al., 2004).”

2.11 Participants: elaborate on the inclusion criteria.

Response: The eligibility criteria have been provided below with some additional clarification.

“The 15 participants were adults, more than 6 months post stroke, with hemiparesis affecting ankle dorsiflexion movement. The sample size was based on that required for the broader experimental study. ⁹Exclusion criteria were significant cognitive/perceptual/communication deficits, cerebellar stroke, inability to produce ankle dorsiflexor force against the dynamometer, or medical conditions that would impact safety or protocol completion. ⁹”

In addition, we have provided further information about the impairment and function of participants in the results section.
“Participants presented with a range of lower limb weakness, from mild to severe, and used a variety of outdoor mobility aids (unaided n = 4, quad or walking stick n = 5, walking frame n = 2, wheelchair n = 2) suggesting a range of walking abilities.”

2.12 Measurement procedures: specify the duration of the 4-5 s isometric dorsiflexor MVCs.

Response: The duration was 4 to 5 seconds. We have written this more clearly in the manuscript.

Line 117
“Following two submaximal practices, participants performed three isometric dorsiflexor MVCs; each lasted a duration of 4 to 5 seconds and a 2-minute rest was given between each MVC.”

2.13 Results Table 1: it is suggested to use subscript rather than superscript characters.

Response: We have changed these outcomes to subscript as suggested.

View more View less

Competing Interests

No competing interests were disclosed.

Back to all reports

Reviewer Report

17 Views

11 Aug 2023 | for Version 1

George Koumantakis, Physiotherapy, University of West Attica, Athens, Attiki, Greece

17 Views Cite this report Responses(1)

Approved With Reservations

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Partly
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Partly

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Reliability, validity, questionnaires, musculoskeletal, physiotherapy, physical therapy, rehabilitation, EMG, functional assessment

Respond to this report

Responses (1)

Author Response

29 Aug 2024

Sharon Olsen, HRRI, Auckland University of Technology, Auckland, New Zealand

1.1 This is a well-conducted test-retest reliability study. The authors know the correct statistical methods to report such a study. Minor issues are present, and these are highlighted to improve this work

Response: Thank you for your encouraging feedback.

1.2 The authors should mention in their Abstract the respective SEM values as well.

Response: Thank you for this suggestion. We have added the SEM% values to the abstract results below.

Abstract results: “Reliability was higher when analysing the mean of three trials rather than the best of three trials. There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92, 0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60, 0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53, 0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48, 0.92], SEM% 24%).”

1.3 The authors correctly make adequate links to the clinical utility of this study, as strength and rate of force development in the ankle dorsiflexors form part of participants’ gait improvement post-stroke.

Response: Thank you for this encouraging feedback.

1.4 Under ‘Participants’, the sample size (n=15), which eventually was n=13, is not adequately explained. Koo & Li (2016), pg. 158, suggest a sample of n=30 as adequate for a reliability study. The best you can do is add this to the limitations of your study.

Response: Thank you for raising this concern. While other reliability studies in this field of stroke research have been conducted with similarly small samples (Eng et al., 2002; Klarner et al., 2014; Pohl et al., 2000), we agree that there is a risk of being underpowered. Therefore, we have amended the manuscript and discussed the sample size in the new limitations section copied below and made recommendations for further research in a larger sample.

Strengths and limitations: Line 302
…"The key limitation in this study was the sample size, which was below the n=30 recommended for reliability studies ²⁸ but comparable with other studies in this field. ^{12, 13, 15} To address this limitation, we have been cautious with our interpretation of results, and considered both the ICC and its lower bound 95% CI (Koo & Li, 2016; Munro, 2005) and have provided SEMs to enable comparisons with other literature. However, due to this limitation, it is recommended that the findings generated in this study are confirmed with further research in a larger sample.”

In addition, we have also provided sample sizes of other research in the discussion to aid in the interpretation.
Line 262 "... Our MVC reliability results were superior to the isometric MVC results of Klarner and colleagues who found moderate between-session reliability (ICC 0.71) for hemiparetic dorsiflexor MVCs over three sessions, with a similar sample size (n=12). ^15 "
Line 267 "...as with the MVC data, our TA EMG data appeared more reliable than that previously reported (ICC 0.67) in sample of 12 people with chronic stroke. ¹⁵”

Furthermore, we have provided further explanation about the 2 dropouts in the results section.
Line 156 "Data for two participants were excluded due to failure to correctly complete the protocol; this was because one participant was not able to consistently follow the task instructions and another participant was observed falling asleep during the protocol.”

In addition to these amendments related to the sample size and study power, we have revised our approach to the interpretation of the ICCs to take a more conservative approach – these amendments are detailed in question 1.6 which raised the issue of ICC interpretation. Please see 1.6.

1.5 It is unclear how many raters were in this study; please clarify.

Response: Thank you for raising this question. This paper investigates between-session reliability, rather than inter-rater reliability. The aim of the paper is stated at the end of the introduction. “This analysis aimed to determine the between-session reliability of isometric ankle dorsiflexor MVC, ankle dorsiflexor muscle RFD in the first 200ms (RFD200ms), time to reach 90% peak force, and TA EMG, in people with chronic stroke.”
In response to your question, we have clarified in the manuscript that the same researcher provided verbal instructions at the two measurement sessions, and that the visual inspection of data was completed by a single researcher.

Line 119
“Participants were instructed to “pull as fast and hard as possible” and received loud verbal encouragement and real-time visual feedback. Instructions were provided by the same researcher at both sessions.”
Line 131
“Movement onset was automatically identified where the signal exceeded the mean baseline signal by 3 SDs, and then confirmed visually by a single researcher. The baseline window and the onset threshold could be individualised by the researcher to ensure the onset was identified correctly for each contraction.”

1.6 Correct the characterization of ICCs, based not only on the lower limit of the ICC 95% CI but on the whole range of the CI, as suggested by Koo and Li (2016), pg. 161. Please correct throughout.

Response: Thank you for raising this. We had chosen to interpret ICCs based on the lower bound of the 95% CI as a conservative approach which considers the sample is not a random sample of the population (Munro, 2005). However, given our sample was small (which we have discussed in 1.4 above), we agree that the full range should be considered and have amended the manuscript to take a more conservative approach to interpretation of the findings and clarified when we are interpreting the ICC or its lower bound 95% confidence interval. Relevant amendments to the abstract, discussion and conclusion are copied below.

Abstract
“Results: …There was excellent reliability for isometric dorsiflexor MVC (ICC 0.97 [95% CI 0.92-0.99], SEM% 7%). However, for other outcomes, while the ICC indicated good reliability, the lower bound of the 95% confidence interval of the ICC fell in the moderate range for TA EMG (ICC 0.86 [95% CI 0.60-0.96], SEM% 25%) and time to reach 90% MVC (ICC 0.8 [95% CI 0.53-0.93], SEM% 23%) and in the poor range for dorsiflexor RFD200ms (ICC 0.79 [95% CI 0.48-0.92], SEM% 24%).
Conclusion: The findings raise concerns about the reliability of measures of rapid force production in the dorsiflexor muscles after stroke. Given the functional significance of the ankle dorsiflexors, larger studies should be conducted to further investigate these concerns and explore reliable methods for measuring rapid force production in the hemiparetic dorsiflexor muscles.”

Results - Reliability analysis
The reliability analysis is reported in Table 1. MVC measures demonstrated excellent reliability, with the mean of three trials displaying slightly higher reliability (ICC 0.97 [95% CI 0.92, 0.99]) than the best of three trials (ICC 0.97 [95% CI 0.90, 0.99]). For TA EMG data, the ICCs were in the good range but the lower bound 95% CIs were in the moderate range (ICC 0.86 [95% CI 0.60, 0.06]). For measures of rapid force production, when using the mean of three trials, the Time to 90% MVC and RFD200ms had ICCs in the good range, but the lower bound 95% CIs were in the moderate range for Time to 90% MVC (ICC 0.80 [95% CI 0.53, 0.93]) and in the poor range for RFD200ms (ICC 0.0.79 [95% CI 0.48, 0.92]). Both measures of rapid force production demonstrated very low lower-bound CIs when only the best trial was analysed (Table 1).
Please note we have removed the interpretation column in Table 1, and instead provided this in the text to enable interpretation of both the ICC and its confidence interval.

Discussion
Line 267
“…Our reliability findings for TA EMG, which represent motor unit recruitment at the peak of the MVC, demonstrated lower reliability, with a good ICC and the lower bound 95% CI in the moderate range (TA EMG _MEAN ICC 0.86 [95% CI 0.60, 0.96). Alongside an SEM% of 23-25%, this suggests that TA EMG is prone to greater biological and/or measurement variability than peak force measures.”

Line 274
“…This study is also the first to report on the reliability of RFD or rapid force production of the hemiparetic dorsiflexor muscles using a rigid dynamometer. While the ICCs were in the good range when three trials were analysed, the lower bound of the 95% CI of the ICCs indicated reliability could be only moderate for Time to 90% MVC _MEAN (ICC 0.80 [95% CI 0.53, 0.93]) and poor for RFD200ms _MEAN (ICC 0.79 [95% CI 0.48, 0.92]).”

Line 296
“Given our findings, further research is needed to investigate these concerns about the reliability of rapid force production measures in the hemiparetic dorsiflexor muscles. This research should explore alternative methods for data collection and processing (Maffiuletti et al., 2016) and seek to identify reliable methods for measuring hemiparetic RFD and muscle power that better account for sources of biological and measurement tool variability.”

Conclusions
“This analysis demonstrated excellent between-session reliability for hemiparetic dorsiflexor isometric MVCs. However, other measures of EMG and rapid force production were less reliable, with ICC 95% confidence intervals extending to the poor to moderate range, and SEM percentages between 23-25%. These findings, which utilise gold-standard dynamometry, raise concerns about the reliability of measures of rapid force production in the hemiparetic dorsiflexors muscles. Further research is required to examine reliability in a large sample of people stroke. In the meantime, researchers and clinicians should be cautious when interpreting rapid force production measures of the dorsiflexor muscles when determining the efficacy of stroke rehabilitation interventions. Given the significance of dorsiflexor muscle function to lower limb recovery after stroke, future research should investigate reliable tools for measuring hemiparetic dorsiflexor muscle RFD and muscle power. This will facilitate a greater understanding this aspect of muscle function and enable more targeted rehabilitation.”

1.7 The EMG acquisition and analysis are correctly reported.

Response: Thank you.

1.8 Are the conclusions drawn adequately supported by the results? Partly

Response: Thank you for indicating this. We have amended our conclusion with a more cautious approach to interpretation and based on Reviewer 2’s feedback, we have added implications for researchers and clinicians. The conclusions have been copied above in 1.6.

View more View less

Competing Interests

No competing interests were disclosed.

Alongside their report, reviewers assign a status to the article:

Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested

Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.

Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

[1] 1. Dorsch S, Ada L, Sorial T, Fanayan E: The Relationship Between Strength of the Affected Leg and Walking Speed After Stroke Varies According to the Level of Walking Disability: A Systematic Review. Phys Ther. 2021; 101(12). PubMed Abstract | Publisher Full Text

[2] 2. Bushman BA: Embracing Physical Activity: A Complete Exercise Program. ACSM's Complete Guide to Fitness & Health. 2nd ed.Bushman BA, editor. Human Kinetics: Champaign, Illinois; 2017; pp. 19–36.

[3] 3. Ng SS, Hui-Chan CW: Contribution of ankle dorsiflexor strength to walking endurance in people with spastic hemiplegia after stroke. Arch. Phys. Med. Rehabil. 2012; 93: 1046–1051. Publisher Full Text

[4] 4. Kwong PWH, Ng SSM, Chung RCK, et al.: A structural equation model of the relationship between muscle strength, balance performance, walking endurance and community integration in stroke survivors. PLoS One. 2017; 12(10): e0185807. PubMed Abstract | Publisher Full Text | Free Full Text

[5] 5. Mentiplay BF, Adair B, Bower KJ, et al.Associations between lower limb strength and gait velocity following stroke: a systematic review. Brain Inj. 2015; 29(4); 409–422. PubMed Abstract | Publisher Full Text

[6] 6. Mentiplay BF, Williams G, Tan D, et al.: Gait Velocity and Joint Power Generation After Stroke: Contribution of Strength and Balance. Am. J. Phys. Med. Rehabil. 2019; 98(10); 841–849. PubMed Abstract | Publisher Full Text

[7] 7. Ng SS, Hui-Chan CW: Ankle dorsiflexor, not plantarflexor strength, predicts the functional mobility of people with spastic hemiplegia. J. Rehabil. Med. 2013; 45: 541–545. Publisher Full Text

[8] 8. de Kam D , Roelofs JMB, Bruijnes AKBD, et al.: The next step in understanding impaired reactive balance control in people with stroke: The role of defective early automatic postural responses. Neurorehabil. Neural Repair. 2017; 31: 708–716. PubMed Abstract | Publisher Full Text | Free Full Text

[9] 9. Chou LW, Palmer JA, Binder-Macleod S, et al.: Motor unit rate coding is severely impaired during forceful and fast muscular contractions in individuals post stroke. J. Neurophysiol. 2013; 109: 2947–2954. PubMed Abstract | Publisher Full Text | Free Full Text

[10] 10. Marigold DS, Eng JJ: Altered timing of postural reflexes contributes to falling in persons with chronic stroke. Exp. Brain Res. 2006; 171: 459–468. PubMed Abstract | Publisher Full Text | Free Full Text

[11] 11. Lomborg SD, Dalgas U, Hvid LG: The importance of neuromuscular rate of force development for physical function in aging and common neurodegenerative disorders – a systematic review. J. Musculoskelet. Neuronal Interact. 2022; 22(4): 562–586. PubMed Abstract

[12] 12. Noguchi KS, McLeod JC, Phillips SM, et al.: Differences in Skeletal Muscle Fiber Characteristics Between Affected and Nonaffected Limbs in Individuals With Stroke: A Scoping Review. Phys. Ther. 2023; 103(12). PubMed Abstract | Publisher Full Text

[13] 13. Azzollini V, Dalise S, Chisari C: How Does Stroke Affect Skeletal Muscle? State of the Art and Rehabilitation Perspective. Front. Neurol. 2021; 12: 797559. PubMed Abstract | Publisher Full Text | Free Full Text

[14] 14. Simpson D, Ehrensberger M, Horgan F, et al.: Unilateral dorsiflexor strengthening with mirror therapy to improve motor function after stroke: A pilot randomized study. Physiother. Res. Int. 2019; 24: e1792. PubMed Abstract | Publisher Full Text

[15] 15. Olsen S, Signal N, Niazi IK, et al.: Peripheral electrical stimulation paired with movement-related cortical potentials improves isometric muscle strength and voluntary activation following stroke. Front. Hum. Neurosci. 2020; 14: 156. PubMed Abstract | Publisher Full Text | Free Full Text

[16] 16. Stark T, Walker B, Phillips JK, et al.: Hand-held dynamometry correlation with the gold standard isokinetic dynamometry: a systematic review. PM&R. 2011; 3: 472–479. PubMed Abstract | Publisher Full Text

[17] 17. Hirano M, Katoh M, Gomi M, et al.: Validity and reliability of isometric knee extension muscle strength measurements using a belt-stabilized hand-held dynamometer: a comparison with the measurement using an isokinetic dynamometer in a sitting posture. J. Phys. Ther. Sci. 2020; 32: 120–124. PubMed Abstract | Publisher Full Text | Free Full Text

[18] 18. Chamorro C, Armijo-Olivo S, De la Fuente C, et al.: Absolute Reliability and Concurrent Validity of Hand Held Dynamometry and Isokinetic Dynamometry in the Hip, Knee and Ankle Joint: Systematic Review and Meta-analysis. Open Med (Wars). 2017; 12: 359–375. PubMed Abstract | Publisher Full Text | Free Full Text

[19] 19. Drouin JM, Valovich-mcLeod TC, Shultz SJ, et al.: Reliability and validity of the Biodex system 3 pro isokinetic dynamometer velocity, torque and position measurements. Eur. J. Appl. Physiol. 2004; 91(1): 22–29. PubMed Abstract | Publisher Full Text

[20] 20. Pohl PS, Startzell JK, Duncan PW, et al.: Reliability of lower extremity isokinetic strength testing in adults with stroke. Clin. Rehabil. 2000; 14: 601–607. PubMed Abstract | Publisher Full Text

[21] 21. Eng JJ, Kim CM, MacIntyre DL: Reliability of lower extremity strength measures in persons with chronic stroke. Arch. Phys. Med. Rehabil. 2002; 83: 322–328. PubMed Abstract | Publisher Full Text | Free Full Text

[22] 22. Bohannon RW: Isokinetic testing of muscle strength of older individuals post-stroke: An integrative review. Isokinet. Exerc. Sci. 2020; 28: 303–316. Publisher Full Text

[23] 23. Klarner T, Barss TS, Sun Y, et al.: Reliability of multiple baseline measures for locomotor retraining after stroke. Replace, Repair, Restore, Relieve: Bridging Clinical and Engineering Solutions in Neurorehabilitation. Proceedings of the 2nd International Conference on NeuroRehabilitation. Jensen W, Andersen OK, Akay M, editors. Aalborg, Denmark: Springer; 2014; pp. 479–486.

[24] 24. Ruiz Munoz M, Gonzalez-Sanchez M, Cuesta-Vargas AI: Tibialis anterior analysis from functional and architectural perspective during isometric foot dorsiflexion: A cross-sectional study of repeated measures. J. Foot Ankle Res. 2015; 8: 74. PubMed Abstract | Publisher Full Text | Free Full Text

[25] 25. Fimland MS, Moen PM, Hill T, et al.: Neuromuscular performance of paretic versus non-paretic plantar flexors after stroke. Eur. J. Appl. Physiol. 2011; 111: 3041–3049. PubMed Abstract | Publisher Full Text | Free Full Text

[26] 26. Canning CG, Ada L, O’Dwyer N: Slowness to develop force contributes to weakness after stroke. Arch. Phys. Med. Rehabil. 1999; 80: 66–70. PubMed Abstract | Publisher Full Text

[27] 27. Stavric VA, McNair PJ: Optimizing muscle power after stroke: a cross-sectional study. J. Neuroeng. Rehabil. 2012; 9: 67. PubMed Abstract | Publisher Full Text | Free Full Text

[28] 28. Mentiplay BF, Tan D, Williams G, et al.: Assessment of isometric muscle strength and rate of torque development with hand-held dynamometry: Test-retest reliability and relationship with gait velocity after stroke. J. Biomech. 2018; 75: 171–175. PubMed Abstract | Publisher Full Text

[29] 29. Mentiplay BF, Perraton LG, Bower KJ, et al.: Assessment of lower limb muscle strength and power using hand-held and fixed dynamometry: a reliability and validity study. PLoS One. 2015; 10: e0140822. PubMed Abstract | Publisher Full Text | Free Full Text

[30] 30. Olsen S, Signal N, Niazi IK, et al.: Reliability of tibialis anterior muscle voluntary activation using the interpolated twitch technique and the central activation ratio in people with stroke. Brain Sci. 2021; 11. PubMed Abstract | Publisher Full Text | Free Full Text

[31] 31. Siddiqi A, Arjunan SP, Kumar D: Improvement of isometric dorsiflexion protocol for assessment of tibialis anterior muscle strength. MethodsX. 2015; 2: 107–111. PubMed Abstract | Publisher Full Text | Free Full Text

[32] 32. Maffiuletti NA, Aagaard P, Blazevich AJ, et al.: Rate of force development: Physiological and methodological considerations. Eur. J. Appl. Physiol. 2016; 116: 1091–1116. PubMed Abstract | Publisher Full Text | Free Full Text

[33] 33. Prieske O, Wick D, Granacher U: Intrasession and intersession reliability in maximal and explosive isometric torque production of the elbow flexors. J. Strength Cond. Res. 2014; 28: 1771–1777. PubMed Abstract | Publisher Full Text

[34] 34. Viitasalo JT, Komi PV: Force-time characteristics and fiber composition in human leg extensor muscles. Eur. J. Appl. Physiol. 1978; 40: 7–15. PubMed Abstract | Publisher Full Text

[35] 35. R Core Team: R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2018. Reference Source

[36] 36. Koo TK, Li MY: A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 2016; 15: 155–163. PubMed Abstract | Publisher Full Text | Free Full Text

[37] 37. Munro B: Statistical methods for health care research. Lippincott Williams & Wilkins. 2005.

[38] 38. Marsh E, Sale D, Mcomas AJ, et al.: Influence of joint position on ankle dorsiflexion in humans. J. Appl. Physiol. Respir. Environ. Exerc. Physiol. 1981; 51: 160–167. Publisher Full Text

[39] 39. Kozinc Ž, Smajla D, Šarabon N: The rate of force development scaling factor: a review of underlying factors, assessment methods and potential for practical applications. Eur. J. Appl. Physiol. 2022; 122: 861–873. PubMed Abstract | Publisher Full Text

[40] 40. Freire B, Dias CP, Oliveira LS, et al.: Rate of force development and torque production assessment in spastic stroke survivors. Revista Brasileira de Cineantropometria e Desempenho Humano. 2015; 17: 328. Publisher Full Text

[41] 41. Suetta C, Aagaard P, Rosted A, et al.: Training-induced changes in muscle CSA, muscle strength, EMG, and rate of force development in elderly subjects after long-term unilateral disuse. J. Appl. Physiol. 2004; 97: 1954–1961. PubMed Abstract | Publisher Full Text

Reliability of ankle dorsiflexor muscle strength, rate of force development, and tibialis anterior electromyography after stroke

Abstract

Background

Method

Results

Conclusion

Keywords

Revised Amendments from Version 1

Introduction

Methods

Study design

Setting

Participants

Measurement outcomes

Measurement procedures

Data processing

Statistical analysis

Results

Participants

Reliability analysis

Table 1. Reliability of all outcomes between test 1 and test 2.

Discussion

Strengths and limitations

Conclusions

Ethical considerations

Data availability

References

Comments on this article Comments (0)

Open Peer Review

Comments on this article Comments (0)

Open Peer Review

Reviewer Status

Reviewer Reports

Comments on this article

Browse by related subjects

Competing Interests Policy

Stay Updated