ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Research Article

Comparison of image quality between Deep learning image reconstruction and Iterative reconstruction technique for CT Brain- a pilot study

[version 1; peer review: 5 approved]
PUBLISHED 26 Jun 2024
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Artificial Intelligence and Machine Learning gateway.

This article is included in the Manipal Academy of Higher Education gateway.

Abstract

Background

Non-contrast Computed Tomography (NCCT) plays a pivotal role in assessing central nervous system disorders and is a crucial diagnostic method. Iterative reconstruction (IR) methods have enhanced image quality (IQ) but may result in a blotchy appearance and decreased resolution for subtle contrasts. The deep-learning image reconstruction (DLIR) algorithm, which integrates a convolutional neural network (CNN) into the reconstruction process, generates high-quality images with minimal noise. Hence, the objective of this study was to assess the IQ of the Precise Image (DLIR) and the IR technique (iDose4) for the NCCT brain.

Methods

This is a prospective study. Thirty patients who underwent NCCT brain were included. The images were reconstructed using DLIR-standard and iDose4. Qualitative IQ analysis parameters, such as overall image quality (OQ), subjective image noise (SIN), and artifacts, were measured. Quantitative IQ analysis parameters such as Computed Tomography (CT) attenuation (HU), image noise (IN), posterior fossa index (PFI), signal-to-noise ratio (SNR), and contrast-to-noise ratio (CNR) in the basal ganglia (BG) and centrum-semiovale (CSO) were measured. Paired t-tests were performed for qualitative and quantitative IQ analyses between the iDose4 and DLIR-standard. Kappa statistics were used to assess inter-observer agreement for qualitative analysis.

Results

Quantitative IQ analysis showed significant differences (p<0.05) in IN, SNR, and CNR between the iDose4 and DLIR-standard at the BG and CSO levels. IN was reduced (41.8-47.6%), SNR (65-82%), and CNR (68-78.8%) were increased with DLIR-standard. PFI was reduced (27.08%) the DLIR-standard. Qualitative IQ analysis showed significant differences (p<0.05) in OQ, SIN, and artifacts between the DLIR standard and iDose4. The DLIR standard showed higher qualitative IQ scores than the iDose4.

Conclusion

DLIR standard yielded superior quantitative and qualitative IQ compared to the IR technique (iDose4). The DLIR-standard significantly reduced the IN and artifacts compared to iDose4 in the NCCT brain.

Keywords

Deep learning image reconstruction, iDose4, Image quality, Filtered back projection, CT Brain

Introduction

Computed tomography (CT) is the primary imaging modality used to evaluate patients suspected to have central nervous system disorders. The ability to visualize brain regions quickly and thoroughly is one of their main advantages. This helps in the timely assessment of problems, including stroke, trauma, and intracranial lesions. Non-contrast CT (NCCT) brain scans are widely used in a variety of therapeutic contexts because of their accessibility, speed, and efficacy, which are vital for the early diagnosis and treatment of neurological diseases.13

One notable development in CT reconstruction technology is the use of iterative reconstruction (IR) techniques. iDose4 is a 4th generation IR method released by Philips Healthcare that offers improved image quality (IQ) with a reduced radiation dose. IQ and diagnostic precision are improved through IR, which uses sophisticated mathematical techniques to optimize and refine image data. A significant reduction in image noise (IN) allows for clearer visualization of anatomical structures, especially in regions of low contrast, which is the main advantage of the IR technique. IR allows the acquisition of high-quality images with a decreased radiation dose (RD) for patients. For vulnerable groups such as children or those who are radiation-sensitive, this is especially important.4,5 The IR technique results in a plastic or blotchy appearance at higher reconstruction levels.68

Deep learning image reconstruction (DLIR) algorithms represent a transformative leap in image reconstruction and dose reduction in CT. DLIR in Philips Healthcare is called a Precise Image (PI). Philips PI is the latest and most reliable way to reconstruct high-quality CT images using artificial intelligence (AI) techniques. A trained deep learning neural network was used in the PI reconstruction process. With the fastest reconstruction speed in the market, PI preserves the traditional view of FBP photos.9 By harnessing the capabilities of artificial intelligence (AI), particularly convolutional neural networks (CNNs), these algorithms revolutionize image reconstruction by learning intricate patterns from raw CT data. These algorithms learn complex relationships between sparse or noisy input projections and corresponding standard-dose reference images, enabling the generation of clinically acceptable reconstructions even when using a reduced radiation dose. By leveraging the inherent information within the data and learning intricate patterns, DLIR contributes to the advancement of dose reduction strategies in CT. The DLIR technique yields an image texture reminiscent of FBP, even at low-dose strengths.1012 There are limited studies on the usefulness of DLIR on IQ in the NCCT brain. Hence, the aim of this study was to compare the IQ between the new Precise Image (DLIR) and IR (iDose4) techniques for the NCCT Brain.

Methods

This is a prospective study. The Institutional Ethical Committee (IEC 400/2022) was obtained from Kasturba Medical College and Hospital, Manipal, India, on 1st July 1, 2023, followed by the Clinical Trial Registry - India (CTRI) registration (CTRI/2023/07/055310) on 18th July 2023. Written informed consent was obtained from all the participants for publication and participation in the study.

Eligibility criteria: Thirty patients referred for the NCCT brain were included. Patients referred to the NCCT brain for various clinical indications such as trauma, seizures, stroke, headache, vomiting, fever, chills, and breast carcinoma were included. Patients who were uncooperative and who underwent CT scans with motion artifacts were excluded. The patients included in the study had neuropathological findings on CT, including hemorrhage (n=10), infarct (n=10), tumor (n = 5), VP shunt (n = 1), arachnoid cyst (n = 1), metastases with edema (n=1), cerebral atrophy (n=1), and encephalomalacia (n=1).

CT Image acquisition: This study was performed at the Department of Radiodiagnosis, Kasturba Medical College and Hospital. Patients referred for NCCT brain examinations underwent 128 slice CT (Incisive, Philips Healthcare). The technical parameters for the NCCT brain acquisition are listed in Table 1. The images were reconstructed using iDose4 (level 3)4 and the DLIR reconstruction9 level standard.

Table 1. Showing the CT technical parameters for Non contrast CT Brain.

ParameterNCCT Brain
Tube voltage (kVp)120
Tube current × exposure time (mAs)290
Collimation (mm)32 × 0.625
Rotation time (sec)0.5
Slice thickness (mm)3
Pitch0.70
FOV (mm)250
Matrix size512 × 512

“Qualitative Image quality analysis”: Two radiologists [reader 1 (R1) and reader 2 (R2)] with over 15 years of experience in neuroradiology imaging evaluated the CT images. Both the readers were blinded to the reconstruction level. The readers assessed the “Overall image quality” (OQ), “Image noise” (IN), “Artifacts” using 5-point Likert scale (Figure 1).

ee8b6a0b-7e58-4680-8593-93092ea47bce_figure1.gif

Figure 1. Showing the 5-point Likert scale for qualitative image quality analysis.

“Quantitative Image quality analysis”: CT attenuation (HU) and image noise (IN) of gray matter (GM) and white matter (WM) at the level of the basal ganglia (BG) and centrum-semiovale (CSO) regions were measured. To calculate attenuation (HU) at the GM and WM of the BG, an ROI of 0.1-0.2 cm2 was placed in the thalamus and posterior limb of the internal capsule (PIC). For calculating attenuation at GM and WM of CSO, the ROI of 0.1-0.2 cm2 was placed in the region of frontal WM and adjacent cortical GM (Figure 2a-b).

ee8b6a0b-7e58-4680-8593-93092ea47bce_figure2.gif

Figure 2. Axial CT images (DLIR-standard) of 61-year old male at the level of centrum semiovale (a) and basal ganglia (b) showing region of interest (ROI) in gray matter and white matter. Axial CT image at the posterior cranial fossa (c) with ROI drawn in the pons region between the petrous bone.

The posterior fossa index (PFI) was calculated as the image noise (Standard deviation-SD) of the HU values in the pons. To calculate the PFI, an ROI of 0.2-0.3 cm2 was placed in the pons region of the posterior cranial fossa (Figure 2c).

The signal-to-noise ratio (SNR) at the BG and CSO levels was calculated as mean CT attenuation (HU)/standard deviation (SD) (SD: Image noise).

The contrast-to-noise ratio (CNR) at the BG and CSO levels was calculated using the following formula:

CNR=MeanHUGMMeanHUWM(SDGM)2+(SDWM)2

Radiation dose metrics such as “CTDIvolume (CTDIvol), dose length product (DLP), and size-specific dose estimate (SSDE)” were recorded from the display of the console monitor.

Statistical analysis

SPSS (IBM, V20.0) was used for statistical analysis. Paired t-tests were performed for qualitative and quantitative IQ analyses between the iDose4 and DLIR-standard. “Kappa (k) statistics” were used to check the interobserver agreement for qualitative analysis. The k-value was considered as follows: <0.20, poor agreement, 0.21-0.40 - Fair agreement, 0.41-0.60 - Moderate agreement, 0.61-0.80 - Good agreement, 0.81-1.00 - Excellent agreement”. Statistical significance was set at P < 0.05.

Results

A total of thirty patients with 22 males and 8 females with mean age of 55.46±15.38 years referred for NCCT brain were included (Table 2). The mean CTDIvol, DLP, and Size specific dose estimate (SSDE) were 46.36±0.20 mGy, 1157.5±64.23 mGy.cm and 44.10 mGy respectively.

Table 2. Showing the characteristics of population.

CharacteristicsMean ± SD
Age (years)55.46±15.38 years
Gender (%)
Males (n=22)73.3%
Females (n=8)26.6%

Qualitative IQ analysis

Qualitative IQ analysis showed an increase in scores for OQ, IN, and artifacts with DLIR-standard compared to iDose4 for both readers (Table 3) (Figure 3a-b).

Table 3. Showing qualitative image quality analysis between iDose4 and DLIR-standard.

IQiDose4DLIR-standardp-value
R1R2kR1R2k
OQ3.2±0.43.2±0.40.9024.2±0.494.13±0.430.821<0.05
IN3.03±0.413.03±0.411.004.16±0.464.23±0.530.837<0.05
Artifacts3.3±0.593.33±0.470.804.23±0.674.26±0.630.943<0.05
ee8b6a0b-7e58-4680-8593-93092ea47bce_figure3.gif

Figure 3. Axial CT images showing the improved image quality with (a) iDose4 compared to (b) DLIR-standard.

The OQ showed a significant difference (<0.05) between the iDose4 (3.2±0.4; R1) and DLIR-standard (4.2±0.49; R1). IN showed a significant difference (<0.05) between iDose4 (3.03±0.41; R1) and DLIR-standard (4.16±0.46; R1). Artifacts showed significant differences (<0.05) between iDose4 (3.3±0.59 R1) and DLIR-standard (4.23±0.67 R1) (Table 3).

Interobserver agreement

For OQ, the agreement between the readers was excellent for iDose4 (0.902) and the DLIR-standard (0.821). For IN, the agreement between readers was excellent for iDose4 (1.00) and the DLIR-Standard (0.837). For artifacts, the agreement between the readers was good for iDose4 (0.80) and excellent for the DLIR-Standard (0.943).

Quantitative IQ analysis

CT Attenuation (HU) at the BG and CSO levels did not show significant differences (<0.05) in the GM thalamus, WM PIC, adjacent cortical GM, and frontal WM between the iDose4 and DLIR-standard (Table 4). IN showed significant differences (<0.05) between iDose4 and DLIR-standard at the BG level (GM thalamus, WM PIC) and CSO level (adjacent cortical GM, frontal WM). IN showed 42.8% and 43.47% decreases in GM thalamus and WM PIC, respectively, with DLIR-standard compared to iDose4. IN showed 41.86% and 47.61% decrease in adjacent cortical GM and frontal WM, respectively, with DLIR-standard compared to iDose4. PFI showed significant difference (<0.05) between iDose4 and DLIR-standard with 27.08% IN reduction in the pons region with DLIR-standard compared to iDose4. SNR at BG and CSO levels showed significant differences (<0.05) for the GM thalamus, WM PIC, adjacent cortical GM, and frontal WM between the iDose4 and DLIR-standard. SNR showed 67.60% and 76.78% increases in GM thalamus and WM PIC, respectively, with DLIR-standard compared to iDose4. SNR showed 65% and 82.81% increases at adjacent cortical GM and frontal WM, respectively, with DLIR-standard compared to iDose4. CNR at BG and CSO levels showed significant differences (p < 0.05) in GM thalamus and WM PIC differentiation, adjacent cortical GM, and frontal WM differentiation between iDose4 and DLIR-standard. CNR showed 68% and 78.8% increases in BG and CSO, respectively, with DLIR-standard compared to iDose4.

Table 4. Comparison of quantitative image quality analysis between iDose4 and DLIR-standard.

Quantitative parameteriDose4DLIR-standardp-value
Attenuation (CT HU)
Basal ganglia level
GM Thalamus33.43±1.9033.41±1.72>0.05
WM PIC25.04±2.0425.07±1.98>0.05
Centrum semioval level
Adjacent cortical GM33.26±1.9333.25±1.65>0.05
Frontal WM25.8±2.2025.7±2.01>0.05
Image noise (IN) HU
Basal ganglia level
GM Thalamus4.9±1.062.8±0.61<0.05
WM PIC4.6±0.932.6±0.54<0.05
Centrum semiovale level
Adjacent cortical GM4.3±0.942.5±0.46<0.05
Frontal WM4.2±0.962.2±0.40<0.05
Posterior fossa index5.2±1.413.74±1.07<0.05
SNR
Basal ganglia level
GM Thalamus7.1±2.1211.9±2.18<0.05
WM PIC5.6±1.229.9±2.04<0.05
Centrum semiovale level
Adjacent cortical GM8.1±2.2213.3±2.24<0.05
Frontal WM6.4±2.111.7±2.5<0.05
CNR
Basal ganglia level
GM thalamus-WM PLIC1.25±0.402.1±0.58<0.05
Centrum semiovale level
Adjacent cortical GM-Frontal WM1.23±0.602.2±0.92<0.05

Discussion

In the present study, we compared the qualitative and quantitative IQ between the DLIR-standard (Precise Image) and IR (iDose4) techniques for the NCCT brain. Our study noticed that both qualitative and quantitative IQ improved significantly with the DLIR-standard compared with the iDose4. The new DLIR technique, Precise Image, outperformed the IR technique (iDose4). Our study found that the DLIR standard showed a significant reduction in IN and an increase in SNR and CNR at BG and CSO levels. The DLIR-standard showed higher subjective IQ scores with excellent agreement between readers compared to the iDose4. The lower IN, higher SNR, and CNR might allow for lowering the radiation dose with the DLIR-standard compared to iDose4 for the NCCT brain.

Studies by Kim et al.13 and Alagic et al.14 showed 24-52% and 3.5-43% reduction in IN for NCCT brains with DLIR (True Fidelity; GE) reconstruction levels of low, medium, and high compared with ASIR-V (Adaptive statistical iterative reconstruction-Veo) at BG and CSO levels. DLIR-standard in the present showed a 41.8-47.6% reduction in IN at BG and CSO levels, which is similar to the results of Kim et al.13 and Alagic et al.14 Another Two studies by Oostveen et al.15 and Cozzi et al.16 reported a 9.6% and 13% reduction in IN for NCCT brains with DLIR (AiCE) compared with “hybrid-iterative reconstruction (Hybrid-IR)” and “model-based iterative reconstruction” (MBIR), “Adaptive iterative dose reduction” (AIDR-3D), which is slightly less IN reduction compared to our study. The slight variation in the reduction of IN across CT vendors might suggest the need for further research comparing different reconstruction algorithms.

For the NCCT brain, diagnostic evaluation of the posterior fossa in emergency situations to identify hemorrhagic and ischemic events is important. However, the posterior cranial fossa often experiences beam hardening, streak, and partial volume artifacts due to the presence of bony structures surrounding the cerebellum, pons, and medulla, which leads to diagnostic challenges in identifying hemorrhage and infarct in this region. The artifact index could indicate the extent of CT number fluctuations resulting from artifacts, along with intrinsic image noise linked to factors related to both the scanner and the patient.17,18 Our study noticed a 27.08% reduction in IN and artifact index in the pons region of the posterior fossa with DLIR-standard compared to iDose4 which was similar to the artifact index reported by Kim et al.13 (17-38%) and Alagic et al.14 (6.8-32.8%). However, Cozzi et al.16 reported a higher artifact index (median 8.4; interquartile range 7.3-9.2) with DLIR (AiCE) than with AIDR-3D (median 7.5; interquartile range 6.9-8.3) in thin sections, which is contrary to the study reported by Oostveen et al.15 with the same DLIR technique. The reason for this could be the difference in the placement of the ROI and slice thickness used between the two studies.

Our study observed higher SNR (65-82%) at BG and CSO levels with DLIR-standard, which suggests better gray and white matter differentiation compared to iDose4. The findings of our study were similar to the results of Alagic et al.14 (2-89%) with DLIR-low, medium, and high levels, and Pula et al.19 (46-59%) with DLIR-High compared to IR techniques. A study by Oostveen et al.15 reported a slightly lower reduction in SNR (5-26%) compared to our study because of the difference in the formula used for calculating the SNR. Our study observed an increase in CNR (68-78.8%) with DLIR-standard at BG and CSO levels, which suggested better gray and white matter differentiation compared to iDose4. The results of our study were similar to the findings reported by Alagic et al.14 (2.4-53%) and Cozzi et al.16 (28-39%). However, Kim et al.13 reported an increase in CNR of 99% with DLIR-high DLIR.

Our study found no significant difference (p>0.05) in CT attenuation (HU) between DLIR-standard and iDose4 at the BG and CSO levels. The findings of our study are similar to the results of Kim et al.13 which showed no significant difference in CT attenuation of GM between DLIR levels and IR technique. However, a study by Alagic et al.14 reported significant differences in CT attenuation between DLIR levels and IR technique at the PLIC WM and adjacent cortical GM, which might suggest that DLIR could lead to minor changes in attenuation values; however, this finding is unlikely to have significant clinical consequences.

The DLIR-standard showed higher qualitative scores for OQ, IN, and artifacts compared to iDose4 which is similar to the findings reported by Oostveen et al.15 and Pula et al.19 Studies by Kim et al.13 and Alagic et al.14 reported an increase in qualitative scores with an increase in the strengths of DLIR from low to high compared to IR techniques.

Our study has a few limitations. First, the study involved a small sample size, and it is necessary to conduct further research with a larger patient cohort to confirm our study findings. Second, the study did not directly evaluate the diagnostic efficacy, which is a crucial step in understanding the complete clinical advantages of DLIR. Third, CT scanning was performed using a standard dose protocol, making it challenging to directly ascertain the potential dose-reduction benefits of DLIR.

Conclusion

The New DLIR Precise Image (DLIR) technique offers improved image quality with reduced image noise and higher SNR and CNR than iDose4. The DLIR standard also showed higher qualitative image quality scores than the iDose4. The reduction of posterior fossa artifacts with the DLIR standard for the NCCT brain improves the diagnostic accuracy of identifying hemorrhages/infarcts in emergency cases. Our current study may provide implications for performing low-dose scans with reduced radiation doses using DLIR in the NCCT brain.

Ethics and consent

The Institutional Ethical Committee (IEC 400/2022) was obtained from Kasturba Medical College and Hospital, Manipal, India, on 1st July 1, 2023.

Written informed consent was obtained from all the participants for publication and participation in the study.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 26 Jun 2024
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Chandran M O, Pendem S, P S P et al. Comparison of image quality between Deep learning image reconstruction and Iterative reconstruction technique for CT Brain- a pilot study [version 1; peer review: 5 approved]. F1000Research 2024, 13:691 (https://doi.org/10.12688/f1000research.150773.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 26 Jun 2024
Views
12
Cite
Reviewer Report 11 Jul 2024
Mustapha Barde, Bayero University, Kano, Kano, Nigeria 
Approved
VIEWS 12
The article revealed the effectiveness of deep learning iterative image reconstruction (DLIR) as compared to iDose4 (iterative reconstruction) in terms of qualitative and quantitative image quality (IQ) in non-contrast brain CT studies. DLIR presented better signal-to-noise ratio, contrast to noise ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Barde M. Reviewer Report For: Comparison of image quality between Deep learning image reconstruction and Iterative reconstruction technique for CT Brain- a pilot study [version 1; peer review: 5 approved]. F1000Research 2024, 13:691 (https://doi.org/10.5256/f1000research.165371.r296712)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
7
Cite
Reviewer Report 03 Jul 2024
Shashi Kumar Shetty, NITTE university, Karnataka, India 
Approved
VIEWS 7
Please find the comments for the article
 Major comments
Introduction: Well-structured. It explained the current reconstruction techniques of CT available in the market and the disadvantages of iDose4. Deep learning-based reconstruction techniques are currently being validated for various applications ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Shetty SK. Reviewer Report For: Comparison of image quality between Deep learning image reconstruction and Iterative reconstruction technique for CT Brain- a pilot study [version 1; peer review: 5 approved]. F1000Research 2024, 13:691 (https://doi.org/10.5256/f1000research.165371.r296706)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
18
Cite
Reviewer Report 03 Jul 2024
Dr. Tamijeselvan S, College of MRIT, Mother Teresa Postgraduate and Research institute of Health sciences, Indira Nagar, Puducherry, India 
Approved
VIEWS 18
In this article the author(s) compared the image quality obtained by 2 reconstruction methods namely DLIR standard and IR technique (iDose4). The findings revealed that DLIR-standard gives the better quality image by reducing the image noise and artifacts compared to ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
S DT. Reviewer Report For: Comparison of image quality between Deep learning image reconstruction and Iterative reconstruction technique for CT Brain- a pilot study [version 1; peer review: 5 approved]. F1000Research 2024, 13:691 (https://doi.org/10.5256/f1000research.165371.r296708)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
8
Cite
Reviewer Report 02 Jul 2024
Jerald Paul Immanuel, Fatima College of Health Sciences, Al Ain, United Arab Emirates 
Approved
VIEWS 8
Major Comments:
This is an interesting study dealing with CT image quality using DLIR and iDose4 for non-contrast CT brain. The study concludes that DLIR showed higher qualitative scores and reduced image noise (41.8-47.6%) with higher SNR (65-82%) and ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Immanuel JP. Reviewer Report For: Comparison of image quality between Deep learning image reconstruction and Iterative reconstruction technique for CT Brain- a pilot study [version 1; peer review: 5 approved]. F1000Research 2024, 13:691 (https://doi.org/10.5256/f1000research.165371.r296703)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.
Views
10
Cite
Reviewer Report 01 Jul 2024
SENTHIL MANIKANDAN, Assistant professor, Department of Radiation Physics, Kidwai Memorial Institute of Oncology, Bangalore, India 
Approved
VIEWS 10
In recent years, significant advancements have been made in CT image reconstruction technology, particularly with the introduction of deep learning-based image reconstruction (DLIR) algorithms. One notable development is the "Precise Image" by Philips Healthcare, which aims to reduce image noise ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
MANIKANDAN S. Reviewer Report For: Comparison of image quality between Deep learning image reconstruction and Iterative reconstruction technique for CT Brain- a pilot study [version 1; peer review: 5 approved]. F1000Research 2024, 13:691 (https://doi.org/10.5256/f1000research.165371.r296709)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 26 Jun 2024
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.