ALL Metrics
-
Views
-
Downloads
Get PDF
Get XML
Cite
Export
Track
Study Protocol

Comparative analysis and assessment of radiological investigation reports for abdomen and pelvic computed tomography scans

[version 1; peer review: 1 approved with reservations]
PUBLISHED 11 Sep 2023
Author details Author details
OPEN PEER REVIEW
REVIEWER STATUS

This article is included in the Datta Meghe Institute of Higher Education and Research collection.

Abstract

Background: Medical imaging modalities have significantly improved the accuracy and timeliness of diagnoses over the years; they also present a risk of diagnostic errors due to various factors. One of the primary issues is the variation in findings between preliminary and final reports, specifically for current imaging technologies such as magnetic resonance imaging, and computed tomography (CT) among others. Although several studies have investigated variations between preliminary and final reports in different contexts, research specific to the radiology department is limited.
Through this study protocol, we aim not only to help provide a comprehensive evaluation of the variation in findings between preliminary and final diagnostic reports in radiology but also aid in improving the accuracy and quality of patient care and contribute to developing effective strategies to minimize diagnostic errors.
Methods: A total of 128 male and female patients presenting to the radiology diagnosis department for abdomen and pelvic CT scans would be considered for the study. The radiological investigation reports for the scans would be interpreted by junior residents and radiologists. The reports will be manually compared to check for similarities, new findings, and exclusions. The degree and frequency of variability will be statistically assessed and reported in tabulations and graphs under the patient's age and gender.
Discussion: This study seeks to investigate the differences in interpretations between resident and radiologist reports, consistent with previous research. The results of this study will provide insights into the variations in interpretations, highlighting the importance of continuous training. Examining the findings of a report as a whole can also deliver valuable knowledge into the potential impact on patient care. This can lead to enhancements in radiology reports and overall patient management. The implications involve improving the education of residents, optimising clinical decision-making processes, and promoting positive patient outcomes.

Keywords

radiology reports, abdo-pelvic CT scans, variations, reporting, resident, radiodiagnosis, provisional report, final report

Introduction

In recent years, diagnostic imaging investigations have advanced and been amplified. It has spurred the necessity for thorough, accurate reporting. Well-crafted reports reflect the judgement of the radiologists serving as a standard of reference for radiology trainees, thus acting as a channel of communication with physicians, guiding the decision-making, management, and long-term follow-up. Also, it works as a legal document when malpractice is asserted.1

The reporting services provided by many radio-diagnostic imaging facilities of large hospitals have progressed so much over the years that the facilities can provide quick support to the attending residents in order to produce reports promptly. Contrarily, this rapidity of report generation has also increased the likelihood of variations between the preliminary and final attending reports, as reflected in numerous studies; however, there is a dearth of research about it, specific to the radiology department and its practices.25 Radiology residents at healthcare facilities routinely provide preliminary imaging study interpretations within hours, and their skill and accuracy are vital to the treatment of patients.6 Therefore, all radiologists must seek to acquire, improve, and update the skills needed to generate optimal reports from the very outset of their training. Towards this goal, a radiologist’s formative training or residency years should incorporate a method to generate an adequate report.7

Quantifying the frequency and types of variations in the standard, abnormal, additional findings and interpretations between the junior residents’ and the radiologists practising in the same hospital system can be a valuable tool for directing general education and systematic quality improvement. This topic has been the subject of numerous past research but was often limited to particular or short periods.25 Thus, an attempt has been made in this study to examine provisional and final computed tomography (CT) scan reports of the abdo-pelvic region prepared by junior residents in radiology and radiologists to prepare a study protocol.8 The reports have been collected and analysed for a comprehensive study. Findings and variances have been assessed in provisional and final reports based on the examinations performed and their interpretations.9

To identify appropriate indicators of resident performance effectiveness and competence that are equally consistent with patient care, reading the provisional and finalized report findings can serve as a potential criterion for finding better interpretation possibilities and eliminating contradictions. Additionally, it can serve as a valuable source of research to demonstrate and strengthen the fact that radiology residents’ reporting is genuinely on par with the radiologists’, contributing to residents’ credibility and elevating their overall self-confidence in reporting.

Protocol

Ethical statement

The Institutional Ethics Committee at Datta Meghe Institute of Higher Education and Research (Deemed to be University), Nagpur, approved the study (Date: 02/02/2023, Ref.No. DMIHER (DU)/IEC/2023/589). Written informed consent will be requested from all patients having C.T. scans of the abdomen and pelvis.

Study design and participants

The study is a prospective observational study.

The duration of the study will extend from October 1st, 2022, to October 1st, 2024, covering a period of 24 months. During this time period, data will be gathered from several residents and radiologists, who are actively engaged in the process of generating preliminary and final reports. Every month, a total of three residents and two radiologists will contribute to the reports, guaranteeing a wide variety of interpretations.

The selection criteria for the reports will encompass individuals of both genders, aged 18 years and older, with a specific emphasis on radiological examinations conducted within the abdominal and pelvic regions.

Participants must meet the following criteria in order to be included:

  • Patients who came to seek treatment at the Acharya Vinoba Bhave Rural Hospital, Datta Meghe Institute of Higher Education & Research, Sawangi Meghe, Wardha, radio-diagnosis department for abdo-pelvic CT examinations.

  • A single anatomical region at a time examination.

  • Patients requiring follow-up examinations.

  • Patients aged 18 years old or above.

Participants meeting the following criteria will be excluded:

  • Patients who do not wish to participate.

  • Patients aged below 18 years old.

  • Repeat imaging procedure examinations.

  • Multi-region examinations.

Rationale

The purpose of this study is multi-pronged. It will assess the findings and variations between preliminary and final attending reports. Also, it will assist in determining precise performance standards for radiology residents. Together these findings will help leverage the patient care paradigm.

Aim

To assess and analyse the findings in provisional and final radiology reports by the junior resident and radiologist for abdo-pelvic CT scan examinations.

Objectives

  • To identify the findings by junior radiology resident interpretations of diverse diagnostic imaging investigations for the abdo-pelvic region.

  • To identify the findings by senior radiologist interpretations of diverse diagnostic imaging investigations for the abdo-pelvic region.

  • To identify the variations between interpretations made by junior residents and radiologists for diverse diagnostic imaging investigations of the abdo-pelvic region.

Research question

Is there any significant difference between the findings in provisional and final abdo-pelvic CT scan reports, and can they be used to determine the precise performance standards for radiology residents?

Sample size

A total of 128 male and female participants will be included in this study presenting to the radio-diagnosis department for abdo-pelvic CT scans.

Sampling procedure and formula used

The following formula will be used to determine the sample:

n=Zα+Zβ2p11p1+p21p2p1p22

Where n = desired sample size

Zα = 1.96 (95% confidence level)

Zβ = 0.84 (statistical power of 80%)

p1 = 26.5 % = 0.265 (proportion of outcome in an exposed group)

p2 = 12.8 % = 0.128 (proportion of outcome in an unexposed group)

n=1.96+0.8420.26510.265+0.12810.1280.2650.1282=127.98=128

This study, referencing Harari et al., utilizes the Chi-Square test and Kappa test as statistical methods, with data analysis performed using SPSS version 27.0 software.10

Methods

Initially, the reports will be reviewed for findings such as under-reading, fulfilment of search, flawed reasoning, irregularities outside the scope of interest, fulfilment of report, neglecting to refer to prior imaging studies, inaccurate or insufficient clinical history, report not reaching referring clinician accurately, flawed measurements and so on during the two-year research period to assess their clinical impact on the hospital system and patient care.

Secondly, the database will encompass a total of 128 abdo-pelvic CT imaging studies that were first evaluated by a junior resident and then reviewed by the radiologist.

Under the supervision of an experienced senior radiologist, a comparison of the preliminary reports by the resident and the final reports by the attending radiologist will then be conducted. Finally, patterns of “similar,” “additional,” and “not carried forward” findings will be noted and tabulations, graphs will be used to quantify the degree and frequency of variation between the two report interpretations. Utilizing a standardized proforma considering the age and sex of the patient, a thorough investigation of the radiological reports for abdominal and pelvic CT scans will be done.11 This method of approach seeks to help document and evaluate the factors contributing to the variations between preliminary and final reports.

Outcomes

The principal objectives to be assessed in this investigation involve the divergences noted in radiology observations among trainees, with a specific emphasis on the disparities between the initial assessments conducted by residents and the ultimate evaluations conducted by attending radiologists. The study aims to precisely quantify and meticulously analyse these intriguing variations in order to thoroughly comprehend their frequency and ascertain their potential impact on the provision of optimal patient care.

Regarding secondary outcomes, the study seeks to assess the impact of these variations on patients and examine educational opportunities for residents. Furthermore, this investigation aims to augment the assurance and reporting proficiencies of residents, ultimately resulting in enhanced patient care. The results are anticipated to make a significant contribution to the overall enhancement of radiology services rendered to patients, potentially leading to advancements in diagnosis and treatment planning.

Data analysis

Statistical investigations will be performed using IBM SPSS Statistics software version 27.0, with a significance level of 0.05. Statistical methods employed for analysing the data will be Chi-square and Kappa tests. Descriptive analysis will be performed to identify variations in reporting. Independent sample tests would also be performed to look for differences between provisional and final radiology reports.

Dissemination

The study’s findings will be disseminated through scientific conferences and published in peer reviewed indexed journals.

Study status

The study is ongoing. It is expected to complete before October 2024.

Discussion

Radiology reports serve an essential role in medical diagnosis and treatment; therefore, the consistency and quality of these reports are vital in guiding clinical decision-making and providing optimal patient care. The variation rates in radiological reports have been the subject of numerous studies, with various degrees of success. According to a study by Ruutiainen et al. (2011), there were differences in the rates of key findings in reports depending on the residents themselves, the modalities they used, and their training levels.4 Mellnick et al. (2016), on the other hand, discovered a reasonably low incidence of variance for radiology residents interpreting examinations after hours, with a very low rate of critical variations.12 According to a 2016 study by Harari et al., 31% of reports were confirmed as unaltered, with no appreciable differences between junior and senior residents.10 However, according to an earlier study by Cooper et al. (2008), a slight increase in accuracy was noticed as the resident year progressed.13 However, Dinh et al. (2020) suggested that despite advancements in technology and training, variances can still happen.14 In relation to our research, these studies offer insightful information about the variables, such as resident training level, modality, and reporting quality, that affect variability in radiology reports. They highlight the significance of quality assurance processes, training opportunities, and adopting benchmark criteria for variation rates and response times to ensure high-quality patient care. Despite advancements in technology and training, variations can persist; thus, it is essential to inquire into their potential causes and find efficient strategies to mitigate them, providing patients with the best possible care.15

Conclusions

In conclusion, reviewing and analyzing the results of abdominopelvic CT scans for patients of different age groups and genders is a viable way to assess the clinical outcomes and can serve as a roadmap for educational and training programs for residents. The results of this study will help emphasize how crucial precise and accurate reporting is in medical practice. Furthermore, this kind of research encourages residents’ confidence in their reporting skills, resulting in high-quality patient care. Overall, this research holds significant implications for improving patient care and the profession of medical imaging.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 11 Sep 2023
Comment
Author details Author details
Competing interests
Grant information
Copyright
Download
 
Export To
metrics
Views Downloads
F1000Research - -
PubMed Central
Data from PMC are received and updated monthly.
- -
Citations
CITE
how to cite this article
Naik S, Mishra GV, Tiwaskar S and Luharia A. Comparative analysis and assessment of radiological investigation reports for abdomen and pelvic computed tomography scans [version 1; peer review: 1 approved with reservations]. F1000Research 2023, 12:1135 (https://doi.org/10.12688/f1000research.138957.1)
NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.
track
receive updates on this article
Track an article to receive email alerts on any updates to this article.

Open Peer Review

Current Reviewer Status: ?
Key to Reviewer Statuses VIEW
ApprovedThe paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approvedFundamental flaws in the paper seriously undermine the findings and conclusions
Version 1
VERSION 1
PUBLISHED 11 Sep 2023
Views
6
Cite
Reviewer Report 25 Sep 2023
Simin Mouodi, Babol University of Medical Science, Babol, Iran 
Approved with Reservations
VIEWS 6
This study protocol aims to compare similarities, new findings, and exclusions between preliminary and final reports for abdomen and pelvic CT-scans. In recent years, some studies assessed different factors impacting abdominal and pelvic CT exam reporting. Multicenter study will increase ... Continue reading
CITE
CITE
HOW TO CITE THIS REPORT
Mouodi S. Reviewer Report For: Comparative analysis and assessment of radiological investigation reports for abdomen and pelvic computed tomography scans [version 1; peer review: 1 approved with reservations]. F1000Research 2023, 12:1135 (https://doi.org/10.5256/f1000research.152194.r208022)
NOTE: it is important to ensure the information in square brackets after the title is included in all citations of this article.

Comments on this article Comments (0)

Version 1
VERSION 1 PUBLISHED 11 Sep 2023
Comment
Alongside their report, reviewers assign a status to the article:
Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested
Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.
Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions
Sign In
If you've forgotten your password, please enter your email address below and we'll send you instructions on how to reset your password.

The email address should be the one you originally registered with F1000.

Email address not valid, please try again

You registered with F1000 via Google, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Google account password, please click here.

You registered with F1000 via Facebook, so we cannot reset your password.

To sign in, please click here.

If you still need help with your Facebook account password, please click here.

Code not correct, please try again
Email us for further assistance.
Server error, please try again.