Closing the communication gap in neonatal inter-hospital transfer: a neonatal referral form for resource-limited settings - a modified e-Delphi-consensus study

Oscar Mwizerwa; Christian Umuhoza; Mark H. Corden; Tom Lissauer; Peter Thomas Cartledge

doi:10.12688/f1000research.50980.2

Home Browse Closing the communication gap in neonatal inter-hospital transfer:...

ALL Metrics

Views

Downloads

Get PDF

Get XML

Export

▬

✚

Research Article

Revised

Closing the communication gap in neonatal inter-hospital transfer: a neonatal referral form for resource-limited settings - a modified e-Delphi-consensus study

[version 2; peer review: 2 approved]

Oscar Mwizerwa^1,2, Christian Umuhoza^1,2, Mark H. Corden^3,4, Tom Lissauer^5,6, Peter Thomas Cartledge ^2,3,7,8

Oscar Mwizerwa^1,2, Christian Umuhoza^1,2, [...] Mark H. Corden^3,4, Tom Lissauer^5,6, Peter Thomas Cartledge ^2,3,7,8

PUBLISHED 07 Jun 2022

Author details Author details

¹ Department of Pediatrics and Child Health, University of Rwanda, Kigali, Rwanda
² Department of Pediatrics, University Teaching Hospital of Kigali, Kigali, Rwanda
³ Rwanda Human Resources for Health (HRH) Programme, Ministry of Health, Kigali, Rwanda
⁴ Division of Hospital Medicine, Department of Pediatrics, Children’s Hospital Los Angeles, Los Angeles, California, USA
⁵ Department of Neonatology, Imperial College Healthcare Trust, London, UK
⁶ Royal College of Paediatrics and Child Health (RCPCH UK), Kigali, Rwanda
⁷ Department of Pediatrics, Yale University, New Haven, Connecticut, USA
⁸ Centre for Paediatrics and Child Health, Imperial College London, London, UK

Oscar Mwizerwa
Roles: Conceptualization, Data Curation, Formal Analysis, Investigation, Methodology, Project Administration, Validation, Writing – Original Draft Preparation, Writing – Review & Editing

Christian Umuhoza
Roles: Conceptualization, Methodology, Writing – Original Draft Preparation, Writing – Review & Editing

Mark H. Corden
Roles: Formal Analysis, Validation, Writing – Original Draft Preparation, Writing – Review & Editing

Tom Lissauer
Roles: Conceptualization

Peter Thomas Cartledge
Roles: Conceptualization, Data Curation, Formal Analysis, Investigation, Methodology, Supervision, Validation, Writing – Original Draft Preparation, Writing – Review & Editing

OPEN PEER REVIEW

REVIEWER STATUS

Abstract

Background: Standardised neonatal referral forms (NRFs) facilitate effective communication between healthcare providers and ensure continuity of care between facilities, which are essential for patient safety. We sought to determine the essential data items, or core clinical information (CCI), that should be conveyed for neonatal inter-hospital transfer in resource-limited settings (Rounds 1 to 3) and to create an NRF suitable for our setting (Round 4).

Methods: We conducted an international, four-round, modified Delphi-consensus study. Round-1 was a literature and internet search to identify existing NRFs. In Round-2 and -3, participants were Rwandan clinicians and international paediatric healthcare practitioners who had worked in Rwanda in the five years before the study. These participants evaluated the draft items and proposed additional items to be included in an NRF. Round-4 focused on creating the NRF and used five focus groups of Rwandan general practitioners at district hospitals.

Results: We identified 16 pre-existing NRFs containing 125 individual items. Of these, 91 items met the pre-defined consensus criteria for inclusion in Round-2. Only 33 items were present in more than 50% of the 16 NRFs, confirming the need for this consensus study. In Round-2, participants proposed 12 new items, six of which met the pre-defined consensus criteria. In Round-3, participants scored items for importance, and 57 items met the final consensus criteria. In Round-4, 29 general practitioners took part in five focus groups; a total of 16 modifications were utilised to finalise the NRF.

Conclusions: We generated a novel, robust, NRF that may be readily employed in resource-limited settings to communicate the essential clinical information to accompany a neonate requiring inter-hospital transfer.

Keywords

Infant, Newborn, Referral and consultation, Patient transfer, Communication, Developing countries, Rwanda

Corresponding author: Peter Thomas Cartledge

Competing interests: No competing interests were disclosed.

Grant information: The author(s) declared that no grants were involved in supporting this work.

Copyright: © 2022 Mwizerwa O et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

How to cite: Mwizerwa O, Umuhoza C, Corden MH et al. Closing the communication gap in neonatal inter-hospital transfer: a neonatal referral form for resource-limited settings - a modified e-Delphi-consensus study [version 2; peer review: 2 approved]. F1000Research 2022, 10:365 (https://doi.org/10.12688/f1000research.50980.2) First published: 10 May 2021, 10:365 (https://doi.org/10.12688/f1000research.50980.1) Latest published: 07 Jun 2022, 10:365 (https://doi.org/10.12688/f1000research.50980.2)

Revised Amendments from Version 1

No additional data, code or data-analysis has been included in this updated version. Authorship has remained the same. With one change to the affiliation of Dr Lissauer.

In this version the authors have responded to the specific comments made by the peer-review team. In particular the “clinical implications” section has been adapted to reflect how the Neonatal Referral Form (NRF) has been employed in Rwanda since this Delphi-study was undertaken and submitted for publication. Additional text has been added to place the study in the context of Human Factors and patient safety initiatives.

See the authors' detailed response to the review by Peter Lachman

Introduction

Globally, neonatal mortality fell to 19 per 1000 live births in 2015 with the aim to reduce neonatal mortality to less than 12 per 1000 live births by 2030.¹ In Rwanda, the neonatal mortality rate has fallen from 37 to 19 per 1000 live births over 15 years (2005-2020).^2,3 The reason for this decline is multifactorial, but the centralisation of specialist care has contributed to an increase in the number of neonatal transfers between low-level units and more specialised hospitals. Healthcare systems should be redesigned to deliver care that is safe, effective and efficient, whilst meeting the multiple needs of patients, including neonates.⁴

Transport of neonates carries a range of risks, and adverse outcomes in up to 40% of transported neonates have been reported, with higher mortality associated with long-distance and duration of transport.^5–7

A specialised transport system for neonates can mitigate against these risks.⁸ In most resource-limited settings, such systems do not yet exist, and for many settings are currently out of reach.⁹ For example, in Rwanda, a general patient-referral transport system is in place, but specialised neonatal transfer is lacking.¹⁰ To optimise the transfer of care when transferring a newborn, it is paramount that the essential demographic and clinical information is shared between the referring and receiving sites. Many sick neonates in Rwanda are transferred to care facilities with inadequate clinical information to allow optimal care of the child. We questioned why health-professionals are not sharing this information adequately. Human factors are central to this and adapting the referral process was required.

Neonatal referral forms (NRFs) are standardised instruments that aid in ensuring high-quality handover of medical history, which include demographics, pre-transfer care, and, potentially, the transport course of the neonate.^11–19 The quality of the shared clinical information has the potential to improve the outcome for the neonate and also reduce the repetition of investigations and treatments, thus decreasing the cost to families and facilities.¹⁸ In the resource-limited setting, we identified that there is a lack of consensus about which clinical information should be communicated between hospital sites, and therefore included in a setting appropriate NRF.²⁰

Objectives

We sought to determine consensus on the essential data items (core clinical information, CCI) that should be conveyed for neonatal inter-hospital transfer in a resource-limited setting, and to create an NRF suitable for our setting. The aimed output was for an NRF suitable for “day-to-day” clinical use, in order to improve quality of care, rather than for future research data-collection.

Methods

Study design

We employed a four-round, modified Delphi technique to identify the CCI that would be essential to communicate during neonatal transfer. Reporting of the study is in accordance with the Sinha and Williamson checklists for creating a “Core Outcome Set” using Delphi techniques.^21,22 The Delphi methodology was chosen as a consensus tool as it allows large numbers of individuals across diverse locations and areas of expertise to be included anonymously, thus avoiding the domination of the consensus process by one or a few experts. It also can be undertaken remotely, removing the need for participants to travel. We modified the Delphi technique in two respects. In Rounds-1 to -3, we sought to meet the first objective of the study, namely to gain consensus on the CCI that should be conveyed for neonatal inter-hospital transfer in a resource-limited setting. In Round-4, we sought to meet the second objective to create an NRF suitable for our setting and employed focus-groups of clinicians who work in the setting to gain consensus.

Round-1

A comprehensive literature and internet search was undertaken to identify pre-existing NRFs and research articles describing NRFs and/or CCI required for inter-hospital transfer of a neonate in the resource-limited setting. In Round-1 we used a Medline/PubMed literature search (rather than participants) in order to help improve response rates in the subsequent rounds, as well as to provide an initial sound CCI set to participants.²³ The search strings included MeSH terms and synonyms for “neonates”, “transportation of patients,” and “resource-limited settings” (Supplementary Table 1, Extended data³⁶). We search for grey literature using both an internet search and using informal networking of contacts known to the authors, we then contacted local (Rwandan) healthcare facilities as well as experienced paediatricians in the region (Malawi, Uganda, and Kenya), by email, to identify any NRFs relevant to our setting, which were not published. We aimed for a minimum of 10 NRFs. Due to the low number of NRFs identified from resource-limited settings, the Medline/PubMed search was then repeated for NRFs, and articles containing NRFs, from outside of the resource-limited setting (Supplementary Table 1, Extended data³⁶), by removing the “developing countries” search string. The individual items found in each NRF were then coded by two authors (OM and PC). During the coding process, items were intentionally removed if they were judged not to be relevant to resource-limited settings where there is no dedicated transport team (e.g., therapeutic hypothermia). Consensus in this round was pre-defined as any item that was used in two or more of the identified NRFs. These items were then used to create the first draft of our CCI list in preparation for Rounds-2 and -3 of the Delphi process.

Selection of participants for Round-2 and -3

Participants from four groups of clinicians were eligible to be included: (i) Rwandan clinicians working in clinical paediatric practice, including all paediatric specialists and senior paediatric residents practicing in Rwanda, identified via the Rwanda paediatric email group; (ii) members of the Rwandan Neonatal Working Group (NWG) including paediatricians, public health specialists and policymakers, identified through the chair of the NWG; (iii) general practitioners (GPs; clinicians working in Rwandan district hospitals) identified through the NWG; (iv) non-Rwandan paediatricians with paediatric clinical experience in Rwanda through the Human Resources for Health (HRH) project identified from the Ministry of Health (MoH) database of HRH faculty.²⁴

Round-2 (open-ended questionnaire)

In Round-2, the draft CCI list from Round-1 was divided into eight themes/sections. Participants were informed about the process involved in gaining the first draft CCI in Round-1. Each section contained a list of the included items in the first draft of the CCI. The list of items was then presented to participants with an open question using a “free text” option at the end of each section.

Participants were presented with a scenario: “We want you to imagine that you are either transferring or receiving a sick neonate who is being transferred between facilities in a resource-limited setting (e.g. Rwanda).” They were then asked what additional clinical items they would add to that section/theme. Consensus was pre-defined as any additional item suggested independently by two or more participants; these were then added to the second draft CCI for Round-3. Non-participation in Round-2 did not exclude participation in Round-3, but no additional participants were invited to Round-3.

Round-3 (closed questions)

All items from the second draft of the CCI were listed in their themes/sections. Each item was presented with feedback from Round-1 in the form of the percentage of articles/NRFs that contained the item, or if it was a new addition from Round-2. After piloting the Round-3 Delphi questionnaire, several items that described similar clinical information were combined to minimise bias from questionnaire fatigue (e.g., stimulation, bag-mask ventilation, etc. were combined into “resuscitation”) (Table 1). The participants were provided with the same clinical scenario as in Round-2 and were then asked to rank the importance of each CCI item on a nine-point Likert scale. Consensus for inclusion in the final CCI was pre-defined as greater than 70% of participants scoring 7–9 (important) AND less than 15% of participants scoring 1-3 (not important) as per GRADE/COMET criteria.^25,26 Participants were informed of the pre-defined consensus to engage them in the process. Participants gave their year of birth and initials in Round-2 and -3 to assess attrition rate.

Table 1. Core clinical information items and domains for Rounds 1 to 3.

		Round-1		Round-2		Round-3
CCI domain/section	Total number of items described in at least 1 NRF	Number of items found only in 1 NRF	Number of items for first draft of CCI (described in at least ≥2 NRFs (included)	New items from participants meeting consensus	Items merged with items to minimise questionnaire fatigue	Total number of items presented in Round-3	Final number of items for the CCI list
Hospital details (Introduction)	16	6	10	0	1	9	8
Patient identification	13	4	9	2	0	11	8
Clinical history at referral	6	3	3	1	0	4	4
Maternal medical and antenatal history	17	4	13	6	0	19	9
Labor details	14	4	11	2	0	13	11
Neonatal past medical history	19	1	17	1	13	5	4
Management at the referring hospital	20	1	19	0	7	12	11
Miscellaneous	10	1	9	0	0	9	2
Totals	115	24	91	12	21	82	57

Round-2 and Round-3 data collection and analysis

The Round-2 and Round-3 questionnaires were hosted and completed using Google Forms^® and distributed to participants via email (see Extended data for Round-2 and Round-3 questionnaires³⁶). Participants were given two weeks to answer each questionnaire from Round-2 and Round-3 with email reminders sent after one week. We aimed for a minimum of 15 respondents in each round.²⁷ Google Forms^® provides data in a downloadable Microsoft Excel^® spreadsheet (V16 for Macintosh) which was used to code and describe statistics (i.e., median, mean, standard deviation, attrition rate) where appropriate.

Round-4 - creating the final NRF

Rounds 1-3 provided consensus from the participants on the CCI that should be conveyed for neonatal inter-hospital transfer in a resource-limited setting and met the first objective of the study. The second objective of the study sought to use this CCI list to create an NRF for clinical use. The CCI items were therefore employed to create a draft NRF. This draft NRF was produced on two pages to enable double-sided printing on a single sheet of A4 paper to keep costs low and facilitate use. The draft NRF was then reviewed at a face-to-face meeting of the Rwandan MoH Neonatal Technical Working Group (NTWG). At this point, amendments were made to the structure and format of the NRF. The members of the NTWG then agreed that a fourth round of the Delphi process was required to ensure that the NRF was ready to be utilised in the clinical setting.

Eligible participants for Round-4 (focus groups)

In Rwanda, and many similar settings, referrals between the district and regional/tertiary hospitals are usually made by General Practitioners (GPs). GPs are medically qualified doctors who have not undertaken specialist training. Eligible participants for the Round-4 focus groups, were, therefore, GPs who had referred neonates to regional and tertiary hospitals. Focus group participants were selected opportunistically as those GPs that were available, and consenting, at the hospital sites on the dates the Principle Investigator visited each of the five hospitals.

Focus groups

Focus groups were undertaken in a quiet room, with no patients or other professionals present. The participants were given hard paper copies of the NRF and an explanation of the purpose of the process and the objective of producing an NRF for clinical use in Rwanda. They were then asked to review the NRF and collectively make suggestions to improve and amend the NRF. No interview guide was used. Focus groups were undertaken in a mix of Kinyarwanda, English and French (official national languages of Rwanda). Recordings were not taken, with the Principal Investigator (OM) taking field notes.

Coding and analysis

Field notes were coded by two coders (OM and PC) using Microsoft Excel, and consensus identified if a code was introduced in two or more separate focus groups. These themes were used to amend the NRF further.

Approval

Finally, the NRF was re-reviewed by the MoH NTWG and the MoH National Health Referral System committee, with no further amendments to the content of the form made.

Ethics statement

Ethics approval

The study protocol was reviewed and approved by the University of Rwanda College of Medicine and Health Sciences Institutional Review Board (IRB) (Ref: 002/CMHS IRB/2018). There were no significant physical, emotional, social, financial or legal risks to participants identified.

Consent:

For Rounds-2 and -3 information regarding the study was provided to participants at the same time as the online google questionnaire and completion of the questionnaires implied informed consent of participation. For Round-4 verbal information was given to participants and participation was deemed as implied consent.

Confidentiality

The questionnaire was fully anonymised, and email invitations were sent individually to maintain confidentiality. Participant demographics and response data were obtained via Google forms^®, which is password-protected and accessed only by the principal investigator and both supervisors of this project.

Results

Round-1

We identified a total of 16 NRFs. Initial searches related to resource-limited settings identified two NRFs from Rwandan Provincial hospitals (Rwamagana and Ruhengeri). Fourteen NRFs were identified from upper-middle and high-income countries: eight from the United Kingdom, five from the United States and one from South Africa. These 16 NRFs contained a total of 125 individual items, of which ten items were immediately removed as being not relevant to the CCI in a resource-limited setting (e.g., therapeutic hypothermia). Ninety-one of the remaining 115 items (79%) met the pre-defined criteria for consensus to be included in the first draft of the CCI. These items were listed individually, grouped under eight relevant sections to aid interpretation by participants (Table 1). Each NRF contained a mean of 34 items (min = 11, max = 52). Only 33 of the 91 identified items (36%) were present in more than half of the 16 NRFs, confirming the need for this consensus study.

Response rate

124 participants were contacted. The response rate was 32 (25%) and 33 (27%) participants for Round-2 and Round-3, respectively. This response rate exceeded our desired sample size of 15, required for consensus, in each round. Eleven of the 32 (33%) participants from Round-2 also completed Round-3; thus, 22 of 33 (67%) participants in Round-3 were new responders. Participants in Round-2 and -3 had a mean of 14 years and 13 years of paediatric experience, respectively (Table 2).

Table 2. Baseline characteristics of participants of Round-2 and Round-3 of Delphi process.

		Round-2 (n=33)	Round-3 (n=34)
Age (years)	Mean (SD)	42.2 (±12.5)	40.9 (±10.7)
Level of expertise	General Pediatrician	11 (34%)	18 (55%)
	Senior Resident	13 (41%)	8 (24%)
	Pediatric subspecialist (non-neonatologist)	5 (16%)	3 (9%)
	Neonatologist	1 (3%)	3 (9%)
	Other	2 (6%)	1 (3%)
Location	East Africa	22 (69%)	20 (61%)
	USA	8 (25%)	12 (36%)
	Other	2 (6%)	1 (3%)
Primary institution	Referral Hospital	27 (84%)	23 (70%)
	District Hospital	2 (6%)	7 (21%)
	Others	3 (9%)	3 (9%)
Employment status	Full-time	25 (78%)	29 (88%)
	Part-time	4 (13%)	3 (9%)
	Retired	3 (9%)	1 (3%)
Country of medical degree	Rwanda	18 (56%)	16 (49%)
	USA	9 (28%)	11 (33%)
	Other	5 (15%)	6 (18%)
Experience post-graduation from medical school	Mean (SD)	14.1 (±13.1)	12.9 (±10.5)

Round-2

All sections/themes had additional items suggested by participants, with 20 participants suggesting new additions to the “Patient Identification” section. Fifty-two items were suggested that were already present in the Round-1 CCI and were therefore excluded. Thirty-three new items were suggested. Twelve (36%) of these were independently suggested by two or more participants and therefore met the pre-defined consensus criteria and were added to the existing 91 items from Round-1 to form the draft CCI list of 103 items for Round-3 (Table 1).

Piloting of the Delphi questionnaire between Round-2 and Round-3 revealed that 21 items could be merged with existing items (Figure 1). For example, in Round-2, seven different types of birth resuscitation were described (e.g., bag-valve-mask, stimulation, etc.); these were merged with the item of “resuscitation at birth.” This was to reduce questionnaire fatigue, which was reported by the piloting participants. Therefore, after merging these items, the list reduced from 103 to 82 items.

Figure 1. Delphi flow diagram.

MoH NTWG, Ministry of Health Neonatal Technical Working Group; NRF, neonatal referral form.

Round-3

The questionnaire was again divided into the same eight sections/domains, to form a second draft CCI list. Eighty-two items were presented individually for scoring of “importance” in Round-3 (Supplementary Table 2, Extended data³⁶). Of these, 57 items (70%) met the pre-defined consensus criteria to be included in the final CCI list (Supplementary Table 3, Extended data³⁶). Seven of the 12 items (58%) suggested in Round-2 met the inclusion criteria for the final CCI list. This list was then used to generate the first draft of the NRF (Supplementary File 3, Extended data³⁶).

Round-4 (focus groups)

The draft NRF was then reviewed at the Rwandan MoH Neonatal Technical Working Group (NTWG), and eight amendments were made (Supplementary Table 4, Extended data³⁶). Twenty-nine general practitioners then took part in five focus groups to review the NRF, with each focus group lasting between 60 and 90 minutes. The five focus groups were undertaken at three rural district hospitals [Gahini (n = 5), Nemba (n = 9) and Ruli (n = 4)] and two urban provincial (secondary) hospitals [Ruhengeri (n = 8), Rwamagana (n = 3)]. The focus-groups created a total of 37 new suggestions for modifying the NRF (Supplementary Table 4, Extended data³⁶). Nineteen of these suggestions were made in two or more of the focus groups. Sixteen of these changes were incorporated into the final NRF (Supplementary File 4, Extended data³⁶); three were not feasible, namely, creating a French version, adapting a version specific for health centres and reducing the size of the NRF.

Discussion

We sought to determine the essential data items that should be conveyed for neonatal inter-hospital transfer in a resource-limited setting. By employing Delphi techniques, we have generated consensus on what information should be included in a neonatal referral form in order to close the communication gap in inter-hospital transfer in Rwanda. Additionally, given the breadth of experience of our participants, we anticipate that the form is readily adaptable to other similar resource-limited settings.

Precise records are an essential component of neonatal inter-hospital transfer.²⁸ However, there is limited evidence for how such data should be communicated. For example, the NRFs we identified in Round-1 were heterogeneous in nature, with only 33 (36%) of the 91 items identified being present in more than half of the 16 NRFs. Therefore, many NRFs may be excluding important data points because robust methods were not employed to develop them. We found that these existing NRFs contained a mean of 34 items, which is less than the 57 items we identified in Rounds -1 to -3 and therefore these NRFs may not be comprehensive. Items in the NRF that are unique to resource-limited settings include modes of transport (e.g. motorcycle, walking), conditions in pregnancy (e.g. tuberculosis), and perinatal infant care (e.g. tetracycline eye ointment). Despite having more items, our NRF fits on two pages as practicalities such as printing costs are important in our setting. The practicality of ensuring that the NRF could be printed on a single A4 double-sided sheet of paper, had resulted in the use of a small font size, which may be challenging for persons with reduced eye-sight, and that the ergonomics of the form may not be optimal.

Communication errors have been established as a potential cause of significant adverse events during transport.²⁹ By encouraging strict adherence to data collection and sharing, NRFs can also assist with providing a standardised patient handoff, which has been identified as a quality metric for neonatal transport.^30,31 Also, NRFs allow for tracking data to assist with clinical benchmarking for transport outcomes, a much-needed measure in neonatal inter-hospital transfer and neonatal registries.^32–34

By utilising a modified Delphi consensus process, we have incorporated core items that previous NRFs included while tailoring the form for use specifically in a resource-limited setting. The participants contributing to the consensus process had a broad length of experience and diverse backgrounds and training. Their broad expertise helped contribute extensive and informed feedback in Round-2 and -3 of the Delphi. Given that two-thirds of these participants were from East African countries, we feel that the consensus process produced CCI items that are generalisable to other resource-limited settings. Using focus groups of general practitioners in Round-4 of the study has made the NRF relevant and practical to the professionals working in the health facilities that are required to transfer neonates for more specialist care.

Study limitations

We identified several possible limitations to our study. First, only two of the 16 NRFs obtained in Round-1 were from resource-limited settings. The content validity of the 14 other NRFs may, therefore, be decreased for our setting. There may be other NRFs from a similar setting, but despite internet/literature searches and contacting local networks, these were not identifiable. However, we feel that this is minimised by the participant contributions in Rounds-2, -3 and -4. Second, the participants involved were all physicians. Parents and nursing staff were not included. It was felt that parents were unlikely to understand the terminology or the nature of the clinical information being presented. However, adding nursing staff could have affected our results by eliminating certain items or introducing additional novel items in our NRF. Only four board-certified neonatologists participated in our study. In practice, many of the general paediatricians who participated in our study, particularly from resource-limited settings, care primarily for neonates but simply do not have official certification as subspecialists. Hence, we feel that the expertise of our participants remains highly relevant to the setting and scope of our study. Regarding potential biases, there are 91 items in the first draft of the CCI list. Asking participants to score the importance of all of these items could result in questionnaire fatigue and bias the results of the later outcomes. To mitigate against this possibility, the questionnaire was split into eight themes/sections, and some items were combined in the final round.

Clinical application

Despite these limitations, we anticipate that our NRF can be used in its current form at any centre that refers neonates to institutions that provide a higher level of care in resource-limited settings. If employed in other settings, the language and terminology would need to be modified where appropriate and the items assessed for local suitability.

The aimed output was for an NRF suitable for “day-to-day” clinical use, in order to improve quality of care, rather than for future research data-collection. The NRF is now in national clinical use in Rwanda.³⁵ It was not initially field-tested in its double-sided, A4 format but has now been adapted by the Ministry of Health to fit onto a double-spread A3 sized pad of carbon-copied paper so that the completed form can be sent to the receiving hospital, with the sending facility keeping a copy. This is used at all levels of referral by different professionals. Standard practice is that doctors complete the form in hospitals and nurses and/or midwives complete it at health centre level. There is currently no formal training in its use.

Future research

Further assessment will be required to assess how frequently the form is used, how accurately it is completed and if it improves outcomes. The design/maintenance and use of the form is now undertaken by the Neonatal Working Group of the Ministry of Health, which includes multi-disciplinary professionals, who are best placed to evaluate its ongoing implementation. This NRF represents an important first step in standardising data collection in our setting in, and may be helpful in other resource-limited settings. Though the form is designed for day-to-day clinical use, the data generated has be potential to form the foundation for future quality improvement initiatives in neonatal inter-hospital transfers or centres establishing neonatal registries.³⁴

Conclusion

Adverse outcomes occur in up to 40% of neonates transported between hospitals, and there are currently no standardised, robustly designed, communication tools for the transport of neonates in resource-limited settings. We have used Delphi consensus methods to generate a novel NRF to close the communication gap in inter-hospital transfer in the resource-limited setting, such as Rwanda, where it is now in national clinical use. The NRF is freely available on Harvard Dataverse³⁶ with a CC0 licence, allowing other settings to use and adapt the NRF to their own setting needs.

Data availability

Underlying data

Harvard Dataverse: A Neonatal Referral Form For Resource-Limited Settings - A Modified Delphi-Consensus Study. https://doi.org/10.7910/DVN/Q0ZGDZ.³⁶

This project contains the following underlying data:

- Round-1 - NRF e-Delphi.tab (Round-1 dataset)
- Round-2 - NRF e-Delphi.xlsx (Round-2 dataset)
- Round-3 - NRF e-Delphi.tab (Round-3 dataset)
- Round-4 - NRF e-Delphi.tab (Round-4 dataset)

Extended data

Harvard Dataverse: A Neonatal Referral Form For Resource-Limited Settings - A Modified Delphi-Consensus Study. https://doi.org/10.7910/DVN/Q0ZGDZ.³⁶

This project contains the following extended data:

- e-Delphi consent form.docx (Consent description for Round-2 and Round-3)
- Google Forms - Questionnaire for Round-2.pdf (Round 2 Questionnaire)
- Google Forms - Questionnaire for Round-3.pdf (Round 3 Questionnaire)
- Supplementary_File_3_RaNRF_Round3.docx (Draft neonatal referral form generated in Round-3)
- Supplementary_File_2_FINAL_NRF_after_Round_4.docx (Final neonatal referral form for resource-limited settings - for public use)
- Supplementary_Table_1_Search_terms.docx (Search terms used in Round-1)
- Supplementary_Table_2_Round_3.docx (Round-3 responses and consensus application)
- Supplementary_Table_3_Final_CCI_list.docx (Final CCI list at end of Round-3)
- Supplementary_Table_4_Round_4_coding.docx (Coding used in Round-4)

Data are available under the terms of the Creative Commons Zero “No rights reserved” data waiver (CC0 1.0 Public domain dedication).

Competing interests

No competing interests were disclosed.

Grant information

The author(s) declared that no grants were involved in supporting this work.

References

1. World Health Statistics 2017: Monitoring health for the SDGs.Switzerland;2017.Reference Source
2. Rwanda National Institute of Statistics: Demographic and Health Survey, 2014-15, final Report.Kigali;2016 [cited 2018 Aug 1]. p. 1–615.Reference Source
3. National Institute of Statistics of Rwanda, Ministry of Health (MOH): Rwanda demographic and health survey 2019-2020: Key indicators report.2020.Reference Source
4. Xie A, Carayon P: A systematic review of human factors and ergonomics (HFE)-based healthcare system redesign for quality of care and patient safety. Ergonomics. 2015 Jan 2; 58(1): 33–49. Publisher Full Text
5. Rathod D, Adhisivam B, Bhat BV: Transport of sick neonates to a tertiary care hospital, South India: condition at arrival and outcome. Trop Doct. 2015; 45(2): 96–9. PubMed Abstract | Publisher Full Text
6. Abdulraheem MA, Tongo OO, Orimadegun AE, et al.: Neonatal transport practices in ibadan, Nigeria. Pan Afr Med J. 2016; 24(216): 1–10. PubMed Abstract | Publisher Full Text | Free Full Text
7. Mori R, Fujimura M, Shiraishi J, et al.: Duration of inter-facility neonatal transport and neonatal mortality: Systematic review and cohort study. Pediatr Int. 2007; 49(4): 452–8. PubMed Abstract | Publisher Full Text
8. Kumar PP, Kumar CD, Shaik F, et al.: Transported neonates by a specialist team- How STABLE are they. Indian J Pediatr. 2011; 78(7): 860–2. PubMed Abstract | Publisher Full Text
9. Kumar PP, Kumar CD, Shaik FAR, et al.: Prolonged neonatal interhospital transport on road: Relevance for developing countries. Indian J Pediatr. 2010; 77(2): 151–4. PubMed Abstract | Publisher Full Text
10. Ministry of Health; Republic of Rwanda: Health Sector Policy.2015 [cited 2018 Aug 1]. p. 1–33.Reference Source
11. KwaZulu-Natal: Monitoring & handover sheet for neonatal transfers (NRF).2016 [cited 2017 Dec 7].Reference Source
12. Neonatal Health System: Embrace acute call medical control form (NRF).2016 [cited 2017 Dec 7].Reference Source
13. Utah Women and Newborns Quality Collaborative: Utah Neonatal Transfer Form (NRF).[cited 2017 Dec 7].Reference Source
14. Calfornia Perinatal Transport System (CPETS): Acute Inter-facility Neonatal Transport form (NRF).2017 [cited 2017 Dec 7]. p. 1–2.Reference Source
15. McConnell D, Butow PN, Tattersall MHN: Improving the letters we write: An exploration of doctor-doctor communication in cancer care. Br J Cancer. 1999; 80(3–4): 427–37. PubMed Abstract | Publisher Full Text | Free Full Text
16. Couper ID, Henbest RJ: The quality and relationship of referral and reply letters. S Afr Med J. 1996; 86(12): 1540–2. PubMed Abstract
17. United Nations Children’s Fund (UNICEF), World Health Organization: Model Chapter for IMCI Textbooks. 2001.
18. Orimadegun AE, Akinbami FO, Akinsola AK, et al.: Contents of referral letters to the children emergency unit of a teaching hospital, southwest of Nigeria. Pediatr Emerg Care. 2008; 24(3): 153–6. PubMed Abstract | Publisher Full Text
19. Vincent-Lambert C, Wade G: Challenges relating to the inter-facility transport of high acuity paediatric cases. Afr J Emerg Med. 2018; 8(1): 29–33. PubMed Abstract | Publisher Full Text | Free Full Text
20. Mwizerwa O, Umuhoza C, Corden MH, et al.: What is the key medical information required to care for a transferred neonate appropriately? – A Best Evidence Topic (BET). Rwanda Med J. 2018; 75(4): 1–5. Publisher Full Text
21. Sinha IP, Smyth RL, Williamson PR: Using the Delphi Technique to Determine Which Outcomes to Measure in Clinical Trials: Recommendations for the Future Based on a Systematic Review of Existing Studies. PLoS Med. 2011 Jan 25 [cited 2016 Nov 17]; 8(1): e1000393. PubMed Abstract | Publisher Full Text | Free Full Text
22. Williamson PR, Altman DG, Blazeby JM, et al.: Developing core outcome sets for clinical trials: Issues to consider. Trials. 2012; 13(132): 1–8. PubMed Abstract | Publisher Full Text | Free Full Text
23. Custer RL, Scarcella JA, Stewart BR: The Modified Delphi Technique - A Rotational Modification. J Career Tech Educ. 1999; 15(2): 1–9. Publisher Full Text
24. Binagwaho A, Kyamanywa P, Farmer PE, et al.: The Human Resources for Health Program in Rwanda — A New Partnership. NEJM. 2010; 369(21): 2054–9. PubMed Abstract | Publisher Full Text
25. Guyatt GH, Oxman AD, Kunz R, et al.: GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol 2011; 64(4): 395–400. PubMed Abstract | Publisher Full Text
26. Williamson PR, Altman DG, Bagley H, et al.: The COMET Handbook: Version 1.0. Trials. 2017; 18(Suppl 3): 1–50. PubMed Abstract | Publisher Full Text | Free Full Text
27. Hsu C, Sandford B: The delphi technique: making sense of consensus. Pract Assessment, Res Eval. 2007; 12(10): 1–8. Publisher Full Text
28. Pan P: Inter Hospital Transfer of Critically Ill Neonates-Challenges Faced. J Pediatr Neonatal Care. 2017; 6(2): 235. Publisher Full Text
29. Gunz AC, Dhanani S, Whyte H, et al.: Identifying Significant and Relevant Events During Pediatric Transport: A Modified Delphi Study. Pediatr Crit Care Med. 2014; 15(7): 653–9. PubMed Abstract | Publisher Full Text
30. Bigham MT, Schwartz HP: Quality Metrics in Neonatal and Pediatric Critical Care Transport: A Consensus Statement. Pediatr Crit Care Med. 2013; 14(5): 518–23. PubMed Abstract | Publisher Full Text
31. Schwartz HP, Bigham MT, Schoettker PJ, et al.: Quality Metrics in Neonatal and Pediatric Critical Care Transport: A National Delphi Project*. Pediatr Crit Care Med. 2015; 16(8): 711–7. PubMed Abstract | Publisher Full Text
32. Ratnavel N: Early Human Development Evaluating and improving neonatal transport services. Early Hum Dev. 2013; 89(11): 851–3. Publisher Full Text
33. Stroud MH, Trautman MS, Meyer K, et al.: Pediatric and neonatal interfacility transport: Results from a national consensus conference. Pediatrics. 2013; 132(2): 359–66. PubMed Abstract | Publisher Full Text
34. Choi J, Urubuto F, Dusabimana R, et al.: Establishing a neonatal database in a tertiary hospital in Rwanda – an observational study. Paediatr Int Child Health. 2019; 39(4): 265–74. PubMed Abstract | Publisher Full Text
35. Ministry of Health, Republic of Rwanda: Integrated National Health Sector Referral Guidelines (INHSRG). 1st ed.Kigali;2020.Reference Source
36. Cartledge P: A Neonatal Referral Form For Resource-Limited Settings - A Modified Delphi-Consensus Study. Harvard Dataverse, V2, UNF:6:vhUBB3u7tvovHWLUGWJYwQ== [fileUNF]. 2020. Publisher Full Text

Comments on this article Comments (1)

Version 2

VERSION 2 PUBLISHED 07 Jun 2022

Revised

Comment

Version 1

VERSION 1 PUBLISHED 10 May 2021

Discussion is closed on this version, please comment on the latest version above.

Reader Comment 02 Sep 2021

Emmanuel Biracyaza, Prison Fellowship Rwanda, Kigali, Rwanda

02 Sep 2021

Reader Comment

The current study conducted in Rwanda which is one of the Sub-Saharan African countries that has limitation to the number of scientific studies on this important topic. This study was ... Continue reading The current study conducted in Rwanda which is one of the Sub-Saharan African countries that has limitation to the number of scientific studies on this important topic. This study was well carried out and written with fashion. I appreciate that this topic has novelty in Rwanda since the Delphi Research Approach is novel in this country. The methodology and result section of this study are informative. I kindly appreciate that the investigators of this study who communicated the policy makers that the adverse outcomes occur in up to 40% of neonates transported between the hospitals and the lack of current standardized and well designed tools for the transport of neonates in resource-limited settings. It is very important for the policy makers to be commutated that the utilisation of the Delphi Consensus Methods revealed a novel NRF to close the communication gap in inter-hospital transfer in Rwanda. Based on the results from this study, I observe that this important study was well designed and inform us the important results that are also important for the further researchers.
The current study conducted in Rwanda which is one of the Sub-Saharan African countries that has limitation to the number of scientific studies on this important topic. This study was well carried out and written with fashion. I appreciate that this topic has novelty in Rwanda since the Delphi Research Approach is novel in this country. The methodology and result section of this study are informative. I kindly appreciate that the investigators of this study who communicated the policy makers that the adverse outcomes occur in up to 40% of neonates transported between the hospitals and the lack of current standardized and well designed tools for the transport of neonates in resource-limited settings. It is very important for the policy makers to be commutated that the utilisation of the Delphi Consensus Methods revealed a novel NRF to close the communication gap in inter-hospital transfer in Rwanda. Based on the results from this study, I observe that this important study was well designed and inform us the important results that are also important for the further researchers.
Competing Interests: I declare no competing interests. Close
Report a concern
Discussion is closed on this version, please comment on the latest version above.

Author details Author details

Christian Umuhoza
Roles: Conceptualization, Methodology, Writing – Original Draft Preparation, Writing – Review & Editing

Mark H. Corden
Roles: Formal Analysis, Validation, Writing – Original Draft Preparation, Writing – Review & Editing

Tom Lissauer
Roles: Conceptualization

Competing interests

No competing interests were disclosed.

Grant information

The author(s) declared that no grants were involved in supporting this work.

Article Versions (2)

version 2

Revised

Published: 07 Jun 2022, 10:365

https://doi.org/10.12688/f1000research.50980.2

version 1

Published: 10 May 2021, 10:365

https://doi.org/10.12688/f1000research.50980.1

© 2022 Mwizerwa O et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Download

Export To

metrics

	Views	Downloads
F1000Research	-	-
PubMed Central Data from PMC are received and updated monthly.	-	-

Citations

SEE MORE DETAILS

CITE

how to cite this article

Mwizerwa O, Umuhoza C, Corden MH et al. Closing the communication gap in neonatal inter-hospital transfer: a neonatal referral form for resource-limited settings - a modified e-Delphi-consensus study [version 2; peer review: 2 approved]. F1000Research 2022, 10:365 (https://doi.org/10.12688/f1000research.50980.2)

NOTE: If applicable, it is important to ensure the information in square brackets after the title is included in all citations of this article.

track

receive updates on this article

Track an article to receive email alerts on any updates to this article.

Open Peer Review

Version 2

VERSION 2

PUBLISHED 07 Jun 2022

Revised

Views

Reviewer Report 15 Jun 2022

Peter Lachman, Lead Faculty Quality Improvement Programme, Royal College of Physicians of Ireland, Dublin, Ireland

Approved

https://doi.org/10.5256/f1000research.125455.r139935

The authors have addressed the issue of clinical implementation. The study is well constructed and the value of the work can now be assessed going forward:

is the form being used reliably?

CITE

Report a concern

Respond or Comment

Version 1

VERSION 1

PUBLISHED 10 May 2021

Views

Reviewer Report 28 Mar 2022

Peter Lachman, Lead Faculty Quality Improvement Programme, Royal College of Physicians of Ireland, Dublin, Ireland

Approved with Reservations

https://doi.org/10.5256/f1000research.54082.r125910

This paper provides a report on the development of a neonatal referral form for use in a low resource setting. This is an important development to improve reliability of communication thereby improving reliability of care and neonatal outcomes.

The rationale for the study is well explained i.e. the lack of a standardized referral process in the context of high neonatal mortality and the need for improved communication on referral.
The context is relevant and important.
The rationale for the study is clear.
The study methodology is described well.
The literature search for similar tools appears to be good – though there may be grey literature i.e unpublished referral forms not available for review.
The modified Delphi appears to be well run and addresses possible bias.
The results are described in sufficient detail.
The supplementary data provides the important background to the paper as well as the final version of the form.

As a paper reporting the development of a tool to improve the reliability of information transfer, the authors have met the aim of the study i.e. developing a form co-designed by referrers and receivers of the referral using a Delphi approach.

I would have expected the theory of standardization of communication to be discussed in the context of patient safety theory, in particular human factors and reliability .

The layout of the form could also be designed more ergonomically.
Was the layout tested in the field to see how best to set out the required information?

The paper does not address the following though the authors note that the form “is now in national clinical use in Rwanda"

Does the form work i.e. do clinicians use it reliably where reliability is defined as completion of all required information accurately 100% of the time?
Are any modifications required especially in design of form?
Are all the items necessary in real life outside the research environment where it was developed.
What training is required to have the form used? Is there a training manual?
Who fills out the form – nurses or doctors?
On case by case basis has the form improved the outcome for babies when filled out correctly?

I note that that these questions are for future research. However a comment on this and on how the implementation of the form is carried out and scaled up would be a good follow up study. A neonatal collaborative across the country may be the way to ensure the form is used on a reliable basis.

A note on the above would add value to the findings of the paper.

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: Patient Safety, Quality Improvement and implementation, Paediatrics

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

CITE

Report a concern

Author Response 24 May 2022

Peter Cartledge, Department of Pediatrics, Yale University, New Haven, USA

24 May 2022

Author Response
We would like to thank the reviewer for their comments and input into the article, which we feel contribute to the article. Here we respond to each comment, point by point: ... Continue reading
We would like to thank the reviewer for their comments and input into the article, which we feel contribute to the article. Here we respond to each comment, point by point:

The literature search for similar tools appears to be good – though there may be grey literature i.e unpublished referral forms not available for review

Response: This is a very valid point. During the study design phase, we did undertake a “grey search” using both an internet search and through networking of contacts known to us. We have amended the text in “Methods” > ”Round-1” to hopefully make this a bit more clear to readers.

I would have expected the theory of standardization of communication to be discussed in the context of patient safety theory, in particular human factors and reliability.

Response: We have added some new text to the background putting the study in context of human factors. We can see that much of what we did employed Human Factors/Ergonomics (HFE) theory, but we feel it would be disingenuous to imply that we used this approach formally in our methodology.

The layout of the form could also be designed more ergonomically.

Response: Yes, we would agree with this. Printing costs and practicalities had to be a major consideration and this has certainly come at the cost of ergonomics. We have added a comment into the Discussion to discuss this; “The practicality of ensuring printing on a single A4 double-sided sheet of paper does that mean that font size may be challenging for persons with reduced eye-sight, and that the ergonomics of the form may not be optimal.”

Was the layout tested in the field to see how best to set out the required information? The paper does not address the following though the authors note that the form “is now in national clinical use in Rwanda"

Response: The layout was not formally field-tested. But its use has adapted since we have submitted the article for publication. We have therefore added the following text into the clinical implications section “The NRF was not initially field-tested in its double-sided A4 format but has now been subsequently adapted by the Ministry of Health. It has been adapted to fit onto a double-spread pad of carbon-copied paper so that the form can be sent to the receiving hospital, with the sending facility being able to keep a copy of the information being shared.”

Does the form work i.e. do clinicians use it reliably where reliability is defined as completion of all required information accurately 100% of the time?

Response: The form has now been implemented in Rwanda, and its use will make an interesting piece of research work. We have added an additional comment into “Clinical application” to make this a bit clearer.

Are any modifications required especially in design of form?

Response: The initial NRF design was evaluated by Round-4 participants for face validity with modifications applied. Beyond the scope of the “methodology” of this study, the form has now been adapted by the Ministry of Health (as discussed in the point above).

Are all the items necessary in real life outside the research environment where it was developed.

Response: The aimed output was for a NRF suitable for “day-to-day” clinical use, rather than research. We have added this comment into the Objectives and the “Clinical Application” section.

What training is required to have the form used? Is there a training manual?

Response: We have added the following text to the Clinical Implications section – “There is currently no formal training delivered for use of the NRF.”

Who fills out the form – nurses or doctors?

Response: We have added the following text to the Clinical Implications section “In its current use in Rwanda, the NRF is being used at all levels of referral by different professionals. Normal practice is that doctors complete the form in hospitals and nurses and/or midwives complete it at the health center level.”

On case by case basis has the form improved the outcome for babies when filled out correctly?

Response: We aren’t able to comment on this at this point in time in the article. Anecdotally professionals have commented to the authors that the form is helpful in their clinical practice. But this information hasn’t been collected in any formal setting.

I note that that these questions are for future research. However a comment on this and on how the implementation of the form is carried out and scaled up would be a good follow up study. A neonatal collaborative across the country may be the way to ensure the form is used on a reliable basis.

Response: As the Clinical Implications section was getting large we have added a new heading “future research”. We have added the following statement to this section “The design and use of the form have now been taken over by the Neonatal Working Group of the Ministry of Health, which includes multi-disciplinary professionals, who are best placed to evaluate its use.”

Additional comments from the authors: Clinical implications section: “The first page also has the potential to be used for intra-hospital transfer.” In the previous version we made this comment. There is a potential for this to be undertaken in Rwanda, but it hasn’t been implemented yet, and we are aware that the section of text is becoming long, therefore we have removed this comment.
We would like to thank the reviewer for their comments and input into the article, which we feel contribute to the article. Here we respond to each comment, point by point:

The literature search for similar tools appears to be good – though there may be grey literature i.e unpublished referral forms not available for review

Response: This is a very valid point. During the study design phase, we did undertake a “grey search” using both an internet search and through networking of contacts known to us. We have amended the text in “Methods” > ”Round-1” to hopefully make this a bit more clear to readers.

I would have expected the theory of standardization of communication to be discussed in the context of patient safety theory, in particular human factors and reliability.

Response: We have added some new text to the background putting the study in context of human factors. We can see that much of what we did employed Human Factors/Ergonomics (HFE) theory, but we feel it would be disingenuous to imply that we used this approach formally in our methodology.

The layout of the form could also be designed more ergonomically.

Response: Yes, we would agree with this. Printing costs and practicalities had to be a major consideration and this has certainly come at the cost of ergonomics. We have added a comment into the Discussion to discuss this; “The practicality of ensuring printing on a single A4 double-sided sheet of paper does that mean that font size may be challenging for persons with reduced eye-sight, and that the ergonomics of the form may not be optimal.”

Was the layout tested in the field to see how best to set out the required information? The paper does not address the following though the authors note that the form “is now in national clinical use in Rwanda"

Response: The layout was not formally field-tested. But its use has adapted since we have submitted the article for publication. We have therefore added the following text into the clinical implications section “The NRF was not initially field-tested in its double-sided A4 format but has now been subsequently adapted by the Ministry of Health. It has been adapted to fit onto a double-spread pad of carbon-copied paper so that the form can be sent to the receiving hospital, with the sending facility being able to keep a copy of the information being shared.”

Does the form work i.e. do clinicians use it reliably where reliability is defined as completion of all required information accurately 100% of the time?

Response: The form has now been implemented in Rwanda, and its use will make an interesting piece of research work. We have added an additional comment into “Clinical application” to make this a bit clearer.

Are any modifications required especially in design of form?

Response: The initial NRF design was evaluated by Round-4 participants for face validity with modifications applied. Beyond the scope of the “methodology” of this study, the form has now been adapted by the Ministry of Health (as discussed in the point above).

Are all the items necessary in real life outside the research environment where it was developed.

Response: The aimed output was for a NRF suitable for “day-to-day” clinical use, rather than research. We have added this comment into the Objectives and the “Clinical Application” section.

What training is required to have the form used? Is there a training manual?

Response: We have added the following text to the Clinical Implications section – “There is currently no formal training delivered for use of the NRF.”

Who fills out the form – nurses or doctors?

Response: We have added the following text to the Clinical Implications section “In its current use in Rwanda, the NRF is being used at all levels of referral by different professionals. Normal practice is that doctors complete the form in hospitals and nurses and/or midwives complete it at the health center level.”

On case by case basis has the form improved the outcome for babies when filled out correctly?

Response: We aren’t able to comment on this at this point in time in the article. Anecdotally professionals have commented to the authors that the form is helpful in their clinical practice. But this information hasn’t been collected in any formal setting.

I note that that these questions are for future research. However a comment on this and on how the implementation of the form is carried out and scaled up would be a good follow up study. A neonatal collaborative across the country may be the way to ensure the form is used on a reliable basis.

Response: As the Clinical Implications section was getting large we have added a new heading “future research”. We have added the following statement to this section “The design and use of the form have now been taken over by the Neonatal Working Group of the Ministry of Health, which includes multi-disciplinary professionals, who are best placed to evaluate its use.”

Additional comments from the authors: Clinical implications section: “The first page also has the potential to be used for intra-hospital transfer.” In the previous version we made this comment. There is a potential for this to be undertaken in Rwanda, but it hasn’t been implemented yet, and we are aware that the section of text is becoming long, therefore we have removed this comment.
Competing Interests: None Close
Report a concern
Respond or Comment

COMMENTS ON THIS REPORT

Author Response 24 May 2022

Peter Cartledge, Department of Pediatrics, Yale University, New Haven, USA

24 May 2022

Author Response
We would like to thank the reviewer for their comments and input into the article, which we feel contribute to the article. Here we respond to each comment, point by point: ... Continue reading
We would like to thank the reviewer for their comments and input into the article, which we feel contribute to the article. Here we respond to each comment, point by point:

The literature search for similar tools appears to be good – though there may be grey literature i.e unpublished referral forms not available for review

Response: This is a very valid point. During the study design phase, we did undertake a “grey search” using both an internet search and through networking of contacts known to us. We have amended the text in “Methods” > ”Round-1” to hopefully make this a bit more clear to readers.

I would have expected the theory of standardization of communication to be discussed in the context of patient safety theory, in particular human factors and reliability.

Response: We have added some new text to the background putting the study in context of human factors. We can see that much of what we did employed Human Factors/Ergonomics (HFE) theory, but we feel it would be disingenuous to imply that we used this approach formally in our methodology.

The layout of the form could also be designed more ergonomically.

Response: Yes, we would agree with this. Printing costs and practicalities had to be a major consideration and this has certainly come at the cost of ergonomics. We have added a comment into the Discussion to discuss this; “The practicality of ensuring printing on a single A4 double-sided sheet of paper does that mean that font size may be challenging for persons with reduced eye-sight, and that the ergonomics of the form may not be optimal.”

Was the layout tested in the field to see how best to set out the required information? The paper does not address the following though the authors note that the form “is now in national clinical use in Rwanda"

Response: The layout was not formally field-tested. But its use has adapted since we have submitted the article for publication. We have therefore added the following text into the clinical implications section “The NRF was not initially field-tested in its double-sided A4 format but has now been subsequently adapted by the Ministry of Health. It has been adapted to fit onto a double-spread pad of carbon-copied paper so that the form can be sent to the receiving hospital, with the sending facility being able to keep a copy of the information being shared.”

Does the form work i.e. do clinicians use it reliably where reliability is defined as completion of all required information accurately 100% of the time?

Response: The form has now been implemented in Rwanda, and its use will make an interesting piece of research work. We have added an additional comment into “Clinical application” to make this a bit clearer.

Are any modifications required especially in design of form?

Response: The initial NRF design was evaluated by Round-4 participants for face validity with modifications applied. Beyond the scope of the “methodology” of this study, the form has now been adapted by the Ministry of Health (as discussed in the point above).

Are all the items necessary in real life outside the research environment where it was developed.

Response: The aimed output was for a NRF suitable for “day-to-day” clinical use, rather than research. We have added this comment into the Objectives and the “Clinical Application” section.

What training is required to have the form used? Is there a training manual?

Response: We have added the following text to the Clinical Implications section – “There is currently no formal training delivered for use of the NRF.”

Who fills out the form – nurses or doctors?

Response: We have added the following text to the Clinical Implications section “In its current use in Rwanda, the NRF is being used at all levels of referral by different professionals. Normal practice is that doctors complete the form in hospitals and nurses and/or midwives complete it at the health center level.”

On case by case basis has the form improved the outcome for babies when filled out correctly?

Response: We aren’t able to comment on this at this point in time in the article. Anecdotally professionals have commented to the authors that the form is helpful in their clinical practice. But this information hasn’t been collected in any formal setting.

I note that that these questions are for future research. However a comment on this and on how the implementation of the form is carried out and scaled up would be a good follow up study. A neonatal collaborative across the country may be the way to ensure the form is used on a reliable basis.

Response: As the Clinical Implications section was getting large we have added a new heading “future research”. We have added the following statement to this section “The design and use of the form have now been taken over by the Neonatal Working Group of the Ministry of Health, which includes multi-disciplinary professionals, who are best placed to evaluate its use.”

Additional comments from the authors: Clinical implications section: “The first page also has the potential to be used for intra-hospital transfer.” In the previous version we made this comment. There is a potential for this to be undertaken in Rwanda, but it hasn’t been implemented yet, and we are aware that the section of text is becoming long, therefore we have removed this comment.
We would like to thank the reviewer for their comments and input into the article, which we feel contribute to the article. Here we respond to each comment, point by point:

The literature search for similar tools appears to be good – though there may be grey literature i.e unpublished referral forms not available for review

Response: This is a very valid point. During the study design phase, we did undertake a “grey search” using both an internet search and through networking of contacts known to us. We have amended the text in “Methods” > ”Round-1” to hopefully make this a bit more clear to readers.

I would have expected the theory of standardization of communication to be discussed in the context of patient safety theory, in particular human factors and reliability.

Response: We have added some new text to the background putting the study in context of human factors. We can see that much of what we did employed Human Factors/Ergonomics (HFE) theory, but we feel it would be disingenuous to imply that we used this approach formally in our methodology.

The layout of the form could also be designed more ergonomically.

Response: Yes, we would agree with this. Printing costs and practicalities had to be a major consideration and this has certainly come at the cost of ergonomics. We have added a comment into the Discussion to discuss this; “The practicality of ensuring printing on a single A4 double-sided sheet of paper does that mean that font size may be challenging for persons with reduced eye-sight, and that the ergonomics of the form may not be optimal.”

Was the layout tested in the field to see how best to set out the required information? The paper does not address the following though the authors note that the form “is now in national clinical use in Rwanda"

Response: The layout was not formally field-tested. But its use has adapted since we have submitted the article for publication. We have therefore added the following text into the clinical implications section “The NRF was not initially field-tested in its double-sided A4 format but has now been subsequently adapted by the Ministry of Health. It has been adapted to fit onto a double-spread pad of carbon-copied paper so that the form can be sent to the receiving hospital, with the sending facility being able to keep a copy of the information being shared.”

Does the form work i.e. do clinicians use it reliably where reliability is defined as completion of all required information accurately 100% of the time?

Response: The form has now been implemented in Rwanda, and its use will make an interesting piece of research work. We have added an additional comment into “Clinical application” to make this a bit clearer.

Are any modifications required especially in design of form?

Response: The initial NRF design was evaluated by Round-4 participants for face validity with modifications applied. Beyond the scope of the “methodology” of this study, the form has now been adapted by the Ministry of Health (as discussed in the point above).

Are all the items necessary in real life outside the research environment where it was developed.

Response: The aimed output was for a NRF suitable for “day-to-day” clinical use, rather than research. We have added this comment into the Objectives and the “Clinical Application” section.

What training is required to have the form used? Is there a training manual?

Response: We have added the following text to the Clinical Implications section – “There is currently no formal training delivered for use of the NRF.”

Who fills out the form – nurses or doctors?

Response: We have added the following text to the Clinical Implications section “In its current use in Rwanda, the NRF is being used at all levels of referral by different professionals. Normal practice is that doctors complete the form in hospitals and nurses and/or midwives complete it at the health center level.”

On case by case basis has the form improved the outcome for babies when filled out correctly?

Response: We aren’t able to comment on this at this point in time in the article. Anecdotally professionals have commented to the authors that the form is helpful in their clinical practice. But this information hasn’t been collected in any formal setting.

I note that that these questions are for future research. However a comment on this and on how the implementation of the form is carried out and scaled up would be a good follow up study. A neonatal collaborative across the country may be the way to ensure the form is used on a reliable basis.

Response: As the Clinical Implications section was getting large we have added a new heading “future research”. We have added the following statement to this section “The design and use of the form have now been taken over by the Neonatal Working Group of the Ministry of Health, which includes multi-disciplinary professionals, who are best placed to evaluate its use.”

Additional comments from the authors: Clinical implications section: “The first page also has the potential to be used for intra-hospital transfer.” In the previous version we made this comment. There is a potential for this to be undertaken in Rwanda, but it hasn’t been implemented yet, and we are aware that the section of text is becoming long, therefore we have removed this comment.
Competing Interests: None Close
Report a concern

Views

Reviewer Report 14 Jun 2021

Pradyumna Pan, Pediatric Surgery Unit, Ashish Hospital and Research Centre, Jabalpur, Madhya Pradesh, India

Approved

https://doi.org/10.5256/f1000research.54082.r85767

Well researched and clearly written article. Very informative. In this paper, the authors explored the nature and use of the Delphi research method, explored how and why it may be applied. The authors established the Delphi method being used principally to ... Continue reading

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

Competing Interests: No competing interests were disclosed.

Reviewer Expertise: Surgical outcome of opertion

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

CITE

Report a concern

Respond or Comment

Comments on this article Comments (1)

Version 2

VERSION 2 PUBLISHED 07 Jun 2022

Revised

Comment

Version 1

VERSION 1 PUBLISHED 10 May 2021

Discussion is closed on this version, please comment on the latest version above.

Reader Comment 02 Sep 2021

Emmanuel Biracyaza, Prison Fellowship Rwanda, Kigali, Rwanda

02 Sep 2021

Reader Comment

The current study conducted in Rwanda which is one of the Sub-Saharan African countries that has limitation to the number of scientific studies on this important topic. This study was ... Continue reading The current study conducted in Rwanda which is one of the Sub-Saharan African countries that has limitation to the number of scientific studies on this important topic. This study was well carried out and written with fashion. I appreciate that this topic has novelty in Rwanda since the Delphi Research Approach is novel in this country. The methodology and result section of this study are informative. I kindly appreciate that the investigators of this study who communicated the policy makers that the adverse outcomes occur in up to 40% of neonates transported between the hospitals and the lack of current standardized and well designed tools for the transport of neonates in resource-limited settings. It is very important for the policy makers to be commutated that the utilisation of the Delphi Consensus Methods revealed a novel NRF to close the communication gap in inter-hospital transfer in Rwanda. Based on the results from this study, I observe that this important study was well designed and inform us the important results that are also important for the further researchers.
The current study conducted in Rwanda which is one of the Sub-Saharan African countries that has limitation to the number of scientific studies on this important topic. This study was well carried out and written with fashion. I appreciate that this topic has novelty in Rwanda since the Delphi Research Approach is novel in this country. The methodology and result section of this study are informative. I kindly appreciate that the investigators of this study who communicated the policy makers that the adverse outcomes occur in up to 40% of neonates transported between the hospitals and the lack of current standardized and well designed tools for the transport of neonates in resource-limited settings. It is very important for the policy makers to be commutated that the utilisation of the Delphi Consensus Methods revealed a novel NRF to close the communication gap in inter-hospital transfer in Rwanda. Based on the results from this study, I observe that this important study was well designed and inform us the important results that are also important for the further researchers.
Competing Interests: I declare no competing interests. Close
Report a concern
Discussion is closed on this version, please comment on the latest version above.

Open Peer Review

Reviewer Status

Reviewer Reports

	Invited Reviewers
	1	2
Version 2 (revision) 07 Jun 22		read
Version 1 10 May 21	read	read

Pradyumna Pan, Ashish Hospital and Research Centre, Jabalpur, India
Peter Lachman, Royal College of Physicians of Ireland, Dublin, Ireland

Comments on this article

All Comments(1)

Add a comment

Browse by related subjects

Back to all reports

Reviewer Report

6 Views

15 Jun 2022 | for Version 2

Peter Lachman, Lead Faculty Quality Improvement Programme, Royal College of Physicians of Ireland, Dublin, Ireland

6 Views Cite this report Responses(0)

Approved

The authors have addressed the issue of clinical implementation. The study is well constructed and the value of the work can now be assessed going forward:

is the form being used reliably?
has it been used as intended?
does it need modification?
is there better communication?
are the neonatal transfers safer?
have clinical outcomes for neonates e.g. morbidity and mortality improved?

I look forward to seeing the next stage of this important work

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Patient Safety, Quality Improvement and implementation, Paediatrics

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

Back to all reports

Reviewer Report

11 Views

28 Mar 2022 | for Version 1

Peter Lachman, Lead Faculty Quality Improvement Programme, Royal College of Physicians of Ireland, Dublin, Ireland

11 Views Cite this report Responses(1)

Approved With Reservations

The rationale for the study is well explained i.e. the lack of a standardized referral process in the context of high neonatal mortality and the need for improved communication on referral.
The context is relevant and important.
The rationale for the study is clear.
The study methodology is described well.
The literature search for similar tools appears to be good – though there may be grey literature i.e unpublished referral forms not available for review.
The modified Delphi appears to be well run and addresses possible bias.
The results are described in sufficient detail.
The supplementary data provides the important background to the paper as well as the final version of the form.

The layout of the form could also be designed more ergonomically.
Was the layout tested in the field to see how best to set out the required information?

The paper does not address the following though the authors note that the form “is now in national clinical use in Rwanda"

Does the form work i.e. do clinicians use it reliably where reliability is defined as completion of all required information accurately 100% of the time?
Are any modifications required especially in design of form?
Are all the items necessary in real life outside the research environment where it was developed.
What training is required to have the form used? Is there a training manual?
Who fills out the form – nurses or doctors?
On case by case basis has the form improved the outcome for babies when filled out correctly?

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Patient Safety, Quality Improvement and implementation, Paediatrics

Respond to this report

Responses (1)

Author Response

24 May 2022

Peter Cartledge, Department of Pediatrics, Yale University, New Haven, USA

We would like to thank the reviewer for their comments and input into the article, which we feel contribute to the article. Here we respond to each comment, point by point:

The literature search for similar tools appears to be good – though there may be grey literature i.e unpublished referral forms not available for review
Response: This is a very valid point. During the study design phase, we did undertake a “grey search” using both an internet search and through networking of contacts known to us. We have amended the text in “Methods” > ”Round-1” to hopefully make this a bit more clear to readers.
I would have expected the theory of standardization of communication to be discussed in the context of patient safety theory, in particular human factors and reliability.
Response: We have added some new text to the background putting the study in context of human factors. We can see that much of what we did employed Human Factors/Ergonomics (HFE) theory, but we feel it would be disingenuous to imply that we used this approach formally in our methodology.
The layout of the form could also be designed more ergonomically.
Response: Yes, we would agree with this. Printing costs and practicalities had to be a major consideration and this has certainly come at the cost of ergonomics. We have added a comment into the Discussion to discuss this; “The practicality of ensuring printing on a single A4 double-sided sheet of paper does that mean that font size may be challenging for persons with reduced eye-sight, and that the ergonomics of the form may not be optimal.”

Was the layout tested in the field to see how best to set out the required information? The paper does not address the following though the authors note that the form “is now in national clinical use in Rwanda"
Response: The layout was not formally field-tested. But its use has adapted since we have submitted the article for publication. We have therefore added the following text into the clinical implications section “The NRF was not initially field-tested in its double-sided A4 format but has now been subsequently adapted by the Ministry of Health. It has been adapted to fit onto a double-spread pad of carbon-copied paper so that the form can be sent to the receiving hospital, with the sending facility being able to keep a copy of the information being shared.”
Does the form work i.e. do clinicians use it reliably where reliability is defined as completion of all required information accurately 100% of the time?
Response: The form has now been implemented in Rwanda, and its use will make an interesting piece of research work. We have added an additional comment into “Clinical application” to make this a bit clearer.
Are any modifications required especially in design of form?
Response: The initial NRF design was evaluated by Round-4 participants for face validity with modifications applied. Beyond the scope of the “methodology” of this study, the form has now been adapted by the Ministry of Health (as discussed in the point above).
Are all the items necessary in real life outside the research environment where it was developed.
Response: The aimed output was for a NRF suitable for “day-to-day” clinical use, rather than research. We have added this comment into the Objectives and the “Clinical Application” section.
What training is required to have the form used? Is there a training manual?
Response: We have added the following text to the Clinical Implications section – “There is currently no formal training delivered for use of the NRF.”
Who fills out the form – nurses or doctors?
Response: We have added the following text to the Clinical Implications section “In its current use in Rwanda, the NRF is being used at all levels of referral by different professionals. Normal practice is that doctors complete the form in hospitals and nurses and/or midwives complete it at the health center level.”

On case by case basis has the form improved the outcome for babies when filled out correctly?
Response: We aren’t able to comment on this at this point in time in the article. Anecdotally professionals have commented to the authors that the form is helpful in their clinical practice. But this information hasn’t been collected in any formal setting.
I note that that these questions are for future research. However a comment on this and on how the implementation of the form is carried out and scaled up would be a good follow up study. A neonatal collaborative across the country may be the way to ensure the form is used on a reliable basis.
Response: As the Clinical Implications section was getting large we have added a new heading “future research”. We have added the following statement to this section “The design and use of the form have now been taken over by the Neonatal Working Group of the Ministry of Health, which includes multi-disciplinary professionals, who are best placed to evaluate its use.”

Additional comments from the authors: Clinical implications section: “The first page also has the potential to be used for intra-hospital transfer.” In the previous version we made this comment. There is a potential for this to be undertaken in Rwanda, but it hasn’t been implemented yet, and we are aware that the section of text is becoming long, therefore we have removed this comment.

View more View less

Competing Interests

None

Back to all reports

Reviewer Report

16 Views

14 Jun 2021 | for Version 1

Pradyumna Pan, Pediatric Surgery Unit, Ashish Hospital and Research Centre, Jabalpur, Madhya Pradesh, India

16 Views Cite this report Responses(0)

Approved

Is the work clearly and accurately presented and does it cite the current literature?

Yes
Is the study design appropriate and is the work technically sound?

Yes
Are sufficient details of methods and analysis provided to allow replication by others?

Yes
If applicable, is the statistical analysis and its interpretation appropriate?

Yes
Are all the source data underlying the results available to ensure full reproducibility?

Yes
Are the conclusions drawn adequately supported by the results?

Yes

Competing Interests

No competing interests were disclosed.

Reviewer Expertise

Surgical outcome of opertion

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Respond to this report

Responses (0)

Alongside their report, reviewers assign a status to the article:

Approved - the paper is scientifically sound in its current form and only minor, if any, improvements are suggested

Approved with reservations - A number of small changes, sometimes more significant revisions are required to address specific details and improve the papers academic merit.

Not approved - fundamental flaws in the paper seriously undermine the findings and conclusions

[1] 1. World Health Statistics 2017: Monitoring health for the SDGs.Switzerland;2017.Reference Source

[2] 2. Rwanda National Institute of Statistics: Demographic and Health Survey, 2014-15, final Report.Kigali;2016 [cited 2018 Aug 1]. p. 1–615.Reference Source

[3] 3. National Institute of Statistics of Rwanda, Ministry of Health (MOH): Rwanda demographic and health survey 2019-2020: Key indicators report.2020.Reference Source

[4] 4. Xie A, Carayon P: A systematic review of human factors and ergonomics (HFE)-based healthcare system redesign for quality of care and patient safety. Ergonomics. 2015 Jan 2; 58(1): 33–49. Publisher Full Text

[5] 5. Rathod D, Adhisivam B, Bhat BV: Transport of sick neonates to a tertiary care hospital, South India: condition at arrival and outcome. Trop Doct. 2015; 45(2): 96–9. PubMed Abstract | Publisher Full Text

[6] 6. Abdulraheem MA, Tongo OO, Orimadegun AE, et al.: Neonatal transport practices in ibadan, Nigeria. Pan Afr Med J. 2016; 24(216): 1–10. PubMed Abstract | Publisher Full Text | Free Full Text

[7] 7. Mori R, Fujimura M, Shiraishi J, et al.: Duration of inter-facility neonatal transport and neonatal mortality: Systematic review and cohort study. Pediatr Int. 2007; 49(4): 452–8. PubMed Abstract | Publisher Full Text

[8] 8. Kumar PP, Kumar CD, Shaik F, et al.: Transported neonates by a specialist team- How STABLE are they. Indian J Pediatr. 2011; 78(7): 860–2. PubMed Abstract | Publisher Full Text

[9] 9. Kumar PP, Kumar CD, Shaik FAR, et al.: Prolonged neonatal interhospital transport on road: Relevance for developing countries. Indian J Pediatr. 2010; 77(2): 151–4. PubMed Abstract | Publisher Full Text

[10] 10. Ministry of Health; Republic of Rwanda: Health Sector Policy.2015 [cited 2018 Aug 1]. p. 1–33.Reference Source

[11] 11. KwaZulu-Natal: Monitoring & handover sheet for neonatal transfers (NRF).2016 [cited 2017 Dec 7].Reference Source

[12] 12. Neonatal Health System: Embrace acute call medical control form (NRF).2016 [cited 2017 Dec 7].Reference Source

[13] 13. Utah Women and Newborns Quality Collaborative: Utah Neonatal Transfer Form (NRF).[cited 2017 Dec 7].Reference Source

[14] 14. Calfornia Perinatal Transport System (CPETS): Acute Inter-facility Neonatal Transport form (NRF).2017 [cited 2017 Dec 7]. p. 1–2.Reference Source

[15] 15. McConnell D, Butow PN, Tattersall MHN: Improving the letters we write: An exploration of doctor-doctor communication in cancer care. Br J Cancer. 1999; 80(3–4): 427–37. PubMed Abstract | Publisher Full Text | Free Full Text

[16] 16. Couper ID, Henbest RJ: The quality and relationship of referral and reply letters. S Afr Med J. 1996; 86(12): 1540–2. PubMed Abstract

[17] 17. United Nations Children’s Fund (UNICEF), World Health Organization: Model Chapter for IMCI Textbooks. 2001.

[18] 18. Orimadegun AE, Akinbami FO, Akinsola AK, et al.: Contents of referral letters to the children emergency unit of a teaching hospital, southwest of Nigeria. Pediatr Emerg Care. 2008; 24(3): 153–6. PubMed Abstract | Publisher Full Text

[19] 19. Vincent-Lambert C, Wade G: Challenges relating to the inter-facility transport of high acuity paediatric cases. Afr J Emerg Med. 2018; 8(1): 29–33. PubMed Abstract | Publisher Full Text | Free Full Text

[20] 20. Mwizerwa O, Umuhoza C, Corden MH, et al.: What is the key medical information required to care for a transferred neonate appropriately? – A Best Evidence Topic (BET). Rwanda Med J. 2018; 75(4): 1–5. Publisher Full Text

[21] 21. Sinha IP, Smyth RL, Williamson PR: Using the Delphi Technique to Determine Which Outcomes to Measure in Clinical Trials: Recommendations for the Future Based on a Systematic Review of Existing Studies. PLoS Med. 2011 Jan 25 [cited 2016 Nov 17]; 8(1): e1000393. PubMed Abstract | Publisher Full Text | Free Full Text

[22] 22. Williamson PR, Altman DG, Blazeby JM, et al.: Developing core outcome sets for clinical trials: Issues to consider. Trials. 2012; 13(132): 1–8. PubMed Abstract | Publisher Full Text | Free Full Text

[23] 23. Custer RL, Scarcella JA, Stewart BR: The Modified Delphi Technique - A Rotational Modification. J Career Tech Educ. 1999; 15(2): 1–9. Publisher Full Text

[24] 24. Binagwaho A, Kyamanywa P, Farmer PE, et al.: The Human Resources for Health Program in Rwanda — A New Partnership. NEJM. 2010; 369(21): 2054–9. PubMed Abstract | Publisher Full Text

[25] 25. Guyatt GH, Oxman AD, Kunz R, et al.: GRADE guidelines: 2. Framing the question and deciding on important outcomes. J Clin Epidemiol 2011; 64(4): 395–400. PubMed Abstract | Publisher Full Text

[26] 26. Williamson PR, Altman DG, Bagley H, et al.: The COMET Handbook: Version 1.0. Trials. 2017; 18(Suppl 3): 1–50. PubMed Abstract | Publisher Full Text | Free Full Text

[27] 27. Hsu C, Sandford B: The delphi technique: making sense of consensus. Pract Assessment, Res Eval. 2007; 12(10): 1–8. Publisher Full Text

[28] 28. Pan P: Inter Hospital Transfer of Critically Ill Neonates-Challenges Faced. J Pediatr Neonatal Care. 2017; 6(2): 235. Publisher Full Text

[29] 29. Gunz AC, Dhanani S, Whyte H, et al.: Identifying Significant and Relevant Events During Pediatric Transport: A Modified Delphi Study. Pediatr Crit Care Med. 2014; 15(7): 653–9. PubMed Abstract | Publisher Full Text

[30] 30. Bigham MT, Schwartz HP: Quality Metrics in Neonatal and Pediatric Critical Care Transport: A Consensus Statement. Pediatr Crit Care Med. 2013; 14(5): 518–23. PubMed Abstract | Publisher Full Text

[31] 31. Schwartz HP, Bigham MT, Schoettker PJ, et al.: Quality Metrics in Neonatal and Pediatric Critical Care Transport: A National Delphi Project*. Pediatr Crit Care Med. 2015; 16(8): 711–7. PubMed Abstract | Publisher Full Text

[32] 32. Ratnavel N: Early Human Development Evaluating and improving neonatal transport services. Early Hum Dev. 2013; 89(11): 851–3. Publisher Full Text

[33] 33. Stroud MH, Trautman MS, Meyer K, et al.: Pediatric and neonatal interfacility transport: Results from a national consensus conference. Pediatrics. 2013; 132(2): 359–66. PubMed Abstract | Publisher Full Text

[34] 34. Choi J, Urubuto F, Dusabimana R, et al.: Establishing a neonatal database in a tertiary hospital in Rwanda – an observational study. Paediatr Int Child Health. 2019; 39(4): 265–74. PubMed Abstract | Publisher Full Text

[35] 35. Ministry of Health, Republic of Rwanda: Integrated National Health Sector Referral Guidelines (INHSRG). 1st ed.Kigali;2020.Reference Source

[36] 36. Cartledge P: A Neonatal Referral Form For Resource-Limited Settings - A Modified Delphi-Consensus Study. Harvard Dataverse, V2, UNF:6:vhUBB3u7tvovHWLUGWJYwQ== [fileUNF]. 2020. Publisher Full Text

Closing the communication gap in neonatal inter-hospital transfer: a neonatal referral form for resource-limited settings - a modified e-Delphi-consensus study

Abstract

Keywords

Revised Amendments from Version 1

Introduction

Objectives

Methods

Study design

Round-1

Selection of participants for Round-2 and -3

Round-2 (open-ended questionnaire)

Round-3 (closed questions)

Table 1. Core clinical information items and domains for Rounds 1 to 3.

Round-2 and Round-3 data collection and analysis

Round-4 - creating the final NRF

Ethics statement

Results

Round-1

Response rate

Table 2. Baseline characteristics of participants of Round-2 and Round-3 of Delphi process.

Round-2

Figure 1. Delphi flow diagram.

Round-3

Round-4 (focus groups)

Discussion

Study limitations

Clinical application

Future research

Conclusion

Data availability

Underlying data

Extended data

Competing interests

Grant information

References

Comments on this article Comments (1)

Open Peer Review

Comments on this article Comments (1)

Open Peer Review

Reviewer Status

Reviewer Reports

Comments on this article

Browse by related subjects

Competing Interests Policy

Stay Updated