Paediatric morbidity and mortality in Sierra Leone . Have things changed after the 2014 / 2015 Ebola outbreak ?

Background: Sierra Leone was severely affected by the 2014/2015 Ebola outbreak which is likely to have had longer term repercussions on the health system including on paediatric morbidity and mortality. We thus assessed under-five morbidity and mortality for malaria, acute respiratory Infections (ARI)/pneumonia, watery diarrhoea and measles during the post-Ebola period in Sierra Leone and compared this with the preand intra-Ebola periods. Methods: This was a retrospective cross-sectional study using program data from the District Health Information system (DHIS2) and sourced from 14 districts in Sierra Leone. It included under-five children from 1,250 health facilities country-wide. Study periods included: before (June 1 st, 2013-April 30 th, 2014); during (June 1 st, 2014-April 30 th, 2015); and after Ebola (June 1 st, 2016-April 30 th, 2017). Results: Malaria, ARI/pneumonia and diarrhoea consultations declined during Ebola but recovered to pre-Ebola levels in the postEbola period.  During the post-Ebola period, there was a highly significant reduction in case-fatality for the first three morbidities compared to the pre-Ebola period (P<0.0001). Average number of measles cases increased from 48/month in the pre-Ebola period to 568/month (12-fold increase) post-Ebola. Although there was no difference in measles case-fatality between the preand post-Ebola periods, case-fatality post-Ebola was significantly lower than during Ebola (Relative Risk: 0.05, 95% confidence interval 0.02-0.15, P <0.0001). Conclusions: Consultations for under-five children at health facilities in Sierra Leone recovered to pre-Ebola levels and case-fatality for common childhood illnesses declined significantly. This is a change for Open Peer Review


Introduction
In 2017, a cross-sectional study 1 documented country-wide morbidity for four common childhood illnesses: malaria, acute respiratory infections (ARI)/pneumonia, watery diarrhoea and measles. There were two main findings. First, during the Ebola outbreak, health facility visits for malaria, ARI/pneumonia and watery diarrhoea dropped significantly nation-wide, without returning to pre-Ebola levels post-outbreak. As these morbidities have similar symptom patterns as Ebola, people may have avoided accessing formal health services to avoid being considered "an Ebola case". Second, measles cases increased dramatically by six-fold during Ebola and the immediate post-Ebola periods. This was attributed to cessation of measles vaccination activities during the Ebola outbreak.
The outbreak was declared over in November 2015. Since then, there have been considerable investments into the health system by Government and development partners. One of the limitations of the 2017 study 1 was that it only included the immediate six-month period after the Ebola outbreak, which might have been too early to assess health system recovery or possible improvement. It is now expected that the country would have fully recovered from the outbreak, but there has been no formal evaluation in this regard.
We thus conducted a similar country-wide study assessing morbidity and mortality for the same childhood illnesses using a longer post-Ebola period and compared this data with the preand intra Ebola periods.

Methods
This was a retrospective analysis using routine program data from the District Health Information system (DHIS2) and sourced from all 14 districts in Sierra Leone (see Underlying data 2 ).
The study setting was described in detail before 1 . In brief, the health infrastructure is tiered into tertiary hospitals, district hospitals and Peripheral Health Units (PHUs). PHUs include Community Health Centres (CHCs), Community Health Posts (CHPs) and Maternal and Child Health Posts (MCHPs). The Ministry of Health and Sanitation provides free primary health care for children under five across 1,250 health facilities nationwide.
The study population included all children under-five years attending public health facilities nationwide. No children were excluded. We exported data on health facility visits and mortality for malaria, ARI/pneumonia, watery diarrhoea and measles from the DHIS2 to Microsoft excel (2016) for analysis. Differences between groups were assessed using Pearson's X 2 test (Chi square) for the case fatality and t-tests for the average monthly consultations. Levels of significance were set at P ≤ 0.05.

Ethics and consent
Ethics approval was obtained from the Sierra Leone Ethics and Scientific Review Board (dated 14 December 2018) and the Union Ethics Advisory Group (International Union against Tuberculosis and Lung Disease, Paris, France; EAG number: 68/18). As the study used anonymous data, there was no need for informed consent.

Results
Country-wide trend in out-patient consultations for underfive morbidities Figure 1 shows country-wide trends in outpatient consultations for malaria, ARI/pneumonia, watery diarrhoea and measles. Consultations followed a seasonal pattern with an overall decline during Ebola. In the post-Ebola period (assessed six months after the end of the outbreak), consultations reached pre-Ebola levels. In contrast, measles increased during the last six months of the Ebola outbreak and this trend continued into the post-Ebola period. Average numbers of measles cases were 48/month in the pre-Ebola period, increasing to 87/month in the Ebola period and 568/month (12-fold increase) post-Ebola. Measles cases peaked in March 2017 with 853 cases. Table 1 shows that the observed differences of the pre-Ebola period relative to both the intra-Ebola and post-Ebola periods were statistically significant for all morbidities.
Morbidity and case-fatality for four under-five morbidities Table 2 shows numbers of cases, deaths and case-fatality (per 1,000) for malaria, ARI/pneumonia, watery diarrhoea and measles. During the post-Ebola period, there was a highly significant reduction in case-fatality for the first three morbidities compared to the pre-Ebola period (P<0.0001).
For measles, there was a total of 525 cases pre-Ebola, 962 cases during Ebola and 6,245 cases post-Ebola. Although there was

Amendments from Version 1
We have made some minor edits to formatting and grammar. In addition, in response to reviewers, we have added clarifications in the introductory paragraph on recovery or improvement. We added t-tests to the methods description and disaggregated the analysis of monthly consultation trends across time periods by disease condition. Therefore, Figure 1 now has four components, one for each of the conditions. We added in Table 1 which presents the results of the t-tests for differences in mean monthly consultations for the four conditions. Finally, in the discussion section, we added points on lack of representation in our data and findings of longer term changes in the health system; a description of our finding on the reductions in case fatality from malaria, ARI/pneumonia and watery diarrhoea; an elaboration on the possible explanations for the decline in immunization services; as well as recommendations for future research.

Discussion
This study shows that health facility consultations for malaria, ARI/Pneumonia and watery diarrhoea recovered to pre-Ebola levels and were accompanied by significant country-wide reductions in case-fatality compared to the pre-Ebola period. Despite a dramatic increase in measles cases post-Ebola, there was a significant mortality reduction, suggesting overall improvements in clinical care.
A study strength is that we included data from 1,250 health facilities and for similar periods before, during and after the outbreak. A limitation is that our data did not include private health facilities resulting in possible underestimation of disease burden. In addition, our post-Ebola period was limited to 2017, which may not be representative of long-term changes in systems strengthening.
There were two key findings. First, the reductions in case fatality from malaria, ARI/pneumonia and watery diarrhoea could be associated with post-Ebola health system investments with improved health seeking behaviour. The post-Ebola recovery plan 3 of the Government of Sierra Leone with enhanced financial, technical and training support from partners may also have contributed. Furthermore, community health worker activities including early identification and referrals of ill children were promoted which in turn would contribute to reducing mortality.
Second, increased measles cases during and after Ebola could be attributed to vaccination service cessation during Ebola in line with the recommendation to avoid invasive procedures as a way of minimizing Ebola-related occupational risks 4 . Many children would have missed their measles vaccination, resulting in a reduction in herd immunity as well as an accumulation of unvaccinated children. Measles coverage among children under two years in 2017 (post-Ebola) stood at 80% 5 while pre-Ebola this was at a low 78.6% 6 . This implies that measles vaccination coverage was already below the desired level prior to Ebola, worsened during Ebola and remained below desired levels after Ebola. The decline in immunization services during the Ebola period may have triggered a measles outbreak; however the resumption of immunization services would have contributed to the reduction of the cases in the post-Ebola period. This calls for strategies to increase immunisation coverage to at least 95% 7,8 and to increase in the coverage of the second measles dose taken at 15 months of age.
Future research may consider including additional time periods of 2018-2019 to understand the longer term changes of health systems strengthening efforts on service delivery.
In conclusion, consultations of under-five children at health facilities in Sierra Leone recovered to pre-Ebola levels and casefatality for common childhood illnesses declined significantly. This is a change for the better. However, the high level of reported measles cases in the post-Ebola period needs focused attention.

Vic Arendt
Service National des Maladies Infectieuses, Centre Hospitalier de Luxembourg, Luxembourg City, Luxembourg This article reports the impact of the West African Ebola outbreak in Sierra Leone (from early 2014late 2015) on the number of consultations for common childhood diseases at 1250 health facilities as well as case fatality rates for these diseases. The conclusions are highly relevant regarding the recovery of the health system and the attendance to these facilities after the end of the Ebola epidemic.
Regarding the figures of mortality, the conclusion that the case fatality between pre and postebola periods decreased significantly is clear. Strange enough, however, the mortality from malaria and diarrheal diseases from the pre to intraebola period also decreased a lot and it would be useful to comment on this. Could this be because of mass drug administration for malaria during the outbreak 1 or could it be due to underreporting fever-related death due to fear of being suspected as Ebola cases or other explanations? Or decreased social contacts during the epidemic leading to a decrease in diarrheal diseases?

If applicable, is the statistical analysis and its interpretation appropriate? Yes
Are all the source data underlying the results available to ensure full reproducibility? Yes

Are the conclusions drawn adequately supported by the results? Yes
Competing Interests: No competing interests were disclosed.

School of Public Health and Community Medicine, B.P. Koirala Institute of Health Sciences, Dharan, Nepal
First, during the Ebola outbreak, health facility visits for malaria, ARI/pneumonia and watery diarrhoea dropped significantly nation-wide, without returning to pre-Ebola levels postoutbreak. (Please explain the reason). We thus conducted a similar country-wide study assessing morbidity and mortality for the same childhood illnesses using a longer post-Ebola period. (Can you specify what a longer period means?)

3.
Is DHIS2 is the latest version? (Has it been upgraded?) 4.
Could you discuss the transition period of recovery from Pre-Ebola to Ebola period and how the health system worked during that period so that the reader could correlate with your findings?

If applicable, is the statistical analysis and its interpretation appropriate? Yes
Are all the source data underlying the results available to ensure full reproducibility? Yes

Are the conclusions drawn adequately supported by the results? Yes
Competing Interests: No competing interests were disclosed.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.
Reviewer Report 17 November 2020 https://doi.org/10.5256/f1000research.23885.r74706 © 2020 Stewart A. This is an open access peer review report distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Alex Stewart
College of Life and Environmental Science, University of Exeter, Exeter, UK This is a revised version of a paper examining rates of consultations for childhood illnesses and deaths before, during and after the Ebola outbreak in Sierra Leone. The authors have responded fully to the reviewers' comments on the first submission.
I have no further comment to make. The paper is clear, the results justify the conclusions, and there are considerable implications for health services both in Ebola and other outbreak and pandemic situations.

If applicable, is the statistical analysis and its interpretation appropriate? Yes
Are all the source data underlying the results available to ensure full reproducibility? Yes

Are the conclusions drawn adequately supported by the results? Yes
Yes Are the conclusions drawn adequately supported by the results? Yes changes to community confidence in the health system. Such speculations need to be clearly framed as such.
Overall, this paper could be made far stronger and more valuable with the addition of just a few additional basic statistical analyses that were more aligned with the conclusions the authors which to highlight in the discussion. This analysis could likely be done while preserving the admirable conciseness and brevity of the paper.

Specific notes:
Introduction, "to early to assess...": Could this not just be recovery, but also improvements, as significant investments followed the Ebola outbreak. ○ Discussion, "First, the reductions in case fatality...": There is not really any evidence for this association in the paper, it should be, at the very least, more clear this is speculation. ○ Discussion, "Second, increased measles cases...": If this is going to be said it needs to be better supported by the statistical analysis in the paper. ○ Discussion, "In conclusion, consultations...": This was not explicitly tested in the analysis, so I am not sure it can be concluded.

If applicable, is the statistical analysis and its interpretation appropriate? Partly
Are all the source data underlying the results available to ensure full reproducibility? Yes

Are the conclusions drawn adequately supported by the results? No
Competing Interests: No competing interests were disclosed.
Reviewer Expertise: Epidemiology, statistics, infectious disease dynamics I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Author Response 09 Dec 2019
Tom Sesay, Ministry of Health and sanitation, Sierra Leone

Author Response to Reviewer Report for Version 1 from Justin Lessler 28 Oct 2019
Thank you for your thoughtful review of the manuscript and your suggestions. We have responded as below.
1. Reviewer comment:"Paediatric morbidity and mortality in Sierra Leone. Have things changed after the 2014/2015 Ebola outbreak?" provides a straight forward analysis of changes in reports of, and mortality from, four diseases before, during and after the 2014/2015 Ebola outbreak based on data from DHIS2 in Sierra Leone. The report provides simple, but important, statistics on morbidity and mortality for malaria, ARI/pneumonia, watery diarrhea, and measles.

Response:
Thank you for this comment.

Reviewer comment: While the data and analysis is important, I have some significant concerns with the statistical analysis and interpretation of the results.
Statistics: While the use of chi-squared test to identify that significant differences in mortality exist is appropriate, it only is being used to compare pre-and post Ebola periods and does not help with evaluation of the size of the changes. I would suggest the authors instead select a reference period and report relative rates and confidence intervals, so the data can be better understood. Further, the authors do not perform statistical tests to support some of their statements, some of which are noted below. More tests for differences in reported rates between periods and some analysis of changes in the Ebola period would better support their conclusions.

Response:
Thank you for this point. We have performed t-tests for the differences in the mean monthly cases of the intra-Ebola and post-Ebola periods relative to the pre-Ebola period at a level of significance of 5%. We have also updated the figures by disease condition, which better displays the differences between the periods.

Reviewer comment:Interpretation:
The authors make several statements in the discussion and abstract that do not correspond to the analyses done. For instance, they make statements regarding trends in case reports, but perform no statistical test as to whether between period changes in reports are significant. Further, in some cases they frame speculation as a key finding of the paper, such as when they attribute changes to community confidence in the health system. Such speculations need to be clearly framed as such.

Response:
We have taken note of this comment and, accordingly, removed comments that could be considered as speculations.
4. Reviewer comment:Overall, this paper could be made far stronger and more valuable with the addition of just a few additional basic statistical analyses that were more aligned with the conclusions the authors which to highlight in the discussion. This analysis could likely be done while preserving the admirable conciseness and brevity of the paper.

Response:
We have included the basic statistical tests to test the statistical significance of differences between periods, as mentioned above.
5. Reviewer comment:Introduction, "to early to assess...": Could this not just be recovery, but also improvements, as significant investments followed the Ebola outbreak.

Response:
This comment is noted, and we have added in a phrase on possible improvements.
6. Reviewer comment:Discussion, "First, the reductions in case fatality..." There is not really any evidence for this association in the paper, it should be, at the very least, more clear this is speculation.

Response:
The reductions in case fatality were indicated by a Chi-square test of the difference between the pre-Ebola and the post-Ebola period which showed a significant reduction in case fatality in the post-Ebola period.
7. Reviewer comment:Discussion, "Second, increased measles cases...": If this is going to be said it needs to be better supported by the statistical analysis in the paper.

Response:
We have included a t-test of the average monthly measles cases, which showed significant increase in the number of measles cases between the pre-Ebola and post-Ebola periods.
8. Reviewer comment:Discussion, "In conclusion, consultations...": This was not explicitly tested in the analysis, so I am not sure it can be concluded.
term post-Ebola period through 2018 which would better capture the more sustainable health system in Sierra Leone rather than the one served by a short-term, high-volume influx of external funding.
Aside from the clear spikes in measles consultations, Figure 1 is difficult to interpret when displayed by time period. The differences may be more impactful if compared by disease instead.

○
The analysis supports the conclusion that measles surged during and post-Ebola and this is backed up by other research and program documentation. However, it does not necessarily support the recommendation to extend the cut off age for vaccination. The recommendation to conduct laboratory confirmation for measles is also not necessarily supported by the data presented. Is this because a number of the measles outbreaks were determined to be rubella which is currently not on the vaccine schedule? If yes, this should be documented by the data. What would be the impact on measles morbidity if there was increased diagnostic versus syndromic management of measles? ○ Is the work clearly and accurately presented and does it cite the current literature? Partly

If applicable, is the statistical analysis and its interpretation appropriate? Yes
Are all the source data underlying the results available to ensure full reproducibility? Yes

Author Response to Reviewer Report for Version 1 from Sara Hersey 08 Oct 2019
Thank you for your thoughtful review of the manuscript and your insightful suggestions. We have responded as below.
1. Reviewer comment:The authors of this paper have looked at trends in the pediatric morbidity and mortality prior to, during and after the 2014-15 Ebola outbreak in West Africa. The impact of large scale outbreaks on health systems remains a critical area of research, and the authors should be congratulated in contributing to this area of work. The comments below are intended to better contextualize the analysis and conclusions proposed by the authors.

Response:
Thank you for recognising the importance of this study and its contribution to knowledge about the impact of the 2014/15 Ebola outbreak. During the 'post-Ebola' time period in the paper, there was an enormous influx of funding to improve health systems at both the facility and community levels that was organized under the Presidential Recovery Plan. This funding supported the national and sub-national health systems but was also supplemented by NGO and other nongovernmental health services. By the end of 2017, there were substantial reductions in the funds available for health systems and service delivery.

Reviewer comment
The continued specter of Ebola transmission and the rapid scale-up in health resources likely had both negative and positive impacts on health systems utilization that are difficult to quantify. The authors have documented significantly lower case fatality rates for three diseases than the pre-Ebola time period which would support the conclusion that there was regained community trust in the health services. However, those services were not the same ones available prior to the Ebola outbreak and the services are difficult to maintain with reduced external resources.
In order to compare the pre and post-Ebola periods, I would recommend that the analysis be extended to the immediate post-Ebola period included in this paper as well as a longer-term post-Ebola period through 2018 which would better capture the more sustainable health system in Sierra Leone rather than the one served by a short-term, high-volume influx of external funding.

Response:
Thank you for this recommendation which we do understand and accept. We do