Keywords
Community health worker, performance evaluation, Swaziland, rural health motivator
Community health worker, performance evaluation, Swaziland, rural health motivator
Many low-and middle-income countries, particularly in sub-Saharan Africa, face a severe shortage of skilled healthcare workers1. Community health workers (CHWs) are increasingly being used to address this shortage of more extensively trained health workers in order to increase access to primary healthcare services2,3. While there has been a recent policy interest in designing, implementing, and evaluating new CHW programs4–8, many large CHW programs that have existed for decades have not yet been rigorously evaluated. One such program is Swaziland’s national CHW program, known as the rural health motivator (RHM) program. Existing since 1976, the RHM program currently employs over 5,000 RHMs and aims to cover every household in the nation with basic primary healthcare and health information9.
HIV is causing the highest burden of any disease in Swaziland10, and is a major challenge to the country’s health system. UNAIDS and the World Health Organization recently set a new goal for ending the HIV epidemic: the 90-90-90 target11. Under this target, countries aim to ensure that, by 2020, 90% of people living with HIV know their HIV status, 90% of all people whose HIV infection has been diagnosed receive sustained antiretroviral therapy (ART), and 90% of all those receiving ART are virally suppressed. Expanded utilization of CHWs is considered essential to achieving this goal12, particularly through offering community-based HIV testing and shifting certain components of long-term ART care from healthcare facilities to the community, for example through ART home delivery13–16. Yet, while RHMs are providing many HIV-relevant services, including the provision of condoms, information on HIV, and following up with pre-ART and ART patients who have missed an HIV care appointment17, HIV treatment and care in Swaziland is still largely facility-based. Successful shifting of further HIV testing, treatment and care tasks from healthcare facilities to RHMs would likely require the RHM program to perform reliably and at a high level. Using the CHW Performance Logic Model as an evaluation framework18, this study therefore aims to (i) assess the performance of the RHM program, and (ii) identify ways in which program performance can be improved.
This study was conducted in the Lubombo and Manzini regions, which are two of Swaziland’s four administrative regions. Shiselweni and Lubombo are the most rural and poorest regions in Swaziland, while Manzini and Hhohho are comparatively more urban and wealthy19,20. In the latest census from 2007, 206,400 people lived in Lubombo and 313,900 in Manzini, jointly accounting for 52% of Swaziland’s total population19. According to Swaziland’s last HIV incidence and measurement survey21,22, conducted in 2010 and 2011, adult HIV prevalence was 32.4% in Lubombo and 33.6% in Manzini region. The corresponding national estimate was 32.1%.
A number of CHW programs are currently active in Swaziland. At the time of the study, all CHW programs other than the RHM program had a cadre of less than 50 CHWs. While this study also collected data on three non-RHM CHW programs (the HIV expert client program, the Mothers2Mothers mentors, and a community outreach team for HIV-testing and voluntary male medical circumcision), this manuscript focuses on the RHM program given its size, and thus importance to Swaziland’s health system.
Established in 1976, the RHM program employed 5,214 RHMs in 2015. As per their official job responsibilities, RHMs are assigned the following activities during their household visits: 1) referring ill household members to a healthcare facility; 2) providing health information on a variety of health topics; 3) providing condoms; 4) encouraging household members to take up preventive healthcare services and antenatal care; 5) follow up with those community members who have missed an HIV care appointment at the healthcare facility; 6) attending medical emergencies (e.g., emergency deliveries); 7) assisting with growth monitoring programs of children under five years of age; 8) dietary counseling; and 9) promoting adult literacy17. RHMs are instructed to visit 25 households assigned to them at least once a month.
Quantitative data were collected through a population-based household survey and a questionnaire for RHMs (Supplementary File 1 and Supplementary File 2). The household survey employed two-stage stratified cluster random sampling. In the first stage, we selected a random sample of 50 enumeration areas (EAs) in each Lubombo and Manzini. In each region, 37 of the enumeration areas were classified as rural by the Swaziland Statistics Office, and 13 as urban. In each EA, we selected 20 households through systematic random sampling. Data collectors administered a questionnaire in SiSwati to each household member aged 11 years or older who was present at the time of the household visit and who provided written consent to participate in the survey. Due to feasibility constraints, the data collection team did not revisit households if no household members were present at the time of the visit.
The RHM questionnaire was administered in SiSwati to all RHMs working in the EAs that were selected for the household survey. Since the EAs selected for the household survey were only a relatively small subsample of all EAs in the Lubombo and Manzini region of Swaziland, 306 (12.0%) out of a total of 2,543 RHMs in these two regions were interviewed. The RHM questionnaire was administered at the RHM’s household by the same cadre of data collectors, which conducted the household survey.
Both the household and RHM survey were conducted between June 2015 and September 2015. Quantitative analyses consisted of descriptive statistics (means and proportions) and were conducted in Stata version 13.0 (College Station, TX, USA).
Qualitative data were collected through semi-structured interviews with 25 RHMs (Supplementary File 3). These RHMs comprised a criterion-based stratified purposive sample. Strata used were region (13 RHMs from Manzini and 12 from Lubombo region) and urban versus rural (13 from rural areas and 12 from urban areas in each region). Additional sampling criteria were age and sex of RHMs, attempting to yield a sample that is similar to the age and sex distribution of the RHM cadre in general. In addition, we conducted semi-structured qualitative interviews with the chief RHM program manager in the program office in Mbabane, Swaziland, and five RHM trainers in the regional offices of the RHM program.
Five recent graduates of the University of Swaziland Social Science Program who were fluent in SiSwati and English conducted the interviews. The data collectors were Swazi and aged between 20 and 35 years. The interviews lasted between 30 and 45 minutes and were conducted in SiSwati. The interviewers taped the interviews, and transcribed them verbatim in SiSwati. The transcripts were then translated into English by the local study coordinator, who is also an author of this paper (MM). He also conducted a quality check of each transcript. Two authors (MV and PG) conducted content analysis using an inductive approach to coding23. We identified broad themes after an initial review of the data, and then conducted iterative reviews to further refine themes and their relationships to each other. All coding was done using NVivo 11 (QSR International, Melbourne, Australia).
The evaluation framework that was used for this performance evaluation is the CHW Performance Logic Model (Figure 1), which has been described in detail elsewhere18. The model was used to inform the design of the questionnaires and interview guides. More specifically, the data collection tools contained questions on the dimensions (white rectangles in Figure 1), which in turn were grouped under sections corresponding to the dimensions of the model (results, activities, and inputs). Questions in the household survey questionnaire focused on CHW program outcomes by asking about the household members’ experiences with the RMH program and the degree to which they sought care from RHMs. Meanwhile the RHM questionnaire focused on CHW program outputs (e.g., self-reported performance, and job satisfaction and motivation), and support provided to RHMs by the community and health system (and actors within these systems). Data on inputs was obtained from program reports and personal meetings with the RHM program management. We have structured the results section according to the logic model dimensions, moving from the inside (CHW performance outcomes) to the outside (inputs) of the model depicted in Figure 1.
Adapted from Naimoli et al.18
This study was approved by the Swaziland Ethics Committee on March 31st 2015 (reference number: MH/599C/FWA 000 15267/IRB 000 9688), and received an exemption by the institutional review board of the Harvard T. H. Chan School of Public Health on March 31st 2015. Written informed consent was obtained from all study participants.
The RHM questionnaire was administered to a total of 306 RHMs, 96.1% of whom were female (Table 1). On average, RHMs were 52.9 years old (SD: 11.6 years) with 16 RHMs (5.2%) older than 70 years. RHMs had lived in their communities for an average of 34.6 years (SD: 16.5 years) and had worked in the RHM program for 15.5 years (SD: 12.9 years). 30.5% of RHMs reported to have done work other than for the RHM program during the previous 12 months. The characteristics of the 25 RHMs with whom we conducted semi-structured qualitative interviews were similar to those of the sample of RHMs who were included in the RHM survey. The population-based household survey was administered to 2,342 household members across 2,000 households. 97.7% of household survey respondents had lived in the surveyed community for more than one year.
As described in the methods, we assessed performance of the RHM program on the output and outcome level of the CHW Performance Logic Model18. Table 2 summarizes our quantitative findings.
Outcomes: Satisfaction with the RHM program. Household survey respondents’ overall satisfaction with RHM services was mixed, with 46.3% of respondents rating their satisfaction as greater or equal to eight on a 10-point scale ranging from very dissatisfied to very satisfied (Table 2 and Figure 2). 20.4% of respondents rated their satisfaction as less than five on this scale. Nonetheless, the vast majority (96.1%) of respondents would recommend the RHM program to other communities.
Outcome level | Percentage/Mean (95% CI) |
---|---|
Satisfaction with the RHM program | |
% of community members1 satisfied with the services provided by the RHMs in their community2 | 46.3 (43.4 – 49.6) |
% of community members1 satisfied with the accessibility of the RHMs in their community2 | 49.8 (46.6 – 53.1) |
% of community members1 satisfied with the quality of the advice and care given by the RHMs in their community2 | 49.4 (46.1 – 52.7) |
% of community members1 who would recommend the RHM program to other communities2 | 96.1 (94.6 – 97.2) |
Care-seeking | |
% of RHMs who report that they have been approached by community members for help or advice | 76.7 (71.3 – 81.1) |
RHMs’ standing in the community | |
% of RHMs reporting that the RHM program increased their community standing | 74.3 (68.2 – 78.4) |
Output level | Percentage/Mean (95% CI) |
Quantity of work performed | |
Mean no. of households RHMs report to have been assigned | 29.8 (28.14 – 31.49) |
% of RHMs who report to have visited all assigned households in the last one month | 15.7 (11.4 – 20.4) |
% of RHMs who report to have visited all assigned households in the last six months | 57.8 (50.8 – 64.6) |
% of RHMs reporting to take off frequently 2 weeks or more | 7.6 (4.8 – 11.1) |
% of RHMs who agree or strongly agree that the amount of work they are expected to finish each week is reasonable | 92.1 (88.4 – 94.8) |
Job satisfaction | |
% of RHMs who are satisfied or very satisfied with their job | 92.4 (88.7 – 95.1) |
% of RHMs who are proud to be working for the RHM program | 95.0 (91.9 – 97.2) |
% of RHMs who would recommend the RHM program to others as a good organization to work for | 93.7 (90.3 – 96.2) |
% of RHMs who are glad to be working for the RHM program rather than other CHW programs | 92.0 (88.4 – 94.8) |
% of RHMs who occasionally or often think about leaving their job | 26.2 (21.3 – 31.5) |
1This question was only asked to household survey respondents who reported that their household had ever been visited by a RHM (n=1, 151). 2Satisfaction was measured on a scale ranging from 1 (“very dissatisfied”) to 10 (“very satisfied”).
Outcomes: Care-seeking from RHMs. 76.7% of RHMs indicated that households had approached them for help or advice. However, in the qualitative interviews, a topic that emerged is that although households did approach RHMs, it was either rare or infrequent. In cases where RHMs were approached, it was usually for acute emergency care:
Interviewer: “How often are you contacted for help or advice?”
RHM: “It is rare … sometimes when someone is in labor then they call me for help” (Manzini)
In the less common scenario where RHMs indicated that they were contacted frequently, it tended to be for material assistance such as medication, diapers, or gloves:
Interviewer: “How often are you contacted for help or advice?”
RHM: “About 3 times a week. They usually want disposable diapers, gloves, or ORS [oral rehydration therapy]” (Lubombo)
Outcomes: RHMs’ standing in the community. In general, RHMs felt that their standing within their communities had increased as a result of them being part of the RHM program. 74.3% indicated that their standing had increased, while only 16.5% stated that their standing had decreased, with the remainder answering that their standing had remained unchanged. In the qualitative interviews, when asked about the effect of their work as a RHM on their community standing, RHMs who indicated an increase in community standing suggested that RHMs’ responsibilities mean that community members respect them more. In cases where RHMs indicated that their community standing remained unchanged or had decreased, these were accompanied by the perception that they did not meet the expectations of community members:
“No, I think [my community standing] is the same especially because people complain that we do not bring them anything except information; they want material things” (RHM, Lubombo)
Outputs: Quantity of work performed. According to the RHM program management, RHMs are responsible for 25 households, which they are to visit at least once a month. In the RHM survey, RHMs reported to be responsible for visiting an average of 29.8 households. Less than a quarter of RHMs (15.7%) reported to have visited all households assigned to them in the last one month, and 57.8% stated they had visited all assigned households at least once in the last six months. The vast majority of RHMs (92.1%) reported that the workload expected of them is reasonable.
Part of the qualitative interviews with RHMs focused on the reasons for not being able to visit all assigned households at least once a month. Four main factors were mentioned most frequently by RHMs: 1) the availability of the client, 2) physical distance to the household, 3) clients’ acceptability of the RHMs, and 4) the inability of RHMs to meet the expectations of some clients. Typical quotes illustrating each of these factors are:
Client availability: “Sometimes there are no people in the household I visit and I have to return on another day” (RHM, Lubombo)
Physical distance to the household: “I find it to be very easy since the households I am responsible for are nearby and I do not need to walk a long distance” (RHM, Manzini)
Acceptability of RHMs: “It is easiest with the homes where people are educated about the health issues and understand our work as RHMs; in homes where this is not the case, they are normally hostile towards us…” (RHM, Manzini)
Inability to meet clients’ expectations: “It is very difficult… people expect motivators to come with material things like [disposable diapers] napkins for their bedridden relatives, but we do not have these things. This disappoints the people and they start to develop an attitude towards us.” (RHM, Manzini)
Outputs: Job satisfaction. Roughly half of RHMs reported to be satisfied or very satisfied with their job. Most RHMs (93.7%) would recommend the RHM program as a good organization to work for, and 95.0% of RHMs answered that they were proud to be working for the RHM program. Roughly a quarter (26.2%) of RHMs reported to occasionally or often think about leaving their job.
Table 3 summarizes the results for the indicators used to evaluate program-level activities (as defined by the CHW Performance Logic Model18).
Social Support | Percentage (95% CI) |
---|---|
Community | |
RHMs who expressed that their community is somewhat supportive or very supportive of their work | 89.8 (85.8 – 93.0) |
RHMs who received the following types of support from their community | |
Verbal support | 95.1 (92.0 – 97.2) |
Financial support | 3.3 (1.6 – 6.0) |
Equipment for work | 9.2 (6.2 – 13.0) |
In-kind support | 10.9 (7.6 – 14.9) |
Special privileges | 5.9 (3.5 – 9.2) |
Facility | |
RHMs who interact regularly with facility-based healthcare workers | 93.0 (89.5 – 95.6) |
RHMs who expressed that facility-based healthcare workers were somewhat supportive or very supportive of their work1 | 96.5 (93.6 – 98.3) |
RHMs who felt that the facility-based healthcare workers value their work1 | 95.4 (92.3 – 97.5) |
Family | |
RHMs who expressed that their families were somewhat supportive or very supportive of their work | 95.7 (92.7 – 97.7) |
Technical Support | |
RHMs who indicated that their job responsibilities were either well explained or very well explained to them | 99.0 (97.1 – 99.8) |
RHMs who either agreed or strongly agreed that they received all the training necessary for them to perform their jobs | 94.7 (91.5 – 96.9) |
RHMs who rated the quality of their in-service training as being high2 | 81.9 (76.8 – 86.2) |
Incentives | |
Monetary | |
RHMs reporting to not being paid for their work | 11.4 (8.1 – 15.5) |
RHMs who disagree or strongly disagree with the statement “Given the amount of work I do as a RHM, I am being paid a fair amount” | 57.8 (50.0 – 63.4) |
Non-monetary | |
RHMs who received any non-monetary payments from the program | 11.5 (8.1 – 15.6) |
RHMs who reported to have received the following types of non-monetary payments from the program3 | |
Food | 17.1 (6.6 – 33.6) |
Livestock | 5.7 (0.6 – 19.2) |
Free access to social support services | 22.9 (10.4 – 40.1) |
Equipment (e.g., mobile phones and uniforms) | 35.3 (19.7 – 53.5) |
Exemption from other community duties | 37.1 (21.5 – 55.1) |
Abbreviations: RHM=rural health motivator.
1 This question was only asked if the RHM reported to have regularly interacted with facility-based healthcare workers (93.0%).
2 This was defined as reporting ≥8 on a 10-point scale from “very bad quality” to “very high quality”.
3 The denominator for these percentages is the number of RHMs who reported having received non-monetary payments from the program.
Social support. The majority of RHMs indicated that they were somewhat or very well supported by members in their communities (89.8%), by their families (95.7%), and by facility-based healthcare workers (96.5%). The vast majority of RHMs (95.4%) felt that facility-based colleagues value their work.
Technical support. The initial training for new RHMs lasts 12 weeks full-time. In addition, the program runs in-service trainings, which re-emphasize certain topics taught during the initial training and usually also cover some new material. These refresher trainings last for two to five days and are conducted once a year for each RHM. Only 10.5% of RHMs surveyed reported to never have attended an in-service training. Most RHMs (94.7%) either agreed (48.3%) or strongly agreed (46.4%) that the training provided by the program is sufficient to competently perform their work as a RHM. 81.9% rated the quality of their in-service training as being high.
Incentives. The majority of RHMs expressed dissatisfaction with the compensation offered. 57.8% either disagreed (38.0%) or strongly disagreed (19.8%) with the statement that “Given the amount of work I do as a rural health motivator, I am being paid a fair amount”. This is also reflected in the qualitative data, in which RHMs frequently mentioned that they do not feel that they are sufficiently compensated. A typical opinion expressed in this regard is:
“I do not feel I am being paid a fair amount because there is a lot of work that we do. Sometimes the families desert the ill patients and leave them in their own dirt until the day a RHM comes along and bathes the patient, feeds them....so the work is quite a lot” (RHM, Lubombo)
Very few RHMs reported to have received non-monetary compensation from the RHM program.
Table 4 summarizes the results for the indicators used to evaluate system-level activities.
Leadership and governance. Among RHMs, 55.8% agreed and 41.9% strongly agreed that the RHM program management was supportive of their work. Most either agreed (53.0%) or strongly agreed (44.0%) with the statement that “the RHM program rules make it easy for me to do a good job”. Similarly, virtually all RHMs (97.0%) expressed that it was generally easy to communicate with members from all levels of the RHM program. Concerning supervision, 91.8% of RHMs indicated that supervisors provide feedback on their work. While 76.0% of RHMs were satisfied (58.6%) or very satisfied (17.4%) with the level of supervision that they receive, 65.3% indicated that they would like to receive more supervision. Qualitatively, in cases where RHMs expressed interest in additional supervision, the reason tended to be that they felt additional feedback would help motivate them further and support continued learning, as illustrated by the following quote:
“I would like more supervision because it would help me learn and grow my skills as a RHM. Additionally, it helps to keep me motivated and to put in more effort in my work” (RHM, Manzini)
Provision of material resources. 60.6% of RHMs either disagreed (40.1%) or strongly disagreed (20.5%) that the program provides all the equipment, supplies, and material resources necessary to perform their duties.
Human resources. The RHM program had 5,214 RHMs in 2015, of which roughly half (2,803) lived and worked in the Lubombo or Manzini region. In addition, the program had one program manager, one program officer, one administrative assistant, 18 RHM trainers (who are trained nurses), and two drivers.
Capital resources The RHM program occupies four offices in the country, one in each of Swaziland’s four regions. The program also owns two cars.
Costs. Table 5 shows the running costs of the RHM program for 2011 using data from the Kingdom of Swaziland Budget versus Expenditure Report 201224, which was the latest data available to us. We present these costs in terms of purchasing power parity dollars (PPP$). One PPP$ is calculated such that it had the same purchasing power in Swaziland in 2011 as one US dollar had in the United States in that year. Roughly two thirds of the program costs are spent on salaries for the RHMs. As of 2015, RHMs earned 350 Swazi Lilangeni per month, which is approximately US$ 22.50 (PPP$ 73.22).
Cost item | PPP$1 |
---|---|
Human resources | |
RHM salaries2 | 10,006,500 |
Head office (program manager, program officer, drivers) | 106,529 |
Capital resources | 766,238 |
RHM uniforms | 251,038 |
RHM training | 4,078,071 |
Total | 15,208,376 |
Abbreviations: PPP$ = Purchasing power parity-adjusted dollars; RHM, rural health motivator.
1 This is the PPP$ value for 2011 (i.e., not further adjusted for inflation since 2011). The PPP
conversion factor for Swaziland for 2011 was obtained from the United Nations Statistics Division29.
2 In 2011, the RHM program employed 4,765 RHMs.
This evaluation identified a number of weaknesses in the RHM program’s performance. First, despite being in close geographic proximity to their clients, the Swazi population appears to prefer seeking care from other healthcare workers than the RHM cadre. As found in particular through our qualitative interviews, community members rarely seek care from RHMs, and if they do, this tends to be for emergency care when care from other health care providers is unavailable. Second, client satisfaction with the RHM program appears to be comparatively low. The survey data on client satisfaction is likely to suffer from some degree of courtesy or social desirability bias whereby community members give a more favorable assessment of the RHMs’ care to abide by a perceived social norm of showing satisfaction and gratitude rather than criticism25. Despite the possibility of this bias, a comparatively low proportion (46.3%) of community members rated their overall satisfaction with RHM services as eight or more points on a 10-point scale ranging from very dissatisfied to very satisfied. Third, RHMs do not appear to provide the quantity of care that the program aims to provide. Data on the number of households visited by RHMs are self-reported and may, thus, also suffer from an upward bias as RHMs are likely to want to appear as fulfilling their duties. Despite this likely bias, only 15.7% of RHMs reported achieving the program target of visiting all assigned households at least once a month. Overall, improving the performance of the RHM cadre may be necessary to successfully shift HIV care tasks from facility-based to RHM-led care.
Our assessment of the RHM program on the program- and system-level dimensions of the CHW Performance Logic Model provides some insight into factors that might be lowering RHM performance. In general, RHMs report that they are satisfied with the quantity and quality of training and supervision provided to them. However, RHMs are dissatisfied with the level of monetary compensation, with 57.8% of RHMs indicating that the level of their pay is unfair given the amount of work they do. In 2015, RHMs earned 350 Swazi Lilangeni (approximately US$ 22.50) per month. Additionally, in the qualitative interviews, RHMs reported that they face transport costs and bank fees to collect and cash their paycheck. Swaziland’s national poverty line lies at US$ 3.10 per day26. Ignoring costs to collect and cash their paycheck, RHMs earn approximately US$ 0.74 per day, which is only 23.9% of the daily income needed to be earning at the national poverty line. Expectations of RHM performance need to be examined in light of this comparatively low level of pay. The low pay is likely also an obstacle for shifting HIV care tasks to RHMs, as many of these tasks, such as ART home-delivery, require reliable and constant care. A theme arising from our qualitative interviews, however, was that RHMs view themselves as volunteers rather than employees given their low level of pay. It would thus seem likely that other income-generating activities take priority over RHM work, which in turn may lead to prolonged gaps in RHM care delivery.
Apart from monetary compensation, RHMs were also dissatisfied with the material resources provided to them by the RHM program for performing their duties. In the qualitative interviews, RHMs frequently mentioned that community members expect them to provide certain material resources, such as diapers, medications (particularly paracetamol), bandages, and disposable gloves. RHMs felt that not being able to meet this expectation was an important barrier in maintaining a good relationship with the community, and to cover the households that they were assigned. Thus, providing the expected material resources to RHMs and/or altering the expectations of community members to receive such resources from RHMs may increase RHM performance. Improving the RHM-client relationship is of particular importance if RHMs are to provide more HIV care given the continued high HIV-related stigma in Swaziland27.
We used the CHW Performance Logic Model to guide this performance evaluation. While the logic model aims to be a useful tool for planning, consensus-building, implementation, and evaluation of CHW programs18, we can only comment on our experience with the model’s usefulness for CHW program evaluations. A key characteristic of the model is that it tries to comprehensively include all factors that may influence CHW performance. As such, the logic model differs strongly from the more simplistic framework of inputs – processes – outputs that we have previously used for a performance evaluation of a CHW program in Dar es Salaam, Tanzania28. In our view, the comprehensive nature of the logic model is its key strength. Given the sheer number of possible factors that may plausibly influence CHW program performance, most evaluators will have to make a decision regarding the scope of their evaluation. The CHW Performance Logic Model could help evaluators clearly define the evaluation’s scope, and be more explicit about their choice of which factors and domains they include in the evaluation. Nonetheless, the model’s comprehensive nature could be a disadvantage if evaluators find the number of possible factors to evaluate overwhelming. In our view, the main disadvantage of the model is that it does not provide any guidance to evaluators on which factors are the most important determinants of CHW performance. As such, a prioritization of the categories and factors in the model based on relevant theory and evidence, rather than an un-weighted list of all factors that plausibly influence CHW performance, would substantially improve the utility of the model. Another limitation of the model is that many of the performance measures and factors assessed under the model’s dimensions lack established measures and scales. In addition, there are doubts as to whether a dimension is measured appropriately, which also results in some degree of subjectivity in interpreting what level of CHW program performance the observed achievement on a measure represents.
Other limitations of this study include that the data from the RHM questionnaire are likely to suffer from a degree of self-reporting bias whereby RHMs may, for example, over-report aspects of their work that they perceive as desirable (e.g., the number of households visited). Similarly, household survey respondents may have been hesitant to express criticism of RHMs because they wanted to maintain a good relationship with the RHMs (who are fellow community members chosen by the community and the village chiefs), or simply due to an intrinsic tendency to be courteous. Lastly, while the RHM program is a national program, this assessment has focused on only two of four regions in Swaziland due to feasibility constraints. However, these two regions constitute more than half (52%) of Swaziland’s population, and the program structures for management and implementation of the RHM cadre do not differ between regions. We, therefore, feel confident that the findings of this study apply to the RHM program as a whole.
This evaluation found that the RHM program does not meet some of its performance targets. For instance, RHMs are currently not an important point of first call for seeking care for an illness, and the RHMs do not appear to achieve their household coverage target. If the RHM program is to adopt specific HIV-related tasks, then Swaziland’s HIV response would likely benefit from policy and management changes aimed at improving RHM performance. While it is beyond the purview of this study to provide an exhaustive list of suitable reforms, two simple changes identified by this evaluation that may lead to an improvement in RHM performance are i) an increase in monetary compensation, and ii) the provision of material resources to RHMs (e.g., paracetamol, diapers, and bandages) to enable RHMs to meet their community’s expectations.
Please note that some items have been removed/edited due to potentially identifiable information. The datasets contain both CSV and .dta files.
Dataset 1: Household (head and member) survey raw data. doi, 10.5256/f1000research.11361.d15877730
Dataset 2: Rural health motivator survey raw data. doi, 10.5256/f1000research.11361.d15877831
Qualitative interview manuscripts are not shared publicly because they cannot be effectively de-identified given the relatively small number of staff involved in the studied community health worker programs. Individuals interested in accessing the transcripts should contact the corresponding author.
PG and MV analyzed the data and wrote the first draft of the manuscript. The authors (PG, MV, JWD, TB, TJB) jointly designed the study and data collection tools. All authors (PG, MV, JWD, TB, TJB) provided important edits to the manuscript and approved the final version.
Data used in this study were collected for other activities supported by the American people through the United States Agency for International Development (USAID) with funding from the U.S. President’s Emergency Plan for AIDS Relief (PEPFAR). The data were collected by the Harvard T.H. Chan School of Public Health through the USAID Applying Science to Strengthen and Improve Systems (ASSIST) Project. The USAID ASSIST Project is managed by University Research Co., LLC (URC) under the terms of Cooperative Agreement AID-OAA-A-12-00101. The authors’ views expressed in this paper do not necessarily reflect the views of USAID or the United States Government.
The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript
Supplementary File 1: Household survey questionnaires consisting of a questionnaire for all household members aged 11 years and older and an additional questionnaire for the household head.
Click here to access the data.
Supplementary File 2: Questionnaire for the survey of rural health motivators.
Click here to access the data.
Supplementary File 3: Interview guide for RHMs, RHM trainers, and the RHM program management.
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
No
If applicable, is the statistical analysis and its interpretation appropriate?
Partly
Are all the source data underlying the results available to ensure full reproducibility?
No
Are the conclusions drawn adequately supported by the results?
Partly
Competing Interests: No competing interests were disclosed.
Is the work clearly and accurately presented and does it cite the current literature?
Partly
Is the study design appropriate and is the work technically sound?
Partly
Are sufficient details of methods and analysis provided to allow replication by others?
No
If applicable, is the statistical analysis and its interpretation appropriate?
No
Are all the source data underlying the results available to ensure full reproducibility?
Partly
Are the conclusions drawn adequately supported by the results?
Partly
References
1. Karim AM, Admassu K, Schellenberg J, Alemu H, et al.: Effect of ethiopia's health extension program on maternal and newborn health care practices in 101 rural districts: a dose-response study.PLoS One. 2013; 8 (6): e65160 PubMed Abstract | Publisher Full TextCompeting Interests: No competing interests were disclosed.
Reviewer Expertise: Applications of Psychology to Global Health. Namely, Oganisational Psychology, Global Mental Health, Psychotraumatology, and Latent Variable Modelling,
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 1 02 May 17 |
read | read |
Click here to access the data.
Spreadsheet data files may not format correctly if your computer is using different default delimiters (symbols used to separate values into separate cells) - a spreadsheet created in one region is sometimes misinterpreted by computers in other regions. You can change the regional settings on your computer so that the spreadsheet can be interpreted correctly.
Click here to access the data.
Spreadsheet data files may not format correctly if your computer is using different default delimiters (symbols used to separate values into separate cells) - a spreadsheet created in one region is sometimes misinterpreted by computers in other regions. You can change the regional settings on your computer so that the spreadsheet can be interpreted correctly.
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)