Keywords
Questionnaire, health services quality, health professionals and amenities
Questionnaire, health services quality, health professionals and amenities
Patient satisfaction has been increasingly used as a quality indicator in health care1. The theoretical concept of satisfaction is controversial, but the user relates it with the set of reactions experienced2. Therefore, the measurement of customer satisfaction should be considered as a personal opinion of health care services that are provided. One of the most used measures3 is the difference between the expectations of the user in relation to the care and their perception of the care actually received. Indeed, it is expected that the patients, throughout their experiences, build a set of beliefs about the health system and professionals. The importance of attending to this type of belief has implications for the quality of communication with health professionals, the degree of trust in health care service delivery and customer satisfaction with the care provided. The aim of this study was to determine the personal assessment of inpatients or their representatives regarding aspects of health care in an internal medicine ward.
Several sources and methods were used to determine the questions to be included in the questionnaire. Firstly, a search was conducted using the Medline database with the aim of evaluating the tools that have been developed so far to assess the satisfaction of patients hospitalized4. Secondly, focus groups of patients, caregivers and health care professionals were used to explore opinions about the positive and negative aspects of care received during hospitalizations. These focus groups were geared towards understanding the issues and expressions that could be used to develop questions to be included in the questionnaire. Thirdly, we developed a pool of items, based on the results of the focus groups and literature search, to be included in the questionnaire. These items were tested with a group of patients and health professionals, and they gave their opinions about the appropriateness of the items and the skills needed to comprehend them and evaluate the content and face validity of the questions.
The questionnaire was designed with twenty-two closed questions. It captures ten domains selected by their relevance to the study: the department’s image, facilities, medical care, nursing care, health care assistants (HCAs), secretarial services, reception, food, diagnostic tests and transport. Each domain is composed of between one and four discrete items rated on a five-point scale, in which the response options range from 1 (very bad) to 5 (very good) as shown in Appendix 1. The score for each domain represents the mean of the responses to each item within a given domain. The global mean score was determined by the sum of the items divided by the number of items answered. The questionnaire also contained socio-demographic variables, such as gender, age, educational level, occupational status, marital status4 and type of respondent.
The respondents’ understanding of the questionnaire items can generate different opinions for each one of them. This diversity exposes the problem of internal consistency of the questionnaire, that is, the degree of uniformity between the answers to each item of the questionnaire. This internal consistency can be measured by Cronbach’s alpha5, which varies from 0 to 16, and the higher the count, the greater the reliability of the scale of questionnaire. A value of at least 0.70 reflects an acceptable reliability, between 0.80 to 0.90 moderate to high, and exceeding 0.90 high internal reliability.
From 1st to 30th September 2011, the self-administered questionnaire was filled out by the discharged patients or their representatives. All patients admitted more than 48 hours were given the questionnaire and an envelope. Family members or caregivers (referred to as ‘representatives’) replaced patients with severe physical or mental diseases, who would have difficulty in understanding and filling out the questionnaire. The deceased were excluded because their representatives would be in mourning.
All participants were informed of the study’s objective, and it was explained to them how to fill out the questionnaire. Delivery was carried out in a sealed envelope. To ensure confidentiality, participants were asked to put the completed questionnaires in a closed box at the time of discharge, according to the declaration of Helsinki. The board of directors and ethics committee of the hospital approved the study.
We describe the frequencies (number), percentages, means (µ), median and standard deviation (σ) of the variables. In univariate analysis, we applied the Student’s t-test and analysis of variance (ANOVA) for the domains addressed in the questionnaire, considering the value of p < 0.05 statistically significant. Statistical analysis was performed using Statistical Package for the Social Sciences (SPSS) version 19.
A total of 284 inpatients were enrolled for the study, of whom 199 completed the questionnaire (response rate = 78%) and 31 died (10.9%). Respondents had a mean age of 62.9 years with a median of 66.5; 51% were men; 64% were married or cohabitating; 59.3% were retired and 51.7% had a basic (primary) education (Table 1).
Cronbach’s alpha measures of internal consistency were computed for each of the ten domains, which showed a reliability for the overall scale of 0.89 (Table 2). In all domains, acceptable values were met, reaching a minimum of 0.868 (for diagnostic tests) and a maximum of 0.880 (for medical care).
Answers to the items in the ten domains had an overall mean score of 4.24 (Figure 1), out of a maximum of 5. This allowed us to compare with the mean score for each domain. The following domains had significantly more positive scores than the overall mean: department’s image (mean difference (DIFM) = 0.15; p = 0.0001), medical care (DIFM = 0.18; p = 0.0001), nurses (DIFM = 0.21; p = 0.0001) and secretarial services (DIFM = 0.15; p = 0.002). The following domains had significantly more negative scores than the overall mean: reception (DIFM = –0.16; p = 0.016), food (DIFM = –0.31; p = 0.0001), diagnostic tests (DIFM = –0.15; p = 0.036) and transport (DIFM = –0.41; p = 0.0001). In the domains related to the facilities and HCAs, there were no significant differences from with the overall mean.
Student t test or analysis of variance (ANOVA) with the Tukey’s multiple comparison test performed.
Table 3 shows a univariate analysis of selected variables and their relationship with the mean scores of the questionnaire’s domains. We found that the variables ‘gender’, ‘occupation’, ‘marital status’ and ‘length of hospital stay’ showed no difference in all domains, except for secretarial services, for which higher scores were given by married respondents (µ = 4.49; p = 0.008).
For the variable ‘respondents’, patients gave higher mean scores for the domains: department’s image (µ = 4.49, p = 0.001) and medical care (µ = 4.51; p = 0.014) than patient representatives. In the variable ‘education level’, respondents with a medium/higher level of education (secondary or university education) gave lower mean scores in the domains: HCAs (µ = 4.17; p = 0.013), reception (µ = 3.89; p = 0.002), food (µ = 3.74; p = 0.004), diagnostic tests (µ = 3.72; p = 0.04) and transport (µ = 3.62; p = 0.025). In the variable ‘age group’, respondents < 50 years old, assessed the mean score in the domains: department’s image (µ = 4.17; p = 0.047), facilities (µ = 2.4; p = 0.04), nurse care (µ = 4.15; p = 0.048), HCAs (µ = 4.04; p = 0.046) and diagnostic tests (µ = 3.63; p = 0.009).
The typical participant was male, married and retired with a low educational level in this convenience sample. Respondents reported good results with the care provided from the professionals, with scores above four points, but the amenities were rated below this score. The present findings seem to be consistent with another study7, which found the following factors to be scored, in descending order: medical performance, nursing staff, amenities and accessibility. In another study in Israel8, the attitudes of nurses and medical care were the most important determinants of patient satisfaction with the care received. In a study performed in Kuwait9, medical care was the most favorably rated domain, followed by admission process and housekeeping, while nursing care was the least favorably rated domain. It can therefore be assumed that the assessment of patient’s satisfaction is based not only on the care received.
The evaluation instrument used here was a questionnaire developed for this purpose, following a search of the literature on the satisfaction of patients or families to determine the applicability of the questions used. Some studies4–10 have chosen variables related to information provided from the patient or their family, the existing support structures, the services available at the hospital and concerns about the ability to meet the patient’s needs during hospitalization.
To avoid bias in the questionnaire4, we used two methods: peer review for content validation and prior testing by a group of inpatients. To test the reliability of the questionnaire we used Cronbach’s alpha, and the results showed values indicating internal consistency in all areas. If alpha is too high this may suggest that some items are redundant6 and test the same question but in a different way. A maximum alpha value of 0.90 is recommended6.
The response rate of 78% for a sample of convenience and a self-administered questionnaire is considered good. This finding is in agreement with Stizia’s11 findings, which showed a response rate of 65% for self-administered questionnaires and in studies with a convenience sample of 25%.
In this study, we found that gender, marital status, occupation (retired or not) and length of stay did not affect the scores in the domains of the questionnaire. A previous study has shown that older subjects tend to have higher scores12, and this was confirmed in all the areas of our questionnaire.
Data from this study showed that the higher the educational level, the lower the scores for the responses in the domains of amenities, with the exception of medical care. A possible explanation for these differences might be better understanding and knowledge of the procedures to be undergone. Our study is in agreement with another4 in which had an inverse relation to educational status, with high educational levels associated with low scores.
We found that with the variable ‘respondent’, patients provided high scores in all domains, with statistical significance in the medical care. Unlike the inpatients, the representatives tended to be more demanding or critical and reported lower scores in some domains. It is likely that representatives complain about inadequate information and practical advice, especially on how to deal with potential decompensated disease13.
This study provides valuable information on the effect of all variables in the various fields that constitute our satisfaction tool in hospitalized patients. Therefore, we offer a picture of the determinants of satisfaction in several areas, which have never been studied together. The study may contribute to the understanding of the factors that influence inpatient satisfaction in hospital wards and could be used as a resource for evaluating the quality of care.
The limitations of this study include that it is a cross-sectional study and inevitably a convenience sample, composed of the patients discharged during one month. However, this convenience sampling is useful when attempting to study the satisfaction of a niche segment such as inpatients in internal medicine. Moreover, the range of possible explanatory variables included in this study, although large, was not as comprehensive as we would have liked. Several other variables, such as previous health status, could also have been assessed. However, when previous mental and physical health is poor, this is associated with lower satisfaction with hospitalization14. These patients have more hospitalizations, more aggressive treatment, and are more likely to suffer from medical complications15.
This study allowed us to conclude that respondent satisfaction was above average in all areas of the questionnaire. Although the mean score was high for all domains, amenities had the lowest level of satisfaction, pointing to the need to reassess food, transport and diagnostic tests. Gender, marital status and length of stay at the hospital were not factors that influenced the level of satisfaction of respondents.
Despite the limitations of the study, it was possible to identify the level of satisfaction of patients hospitalized in the internal medicine department, and the influential variables. These findings will allow the hospital management to implement changes in practice and propose actions to improve quality of care, and provide visibility to the teamwork of professionals involved. We conclude that, as in previous studies, there is evidence that the educational level, age and amenities affect the levels of satisfaction. Finally, we must consider that patient representatives are more critical than patients in the evaluation of satisfaction. Therefore, researchers conducting a survey of hospitalized patients’ satisfaction in internal medicine departments should be aware of the effect of variables on the responses to the questionnaire and make the necessary adjustments to provide valid results.
The authors had equal roles in the study design; in the collection, analysis and interpretation of data; in the writing of the report; and in the decision to submit the paper for publication.
We would like to thank Prof Laura Oliveira, Dra Emilia Moreira and Dr° Claudio Barrios for their useful comments on the English of the manuscript, which substantially contributed to the final shape of this paper.
Questionnaire handed out to study participants (English translation).
Questionnaire handed out to study participants (English translation).
Questionnaire handed out to study participants (Portuguese translation).
Views | Downloads | |
---|---|---|
F1000Research | - | - |
PubMed Central
Data from PMC are received and updated monthly.
|
- | - |
Competing Interests: No competing interests were disclosed.
Competing Interests: No competing interests were disclosed.
Alongside their report, reviewers assign a status to the article:
Invited Reviewers | ||
---|---|---|
1 | 2 | |
Version 1 13 Feb 13 |
read | read |
Provide sufficient details of any financial or non-financial competing interests to enable users to assess whether your comments might lead a reasonable person to question your impartiality. Consider the following examples, but note that this is not an exhaustive list:
Sign up for content alerts and receive a weekly or monthly email with all newly published articles
Already registered? Sign in
The email address should be the one you originally registered with F1000.
You registered with F1000 via Google, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Google account password, please click here.
You registered with F1000 via Facebook, so we cannot reset your password.
To sign in, please click here.
If you still need help with your Facebook account password, please click here.
If your email address is registered with us, we will email you instructions to reset your password.
If you think you should have received this email but it has not arrived, please check your spam filters and/or contact for further assistance.
Comments on this article Comments (0)