Anaesthesia for total hip and knee replacement: A review of patient education materials available online

Introduction

Total hip replacement (THR) and total knee replacement (TKR) are proven interventions for patients with advanced arthritis, and are among the most common elective surgical procedures carried out in the UK and Ireland¹. National Joint Registry data for both the UK and Ireland reveals that close to 200,000 total hip and knee replacements are performed each year^2,3. Demand for both THR and TKR is set to increase dramatically in the coming decades due to changing demographics and an ageing population, with studies suggesting the demand for TKR in the United States will grow by 673% by 2030^4–6. Anaesthesia can play a significant role in reducing perioperative morbidity, and in an increasingly complex patient population it is important that patients are given accurate and up to date information about the various anaesthetic techniques used⁷.

Internet use is increasing worldwide, with 85% of adults in the United States using the Internet⁸. In the UK, the Oxford Internet Survey group stated that in 2013, 78% of people used the Internet and, of these, up to 71% sought health related information⁹. Patient education materials (PEM) can be beneficial for assisting patients in the informed consent procedure, by explaining indications, risks, benefits and alternatives¹⁰. A recent online poll revealed that up to 90% of patients who access the Internet for their health information believe it to be accurate, and over 60% reported that it impacted their medical decision making¹¹. However, the Internet is a completely unregulated source susceptible to provider bias and has the capacity to negatively influence consumer health outcomes¹². Implementing and enforcing standards is very difficult, and health information available has been shown to be of poor quality and largely unreliable^8,11,13,14. It is important for doctors to be aware of the information available to patients on the Internet and to understand confusion surrounding such information. As well as supplying high quality accurate health information, the readability of the website must be suitable for the target audience. Several medical organisations , including the National Institute of Health (NIH), and the American Medical Association (AMA) recommend that all PEM should be written at or below sixth grade level (reading age 11-12 years) in order to be effectively understood by the general public¹⁵. However many previous studies have shown that a significant proportion of health information websites are written above this recommended level, suggesting that it may be beyond the comprehension of a substantial proportion of the patient population accessing it 16–18.

Over the past number of years there has been several studies assessing both the quality and readability of PEM available on the Internet across all medical specialties, including general and regional anaesthesia for labour and pain procedures^19–22. We also already know that orthopaedic patients research their conditions extensively online^11,13,23,24, but to our knowledge none of these studies have looked at the availability of high quality health information relating to anaesthesia for common surgical procedures. Therefore, our aim was to assess the readability and quality of patient information available on the Internet relating to anaesthesia for both TKR and THR.

Methods

Results

Out of the 168 initial search results, 32 were analysed further as per the previously described exclusion criteria (Figure 1). Each website was categorised according to authorship; seven were academic, seven were commercial/physician, five were discussion/social media related, four were physician, four were Government/NPO related, four were commercial and one was media-related (Figure 2). Only 8/32 sites (25%) were HONcode certified and 5/32 (15.6%) had the Information Standard quality mark.

Figure 1. Results flow diagram of analysed websites.

27 sites for each of the above terms on both Google and Bing (9 websites per page) and 30 for each on Yahoo (10 websites per page), giving a total of 168. Websites were then excluded from further analysis if they were not PEM, if they were written in a language other than English, if they were inaccessible, or in a non-written format i.e. video. Duplicate websites were also excluded. In total 32 unique websites were analysed further.

Figure 2. Each website was categorised according to authorship.

Seven were academic, seven were commercial/physician, five were discussion/social media related, four were physician, four were Government/NPO related, four were commercial and one was media-related.

Readability

The readability of each website was assessed using three validated commonly used readability assessment tools: the Flesch Reading Ease (FRE) score, the Flesch-Kincaid grade level (FKGL), and the Gunning Fog Index (GFI). Table 2 summarises the study’s readability and quality scores. The overall mean readability scores indicated that the websites as a group were difficult to read. The mean FRE score was 55.2 ±12.8, with social/discussion networks associated with both the minimum (3.3) and maximum (74.2) FRE scores. The mean FKGL score was 8.6 ±1.9, with only six websites (18.8%) having the recommended readability level of sixth-grade or less (Figure 3). Overall, a mean of 10.4 years (mean GFI 10.4 ±2.6) of formal education was required to read the websites included in this study. Commercial websites had the highest mean GFI (11.7 ±2.3), while social/discussion networks had the lowest (8.3±3.9).

Table 2. Readability and quality values across all authorship groups.

Overall results for each scoring system, presented as mean ±standard deviation for normally distributed data and median ±standard deviation for non-normally distributed data (FRE Score). FRE, Flesch Reading ease; FKGL, Flesch-Kincaid Grade Level; GFI, Gunning Fox Index; DISCERN, DISCERN instrument.

	FRE Score	FKGL	GFI	DISCERN
Total	55.2 ±12.8	8.6±1.9	10.4±2.6	40.3±13
Academic	54.8±7.1	8.6±1	10.6±2.1	49.7±11.8
Commercial/physician	55.9±8.0	8.7±1.4	10.9±1.7	38±14.3
Commercial	51.8±8.3	8.5±1.8	11.7±2.3	43±6.7
Physician	46.6±3.6	9.7±2.2	11.4±3.2	47.8±6.8
Social/discussion	70.1±30.1	8.5±3.6	8.3±3.9	24.8±3.4
Government/ Not for profit organisations	56.5±4.6	7.6±1.9	10.1±2.1	41.8±10.8
Media-related	N/A	N/A	N/A	N/A
HON-code +	51.2±8.1	8.5±2.1	10.8±2.4	45.4±6.7
HON-code -	56.4±14.1	8.6±1.9	10.3±2.7	38.5±14.2
Information Standard +	64.2±5.4	6.2±.8	8.8±1.2	42.4±12.6
Information Standard -	51.9±13	9.0±1.7	10.7±2.7	39.9±13.3

Figure 3. Flesch-Kincaid Grade Level by authorship.

The line denotes the recommended readability level of the sixth-grade level with a minority of websites falling at or below this level.

Organisations that have achieved the Information Standard quality mark were as a group easier to read. This was seen across all three readability assessment tools. Member websites had a significantly lower mean FKGL (6.2 vs. 9, P < 0.001) and GFI (8.8 vs. 10.7, P = 0.04) and a significantly higher median FRE score (64.2 vs. 9, P = 0.02) than non-member websites. There was no difference in FKGL (8.5 vs. 8.6, P = 0.78), GFI (10.8 vs. 10.3, P = 0.92) or FRE (51.2 vs. 56.4, P = 0.31) between HONcode certified and noncertified groups.

DISCERN Instrument

The DISCERN instrument was used to assess each website. Overall, the mean DISCERN score was low, 40.3 ± 13 out of a maximum of 80. Three of the top five scoring websites were of academic authorship with one being of physician authorship and one Government/NPO. Eight websites (25%) scored 51 or above, representing good quality, with academic authorship associated with both the single highest DISCERN score (61) and the highest mean DISCERN score across all groups (49.7). Six websites (18.75%) scored less than 26 points, representing very poor quality with extensive shortcomings. Average DISCERN scores by authorship groups are shown in Figure 4. Neither HONcode nor the presence of the Information Standard quality mark was associated with a higher mean DISCERN score (P=0.08 and P=0.7, respectively). Academic and physician-related websites achieved significantly higher mean DISCERN scores than social/discussion networks (P = 0.005 and P = 0.032, respectively; Figure 5).

Figure 4. Bar chart of DISCERN scores by authorship.

From highest (61) to lowest (20) mean DISCERN score. Error bars denote 95% confidence interval.

Figure 5. Mean DISCERN scores.

Significantly higher for academic (P = 0.005) and physician-related (P = 0.032) websites versus the mean DISCERN score for social/discussion networks.

Discussion

There can be no doubt that the Internet has changed the manner in which patients access information. Traditionally, information was passed from doctor to patient in a single direction and decisions were made under the paternalistic guidance of the doctor. In the Internet era, in which information is immediately available, this flow of information is no longer appropriate, nor is it acceptable to patients. More and more, patients are accessing this medical information online and using it to make decisions regarding their own healthcare^8,18. However, the reliability and suitability of these online patient education materials is increasingly being called into question^{8,13,14,16–18}. The majority of Internet users start their search with a search engine, and most do not trawl beyond the websites from the first three pages returned²². The aim of this study was to assess both the quality and the readability of Internet information relating to anaesthesia for total hip replacement and total knee replacement, using three validated tools to assess readability (FRE, GFI, FKGL) and the DISCERN instrument to assess quality of information obtained. We also looked for websites that displayed HONcode certification or had received the Information Standard NHS quality mark.

Our results show that 81.2% of the websites assessed were above the recommended sixth-grade readability level for PEM. This should be a concern for healthcare providers; many patients will have a limited understanding of the health information available to them online, and thus even those patient education materials that may be of good quality may not be understood. This could have an adverse effect on the informed consent and decision-making process. These findings echo multiple studies over the last decade, suggesting that producing information at an appropriate readability level is still a challenge for healthcare providers^10,18,19,21. Encouragingly, our study found that websites that had been awarded the Information Standard NHS quality mark were statistically significantly more likely to achieve the appropriate readability level, suggesting that these are the websites that healthcare providers should be recommending to our patients.

The quality of the websites was assessed using the DISCERN instrument. It is important to note that the DISCERN instrument does not take into account the readability of the material, and thus when recommending websites to patients, healthcare providers should seek websites which are of both high quality and appropriate readability. In our study, only a small number of the websites analysed (25%) scored highly using the DISCERN instrument, which indicates that most PEM related to anaesthesia for TKR and THR available on the Internet are of poor quality. Websites were more likely to achieve high DISCERN scores if the authors were physicians, affiliated with academic institutions or government agencies. Again, this highlights the importance of healthcare professionals directing patients towards more reliable and appropriate PEM.

One of the most significant and disappointing findings from our study relates to the presence or absence of the HONcode seal on websites. Although the HONcode seal indicates that a website has met certain quality and reliability standards, our study did not find that HONcode certified websites achieved higher readability or quality standards than those without the HONcode seal. The Information Standard quality mark was introduced to help patients make informed choices about their condition and options for treatment. In our study, we found that although there was a statistically significant relationship between the presence of the Information Standard quality mark and appropriate reading levels, there was no correlation between this quality mark and quality of information using the DISCERN instrument.

A number of limitations to this study are recognised. We performed our online search in one country, and only analysed PEM from websites written in the English language. The search was limited to the first three pages of returned websites, as it has been shown previously that the general public usually don’t pursue beyond this²². We acknowledge that comprehension of healthcare information is not solely related to readability of text and that other factors, i.e. videos and visual tools, can contribute greatly to a patient’s understanding. The examination of such materials was beyond the scope of this study and previous studies have also acknowledged this limitation^8,16. While readability indices have been validated in the literature, there is no general consensus on which index is best and each one uses a different formula to calculate readability. Scores by different indices may vary substantially. It should also be noted that although there is a large volume of material available to guide users when appraising websites using the DISCERN instrument, there is still the potential for variability among raters, which is a limitation not present when assessing readability.

In conclusion, we aimed to assess the quality and readability of information available online regarding anaesthesia for total knee replacement and total hip replacement. Overall, we found that most of the websites were of poor quality and many had reading levels which were too high for the target audience. These findings echo many other studies that examine online information relating to healthcare^{8,11,13,16,17,19,20}. We found that while the Information Standard NHS quality mark was associated with improved readability, neither the quality mark nor the HONcode were found to have a statistically significant correlation with quality of material. Based on this study we would encourage doctors and other healthcare professionals to be judicious in the websites they recommend to patients, and to consider both the readability and the quality of the information provided.

Data availability