Ahmet Adnan Cırık1,†
Yeşim Esen Yiğit1,†
Ahmet Mahmut Tekin2,†
Yaşar Kemal Duymaz1,†
Şamil Şahin3,†
Burak Erkmen4,†
Vedat Topsakal2*†
- 1Department of Otolaryngology, Umraniye Training and Research Hospital, University of Health Sciences, Istanbul, Türkiye
- 2Department of Otolaryngology and Head & Neck Surgery, Vrije Universiteit Brussel, University Hospital UZ Brussel, Brussels Health Campus, Brussels, Belgium
- 3Private Practitioner, Istanbul, Türkiye
- 4Sancaktepe Martyr Prof Dr Ilhan Varank Training and Research Hospital Department of Otolaryngology, University of Health Sciences, İstanbul, Türkiye
Purpose: This study aimed to assess the readability indices of websites including educational materials on otosclerosis.
Methods: We performed a Google search on 19 April 2023 using the term “otosclerosis.” The first 50 hits were collected and analyzed. The websites were categorized into two groups: websites for health professionals and general websites for patients. Readability indices were calculated using the website https://www.webfx.com/tools/read-able/.
Results: A total of 33 websites were eligible and analyzed (20 health professional-oriented and 13 patient-oriented websites). When patient-oriented websites and health professional-oriented websites were individually analyzed, mean Flesch Reading Ease scores were found to be 52.16 ± 14.34 and 46.62 ± 10.07, respectively. There was no significant difference between the two groups upon statistical analysis.
Conclusion: Current patient educational material available online related to otosclerosis is written beyond the recommended sixth-grade reading level. The quality of good websites is worthless to the patients if they cannot comprehend the text.
Introduction
In an era of rapidly developing technological innovations, patients should have easy access to information about their disease on the internet. One in five people use the internet to research detailed medical information about their disease even before consulting an otolaryngologist (1). Moreover, even health professionals use the internet to gather information about a specific disease. These information sources must therefore provide reliable, easily readable, and understandable texts (2).
Otosclerosis, characterized by an abnormally high pace of bone remodeling in the otic capsule, is a cause of progressive hearing loss. Its incidence is 0.1% in the Caucasian population. It is much less frequent in Asians and Native Americans. Patients with otosclerosis generally present with tinnitus and progressive conductive hearing loss (3). The progression of sensorineural hearing loss is independent of age and sex (4). Ten percent of patients also experience sensorineural hearing loss due to cochlear involvement (5). It is diagnosed with clinical presentation, pure-tone audiogram results, stapedial reflexes, and often high-resolution CT scans (3).
A strong genetic origin is suspected, and generally, it is accepted as an autosomal dominant disease with variable penetrance. For a long time, no animal models were available, and it is exclusively a human disease. Eight different loci have been discovered so far in eight distinct families (6). The Foxl 1 gene has been identified as a monogenic cause, and about 10 families have been localized with regions of interest for further study. It is anticipated that additional disease-causing genes will be published soon (7, 8). ACAN is another candidate gene associated with the etiology of otosclerosis (6). While the SERPINF1 gene was found to lack sufficient evidence in relation to the etiology of otosclerosis (9), a recent publication has suggested that a variant of SMARCA4 might be the cause of otosclerosis (10).
Oral sodium fluoride therapy for several months was thought to slow down the bone turnover rate. However, bony structural alterations have no known cure yet. In addition, there have been claims that fluoride in tap water should be enough for an equal therapeutic effect (11). The rehabilitation of conductive hearing loss can involve hearing aids or surgical treatment (12). Patients may start with hearing aids, and if they are not sufficient, stapedotomy is a well-standardized bypass option for addressing conductive hearing loss (13). Hearing aids are commonly used by many patients and carry no potential risk in their use, but they can often pose a burden to users. However, patients are mostly not well informed or even incapable of choosing surgery or hearing aids. A trial period with hearing aids is already a tool to help them decide, and well-standardized readable information on the internet could serve as guidance.
Furthermore, otosclerosis surgery comes with its own set of surgical risks that patients need to know in advance. Complications such as facial paralysis, perceptive hearing loss, cerebrospinal fluid leakage, prosthesis dislocation, and vertigo have been described, and most patients want to be aware of these risks (12). Considering that otosclerosis is a progressive disease, even after successful surgery (often around 40–55 years), most patients progress with sensorineural hearing loss and would need hearing aids in their later years, around the age of 70 or 80 years. So, there are many aspects for an otologist to correctly counsel every case, and vouchers, leaflets, and websites can provide significant benefits in informing patients about this disease.
Patients diagnosed with otosclerosis are very likely to search for their condition on the internet because the choice for having surgery is elective. Helping patients make correct treatment choices is a cornerstone of treatment strategies and will also help in dealing with eventual postoperative complications.
Many web sources provide information, but little is known about their quality. Assessing whether web sources use too much medical terminology and whether the layperson can understand the context is crucial. For this reason, we aim to assess the readability indices of websites including educational materials on otosclerosis.
Materials and methods
We performed a Google search on 19 April 2023 using the term “otosclerosis.” The first 50 hits were collected and analyzed. After 50 clicks, the quality of websites severely deteriorated, and many other studies on readability indices stopped beyond the first 50 hits (2, 14). Websites containing only videos, those in a non-English language, and those with duplicate results were among the exclusion criteria; in addition, academic articles were excluded. The websites were categorized into two groups: websites for health professionals and general websites for patients. The categorization was done by considering the way readers were addressed. If words such as “your symptoms, your complaints” were used, these were categorized as general websites for patients. However, if medical jargon was used or words such as “your patient” were used, then these were categorized as websites for healthcare professionals. The website content was copied to Microsoft Word. Links, resources, videos, images, and advertisements were removed.
Readability indices were calculated using the website https://www.webfx.com/tools/read- able/. Readability indices have different subtypes: Flesch Reading Ease (FRE), Flesch–Kincaid grade level (FKGL), Gunning–Fog index (GFI), simple measure of Gobbledygook (SMOG), Coleman–Liau index (CLI), and automated readability index (ARI). Each score has a different calculation. FRE and FKGL use sentence and word length in the calculation. FKGL is the most considered score. GFI is used to show clarity and simplicity (complex words are used in the calculation). SMOG uses polysyllabic count in the calculation, and it indicates complete comprehension. ARI and CLI use characters in the calculation rather than syllables like most of the other formulas. The automatically calculated results were collected. When using the website, it was noted that headings/subheadings ended with a period, preventing them from merging with the upcoming sentence. In addition, sentences with bullet points ended with a period (if there was no period at the end of the sentence, we added it); therefore, these sentences did not merge with the upcoming sentence.
Permission from an ethical committee was not required since the research included only publicly accessible data.
Statistical method
For descriptive statistics, mean, standard deviation, median, minimum, maximum value frequency, and percentage were calculated. The Kruskal–Wallis test was used for the comparison of quantitative data. SPSS 28.0 was preferred for statistical analyses.
Results
A total of 33 websites were eligible and were copied into Microsoft Word. Of these websites, 13 were patient-oriented websites and 20 were health professional-oriented. The scores of all websites and the countries of their origin are listed in Table 1.
Table 1. Scores of websites and their country of origin.
The mean FRE score of all 33 websites was 48,803 ± 12,037 (10th–12th grades). Mean FKGL was 10.839 ± 2.852 (10th–12th grades). The mean Gunning–Fog index was 13.08 ± 2.851 (13th–14th grades). The mean SMOG index was 9.854 ± 1.813 (9th–10th grades). Mean CLI was 13.251 ± 1.790 (13th–14th grades). Mean ARI was 10.639 ± 3.504 (10th–12th grades) (Table 2).
Table 2. Descriptive statistics.
When patient-oriented and health professional-oriented websites were individually analyzed, mean FRE scores were found to be 52.16 ± 14.34 and 46.62 ± 10.07, respectively. Mean FKGL scores were 9.923 ± 2.554 and 11.435 ± 2.938, respectively. Mean Gunning–Fog indices were 12.3 ± 2.817 and 13.585 ± 2.837, respectively. Mean Smog indices were 9.292 ± 1.86 and 10.220 ± 1.729, respectively. Mean CLI scores were 12.915 ± 2.222 and 13.47 ± 1.467, respectively. Mean ARI scores were 9.492 ± 2.820 and 11.385 ± 3.760, respectively. There was no significant difference between the two groups upon statistical analysis (Table 3).
Table 3. Test statistics.
Discussion
In our study, our aim was to assess the readability indices of websites including educational materials on otosclerosis. Despite the proven effectiveness and safety of hearing aids, patients often look for alternative therapies online, especially if they are less visible. Stapedectomy is still known for resulting in sensorineural hearing loss after surgery in 1 in 100 cases, a concern frequently noted by patients (15). While no surgery is risk-free, patients look for data on the internet to help them decide on their customized therapy.
Today, because of technology, patients have easy access to information about their health issues online. Most of the patients use the internet to search for medical information regarding the specifics of their condition before meeting with an otolaryngologist. As a result, the internet significantly influences patients’ treatment decisions. In addition, healthcare professionals may also resort to online platforms to seek information about diseases that may be unfamiliar or novel to them. Strikingly, anyone can write anything on the internet, and there is not much regulation or criteria for either professional-oriented or patient-oriented disease informative websites. A primary requirement to reach a general readers audience to which patients may belong would be to look for the readability of the texts of these sources.
The American Medical Association (AMA) and the National Institutes of Health (NIH) propose that patient information be prepared at the eighth- and sixth-grade levels, respectively (16, 17). A small fraction of medical resources is written at a grade level suitable for the public, as evidenced by the readability of patient educational materials from high-impact medical publications (16). For appropriate information, patient educational materials must be understandable. However, in our study, overall FKGL was found to be 10th grade, which is above the recommended reading level. When each group was individually analyzed, patient-oriented websites were found to be of the 9th level, but health professional websites were calculated as the 11th level. Compared to the desired level 6, both are too demanding for their audience. Patient-oriented websites were easier to read, however there was not a significant statistical difference (p > 0.05) (Table 2). For professionals, the high-grade reading level is an expected and scrutable result because of their higher literacy rate. However, for an average person, the results are above than average readability level (sixth grade). Moreover, patients may choose to read from health professional-oriented websites, which are not only available to professionals (2). Consequently, such websites could potentially confuse patients lacking a medical background.
Many readability studies have been reported both in otolaryngology and other medical fields. Eloy et al. analyzed 262 patient educational materials from major otolaryngology association websites and used 10 different readability scales. They found that FKGL ranges from 9.7 to 17.1 (18). Therefore, all available documentation was above the suggested fourth- to sixth-grade level when using readability as an estimate for comprehension. Patel et al. evaluated 31 patient educational materials on thyroid surgery and found that the mean FKGL was 10.4 (19). None of them were found to be easy to read. In all, 16 articles were categorized as average difficulty using FKGL. Cherla et al. analyzed 31 online educational materials on endoscopic sinus surgery and highlighted that only one article’s FKGL was close to sixth grade; the mean score was 10.7 (20). Kong and Hu searched 50 online tracheostomy sources and found that the mean FKGL was 8.3 (2). They categorized the websites into two subgroups: professional-oriented and patient-oriented. FKGL scores of professional-oriented websites were found to be higher than patient-oriented websites. Furthermore, in our previous study, hereditary hearing loss was researched on this aspect and all analyzed websites required higher reading levels than the sixth grade (21). In other fields of medicine, similar results are reported regarding readability (22–24). All these studies are highly significant because internet-based patient educational tools have allowed people to easily explore their ailments thanks to the abundance of freely available internet medical information. However, low health literacy might cause readers to misread the online material.
Overall, the readability of otosclerosis educational materials needs to improve to reach a wider audience. This could be achieved by implementing layperson's language and avoiding medical jargon. In addition, shorter sentences and simple words are preferred. The number of commonly used words may be increased. This would increase the readability scores of the educational materials. Increased readability will help patients comprehend their conditions better. Hence, patients will be more eager for their treatment and follow-up period. Patients will be more compliant with their treatment.
Our study may have some limitations, such as the fact that we only accessed Google as a search engine; however, it is the most commonly available engine for Anglo-Saxon literature for which there is a standard level of readability, determined as sixth grade.
More importantly, evaluating the readability may not be misinterpreted as good-quality information. This study did not evaluate the content of the texts nor the effect of the information on helping patients decide their treatment options. It seems logical that to reach the target, all text should be readable by a large audience from the beginning.
Conclusion
Current patient educational material available online related to otosclerosis is written beyond the recommended sixth-grade reading level. Since the internet is progressively gaining importance in patient counseling and is becoming a tool for physicians and healthcare workers in patient and professional education regarding the diagnosis, treatment, and follow-up of diseases, readability is as important as the content of information. The quality of good websites is worthless to the patients if they cannot comprehend the text.
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.
Author contributions
AC: Formal Analysis, Investigation, Methodology, Resources, Writing – review & editing. YY: Data curation, Formal Analysis, Investigation, Methodology, Resources, Visualization, Writing – original draft, Writing – review & editing. AT: Conceptualization, Methodology, Project administration, Supervision, Validation, Writing – review & editing. YD: Data curation, Formal Analysis, Investigation, Methodology, Supervision, Writing – original draft, Writing – review & editing. ŞŞ: Data curation, Methodology, Supervision, Writing – review & editing. BE: Data curation, Investigation, Project administration, Resources, Supervision, Writing – review & editing. VT: Conceptualization, Investigation, Methodology, Supervision, Validation, Writing – original draft, Writing – review & editing.
Funding
The authors declare that no financial support was received for the research, authorship, and/or publication of this article.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. JH Kim, Grose E, Philteos J, Forner D, Noel CW, Wu V, et al. Readability of the American, Canadian, and British Otolaryngology–Head and Neck Surgery Societies’ patient materials. Otolaryngol Head Neck Surg. (2022) 166:862–8. doi: 10.1177/01945998211033254
2. Kong K, Hu A. Readability assessment of online tracheostomy care resources. Otolaryngol Head Neck Surg. (2015) 152:272–8. doi: 10.1177/0194599814560338
3. Ballenger JJ, Snow J. Ballenger’s Otorhinolaryngology: Head and Neck Surgery, 16th ed. Ontario: BC Decker (2003).
4. Topsakal V, Fransen E, Schmerber S, Declau F, Yung M, Gordts F, et al. Audiometric analyses confirm a cochlear component, disproportional to age, in stapedial otosclerosis. Otol Neurotol. (2006) 27(6):781–7. doi: 10.1097/01.mao.0000231500.46534.79
5. Quesnel AM, Ishai R, McKenna MJ. Otosclerosis: temporal bone pathology. Otolaryngol Clin North Am. (2018) 51:291–303. doi: 10.1016/j.otc.2017.11.001
6. Højland AT, Tavernier LJM, Schrauwen I, Sommen M, Topsakal V, Schatteman I, et al. A wide range of protective and predisposing variants in aggrecan influence the susceptibility for otosclerosis. Hum Genet. (2022) 141:951–63. doi: 10.1007/s00439-021-02334-8
7. Abdelfatah N, Mostafa AA, French· CR, Doucette LP, Penney C, Lucas MB, et al. A pathogenic deletion in Forkhead Box L1 (FOXL1) identifies the first otosclerosis (OTSC) gene. Hum Genet. (2022) 141:965–79. doi: 10.1007/s00439-021-02381-1
8. Available online at: https://hereditaryhearingloss.org/.
9. Valgaeren H, Sommen M, Beyens M, Vandeweyer G, Schrauwen I, Schepers A, et al. Insufficient evidence for a role of SERPINF1 in otosclerosis. Mol Genet Genomics. (2019) 294:1001–6. doi: 10.1007/s00438-019-01558-8
10. Drabkin M, Matan MJ, Noy Y, Halperin D. SMARCA4 mutation causes human otosclerosis and a similar phenotype in mice. J Med Genet. (2023).37399313
11. Jefferson H, Iii D. Stapedial otosclerosis and fluorine in the drinking water. Arch Otolaryngol. (1969) 90(5):585–9. doi: 10.1001/archotol.1969.00770030587011
12. Probst R, Grevers G, Iro H. Basic otorhinolaryngology a step-by-step learning guide. Thieme (2006).
13. Batson L, Rizzolo D. Otosclerosis: an update on diagnosis and treatment. J Am Acad Physician Assist. (2017) 30:17–22. doi: 10.1097/01.JAA.0000511784.21936.1b
14. Ting K, Hu A. Evaluating the quality and readability of thyroplasty information on the internet. J Voice. (2014) 28:378–81. doi: 10.1016/j.jvoice.2013.10.011
15. Flint PW, Haughey BH, Lund V, Niparko JK, Robbins KT, Thomas JR, et al. Cummings Otolaryngology: Head and Neck Surgery, 6th ed. Philadelphia: Elsevier Saunders (2015)
16. Rooney MK, Santiago G, Perni S, Horowitz DP, McCall AR, Einstein AJ, et al. Readability of patient education materials from high-impact medical journals: a 20-year analysis. J Patient Exp. (2021) 8:1–9. doi: 10.1177/2374373521998847
17. Weiss BD, Schwartzberg JG, Davis TC, Parker RM, Williams MV, Wang CC. Health Literacy: A Manual for Clinicians. United States: American Medical Association.
18. Eloy JA, Li S, Kasabwala K, Agarwal N, Hansberry DR, Baredes S, et al. Readability assessment of patient education materials on major otolaryngology association websites. Otolaryngol Head Neck Surg. (2012) 147:848–54. doi: 10.1177/0194599812456152
19. Patel CR, Cherla DV, Sanghvi S, Baredes S, Eloy JA. Readability assessment of online thyroid surgery patient education materials. Head Neck. (2013) 35:1421–5. doi: 10.1002/hed.23157
20. Cherla DV, Sanghvi S, Choudhry OJ, Liu JK, Eloy JA. Readability assessment of internet-based patient education materials related to endoscopic sinus surgery. Laryngoscope. (2012) 122:1649–54. doi: 10.1002/lary.23309
21. Duymaz YK, Tekin AM, D’Haese P, Şahin Ş, Erkmen B, Cırık AA, et al. Comprehensiveness of online sources for patient education on hereditary hearing impairment. Front Pediatr. (2023) 11:1147207. doi: 10.3389/fped.2023.1147207
22. Shukla P, Sanghvi SP, Lelkes VM, Kumar A, Contractor S. Readability assessment of internet-based patient education materials related to uterine artery embolization. J Vasc Interv Radiol. (2013) 24:469–74. doi: 10.1016/j.jvir.2013.01.006
23. Williams AM, Muir KW, Rosdahl JA. Readability of patient education materials in ophthalmology: a single-institution study and systematic review. BMC Ophthalmol. (2016) 16:133. doi: 10.1186/s12886-016-0315-0
Keywords: otosclerosis, readability, comprehensiveness, online sources, patient education
Citation: Cırık AA, Yiğit YE, Tekin AM, Duymaz YK, Şahin Ş, Erkmen B and Topsakal V (2024) Comprehensiveness of online sources for patient education on otosclerosis. Front. Surg. 11:1327793. doi: 10.3389/fsurg.2024.1327793
Received: 25 October 2023; Accepted: 8 January 2024;
Published: 24 January 2024.
Edited by:
Lukas Anschuetz, University Hospital of Bern, SwitzerlandReviewed by:
Andy Wai Kan Yeung, University of Hong Kong, ChinaCecilia Lotto, University of Bologna, Italy
© 2024 Cırık, Yiğit, Tekin, Duymaz, Şahin, Erkmen and Topsakal. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Vedat Topsakal vedat.topsakal@uzbrussel.be
†ORCID Ahmet Adnan Cırık orcid.org/0000-0001-9508-0469 Yeşim Esen Yiğit orcid.org/0000-0003-3422-2923 Ahmet Mahmut Tekin orcid.org/0000-0003-1604-3382 Yaşar Kemal Duymaz orcid.org/0000-0002-4887-4677 Şamil Şahin orcid.org/0000-0002-7378-6759 Burak Erkmen orcid.org/0000-0002-9990-8099 Vedat Topsakal orcid.org/0000-0003-0416-4005