Skip to main content

OPINION article

Front. Med., 18 October 2024
Sec. Healthcare Professions Education
This article is part of the Research Topic Insights in Healthcare Professions Education: 2024 View all 11 articles

Redefining medical education: harnessing the power of patient feedback

  • 1Research and Development Unit, Hammersmith and Fulham Primary Care Network, London, United Kingdom
  • 2Faculty of Medicine, Imperial College London, London, United Kingdom

Introduction

Health education paradigms are changing and now increasingly emphasize the importance of patient-centered care. This change has not occurred as a trend but is a basic tenet in training and preparing healthcare professionals to serve patient populations with complex needs. Central to such a change is the integration of patient feedback into the process of clinical education: a practice that centralizes the patient's perspective at the very core of the development of a clinician (1). Such feedback in medical training is not just an adjunct to traditional education models; rather, it actively enriches by providing real-time insights into the utility of medical communication, empathy, and patient autonomy. This view point will argue why we believe patient feedback must be better valued and utilized in clinical education. This is not only to enhance the communication skills that shape patient interaction but moreover to instill a patient-centric philosophy, vital to developing our future clinicians into responsive, empathetic, socially-conscientious clinicians. For this reason, we assess the value of patient feedback in clinical education by highlighting its importance in an educational context where healthcare professionals of the future can easily manage the complicated interpersonal dimensions of medical practice. Our focus will be on undergraduate medical education, but we believe similar ideas are applicable to postgraduate specialist medical education. The debate that will ensue herein will look at the historical background of this integration, the multifaceted benefits of patient feedback, and then more practically, the challenges and potential solutions to its implementation.

Historical overview and current shifts

Traditionally, clinical education has been driven by a clinician-centric model. Following the impact of the Flexner report, for over a century medical education has emphasized university-based didactic teaching of biomedical sciences, participation in medical research, and bedside teaching of technical skills by specialist physicians (1, 2). This profoundly entrenched approach formed part of broader historical practices that privileged the medical professional's expertise—traditionally at the expense of broader patient engagement. Further, the overemphasis in medical education on “make or break” qualification examinations has arguably led to neglect around development of the holistic skills required to be a well-rounded clinician (3). While this model is effective in developing technical competence, it has often proved to be limited by failure to recognize the most essential participant in the educational dialogue—the patient, and thus learning has been defined as clinical interaction and not holistic patient care. Further, such technical skills may well lose relevance over the course of a clinician's career as new technology emerges and the landscape of healthcare changes.

Over the last decade, however, there has been a significant shift toward an expanded view of education that actively includes the patient (4). This changing nature is, in part, a growing appreciation for the powerful depth of insights that patients bring to the healthcare experience—truly priceless insights to help train future empathetic, responsive, and patient-centered professionals. This integration of patient perspectives into an educational frame represents a gargantuan cultural change in medical education: acknowledgment that patients are active and necessary contributors to the learning process. Acceptance of this change further aligns educational practice with emerging expectations from patients, and indeed from the medical profession itself, while at the same time signaling a move to more dynamic medical education (5).

Certainly some alternative models have emerged that challenge the historically-dominant, Western style of medical education. For instance, the Mayo Clinic model has emphasized developing professionalism and regard for patient welfare in students, something integrated at all levels of education, including assessment (6). Additionally, several distinct schools, such as Northern Ontario (Canada) and Ateneo de Zamboanga University (the Philippines) Schools of Medicine, have developed novel programs which centralize education around community-engagement in rural underserved areas, and seek to develop socially conscientious practitioners (7, 8).

The value of patient feedback

The pillar of the transformational approach to clinical education is on utility brought out in terms of patient feedback, given from experience and mostly overlooked in the conventional models of teaching. Therefore, this kind of feedback is crucial since it reflects their direct experiences and perceptions about care (9). Types of feedback commonly gathered include: how well one communicated, demonstrated empathy and listening, empowered the patient and respected their autonomy, or educated the patient about matters related to health. The type of feedback can range from simple quantitative scoring to detailed qualitative feedback and instruction.

Integrating such feedback highlights the often-subtle interpersonal dynamics in patient interaction that can significantly influence patient satisfaction and treatment adherence (10). For example, tailored patient feedback can identify weaknesses, and motivate students toward developing more considerate, and therefore more effective, practice. Educator exposure to such feedback, may also help positively shift educational culture and methods toward considering the patient perspective. Indeed, from a course design point of view, the use of patient feedback for the development of training material could be used as a focus for the enhancement of more straightforward, warmer communication skills. Additionally, such educational methods should help facilitate patients sharing their lived experience and expertise about their own conditions, greatly contextualizing and broadening student understanding of these conditions (11).

Furthermore, personal autonomy and empathy feedback can guide the understanding and promotion of patient trust and confidence—vital in any clinical relationship. Through a systematic infusion of these findings into the curriculum, these educators would thus be nurturing a generation of technically competent healthcare professionals who are also brought up to be deeply sensitized toward the social, emotional, and psychological facets of patient care. It further helps in more patient-centric, empathetic healthcare, but ultimately also elevates the standards of care (12). Through ensuring high quality communication, benefits such as active patient participation, better self-care, and improved treatment adherence can be achieved. Closer and fuller collaboration between clinician and patient through such refined communication skills, has also been shown to enhance chronic disease measures and functional status (13). Vitally, this also ensures the care delivered is of relevance to meeting a patient's priorities, having fully explored and understood them beforehand. Integration of patient feedback, can also enhance awareness and education about local communities, so long as patients are recruited from a broad range of cultural, ethnic, and socioeconomic backgrounds. This could be promoted through engaging diverse community stakeholders. Such an approach could expose students early on in their education to cultures differing from their own background, with an aim to enhancing social conscientiousness and cultural competence.

Methods for gathering patient feedback

Systematic collection of patient feedback needs to be done with care to ensure processes respect the confidentiality and sensitivity of the patient-clinician relationship (14). Different methodologies have been used to gather such invaluable data, ensuring process integrity and the comfort of all parties involved. A usual technique is the implementation of questionnaires with their patients remaining unidentified or, for instance, structured interviews through independent third parties—educational supervisors. Such instruments seek to investigate somewhat tangible aspects of clinical communication, such as communication skills, empathy, and the understanding of the patient, thus providing an explicit source of valuable information while keeping the patient anonymous.

Moreover, the presence of patient representatives in educational review committees adds huge depth and pertinence to the process of giving feedback (15). First-hand patient views are highly valuable to the development of the curricula and academic assessments, thus making sure that educational strategies closely follow the needs and expectations of the patients. This not only enriches the educational content but also vitally includes patients in shaping the training of healthcare professionals who will serve future generations. Innovative models of medical education have even successfully embedded patient-engagement heavily into medical school design and student admissions to ensure that local communities are best served. For example, Northern Ontario School of Medicine regularly includes community members in admission interview panels, consultations on curriculum design and development, and in facilitating community placements (7).

Both methods underlie the commitment to a more inclusive and responsive medical education system, where patient experiences are acknowledged and integral in shaping the educational paradigms (16). This will then bring about insightful knowledge and move medical education toward the development of genuinely patient-centered healthcare professionals. Table 1 shows the path along which educational institutions should find ways of embedding patient input effectively in their curricula.

Table 1
www.frontiersin.org

Table 1. Structured plan for integrating patient feedback into clinical education.

Integrating feedback into teaching practices

Patient involvement in teaching strategies is a relatively new technique, and its implementation might significantly impact how to train the generation of health professionals (17, 18). One new style is case-based learning, that includes stories and feedback from actual patients. This approach allows students to be fully immersed in patient experiences, which is meant to bring about a more intuitive comprehension of the principles of patient-centered care. When patients share their lived experiences, it brings practical reality to students so that they value the complexity of patient interactions and the importance of empathy, communication, and ethical practice.

Simulated patient encounters are another fruitful way: in this process, after being briefed on scenarios, actors give specific feedback based on their experience as a simulated patient (19, 20). This way, it becomes a safe learning environment for the students, who can develop and practice clinical and interpersonal skills without causing harm or distress to actual patients. Following these simulations, debriefing is critical in providing the opportunity for reflective learning, allowing students to receive immediate and constructive feedback to enhance both their technical skills and communication style and their ability to mentalize and respond to patient emotions and needs.

These are teaching practices meant to develop not only clinical competencies but also a professional attitude—patient perspective is considered an integral constituent of the development of professionalism (21, 22). Embedding these methods within the curriculum allows the medical educator to create a more dynamic learning environment, therefore enabling the learners to be more reflective and responsive ultimately resulting in competent health practitioners.

Discussion

The integration of patient feedback into medical curricula is a strategic move that significantly realigns educational content with the principles of patient-centered care (1, 4, 23). This feedback is necessary for forming personalized learning objectives; not to mention, refining assessment criteria makes sure that the curriculum teaches not just medical expertise but also broader holistic skills, with efficient communication with patients.

In this light, an educator can develop a curriculum enriched with patient stories and feedback to emulate the kind of clinical practice where communication, empathetic responses, and patient autonomy are stressed as vital to the successful application of clinical skills; which are ultimately more relevant and acceptable to the patient (24, 25). Such stories provide rich context scenarios that challenge the student to think beyond the diagnosis to get the experience, fears, and psychological wellbeing of the patient. This method promotes a holistic view of medicine that values the patient's perspective as a critical ingredient in appropriate care.

In addition, the development of assessment tools that measure students' ability to meet these integrated objectives is directly influenced by patient feedback (26, 27). Classic assessments are relatively narrow and focus on technical skills and knowledge. With redefined criteria, due to patient feedback, the assessments can be more comprehensive regarding whether a student can effectively interact with patients, thus covering more competencies, such as interpersonal skills and ethical considerations, and at the same time being clear as to those that need targeting for personal development goals. That feedback, incorporated into curriculum development for improvement, would assure more effective training for healthcare professionals and better response to what communities await from their service. Alignment of this nature is essential in driving a healthcare system that is genuinely responsive and sensitive to the patient's experience in fostering good care outcomes, as well as helping us strive toward health equity and inclusivity goals amongst underserved communities.

Broader implications for healthcare culture

Incorporating patient feedback into clinical education is far more than a pedagogical shift; it represents seismic change within healthcare cultures toward openness, inclusivity, and genuinely patient-centered systems (1, 12). This process in medical education will help us better respond to the broader social demand for the establishment of a medical practice that should be not only effective on a clinical level, but also compassionate and carefully crafted around patient's individual needs and preferences.

Educating health professionals to integrate patient views in learning strategies embraces a culture of respecting patient experience and views (28). It forms a cultural change way beyond the medical schools and trickles down through the health delivery ecosystem with an eventual betterment of patient care quality and patient outcomes. Such practice becomes normalized and improves the health environment when the principles of empathy, respect, and autonomy toward patients are concerned.

Most importantly, this long-term change bears profound benefits. It will improve patient satisfaction and engagement because new generations of healthcare providers, who were appropriately trained in the complexities of patient interactions, will be enabled (29). This offers great potential for achieving patient adherence to treatment plans and preventive measures, in the end, enhancing health outcomes and lowering the costs of care. Furthermore, a culture that actively pursues and values the input of patients could become inherently self-improving, adapting constantly to the changing needs and expectations of the population it serves.

Therefore, embedding patient feedback into clinical education not only enriches the development of health professionals but also significantly contributes to the evolution of a healthcare system focused on the values for whom it is created.

Challenges and considerations

Patient feedback on clinical education has much potential, yet it is not without its challenges or the possibility of being problematic. Caution will be needed in handling these barriers to ensure that the potentials of this educational method are realized and sustained.

One primary concern is if negative feedback might impact student confidence, particularly in the initial stages of training. While constructive criticism has its place in professional development, repeated or intense negativity might risk reducing self-esteem and impair effective learning (23, 30). As such, medical educators should promote a safe, encouraging learning environment, where students are encouraged to reflect and grow, but not in a way that takes away from them.

Major logistical problems also exist. “Taking feedback from patients, analysis of it and putting it into systems which are already overburdened in terms of clinical and educational activities is not always easy.” This requires a great deal of planning and provision of resources to ensure that the processes are well organized and effectively conducted so the feedback is also relevant and timely. This might sometimes require developing new administrative protocols or setting up technological solutions to streamline the feedback processes (1, 12, 26, 31).

Besides, it is essential that the fairness and representativeness of the feedback collected is of utmost importance (7, 20). It will be essential to gather feedback from as diversified a patient population as possible to not introduce bias that may distort educational content and results. This calls for intentional engagement with the highest levels of patient diversity and the health conditions they present so that any feedback resulting from the process can be applied in an all-inclusive manner and utilized across the patient's experience. Essential here is ensuring that those educational practices lessen health inequities rather than deepen them.

Overcoming these challenges requires a dynamic, thoughtful approach with continuous evaluation and modification of strategies to incorporate patient feedback into medical education effectively.

Conclusion

It, therefore, underscores the need to turn around a paradigm regarding patient feedback in clinical learning to be within an approach that is more inclusive and empathic through which healthcare professionals can be trained. By and large, it would have been noticed throughout the discussion that patient feedback not only enriches the educational process but also sharpens future clinicians' interpersonal skills and the underpinning attitudes of care, hence improving patient care.

Medical educators, therefore, have the formidable charge of catalyzing such change. Incorporating patient feedback into the curriculum will create professionals in health education who are as technically competent as they are sensitized to the patient's wishes and experiences to whom they will deliver their services. This is the only way that a caring healthcare environment—one that empathizes with and values patients' experiences—will be realized.

Patient feedback, therefore, offers benefits not just to individual patient encounters but also to general healthcare outcomes. In essence, the medical community needs to adopt and spread patient-centered educational practices to ensure that changes in societal expectations are met.

Author contributions

WJ: Conceptualization, Investigation, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing. DH: Conceptualization, Investigation, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Jerjes W. Enhancing clinical education through patient voices. Clin Teach. (2024) 21:e13784. doi: 10.1111/tct.13784

PubMed Abstract | Crossref Full Text | Google Scholar

2. Towle A, Godolphin W. A meeting of experts: the emerging roles of non-professionals in the education of health professionals. Teach High Educ. (2011) 16:495–504. doi: 10.1080/13562517.2011.570442

Crossref Full Text | Google Scholar

3. Alzerwi NAN. Flexner has fallen: transitions in medical education system across time, a gradual return to pre-Flexnerian state (de-Flexnerization). World J Clin Cases. (2023) 11:4966–74. doi: 10.12998/wjcc.v11.i21.4966

PubMed Abstract | Crossref Full Text | Google Scholar

4. Little D, Green DA. Credibility in educational development: trustworthiness, expertise, and identification. High Educ Res Dev. (2021) 41:804–19. doi: 10.1080/07294360.2020.1871325

Crossref Full Text | Google Scholar

5. Butalid L, Verhaak PF, Boeije HR, Bensing JM. Patients' views on changes in doctor-patient communication between 1982 and 2001: a mixed-methods study. BMC Fam Pract. (2012) 13:80. doi: 10.1186/1471-2296-13-80

PubMed Abstract | Crossref Full Text | Google Scholar

6. Mueller PS. Incorporating professionalism into medical education: the Mayo Clinic experience. Keio J Med. (2009) 58:133–43. doi: 10.2302/kjm.58.133

PubMed Abstract | Crossref Full Text | Google Scholar

7. Strasser R, Hogenbirk J, Jacklin K, Maar M, Hudson G, Warry W, et al. Community engagement: a central feature of NOSM's socially accountable distributed medical education. Can Med Educ J. (2018) 9:e33–43. doi: 10.36834/cmej.42151

PubMed Abstract | Crossref Full Text | Google Scholar

8. Guignona M, Halili S, Cristobal F, Woolley T, Reeve C, Ross SJ, et al. Curriculum for achieving universal health care: a case study of Ateneo de Zamboanga University School of Medicine. Front Public Health. (2021) 9:612035. doi: 10.3389/fpubh.2021.612035

PubMed Abstract | Crossref Full Text | Google Scholar

9. Dai CM, Bertram K, Chahine S. Feedback credibility in healthcare education: a systematic review and synthesis. Med Sci Educ. (2021) 31:923–33. doi: 10.1007/s40670-020-01167-w

PubMed Abstract | Crossref Full Text | Google Scholar

10. Barr J, Ogden K, Robertson I, Martin J. Exploring how differently patients and clinical tutors see the same consultation: building evidence for inclusion of real patient feedback in medical education. BMC Med Educ. (2021) 21:246. doi: 10.1186/s12909-021-02654-3

PubMed Abstract | Crossref Full Text | Google Scholar

11. Chan K, Samoutis G. Patient-centred medicine: the use of expert patients in medical education. J Contemp Med Educ. (2020) 10:84. doi: 10.5455/jcme.20200129092612

Crossref Full Text | Google Scholar

12. Tielemans C, De Kleijn R, Van Der Schaaf M, Broek Van der S, Westerveld T. The Westerveld framework for interprofessional feedback dialogues in health professions education. Assess Eval High Educ. (2021) 48:241–57. doi: 10.1080/02602938.2021.1967285

Crossref Full Text | Google Scholar

13. King A, Hoppe RB. “Best practice” for patient-centered communication: a narrative review. J Grad Med Educ. (2013) 5:385–93. doi: 10.4300/JGME-D-13-00072.1

PubMed Abstract | Crossref Full Text | Google Scholar

14. Lai MMY, Roberts N, Mohebbi M, Martin J. A randomised controlled trial of feedback to improve patient satisfaction and consultation skills in medical students. BMC Med Educ. (2020) 20:277. doi: 10.1186/s12909-020-02171-9

PubMed Abstract | Crossref Full Text | Google Scholar

15. Finch E, Lethlean J, Rose T, Fleming J, Theodoros D, Cameron A, et al. How does feedback from patients impact upon healthcare student clinical skill development and learning? A systematic review. Med Teach. (2018) 40:244–52. doi: 10.1080/0142159X.2017.1401218

PubMed Abstract | Crossref Full Text | Google Scholar

16. Eijkelboom MCL, de Kleijn RAM, van Diemen WJM, Maljaars CDN, van der Schaaf MF, Frenkel J. Patients as feedback providers: exploring medical students' credibility judgments. Perspect Med Educ. (2023) 12:129–40. doi: 10.5334/pme.842

PubMed Abstract | Crossref Full Text | Google Scholar

17. Björklund K, Stenfors T, Nilsson GH, Alinaghizadeh H, Leanderson C. Let's ask the patient – composition and validation of a questionnaire for patients' feedback to medical students. BMC Med Educ. (2021) 21:1–13. doi: 10.1186/s12909-021-02683-y

PubMed Abstract | Crossref Full Text | Google Scholar

18. Dijk SW, Duijzer EJ, Wienold M. Role of active patient involvement in undergraduate medical education: a systematic review. BMJ Open. (2020) 10:e037217. doi: 10.1136/bmjopen-2020-037217

PubMed Abstract | Crossref Full Text | Google Scholar

19. Burgess A, van Diggele C, Roberts C, Mellis C. Introduction to the peer teacher training in health professional education supplement series. BMC Med Educ. (2020) 20:454. doi: 10.1186/s12909-020-02279-y

PubMed Abstract | Crossref Full Text | Google Scholar

20. Wykurz G, Kelly D. Developing the role of patients as teachers: literature review. BMJ. (2002) 325:818–21. doi: 10.1136/bmj.325.7368.818

PubMed Abstract | Crossref Full Text | Google Scholar

21. Towle A, Bainbridge L, Godolphin W, Katz A, Kline C, Lown B, et al. Active patient involvement in the education of health professionals. Med Educ. (2010) 44:64–74. doi: 10.1111/j.1365-2923.2009.03530.x

PubMed Abstract | Crossref Full Text | Google Scholar

22. Spencer J, Blackmore D, Heard S, McCrorie P, McHaffie D, Scherpbier A, et al. Patient-oriented learning: a review of the role of the patient in the education of medical students. Med Educ. (2000) 34:851–7. doi: 10.1046/j.1365-2923.2000.00779.x

PubMed Abstract | Crossref Full Text | Google Scholar

23. Eva KW, Armson H, Holmboe E, Lockyer J, Loney E, Mann K, et al. Factors influencing responsiveness to feedback: on the interplay between fear, confidence, and reasoning processes. Adv Heal Sci Educ. (2012) 17:15–26. doi: 10.1007/s10459-011-9290-7

PubMed Abstract | Crossref Full Text | Google Scholar

24. Baines R, Regan De Bere S, Stevens S, Read J, Marshall M, Lalani M, et al. The impact of patient feedback on the medical performance of qualified doctors: a systematic review. BMC Med Educ. (2018) 18:1–12. doi: 10.1186/s12909-018-1277-0

PubMed Abstract | Crossref Full Text | Google Scholar

25. Burford B, Greco M, Bedi A, Kergon C, Morrow G, Livingston M, et al. Does questionnaire-based patient feedback reflect the important qualities of clinical consultations? Context, benefits and risks. Patient Educ Couns. (2011) 84:e28–36. doi: 10.1016/j.pec.2010.07.044

PubMed Abstract | Crossref Full Text | Google Scholar

26. Ramani S, Könings KD, Mann KV, Pisarski EE, Van Der Vleuten CPM. About politeness, face, and feedback: exploring resident and faculty perceptions of how institutional feedback culture influences feedback practices. Acad Med. (2018) 93:1348–58. doi: 10.1097/ACM.0000000000002193

PubMed Abstract | Crossref Full Text | Google Scholar

27. Molloy E, Bearman M. Embracing the tension between vulnerability and credibility: ‘intellectual candour' in health professions education. Med Educ. (2019) 53:32–41. doi: 10.1111/medu.13649

PubMed Abstract | Crossref Full Text | Google Scholar

28. Telio S, Ajjawi R, Regehr G. The “educational alliance” as a framework for reconceptualizing feedback in medical education. Acad Med. (2015) 90:609–14. doi: 10.1097/ACM.0000000000000560

PubMed Abstract | Crossref Full Text | Google Scholar

29. Bogetz AL, Orlov N, Blankenburg R, Bhavaraju V, McQueen A, Rassbach C. How residents learn from patient feedback: a multi-institutional qualitative study of pediatrics residents' perspectives. J Grad Med Educ. (2018) 10:176–84. doi: 10.4300/JGME-D-17-00447.1

PubMed Abstract | Crossref Full Text | Google Scholar

30. Mozayan C, Manella H, Chimelski E, Kline M, Alvarez A, Gisondi MA, et al. Patient feedback in the emergency department: a feasibility study of the Resident Communication Assessment Program (ReCAP). J Am Coll Emerg Physicians Open. (2020) 1:1194–8. doi: 10.1002/emp2.12272

PubMed Abstract | Crossref Full Text | Google Scholar

31. Reinders ME, Blankenstein AH, Knol DL, de Vet HCW, van Marwijk HWJ. Validity aspects of the patient feedback questionnaire on consultation skills (PFC), a promising learning instrument in medical education. Patient Educ Couns. (2009) 76:202–6. doi: 10.1016/j.pec.2009.02.003

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: patient feedback, medical training and education, health education paradigms, communication skills, medical practice

Citation: Jerjes W and Harding D (2024) Redefining medical education: harnessing the power of patient feedback. Front. Med. 11:1453262. doi: 10.3389/fmed.2024.1453262

Received: 22 June 2024; Accepted: 08 October 2024;
Published: 18 October 2024.

Edited by:

Jacqueline G. Bloomfield, The University of Sydney, Australia

Reviewed by:

Kathryn Marie Hird, University of Notre Dame Australia, Australia

Copyright © 2024 Jerjes and Harding. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Waseem Jerjes, waseem.jerjes@nhs.net

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.