- 1The Health and Risk Communication Lab, School of Public Health, University of Haifa, Haifa, Israel
- 2Department of Sociology, University of Haifa, Haifa, Israel
Background: Healthcare workers play a central role in communicating information to the public regarding vaccines. Most of the literature has focused on healthcare workers’ hesitancy and doubts about getting the flu vaccine themselves. However, few studies have dealt with how they perceive their role in communicating information regarding vaccines, especially following the COVID-19 pandemic.
Objectives: (1) To identify the communication strategies used by the Israeli Ministry of Health regarding vaccines during epidemic crises (before and after the COVID-19 pandemic); (2) To identify the communication strategies used by healthcare workers regarding vaccines before and after the COVID-19 pandemic.
Methods: A qualitative study based on in-depth interviews was conducted among healthcare workers and used a semi-structured protocol as a research tool. A total of 18 healthcare workers were sampled using purposeful and snowball sampling.
Results: Despite healthcare workers’ perception that there has been a decrease in trust in the Israeli Ministry of Health among the public following the COVID-19 outbreak, they still rely on the Israeli Ministry of Health as their primary source of information and use the same communication strategies (such as fear appeals and correcting information) as of the Israeli Ministry of Health to communicate with the public, healthcare providers, and other relevant stakeholders.
Conclusion: Healthcare workers have been shaped by the professional socialization processes within the health system, leading to a predominant reliance on established communication strategies and informational channels. This reliance underscores the importance of evolving these methods to better engage with the public. To address this, there is a compelling need to innovate and adopt new communication techniques that emphasize effective dialogue and transparent interactions. By doing so, healthcare professionals can ensure that their outreach is not only informative but also responsive to the diverse needs and preferences of the community.
Introduction
Health organizations during epidemics, and also when communicating information about children’s routine vaccines, have adopted several communication strategies to promote vaccination and encourage the public to get vaccinated (1, 2). This study seeks to shed light on some of the strategies employed by healthcare workers before and after the COVID-19 crisis.
Myth-busting – differentiating between facts and myths – is commonly used by health organizations. According to this approach, every piece of information that comes from other sources besides the health organization itself is labeled as a “myth,” while information that originates from the health organization itself is labeled as “fact” (3). Several studies have noted the problematic use of this strategy, which was found to result in a backfire effect (4–6); the public refused to accept this information unless it was supported by scientific evidence (7–9). In addition, repeating the “myth” by the health organizations was found to make the information more familiar and more likely to be true (6). Hence, studies conducted during the COVID-19 outbreak found that health organizations continue to use the same communication strategies of myth-busting and fear appeal strategies (2, 10).
Health organizations also widely used the fear appeal strategy during previous disease outbreaks. A fear appeal strategy attempts to persuade the public to adopt a specific action (such as vaccination or compliance with instructions) by arousing fear. This strategy is based on emphasizing the potential danger and harm that might result if the public does not adopt the messages’ recommendations (11). A comprehensive meta-analysis of fear appeal literature indicates that this strategy is ineffective (12). Moreover, fear appeal has also been associated with negative effects and responses such as risk denial, biased information processing, lower levels of self-efficacy, less attention, and a higher level of discomfort after being exposed to fear appeal messages during a vaccine promotion campaign (13, 14). Previous studies emphasized the apparent use of a fear appeal strategy by the Israeli Ministry of Health during the COVID-19 vaccination campaign (2). The use of this strategy was characterized by the language and tone politicians used to deliver information in the media (15, 16).
Health organizations have used these communication strategies and reached the public through the media, especially through channels such as social media in the last decade. However, the primary way of communicating with the public is still through healthcare workers, including nurses and physicians. Healthcare workers are considered the representatives of health organizations and as such play an essential role in public vaccination (17). This role includes communicating recommendations, providing information about vaccines, and vaccinating the public (18). Physicians and other healthcare providers are considered the most reliable source of information (19).
Parents perceive healthcare workers as a primary and trustworthy source of information about vaccination and vaccines (20) and play a central role in maintaining public trust in vaccination (21). Healthcare workers’ recommendations were found to be strong drivers of vaccine acceptance among the public. Therefore, they are in a position to empower parents to make an informed decision about vaccinating their children (19).
Due to the essential role of healthcare workers in the vaccination process and as a trusted source of information for parents, as well as influencing the parents’ attitudes regarding vaccination, there is a need for a better understanding of how they communicate vaccination information. This is further supported by the fact that most of the studies in the literature on healthcare workers and vaccines have focused on vaccine hesitancy, vaccine acceptance, and vaccination intention among healthcare workers (22–24). However, few studies have dealt with how healthcare workers perceive their role in communicating information regarding vaccines to the public, especially following the COVID-19 pandemic.
This study aims to (1) Identify the communication strategies used by the Israeli Ministry of Health regarding vaccines during epidemic crises (before and after the COVID-19 pandemic); (2) Identify the communication strategies used by healthcare workers regarding vaccines before and after the COVID-19 pandemic.
Methods
Research design and procedure
This study is based on a qualitative constructivist research method (25), which enables the researchers to study the meaning of the experience as it is perceived by the research subjects. In this study, healthcare workers themselves are used as the instrument for data collection to identify the communication strategies employed by healthcare workers and health organizations (26).
The study was approved by the Faculty of Social Welfare and Health Sciences Ethics Committee for research with human subjects at the University of Haifa (approval no. 421/17). The studies were conducted in accordance with the Israeli Medical Research Involving Human Subjects Law (1996) as the local legislation, and the requirements and guidelines set by the University of Haifa Ethics Committee. Written informed consent to participate in this study was provided by the participants.
Sampling and data collection
In the first stage, the researchers performed a purposeful criterion sampling of healthcare workers such as family physicians, pediatricians, and nurses who are involved in the vaccination process with the public, including giving vaccines and communicating information regarding vaccines to the public. In the second stage, the researchers proceeded to perform snowball sampling. The study’s sample included 18 healthcare workers – 9 pediatricians, 1 physician, and 8 nurses from the Mother and Child Health Clinics were interviewed (Table 1). The duration of each interview was approximately half an hour.
Research tools
In-depth interviews were conducted based on a semi-structured protocol. In the first part, the questions referred to the period before the COVID-19 outbreak in Israel. The interviewees were asked questions about how they communicate the issue of vaccines to the parents, how the Israeli Ministry of Health communicates the issue of vaccines, how they deal with uncertainty, and how they correct misinformation regarding vaccines. In addition, the questionnaire included questions regarding the level of trust in the health system in Israel. The second part of the questionnaire aimed to examine whether the interviewees’ attitudes and perceptions changed after the COVID-19 outbreak in Israel. Therefore, this part included questions about the change in the level of trust in the health system in Israel, vaccine hesitancy after the COVID-19 outbreak, and how the health organizations in Israel communicated the information about the COVID-19 virus and its vaccine to the public.
Credibility and validity
The qualitative interviews were conducted in the language preferred by the interviewee (Hebrew or Arabic) and they were audio-recorded. Then, they were transcribed verbatim, and the Arabic interviews were translated into Hebrew. The validity and reliability of this study were established based on the framework presented by Lincoln and Guba (26). These researchers suggested the term “trustworthiness” to evaluate the validity and reliability of the qualitative research. Trustworthiness is demonstrated through four components. The first component is credibility (comparable with internal validity) and refers to the “fit” between the participants’ views and the researchers’ presentation of the findings. Transferability (comparable with external validity) is the second component, which addresses the issue of generalizability of inquiry and the researchers’ ability to anchor the research findings in other similar cases and other relevant theories. The third component is dependability (comparable with reliability), which is achieved by ensuring that the research process is logical, traceable, and clearly documented. The last component is confirmability (comparable with objectivity or neutrality), which is concerned with establishing that the findings do not arise from the researchers’ assumptions, prejudices, interests, and motivations, but are clearly derived from the data and allow for the acceptance of the conclusions arising from the findings (27). This study achieved these components through prolonged engagement, persistent observation, peer debriefing, and audit trials (28).
Analysis
Qualitative data were analyzed using thematic analysis (29). Specifically, we focused on text codes regarding the participants’ attitudes toward vaccination, dilemmas in communicating the information regarding vaccines to the public, the public’s perceived level of trust in the health system, and how participants perceive health organizations’ communication methods in Israel before and after the COVID-19 outbreak. These codes were then grouped into themes and sub-themes, and following the rules for inclusion in each category, relevant texts from subsequent interviews were coded.
Results
Four main themes emerged from the analysis of the interviews (Table 2). The themes focused on the communication strategies used by healthcare workers and the Israeli Ministry of Health before and after the COVID-19 outbreak, and on how the participants perceived these strategies. In addition, the issue of trust in the Ministry of Health also emerged as a main theme.
Trust in the Israeli Ministry of Health
Trust in the Ministry of Health emerged as a main theme in the study. The interviewees referred to (1) healthcare workers’ trust in the Ministry of Health, and (2) the public’s level of trust in the Ministry of Health before and after the COVID-19 outbreak in Israel.
Healthcare workers’ trust in the Ministry of Health
Seven interviewees out of 18 expressed a high level of trust in the Ministry of Health. The interviewees described the Ministry of Health as a reliable and trustworthy source of health information in general and as regards vaccine information.
“I trust all the information provided by the Ministry of Health. This information is reliable and trustworthy” (Interviewee 12).
In addition, the interviewees expressed a high level of trust in the health authorities represented by the Ministry of Health and policymakers. They claimed that policymakers always make the best decisions for public health. Their decisions are based on studies and motivated by concern and responsibility for public health and not by other hidden interests. “I am confident in the policymakers and their decisions. I trust the authorities. The decisions regarding vaccines aim to promote public health and are not motivated by hidden interests” (Interviewee 7).
The public’s level of trust in the Ministry of Health before and after the COVID-19 outbreak in Israel
Most interviewees referred to the change in the public’s level of trust in the Ministry of Health after the COVID-19 outbreak in Israel. Fourteen out of 18 interviewees mentioned that the public’s trust in the Ministry of Health was higher before the COVID-19 outbreak in Israel. However, following the COVID-19 outbreak in Israel, the public’s level of trust in the Ministry of Health decreased because of crisis management issues, particularly inconsistent instructions, inconsistent statistical reporting of the COVID-19 cases, political and economic motives, and using an intimidation-based communication strategy.
“The level of trust has decreased because of corruption and political and economic interests… The public doesn’t feel their personal interest is a priority of the authorities… Instead, they see that there are all kinds of other interests and things that influence the authorities' decisions such as politics, ego, power, and economic interests” (Interviewee 10).
“After the COVID-19 outbreak, the level of trust decreased. The health authorities reported inconsistent statistics regarding the number of COVID-19 cases, in general, and serious cases, in particular. The authorities scared the public, and people understood that the number of reported patients was not accurate” (Interviewee 11).
In addition, some interviewees claimed social media was the reason for the decrease in the public’s trust in the Ministry of Health after the COVID-19 outbreak. The public was exposed to anti-vaccination information and intense debate on social media regarding the COVID-19 vaccine’s effectiveness and safety.
“Before the COVID-19 outbreak, the public’s trust in the Ministry of Health was higher. Fewer people were exposed to what was written on social media and anti-vaccination messages. Some parents didn’t know that there are parents who oppose vaccines and don’t vaccinate their children” (Interviewee 14).
However, one interviewee claimed that the drop in the public’s level of trust in the Ministry of Health was a temporary situation and that the level of trust has returned to what it was before the COVID-19 outbreak.
“I think the public has already forgotten what happened during the COVID-19 outbreak, and the trust has returned to its previous level. There was no real loss of trust … It’s just that at first, we received ambiguous instructions because there were constant changes in the instructions… Almost every week, we received different instructions, and we were confused” (Interviewee 1).
Information communication by the Israeli Ministry of Health
The interviewees described the communication strategies used by the Ministry of Health. These strategies included fear appeals and correcting misinformation. In addition, they described the information delivered by the Ministry of Health as being uniform, without adapting the information to the different public groups.
Fear appeals as the main strategy for communicating information
Most interviewees (15 out of 18) claimed the Ministry of Health used and still uses fear appeal as the primary strategy to promote vaccination before and after the COVID-19 outbreak. As described by the interviewees, this strategy is based on persuasive messages that attempt to arouse fear among the public to promote routine vaccines and the COVID-19 vaccine. These messages emphasized the severity of the disease, the risk of not being vaccinated, reported statistics of infected cases and deaths, and sanctions against those who are not vaccinated and fail to comply with the health authorities’ recommendations. They described this strategy as effectively motivating the public to vaccinate and claimed that imposing sanctions – such as preventing unvaccinated children from entering kindergarten – against unvaccinated individuals is legitimate.
“The act of not letting an unvaccinated child into kindergarten is completely acceptable. I think that unvaccinated children should not be protected indirectly because other children are vaccinated” (Interviewee 8).
“The public got the vaccine because the Ministry of Health scared them and forced them to get vaccinated. The Ministry of Health described the virus as very contagious and said the disease was severe” (Interviewee 2).
Correcting misinformation
Healthcare workers and health organizations play a critical role in addressing and correcting misinformation. Thirteen interviewees described the methods by which they and the health organizations correct misinformation. For example, healthcare workers may face misinformation regarding vaccines during their appointments with parents. According to the interviewees, healthcare workers’ ways of correcting information included explaining the importance of vaccination in preventing infectious diseases to the parents, assessing the risks and benefits of vaccines, and explaining that clinical trials have been conducted to approve vaccines just like other medicines.
“I give an example of the medicines they receive. Furthermore, I explain that both these medicines and vaccines have undergone clinical trials. Moreover, I also present the statistics and how people in the past died before vaccines were invented” (Interviewee 4).
In addition, the interviewees dealt with misinformation by referring parents to the Ministry of Health website for more information or giving them medical information leaflets provided by the Ministry of Health. Another way to deal with the misinformation suggested by the interviewees is to rely on their rich experience and say that this information needs to be corrected.
“I refer parents to the Ministry of Health website and explain that I’ve been working here for years and that they should trust me. I also try to explain more about the risks and benefits of vaccines” (Interviewee 8).
“I explain that during the 20 years that I’ve worked as a Tipat-Halav (Mother and Child Health Clinics) nurse, I’ve never seen any child who suffered from unusual symptoms or side effects such as those which you, the parent, mentioned … I say that even if it’s true, then it occurs among a very small percentage of children” (Interviewee 2).
Two interviewees claimed that they would search for studies addressing and correcting misinformation from other sources of information besides the Ministry of Health, such as studies conducted in other countries. In addition, one interviewee also suggested referring parents to reliable information-seeking sources.
“To deal with misinformation, I search for other studies carried out in Israel and abroad, and I send these studies to the parents or even tell them where to search for reliable information” (Interviewee 7).
The interviewees also mentioned that health organizations correct misinformation by presenting the misinformation and its correction. To correct misinformation, health organizations used healthcare workers who appeared in the media or posted posts on social media mentioning fake news.
“Healthcare workers and experts appeared in the media to correct misinformation” (Interviewee 18).
“The Ministry of Health started to correct the misinformation through social media during the COVID-19 outbreak by mentioning the misinformation and labeling it as false or fake” (Interviewee 14).
Segmentation of the public
The way the Ministry of Health communicates information in general, and on the topic of vaccination in particular, emerged as a theme from the interviews. Fifteen interviewees (out of 18) described the information provided by the Ministry of Health as uniform and addressed to the broad public. This means the transmitted information is not adapted to the different groups which comprise the general public.
“I think the Ministry of Health provides everyone with the same information, but everyone deals with the information differently” (Interviewee 15).
How healthcare workers perceive the Ministry’s of Health communication strategies and its ways of conveying information to the public
This main theme consisted of four sub-themes: (1) the controversy regarding transparency and providing complete information; (2) communicating uncertainty; (3) the Ministry of Health is the most reliable source of information for healthcare workers; and (4) healthcare workers as role models.
The controversy regarding transparency and providing complete information
On the one hand, four interviewees out of 18 claimed that the Ministry of Health does not provide the public with complete and transparent information. In addition, they mentioned that the Ministry of Health needs to be transparent and provide complete and accurate information to the public, so they can make informed decisions regarding their health. Moreover, some interviewees argued that not providing complete information underestimates the public’s intelligence and that the health authorities perceive the public as being unable to deal with all the information and make the best decisions regarding their health.
“The Ministry of Health certainly does not provide complete information to the public. Instead, it provides the information it thinks the public should know. The Ministry of Health doesn’t think the public is intelligent enough to make their own health decisions. The authorities perceive the public as lacking the ability to read, understand, and ask questions. You have a doctor, do what he tells you. Today, it is no longer like that; some patients know more about their diseases than their doctors because they have access to the information. I believe underestimating the public’s intelligence is not good” (Interviewee 10).
On the other hand, six interviewees out of 18 suggested that the Ministry of Health should not provide complete information to the public. They also claimed that the public could not deal with complete information and that providing it might create confusion among the public. Therefore, the Ministry of Health should make public health decisions and provide information that promotes vaccination or motivates the public to make the decision recommended by the Ministry of Health.
“I think providing complete information is wrong because the patient should play the role of the patient, and the doctor should play the role of the doctor. The patient should not cross this border… The information should be conveyed assertively, and in a goal-oriented manner… and the goal should be to promote vaccination” (Interviewee 4).
Communicating uncertainty
Communicating uncertainty to the public was examined through nine interviewees. On the one hand, seven interviewees mentioned that the public could not handle or deal with uncertainty and that communicating uncertainty might generate confusion and “hysteria” among the public. Therefore, health organizations should provide only specific information.
“I think the public cannot deal with uncertainty. In addition, communicating uncertainty may generate confusion. It also requires a lot of explanation and effort, which burdens the health system” (Interviewee 4).
On the other hand, two interviewees mentioned that the public wants to receive complete and transparent information, including uncertain information. Moreover, it is the public’s right to receive complete information. Therefore, health organizations need to practice transparent communication.
“The public should receive all the information, including uncertainty … there is no such thing as hiding information. The information should be transparent… I think the Ministry of Health does not communicate all the information” (Interviewee 6).
The Ministry of Health is the most reliable source of information for healthcare workers
Thirteen interviewees out of 18 mentioned that for them the only source of information regarding vaccines is the Ministry of Health. Therefore, they only share information from the Ministry of Health with parents or on social media. Moreover, some mentioned that they do not know of any other sources of information besides the Ministry of Health that are reliable and trustworthy.
“I’m not aware of any other sources besides the Ministry of Health. We get the information only from the Ministry of Health” (Interviewee 12).
"I only receive information from the Ministry of Health and share it on social networks as well” (Interviewee 13).
In addition, some interviewees mentioned that parents who ask for more information from other sources are referred to websites recommended by the Ministry of Health.
“We give parents who ask for more information a website we received in lectures for Tipat-Halav nurses. This is a website recommended by the Ministry of Health … We refer concerned parents to this site along with those who say they prefer to postpone getting the vaccine for another month…” (Interviewee 8).
Healthcare workers as role models
Six interviewees out of 18 claimed they try to encourage hesitant and anti-vaccination parents to vaccinate their children by mentioning that they themselves, as well as their children, are vaccinated.
“In addition to explaining and talking about studies, I would tell the parents about myself, that I am vaccinated, and that my children are vaccinated. This convinced most of them to vaccinate their children” (Interviewee 15).
However, three interviewees out of 18 described the difficulty of promoting some vaccines, such as the COVID-19 vaccine, the Polio vaccine, and the Rotavirus vaccine. They said that because they consider themselves role models, it is difficult to recommend hesitant and anti-vaccination parents to vaccinate their children when they, themselves, do not vaccinate their children with these vaccines or believe that these vaccines are effective and safe.
"It was difficult for me to recommend the Corona vaccine for both adults and children. I had concerns because I know several people who suffered from side effects from the vaccine” (Interviewee 14).
“I have concerns regarding the safety of the Polio vaccine. Only two of my children were vaccinated with this vaccine. Therefore, when a hesitant parent asks me what I did, it’s hard for me to tell them that I didn’t vaccinate all my children because we are role models. Sometimes, I say that it doesn’t matter what I did. Moreover, sometimes, I say that I did vaccinate my children … Regarding the Rotavirus vaccine, it’s hard for me to encourage hesitant parents to vaccinate their baby because I know that the baby may suffer from side effects and pain” (Interviewee 9).
How healthcare workers perceive children’s vaccination and parents who are hesitant or anti-vaccination
The interviewees described their concerns and doubts regarding vaccinating children with the COVID-19 vaccine. In addition, they mentioned in this main theme how they perceive and communicate with hesitant and anti-vaccination parents.
Concerns following the recommendation to vaccinate children with the COVID-19 vaccine
The interviewees (nine out of 18) expressed concerns about the recommendation to vaccinate children with the COVID-19 vaccine. They claimed that authorities were supposed not to rush recommending vaccinating children because the COVID-19 vaccine was new. In addition to fewer severe reported cases of Corona disease among children, more information was available regarding short-term side effects, and long-term side effects were still being determined. Therefore, they were not confident about recommending the COVID-19 vaccine for children.
“Regarding the COVID-19 vaccine, my family and I were vaccinated, but regarding children's vaccinations, I would wait with that and not rush to vaccinate. Because children are not at risk, especially healthy children” (Interviewee 12).
“It was tough for me to recommend the COVID-19 vaccine because the vaccine is new and its side effects are still unknown” (Interviewee 11).
How healthcare workers perceive anti-vaccination parents
Eleven interviewees described how they perceive anti-vaccination parents. Most of them (9 out of 11) think that anti-vaccination parents oppose vaccines because of their ideological perceptions and their opposing attitudes toward the government, or they think the vaccination process is motivated by hidden interests. In addition, anti-vaccination parents’ attitudes rely on the information they receive from social media or rumors that are not evidence-based. Therefore, these healthcare workers think it is not worth trying to conduct a dialogue with these parents because they will not be convinced.
“They decide not to vaccinate without scientific proof and only because they heard that the vaccine could cause harm from their neighbors or someone who knows nothing … their information is not scientifically based” (Interviewee 11).
“The opposition to the government is expressed by their opposition to the vaccines… At the same time, many groups with agendas publish fake news and misinformation on social media… I don’t have the time or the patience to try and talk with them” (Interviewee 5).
However, three interviewees mentioned that there are anti-vaccination parents whose attitudes are based on scientific information such as studies and articles. In addition, they described these parents as highly educated.
“I was surprised to find that some anti-vaccination parents are highly educated. Some are physicians and refuse vaccines out of knowledge. For example, they cite side effects listed in the American leaflet and not in the Israeli leaflet, and they cite scientific studies and quotes from expert doctors from abroad” (Interviewee 16).
Discussion
The literature has indicated the unique and essential role of healthcare workers in mediating the public’s trust in health authorities and policymakers. Previous studies have found that trust in the healthcare system is essential to public compliance with the authorities’ recommendations and guidelines during epidemics (30, 31). The public’s trust in the healthcare system includes trust in the health authorities, healthcare workers, and policymakers (32). Trust was also found to influence the public’s acceptance of vaccines. Higher trust in the healthcare system is associated with lower barriers and higher acceptance of vaccines (33, 34). The COVID-19 outbreak has elucidated the importance of establishing trust in the health authorities among the public. Recent studies have emphasized the importance of trust in the healthcare system and its association with compliance with both the COVID-19 vaccine and the authorities’ recommendations (35–40). In this study, healthcare workers reported a decrease in the public’s trust in the health authorities following the COVID-19 outbreak in Israel. However, despite the decrease in the public’s trust in the health authorities, the study findings show a high level of trust in the health authorities among healthcare workers during the COVID-19 outbreak in Israel.
An essential aspect related to healthcare workers’ trust in this study is the fact that many perceive the health authorities as their primary and only source of credible and reliable information. Previous studies have found that although the public draws upon various sources of information, such as social media (41), healthcare workers are still perceived as a primary and trustworthy source of information about vaccination (20). As part of the healthcare workers’ role, they are required to provide information to the public, address their concerns, and answer their questions. Therefore, healthcare workers need to have up-to-date and comprehensive information (42) to serve as a reliable source for the public (43).
The same ambivalent approach represents the rest of the participants’ attitudes in this study. For example, most of the participants claimed that the Ministry of Health uses a fear appeal strategy to communicate with the public. They stated that the Israeli Ministry of Health uses fear-based messages to promote vaccinations by emphasizing disease severity, risks of being unvaccinated, infection/death statistics, and sanctions for non-compliance. Participants viewed this approach and restricting kindergarten access for the unvaccinated as effective and legitimate motivators. Consistently, previous studies found that fear appeal strategy was widely employed in COVID-19 public health messages to promote preventive behaviors by highlighting illness or death risks (44, 45). However, overreliance on fear risks unintended consequences (46). While fear can motivate if applied judiciously, balancing severity, susceptibility, self-efficacy and response efficacy is complex (47). For instance, a Kenyan case study found job/income loss threats promoted hand sanitizing and masking among taxi drivers (48). In addition, previous studies found that sanction risk had no significant effect on compliance (49, 50).
Attitudes of the participants also diverged regarding transparency. Some stated that the Ministry of Health should provide complete information and communicate with transparency. On the other hand, still, other healthcare workers in this study believe the communication strategies used by the Ministry of Health are effective and think the Ministry of Health should provide the public with only partial information.
The same holds true regarding their perceptions about vaccinating children with the COVID-19 vaccine. Although they reported having concerns and doubts regarding the vaccine’s safety and admitted they did not have sufficient information regarding the vaccine’s side effects among children, they still communicated the importance of vaccinating children and recommended this vaccine for children. In addition, they said they believed the health authorities had successfully managed the COVID-19 crisis. Contrary to these findings, a recent study showed that Israeli health professionals expressed varied levels of trust in the authorities and a moderate level of trust in policy during the first wave of COVID-19 (51).
The findings indicate that despite health workers’ reservations about a variety of issues (the use of fear appeal, child vaccinations, etc.), they still perceive the Ministry of Health as a reliable and central source of information and used the same strategies to convey information to the public during COVID-19 pandemic. These findings may be explained by the socialization of healthcare workers, which is defined as “a process in which people learn to adapt to values, skills, points of view, norms, and knowledge needed for belonging to a community, group, or organization” (52).
The inconsistent findings in this study regarding the high level of trust among healthcare workers, their perception of the public’s decreased level of trust in the Ministry of Health, and their hesitant attitudes regarding giving children the COVID-19 vaccine may be explained by cognitive dissonance theory. This theory claims that inconsistency between attitudes, beliefs, and behaviors may create cognitive dissonance and a lack of harmony accompanied by psychological stress. Therefore, people seek psychological consistency by resolving the dissonance and aligning their cognitions with their actions. Blindly trusting whatever they want to believe or avoiding contradictory information are ways to establish psychological consistency and reduce the magnitude of the dissonance (53, 54). For example, recent research found that inducing cognitive dissonance improved COVID-19 safety compliance and vaccination attempts versus controls (55). Concerning the findings of this study, cognitive dissonance may provide a useful framework for several reasons. First, it directly links the inconsistencies observed between trust in the health authorities and attitudes toward vaccination. Second, seeking consistency to resolve dissonance fits with healthcare workers’ tendency to maintain trust and recommend the COVID-19 vaccine despite doubts raised. However, cognitive dissonance theory faced limitations as alternative theoretical frameworks and models were proposed to account for various dissonance-related findings (56–59). For instance, Bem (60, 61) self-perception theory and Tedeschi et al. (62) impression management theory aimed to explain dissonance effects observed in classic studies like Festinger and Carlsmith (63). Additionally, early research by Heine and Lehman (64) suggested that cultural factors may moderate experiences of dissonance. Social cognition theories and theories about motivational processes were also put forth as alternative explanatory perspectives (65, 66). Some experimental designs further challenged certain specific aspects of cognitive dissonance theory (67, 68). Therefore, other interpretations may be possible, and cognitive dissonance may not fully account for the complex factors influencing attitudes and behaviors. With these limitations in mind, cognitive dissonance theory still offers one approach for comprehending how healthcare workers reconcile their conflicting attitudes and perceptions to establish psychological consistency and reduce dissonance through vaccine recommendations and trust in authorities.
Another theory that may explain the study findings is Heider’s balance theory, which reinforces the cognitive dissonance theory. This theory is based on a triadic model where a balance must exist among the three subjects involved. Therefore, the individual tends to seek modifications to maintain cognitive and emotional harmony and balance (54, 69, 70). According to this theory, healthcare workers in this study seek to maintain a balance between their trust in the science of vaccines, their trust in the Ministry of Health (which promotes vaccines), and their communication strategies and recommendations for the COVID-19 vaccine. Thus, a higher level of trust among healthcare workers in the science of vaccines leads to a higher level of trust in the Ministry of Health (which promotes vaccines), eventually resulting in behavior that reflects vaccination recommendations and adopts the same communication strategies as the Ministry of Health.
Study limitations
This is a qualitative study that does not profess to include a representative sample of healthcare workers. However, the strength of the qualitative study lies in the richness and depth of the collected data. A clear limitation is the small sample size (only 18 healthcare workers were interviewed). Consequently, the results cannot be generalized to the entire population of Israeli healthcare workers. It is important to note, though, that thematic saturation was achieved within the analysis. In addition, the sample consisted of specific categories of healthcare workers (pediatricians, a physician, and nurses), who primarily work at child health centers that belong to the Ministry of Health and health organizations. As such, it is possible that the attitudes and perceptions shared may not fully encompass the diversity of views among Israel’s broader healthcare community, which includes a more extensive array of professional roles and specializations. Therefore, future studies should include other healthcare workers besides the ones in the study sample. Further studies should also be conducted to evaluate the healthcare workers’ trust in the health authorities, due to a dearth of these studies in the literature. It is important to note that this study was partly conducted before the COVID-19 outbreak and resumed after the COVID-19 vaccination campaign. Therefore, it aimed to address the change in attitudes and perceptions among healthcare workers regarding the communication of the vaccine issue. Thus, follow-up studies on healthcare workers’ communication strategies should be conducted.
Conclusion
In summary, the study’s findings indicate that healthcare workers have undergone professional socialization by the health system. Despite healthcare workers’ perception that there has been a decrease in the public’s trust in the Ministry of Health following the COVID-19 outbreak, the workers, themselves, continue to adopt the same communication strategies as the health authorities. Therefore, to increase the public’s trust in both the healthcare system and in healthcare workers, multifaceted approaches and policies are recommended. Health organizations, authorities, and healthcare workers need to change their communication strategies to regain public trust. This includes transparently providing complete information, encouraging open dialogue to address public concerns and fears, and empowering healthcare workers to engage patients through dedicated discussion time and communication training. Health authorities and workers should also collaborate on unified messaging campaigns to enhance credibility, while tailoring outreach efforts to acknowledge the diversity of public perspectives across different demographic groups. It is important to note that while these recommendations are based on the findings from this study, the limited generalizability of the study should be considered.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by the Faculty of Social Welfare and Health Sciences Ethics Committee for research with human subjects at the University of Haifa (approval no. 421/17). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
RH: Conceptualization, Data curation, Formal analysis, Investigation, Validation, Writing – original draft, Writing – review & editing. AG-E: Conceptualization, Formal analysis, Supervision, Validation, Writing – original draft, Writing – review & editing. GM: Supervision, Writing – review & editing.
Funding
The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.
Acknowledgments
This study was part of RH PhD dissertation conducted at the School of Public Health, Faculty of Social Welfare and Health Sciences, University of Haifa, supervised by AG-E and GM.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Gesser-Edelsburg, A, Diamant, A, Hijazi, R, and Mesch, GS. Correcting misinformation by health organizations during measles outbreaks: a controlled experiment. PLoS One. (2018) 13:e0209505. doi: 10.1371/journal.pone.0209505
2. Gesser-Edelsburg, A, Hijazi, R, and Cohen, R. It takes two to tango: how the Covid-19 vaccination campaign in Israel was framed by the health ministry vs. the television news. Front Public Health. (2022) 10:887579. doi: 10.3389/fpubh.2022.887579
3. Charron, J, Gautier, A, and Jestin, C. Influence of information sources on vaccine hesitancy and practices. Med Mal Infect. (2020) 50:727–33. doi: 10.1016/j.medmal.2020.01.010
4. Manyibe, EO . Top ten cancer myths. J Appl Rehabil Couns. (2006) 37:36. Available at: https://www.proquest.com/scholarly-journals/top-ten-cancer-myths/docview/216484304/se-2
5. Miller, K . Book review: Girls' violence: myths and realities. Youth Violence Juvenile Justice. (2007) 5:207–10. doi: 10.1177/1541204006296166
6. Signorini, A, Segre, AM, and Polgreen, PM. The use of twitter to track levels of disease activity and public concern in the U.S. during the influenza a H1n1 pandemic. PLoS One. (2011) 6:e19467. doi: 10.1371/journal.pone.0019467
7. Baxendale, S, and O'Toole, A. Epilepsy myths: alive and foaming in the 21st century. Epilepsy Behav. (2007) 11:192–6. doi: 10.1016/j.yebeh.2007.04.019
8. Challenger, A, Sumner, P, and Bott, L. Covid-19 myth-busting: an experimental study. BMC Public Health. (2022) 22:131. doi: 10.1186/s12889-021-12464-3
9. Romo, LK . “Above the influence”: how college students communicate about the healthy deviance of alcohol abstinence. Health Commun. (2012) 27:672–81. doi: 10.1080/10410236.2011.629409
10. Gesser-Edelsburg, A . How to make health and risk communication on social media more "social" during Covid-19. Risk Manag Healthc Policy. (2021) 14:3523–40. doi: 10.2147/rmhp.S317517
11. Maddux, JE, and Rogers, RW. Protection motivation and self-efficacy: a revised theory of fear appeals and attitude change. J Exp Soc Psychol. (1983) 19:469–79. doi: 10.1016/0022-1031(83)90023-9
12. Tannenbaum, MB, Hepler, J, Zimmerman, RS, Saul, L, Jacobs, S, Wilson, K, et al. Appealing to fear: a Meta-analysis of fear appeal effectiveness and theories. Psychol Bull. (2015) 141:1178–204. doi: 10.1037/a0039729
13. Ort, A, and Fahr, A. Using efficacy cues in persuasive health communication is more effective than employing threats – an experimental study of a vaccination intervention against Ebola. Br J Health Psychol. (2018) 23:665–84. doi: 10.1111/bjhp.12310
14. Su, Z, McDonnell, D, Wen, J, Cheshmehzangi, A, Ahmad, J, Goh, E, et al. Young Adults' preferences for influenza vaccination campaign messages: implications for Covid-19 vaccine intervention design and development. Brain Behav Immun Health. (2021) 14:100261. doi: 10.1016/j.bbih.2021.100261
15. Gesser-Edelsburg, A . Using narrative evidence to convey health information on social media: the case of Covid-19. J Med Internet Res. (2021) 23:e24948. doi: 10.2196/24948
16. Gesser-Edelsburg, A, and Hijazi, R. When politics meets pandemic: how prime minister Netanyahu and a small team communicated health and risk information to the Israeli public during the early stages of Covid-19. Risk Manag Healthc Policy. (2020) 13:2985–3002. doi: 10.2147/rmhp.S280952
17. ECDC . Communication on immunisation – Building trust. Stockholm: European Centre for Disease Prevention and Control (2012).
18. Bouder, F . Risk communication of vaccines: challenges in the post-trust environment. Curr Drug Saf. (2015) 10:9–15. doi: 10.2174/157488631001150407103916
19. Simone, B, Carrillo-Santisteve, P, and Lopalco, PL. Healthcare workers’ role in keeping Mmr vaccination uptake high in Europe: a review of evidence. Eur Secur. (2012) 17:20206. doi: 10.2807/ese.17.26.20206-en
20. Verger, P, and Dubé, E. Restoring confidence in vaccines in the Covid-19 era. Expert Rev Vaccines. (2020) 19:991–3. doi: 10.1080/14760584.2020.1825945
21. Kempe, A, Daley, MF, McCauley, MM, Crane, LA, Suh, CA, Kennedy, AM, et al. Prevalence of parental concerns about childhood vaccines: the experience of primary care physicians. Am J Prev Med. (2011) 40:548–55. doi: 10.1016/j.amepre.2010.12.025
22. Peterson, CJ, Lee, B, and Nugent, K. Covid-19 vaccination hesitancy among healthcare workers-a review. Vaccines (Basel). (2022) 10:948. doi: 10.3390/vaccines10060948
23. Verger, P, Botelho-Nevers, E, Garrison, A, Gagnon, D, Gagneur, A, Gagneux-Brunon, A, et al. Vaccine hesitancy in health-care providers in Western countries: a narrative review. Expert Rev Vaccines. (2022) 21:909–27. doi: 10.1080/14760584.2022.2056026
24. Willems, LD, Dyzel, V, and Sterkenburg, PS. Covid-19 vaccination intentions amongst healthcare workers: a scoping review. Int J Environ Res Public Health. (2022) 19:10192. doi: 10.3390/ijerph191610192
25. Creswell, JW, Hanson, WE, Clark Plano, VL, and Morales, A. Qualitative research designs:selection and implementation. Couns Psychol. (2007) 35:236–64. doi: 10.1177/0011000006287390
26. Lincoln, YS, and Guba, EG. Naturalistic inquiry. Newbury Park, London, and New Delhi: Sage (1985).
27. Lincoln, YS, Guba, EG, and Pilotta, JJ. Naturalistic inquiry: Beverly Hills, ca: sage publications, 1985. Int J Intercult Relat. (1985) 9:438–9. doi: 10.1016/0147-1767(85)90062-8
28. Lincoln, YS . Emerging criteria for quality in qualitative and interpretive research. Qual Inq. (1995) 1:275–89. doi: 10.1177/107780049500100301
29. Braun, V, and Clarke, V. Using thematic analysis in psychology. Qual Res Psychol. (2006) 3:77–101. doi: 10.1191/1478088706qp063oa
30. Blair, RA, Morse, BS, and Tsai, LL. Public health and public trust: survey evidence from the Ebola virus disease epidemic in Liberia. Soc Sci Med. (2017) 172:89–97. doi: 10.1016/j.socscimed.2016.11.016
31. OECD . Government at a glance 2013: Procurement data. Oecd meeting of leading practitioners on public procurement. Paris: Organisation for Economic Co-operation and Development. (2013).
32. Murdan, S, Ali, N, and Ashiru-Oredope, D. How to address vaccine hesitancy. Pharm J. (2021) 306:7949. Available at: https://pharmaceutical-journal.com/article/ld/how-to-address-vaccine-hesitancy
33. Featherstone, JD, Bell, RA, and Ruiz, JB. Relationship of People's sources of health information and political ideology with acceptance of conspiratorial beliefs about vaccines. Vaccine. (2019) 37:2993–7. doi: 10.1016/j.vaccine.2019.04.063
34. Fu, LY, Zimet, GD, Latkin, CA, and Joseph, JG. Associations of trust and healthcare provider advice with Hpv vaccine acceptance among African American parents. Vaccine. (2017) 35:802–7. doi: 10.1016/j.vaccine.2016.12.045
35. Ali-Saleh, O, Bord, S, and Basis, F. Low response to the Covid-19 vaccine among the Arab population in Israel: is it a cultural background, or a systemic failure, or maybe both? J Racial Ethn Health Disparities. (2023) 10:296–305. doi: 10.1007/s40615-021-01220-3
36. Bord, S, Schor, A, Satran, C, Ali Saleh, O, Inchi, L, and Halperin, D. Distancing adherence and negative emotions among the Israeli elderly population during the Covid-19 pandemic. Int J Environ Res Public Health. (2021) 18:8770. doi: 10.3390/ijerph18168770
37. Jennings, W, Stoker, G, Bunting, H, Valgarðsson, VO, Gaskell, J, Devine, D, et al. Lack of trust, conspiracy beliefs, and social media use predict Covid-19 vaccine hesitancy. Vaccines (Basel). (2021) 9:593. doi: 10.3390/vaccines9060593
38. Satran, C, Ali-Saleh, O, Mashiach-Eizenberg, M, and Bord, S. Stress and perceived discrimination among the Arab population in Israel: the mediation role of the perceived Covid-19 threat and Trust in the Healthcare System. Ethn Health. (2022) 27:1377–94. doi: 10.1080/13557858.2021.1899139
39. Schernhammer, E, Weitzer, J, Laubichler, MD, Birmann, BM, Bertau, M, Zenk, L, et al. Correlates of Covid-19 vaccine hesitancy in Austria: trust and the government. J Public Health (Oxf). (2022) 44:e106–16. doi: 10.1093/pubmed/fdab122
40. Shahrabani, S, Bord, S, Admi, H, and Halberthal, M. Physicians' compliance with Covid-19 regulations: the role of emotions and trust. Healthcare (Basel). (2022) 10:582. doi: 10.3390/healthcare10030582
41. Gesser-Edelsburg, A, Shir-Raz, Y, Walter, N, Mordini, E, Dimitriou, D, James, JJ, et al. The public sphere in emerging infectious disease communication: recipient or active and vocal partner? Disaster Med Public Health Prep. (2015) 9:447–58. doi: 10.1017/dmp.2015.31
42. Gesser-Edelsburg, A, Abed Elhadi Shahbari, N, Cohen, R, Mir Halavi, A, Hijazi, R, Paz-Yaakobovitch, G, et al. Differences in perceptions of health information between the public and health care professionals: nonprobability sampling questionnaire survey. J Med Internet Res. (2019) 21:e14105. doi: 10.2196/14105
43. Tafuri, S, Gallone, MS, Cappelli, MG, Martinelli, D, Prato, R, and Germinario, C. Addressing the anti-vaccination movement and the role of Hcws. Vaccine. (2014) 32:4860–5. doi: 10.1016/j.vaccine.2013.11.006
44. Chang, KC, Strong, C, Pakpour, AH, Griffiths, MD, and Lin, CY. Factors related to preventive Covid-19 infection behaviors among people with mental illness. J Formos Med Assoc. (2020) 119:1772–80. doi: 10.1016/j.jfma.2020.07.032
45. Harper, CA, Satchell, LP, Fido, D, and Latzman, RD. Functional fear predicts public health compliance in the Covid-19 pandemic. Int J Ment Health Addict. (2021) 19:1875–88. doi: 10.1007/s11469-020-00281-5
46. Stolow, JA, Moses, LM, Lederer, AM, and Carter, R. How fear appeal approaches in Covid-19 health communication may be harming the global community. Health Educ Behav. (2020) 47:531–5. doi: 10.1177/1090198120935073
47. Witte, K, and Allen, M. A Meta-analysis of fear appeals: implications for effective public health campaigns. Health Educ Behav. (2000) 27:591–615. doi: 10.1177/109019810002700506
48. Kigatiira, KK . Efficacy of fear appeals on adoption of Covid-19 preventive measures: a case of Boda Boda riders in Nairobi County, Kenya. Int J Res Granthaalayah. (2020) 8:219–28. doi: 10.29121/granthaalayah.v8.i6.2020.533
49. Kooistra, EB, Reinders Folmer, CP, Kuiper, ME, Olthuis, EH, Brownlee, MA, Fine, A, et al. Mitigating Covid-19 in a nationally representative UK sample: Personal abilities and obligation to obey the law shape compliance with mitigation measures. Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3598221 (Accessed May 11, 2020).
50. Murphy, K, Williamson, H, Sargeant, E, and McCarthy, M. Why people comply with Covid-19 social distancing restrictions: self-interest or duty? Aust N Z J Criminol. (2020) 53:477–96. doi: 10.1177/0004865820954484
51. Zohar, T, Negev, M, Sirkin, M, and Levine, H. Trust in Covid-19 policy among public health professionals in Israel during the first wave of the pandemic: a cross-sectional study. Isr J Health Policy Res. (2022) 11:20. doi: 10.1186/s13584-022-00529-6
52. Goodfellow, LM . Professional socialization of students enrolled in an online doctor of philosophy program in nursing. J Nurs Educ. (2014) 53:595–9. doi: 10.3928/01484834-20140922-06
53. Festinger, L . A theory of cognitive dissonance. Stanford, CA: Stanford University Press (1962).
54. Shahbari, NAE, Gesser-Edelsburg, A, Davidovitch, N, Brammli-Greenberg, S, Grifat, R, and Mesch, GS. Factors associated with seasonal influenza and Hpv vaccination uptake among different ethnic groups in Arab and Jewish Society in Israel. Int J Equity Health. (2021) 20:201. doi: 10.1186/s12939-021-01523-1
55. Pearce, L, and Cooper, J. Fostering Covid-19 safe behaviors using cognitive dissonance. Basic Appl Soc Psychol. (2021) 43:267–82. doi: 10.1080/01973533.2021.1953497
56. Harmon-Jones, E, and Harmon-Jones, C. Cognitive dissonance theory after 50 years of development. Z Sozialpsychol. (2007) 38:7–16. doi: 10.1024/0044-3514.38.1.7
57. Harmon-Jones, E, and Mills, J. An introduction to cognitive dissonance theory and an overview of current perspectives on the theory. Cognitive dissonance: Reexamining a pivotal theory in psychology, 2nd Ed. Washington, DC, US: American Psychological Association (2019). p. 3–24.
58. MacDonald, NE, Comeau, J, Dubé, È, Graham, J, Greenwood, M, Harmon, S, et al. Royal Society of Canada Covid-19 report: enhancing Covid-19 vaccine acceptance in Canada. Facets. (2021) 6:1184–246. doi: 10.1139/facets-2021-0037
59. Metin, I, and Camgoz, SM. The advances in the history of cognitive dissonance theory. Int J Humanit Soc Sci. (2011) 1:131–6. Available at: https://www.ijhssnet.com/view.php?u=http://www.ijhssnet.com/journals/Vol._1_No._6;_June_2011/14.pdf
60. Bem, DJ . Self-perception: an alternative interpretation of cognitive dissonance phenomena. Psychol Rev. (1967) 74:183–200. doi: 10.1037/h0024835
61. Bem, DJ . Self-perception theory In: L Berkowitz , editor. Advances in experimental social psychology, vol. 6. New York and London: Academic Press (1972). 1–62.
62. Tedeschi, JT, Schlenker, BR, and Bonoma, TV. Cognitive dissonance: private ratiocination or public spectacle? Am Psychol. (1971) 26:685–95. doi: 10.1037/h0032110
63. Festinger, L, and Carlsmith, JM. Cognitive consequences of forced compliance. J Abnorm Soc Psychol. (1959) 58:203–10. doi: 10.1037/h0041593
64. Heine, S. J., and Lehman, D. R. Culture, dissonance, and self-affirmation. Pers. Soc. Psychol. Bull. (1997) 23:389–400. doi: 10.1177/0146167297234005
65. Aronson, E . The return of the repressed: dissonance theory makes a comeback. Psychol Inq. (1992) 3:303–11. doi: 10.1207/s15327965pli0304_1
66. Aronson, E. The theory of cognitive dissonance: the evolution and vicissitudes of an idea. The message of social psychology: perspectives on mind in society. Malden: Blackwell Publishing (1997). p. 20–35.
67. Cooper, J, and Fazio, RH. A new look at dissonance theory In: L Berkowitz , editor. Advances in experimental social psychology, vol. 17. New York and London: Academic Press (1984). 229–66.
68. Harmon-Jones, E. Toward an understanding of the motivation underlying dissonance effects: is the production of aversive consequences necessary? Cognitive dissonance: Progress on a pivotal theory in social psychology. Science Conference Series. Washington, DC, US: American Psychological Association (1999). p. 71–99.
69. Heider, F . Attitudes and cognitive organization. J Psychol. (1946) 21:107–12. doi: 10.1080/00223980.1946.9917275
Keywords: vaccine hesitancy, healthcare workers, COVID-19 pandemic, health communication strategies, qualitative study, Israel, parents, public trust in the healthcare system
Citation: Hijazi R, Gesser-Edelsburg A and Mesch GS (2024) Vaccine communication strategies among healthcare workers as a reflection of the Israeli Ministry of Health’s communication strategies before and after the COVID-19 pandemic. Front. Public Health. 12:1377393. doi: 10.3389/fpubh.2024.1377393
Edited by:
Carlos Alberto De Oliveira Magalhães Júnior, State University of Maringá, BrazilReviewed by:
Willian Melo, State University of Paraná, BrazilPier Luigi Sacco, University of Studies G. d'Annunzio Chieti and Pescara, Italy
Copyright © 2024 Hijazi, Gesser-Edelsburg and Mesch. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Rana Hijazi, cmFuYWhpMzAxMEBnbWFpbC5jb20=