Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 04 May 2022
Sec. Psychology for Clinical Settings

Changes in Prosocial Behaviors Among Children With Behavioral Problems Following Incredible Years Parenting Program

  • 1Department of Psychiatry, Faculty of Medicine and Health Sciences, Universiti Putra Malaysia, Serdang, Malaysia
  • 2Department of Psychiatry, Hospital Pengajar Universiti Putra Malaysia (HPUPM), Serdang, Malaysia
  • 3Department of Community Health, Faculty of Medicine and Health Sciences, Universiti Putra Malaysia, Serdang, Malaysia

Parenting programs often train parents in improving their parenting practices and parent-child relationship to reduce behavioral problems in children. However, the children’s prosocial behaviors are less examined as an intervention outcome in these programs. This study aimed to evaluate the effectiveness of the Incredible Years parenting program (IYPP) for Malaysian parents of school-going children and its sustainability in improving the children’s prosocial behaviors. This randomized controlled study involved pre- and post-intervention assessments at 2 and 14 weeks. Mothers of children aged 6-12 years (n = 70) recruited through the pediatrics and the child and adolescent psychiatric clinics were randomly assigned to the parenting program or a waitlist control condition. The mothers rated their children’s prosocial behaviors using a self-administered questionnaire. The program ran two to three hours weekly for 14 weeks. Several modifications were made to the program to accommodate public health control during the pandemic. Children in the intervention group showed a notable but non-significant increase in prosocial skills. However, subsequent score decline at follow-up may suggest a lack of evidence that the program is potentially effective in improving prosocial behaviors among school children who are at risk of or already having behavioral problems.

Introduction

Social competence is a major childhood developmental task that needs to be accomplished as it promotes positive and supportive future interpersonal relationships (Ma, 2012). Children who are more socially competent are more likely to engage in prosocial behaviors, a set of social competence measures (Rydell et al., 1997; Ma, 2012). Prosocial behaviors are behaviors that are voluntarily and deliberately done to benefit others ‘for which the motive is unspecified, unknown, or not altruistic’, including helping people and sharing objects (pp. 6) (Eisenberg, 1982). The earliest definition and concept of prosocial behavior was introduced by Nancy Eisenberg, who differentiated prosocial behaviors and altruistic behaviors based on the underlying motives (pp. 3) (Eisenberg and Mussen, 1989). Eisenberg (1982) had argued that different moral reasoning, such as compensation, recognition, or simply caring about others, may justify prosocial acts (pp. 234). While the development of these behaviors is rooted in cognitive, social learning, and biological theories, cultural variations may play a role in the nurturance of these behaviors in children (Hammond et al., 2015). Therefore, nurturing prosocial behaviors in children is valuable for a child’s social competence (Ma, 2012) and their social well-being in adulthood (Biglan et al., 2012; Vergunst et al., 2019). Besides, prosocial behaviors are positively associated with academic outcomes (Carlo et al., 2018) and parenting practices (Pastorelli et al., 2016), and also transcend cultures. In an analysis performed in eight countries (Colombia, Italy, Jordan, Kenya, the Philippines, Sweden, Thailand, and the United States), Pastorelli et al. (2016) demonstrated that prosocial behaviors in late childhood enhance positive maternal parenting. On the other hand, prosocial behaviors are negatively associated with children’s internalizing and externalizing behavioral problems, high-risk sexual behaviors, and substance use (Padilla-Walker et al., 2015; Flouri and Sarmadi, 2016; Bagán et al., 2019; Memmott-Elison et al., 2020).

Positive parenting, which comprised of parental warmth and support (Llorca et al., 2017), parental involvement (Ogunboyede and Agokei, 2016), as well as supportive emotion socialization (Acar-Bayraktar et al., 2019), promotes prosociality in children (Llorca et al., 2017). In an experiment by Acar-Bayraktar et al. (2019), positive maternal reactions were found to be positively associated with prosocial behaviors in children. This finding is in agreement with the literature, which showed that parental practices of empathic responding (Eisenberg et al., 2010; Van der Graaff et al., 2018), providing sympathetic expression (Eisenberg et al., 2010), and modeling good behaviors (Schuhmacher et al., 2019), promote prosocial behaviors. Furthermore, Baez et al. (2017) and Van der Graaff et al. (2018) highlighted that moral emotions foster prosocial behaviors. According to Haidt (2003), moral emotions are ‘those emotions that are linked to the interests or welfare either of society as a whole or at least of persons other than the judge or agent’ (p. 853). Therefore, it was concluded that prosocial moral reasoning lead to prosocial actions (Carlo et al., 2010). Furthermore, girls have been found to be more prosocial than boys (Altay and Gure, 2012). According to Orte et al. (2015), positive parenting is predictive of prosocial behaviors in boys, while girls’ prosocial behaviors are influenced by the parent-children relationship. Another important parenting factor is parenting style (Malonda et al., 2019). Children of authoritative parents showed more prosocial behaviors compared to children whose parents were more demanding, less involved (Carlo et al., 2018), or permissive (Altay and Gure, 2012). This is in line with a recent study by Wong et al. (2021) that documented a positive association between authoritative parenting and prosocial behaviors. Also, it was argued that maternal parenting plays a larger role in encouraging prosocial behaviors than paternal parenting (Bagán et al., 2019).

Evidence showed that behavioral strategies are employed in the majority of interventions that promote prosocial skills (Laguna et al., 2020). Based on previous data, there was a significant negative correlation between behavioral problems and social competence (r = −0.42, p < 0.001) (Hukkelberg et al., 2019), which indicated that interventions aimed at behavioral problems are expected to increase social competence. Correspondingly, parenting programs have moved forward from eliminating disruptive behaviors to increasing prosocial skills in children (Shaffer et al., 2001). In these programs, parents are commonly trained to teach children to share and get along with peers (Kaminski et al., 2008). One such program is the Incredible Years parenting program (IYPP) (Webster-Stratton and Reid, 2011), a widely-researched and effective series of parent training programs that focuses on enhancing positive parent-child interactions. In early research that utilized this program, prosocial behaviors displayed immediate increment after program completion and six months afterward (Patterson et al., 2002). Consistent with that, a meta-analysis by Menting et al. (2013) supported its use to improve children’s prosocial behaviors (d = 0.23). Subsequent research on the efficacy of the IYPP among preschoolers showed that enhanced prosocial behaviors occurred in tandem with improved parenting (Seabra-Santos et al., 2016). Nevertheless, the impact of this program on prosocial behaviors is still rarely been evaluated (Mingebach et al., 2018). This current study aimed to evaluate the effectiveness of the IYPP to improve prosocial behaviors among Malaysian school-going children with behavioral problems. It was hypothesized that the program would increase the scores of prosocial behaviors of these children.

Materials and Methods

The study used an experimental randomized controlled between-group design. Pre- and post-intervention assessments were conducted, with post-intervention assessments at 2 and 14 weeks.

Participants

Children were referred by their treating pediatricians and psychiatrists from the pediatrics and child and adolescent psychiatric (CAP) clinics of Kajang, Kuala Lumpur, and Selayang Hospitals in Malaysia. Children aged 6-12 years old were eligible if they had clinical levels of behavioral problems, indicated by their mothers’ ratings on the Strengths and Difficulties Questionnaire (SDQ) total difficulty scores of ≥15, i.e., the 80th percentile (borderline and abnormal levels) (Gomez and Suhaimi, 2013). Other inclusion criteria include the mothers must have lived with the children for at least six months, agreed to participate, and were not attending other parenting programs during the study period. Children were excluded from the study if they had a formal diagnosis of autism spectrum, severe neurological, or developmental disorder.

Sample Size Calculation

The formula for continuous response variables in hypothesis testing for two means by Lemeshow et al. (1990) was used to calculate the sample size. To determine the effectiveness of the IYPP, the Type 1 error (α) was set to be 0.05, to give a statistical power of 80% in order to detect an effect size of 0.50 (medium) in the total behavioral problem, among participants of the IYPP compared to the control group, based on the findings by Morpeth et al. (2017). The minimum sample size required was a total of 34 parents; 17 for the intervention group and 17 for the control group. Nonetheless, based on their systematic review on behavioral parent training, Chacko et al. (2016) found a combined dropout rate of 51%. Therefore, in order to achieve a medium effect size, and allowing for a dropout rate of 50%, the total sample size will be [34 × 1/(1−0.50)] = 69.4, with 35 participants for each group.

Procedures

Ninety two mother child-dyads were referred by clinicians. After assessing for eligibility, there were 81 mother-child dyads in the sampling frame, of which simple random sampling was performed to select 70 mother-child dyads. After the baseline assessment, mother-child dyads were randomly allocated to the IYPP group (IY; n = 35) or the waitlist control group (WL; n = 35) (Figure 1). A research assistant who was not involved in data collection or intervention randomly assigned participants using an online random sequence generator on a 1:1 basis. Data were collected by research assistants who were blinded to the participant’s group assignment, and mothers were asked not to reveal whether or not they had attended a group. The data collection was done three times and scheduled on different days for the intervention and control groups. Participating mothers were also given non-overlapping follow-up dates with their children’s treating doctors to prevent treatment contamination.

FIGURE 1
www.frontiersin.org

Figure 1. The flow of study. Adapted from “CONSORT 2010 statement: Updated guidelines for reporting parallel group randomized trials”, by Schulz et al., 2010. CC BY 2.0.

Ethical Considerations

This study was authorized by the Medical Research and Ethics Committee of the Ministry of Health, Malaysia and the Ethics Committee for Research Involving Human Subject of Universiti Putra Malaysia (JKEUPM). Mothers who agreed to participate were given an information packet containing a cover letter describing the study and an informed consent form. Eligible parent-child dyads who gave their informed consents were enrolled and included into the participant list. As a small compensation for their participation in the research and completing the questionnaires at baseline, post-intervention, and follow-up, mothers received RM10 cash along with travelling cost reimbursement.

Measures

Sociodemographic Data

The sociodemographic details of participants contained the following information:

The sociodemographic factors included in the analysis were the parental factors: age, ethnicity, marital status, number of children, education level, income; child factors: age, gender, and ethnicity. presence of attention-deficit/hyperactivity disorder (ADHD), and prescription of stimulants.

Clinical Data

The clinical profile of participants contained the following information:

(i) Name referring hospital (where the child was being followed-up).

(ii) Presence of attention deficit/hyperactivity disorder (ADHD) diagnosis.

(iii) Prescription of stimulant.

Measures of Child Behavior

The Malay version of parent-rated 25-item Strengths and Difficulties Questionnaire (SDQ) (Goodman, 1997) was used to assess the emotional and behavioral symptoms in children and adolescents aged 4-17 years. Scores from four difficulties subscales (emotional problems, conduct problems, hyperactivity symptoms, and peer problems) were combined to generate total difficulties score between 0 and 40. The prosocial subscale (SDQ-PRO) was grouped separately, with a higher score indicated more prosocial behaviors. Children were then categorized into normal, borderline, or abnormal bands based on the sum of SDQ scores, but it was previously noted that the cut-off scores may vary by culture (Goodman, 1997). Accordingly, the present study used the Malaysian cut-off score for total difficulties: 0-14 = normal, 15-17 = borderline, and 18-40 = abnormal (Gomez and Suhaimi, 2013). The SDQ has high internal consistency, test-retest reliability, and strong criterion validity for predicting psychological disorders (Goodman, 1997). The Malay parent-rated SDQ used in this study show acceptable internal consistencies with Cronbach α values above 0.70 for all SDQ scales except for conduct and peer problems.

Intervention

Program Background

The IYPP equips parents with parenting skills by employing role-plays, video modeling, coaching, self-reflection, individual goal setting, assignments, and experiential learning (The Incredible Years®, 2013). The IYPP School Age Basic, which aimed at children aged 6-12 years old, was selected as the program version for the present study. The session topics in the Incredible Years® manual were delivered comprehensively to ensure fidelity and to achieve the intended program outcomes. Two additional sessions were added on top of the 12 intended sessions due to the higher risk of internalizing and externalizing disorders in the participating children and the requirement for intra-session translation (Webster-Stratton, 2009). For each session, 11-12 mothers attended and were divided into three separate parent groups. Each session lasted between two and three hours. Participants who missed a session would be contacted via phone and invited to participate in a make-up session any day before the next session. This make-up session was conducted in the same venue with the intervention program, and could be one-on-one or small group sessions, depending on attendance. In these sessions, shorter versions of the previous week’s group training were done, which lasted for 30-45 min. However, a make-up session was not considered as a session attended. The parent training sessions began in the final week of February and ended in the first week of September 2020. Due to the COVID-19 pandemic, the national lockdown was announced in mid-March 2020.

Fidelity Measures

The sessions for all three groups were facilitated by a parenting group leader and a co-facilitator. The group leader had completed a compulsory three-day accredited workshop and was in the process of being certified. Both of them had vast experience in child psychology/psychiatry and have been working with families. Sessions were videotaped for weekly self-review and regular peer supervision.

Adaptation to the Program

During the training, minimal adaptation was done by providing participants with culturally relevant examples related to the video and the role-plays. However, as the coronavirus pandemic led to the first national lockdown (Shanmugam et al., 2020) right after three parent training sessions, some changes to the program’s schedule and delivery were made. The subsequent training sessions resumed after three months of lockdown in the previous, face-to-face format. Additionally, the facilitators and participants were kept in contact through text messages via smartphones. A weekly text message served as reminders for mothers to continue practicing the parenting skills learned during the first three parent training sessions. Each weekly reminder came with photos of the notes taken during these sessions. As mentioned, another adaptation was the three make-up classes conducted through online conferencing for mothers who missed any of the sessions.

Statistical Analysis

Statistical analysis was performed using the Statistical Package for Social Sciences (SPPS) Software Version 25.0. The two-tailed statistical significance was set at p < 0.05 and expressed as a 95% confidence interval, and the power fixed at 80%. Missing values were replaced with the last-observation-carried-forward method. The sociodemographic and clinical factors included in the analysis were the parental factors: age, ethnicity, marital status, education level, number of children, total family income, motivation level, and parenting self-efficacy; child factors: age, birth order, gender, education setting, presence of attention-deficit/hyperactivity disorder (ADHD), and prescription of stimulant.

Baseline comparisons between the IY and WL groups were performed using the independent t-test or Mann-Whitney U tests for continuous outcome variables and the Chi-square test for categorical outcome variables. Fisher’s exact test was used if the expected value in each cell was less than five. To evaluate the effectiveness of the intervention, generalized estimating equations (GEE) analysis with the intention-to-treat approach was applied. The robust estimator was used for the covariance matrix and the working correlation matrix employed was unstructured. The outcomes of prosocial behaviors (SDQ-PRO) were regarded as the dependent variable. Cohen’s d effect sizes were calculated by dividing the overall mean difference between the groups (expressed as regression coefficient) with the overall standard deviation of the observed data. Effect sizes ≥ 0.8 were considered large, between 0.5 and 0.8 were considered moderate, and between 0.2 and 0.5 were considered small.

Results

Sample Characteristics at Baseline

Seventy mother-child dyads participated in the study, and 32 participants attended at least one of the 14 sessions (91.4%). The dropout rate was 15.6% (n = 5). The sociodemographic characteristics of IY and WL groups are shown in Table 1. The baseline prosocial behavior scores (SDQ-PRO) between the IY and WL groups showed no significant mean difference [6.26 ± 2.49 vs. 6.57 ± 2.63, t(68) = −0.51, p < 0.609]. There was a significant difference in mother’s education level between the intervention and control groups (x2(1) = 4.64, p = 0.031). The equations should be inserted in editable format from the equation editor.

TABLE 1
www.frontiersin.org

Table 1. Baseline comparison of sociodemographic and clinical characteristics between IY and WL groups.

Program Attendance and Dropouts

Attendance of at least one session was calculated as the number of attended sessions. 91.4% of the 35 participants in the intervention group, attended at least one session, and eight (25.0%) of them never missed any session. Five participants (15.6%) were categorized as dropouts, meaning they did not return to the program after missing a session.

Program Effects on Prosocial Behaviors

Table 2 displays the GEE analysis on the effectiveness of the IYPP in improving the SDQ-PRO in children with emotional and/or behavioral problems (EBP) after controlling the sociodemographic and clinical characteristics and number of attended sessions. The IY group produced 0.20 and 0.63 SDQ-PRO points higher than the WL group at 2 weeks post-intervention and 3 months follow-up, respectively (B = 0.20, 95% CI: −0.67, 1.07, p = 0.652; B = 0.63, 95% CI: −0.38, 1.64, p = 0.0221). A one-point increase in baseline prosocial behaviors was associated with 0.68-point increase in SDQ-PRO (B = 0.68, 95% CI: 0.63, 0.74, p < 0.001). The changes in the SDQ-PRO for the IY and WL groups are shown in Figure 2.

TABLE 2
www.frontiersin.org

Table 2. Prosocial behavior scores (SDQ-PRO) at baseline, post-intervention, and follow-up between groups.

FIGURE 2
www.frontiersin.org

Figure 2. Changes in the prosocial behavior scores (SDQ-PRO) among children in the intervention (IY) and control (WL) group across time.

Discussion

This study aimed to determine the effectiveness of the Incredible Years parent training program in improving prosocial behaviors among Malaysian primary school children with clinically significant behavioral problems. This was performed by comparing the prosocial subscale scores between the intervention and waitlist control groups over some time. Overall, the results revealed a non-significant increase in the children’s prosocial behaviors. Nonetheless, this study contributes to the existing evidence on the program’s impact on children’s prosocial behaviors. Through the implementation of an evidence-based parenting program with high fidelity, the study demonstrates that an evidence-based, foreign parenting program with minimal adaptation could be promising even in countries with limited resources.

The primary result indicated that the prosocial behavior scores of the intervention group increased shortly after program completion and enhanced further three months later, long after the mothers were trained. These results support the meta-analytic finding that parenting programs that emphasize positive reinforcement techniques and natural/logical consequences are effective in improving children’s behaviors (Leijten et al., 2019). Although the outcome of this study did not reach statistical significance, this finding may reflect the importance of positive parenting within the intervention of choice. This is in line with the goals of the IYPP to promote parenting competence by increasing positive parenting and parent-child relationships (Webster-Stratton et al., 2016). Additionally, the underlying behavioral approach highlights the importance of appreciating children’s prosocial behaviors through positive reinforcement measures, such as praising and giving rewards.

The lack of significant increment in parent-rated prosocial behavior scores at post-intervention in this current study is contrary to that of Seabra-Santos et al. (2016), who found that IYPP significantly improved child behaviors, measured through rating and direct observation. This inconsistency may be due to using only the parental self-report method without complementation of observation measurement in the present study. This could prove disadvantageous as the parent-report measure is a less objective assessment of a child’s behavior, and it does not provide a more holistic picture of the study outcome as compared to outcome observations. Despite its high cost (Hawes and Dadds, 2006), direct behavioral observation provides an objective examination of the relationship between a child’s prosocial behaviors and the parenting they received. On the other hand, child-rated prosocial behaviors might be more relevant when children are cognitively advanced enough to report on their own behavior (Pastorelli et al., 2016).

Apart from that, parental reports could be biased due to various parental factors. In particular, there was a high level of parental burnout among Malaysian parents (Manja et al., 2020) and depression, anxiety, and stress among adults (Perveen et al., 2020) in the wake of the pandemic. The lockdown was slightly relaxed between the second and third data collection but was retightened when the number of positive COVID-19 cases rose. During this period, the schooling system went from in-person learning to online and back to in-person again. It has been reported that home-based schooling brought a great deal of stress to parents, and the pre-existing behavioral problems in children exacerbated parenting stress (Meltzer et al., 2011). Moreover, there was also a spill-over effect from parents’ lockdown-induced stress or anxiety to children’s emotional and behavioral problems during the lockdown (Spinelli et al., 2020; Dubois-Comtois et al., 2021). This proves that children are equally vulnerable and easily influenced by the mental state of their parents (Imran et al., 2020). Also, young children tend to throw tantrums and project more emotional or behavioral problems during the pandemic (Singh et al., 2020). As a result of this parent and child emotional turmoil, children’s prosocial behaviors may be less than ideal and parents may not be able to give an objective assessment of their children during this period.

Looking at the prosocial behavior scores in the control group, the children exhibited higher scores at post-intervention than baseline, but the scores declined lower three months later. The initial climb could be explained by the fact that the mothers in the waitlist control group were still able to continue their children’s follow-up with their pediatricians or psychiatrists. Consequently, the children would still receive a form of therapy, which could contribute to the enhancement of prosocial behaviors above the baseline. Furthermore, the possibility of compensatory rivalry among the wait-listed mothers should not be underestimated. The mothers may seek for any parenting input to supplement their parenting practices and indirectly improved their children’s behavior. The decline of prosocial scores at 14 weeks post-intervention could be attributed to the lack of parent training on behavioral approaches, leading to the decrease in good behaviors.

In general, literature had strongly suggested the effectiveness of the IYPP in improving children’s behaviors with small to large effect sizes (Javier et al., 2016; Seabra-Santos et al., 2016; Morpeth et al., 2017; Murray et al., 2017; Weeland et al., 2017; Leckey et al., 2018; Leijten et al., 2018a; Gardner et al., 2019; Karjalainen et al., 2019; van Aar et al., 2019). Except for Weeland et al. (2017), who studied the program’s effect on 4-8 year-olds, most of the recent IYPP studies focused on preschool children of a much younger age. One of the few published IYPP studies on school-aged children was conducted by Javier et al. (2016) on Asian children living in the United States. The researchers found a medium effect size in improving the total behavioral problems of children aged 6-12 years old at post-intervention. Another study that included both preschool and school-aged children indicated a significant and large effect in the reduction of the intensity and hyperactivity symptoms of the behavioral problem (ds = 1.51 and 0.81, respectively) (Högström et al., 2017).

In most studies, the child behavioral outcomes were measured in the form of total difficulties or using the internalizing/externalizing behavioral dimensions. Total difficulties are generated by summing scores from all the scales except the prosocial. The internalizing dimensions consist of emotional and peer problem subscales while externalizing dimensions include conduct problem and hyperactivity subscales in the SDQ (Goodman et al., 2010). Similarly, published studies often documented evidence on the positive effects of IYPP on disruptive behaviors (van Aar et al., 2019), such as to conduct problems and hyperactivity that were measured with the Child Behavior Checklist (CBCL) (Javier et al., 2016), Eyberg Child Behavior Inventory (ECBI) (Högström et al., 2017; Weeland et al., 2017), and SDQ (Seabra-Santos et al., 2016; Morpeth et al., 2017). However, only a minority of studies showed that children with higher levels of emotional problems benefited more from IYPP (Leijten et al., 2018a), while others reported no effect (Gardner et al., 2017; Morpeth et al., 2017; Leijten et al., 2018b). This suggests that prosocial behaviors are not commonly measured as a parent training outcome.

The predominant effect of the IYPP on externalizing behavior rather than internalizing shows that the two behavioral dimensions are most likely different concepts. Similar to prosocial skills, internalizing behaviors are related to social processing, problem-solving, and coping strategies (Caputi and Schoenborn, 2018), which are distinct from the behavioral and coercion models underpinning many behavior-based parenting interventions. Like most established parenting programs, the IYPP emphasizes the importance of coercive parenting in interactions with children, enabling it to have a longer effect on externalizing behavior (van Aar et al., 2017). The program’s schedule was designed with the first five sessions focusing on providing positive attention, social skills, and emotion and giving persistent coaching and encouragement. These are the parts where mothers were trained to promote prosocial behaviors in their children. The subsequent sessions were heavily centered on strategies to reduce disruptive/externalizing behaviors, including Clear Limit Setting, Ignoring Misbehavior, Time Out to Calm Down-Discipline Strategies for Excessive Child Disobedience & Hitting or Destructive Behaviors, and Natural & Logical Consequences. This sequence of topics helps them to memorize and be more inclined to use disciplinary strategies rather than the strategies aiming to improve parent-child interaction, the child’s social skills, and emotional regulations. Hence, the strategies to deal with the disruptive behaviors of children would be practiced more.

Limitations of Study

Due to the small sample size in the present study, the statistical power to detect the difference between the intervention and control groups may have been limited, resulting in false-negative or type II errors. Therefore, future studies must utilize a larger sample to obtain more reliable results with greater precision and power. Another important limitation is the issue of internal validity, as the program had to be temporarily halted for three months after the third session because of the national lockdown. As a result, the internal validity of the study could have been attenuated by the maturation effect. Therefore, various control measures were taken, such as mothers were reminded about the principles and techniques they have learned through text messaging, and the training materials from the first three sessions were revisited when the sessions resumed. In addition, despite the presumed usual contact with the children’s treating doctors for the control group, it was realized that additional details on this ‘usual contact’ should have been obtained. During the usual clinic follow-ups, doctors may have inadvertently imparted parenting advice and become the source of treatment contamination. Parents could similarly be exposed to several psychoeducational approaches concerning parenting during the pandemic through mass and social media. Finally, the sole use of parental self-report measures could cause bias. Direct behavioral observation is a better aid in the systematic analysis of the relationship between the child’s behaviors and the family environment. Nonetheless, despite being the gold standard for the assessment of parenting practices (Zahidi et al., 2019), observational methods are seldom applied due to their high cost (Hawes and Dadds, 2006).

Implications and Recommendations

This study presents a preliminary indication of the potential effectiveness of the IYPP in promoting prosocial behaviors among school children who are at high risk of or already have behavioral problems. In the clinical setting, it would be beneficial to identify children who would benefit the most from the program. Moreover, an analysis of the program’s effect on each SDQ subscale may reveal whether the program would improve a child’s disruptive behaviors, emotions, peer problems, or prosocial behaviors. Lastly, Malaysian clinicians and policymakers should work together to make the provision of professional training and organizational support for staff possible, so that the IYPP may also benefit families in the community settings.

Conclusion

The Incredible Years School Age Basic parenting program demonstrated a non-significant increase in the prosocial behavior scores among Malaysian primary school-going children with borderline and abnormal levels of behavioral problems. Subsequent score decline at follow-up suggests a lack of evidence that the program is potentially effective in improving prosocial behaviors.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics Statement

The studies involving human participants were reviewed and approved by Medical Research and Ethics Committee of the Ministry of Health, Malaysia and the Ethics Committee for Research Involving Human Subject of Universiti Putra Malaysia (JKEUPM). Written informed consent to participate in this study was provided by the participants.

Author Contributions

RM, NI, and HA contributed to the research design and implementation. RM and PYL were involved in data analysis and interpretation. RM and NI participated in the preparation of the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work was funded by Universiti Putra Malaysia (GP/IPM/2018/9670700).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

Immense gratitude to the families that kindly participated in this study and the research assistants for their support.

References

Acar-Bayraktar, A. V., Cakmak, Z., and Saritas-Atalar, D. (2019). Parenting and children’s prosocial and problem behaviors in middle childhood: the role of Turkish mothers’ emotion socialization practices. Soc. Dev. 28, 333–346. doi: 10.1111/sode.12344

CrossRef Full Text | Google Scholar

Altay, F. B., and Gure, A. (2012). Relationship among the parenting styles and the social competence and prosocial behaviors of the children who are attending to state and private preschools. Educ. Sci.: Theory Pract. 12, 2712–2718.

Google Scholar

Baez, S., García, A. M., and Santamaría-garcía, H. (2017). “Moral cognition and moral emotions,” in Neuroscience and Social Science, eds A. Ibáñez, L. Sedeño, and A. García (New York, NY: Springer), 169–197.

Google Scholar

Bagán, G., Tur-Porcar, A. M., and Llorca, A. (2019). Learning and parenting in Spanish environments: prosocial behavior, aggression, and self-concept. Sustainability 11:5193 doi: 10.3390/su11195193

CrossRef Full Text | Google Scholar

Biglan, A., Flay, B. R., Embry, D. D., and Sandler, I. N. (2012). The critical role of nurturing environments for promoting human wellbeing. Am. Psychol. 67, 257–271. doi: 10.1037/a0026796

PubMed Abstract | CrossRef Full Text | Google Scholar

Caputi, M., and Schoenborn, H. (2018). Theory of mind and internalizing symptoms during middle childhood and early adolescence: the mediating role of coping strategies. Cogent Psychol. 5:1487270. doi: 10.1080/23311908.2018.1487270

CrossRef Full Text | Google Scholar

Carlo, G., Vicenta, M., Samper, P., Tur, A., and Armenta, B. E. (2010). Feelings or cognitions?? moral cognitions and emotions as longitudinal predictors of prosocial and aggressive behaviors. Pers. Individ. Dif. 48, 872–877. doi: 10.1016/j.paid.2010.02.010

CrossRef Full Text | Google Scholar

Carlo, G., White, R. M. B., Streit, C., Knight, G. P., and Zeiders, K. H. (2018). Longitudinal relations among parenting styles, prosocial behaviors, and academic outcomes in U.S. Mexican adolescents. Child Dev. 89, 577–592. doi: 10.1111/cdev.12761

PubMed Abstract | CrossRef Full Text | Google Scholar

Chacko, A., Jensen, S. A., Lowry, L. S., Cornwell, M., Chimklis, A., Chan, E., et al. (2016). Engagement in behavioral parent training: review of the literature and implications for practice. Clin. Child Fam. Psychol. Rev. 19, 204–215. doi: 10.1007/s10567-016-0205-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Dubois-Comtois, K., Suffren, S., St-Laurent, D., Milot, T., and Lemelin, J.-P. (2021). Child Psychological functioning during the COVID-19 lockdown. J. Dev. Behav. Pediatr. 42, 532–539. doi: 10.1097/dbp.0000000000000935

PubMed Abstract | CrossRef Full Text | Google Scholar

Eisenberg, N. (1982). “The development of reasoning regarding prosocial behavior,” in The Development of Prosocial Behavior, ed. N. Eisenberg (New York, NY: Academic Press, Inc), 219–249.

Google Scholar

Eisenberg, N., Eggum, N. D., and Di Giunta, L. (2010). Empathy-Related responding: associations with prosocial behavior, aggression, and intergroup relations. Soc. Issues Policy Rev. 4, 143–180. doi: 10.1111/j.1751-2409.2010.01020.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Eisenberg, N., and Mussen, P. H. (1989). The Roots of Prosocial Behavior in Children. Cambridge: Cambridge University Press.

Google Scholar

Flouri, E., and Sarmadi, Z. (2016). Prosocial behavior and childhood trajectories of internalizing and externalizing problems: the role of neighborhood and school contexts. Dev. Psychol. 52, 253–258. doi: 10.1037/dev0000076

PubMed Abstract | CrossRef Full Text | Google Scholar

Gardner, F., Leijten, P., Harris, V., Mann, J., Hutchings, J., Beecham, J., et al. (2019). Equity effects of parenting interventions for child conduct problems: a pan-European individual participant data meta-analysis. Lancet Psychiatry 6, 518–527. doi: 10.1016/S2215-0366(19)30162-2

CrossRef Full Text | Google Scholar

Gardner, F., Leijten, P., Mann, J., Landau, S., Harris, V., Beecham, J., et al. (2017). Could scale-up of parenting programmes improve child disruptive behaviour and reduce social inequalities? using individual participant data meta-analysis to establish for whom programmes are effective and cost-effective. Pub. Health Res. 5, 1–144. doi: 10.3310/phr05100

PubMed Abstract | CrossRef Full Text | Google Scholar

Gomez, R., and Suhaimi, A. F. (2013). Incidence rates of emotional and behavioural problems in Malaysian children as measured by parent ratings of the strengths and difficulties questionnaire. Asian J. Psychiatr. 6, 528–531. doi: 10.1016/j.ajp.2013.06.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Goodman, A., Lamping, D. L., and Ploubidis, G. B. (2010). When to use broader internalising and externalising subscales instead of the hypothesised five subscales on the strengths and difficulties questionnaire (SDQ): data from British parents, teachers and children. J. Abnorm. Child Psychol. 38, 1179–1191. doi: 10.1007/s10802-010-9434-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Goodman, R. (1997). The strengths and difficulties questionnaire: a research note. J. Child Psychol. Psychiatry 38, 581–586. doi: 10.1111/cge.12538

PubMed Abstract | CrossRef Full Text | Google Scholar

Haidt, J. (2003). “The moral emotions,” in Handbook of Affective Sciences, Vol. 11, eds R. J. Davidson, K. R. Scherer, and H. H. Goldsmith (Oxford: Oxford University Press), 852–870.

Google Scholar

Hammond, S. I., Waugh, W., Satlof-Bedrick, E., and Brownell, C. A. (2015). “Prosocial behavior during childhood and cultural variations,” in International Encyclopedia of the Social and Behavioral Sciences (Amsterdam: Elsevier), 19, 228–232. doi: 10.1016/B978-0-08-097086-8.23182-6

CrossRef Full Text | Google Scholar

Hawes, D. J., and Dadds, M. R. (2006). Assessing parenting practices through parent-report and direct observation during parent-training. J. Child Fam. Stud. 15, 555–568. doi: 10.1007/s10826-006-9029-x

CrossRef Full Text | Google Scholar

Högström, J., Olofsson, V., Özdemir, M., Enebrink, P., and Stattin, H. (2017). Two-year findings from a national effectiveness trial: effectiveness of behavioral and non-behavioral parenting programs. J. Abnorm. Child Psychol. 45, 527–542. doi: 10.1007/s10802-016-0178-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Hukkelberg, S., Keles, S., Ogden, T., and Hammerstrøm, K. (2019). The relation between behavioral problems and social competence?: a correlational meta-analysis. BMC Psychiatry 19:354. doi: 10.1186/s12888-019-2343-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Imran, N., Zeshan, M., and Pervaiz, Z. (2020). Mental health considerations for children & adolescents in covid-19 pandemic. Pak. J. Med. Sci. 36, S67–S72. doi: 10.12669/pjms.36.COVID19-S4.2759

PubMed Abstract | CrossRef Full Text | Google Scholar

Javier, J. R., Coffey, D. M., Schrager, S. M., Palinkas, L. A., and Miranda, J. (2016). Parenting intervention for prevention of behavioral problems in elementary school-age filipino-American children: a pilot study in churches. J. Dev. Behav. Pediatr. 37, 737–745. doi: 10.1097/DBP.0000000000000342

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaminski, J. W., Valle, L. A., Filene, J. H., and Boyle, C. L. (2008). A meta-analytic review of components associated with parent training program effectiveness. J. Abnorm. Child Psychol. 36, 567–589 doi: 10.1007/s10802-007-9201-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Karjalainen, P., Kiviruusu, O., Aronen, E. T., and Santalahti, P. (2019). Group-based parenting program to improve parenting and children’s behavioral problems in families using special services: a randomized controlled trial in a real-life setting. Child Youth Serv. Rev. 96, 420–429. doi: 10.1016/j.childyouth.2018.12.004

CrossRef Full Text | Google Scholar

Laguna, M., Mazur, Z., Kêdra, M., and Ostrowski, K. (2020). Interventions stimulating prosocial helping behavior: a systematic review. J. Appl. Soc. Psychol. 50, 676–696. doi: 10.1111/jasp.12704

CrossRef Full Text | Google Scholar

Leckey, Y., Mcgilloway, S., Hickey, G., Bracken-scally, M., Kelly, P., Furlong, M., et al. (2018). A randomised control trial of parent and child training programmes (versus wait list control) for children with ADHD-type behaviours?: a pilot study. Child Care Pract. 25, 419–438. doi: 10.1080/13575279.2018.1481368

CrossRef Full Text | Google Scholar

Leijten, P., Gardner, F., Landau, S., Harris, V., Mann, J., Hutchings, J., et al. (2018a). Research review: harnessing the power of individual participant data in a meta-analysis of the benefits and harms of the incredible years parenting program. J. Child Psychol. Psychiatry 59, 99–109. doi: 10.1111/jcpp.12781

PubMed Abstract | CrossRef Full Text | Google Scholar

Leijten, P., Gardner, F., Melendez-Torres, G. J., van Aar, J., Hutchings, J., Schulz, S., et al. (2019). Meta-analyses: key parenting program components for disruptive child behavior. J. Am. Acad. Child Adolesc. Psychiatry 58, 180–190. doi: 10.1016/j.jaac.2018.07.900

PubMed Abstract | CrossRef Full Text | Google Scholar

Leijten, P., Raaijmakers, M., Wijngaards, L., Matthys, W., Menting, A., Hemink-van Putten, M., et al. (2018b). Understanding who benefits from parenting interventions for children’s conduct problems: an integrative data analysis. Prev. Sci. 19, 579–588. doi: 10.1007/s11121-018-0864-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Lemeshow, S., Hosmer, D. W., Klar, J., and Lwanga, S. K. (1990). Adequacy of Sample Size in Health Studies. New York, NY: World Health Organization. John Wiley and Sons, doi: 10.2307/253252

CrossRef Full Text | Google Scholar

Llorca, A., Richaud, M. C., and Malonda, E. (2017). Parenting styles, prosocial, and aggressive behavior: the role of emotions in offender and non-offender adolescents. Front. Psychol. 8:1246. doi: 10.3389/fpsyg.2017.01246

PubMed Abstract | CrossRef Full Text | Google Scholar

Ma, H. K. (2012). Social competence as a positive youth development construct: a conceptual review. Scientific World J. 2012:287472. doi: 10.1100/2012/287472

PubMed Abstract | CrossRef Full Text | Google Scholar

Malonda, E., Llorca, A., Mesurado, B., Samper, P., and Vicenta Mestre, M. (2019). Parents or peers? predictors of prosocial behavior and aggression: a longitudinal study. Front.Psychol. 10:2379. doi: 10.3389/fpsyg.2019.02379

PubMed Abstract | CrossRef Full Text | Google Scholar

Manja, S. A., Mohamad, I., Ismail, H., and Yusof, N. I. (2020). Working parents and emotionally parental burnout during Malaysia Movement Control Order (MCO). Eur. J. Mol. Clin. Med. 7, 4930–4953.

Google Scholar

Meltzer, H., Ford, T., Goodman, R., and Vostanis, P. (2011). The burden of caring for children with emotional or conduct disorders. Int. J. Family Med. 2011:801203. doi: 10.1155/2011/801203

PubMed Abstract | CrossRef Full Text | Google Scholar

Memmott-Elison, M. K., Holmgren, H. G., Padilla-Walker, L. M., and Hawkins, A. J. (2020). Associations between prosocial behavior, externalizing behaviors, and internalizing symptoms during adolescence: a meta-analysis. J. Adolesc. 80, 98–114. doi: 10.1016/j.adolescence.2020.01.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Menting, A. T., Orobio, De Castro, B., and Matthys, W. (2013). Effectiveness of the incredible years parent training to modify disruptive and prosocial child behavior: a meta-analytic review. Clin. Psychol. Rev. 33, 901–913. doi: 10.1016/j.cpr.2013.07.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Mingebach, T., Kamp-Becker, I., Christiansen, H., and Weber, L. (2018). Meta-meta-analysis on the effectiveness of parent-based interventions for the treatment of child externalizing behavior problems. PLoS One. 13:e0202855. doi: 10.1371/journal.pone.0202855

PubMed Abstract | CrossRef Full Text | Google Scholar

Morpeth, L., Blower, S., Tobin, K., Taylor, R. S., Bywater, T., Edwards, R. T., et al. (2017). The effectiveness of the incredible years pre-school parenting programme in the United Kingdom: a pragmatic randomised controlled trial. Child Care Pract. 23, 141–161. doi: 10.1080/13575279.2016.1264366

CrossRef Full Text | Google Scholar

Murray, D. W., Lawrence, J. R., and LaForett, D. R. (2017). The incredible years§programs for ADHD in young children: a critical review of the evidence. J. Emot. Behav. Disord. 26, 195–208. doi: 10.1177/1063426617717740

CrossRef Full Text | Google Scholar

Ogunboyede, M., and Agokei, R. (2016). Prosocial behaviour of in-school adolescents: the perceived influence of self-esteem, peer influence and parental involvement. J. Educ. Society Behav. Sci. 13, 1–9. doi: 10.9734/bjesbs/2016/19995

CrossRef Full Text | Google Scholar

Orte, C., Ballester, L., March, M. X., Oliver, J. L., Pascual, B., Gomila, M. A., et al. (2015). Development of prosocial behaviour in children after the improvement of family competences. J. Child Serv. 10, 161–172. doi: 10.1108/JCS-02-2014-0013

CrossRef Full Text | Google Scholar

Padilla-Walker, L. M., Carlo, G., and Nielson, M. G. (2015). Does helping keep teens protected?? longitudinal bidirectional relations between prosocial behavior and problem behavior. Child Dev. 86, 1759–1772. doi: 10.1111/cdev.12411

PubMed Abstract | CrossRef Full Text | Google Scholar

Pastorelli, C., Lansford, J. E., Luengo Kanacri, B. P., Malone, P. S., Di Giunta, L., Bacchini, D., et al. (2016). Positive parenting and children’s prosocial behavior in eight countries. J. Child Psychol. Psychiatry 57, 824–834. doi: 10.1111/jcpp.12477

PubMed Abstract | CrossRef Full Text | Google Scholar

Patterson, J., Barlow, J., Mockford, C., Klimes, I., Pyper, C., Stewart-Brown, S., et al. (2002). Improving mental health through parenting programmes: block randomised controlled trial. Arch. Dis. Child. 87, 472–477.

Google Scholar

Perveen, A., Motevalli, S., Hamzah, H., Ramlee, F., Olagoke, S. M., Othman, A., et al. (2020). The comparison of depression, anxiety, stress, and coping strategies among Malaysian male and female during COVID-19 movement control period. Int. J.Acad. Res. Bus. Soc. Sci. 10, 487–496. doi: 10.6007/ijarbss/v10-i7/7451

CrossRef Full Text | Google Scholar

Rydell, A.-M., Hagekull, B., and Bohlin, G. (1997). Measurement of two social competence aspects in middle childhood. Dev. Psychol. 33, 824–833. doi: 10.1037//0012-1649.33.5.824

CrossRef Full Text | Google Scholar

Schuhmacher, N., Köster, M., and Kärtner, J. (2019). Modeling prosocial behavior increases helping in 16-month-olds. Child Dev. 90, 1789–1801. doi: 10.1111/cdev.13054

PubMed Abstract | CrossRef Full Text | Google Scholar

Schulz, K. F., Altman, D. G., and Moher, D. (2010). CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. Trials. 11, 672–77. doi: 10.1016/j.ijsu.2011.09.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Seabra-Santos, M. J., Gaspar, M. F., Azevedo, A. F., Homem, T. C., Guerra, J., Martins, V., et al. (2016). Incredible years parent training: what changes, for whom, how, for how long? J. Appl. Dev. Psychol. 44, 93–104. doi: 10.1016/j.appdev.2016.04.004

CrossRef Full Text | Google Scholar

Shaffer, A., Kotchick, B. A., Dorsey, S., and Forehand, R. (2001). The past, present, and future of behavioral parent training: interventions for child and adolescent problem behavior. Behav. Anal. Today 2, 91–105. doi: 10.1037/h0099922

CrossRef Full Text | Google Scholar

Shanmugam, H., Juhari, J. A., Nair, P., Chow, S. K., and Ng, C. G. (2020). Impacts of COVID-19 pandemic on mental health in Malaysia: a single thread of hope. Malays. J. Psychiatry Ejournal 29, 78–84.

Google Scholar

Singh, S., Roy, D., Sinha, K., Parveen, S., Sharma, G., Joshi, G., et al. (2020). Impact of COVID-19 and lockdown on mental health of children and adolescents: a narrative review with recommendations. Psychiatry Res. 293:113429. doi: 10.1016/j.psychres.2020.113429

PubMed Abstract | CrossRef Full Text | Google Scholar

Spinelli, M., Lionetti, F., Pastore, M., and Fasolo, M. (2020). Parents’ stress and children’s psychological problems in families facing the COVID-19 outbreak in Italy. Front.Psychol. 11:1713. doi: 10.3389/fpsyg.2020.01713

PubMed Abstract | CrossRef Full Text | Google Scholar

The Incredible Years® (2013). School Age Basic Agendas and Checklists. Available online at: https://incredibleyears.com/resources/gl/parent-program/ (accessed 15 January, 2020).

Google Scholar

van Aar, J., Leijten, P., de Castro, B., and Overbeek, G. (2017). Sustained, fade-out or sleeper effects? a systematic review and meta-analysis of parenting interventions for disruptive child behavior. Clin. Psychol. Rev. 51, 153–163. doi: 10.1016/j.cpr.2016.11.006

PubMed Abstract | CrossRef Full Text | Google Scholar

van Aar, J., Leijten, P., de Castro, B., Weeland, J., Matthys, W., Chhangur, R., et al. (2019). Families who benefit and families who do not: integrating person- and variable-centered analyses of parenting intervention responses. J. Am. Acad. Child Adolesc. Psychiatry 58, 993–1003. doi: 10.1016/j.jaac.2019.02.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Van der Graaff, J., Carlo, G., Crocetti, E., Koot, H. M., and Branje, S. (2018). Prosocial behavior in adolescence: gender differences in development and links with empathy. J. Youth Adolesc. 47, 1086–1099. doi: 10.1007/s10964-017-0786-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Vergunst, F., Tremblay, R. E., Nagin, D., Algan, Y., Beasley, E., Park, J., et al. (2019). Association between childhood behaviors and adult employment earnings in Canada. JAMA Psychiatry 76, 1044–1051. doi: 10.1001/jamapsychiatry.2019.1326

PubMed Abstract | CrossRef Full Text | Google Scholar

Webster-Stratton, C. (2009). Affirming diversity: multi-cultural collaboration to deliver the incredible years parent programs. International Journal of Child Health and Human Development 2, 17–32.

Google Scholar

Webster-Stratton, C. H., Reid, M. J., and Beauchaine, T. (2016). “The Incredible Years§Series: a developmental approach,” in Family-Centered Prevention Programs for Children and Adolescents: Theory, Research, and Large-Scale Dissemination, eds M. J. VanRyzin, K. Kumpfer, G. Fosco, and M. T. Greenberg (New York, NY: Psychology Press), 42–67.

Google Scholar

Webster-Stratton, C. H., and Reid, M. J. (2011). “The incredible years program for children from infancy to pre-adolescence: prevention and treatment of behavior problems”, in Clinical Handbook of Assessing and Treating Conduct Problems in Youth, eds R. Murrihy, A. Kidman, and T. Ollendick (New York, NY: Springer Press), doi: 10.1007/978-1-4419-6297-3_5

CrossRef Full Text | Google Scholar

Weeland, J., Chhangur, R. R., van der Giessen, D., Matthys, W., de Castro, B. O., Overbeek, G., et al. (2017). Intervention effectiveness of the incredible years: new insights into sociodemographic and intervention-based moderators. Behav. Ther. 48, 1–18. doi: 10.1016/j.beth.2016.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Wong, T. K. Y., Konishi, C., and Kong, X. (2021). Parenting and prosocial behaviors: a meta-analysis. Soc. Dev. 30, 343–373. doi: 10.1111/sode.12481

CrossRef Full Text | Google Scholar

Zahidi, R., Rogers, J., Guastaferro, W., and Whitaker, D. (2019). Relationship between self- report and observed parenting among parents in treatment versus not in treatment populations. J. Ga. Public Health Assoc. 7:17. doi: 10.20429/jgpha.2019.070217

CrossRef Full Text | Google Scholar

Keywords: behavior problem, children, incredible years, intervention, Malaysia, parenting, parenting program, prosocial behavior

Citation: Masiran R, Ibrahim N, Awang H and Lim PY (2022) Changes in Prosocial Behaviors Among Children With Behavioral Problems Following Incredible Years Parenting Program. Front. Psychol. 13:847722. doi: 10.3389/fpsyg.2022.847722

Received: 03 January 2022; Accepted: 10 March 2022;
Published: 04 May 2022.

Edited by:

Pietro Spataro, Mercatorum University, Italy

Reviewed by:

Margiad Elen Williams, Bangor University, United Kingdom
Nuria Galende, University of the Basque Country, Spain

Copyright © 2022 Masiran, Ibrahim, Awang and Lim. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ruziana Masiran, cnV6aWFuYV9tQHVwbS5lZHUubXk=

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.