Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 30 May 2023
Sec. Educational Psychology
This article is part of the Research Topic Research on Teaching Strategies and Skills in Different Educational Stages View all 32 articles

Involvement, leadership and social practice to the development of postgraduate attributes: evidence from extracurricular education with Chinese characteristics

\r\nSen Li&#x;Sen Li1†Yusheng Hu&#x;Yusheng Hu2†Lingling Wang*Lingling Wang3*Enjun XiaEnjun Xia1
  • 1School of Management and Economics, Beijing Institute of Technology, Beijing, China
  • 2School of Information Management, Beijing Information Science and Technology University, Beijing, China
  • 3School of Economics and Management, China University of Petroleum, Qingdao, China

Limited by students’ time and energy, participation in extracurricular activities is not necessarily beneficial to the development of postgraduate attributes. Thus, it is necessary to explore the impact path of extracurricular activities and education outcomes on the development of postgraduate attributes. From a configuration perspective, this study identifies the asymmetric causal effects of engagement and extracurricular education on postgraduate attributes. First, this study proposes a theoretical framework for postgraduate attribute development in extracurricular education with Chinese characteristics based on the input-environment-output (IEO) theory. Second, 166 academic scholarship applications submitted by the whole third-grade postgraduates who are from a science and engineering school at a double first-class university in China are taken as the sample. Finally, utilizing data envelopment analysis (DEA) and fuzzy set qualitative comparative analysis (fsQCA), this study conducts the effect of the combination of causal conditions on the development of postgraduate attributes. Results are as follows: (1) the development efficiency of postgraduate attribute in extracurricular education with Chinese characteristics is practical but still insufficient; (2) four configurations consistently linked to high development efficiency of postgraduate attributes. Specifically, in context with outstanding academic research achievement and excellent moral character, participating in extracurricular education or not consistently linked to high development efficiency. In contrast, in a context characterized by academic achievement or moral award not outstanding enough, involvement in extracurricular activities or social practice is consistently linked to high development efficiency. In addition, no configuration links student leadership to high development efficiency, and non-scientific research ability is consistently linked to low development efficiency; (3) there is an asymmetric causal relationship between the high and low development efficiency paths, indicating that the conditions affecting the development of postgraduate attributes have multiple concurrencies. These findings provide a new practical path and perspective for promoting the development of postgraduate attributes through extracurricular education with Chinese characteristics.

1. Introduction

Student development is some kind of positive change that occurs in the student, such as intellectual and ethical growth, cognitive complexity, self-awareness, and social identity (Patton et al., 2016). Rodgers (1990) defined student development as the ways that a student grows, progresses, or increases his or her developmental capabilities as a result of enrollment in an institution of higher education. Higher education serves several fundamental roles in that it imparts knowledge, develops students’ professional skills, promotes other academic and professional outcomes, and shapes students’ attributes and qualities (Anderson et al., 2013). Archer and Davison (2008) found that personal attributes, such as communication skills, integrity, self-confidence, and personality, were among the top 10 qualities that employers thought important when recruiting graduates. These professional skills and personal attributes must be acquired through formal and informal experiences in different learning spaces (Jackson, 2008), with academic study and extracurricular activities (ECAs) representing other spaces within the student experience (Barnett, 2011).

Numerous studies have reported that extracurricular activity participation (ECAP) during adolescence is positively associated with academic performance (Bartko and Eccles, 2003; Roeser and Peck, 2003; Peck et al., 2008; Guilmette et al., 2019), psychological health (Viau and Poulin, 2015), persistence (Lufi and Tenenbaum, 1991; Allen et al., 2015), self-regulation (Hansen et al., 2003), and social interaction (Mahoney et al., 2005). Similarly, research on the value of ECAs in higher education has shown that ECAP benefits academic achievement (Terenzini et al., 1996; Shulruf, 2010; Van der Zanden et al., 2018) and that the quality of ECAP significantly predicts adaptation and transition to university (Harvey et al., 2006; Tieu and Pancer, 2009; Tieu et al., 2010). For example, data drawn from the U.S. National Survey of Student Engagement indicate that spending more time engaging in extracurricular activities increases students’ likelihood of acquiring valuable work skills and attributes such as improved critical thinking, leadership, and social skills (Kuh, 1995; Tieu et al., 2010; Thompson et al., 2013). In university settings, ECAP could also promote civic engagement, prosocial activities, and social integration (Fredricks and Eccles, 2006) as well as decreased internalization problems such as symptoms of depression and anxiety (Bartko and Eccles, 2003).

Extracurricular education with Chinese characteristics has become an essential supplement to classroom learning since 1983 (Zhu et al., 1983). Many Chinese scholars have demonstrated that extracurricular education with Chinese characteristics has unique functions and advantages with regard to cultivating students’ comprehensive quality (Song and Zeng, 2018; Chen et al., 2019; Xiao and Ren, 2021), and this field has gradually developed into a new front for the comprehensive implementation of quality-oriented education in China. For example, the Central Committee of the Communist Youth League and the Ministry of Education jointly proposed the university extracurricular activity record system in 2016 (CYD, 2018). This record system covers innovation and entrepreneurship, social practice, culture and art, sports activities, work history, skills and expertise, ideological growth (Chen et al., 2019). At the end of 2017, the Central Committee of the Communist Youth League started to pilot and promote this system on a larger scale (CYD, 2018). By May 2018, 507 universities and 291 junior colleges in China had implemented the university extracurricular activity record system, and 427 universities and 234 junior colleges had issued or were on the verge of releasing relevant documents (CYD, 2018). Generally, all colleges and universities in China have reached a preliminary consensus regarding the implementation of the university extracurricular activity record system (CYD, 2018).

It is worth noting that, although these domestic and foreign findings have highlighted the association between ECAP and educational outcomes, not all such studies have reported a positive association in this context (Lindsay and Paton-Saltzberg, 1994). Moreover, due to the limitations of research methods, more evidence supporting causal effects is needed (Shulruf, 2010). In addition, given the richness of extracurricular education with Chinese characteristics and the limited time and energy of students, increasing numbers of participants in extracurricular education entail a reduction in academic investment. The mention fact leads to the following reflections: “—Is extracurricular education better for students? —How can students achieve effective development through extracurricular education?” Student development is like a systematic project that is affected not only by input factors but also by output factors which, in turn, affect the further development of students (Zou and Tan, 2013). The impacts of various factors on student development are not independent, and the factors have different combination effects through linkage and matching (Zepke et al., 2011). Therefore, it is necessary to explore how extracurricular education affects the development of students from a configuration perspective.

Based on student development theory and graduate attribute theory, this study proposes a theoretical framework for postgraduate attribute development in extracurricular education with Chinese characteristics. Based on a combination of DEA and fsQCA, this study aims to identify the multiple concurrent causalities (Ragin, 2009a) that might improve/hinder postgraduate attribute development. The sample consists of 166 academic scholarship applications submitted by the whole third-grade postgraduates who are from a science and engineering school at a double first-class university in China. The primary contributions of this study can be summarized as follows: (1) based on the IEO model, this study develops a collaborative linkage framework of postgraduate attribute development in extracurricular education with Chinese characteristic; (2) using the DEA method, this study measures the efficiency of the development of postgraduate attributes and verifies the effectiveness of extracurricular education with Chinese characteristics; and (3) from the configurational perspective, this study proposes four practical ways of promoting postgraduate attribute development in extracurricular education with Chinese characteristics, which are refined into an output-driven model and an input-output linkage model.

2. Theoretical background

2.1. Student development theory

According to different perspectives, student development theories can be divided into psychosocial, cognitive-structural, typological, and person-environment schools (Patton et al., 2016). Psychosocial theories focus on analyzing the content of student development and emphasize the critical issues that students face in college. Representative theories include Erikson’s life cycle theory (Erikson, 1994) and Chickering’s seven-vector development theory (Chickering and Reisser, 1993). Cognitive-structural theories focus on describing the process of students’ epistemological and intellectual development that occurs during college (Kohlberg, 1969; Perry, 1999). Typological theories treat differences among students as relatively fixed characteristics reflected in the cognitive process. Kolb (2007) and Myers and Myers (2010) are representative authors. Person-environment theories regard student development as the result of the interaction between individuals and the environment, such as Astin’s (1970) IEO model and student involvement theory (Astin, 1984), Pascarella’s comprehensive causality model (Pascarella, 1985), and Tinto’s student departure theory (Tinto, 2012).

Astin’s IEO model is one of the most frequently used frameworks for understanding the effects of college on a range of outcomes of undergraduate education (Gayles et al., 2012), which has been used extensively in higher education settings for nearly four decades (Stein, 2007). The model includes three major components—inputs, environments, and outputs. Inputs refer to the personal traits, attitudes, and characteristics of students themselves, such as gender, race, high school grade point average, expectations, and involvement. Environments include the programs, strategies, interventions, peers’ influences, and policies introduced to the student while they are in college. Outcomes are the consequences and/or results that are derived through the influence of the input and environment variables, such as academic achievement, critical thinking disposition, and social-emotional adjustment (Van der Zanden et al., 2018).

2.2. Graduate attributes

Graduate attributes are the qualities, skills, and understandings that a university community agrees that its students should develop during their time at the institution (Bowden et al., 2000). These attributes include the disciplinary expertise or technical knowledge that has traditionally formed the core of most university courses, and the qualities that prepare graduates to become agents of social good in an unknown future (Bowden et al., 2000). Many studies have claimed that these attributes are core outcomes of higher education and have thus emphasized the importance of graduate attributes with regard to employability and social-civic responsibility. Barrie (2007) identified four distinct orientations: precursory, complementary, translation and enabling. In the most complex integrated conception, graduate attributes are understood to be interwoven aptitudes and abilities, such as academic inquiry and intellectual curiosity, the ability to accommodate diversity and alternative perspectives, the ability to create and defend ideas, and the ability to employ communication as a vehicle for learning (Barrie, 2007). While these outcomes might lie at the heart of formal academic and university curricula, the processes by which students develop these abilities may also extend far beyond the regular academic classroom. In other words, graduate attributes develop through student engagement during the learning experience that occurs due to the individual’s immersion in the university’s intellectual and social community, of which formal courses are only one part. Moreover, student-centered approaches to the development of graduate attributes are consistently associated with better graduate attribute outcomes. Therefore, universities’ efforts to develop effective student-centered strategies serve to guarantee the quality of university teaching (Prosser and Barrie, 2003).

2.3. Research framework

Drawing on the research conducted by Bowden et al. (2000), this study defines postgraduate attributes in terms of the qualities, skills, and understandings that a university community agrees that its students should develop during their time at the institution. It is worth noting that the postgraduate attributes referenced in this study are based on the most complex integrated conception summarized by Barrie (2007). These attributes include not only disciplinary expertise or technical knowledge, which lie at the core of the university curriculum, but also communication ability, social ability, student leadership, a sense of responsibility, and the ability to serve society. Consequently, this study follows Barrier’s emphasis on student participation in the broader university experience and the critical importance of designing student-centered teaching strategies.

Therefore, based on Astin’s IEO model, this study regards extracurricular education with Chinese Characteristics as a dimension of the university environment, and divides the effect of extracurricular education on postgraduate attribute development into three parts: the student involvement, student leadership role, and social practice of prosocial behavior in the extracurricular education as input factors; the extracurricular education with Chinese characteristics as environment, scientific research ability and moral character as output factors corresponding to academic education and moral education in China. Notably, postgraduate attribute development is a systematic project with the linkage effects among input factors, environment, and output factors (Zou and Tan, 2013). The research framework is drawn in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1. Research framework of postgraduate attribute development in extracurricular education with Chinese characteristic.

2.4. Research hypotheses

2.4.1. Student involvement and postgraduate attribute development

Student involvement is now considered to be an overarching meta-construct in which an ecosystem of students, educators, service staff, and institutions interact to create enriching tertiary experiences (Zepke, 2014; Kahu and Nelson, 2018). Bowden et al. (2021) defined student involvement as a student’s positive social, cognitive, emotional, and behavioral investments in the context of interacting with their tertiary institution and its focal agents, such as peers and employees. These four dimensions jointly motivate student striving, persistence, and retention within academic contexts (Kuh et al., 2008).

For example, involvement has strong links with the emotional dimension of engagement, as the more involved a student is, the higher that student’s propensity for the creation of intrinsic value, such as joy, elation, enjoyment, passion, pride (Kahu, 2013; Pansari and Kumar, 2017). Involvement can also motivate the social dimension of engagement, such as by enhancing feelings of connection, belonging, warmth, and relatedness between students and their peers, staff, and the institution community (O’Keeffe, 2013). In addition, positive involvement is central to academic achievement (De Carolis et al., 2020). Thus, we propose:

Hypothesis 1: Postgraduates who are more involved in extracurricular education with Chinese characteristics are more likely to get a higher development efficiency of the postgraduate attribute.

2.4.2. Social practice and postgraduate attribute development

Many scholars have called for more authentic forms of instruction based on Dewey’s notion of experiential learning (Dewey, 1986) and Bandura’s social learning theory (Bandura and Walters, 1977). The social practice represents a potentially powerful form of pedagogy because all types of social practice activities involve the incorporation of academic learning with practical service (Salam et al., 2019). Various scholars have noted that social practice offers a variety of benefits for students, such as a deep understanding of course contents (Dienhart et al., 2016), increased student practical experience (Meyer et al., 2016), acquiring specific career-oriented skills (Geller et al., 2016), enhancing social responsibility and civic leadership (Weiler et al., 2013). Therefore, we propose:

Hypothesis 2: Postgraduates who participate more in social practice are more likely to get a higher development efficiency of the postgraduate attribute.

2.4.3. Student leadership and postgraduate attribute development

Scholars have agreed that one of the core functions of universities is to prepare the leaders of tomorrow’s society (Astin and Astin, 2000). Developing leadership in students is increasingly becoming an explicit priority of higher education institutions (Skalicky et al., 2020). This is because universities face the challenge of graduate employability, which has prompted institutions to pay attention to the development of graduate attributes, including leadership (Osmani et al., 2015). Student leadership development within the higher education context comes in a variety of forms, including those that are specifically designed to develop leadership capabilities within a program (e.g., student union, leadership award programs), and those that provide leadership experience incidentally through student-facing activities (e.g., tutoring peers, campus tour guides) or community volunteer activities (Skalicky et al., 2020). All students who involve themselves in leadership education have the potential to increase their skills and knowledge (Zimmerman-Oster and Burkhardt, 1999; Komives et al., 2006; Wren, 2013). Therefore, we propose:

Hypothesis 3: Postgraduates who take on a student leadership role are more likely to get a higher development efficiency of the postgraduate attribute.

2.4.4. Scientific research ability and postgraduate attribute development

Scientific research ability is an essential indicator of the quality of graduate education (Zajda and Rust, 2016; Van der Zanden et al., 2019). From the social perspective, postgraduates’ scientific research ability directly affects national scientific and technological innovation and comprehensive competitiveness. Therefore, the British government identified the following as the primary goal of postgraduate education in 1974,which is meeting the future talent needs of the country, providing further training for qualified, appropriate, and keen students; and contributing to the advancement of knowledge (Clark and Clark, 1993).

The National Science Foundation of the United States implemented a strategic framework for postgraduate education investment from 2016 to 2020 (Huang et al., 2021). China’s Ministry of Education also implemented a postgraduate education innovation plan in 2003–2007 to improve postgraduate innovation ability. Cultivating scientific research ability is a continuous and uninterrupted process, which is not only related to curriculum system design, academic environment, tutor relationships, but also to extracurricular social practice, community culture, and psychological capital (Zhou and Wang, 2018). Therefore, we propose:

Hypothesis 4: Postgraduates with a higher scientific research ability are more likely to get a higher development efficiency of the postgraduate attribute.

2.4.5. Moral character and postgraduate attribute development

Moral education practice has become a student-centered practice, and incorporated into various fields, such as music, health, and business (Julia et al., 2020). Recently, moral character has developed into an essential and popular theme in various countries (Rissanen et al., 2018; Darnell et al., 2019). For example, increasing numbers of schools in the U.S. have incorporated character education into their programs (Narvaez and Lapsley, 2008). A comprehensive civics and moral education program was established in Singapore, which focuses on nurturing both moral and character development and active citizenship and aims to equip students with appropriate competencies and value systems (Koh, 2012). In China, moral education belongs to citizenship education (Zhao and Tan, 2007). Integrative character education is not a package of virtues designed to control student behavior, but rather a continuation of moral development through role building, interactions among students, families, and the community, as well as student active participation, discussion and reflection (Marshall et al., 2011). The research conducted by Marshall et al. (2011) shows that comprehensive character education can improve students’ prosocial and moral behaviors and their reading and test scores. Therefore, we propose:

Hypothesis 5: Postgraduate students with a higher moral character are more likely to get a higher development efficiency of the postgraduate attribute.

3. Methodology

3.1. Research method

Fuzzy set qualitative comparative analysis is a variant of qualitative comparative analysis that combines fuzzy sets with logical principles in the context of qualitative comparative analysis (Ragin, 2009b). Compared with other variance-based quantitative techniques, fsQCA aims to disentangle the relationship of these combinations of variables to a given outcome (Fiss, 2007) by expressing the relative contribution of a set of variables to a given outcome rather than individual contributions (Vis, 2012). The essential features of this approach are as follows: (1) fsQCA is based on Boolean algebra and its associated tools, such as truth tables, consistency, coverage scores, and set coincidences (Ragin, 2014). (2) fsQCA is a method of data analysis used for small and medium sample cases that combines the case orientation of qualitative methods and the variable orientation of quantitative methods, thereby combining case analysis and cross-case comparison. However, larger samples can also be investigated (Vis, 2012). (3) fsQCA is based on combinations of variables, including equilibria, that is, different paths leading to specific outcomes (Fernández-García et al., 2020). This approach is used to explore the generative logic across different conditional configurations and outcomes and to identify the synergistic effects of multiple conditional variables based on an acknowledgment of the complexity of causality (Du and Jia, 2017).

The development of postgraduate attributes is a systematic project in which input and output factors interact with each other, and the impacts of each factor are not independent. These impacts have different combined effects through linkage matching. Therefore, to explore the multiple driving mechanisms underlying the promotion of postgraduate attribute development in extracurricular education with Chinese characteristics, this study uses fsQCA to examine the multiple conjunctural causations between student input and output in the context of a university environment featuring extracurricular education.

3.2. Sample and data collection

Referring to the study by Guilmette et al. (2019), this study selected a science and engineering school at a double first-class university in China. Given that the output of postgraduates will increase gradually over time, this study took a random sample consists of academic scholarship applications which are submitted by the whole third-grade postgraduates voluntarily. Data collection was carried out in September 2022. Finally, 166 valid academic scholarship applications were obtained. Notably, the extensive coverage of graduate academic scholarships for as many as 90% of students guarantees the diversity of applicants and research value. The proportions of special prizes, first prizes, second prizes, and non-awarded applicants in the sample are 22.30, 21.69, 42.78, and 13.25%, respectively, thus ensuring maximum heterogeneity in the sample and avoiding excessive consistency within the sample.

3.3. Variable measurement

Conditional variables in this study include student involvement, social practice, student leadership, academic achievement, and moral development, all measured by objective indicators included in the scholarship applications, all of which are fuzzy values. The measurements of these variables are displayed in Table 1.

TABLE 1
www.frontiersin.org

Table 1. Variable list.

3.3.1. Student involvement (SI)

The behavioral dimension is the most frequently measured dimension within national barometers of the student experience (Kuh et al., 2008; Zepke, 2014). According to the research by Khademi Ashkzari et al. (2018), this study selects the number of participants in extracurricular activities (e.g., science and technology activities, competitions, cultural and sports activities, and other activities) as the measurement of student involvement in extracurricular education with Chinese characteristics.

3.3.2. Social practice (SP)

Referring to the research by Scales et al. (2006), this study selects the total score of volunteer service, summer social practice, and winter social practice in the scholarship applications as the measurement of students’ social practice in extracurricular education with Chinese characteristics.

3.3.3. Student leadership (SL)

According to the research by Skalicky et al. (2020), the work performance score of the student leadership role in the scholarship applications is selected as the measurement of student leadership.

3.3.4. Scientific research ability (SR)

According to the studies by Thursby (2000), Bonaccorsi et al. (2006), Abramo et al. (2008), this study selects the academic achievement score in the scholarship applications, that is, the scores of published papers and authorized patents, as the measurement of scientific research ability.

3.3.5. Moral character (MC)

A moral sense of honor is the praise and award people get after fulfilling their moral obligations. This study refers to the research of Kou (2011) and selects the honor and award scores in the scholarship applications as the measurement of students’ moral character.

The outcome variable of this study is Postgraduate Attribute Development (PAD). Referring to the research of Amara et al. (2020), total efficiency is calculated through the input-oriented CRS model of DEA, in which student involvement, social practice, and student leadership are input variables, and scientific research ability, moral development are output variables. The formula for calculating PAD is shown in formula (1):

P A D = t o t a l e f f i c i e n c y × ( S I + S P + S L + S R + M C ) (1)

4. Results

4.1. Efficiency assessment

This study developed an input-oriented CRS efficiency model featuring two outputs (scientific research ability and moral character) and three inputs (student involvement, social practice, and student leadership). DEAP-XP1 software was used to obtain the DEA efficiency scores for the development of postgraduate attributes in extracurricular education with Chinese characteristics.

As shown in Table 2, in extracurricular education with Chinese characteristics, the average efficiency score of the sample is 62.15%, and approximately half of the postgraduates exhibited strong DEA efficiency (development efficiency = 1). However, more than 40% of postgraduates did not achieve 50% efficiency, and nearly 45% of postgraduates did not achieve 75% efficiency. These findings show that extracurricular education with Chinese characteristics can be substantially improved with regard to its ability to promote development efficiency with regard to postgraduate attributes.

TABLE 2
www.frontiersin.org

Table 2. Development efficiency of postgraduates in extracurricular education with Chinese characteristics.

4.2. Variable calibration

The first step in fsQCA is a process known as calibration, in which context each case is assigned a degree of membership in each set (Ragin, 2009b). Three thresholds (full membership, a crossover point of maximum membership ambiguity, and full non-membership) are required to rescale interval variables into fuzzy sets. The research conducted by Ragin (2009b), Fiss (2011) indicated that theoretical and empirical knowledge should be taken into full consideration when selecting these three thresholds. The full membership point can be set at the 10th percentile, the 20th percentile, or the upper percentile; the crossover point can be set at the average or the median; and the full non-membership point can be set at the 80th percentile or the 90th percentile (Sun and Li, 2021).

In this study, considering the distribution characteristics of the case data (Table 3), we use sample-dependent anchors to define set membership (Gupta et al., 2020). Specifically, the three thresholds of student involvement, moral character, and postgraduate attributes development are set as follows: the 90th percentile is the anchor for full membership; the 10th percentile is the anchor for non-membership; and the median is the crossover point anchor. Similarly, the three thresholds of scientific research ability, social practice, and student leadership are set as follows: the 90th percentile is the anchor for full membership; the 10th percentile is the anchor for non-membership; and the mean is the crossover point anchor. The calibration values of the outcomes and conditions are shown in Table 4. This study uses these calibration values and fsQCA 3.1 software to calibrate the variable data.

TABLE 3
www.frontiersin.org

Table 3. Descriptive statistics and percentile analysis of the outcomes and conditions.

TABLE 4
www.frontiersin.org

Table 4. Calibration values of the outcomes and conditions.

4.3. Necessity analyses

Before conducting a sufficiency analysis, necessity analyses must be conducted to determine whether any condition is necessary for obtaining high or low PAD. A condition is necessary if it must be present for the outcome to occur (Ragin, 2009b). Consistency thresholds for necessity analyses are typically set above 0.90 (Ragin, 2009a,b; Schneider and Wagemann, 2012; Afonso et al., 2018; Grau and López, 2018), and a condition may be considered to be necessary if it has high consistency and coverage scores. The necessity analysis results concerning high PAD show that the consistency of each condition is lower than 0.9 (Table 5), indicating that no condition is necessary for the occurrence of high postgraduate attribute development. That is, the explanatory power of any single condition on high PAD is insufficient. Therefore, the effect of a combination of conditions on high PAD must be analyzed in further detail. Correspondingly, the necessity analysis for low PAD shows that the consistency of weak scientific research ability (∼SR) is higher than 0.9, thus suggesting that weak scientific research ability may be necessary to explain low postgraduate attribute development. However, the consistency of the other conditions are all lower than 0.9, thus indicating that further analysis of the causal condition combinations impacting low PAD is needed.

TABLE 5
www.frontiersin.org

Table 5. Necessary conditions for high and low development efficiency of postgraduate attributes.

4.4. Sufficiency analysis

According to fsQCA truth-table approach, this study constructs and analyzes a data matrix known as the truth table using fsQCA 3.1, which includes 32 rows (25 = 32; the number of explanatory conditions is five). Each row represents a logically possible combination of conditions. Using Boolean algebra, the truth table is reduced into a simplified expression of combinations linked to the outcome. To simplify the truth table, we follow the criteria suggested by Gupta et al. (2020): (1) a frequency threshold for the minimum number of cases that must belong to a combination for that combination to be considered by the analysis and (b) a consistency benchmark to identify combinations that are reliably linked to an outcome. Therefore, this study sets the case frequency threshold at the minimum critical value of one and chooses a raw consistency threshold of 0.75 (Rihoux and Ragin, 2008), which is supplemented by a 0.7 proportional reduction in consistency (PRI) threshold (Greckhamer et al., 2018). In addition, in the section on counterfactual analysis, this study does not presuppose the direction, and all factors are measured in terms of existence or absence. Namely, the development of postgraduate attributes is a system of interactions among input, environment, and output, which is challenging to judge in a uniform manner. This study uses the Quine-McCluskey method to obtain intermediate, parsimonious, and complex solutions (Mustafa et al., 2022). Furthermore, the intermediate solution is the main solution, which is supplemented by the parsimonious solution and used to identify the core and peripheral conditions (Fiss, 2011).

To understand the results more accurately, we follow the convention of using a configuration chart to report a combination of parsimonious and intermediate solutions, as shown in Table 6. Core conditions are contained in the intermediate and parsimonious solutions, while peripheral conditions are contained in the intermediate solution but not is the parsimonious solution (Pappas and Woodside, 2021). In Table 6, black circles represent the presence of a causal condition, whereas crossed circles indicate the absence of such a causal condition. Large circles represent core conditions, whereas small circles indicate peripheral conditions. Blank spaces indicate a state of “do not care.”

TABLE 6
www.frontiersin.org

Table 6. Sufficient conditions for the development efficiency of postgraduate attributes.

Table 6 shows that four configurations of student involvement, leadership, social practice, scientific research ability, and moral character, are consistently linked to high PAD. These configurations can be refined into the output-driven model (Configuration H1) and the input-output linkage model (Configurations H2, H3, and H4). The overall consistency and coverage are 0.936 (>0.80) and 0.517 (>0.10), respectively, which are higher than the thresholds suggested by Ragin (2009a,b), Woodside (2014), indicating that these four configurations have good explanatory power and are sufficient to ensure high development efficiency with regard to postgraduate attributes. The overall solution coverage is 0.517, which indicates that the four configurations can explain 51.7% of the empirical cases. Moreover, the raw coverage of the four configurations ranges between 0.141 and 0.280, which is higher than 0.10 and can thus be considered satisfactory (Eng and Woodside, 2012). Similarly, Table 6 shows four configurations linked to low PAD, the overall consistency and coverage values of which are 0.938 (>0.80) and 0.704 (>0.10), respectively. Moreover, the raw coverage of the four sufficient conditions ranges between 0.138 and 0.632, indicating that these conditions serve as a compelling explanation for low development efficiency with regard to postgraduate attributes.

4.5. Robustness test

To ensure the accuracy of the results, we conducted a stability test. First, the consistency threshold was increased from 0.75 to 0.80. Second, the PRI consistency was increased from 0.70 to 0.75. The results were all consistent with the configuration solutions shown in Table 6. Therefore, the configuration results obtained in this study are robust (Greckhamer et al., 2018; Yuan et al., 2022).

5. Discussion

5.1. Configuration path of high PAD

Configuration H1 (SR*MC*∼SP) shows that the configuration of scientific research ability, moral character, and a lack of social practice is linked to high development efficiency with regard to postgraduate attributes. The consistency is 0.989 (>0.800), and the raw coverage is 0.280, indicating that this path can explain approximately 28.0% of cases (Leppänen et al., 2019). The number of example cases representing this configuration is 19. Accordingly, compared with other conditions, strengthening scientific research ability and moral traits is particularly important with respect to improving the development efficiency of postgraduate attributes.

Configuration H1 is consistent with studies concerning policy and research on higher education effects, which have generally used scientific research ability as an essential indicator of student success, academic achievement, or the quality of graduate education (Zajda and Rust, 2016; Van der Zanden et al., 2019). This configuration is also consistent with the emphasis on scientific research achievements in international/national accreditation (De Boer et al., 2015). Furthermore, Configuration H1 validates the claim that postgraduate attributes are a multidisciplinary concept that includes various outcomes (Wegner, 2008; Universities UK, 2015). Higher education should not only focus on imparting knowledge (Mayhew et al., 2016) but should also include moral education and character formation. Moral character is both the starting point and a critical point for education (Wolf-Wendel and Ruel, 1999; Podger et al., 2010). Therefore, higher education should focus on cultivating students’ essential qualities and behavioral standards, shaping students’ moral responsibilities (Shaaban, 2005; Podger et al., 2010), and providing students with appropriate abilities and value systems (Nucci, 1997; Corrigan et al., 2007; Marshall et al., 2011). This approach is consistent with the central role of moral character in improving the development efficiency of postgraduate attributes emphasized in Configuration H1.

Configuration H2 (SR*SI*∼SL) shows that the configuration of scientific research ability, student involvement, and a lack of student leadership is linked to high development efficiency with regard to postgraduate attributes. The consistency is 0.983 (>0.800), and the raw coverage is 0.277, indicating that this path is able to explain approximately 27.7% of cases. With the exception of conducting scientific research, Configuration H2 highlights participation in extracurricular education such as scientific and technological activities, cultural and sports activities, and competitions. This path is consistent with some findings regarding the value of extracurricular activities. For example, extracurricular involvement helps enhance individual adaptive self-regulation (Larson and Verma, 1999; Hansen et al., 2003; Tieu and Pancer, 2009) and learning persistence (Allen et al., 2015), which are helpful for scientific research (Nonis et al., 2006). Participation in extracurricular activities can also induce positive feelings, such as a sense of connection with others, and allow the participant to obtain many valuable job skills or attributes, such as improved critical thinking, leadership, and social skills (Tieu et al., 2010). However, more participation in extracurricular education is not guaranteed to be beneficial for postgraduate attribute development due to the student’s limitations with regard to time and energy. Previous studies have revealed that extracurricular involvement hinders academic research (Lindsay and Paton-Saltzberg, 1994) and that this negative effect depends on individual characteristics and circumstances. Therefore, the task of achieving a good balance between academic research and extracurricular activities is challenging (Thompson et al., 2013).

Configuration H3 (SR*∼MC*SP*∼SL) shows that the configuration of scientific research ability, social practice, and a lack of student leadership are core conditions and that complementary non-moral character is linked to high development efficiency with regard to postgraduate attributes. The consistency is 1.000 (>0.800), and the raw coverage is 0.141, indicating that this path can explain approximately 14.1% of cases. Configuration H3 emphasizes the fact that while conducting scientific research, graduate students should actively participate in social practice activities associated with prosocial behaviors, such as volunteer service and community service, the cultivation of moral responsibility, and the improvement of their development efficiency and efficiency. Our findings are consistent with those of numerous studies that have identified service learning as an effective tool that can benefit students (Strage, 2000). For example, participation in community service and service learning effectively contribute to higher grades (Billig, 2004; Scales and Roehlkepartain, 2004) and academic advantages (Benson et al., 1999; Scales et al., 2006). Service learning also has a powerful impact on students’ moral, social-cognitive, and emotional development (Batchelder and Root, 1994; Ostrow, 1995; Eyler and Giles, 1996, Eyler and Giles, 1999; Kendrick, 1996; Rhoads, 1997). Participation in service learning develops students’ sense of responsibility, acceptance of diversity, and leadership skills in community work (Markus et al., 1993; Eyler and Giles, 1996; Shumer and Belbas, 1996; Brandell and Hinck, 1997; Myers-Lipton, 1998). This situation may be due to the fact that community service and service learning provide opportunities for students to experience meaningful engagement in various life settings (Hanson et al., 2003).

Configuration H4 (MC*SI*SP*∼SL) shows that the configuration of student involvement, social practice, moral character, and a lack of student leadership are core conditions that are linked to high development efficiency with regard to postgraduate attributes. The consistency is 0.905 (>0.800), and the raw coverage is 0.268, indicating that this path can explain approximately 26.8% of cases. Configuration H4 indicates that when the scientific research achievements are insufficiently outstanding, postgraduate attributes can be improved by increasing involvement in extracurricular activities and social practices associated with prosocial behaviors. For example, some students actively participate in extracurricular activities because they do not expect to make strong academic research achievements, even though extracurricular education is not a substitute for exemplary achievement. Nevertheless, extracurricular education encourages the acquisition of specific skills and personal development, which can boost employability (Thompson et al., 2013).

These four configurations of high PAD can be further refined into two models: the output-driven model (configuration H1) and the input-output linkage model (configurations H2, H3, and H4). Comparing configurations H2 and H3, we find that strong student involvement can substitute for strong social practice in the context of strong scientific research ability and a lack of leadership. Namely, there is a potential substitution relationship between configurations H2 and H3. Scientific research ability is a core condition in three out of four paths. Therefore, scientific research ability remains essential for improving the efficacy and development efficiency of postgraduate attributes.

5.2. Configuration path of low PAD

Configuration L1 (∼SR*∼SI*∼SP) shows that in cases featuring a lack of scientific research ability and no participation in extracurricular activities, the development efficiency of postgraduate attributes is not high. Configuration L1 exhibits a consistency of 0.958 and a raw coverage of 0.632, showing that this path can explain approximately 63.2% of cases. Configuration L2 (∼SR*∼SP*SL) shows that in cases of a lack of scientific research ability and no social practice, even if the student leadership role is fulfilled, the development efficiency of postgraduate attributes is not high. Configuration L2 exhibits a consistency of 0.965 and a raw coverage of 0.138, indicating that this path can explain approximately 13.8% of cases. A total of nine example cases represent this configuration. Configuration L3 (∼SR*∼SI*SL) shows that in cases of a lack of scientific research ability and no engagement in extracurricular activities, even if the student leadership role is fulfilled, the development efficiency of the postgraduate attribute is not high. Configuration L3 exhibits a consistency of 0.870 and a raw coverage of 0.142, indicating that this path can explain approximately 14.2% of cases. Configuration L4 (∼SR*∼MC*SL) shows that in cases of a lack of scientific research ability and no outstanding achievements in moral education, even if the student leadership role is fulfilled, the development efficiency of the postgraduate attribute is not high. Configuration L4 exhibits a consistency of 0.943 and a raw coverage of 0.158, showing that this path can explain approximately 15.8% of cases.

Comparing the coverages of the four configurations for low PAD discussed above, we find that configuration L1 exhibits the highest coverage, explaining 63.2% of cases. That is, more than half of cases emerge because path L1 inhibits the development efficiency of postgraduate attributes. Similarly, comparing configurations L2 and L3, we find that weak social practice and weak student involvement can be substituted for each other in a context featuring weak scientific research ability and strong student leadership. Namely, there is a potential substitution relationship between configurations H2 and H3. In addition, it is worth noting that the lack of scientific research ability is a core condition in all four paths leading to the low development efficiency of postgraduate attributes, which is consistent with Section 4.3 Necessity Analyses.

6. Conclusion

6.1. Findings

In this paper, a theoretical framework of input, environment, and output is established to evaluate the influence of extracurricular education with Chinese characteristics on postgraduate attributes via involvement, leadership, social practice, moral psychology character and research ability. To gauge the developmental efficiency of this education, we employ DEA- and fsQCA-based methods to examine various causal conditions that can enhance or obstruct postgraduate attribute development. The main findings of the study are summarized as follows: Firstly, extracurricular education with Chinese characteristics is somewhat effective in promoting postgraduate attribute development, but this efficacy is relatively modest (efficiency mean = 62.15%; 50.6% of sample attained strong DEA-efficiency), and requires improvement. Secondly, our results show that four configurations consistently result in high developmental efficiency of postgraduate attributes. Students participating in extracurricular education in an environment characterized by excellent research achievement and moral psychology attributes showed the highest developmental efficiency; while academic achievement or moral award that are insufficiently outstanding, active involvement in extracurricular activities or social practice with prosocial behavior, are also associated with high developmental efficiency. This highlights the fact that participating in extracurricular activities or social practice can provide students with valuable learning opportunities and benefit them in many ways, including developing leadership, responsibility, and social skills. Furthermore, strong student involvement and strong social practice can serve as substitutes for each other in a context featuring strong research ability and a lack of leadership, suggesting that students should be strategic in their investment of time and energy in academic research and extracurricular education. Lastly, our research reveals an asymmetric causal relationship between the high and low developmental efficiency paths, indicating that conditions affecting postgraduate attribute development exhibit multiple concurrencies (Douglas et al., 2020; Zhang and Long, 2022). All hypotheses are supported except Hypothesis 3.

6.2. Implications and limitations

The four configurations consistently linked to the high development efficiency of postgraduate attributes can be refined into the output-driven model (configuration H1) and the input-output linkage model (configurations H2, H3, and H4), thus indicating that postgraduate attribute development is output-oriented from the perspective of students. The input-output linkage model can explain 68.6% of cases, suggesting that graduate education should combine extracurricular education and academic research to promote the postgraduate attribute development. Classroom and laboratory learning should be linked with extracurricular activities and social practice. In addition, given the importance of scientific research ability and the substitutability between strong student involvement and strong social practice, education policy-makers should remind postgraduates to allocate time and energy efficiently.

However, there are several limitations to this study that must be acknowledged. Firstly, the sample size is limited, and the participants are drawn from a science and engineering school at a double first-class university in China. Thus, the generalizability of the conclusions is limited. Future research should explore data drawn from other countries or regions and compare our findings with those of other studies. Secondly, this study is based on students’ perspectives, and other factors such as the extra support and services provided by universities and schools may lead to different outcomes. Thus, future research should look at this issue from the perspective of schools or universities. Lastly, this study is based on cross-sectional research data collected from scholarship applications during postgraduates’ final year of education. However, postgraduate attribute development is a dynamic process, and longitudinal tracking should be adopted in future research.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Author contributions

SL conceptualization, methodology, and writing—original draft. YH: software, data collection, and analyzing. LW supervision and writing—review and editing. EX project administration and funding acquisition. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the National Natural Science Foundation of China, grant number 7217020877 and Beijing Institute of Technology, grant number 2021ZXJG013.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Abramo, G., D’Angelo, C., and Pugini, F. (2008). The measurement of Italian universities’ research productivity by a non parametric-bibliometric methodology. Scientometrics 76, 225–244. doi: 10.1007/s11192-007-1942-2

CrossRef Full Text | Google Scholar

Afonso, C., Silva, G. M., Gonçalves, H. M., and Duarte, M. (2018). The role of motivations and involvement in wine tourists’ intention to return: SEM and fsQCA findings. J. Bus. Res. 89, 313–321. doi: 10.1016/j.jbusres.2017.11.042

CrossRef Full Text | Google Scholar

Allen, M. S., Vella, S. A., and Laborde, S. (2015). Sport participation, screen time, and personality trait development during childhood. Br. J. Dev. Psychol. 33, 375–390. doi: 10.1111/bjdp.12102

PubMed Abstract | CrossRef Full Text | Google Scholar

Amara, N., Rhaiem, M., and Halilem, N. (2020). Assessing the research efficiency of Canadian scholars in the management field: evidence from the DEA and fsQCA. J. Bus. Res. 115, 296–306. doi: 10.1016/j.jbusres.2019.10.059

CrossRef Full Text | Google Scholar

Anderson, L., Ostrom, A. L., Corus, C., Fisk, R. P., Gallan, A. S., Giraldo, M., et al. (2013). Transformative service research: an agenda for the future. J. Bus. Res. 66, 1203–1210. doi: 10.1016/j.jbusres.2012.08.013

CrossRef Full Text | Google Scholar

Archer, W., and Davison, J. (2008). Graduate employability: What do employers think and want? London: Council for Industry and Higher Education (CIHE).

Google Scholar

Astin, A. W. (1970). The methodology of research on college impact, part one. Sociol. Educ. 43, 223–254. doi: 10.2307/2112065

CrossRef Full Text | Google Scholar

Astin, A. W. (1984). Student involvement: a developmental theory for higher education. J. Coll. Student Personnel 25, 297–308.

Google Scholar

Astin, A. W., and Astin, H. S. (2000). Leadership reconsidered: engaging higher education in social changein social change. Educational Resources Information Center (ERIC) [Preprint]. Available online at: https://files.eric.ed.gov/fulltext/ED444437.pdf (accessed May 9, 2023).

Google Scholar

Bandura, A., and Walters, R. H. (1977). Social Learning Theory. Englewood Cliffs, NJ: Englewood cliffs Prentice Hall.

Google Scholar

Barnett, R. (2011). “Lifewide education: a new and transformative concept for higher education,” in Learning for a Complex World: a Lifewide Concept of Learning, Education and Personal Development, ed. N. Jackson (Bloomington: Authorhouse).

Google Scholar

Barrie, S. C. (2007). A conceptual framework for the teaching and learning of generic graduate attributes. Stud. Higher Educ. 32, 439–458. doi: 10.1080/03075070701476100

CrossRef Full Text | Google Scholar

Bartko, W. T., and Eccles, J. S. (2003). Adolescent participation in structured and unstructured activities: a person-oriented analysis. J. Youth Adolesc. 32, 233–241. doi: 10.1023/A:1023056425648

CrossRef Full Text | Google Scholar

Batchelder, T. H., and Root, S. (1994). Effects of an undergraduate program to integrate academic learning and service: cognitive, prosocial cognitive, and identity outcomes. J. Adolesc. 17, 341–355. doi: 10.1006/jado.1994.1031

CrossRef Full Text | Google Scholar

Benson, P. L., Scales, P. C., Leffert, N., and Roehlkepartain, E. C. (1999). A Fragile Foundation: The State of Developmental Assets Among American Youth. Washington, DC: ERIC.

Google Scholar

Billig, S. H. (2004). “Heads, hearts, and hands: The research on K-12 service-learning,” in Growing to Greatness (Redwood city, CA: Stanford University Press), 12–25.

Google Scholar

Bonaccorsi, A., Daraio, C., and Simar, L. (2006). Advanced indicators of productivity of universitiesAn application of robust nonparametric methods to Italian data. Scientometrics 66, 389–410. doi: 10.1007/s11192-006-0028-x

CrossRef Full Text | Google Scholar

Bowden, J., Hart, G., King, B., Trigwell, K., and Watts, O. (2000). Generic capabilities of ATN university graduates: Final report to DETYA, Sydney, NSW: Teaching and Learning Committee, Australian Technology Network.

Google Scholar

Bowden, J. L.-H., Tickle, L., and Naumann, K. (2021). The four pillars of tertiary student engagement and success: a holistic measurement approach. Stud. High. Educ. 46, 1207–1224. doi: 10.1080/03075079.2019.1672647

CrossRef Full Text | Google Scholar

Brandell, M. E., and Hinck, S. (1997). Service learning: connecting citizenship with the classroom. NASSP Bull. 81, 49–56. doi: 10.1177/019263659708159109

CrossRef Full Text | Google Scholar

Chen, L., Tao, H., and Xie, M. (2019). On the role of the extracurricular activities in talents training: focusing on the linkage between classroom learning and extracurricular activities in universities. J. Beijing Normal Univers. 5, 13–23.

Google Scholar

Chickering, A. W., and Reisser, L. (1993). Education and Identity. The Jossey-Bass Higher and Adult Education Series. Washington, DC: ERIC.

Google Scholar

Clark, B. R., and Clark, B. R. (1993). The Research Foundations of Graduate Education: Germany, Britain, France, United States, Japan. Berkeley, CA: University of California Press. doi: 10.1525/9780520338715

CrossRef Full Text | Google Scholar

Corrigan, M. W., Chapman, P., Grove, D., Walls, R. T., and Vincent, P. F. (2007). The importance of multidimensional baseline measurements to assessment of integrated character education models. J. Character Educ. 5, 103.

Google Scholar

CYD (2018). Comrades in charge of the School Department of the Central Committee of the Communist Youth League answer reporters’ questions on the implementation of the “Second Class Transcript” system of the Communist Youth League in colleges and universities [Online]. China Youth Daily. Available Online at: https://baijiahao.baidu.com/s?id=1605101396432992024&wfr=spider&for=pc (accessed July 5, 2018).

Google Scholar

Darnell, C., Gulliford, L., Kristjánsson, K., and Paris, P. (2019). Phronesis and the knowledge-action gap in moral psychology and moral education: a new synthesis? Hum. Dev. 62, 101–129. doi: 10.1159/000496136

CrossRef Full Text | Google Scholar

De Boer, H., Jongbloed, B., Benneworth, P., Cremonini, L., Kolster, R., Kottmann, A., et al. (2015). Performance-Based Funding and Performance Agreements in Fourteen Higher Education Systems. Lausanne: Center for Higher Education Policy Studies.

Google Scholar

De Carolis, B., D’Errico, F., Paciello, M., and Palestra, G. (2020). “Cognitive emotions recognition in e-learning: exploring the role of age differences and personality traits,” in Proceedings of the Methodologies and Intelligent Systems for Technology Enhanced Learning, 9th International Conference, (Berlin: Springer). doi: 10.1007/978-3-030-23990-9_12

CrossRef Full Text | Google Scholar

Dewey, J. (1986). Experience and education. Educ. Forum 50, 241–252. doi: 10.1080/00131728609335764

CrossRef Full Text | Google Scholar

Dienhart, C., Maruyama, G., Snyder, M., Furco, A., McKay, M. S., Hirt, L., et al. (2016). The impacts of mandatory service on students in service-learning classes. J. Soc. Psychol. 156, 305–309. doi: 10.1080/00224545.2015.1111856

PubMed Abstract | CrossRef Full Text | Google Scholar

Douglas, E. J., Shepherd, D. A., and Prentice, C. (2020). Using fuzzy-set qualitative comparative analysis for a finer-grained understanding of entrepreneurship. J. Bus. Vent. 35:105970. doi: 10.1016/j.jbusvent.2019.105970

CrossRef Full Text | Google Scholar

Du, Y., and Jia, L. (2017). Configuration perspective and qualitative comparative analysis (QCA): a new way of management research. Manag. World 6, 155–167.

Google Scholar

Eng, S., and Woodside, A. G. (2012). Configural analysis of the drinking man: fuzzy-set qualitative comparative analyses. Addict. Behav. 37, 541–543. doi: 10.1016/j.addbeh.2011.11.034

PubMed Abstract | CrossRef Full Text | Google Scholar

Erikson, E. H. (1994). Identity and the Life Cycle. New York, NY: WW Norton & company.

Google Scholar

Eyler, J., and Giles, D. (1996). “The impact of service learning program characteristics on student outcomes,” in Proceedings of the National Society for Experiential Education Conference, (Snowbird, UT).

Google Scholar

Eyler, J., and Giles, D. E. Jr. (1999). Where’s the Learning in Service-Learning? Jossey-Bass Higher and Adult Education Series. Washington, DC: ERIC.

Google Scholar

Fernández-García, D., Giménez-Espert, M. D. C., Castellano-Rioja, E., and Prado-Gascó, V. (2020). What academic factors influence satisfaction with clinical practice in nursing students? regressions vs. fsQCA. Front. Psychol. 11:585826. doi: 10.3389/fpsyg.2020.585826

PubMed Abstract | CrossRef Full Text | Google Scholar

Fiss, P. C. (2007). A set-theoretic approach to organizational configurations. Acad. Manag. Rev. 32, 1180–1198. doi: 10.5465/amr.2007.26586092

CrossRef Full Text | Google Scholar

Fiss, P. C. (2011). Building better causal theories: a fuzzy set approach to typologies in organization research. Acad. Manag. J. 54, 393–420. doi: 10.5465/amj.2011.60263120

CrossRef Full Text | Google Scholar

Fredricks, J. A., and Eccles, J. S. (2006). Extracurricular involvement and adolescent adjustment: impact of duration, number of activities, and breadth of participation. Appl. Dev. Sci. 10, 132–146. doi: 10.1207/s1532480xads1003_3

CrossRef Full Text | Google Scholar

Gayles, J. G., Rockenbach, A. B., and Davis, H. A. (2012). Civic responsibility and the student athlete: validating a new conceptual model. J. High. Educ. 83, 535–557. doi: 10.1353/jhe.2012.0024

PubMed Abstract | CrossRef Full Text | Google Scholar

Geller, J. D., Zuckerman, N., and Seidel, A. (2016). Service-learning as a catalyst for community development: how do community partners benefit from service-learning? Educ. Urban Soc. 48, 151–175. doi: 10.1177/0013124513514773

CrossRef Full Text | Google Scholar

Grau, A. J. G., and López, F. R. (2018). Determinants of migratory flow in Europe: a fuzzy-set approach. J. Bus. Res. 89, 243–250. doi: 10.1016/j.jbusres.2018.01.051

CrossRef Full Text | Google Scholar

Greckhamer, T., Furnari, S., Fiss, P. C., and Aguilera, R. V. (2018). Studying configurations with qualitative comparative analysis: best practices in strategy and organization research. Strateg. Organ. 16, 482–495. doi: 10.1177/1476127018786487

CrossRef Full Text | Google Scholar

Guilmette, M., Mulvihill, K., Villemaire-Krajden, R., and Barker, E. T. (2019). Past and present participation in extracurricular activities is associated with adaptive self-regulation of goals, academic success, and emotional wellbeing among university students. Learn. Ind. Differ. 73, 8–15. doi: 10.1016/j.lindif.2019.04.006

CrossRef Full Text | Google Scholar

Gupta, K., Crilly, D., and Greckhamer, T. (2020). Stakeholder engagement strategies, national institutions, and firm performance: A configurational perspective. Strateg. Manag. J. 41, 1869–1900. doi: 10.1002/smj.3204

CrossRef Full Text | Google Scholar

Hansen, D. M., Larson, R. W., and Dworkin, J. B. (2003). What adolescents learn in organized youth activities: a survey of self-reported developmental experiences. J. Res. Adolesc. 13, 25–55. doi: 10.1111/1532-7795.1301006

CrossRef Full Text | Google Scholar

Hanson, T. L., Austin, G., and Lee-Bayha, J. (2003). Student Health Risks, Resilience, and Academic Performance. Los Alamitos, CA: WestEd.

Google Scholar

Harvey, L., Drew, S., and Smith, M. (2006). The First-Year Experience: a Review of Literature for the Higher Education Academy. London: Higher Education Academy.

Google Scholar

Huang, B., Huang, H., Qiao, W., and Hu, D. (2021). Graduate education development index of major countries in the world: connotation, framework and measurement. China High. Educ. Res. 11, 21–26.

Google Scholar

Jackson, N. (2008). “Tackling the wicked problem of creativity in higher education,” in Paper Presented at the Conference Briefing Paper, (Brisbane: ARC Centre for the Creative).

Google Scholar

Julia, J., Supriatna, E., Isrokatun, I., Aisyah, I., Nuryani, R., and Odebode, A. A. (2020). Moral education (2010-2019): a bibliometric study (part 1). Univ. J. Educ. Res. 8, 2554–2568. doi: 10.13189/ujer.2020.080639

CrossRef Full Text | Google Scholar

Kahu, E. R. (2013). Framing student engagement in higher education. Stud. High. Educ. 38, 758–773. doi: 10.1080/03075079.2011.598505

CrossRef Full Text | Google Scholar

Kahu, E. R., and Nelson, K. (2018). Student engagement in the educational interface: understanding the mechanisms of student success. High. Educ. Res. Dev. 37, 58–71. doi: 10.1080/07294360.2017.1344197

CrossRef Full Text | Google Scholar

Kendrick, J. R. Jr. (1996). Outcomes of service-learning in an introduction to sociology course. Michigan J. Commun. Serv. Learn. 3, 72–81.

Google Scholar

Khademi Ashkzari, M., Piryaei, S., and Kamelifar, L. (2018). Designing a causal model for fostering academic engagement and verification of its effect on educational performance. Int. J. Psychol. 12, 136–161. doi: 10.24200/ijpb.2018.58146

CrossRef Full Text | Google Scholar

Koh, C. (2012). Moral development and student motivation in moral education: a Singapore study. Aust. J. Educ. 56, 83–101. doi: 10.1177/000494411205600107

CrossRef Full Text | Google Scholar

Kohlberg, L. (1969). “Stage and sequence: the cognitive-developmental approach to socialization,” in Handbook of Socialization Theory and Research, eds J. C. Grusec, P. D. Hastings, and P. D. Hastings (New York, NY: Guilford Publications).

Google Scholar

Kolb, D. A. (2007). The Kolb Learning Style Inventory. Boston, MA: Hay Group, Hay Resources Direct.

Google Scholar

Komives, S. R., Longerbeam, S. D., Owen, J. E., Mainella, F. C., and Osteen, L. (2006). A leadership identity development model: applications from a grounded theory. J. Coll. Stud. Dev. 47, 401–418. doi: 10.1353/csd.2006.0048

PubMed Abstract | CrossRef Full Text | Google Scholar

Kou, D. (2011). The sense of moral honor and its cultivation. Stud. Ethics 3, 29–33.

Google Scholar

Kuh, G. D. (1995). The other curriculum: out-of-class experiences associated with student learning and personal development. J. High. Educ. 66, 123–155. doi: 10.1080/00221546.1995.11774770

CrossRef Full Text | Google Scholar

Kuh, G. D., Cruce, T. M., Shoup, R., Kinzie, J., and Gonyea, R. M. (2008). Unmasking the effects of student engagement on first-year college grades and persistence. J. High. Educ. 79, 540–563. doi: 10.1080/00221546.2008.11772116

CrossRef Full Text | Google Scholar

Larson, R. W., and Verma, S. (1999). How children and adolescents spend time across the world: work, play, and developmental opportunities. Psychol. Bull. 125:701. doi: 10.1037/0033-2909.125.6.701

PubMed Abstract | CrossRef Full Text | Google Scholar

Leppänen, P. T., McKenny, A. F., and Short, J. C. (2019). “Qualitative comparative analysis in entrepreneurship: Exploring the approach and noting opportunities for the future,” in Standing on the shoulders of giants, eds B. Boyd, T. R. Crook, J. K. Le, and A. D. Smith (Bingley: Emerald Publishing Limited), 155–177 doi: 10.1108/S1479-838720190000011010

CrossRef Full Text | Google Scholar

Lindsay, R. O., and Paton-Saltzberg, R. (1994). The effects of paid employment on the academic performance of full-time students in a British’new’university. Oxford: Oxford Brookes University.

Google Scholar

Lufi, D., and Tenenbaum, G. (1991). Persistence among young male gymnasts. Percept. Motor Skills 72, 479–482. doi: 10.2466/pms.1991.72.2.479

CrossRef Full Text | Google Scholar

Mahoney, J. L., Lord, H., and Carryl, E. (2005). An ecological analysis of after-school program participation and the development of academic performance and motivational attributes for disadvantaged children. Child Dev. 76, 811–825. doi: 10.1111/j.1467-8624.2005.00879.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Markus, G. B., Howard, J. P., and King, D. C. (1993). Integrating community service and classroom instruction enhances learning: results from an experiment. Educ. Eval. Policy Anal. 15, 410–419. doi: 10.2307/1164538

CrossRef Full Text | Google Scholar

Marshall, J. C., Caldwell, S. D., and Foster, J. (2011). Moral education the character plus Way®. J. Moral Edu. 40, 51–72. doi: 10.1080/03057240.2011.541770

CrossRef Full Text | Google Scholar

Mayhew, M. J., Rockenbach, A. N., Bowman, N. A., Seifert, T. A., and Wolniak, G. C. (2016). How College Affects Students: 21st Century Evidence that Higher Education Works. New York, NY: John Wiley & Sons.

Google Scholar

Meyer, C. L., Harned, M., Schaad, A., Sunder, K., Palmer, J., and Tinch, C. (2016). Inmate education as a service learning opportunity for students: preparation, benefits, and lessons learned. Teach. Psychol. 43, 120–125. doi: 10.1177/0098628316636278

CrossRef Full Text | Google Scholar

Mustafa, S., Sohail, M. T., Alroobaea, R., Rubaiee, S., Anas, A., Othman, A. M., et al. (2022). Éclaircissement to understand consumers’ decision-making psyche and gender effects, a fuzzy set qualitative comparative analysis. Front. Psychol. 13:920594. doi: 10.3389/fpsyg.2022.920594

PubMed Abstract | CrossRef Full Text | Google Scholar

Myers, I. B., and Myers, P. B. (2010). Gifts Differing: Understanding Personality Type. Boston, MA: Nicholas Brealey.

Google Scholar

Myers-Lipton, S. J. (1998). Effect of a comprehensive service-learning program on college students’ civic resopnsibility. Teach. Sociol. 26, 243–258. doi: 10.2307/1318766

CrossRef Full Text | Google Scholar

Narvaez, D., and Lapsley, D. K. (2008). Teaching moral character: two alternatives for teacher education. Teacher Educator 43, 156–172. doi: 10.1080/08878730701838983

CrossRef Full Text | Google Scholar

Nonis, S. A., Philhours, M. J., and Hudson, G. I. (2006). Where does the time go? a diary approach to business and marketing students’ time use. J. Mark. Educ. 28, 121–134. doi: 10.1177/0273475306288400

CrossRef Full Text | Google Scholar

Nucci, L. (1997). Moral development and character formation. Psychol. Educ. Pract. 82, 127–157.

Google Scholar

O’Keeffe, P. (2013). A sense of belonging: improving student retention. Coll. Stud. J. 47, 605–613.

Google Scholar

Osmani, M., Weerakkody, V., Hindi, N. M., Al-Esmail, R., Eldabi, T., Kapoor, K., et al. (2015). Identifying the trends and impact of graduate attributes on employability: a literature review. Tertiary Educ. Manag. 21, 367–379. doi: 10.1080/13583883.2015.1114139

CrossRef Full Text | Google Scholar

Ostrow, J. M. (1995). Self-consciousness and social position: on college students changing their minds about the homeless. Qualit. Sociol. 18, 357–375. doi: 10.1007/BF02393347

CrossRef Full Text | Google Scholar

Pansari, A., and Kumar, V. (2017). Customer engagement: the construct, antecedents, and consequences. J. Acad. Mark. Sci. 45, 294–311. doi: 10.1007/s11747-016-0485-6

CrossRef Full Text | Google Scholar

Pappas, I. O., and Woodside, A. G. (2021). Fuzzy-set qualitative comparative analysis (fsQCA): guidelines for research practice in information systems and marketing. Int. J. Information Manag. 58:102310. doi: 10.1016/j.ijinfomgt.2021.102310

CrossRef Full Text | Google Scholar

Pascarella, E. T. (1985). “College environmental influences on learning and cognitive development: a critical review and synthesis,” in Higher Education: Handbook of Theory and Research, eds M. B. Paulsen and L. W. Perna (Berlin: Springer).

Google Scholar

Patton, L. D., Renn, K. A., Guido, F. M., and Quaye, S. J. (2016). Student Development in College: Theory, Research, and Practice. Hoboken, NJ: John Wiley & Sons.

Google Scholar

Peck, S. C., Roeser, R. W., Zarrett, N., and Eccles, J. S. (2008). Exploring the roles of extracurricular activity quantity and quality in the educational resilience of vulnerable adolescents: variable-and pattern-centered approaches. J. Soc. Issues 64, 135–156. doi: 10.1111/j.1540-4560.2008.00552.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Perry, W. G. Jr. (1999). Forms of Intellectual and Ethical Development in the College Years: a Scheme. Jossey-Bass Higher and Adult Education Series. Washington, DC: ERIC.

Google Scholar

Podger, D. M., Mustakova-Possardt, E., and Reid, A. (2010). A whole-person approach to educating for sustainability. Int. J. Sustainabil. High. Educ. 11, 339–352. doi: 10.1108/14676371011077568

CrossRef Full Text | Google Scholar

Prosser, M., and Barrie, S. C. (2003). “Using a student-focused learning perspective to align academic development with institutional quality assurance,” in Towards strategic staff development in higher education, eds R. Blackwell and P. Blackmore (Milton Keynes: Open University Press), 191–221.

Google Scholar

Ragin, C. C. (2009a). “Qualitative comparative analysis using fuzzy sets (fsQCA),” in Configurational Comparative Analysis, ed. B. Rihoux and C. Ragin. Thousand Oaks, CA: Sage Publications doi: 10.4135/9781452226569.n5

CrossRef Full Text | Google Scholar

Ragin, C. C. (2009b). Redesigning Social Inquiry: Fuzzy Sets and Beyond. Chicago: University of Chicago Press. doi: 10.7208/chicago/9780226702797.001.0001

CrossRef Full Text | Google Scholar

Ragin, C. C. (2014). The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. Berkerly, CA: University of California Press. doi: 10.1525/9780520957350

CrossRef Full Text | Google Scholar

Rhoads, R. A. (1997). Community Service and Higher Learning: Explorations of the Caring Self. Albany, NY: State University of New York Press.

Google Scholar

Rihoux, B., and Ragin, C. C. (2008). Configurational Comparative methods: Qualitative Comparative Analysis (QCA) and Related Techniques. Thousand Oaks, CA: Sage Publications. doi: 10.4135/9781452226569

CrossRef Full Text | Google Scholar

Rissanen, I., Kuusisto, E., Hanhimäki, E., and Tirri, K. (2018). The implications of teachers’ implicit theories for moral education: a case study from Finland. J. Moral Educ. 47, 63–77. doi: 10.1080/03057240.2017.1374244

CrossRef Full Text | Google Scholar

Rodgers, R. F. (1990). “Recent theories and research underlying student development,” in College Student Development: Theory Andpractice for the 1990s, ed. D. G. Creamer & Associates (Alexandria, VA: American College Personnel Association), 27–79.

Google Scholar

Roeser, R. W., and Peck, S. C. (2003). Patterns and pathways of educational achievement across adolescence: a holistic-developmental perspective. New Dir. Child Adolesc. Dev. 2003, 39–62. doi: 10.1002/cd.81

PubMed Abstract | CrossRef Full Text | Google Scholar

Salam, M., Awang Iskandar, D. N., Ibrahim, D. H. A., and Farooq, M. S. (2019). Service learning in higher education: a systematic literature review. Asia Pac. Educ. Rev. 20, 573–593. doi: 10.1007/s12564-019-09580-6

CrossRef Full Text | Google Scholar

Scales, P., and Roehlkepartain, E. (2004). “Service to others: A gateway asset for school success and healthy development,” in Growing to greatness (St. Paul, MN: National Youth Leadership Council), 26–32.

Google Scholar

Scales, P. C., Roehlkepartain, E. C., Neal, M., Kielsmeier, J. C., and Benson, P. L. (2006). Reducing academic achievement gaps: the role of community service and service-learning. J. Exp. Educ. 29, 38–60. doi: 10.1177/105382590602900105

CrossRef Full Text | Google Scholar

Schneider, C. Q., and Wagemann, C. (2012). Set-Theoretic Methods for the Social Sciences: a Guide to Qualitative Comparative Analysis. Cambridge: Cambridge University Press. doi: 10.1017/CBO9781139004244

CrossRef Full Text | Google Scholar

Shaaban, K. (2005). A proposed framework for incorporating moral education into the ESL/EFL classroom. Lang. Cult. Curriculum 18, 201–217. doi: 10.1080/07908310508668742

CrossRef Full Text | Google Scholar

Shulruf, B. (2010). Do extra-curricular activities in schools improve educational outcomes? a critical review and meta-analysis of the literature. Int. Rev. Educ. 56, 591–612. doi: 10.1007/s11159-010-9180-x

CrossRef Full Text | Google Scholar

Shumer, R., and Belbas, B. (1996). What we know about service learning. Educ. Urban Soc. 28, 208–223. doi: 10.1177/0013124596028002006

CrossRef Full Text | Google Scholar

Skalicky, J., Warr Pedersen, K., van der Meer, J., Fuglsang, S., Dawson, P., and Stewart, S. (2020). A framework for developing and supporting student leadership in higher education. Stud. Higher Educ. 45, 100–116. doi: 10.1080/03075079.2018.1522624

CrossRef Full Text | Google Scholar

Song, D., and Zeng, J. (2018). An empirical research on the relationship among the extracurricular courses, study satisfaction and college students’ core competitiveness. Univer. Educ. Sci. 5, 21–29.

Google Scholar

Stein, J. L. (2007). Peer educators and close friends as predictors of male college students’ willingness to prevent rape. J. Coll. Stud. Dev. 48, 75–89. doi: 10.1353/csd.2007.0008

PubMed Abstract | CrossRef Full Text | Google Scholar

Strage, A. (2000). Service-learning as a tool for enhancing student outcomes in a college-level lecture course. Michigan J. Commun. Serv. Learn. 2000, 5-13.

Google Scholar

Sun, L., and Li, S. (2021). Research on the impact path of artificial intelligence empowerment on innovation performance: based on fuzzy qualitative comparative analysis. Sci. Technol. Manag. Res. 41, 11–19.

Google Scholar

Terenzini, P. T., Pascarella, E. T., and Blimling, G. S. (1996). Students’ out-of-class experiences and their influence on learning and cognitive development: a literature review. J. Coll. Stud. Dev. 40, 610–623.

Google Scholar

Thompson, L. J., Clark, G., Walker, M., and Whyatt, J. D. (2013). ‘It’s just like an extra string to your bow’: exploring higher education students’ perceptions and experiences of extracurricular activity and employability. Active Learn. Higher Educ. 14, 135–147. doi: 10.1177/1469787413481129

CrossRef Full Text | Google Scholar

Thursby, J. G. (2000). What do we say about ourselves and what does it mean? Yet another look at economics department research. J. Econ. Literature 38, 383–404. doi: 10.1257/jel.38.2.383

CrossRef Full Text | Google Scholar

Tieu, T.-T., and Pancer, S. (2009). Cocurricular involvement and first-year students’ transition to university: quality vs. quantity of involvement. J. First Year Exp. Stud. Transition 21, 43–63.

Google Scholar

Tieu, T.-T., Pancer, S. M., Pratt, M. W., Wintre, M. G., Birnie-Lefcovitch, S., Polivy, J., et al. (2010). Helping out or hanging out: the features of involvement and how it relates to university adjustment. Higher Educ. 60, 343–355. doi: 10.1007/s10734-009-9303-0

CrossRef Full Text | Google Scholar

Tinto, V. (2012). Leaving College: Rethinking the Causes and Cures of Student Attrition. Chicago: University of Chicago press.

Google Scholar

Universities, U. (2015). “Student mental wellbeing in higher education: good practice guide,” in Proceedings of the Standing Conference of Principals, (London: Universities UK).

Google Scholar

Van der Zanden, P. J., Denessen, E., Cillessen, A. H., and Meijer, P. C. (2018). Domains and predictors of first-year student success: a systematic review. Educ. Res. Rev. 23, 57–77. doi: 10.1016/j.edurev.2018.01.001

CrossRef Full Text | Google Scholar

Van der Zanden, P. J., Denessen, E., Cillessen, A. H., and Meijer, P. C. (2019). Patterns of success: first-year student success in multiple domains. Stud. Higher Educ. 44, 2081–2095. doi: 10.1080/03075079.2018.1493097

CrossRef Full Text | Google Scholar

Viau, A., and Poulin, F. (2015). Youths’ organized activities and adjustment in emerging adulthood: a multidimensional conception of participation. J. Res. Adolesc. 25, 652–667. doi: 10.1111/jora.12159

CrossRef Full Text | Google Scholar

Vis, B. (2012). The comparative advantages of fsQCA and regression analysis for moderately large-N analyses. Sociol. Methods Res. 41, 168–198. doi: 10.1177/0049124112442142

CrossRef Full Text | Google Scholar

Wegner, G. R. (2008). Partnerships for Public Purposes: Engaging Higher Education in Societal Challenges of the 21st Century. National Center for Public Policy and Higher Education. Paris: UNESCO

Google Scholar

Weiler, L., Haddock, S., Zimmerman, T. S., Krafchick, J., Henry, K., and Rudisill, S. (2013). Benefits derived by college students from mentoring at-risk youth in a service-learning course. Am. J. Commun. Psychol. 52, 236–248. doi: 10.1007/s10464-013-9589-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Wolf-Wendel, L. E., and Ruel, M. (1999). Developing the whole student: the collegiate ideal. New Dir. Higher Educ. 1999, 35–46. doi: 10.1002/he.10503

CrossRef Full Text | Google Scholar

Woodside, A. G. (2014). Embrace perform model: complexity theory, contrarian case analysis, and multiple realities. J. Bus. Res. 67, 2495–2503. doi: 10.1016/j.jbusres.2014.07.006

CrossRef Full Text | Google Scholar

Wren, J. T. (2013). The Leader’s Companion: Insights on Leadership Through the Ages. New York, NY: Simon and Schuster.

Google Scholar

Xiao, Y., and Ren, Y. (2021). A study on the enhancement of college students’ entrepreneurial ability from the erspective of the second classroom. Party Build. Ideol. Educ. Schools 2, 61–63.

Google Scholar

Yuan, B., Xu, S., Chen, L., and Niu, M. (2022). How do psychological cognition and institutional environment affect the unsafe behavior of construction workers?—research on fsQCA method. Front. Psychol. 13:875348. doi: 10.3389/fpsyg.2022.875348

PubMed Abstract | CrossRef Full Text | Google Scholar

Zajda, J., and Rust, V. (2016). “Current research trends in globalisation and neo-liberalism in higher education,” in Globalisation and Higher Education Reforms, eds J. Zajda and V. Rust (Berlin: Springer). doi: 10.1007/978-3-319-28191-9

CrossRef Full Text | Google Scholar

Zepke, N. (2014). Student engagement research in higher education: questioning an academic orthodoxy. Teaching Higher Educ. 19, 697–708. doi: 10.1080/13562517.2014.901956

CrossRef Full Text | Google Scholar

Zepke, N., Leach, L., and Butler, P. (2011). Non-institutional influences and student perceptions of success. Studi. High. Educ. 36, 227–242. doi: 10.1080/03075070903545074

CrossRef Full Text | Google Scholar

Zhang, H., and Long, S. (2022). How business environment shapes urban tourism industry development? configuration effects based on NCA and fsQCA. Front. Psychol. 13:947794. doi: 10.3389/fpsyg.2022.947794

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhao, Z., and Tan, C. (2007). “Citizenship education in mainland China at a crossroads,” in Critical perspectives on values education in Asia, eds C. Tan and K. Chong (Singapore: Prentice Hall, Pearson Education South Asia), 124–137.

Google Scholar

Zhou, Z., and Wang, H. (2018). “Study on scientific research and innovation oriented cultivation model of postgraduate,” in Proceedings of the 2018 International Seminar on Education Research and Social Science (ISERSS 2018), (Amsterda: Atlantis Press), 252–255. doi: 10.2991/iserss-18.2018.65

PubMed Abstract | CrossRef Full Text | Google Scholar

Zhu, J., Cai, K., and Yao, Q. (1983). Management of Institutions of Higher Education. Wuhan: Huazhong University of Science & Technology Press.

Google Scholar

Zimmerman-Oster, K., and Burkhardt, J. (1999). Leadership in the Making: Impact and Insights from Leadership Development Programs in US Colleges and Universities. Battle Creek, MI: WK Kellogg Foundation.

Google Scholar

Zou, M., and Tan, D. (2013). A literature review o input-output evaluation of student learning. Educ. Measur. Eval. 3, 10–14.

Google Scholar

Keywords: postgraduate attribute, extracurricular education, student involvement, student leadership, social practice

Citation: Li S, Hu Y, Wang L and Xia E (2023) Involvement, leadership and social practice to the development of postgraduate attributes: evidence from extracurricular education with Chinese characteristics. Front. Psychol. 14:1161308. doi: 10.3389/fpsyg.2023.1161308

Received: 08 February 2023; Accepted: 31 March 2023;
Published: 30 May 2023.

Edited by:

Luisa Losada Puente, University of A Coruña, Spain

Reviewed by:

José Luis Gómez Ramos, University of Castilla-La Mancha, Spain
Keri L. Heitner, Saybrook University, United States

Copyright © 2023 Li, Hu, Wang and Xia. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Lingling Wang, bGluZ2xpbmd3YW5nQHVwYy5lZHUuY24=

These authors share first authorship

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.