Skip to main content

ORIGINAL RESEARCH article

Front. Educ., 01 February 2024
Sec. Digital Education

Factors affecting Thai EFL students’ behavioral intentions toward mobile-assisted language learning

Li PanLi Pan1Yan Ye
Yan Ye2*Xinyi LiXinyi Li2
  • 1Graduate School of Business and Advanced Technology Management, Assumption University, Bangkok, Thailand
  • 2Graduate School of Education, Stamford International University, Bangkok, Thailand

Introduction: Recently, researchers have begun to pay more attention to topics related to the adoption of mobile devices for supporting second or foreign language learning. Mobile-assisted language learning (MALL) is now prevalent among language learners and educators because of its convenient and enjoyable features. This study combined and extended the Technology Acceptance Model (TAM) and Expectation Confirmation Theory (ECT) to investigate the factors influencing English as a Foreign Language (EFL) students’ behavioral intentions to use MALL at two universities in Bangkok, Thailand.

Methods: Quantitative methods were utilized in this study and the researchers obtained a total of 507 valid responses by using three-step sampling. After using confirmatory factor analysis (CFA) to determine that the study had enough construct validity, structural equation modeling (SEM) was applied to test the research’s hypotheses.

Results: The findings revealed that all 15 hypotheses were supported, except that social influence cannot significantly influence behavioral intention.

Discussion and implication: By acquiring a deeper understanding of the factors that impact the behavioral intentions of language learners to utilize MALL, developers and providers can improve their capacity to design more enjoyable and effective applications that align with customer expectations and enhance financial gains. By understanding students’ behavioral intentions towards MALL, educators can efficiently raise awareness of its benefits and provide effective training, enabling students to utilize available resources and enhance their language learning experience.

1 Introduction

Over the past few decades, the education sector has witnessed a substantial transformation through the increasing integration of electronic devices into teaching and learning, owing to the relentless advancements in information technology (Alghamdi et al., 2022). The critical role of e-learning in educational settings has grown considerably, attracting interest from a great number of learners, educators, and researchers (Yeh and Chu, 2018; Mensah et al., 2022; Shams et al., 2022). E-learning refers to using various electronic devices in the learning process and is usually characterized by its high convenience, flexibility, interactivity, and self-pacing learning features (Arpaci et al., 2020; Zarei and Mohammadi, 2022). In light of the COVID-19 pandemic involving around 1.6 billion students worldwide, many schools have been compelled to discontinue classroom instruction and encourage remote learning through various electronic devices (Kim et al., 2022).

According to Criollo-C et al. (2021), mobile devices, including smartphones, smart tablets, and laptops, are widely utilized and have become indispensable in everyday life. Mobile learning is a type of e-learning that has experienced a significant increase in popularity among learners, particularly the younger generation (Qashou, 2021). The increased use of mobile learning could be attributed to its user-friendliness and gamification features, which contribute to a more interactive and enjoyable learning environment (Kao et al., 2023). Mobile devices allow learners to access a diverse range of learning materials via the Internet and facilitate the sharing and discussion of knowledge with others (Shadiev et al., 2018). Many countries, Thailand included, exhibit a firm disposition toward encouraging students to adopt mobile learning as a means to save on educational expenses and school years (Aroonsrimarakot et al., 2023). However, according to Buasuwan (2018), only 20% of Thai students would like to use online resources to acquire more knowledge outside of the classroom, and most of them still need to be taught how to use mobile learning effectively.

Undoubtedly, language occupies a pivotal position in all facets of contemporary society. As a form of communication that evolved naturally, language enables humans to express various complex ideas (Brighton et al., 2005). As a global language, English is now widely used for global communication and collaboration. According to Seidlhofer (2017), most non-native English speakers rely strictly on English to communicate with people from other countries. English is becoming increasingly prevalent in Thailand, a country with a thriving tourist economy, serving as the primary mode of communication between Thai people and their international counterparts (Watson Todd, 2006; Baker, 2011). According to Tantiwich and Sinwongsuwat (2021), although most Thai students have received English education from early childhood to university, their English language proficiency is still very low, with an average Common European Framework of Reference for Languages (CEFR) proficiency level of A2.

Mobile devices have emerged as indispensable instruments in the realm of education, particularly in the domain of language acquisition (Liu and Chen, 2015; Mahyoob, 2020). The concept of mobile-assisted language learning (MALL) was first introduced by Chickering and Ehrmann (1996), and since then, numerous studies have been conducted by numerous linguistic and educational researchers. Research on MALL in English language learning has focused on vocabulary, listening, speaking, reading, and grammar (Burston, 2014). Within the existing literature examining the utilization of MALL among native Thai students, the majority of research inquiries have primarily focused on vocabulary, oral communication, and extracurricular activities (Phetsut and Waemusa, 2022; Pingmuang and Koraneekij, 2022).

Existing research on English language learning has focused on specific aspects of language learning, particularly vocabulary and grammar learning, as well as improving listening, speaking, reading, and writing skills. However, a clear gap exists in the comprehensive survey of language learners’ utilization of a specific technological product, such as MALL. In the MALL field, the existing literature has conducted several empirical studies on behavioral intentions associated with MALL utilization in language learning. Nevertheless, there is a clear and ongoing need in this field, characterized by the need for further research endeavors that systematically integrate and extend both the Technology Acceptance Model (TAM) and Expectancy Confirmation Theory (ECT). Furthermore, a noticeable literature gap exists regarding the ongoing utilization of MALL among Thai students. This study aims to address this gap by investigating in depth the factors influencing Thai EFL learners’ persistent utilization of MALL in the context of Thailand’s unique educational and linguistic environment.

This study examines the factors that influence the behavioral intentions of EFL learners toward adopting MALL at two universities in Bangkok, Thailand. The researchers aim to integrate and extend upon the TAM and ECT to explore a model that could more effectively explain learners’ intentions to utilize MALL. Furthermore, this study employed social influences, habits, and perceived enjoyment as external variables to improve the model’s predictive capacity and better comprehend learners’ intentions to utilize MALL. Moreover, this study seeks to enhance educators’ understanding of MALL’s features and learners’ perspectives on its utilization, thereby fostering the integration of mobile technology into language education, ultimately enhancing the effectiveness and outcomes of language learning. Furthermore, it offers valuable insights for MALL service developers and providers, enabling them to better grasp their target users’ preferences and needs and, consequently, develop more efficient, convenient, and tailored MALL applications for their customers.

2 Literature review

2.1 Mobile assisted language learning (MALL)

Mobile learning is a method of electronic learning that employs mobile devices, facilitating learners’ access to educational resources (Traxler, 2004). Mobile learning enables learners to access educational resources through mobile devices without being restricted to a fixed location (Yousafzai et al., 2016). As stated by Nuraeni (2021), mobile learning is a modernized educational method that leverages technological advancements to enhance learners’ accessibility to educational resources through mobile devices, enabling them to engage in learning activities regardless of time and location. Huang et al. (2012) stated that information technology development has brought a new language-learning method for learners. MALL, an acronym for mobile-assisted language learning, refers to language learning activities conducted on various mobile devices (Rahimi and Miri, 2014). MALL is a kind of mobile learning that exclusively involves using mobile devices for language-learning purposes (Shortt et al., 2023).

In the field of English as a second/foreign language (ESL & EFL), there has been a growing focus on integrating information technology into language learning and teaching. Many researchers have increasingly focused on investigating the integration of various language apps (such as Duolingo, Hellotalk, and WhatsApp) into English learning and teaching (Ahmed et al., 2022; Sadeghi and Chalak, 2023; Sakkir and Syamsuddin, 2023). Recently, a surge in the number of studies conducted has consistently highlighted the significant efficacy of MALL as an effective tool for language learners. MALL integrates various information technologies into language education, establishing a situated learning context that promotes active learner participation in acquiring language knowledge and exploring individual learning strategies and patterns (Jeong, 2022). MALL facilitates learners’ proficiency development and refinement through applying and improving language skills in authentic real-life situations (Sabiri and Shah, 2023). Moreover, an extensive body of literature has investigated the impact of mobile-assisted language learning (MALL) on learners’ language competence. A study conducted by Katemba (2021) examined the effectiveness of MALL in rural Indonesian schools, and the results indicated that MALL was effective in strengthening the EFL learners’ vocabulary performance. Ghorbani and Ebadi (2020) demonstrated that MALL can significantly enhance the grammatical development of EFL learners, especially grammatical accuracy. According to Gharehblagh and Nasri (2020), EFL learners mostly believe that MALL has the potential to yield positive outcomes in terms of enhancing writing proficiency. Implementing MALL in English learning could effectively reduce grammatical and structural errors in writing and enhance proficiency (Ghorbani and Ebadi, 2020).

Furthermore, several studies have explored the factors affecting language learners’ intention to adopt or continue using MALL. Hsu and Lin (2021) conducted a study to test the factors impacting the continuous intention of MALL using an extended technology acceptance model (TAM), which revealed that perceived ease of use and perceived usefulness served as essential factors that can effectively explain the continuous intention of using MALL (R-square = 0.8). In an investigation using Expectation Confirmation Theory (ECT) and focusing on Duolingo as the targeted MALL application, Unal and Güngör (2021) found that various factors, including satisfaction, conformation, and perceived usefulness, significantly influenced individuals’ intentions to continue utilizing MALL. Garcia Botero et al. (2022) surveyed 89 higher education language instructors in Colombia and found that social influences significantly influenced teachers’ intention to adopt MALL. Undoubtedly, gamification plays a crucial role in MALL apps, encompassing various enjoyable elements such as entertaining mini-games, incentivizing reward mechanisms, rankings, and engaging quest-based activities, which can effectively stimulate language learners’ decisions about MALL adoption (Shortt et al., 2023). While the number of studies examining the impact of perceived enjoyment on intention to use MALL remains very limited, much research has consistently confirmed the significant influence of perceived enjoyment on learners’ intention to use mobile learning (Cheng, 2014; Mubuke, 2017; Chao, 2019). The concept of habits has consistently been recognized as an essential factor in language learning, receiving considerable attention due to its crucial impact on the overall learning outcome (Patra et al., 2022). So far, empirical investigations about the impact of habits on learners’ intention to utilize MALL have been scarce. However, many studies have confirmed that habits significantly influence learners’ behavioral intention to engage with mobile learning (Yang et al., 2022; Zacharis and Nikolopoulou, 2022; Jameel et al., 2023).

2.2 Technology acceptance model (TAM)

The degree to which users accept a new information system can indicate the system’s success (Qashou, 2021). Davis (1985) initially developed the TAM to explore the acceptance of information technology. The TAM is based on the Theory of Reasoned Action (TRA) proposed by Fishbein and Ajzen (1975), which is designed to evaluate users’ acceptance of an information system more effectively. According to Davis et al. (1989), the TAM model is a well-established framework for explaining the factors that guide user acceptance of a technological product. According to Nikou and Economides (2017), the TAM model is recognized as a well-known model for investigating user acceptance of new technologies or systems. Perceived usefulness and perceived ease of use are the major factors controlling user acceptance of a technology or system (Davis et al., 1989). Perceived usefulness refers to the degree to which users perceive that a particular technology or system can enhance their work performance, while perceived ease of use refers to the degree to which users perceive that they can minimize the effort needed (Davis et al., 1989). While perceived usefulness and perceived ease of use are valuable factors for predicting user behavior, they do not provide a comprehensive explanation for user adoption of new technology (Malatji et al., 2020). Incorporating external variables into the TAM model for a particular technology or system can improve its accuracy in forecasting (Davis et al., 1989).

2.3 Expectation confirmation theory (ECT)

Consumers’ satisfaction with a product is influenced by their expectations regarding its performance and the confirmation associated with those expectations (Oliver, 1977). When the performance of a product aligns with a customer’s expectations, it increases the likelihood of customer repurchase behavior (Oliver, 1980). Expectations are benchmarks for evaluating the actual performance of a product (Oliver, 1980). If the performance surpasses their expectations, users experience a sense of confirmation, leading to an increase in satisfaction. Conversely, if the performance falls below their expectations, users encounter a sense of disconfirmation, resulting in decreased satisfaction (Oliver, 1980; Najmul Islam, 2014). The inception of the ECT by Oliver (1980) marked its pioneering application in exploring customer satisfaction, which emerges from the cognitive dissonance arising from the variance between expectations and realized performance and post-purchase behavior. Inspired by the Technology Acceptance Model and the Theory of Planned Behavior, Bhattacherjee (2001) sought to employ the Expectancy Confirmation Theory to investigate users’ satisfaction and behavioral intentions toward information systems. ECT-based research typically investigates customers’ pre-behavior and post-behavior regarding technology adoption, thus emphasizing a comprehensive understanding of the customer’s adoption progression (Lin et al., 2012). Customer satisfaction and post-behavioral intentions or behaviors are contingent upon their confirmation or disconfirmation of the product (Zhigang et al., 2020).

3 Research model, theoretical background, and research hypotheses

3.1 Research model

The Technology Acceptance Model (TAM) has proven effective in explaining the user’s acceptance of a specific technique or technology, whereas Expectation Confirmation Theory (ECT) models possess the capability to forecast user satisfaction and post-adoption behavior by examining the disconfirmation between performance and expectations. This study integrated and extended the TAM and ECT to elucidate the behavioral intentions of Thai EFL learners in utilizing MALL. Besides that, social influences, habits, and perceived enjoyment were employed as external variables to better explain the behavioral intention to use MALL. The conceptual framework of this research is shown in Figure 1.

Figure 1
www.frontiersin.org

Figure 1. Research model.

3.2 Perceived usefulness (PU)

According to Davis et al. (1989), perceived usefulness (PU) is the extent to which users believe a specific system can increase their productivity. PU is a crucial factor influencing behavioral intention in the TAM model. In ECT, users’ post-adoption expectations are also based on PU (Saeed and Abdinnour-Helm, 2008). PU serves as an extrinsic motivator for users to continue using the product when their expectations exceed those that would enable them to be satisfied (Kumar and Natarajan, 2020). This study defined PU as the extent to which Thai EFL students perceived that MALL could enhance their English learning performance.

Hoi and Mu (2021) investigated the adoption of MALL among 293 higher education EFL learners and discovered that PU has a significant impact on learners’ intention to use MALL and was the most influential predictor of behavioral intention. Based on TAM and the theory of language learning motivation, Fan (2023) conducted a study involving 834 Chinese undergraduates to explore the relationship between perceived usefulness and behavioral intention, revealing that learners’ behavioral intention to utilize mobile platforms for language learning was positively influenced by their perception of the effectiveness of mobile platforms in enhancing their English proficiency. Besides, a great number of studies related to MALL have also confirmed the significant impact of perceived usefulness on satisfaction (Daneji et al., 2019; Al-Sharafi et al., 2021; Li, 2021; Jiang et al., 2022). Therefore, the researchers proposed the following hypotheses:

H1a: Perceived usefulness has a significant impact on behavioral intention.

H1b: Perceived usefulness has a significant impact on satisfaction.

3.3 Perceived ease of use (PEOU)

Perceived ease of use (PEOU) is another critical factor influencing behavioral intention in the TAM model. PEOU refers to the extent to which users perceive a particular technology as effortless (Davis et al., 1989). In this study, PEOU refers to the degree to which Thai EFL students perceive MALL to be easy to use.

Hsu and Lin (2021) utilized and extended TAM to investigate 557 Taiwanese EFL learners’ intention to use MALL and found that PEOU can significantly influence learners’ behavioral intentions. Ebadi and Raygan (2023) investigated the intention to use MALL among 223 Iranian EFL learners and found that PEOU can significantly influence learners’ intention to use MALL. Besides, several studies have shown that PEOU can significantly impact the perceived usefulness (Hsu, 2016) and satisfaction (Joo et al., 2018) of MALL users. Therefore, the researchers proposed the following several hypotheses:

H2a: Perceived ease of use has a significant impact on perceived usefulness.

H2b: Perceived ease of use has a significant impact on satisfaction.

H2c: Perceived ease of use has a significant impact on behavioral intention.

3.4 Perceived enjoyment (PE)

Perceived enjoyment (PE) is an external variable in this study. PE is a kind of intrinsic motivation that indicates the degree of pleasure users believe a technology can provide (Chao, 2019). Users are more inclined to adopt a technology or system when they perceive its utilization will result in happiness and pleasure (Lu et al., 2009). Integrating enjoyable elements within MALL applications can greatly enhance learners’ engagement, motivation, and persistence, fostering more pleasant language learning experiences and yielding higher learning effectiveness (An et al., 2021; Zheng and Zhou, 2022). In this study, PE refers to how Thai EFL learners experience happiness and pleasure when using MALL.

Al-Bashayreh et al. (2022) conducted a study on 415 Jordanian students to examine their acceptance of m-learning. The study revealed that perceived enjoyment is the most critical factor influencing the students’ behavioral intention to use m-learning. The researchers also concluded that incorporating more enjoyable elements in the design of m-learning apps is crucial for enhancing learners’ adoption and continued use of m-learning. Li et al. (2021) conducted a study involving 199 Chinese higher education EFL students who utilized e-learning. They discovered that the students’ perceived enjoyment of e-learning significantly influenced their perceived usefulness and behavioral intentions. Li et al. (2022) conducted a survey of 493 Chinese university students, investigating their behavioral intention and satisfaction with online learning. The study established a significant relationship between perceived enjoyment and user satisfaction. Therefore, the researchers proposed hypotheses as follows:

H3a: Perceived Enjoyment has a significant impact on perceived usefulness.

H3b: Perceived Enjoyment has a significant impact on satisfaction.

H3c: Perceived Enjoyment has a significant impact on behavioral intention.

3.5 Social influence (SI)

Social influence (SI) is another external variable in this study. SI refers to how individuals believe others’ feelings about adopting a specific technology (Venkatesh et al., 2003). In this research, SI refers to the extent to which Thai EFL learners perceive that others support their use of MALL for English language study.

Garcia Botero et al. (2022) and Alyoussef (2021) conducted studies that revealed that social influences can significantly influence the perceived usefulness and behavioral intentions of MALL users. Lutfi et al. (2022) combined the Unified Theory of Acceptance and Use of Technology (UTAUT) with the Expectation Confirmation Model (ECM) to investigate the adoption of mobile learning among 428 university students from King Faisal University, revealing a significant impact of social influence on user satisfaction. In contrast, Huang et al. (2023) conducted a survey involving 681 online short video application users, which indicated that social influence cannot significantly influence users’ behavioral intentions. Therefore, the researchers proposed the following hypotheses:

H4a: Social influence has a significant impact on perceived usefulness.

H4b: Social influence has a significant impact on satisfaction.

H4c: Social influence has a significant impact on behavioral intention.

3.6 Habit (HA)

Habit (HA) is also an external variable in this study. HA refers to a regular and automated manner of behavior resulting from repeated learning (Limayem et al., 2007). HA is commonly characterized as recurrent behaviors that are subject to the individual subconscious (Shiau and Luo, 2013; Yoo and Cho, 2020). HA exerts a direct and interactive influence on the user’s behavior (Triandis, 1979; Isbell et al., 2017). In this study, HA pertains to the extent to which Thai EFL learners perceive the utilization of MALL as an automated behavioral pattern.

Alhadiah (2023) investigated the adoption behavior of MALL among 945 undergraduate EFL learners in Saudi Arabia and found that HA can significantly influence learners’ behavioral intentions. Wu and Perng’s (2016) study of mobile learning with 344 university students at the Shanghai Open University found that habits can significantly influence users’ perceived usefulness and behavioral intention. Soria-Barreto et al. (2021) employed the ECM to investigate the online learning behavior of 452 university students from Spain, Chile, and Jordan, revealing a significant relationship between habit and continuance intention. Therefore, the researchers proposed the following hypotheses:

H5a: Habit has a significant impact on perceived usefulness.

H5b: Habit has a significant impact on behavioral intention.

3.7 Confirmation (CON)

Confirmation (CON) is one of the essential variables in ECM. CON refers to the difference between the user’s perceived actual performance and expectations of a specific product (Bhattacherjee, 2001). In this study, CON pertains to the discrepancy between the perceived performance of Thai EFL learners during their utilization of MALL and their initial expectations.

Meng and Li (2023) explored the use of m-learning by 231 Chinese in-service teachers and revealed that confirmation can significantly affect perceived usefulness and satisfaction. Alhumaid (2021) conducted a survey of 420 students at Zayed University and found that confirmation can significantly affect the perceived usefulness and satisfaction of using mobile learning. Therefore, the researchers proposed hypotheses as follows:

H6a: Confirmation has a significant impact on perceived usefulness.

H6b: Confirmation has a significant impact on satisfaction.

3.8 Satisfaction (SAT)

Satisfaction (SAT) is another critical variable in ECM. SAT refers to the degree to which a person fulfills his or her needs and desires (Kotler, 2000). Within the information systems context, SAT denotes an individual user’s cognitive and affective response while engaging with a specific product or system (McNamara and Kirakowski, 2011; Habib et al., 2022). In this study, SAT refers to the extent to which Thai EFL learners are satisfied with using MALL.

Chao (2019) explored the utilization of m-learning among 1,562 learners from 10 universities in Taiwan, revealing that learners’ perception of satisfaction with m-learning significantly impacted their behavioral intention to employ m-learning. In a study conducted by Alshurideh et al. (2023) involving a sample of 448 students, the findings revealed a significant relationship between satisfaction and continuance intentions of utilization of mobile learning platforms. Similarly, Al-Hamad et al. (2021) found that satisfaction can significantly influence behavioral intention in their study on students’ use of m-learning in higher education contexts.

H7: Satisfaction has a significant impact on behavioral intention.

4 Research methodology

4.1 Research design

This research aimed to examine the factors that influence the behavioral intention of EFL learners to utilize MALL at two universities in Thailand. This study used a quantitative research methodology and selected a previous questionnaire as the research instrument. Following a three-step sampling procedure, the researcher employed SPSS 24 and Amos 27 for data analysis and hypothesis testing.

4.2 Sampling

The researchers distributed 600 questionnaires to full-time students at two universities in Bangkok, Thailand, of which 507 were deemed valid, with an 84.5% validity return rate.

This study employed a meticulous three-stage sampling method, including stratified, snowball, and judgmental sampling. In the stratified sampling stage, the researchers systematically obtained the total number of full-time students from the registration offices of the two involved universities. The researchers initially intended to collect 600 questionnaires, and by calculating the proportion of full-time students at the two universities, the researchers determined the number of questionnaires that needed to be distributed at each university. For the next stage, the researchers employed the snowball sampling method by distributing the questionnaires in the form of QR codes to acquaintances at the two universities in order to facilitate a more extensive distribution of the questionnaires. The last stage involved judgmental sampling, which entailed a careful selection procedure based on screening questions. The researcher ensured the questionnaire was only gathered from full-time students at the specified universities with at least one year of MALL experience. Finally, the researchers received 507 valid questionnaires, and to thank the participants for participating, the researchers expressed gratitude through a gift worth 20 baht.

The study gathered demographic data by acquiring three pieces of information from participants, encompassing gender, educational level, and previous experience with MALL. As shown in Table 1, the gender distribution revealed that male participants accounted for 53.65% (n = 272), while the female counterparts accounted for 46.35% (n = 235). In terms of educational level, the majority comprised undergraduates, encompassing 72.19% (n = 366), followed by master’s degree candidates at 21.30% (n = 108) and doctoral degree candidates at 6.51% (n = 33). About the previous experience with MALL, 8.28% (n = 42) reported less than one year of experience, 36.88% (n = 187) reported one to three years, 41.81% (n = 212) reported three to five years, and 13.02% (n = 66) affirmed an experience over five years.

Table 1
www.frontiersin.org

Table 1. Demographic information.

4.3 Questionnaire design

In this research, the questionnaire consisted of three main parts: screening questions, demographic questions, and scaling questions. The screening questions were applied to help the researchers determine the appropriateness of the participants, including asking whether they were full-time students and their experience with mobile-assisted language learning. Demographic questions were used to gather personal information, including gender, educational level, and experience with MALL. Last, the scaling questions contained eight factors, totaling 32 scale items. All scale items were on a five-point Likert scale, ranging from strongly disagree (1) to strongly agree (5). Also, all scale items were derived from the adaptation of previous literature questionnaires. The items for perceived usefulness and behavioral intention are from Buabeng-Andoh (2018), perceived ease of use is from Chang et al. (2012), social influence is from Garcia Botero et al. (2022), perceived enjoyment is from Alyoussef (2021), satisfaction and confirmation are from Faozi and Handayani (2023), and habit is from Voicu and Muntean (2023).

4.4 Pilot test

The pilot test serves as a preliminary evaluation to determine the feasibility and reliability of the study (Malmqvist et al., 2019). According to Kieser and Wassmer (1996), a sample size ranging from 30 to 40 individuals would be appropriate for conducting pilot research. Therefore, the researchers selected to include a sample of 35 full-time Thai EFL students from two universities in the pilot test. The Cronbach Alpha coefficients for the six factors examined in the pilot study were as follows: perceived usefulness (0.836), perceived ease of use (0.867), satisfaction (0.901), confirmation (0.822), perceived enjoyment (0.835), social influence (0.808), habit (0.855), and behavioral intention (0.834). All the Cronbach Alpha exhibited values greater than 0.8, indicating a high level of reliability for the questionnaire and affirming the feasibility of the study.

4.5 Data analysis

The study employed SPSS 24 software to conduct a descriptive analysis of demographic questions and reliability. After that, the Amos 27 software will be applied to perform a confirmatory factor analysis (CFA) to assess the research study’s discriminant and convergent validity. Lastly, structural equation modeling (SEM) was used for hypothesis testing by using Amos 27 software.

5 Results

5.1 Measurement model

The reliability of this research was measured using Cronbach’s alpha. Cronbach’s alpha, a reliability coefficient used to measure internal consistency between items, is considered acceptable when its value exceeds 0.7 (Taber, 2018). As shown in Table 2, the study demonstrates adequate reliability and internal consistency, with Cronbach’s alpha ranging from 0.821 to 0.878 across the dimensions.

Table 2
www.frontiersin.org

Table 2. Reliability and convergent validity.

The convergent validity was evaluated using three metrics: factor loadings, composite reliability (CR), and average variance extracted (AVE). According to Hair et al. (2010), factor loadings represent the correlation coefficients between latent and observed variables and are considered ideal when they exceed 0.7 and are statistically significant. Table 2 demonstrates that all the factor loadings are statistically significant and range from 0.712 to 0.917, indicating that the factor loadings in this study could be considered adequate. Composite reliability, akin to Cronbach’s alpha, is a measure of internal consistency of dimensions, with an acceptable range typically falling between 0.7 and 0.95 (Hair et al., 2020). As shown in Table 2, the composite reliability ranged between 0.820 and 0.911, demonstrating sufficient internal consistency. An average variance extracted over 0.5 can indicate sufficient convergent validity (Fornell and Larcker, 1981). The convergent validity has been ensured as all dimensions in Table 2 exhibited AVE values that exceeded the threshold of 0.5.

To ensure adequate discriminant validity, the square root of the AVE must exceed all correlation coefficients between it and the other dimensions (Fornell and Larcker, 1981). According to Table 3, the discriminant validity was confirmed as the square root of the AVE for all dimensions exceeded the correlation coefficients with the other dimensions. The heterotrait-monotrait (HTMT) correlation ratio is another method for evaluating discriminant validity. According to Henseler et al. (2015), any coefficient beyond 0.9 in the HTMT table indicates a lack of discriminant validity. As shown in Table 4, the discriminant validity of the study was established as all coefficients in the table are less than 0.9.

Table 3
www.frontiersin.org

Table 3. Fornell-Larcker criterion.

Table 4
www.frontiersin.org

Table 4. HTMT.

5.2 Structural model

Before conducting hypothesis testing, the researchers analyzed the goodness-of-fit for the structural model. Based on the results shown in Table 5, all the goodness-of-fit indices are above thresholds, which shows a strong match between the data and the proposed model. Therefore, the researchers can start hypothesis testing using this proposed model. Subsequently, the researchers conducted structural equation modeling (SEM) to examine all the research hypotheses. According to the results in Table 6, hypotheses H4b (the effect of society on satisfaction) was not supported, while the remaining 14 hypotheses were supported. The results of the structural model are presented in Figure 2.

Table 5
www.frontiersin.org

Table 5. Goodness of fit indices.

Table 6
www.frontiersin.org

Table 6. Hypothesis testing.

Figure 2
www.frontiersin.org

Figure 2. Structural model results.

The R-squared is a statistical measure that quantifies the proportion of variation in endogenous variables that can be accounted for by exogenous variables (Hair et al., 2013). As demonstrated in Figure 2, the R-square of behavioral intention is 0.773, indicating that all dimensions can explain 77.3% of behavioral intention. That is, the study’s variables have a good explanation for the behavioral intention to use MALL. The R-squared values for the remaining dimensions are perceived usefulness (0.313) and satisfaction (0.356).

6 Conclusion and discussion

The advent and widespread adoption of mobile devices have presented novel opportunities and potential for the development of second language acquisition and foreign language learning (Sung et al., 2015). Due to its effectiveness, convenience, and entertainment features, Mobile Assisted Language Learning (MALL) is gradually gaining prominence as the preferred autonomous language learning approach among young individuals (Wu, 2015). In Thailand, English is spoken as a foreign language, and the English proficiency of Thai university students still needs to be improved (Tantiwich and Sinwongsuwat, 2021). Younger generation students increasingly rely on intelligent mobile devices and are initiating to employ such devices for educational purposes, particularly in language learning (Pikhart and Klímová, 2020; Salehan and Negahban, 2013).

By integrating and extending TAM and ECT, this study aims to investigate the factors influencing EFL learners’ behavioral intention to use MALL at two universities in Bangkok, Thailand. A total of 507 valid samples were collected through a three-step sampling process. Following the utilization of CFA to assess the structural validity of the study, the researcher employed SEM to test all research hypotheses. The results revealed that all the hypotheses were supported except for the impact of social influence on behavioral intention.

In the current study, the explanatory level of all factors for the behavioral intention of Thai EFL learners to continuously use MALL was 77.3% (R-square = 0.773). All investigated factors exhibited a significant impact on the behavioral intention of Thai EFL learners to use MALL, with perceived enjoyment (PE) emerging as the most influential factor (β = 0.5809, p < 0.05). This finding is consistent with the conclusions of previous studies (Li et al., 2021, 2022; Al-Bashayreh et al., 2022). PE plays a crucial role in language learning because it increases learners’ effectiveness and overall satisfaction (Zheng and Zhou, 2022). When learners enjoy the language-learning process, they are more likely to be actively involved and engaged in language learning (Mierzwa, 2019). Moreover, individuals who experience enjoyment from using mobile devices for language acquisition are inclined to engage actively with MALL, explore various language learning applications, and maintain their learning efforts over an extended period (An et al., 2021). Learning English can be an extremely challenging endeavor for Thai students, who must dedicate a significant amount of time and effort to improving their English competencies, making it difficult for many Thai students to keep learning English on their mobile devices. Currently, there is a growing trend in the development of MALL applications that prioritize user enjoyment and satisfaction. While learning English, learners have the opportunity to engage with various kinds of exciting videos and interactive games. Incorporating entertaining features like gamification is exciting to young MALL users, and the level of enjoyment derived from their experiences plays a crucial role in determining their intention to use MALL (Shortt et al., 2023).

Perceived usefulness (PU), a crucial factor in TAM and ECM research, is identified as one of the most significant variables that can impact the behavioral intention of Thai EFL learners to adopt MALL in the present study (β = 0.3597, p < 0.05). This finding is consistent with the conclusions of previous studies (Kim and Lee, 2016; Hoi and Mu, 2021; Fan, 2023). PU has been consistently demonstrated as one of the critical variables within information systems research, exerting significant influence on individuals’ behavioral intentions (Saeed and Abdinnour-Helm, 2008). In language learning, individuals who perceive MALL as beneficial for enhancing their language learning proficiency are more inclined to use it (Aratusa et al., 2022). Language learners will only adopt or utilize MALL in the long term if they believe that MALL can enhance their learning efficiency and outcomes (Soleimani et al., 2014).

Habit (HA), as an external variable in this study, is a critical factor affecting language learning. In this research, HA can significantly influence Thai EFL learners’ behavioral intention to continuously use MALL (β = 0.2596, p < 0.05). This finding is consistent with previous results in the literature (Soria-Barreto et al., 2021; Alhadiah, 2023). HA plays a critical role in both language learning and mobile learning (Yoo and Cho, 2020). Several studies have demonstrated that HA can determine whether learners are able to adopt language learning (Bailey and Onwuegbuzie, 2002; Chiang, 2016) and m-learning (Wu and Perng, 2016; Nikolopoulou et al., 2021) consistently and effectively, which in turn affects their language learning outcomes. HA can impact learners’ active involvement, persistence, and effectiveness in consistently and proficiently employing MALL (Isbell et al., 2017).

Satisfaction (SAT), a critical factor in ECT, is often used to predict users’ behavioral intentions. The findings of this research indicate that the level of satisfaction among Thai EFL learners about the use of MALL significantly influences their behavioral intention (β = 0.2344, p < 0.05). This finding is consistent with the results of a substantial number of previous studies (Chao, 2019; Al-Hamad et al., 2021; Alshurideh et al., 2023). In language learning, a high level of satisfaction fosters active involvement and perseverance among learners, boosting their learning achievements and outcomes (Chiu, 2022). If language learners are satisfied with MALL, they are more likely to keep a positive learning attitude and motivation, thus leading to their ongoing utilization of MALL (Habib et al., 2022).

Perceived ease of use (PEOU), another vital factor in TAM, is considered to be able to impact perceived usefulness and behavioral intention. The current study found that the PEOU of the MALL had a significant impact on Thai EFL learners’ intention to utilize the MALL (β = 0.1036, p < 0.05). It is consistent with a great number of findings from previous studies (Hsu and Lin, 2021; Ebadi and Raygan, 2023). Language learners tend to prefer MALL apps characterized by simple interface design, efficient functionality, and enhanced interactive experiences, as these attributes help them save much time in adapting to the MALL (Viberg and Grönlund, 2012).

Lastly, social influence (SI), a crucial factor influencing behavioral intention in the unified theory of acceptance and use of technology (UTAUT), is an external variable in this study. In this research, SI can significantly influence Thai EFL learners’ behavioral intention to use MALL (β = 0.1024, p < 0.05). This is consistent with the findings of a number of previous studies (Alyoussef, 2021; Garcia Botero et al., 2022). Language learners’ attitudes and motivation positively correlate with the social recognition of language learning as a significant pursuit, thereby influencing their eagerness to develop proficiency in the target language (Dörnyei, 2003).

The explanatory level of the remaining factors in this study for the satisfaction of Thai EFL learners in using MALL was 35.6% (R-square = 0.356). Among all the factors, perceived usefulness was the most influential factor, and a great number of studies also confirmed this finding (Al-Sharafi et al., 2021; Jiang et al., 2022). On the other hand, social influence was found unable to significantly influence satisfaction, which is also consistent with Huang et al. (2023). The remaining factors all had a significant effect on satisfaction, which were perceived enjoyment (β = 0.2445, p < 0.05), confirmation (β = 0.1355, p < 0.05), and perceived ease of use (β = 0.1262, p < 0.05).

In this study, the explanatory level of the factors for the perceived usefulness of MALL by Thai EFL learners was 31.3% (R-square = 0.313). Among all factors, confirmation could most significantly influence perceived usefulness (β = 0.3209, p < 0.05), which is also consistent with the findings of previous studies (Alhumaid, 2021; Meng and Li, 2023). The remaining factors all significantly influenced perceived usefulness, which were social influence (β = 0.1923, p < 0.05), perceived enjoyment (β = 0.2884, p < 0.05), habits (β = 0.1370, p < 0.05), and perceived ease of use (β = 0.1036, p < 0.05).

7 Implications

7.1 Theoretical implications

This research introduces an integrated and extended TAM and ECM model that incorporates perceived enjoyment, social influence, and habits as external factors to explore the factors that influence behavioral intention to use MALL among university students in Thailand. Numerous research studies have used the TAM and ECT to forecast behavioral intentions related to e-learning, online learning, or m-learning. However, there is limited research that integrated TAM and ECT to explore behavioral intentions to use MALL, especially in the Thai cultural context. Therefore, this study not only expands the theoretical understanding of technology adoption in the context of MALLs but also provides a more comprehensive framework for exploring the factors influencing MALL use intention among Thai university students.

7.2 Practical implications

The influential impact of perceived enjoyment on behavioral intention demonstrates the importance of substituting enjoyable elements into language learning. EFL learners always face many challenges while learning English, including remembering wide-ranging vocabulary and grammatical rules and improving the four basic language skills (listening, speaking, reading, and writing). Many EFL learners discontinue using MALL because they find English too tricky and lose interest. Most young language learners perceive MALL as an enjoyable experience, contributing to their persistence and commitment to language learning. Therefore, it is important for educators to focus on the fun aspect of learning content in language teaching so that learners can be motivated to learn a foreign language more efficiently and for a more extended period. For MALL developers and providers, it is essential to design language learning apps that provide a more enjoyable and immersive learning experience for learners. The frequent utilization of MALL by EFL learners is more likely to occur when they are exposed to engaging games and exciting videos in their English learning progress.

Perceived usefulness also holds a considerable influence on the behavioral intention of language learners toward MALL. Learners who recognize the potential of MALL to improve language learning’s efficacy and performance are more likely to be motivated and inclined to accept it as a means of language learning. Educators should emphasize the functions and advantages of MALLs in language learning to encourage learners to incorporate MALLs into their language learning. MALL developers and providers should focus more on developing functions that can improve learners’ foreign language ability efficiently to gain more advantages in the market competition.

Apart from perceived enjoyment and perceived usefulness, the other factors investigated in this research also revealed significant effects on the behavioral intention of Thai EFL learners to use MALL. These discoveries have the potential to provide valuable insights for researchers, educators, and developers to improve the effectiveness of MALL in promoting language learning outcomes.

8 Limitations and future research

The current research only obtained data from a sample of 507 university students enrolled at two universities in Bangkok, Thailand. It is important to point out that the findings of this study may not be fully representative of the overall population of Thai EFL learners. Hence, a broader and more diversified sample might provide a more exhaustive comprehension of the factors that impact the behavioral inclination of EFL learners toward using MALL.

Moreover, this research’s findings may only apply to EFL learners in Thai educational settings. The Thai education system has a comparatively higher degree of flexibility and tolerance than many other Asian countries, with a greater emphasis on fostering enjoyable educational experiences for students. Therefore, the researchers encourage future studies to be conducted in other countries using the extended TAM model.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

The studies involving humans were approved by Stamford International University. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

LP: Formal analysis, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing. YY: Conceptualization, Project administration, Resources, Supervision, Writing – review & editing. XL: Data curation, Investigation, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Ahmed, A. A. A., Hassan, I., Pallathadka, H., Keezhatta, M. S., Noorman Haryadi, R., Al Mashhadani, Z. I., et al. (2022). MALL and EFL learners’ speaking: impacts of Duolingo and Whats app applications on speaking accuracy and fluency. Educ. Res. Int. 2022, 1–10. doi: 10.1155/2022/6716474

Crossref Full Text | Google Scholar

Al-Bashayreh, M., Almajali, D., Altamimi, A., Masadeh, R. E., and Al-Okaily, M. (2022). An empirical investigation of reasons influencing student acceptance and rejection of Mobile learning apps usage. Sustain. For. 14:4325. doi: 10.3390/su14074325

Crossref Full Text | Google Scholar

Alghamdi, A. M., Alsuhaymi, D. S., Alghamdi, F. A., Farhan, A. M., Shehata, S. M., and Sakoury, M. M. (2022). University students’ behavioral intention and gender differences toward the acceptance of shifting regular field training courses to e-training courses. Educ. Inf. Technol. 27, 451–468. doi: 10.1007/s10639-021-10701-1

PubMed Abstract | Crossref Full Text | Google Scholar

Alhadiah, A. (2023). Undergraduate EFL learners’ use and acceptance of Mobile-assisted language learning: A structural equation modeling approach. World J. Eng. Lang. 13:253. doi: 10.5430/wjel.v13n3p253

Crossref Full Text | Google Scholar

Al-Hamad, M., Mbaidin, O., Alhamad, A. Q., Alhamad, M., Hikmat, B., Al-Hamad, N., et al. (2021). Investigating students' behavioral intention to use mobile learning in higher education in UAE during Coronavirus-19 pandemic. Int. J. Data Netw. Sci. 5, 321–330. doi: 10.5267/j.ijdns.2021.6.001

Crossref Full Text | Google Scholar

Alhumaid, K. (2021). Developing an educational framework for using mobile learning during the era of COVID-19. Int. Jou. Dat. Net. Sci., 5, 215. doi: 10.5267/j.ijdns.2021.6.012

Crossref Full Text | Google Scholar

Al-Sharafi, M. A., Al-Qaysi, N., Iahad, N., and Al-Emran, M. (2021). Evaluating the sustainable use of mobile payment contactless technologies within and beyond the COVID-19 pandemic using a hybrid SEM-ANN approach. Int. J. Bank Mark. 40, 1071–1095. doi: 10.1108/IJBM-07-2021-0291

Crossref Full Text | Google Scholar

Alshurideh, M., Al Kurdi, B., Salloum, S. A., Arpaci, I., and Al-Emran, M. (2023). Predicting the actual use of m-learning systems: a comparative approach using PLS-SEM and machine learning algorithms. Interact. Learn. Environ. 31, 1214–1228. doi: 10.1080/10494820.2020.1826982

Crossref Full Text | Google Scholar

Alyoussef, I. Y. (2021). Factors influencing students’ acceptance of M-learning in higher education: An application and extension of the UTAUT model. Electronics 10:3171. doi: 10.3390/electronics10243171

Crossref Full Text | Google Scholar

An, Z., Wang, C., Li, S., Gan, Z., and Li, H. (2021). Technology-assisted self-regulated English language learning: associations with English language self-efficacy, English enjoyment, and learning outcomes. Front. Psychol. 11:558466. doi: 10.3389/fpsyg.2020.558466

PubMed Abstract | Crossref Full Text | Google Scholar

Aratusa, Z., Suriaman, A., Darmawan, D., Marhum, M., Rofiqoh, R., and Nurdin, N. (2022). Students' perceptions on the use of Mobile-assisted language learning (MALL) in learning pronunciation. Int. J. Sci. Res. 5, 2652–2660. doi: 10.47191/ijcsrr/V5-i7-50

Crossref Full Text | Google Scholar

Aroonsrimarakot, S., Laiphrakpam, M., Chathiphot, P., Saengsai, P., and Prasri, S. (2023). Online learning challenges in Thailand and strategies to overcome the challenges from the students’ perspectives. Educ. Inf. Technol. 28, 8153–8170. doi: 10.1007/s10639-022-11530-6

PubMed Abstract | Crossref Full Text | Google Scholar

Arpaci, I., Al-Emran, M., and Al-Sharafi, M. A. (2020). The impact of knowledge management practices on the acceptance of massive open online courses (MOOCs) by engineering students: A cross-cultural comparison. Telematics Inform. 54:101468. doi: 10.1016/j.tele.2020.101468

Crossref Full Text | Google Scholar

Awang, Z. (2012). A handbook on SEM structural equation modelling: SEM using AMOS graphic (5th Edn). Kota Baru: Universiti Teknologi Mara Kelantan.

Google Scholar

Bailey, P. D., and Onwuegbuzie, A. J. (2002). The role of study habits in foreign language courses. Assess. Eval. High. Educ. 27, 463–473. doi: 10.1080/0260293022000009339

Crossref Full Text | Google Scholar

Baker, W. (2011). Intercultural awareness: modelling an understanding of cultures in intercultural communication through English as a lingua franca. Lang. Intercult. Commun. 11, 197–214. doi: 10.1080/14708477.2011.577779

Crossref Full Text | Google Scholar

Bhattacherjee, A. (2001). Understanding information systems continuance: An expectation-confirmation model. MIS Q. 25, 351–370. doi: 10.2307/3250921

Crossref Full Text | Google Scholar

Brighton, H., Smith, K., and Kirby, S. (2005). Language as an evolutionary system. Phys Life Rev 2, 177–226. doi: 10.1016/j.plrev.2005.06.001

Crossref Full Text | Google Scholar

Buabeng-Andoh, C. (2018). Predicting students’ intention to adopt mobile learning. J. Res. Innov. Teach. Learn. 11, 178–191. doi: 10.1108/JRIT-03-2017-0004

Crossref Full Text | Google Scholar

Buasuwan, P. (2018). Rethinking Thai higher education for Thailand 4.0. Asian Educ. Dev. Stud. 7, 157–173. doi: 10.1108/AEDS-07-2017-0072

Crossref Full Text | Google Scholar

Burston, J. (2014). The reality of MALL project implementations: still on the fringes. CALICO 31, 103–125. doi: 10.11139/cj.31.1.103-125

Crossref Full Text | Google Scholar

Byrne, B. M. (1994). Structural equation modeling with EQS and EQS/Windows: Basic concepts, applications, and programming. Sage.

Google Scholar

Chang, C.-C., Yan, C.-F., and Tseng, J.-S. (2012). Perceived convenience in an extended technology acceptance model: Mobile technology and English learning for college students. Australas. J. Educ. Technol. 28, 809–826. doi: 10.14742/ajet.818

Crossref Full Text | Google Scholar

Chao, C.-M. (2019). Factors determining the behavioral intention to use Mobile learning: An application and extension of the UTAUT model. Front. Psychol. 10:1652. doi: 10.3389/fpsyg.2019.01652

PubMed Abstract | Crossref Full Text | Google Scholar

Cheng, Y.-M. (2014). Exploring the intention to use mobile learning: the moderating role of personal innovativeness. J. Syst. Inf. Technol. 16, 40–61. doi: 10.1108/JSIT-05-2013-0012

Crossref Full Text | Google Scholar

Chiang, I. C. (2016). Reading habits, language learning achievements and principles for deep knowledge. Linguistics Lit. Stud. 4, 203–212. doi: 10.13189/lls.2016.040304

Crossref Full Text | Google Scholar

Chickering, A., and Ehrmann, S. (1996). Implementing the seven principles: technology as lever. Am. Assoc. Higher Educ. Bulletin 49, 3–6.

Google Scholar

Chiu, T. K. F. (2022). Applying the self-determination theory (SDT) to explain student engagement in online learning during the COVID-19 pandemic. J. Res. Technol. Educ. 54, S14–S30. doi: 10.1080/15391523.2021.1891998

Crossref Full Text | Google Scholar

Criollo-C, S., Guerrero-Arias, A., Jaramillo-Alcázar, Á., and Luján-Mora, S. (2021). Mobile learning Technologies for Education: benefits and pending issues. Appl. Sci. 11:4111. doi: 10.3390/app11094111

Crossref Full Text | Google Scholar

Daneji, A. A., Ayub, A. F. M., and Khambari, M. N. M. (2019). The effects of perceived usefulness, confirmation and satisfaction on continuance intention in using massive open online course (MOOC). Knowl. Manag. E-Learn. 11, 201–214. doi: 10.34105/j.kmel.2019.11.010

Crossref Full Text | Google Scholar

Davis, F. (1985). A technology acceptance model for empirically testing new end-user information systems. Massachusetts Institute of Technology.

Google Scholar

Davis, F. D., Bagozzi, R. P., and Warshaw, P. R. (1989). User acceptance of computer technology: a comparison of two theoretical models. Manag. Sci. 35, 982–1003. doi: 10.1287/mnsc.35.8.982

Crossref Full Text | Google Scholar

Dörnyei, Z. (2003). Attitudes, orientations, and motivations in language learning: advances in theory, research, and applications. Lang. Learn. 53, 3–32. doi: 10.1111/1467-9922.53222

Crossref Full Text | Google Scholar

Ebadi, S., and Raygan, A. (2023). Investigating the facilitating conditions, perceived ease of use and usefulness of mobile-assisted language learning. Smart Learn. Environ. 10:30. doi: 10.1186/s40561-023-00250-0

Crossref Full Text | Google Scholar

Fan, C. (2023). English learning motivation with TAM: undergraduates’ behavioral intention to use Chinese indigenous social media platforms for English learning. Cogent Social Sci. 9:2260566. doi: 10.1080/23311886.2023.2260566

Crossref Full Text | Google Scholar

Faozi, F., and Handayani, P. (2023). The antecedents of Mobile-assisted language learning applications continuance intention. Electron. J. e-Learn. 21, 299–313. doi: 10.34190/ejel.21.4.2744

Crossref Full Text | Google Scholar

Fishbein, M., and Ajzen, I. (1975). Belief, attitude, intention and behaviour: An introduction to theory and research. Reading, MA: Addison-Wesley.

Google Scholar

Fornell, C., and Larcker, D. F. (1981). Structural equation models with unobservable variables and measurement error: algebra and statistics. J. Mark. Res. 18, 382–388. doi: 10.1177/002224378101800313

Crossref Full Text | Google Scholar

Garcia Botero, G., Diep, A., Botero, J., Zhu, C., and Questier, F. (2022). Acceptance and use of Mobile-assisted language learning by higher education language teachers. Lenguaje 50, 66–92. doi: 10.25100/lenguaje.v50i1.11006

Crossref Full Text | Google Scholar

Gharehblagh, N. M., and Nasri, N. (2020). Developing EFL elementary learners’ writing skills through mobile-assisted language learning (MALL). Teach. English With Technol. 20, 104–121.

Google Scholar

Ghorbani, N., and Ebadi, S. (2020). Exploring learners’ grammatical development in mobile assisted language learning. Cogent Educ. 7:1704599. doi: 10.1080/2331186X.2019.1704599

Crossref Full Text | Google Scholar

Habib, S., Haider, A., Suleman, S. S. M., Akmal, S., and Khan, M. A. (2022). Mobile assisted language learning: evaluation of accessibility, adoption, and perceived outcome among students of higher education. Electronics 11:1113. doi: 10.3390/electronics11071113

Crossref Full Text | Google Scholar

Hair, J. F., Black, W. C., Babin, B. J., and Anderson, R. E. (2010). Multivariate data analysis. 7th Edn, Pearson: New York.

Google Scholar

Hair, J. F., Howard, M. C., and Nitzl, C. (2020). Assessing measurement model quality in PLS-SEM using confirmatory composite analysis. J. Bus. Res. 109, 101–110. doi: 10.1016/j.jbusres.2019.11.069

Crossref Full Text | Google Scholar

Hair, J. F., Ringle, C. M., and Sarstedt, M. (2013). Partial least squares structural equation modeling: rigorous applications, better results, and higher acceptance. Long Range Plan. 46, 1–12. doi: 10.1016/j.lrp.2013.01.001

Crossref Full Text | Google Scholar

Henseler, J., Ringle, C. M., and Sarstedt, M. (2015). A new criterion for assessing discriminant validity in variance-based structural equation modeling. J. Acad. Mark. Sci. 43, 115–135. doi: 10.1007/s11747-014-0403-8

Crossref Full Text | Google Scholar

Hoi, V. N., and Mu, G. M. (2021). Perceived teacher support and students’ acceptance of mobile-assisted language learning: evidence from Vietnamese higher education context. Br. J. Educ. Technol. 52, 879–898. doi: 10.1111/bjet.13044

Crossref Full Text | Google Scholar

Hsu, H.-T., and Lin, C.-C. (2021). Extending the technology acceptance model of college learners' mobile-assisted language learning by incorporating psychological constructs. Br. J. Educ. Technol. 53, 286–306. doi: 10.1111/bjet.13165

Crossref Full Text | Google Scholar

Hsu, L. (2016). Examining EFL teachers’ technological pedagogical content knowledge and the adoption of mobile-assisted language learning: a partial least square approach. Comput. Assist. Lang. Learn. 29, 1287–1297. doi: 10.1080/09588221.2016.1278024

Crossref Full Text | Google Scholar

Huang, L., Dong, X., Yuan, H., and Wang, L. (2023). Enabling and inhibiting factors of the continuous use of Mobile short video APP: satisfaction and fatigue as mediating variables respectively. Psychol. Res. Behav. Manag. 16, 3001–3017. doi: 10.2147/PRBM.S411337

PubMed Abstract | Crossref Full Text | Google Scholar

Huang, Y.-M., Huang, Y.-M., Huang, S.-H., and Lin, Y.-T. (2012). A ubiquitous English vocabulary learning system: evidence of active/passive attitudes vs. usefulness/ease-of-use. Comput. Educ. 58, 273–282. doi: 10.1016/j.compedu.2011.08.008

Crossref Full Text | Google Scholar

Isbell, D. R., Rawal, H., Oh, R., and Loewen, S. (2017). Narrative Perspectives on Self-Directed Foreign Language Learning in a Computer- and Mobile-Assisted Language Learning Context. Languages, 2, 4. doi: 10.3390/languages2020004

Crossref Full Text | Google Scholar

Jameel, A., Abdulkarem, M., and Alheety, A. S. (2023). Behavioral intention and actual use of Mobile learning during the COVID-19 pandemic in the higher education system. In International Conference on Emerging Technologies and Intelligent Systems Cham: Springer International Publishing. 155–167.

Google Scholar

Jeong, K.-O. (2022). Facilitating sustainable self-directed learning experience with the use of Mobile-assisted language learning. Sustain. For. 14:2894. doi: 10.3390/su14052894

Crossref Full Text | Google Scholar

Jiang, P., Wijaya, T. T., Mailizar, M., Zulfah, Z., and Astuti, A. (2022). How Micro-lectures improve learning satisfaction and achievement: A combination of ECM and extension of TAM models. Mathematics 10:3430. doi: 10.3390/math10193430

Crossref Full Text | Google Scholar

Joo, Y. J., So, H.-J., and Kim, N. H. (2018). Examination of relationships among students' self-determination, technology acceptance, satisfaction, and continuance intention to use K-MOOCs. Comput. Educ. 122, 260–272. doi: 10.1016/j.compedu.2018.01.003

Crossref Full Text | Google Scholar

Kao, M.-C., Yuan, Y.-H., and Wang, Y.-X. (2023). The study on designed gamified mobile learning model to assess students’ learning outcome of accounting education. Heliyon 9:e13409. doi: 10.1016/j.heliyon.2023.e13409

PubMed Abstract | Crossref Full Text | Google Scholar

Katemba, C. V. (2021). Enhancing vocabulary performance through Mobile assisted language learning at a rural School in Indonesia. Acuity 6, 1–11. doi: 10.35974/acuity.v6i1.2457

Crossref Full Text | Google Scholar

Kieser, M., and Wassmer, G. (1996). On the use of the upper confidence limit for the variance from a pilot sample for sample size determination. Biom. J. 38, 941–949. doi: 10.1002/bimj.4710380806

Crossref Full Text | Google Scholar

Kim, G.-M., and Lee, S. (2016). Korean Students' intentions to use Mobile-assisted language learning: applying the technology acceptance model. Int. J. Contents 12, 47–53. doi: 10.5392/IJoC.2016.12.3.047

Crossref Full Text | Google Scholar

Kim, L., Pongsakornrungsilp, P., Pongsakornrungsilp, S., Cattapan, T., and Nantavisit, N. (2022). Determinants of perceived e-learning usefulness in higher education: A case of Thailand. Innov. Mark. 18, 86–96. doi: 10.21511/im.18(4).2022.08

Crossref Full Text | Google Scholar

Kotler, P. (2000). Marketing Management. 10th Edn, Hoboken, NJ: Prentice-Hall.

Google Scholar

Kumar, A., and Natarajan, S. (2020). An extension of the expectation confirmation model (ECM) to study continuance behavior in using e-health services. Innov. Mark. 16, 15–28. doi: 10.21511/im.16(2).2020.02

Crossref Full Text | Google Scholar

Li, C., He, L., and Wong, I. A. (2021). Determinants predicting undergraduates’ intention to adopt e-learning for studying english in chinese higher education context: A structural equation modelling approach. Educ. Inf. Technol. 26, 4221–4239. doi: 10.1007/s10639-021-10462-x

Crossref Full Text | Google Scholar

Li, L., Wang, Q., and Li, J. (2022). Examining continuance intention of online learning during COVID-19 pandemic: incorporating the theory of planned behavior into the expectation–confirmation model. Front. Psychol. 13:1046407. doi: 10.3389/fpsyg.2022.1046407

PubMed Abstract | Crossref Full Text | Google Scholar

Limayem, M., Hirt, S. G., and Cheung, C. M. K. (2007). How habit limits the predictive power of intention: the case of information systems continuance. MIS Q. 31, 705–737. doi: 10.2307/25148817

Crossref Full Text | Google Scholar

Lin, T.-C., Wu, S., Hsu, J. S.-C., and Chou, Y.-C. (2012). The integration of value-based adoption and expectation–confirmation models: An example of IPTV continuance intention. Decis. Support. Syst. 54, 63–75. doi: 10.1016/j.dss.2012.04.004

Crossref Full Text | Google Scholar

Li, R. (2021). Modeling the continuance intention to use automated writing evaluation among Chinese EFL learners. SAGE Open 11:215824402110607. doi: 10.1177/21582440211060782

Crossref Full Text | Google Scholar

Liu, P.-L., and Chen, C.-J. (2015). Learning English through actions: a study of mobile-assisted language learning. Interact. Learn. Environ. 23, 158–171. doi: 10.1080/10494820.2014.959976

Crossref Full Text | Google Scholar

Lutfi, A., Saad, M., Almaiah, M. A., Alsaad, A., Al-Khasawneh, A., Alrawad, M., et al. (2022). Actual use of Mobile learning technologies during social distancing circumstances: case study of King Faisal University students. Sustain. For. 14:7323. doi: 10.3390/su14127323

Crossref Full Text | Google Scholar

Lu, Y., Zhou, T., and Wang, B. (2009). Exploring Chinese users’ acceptance of instant messaging using the theory of planned behavior, the technology acceptance model, and the flow theory. Comput. Hum. Behav. 25, 29–39. doi: 10.1016/j.chb.2008.06.002

Crossref Full Text | Google Scholar

Mahyoob, M. (2020). Challenges of e-learning during the COVID-19 pandemic experienced by EFL learners. Arab World Eng. J. 11, 351–362. doi: 10.24093/awej/vol11no4.23

Crossref Full Text | Google Scholar

Malatji, W. R., Eck, R. V., and Zuva, T. (2020). Understanding the usage, modifications, limitations and criticisms of technology acceptance model (TAM). Adv. Sci. Technol. Eng. Syst. J. 5, 113–117. doi: 10.25046/aj050612

Crossref Full Text | Google Scholar

Malmqvist, J., Hellberg, K., Möllås, G., Rose, R., and Shevlin, M. (2019). Conducting the pilot study: A neglected part of the research process? Methodological findings supporting the importance of piloting in qualitative research studies. Int J Qual Methods 18:160940691987834. doi: 10.1177/1609406919878341

Crossref Full Text | Google Scholar

McNamara, N., and Kirakowski, J. (2011). Measuring user-satisfaction with electronic consumer products: the consumer products questionnaire. Int. J. Human Comput. Stud. 69, 375–386. doi: 10.1016/j.ijhcs.2011.01.005

Crossref Full Text | Google Scholar

Meng, Z., and Li, R. (2023). Understanding Chinese teachers’ informal online learning continuance in a mobile learning community: an intrinsic–extrinsic motivation perspective. J. Comput. High. Educ., 1–23. doi: 10.1007/s12528-023-09352-7

PubMed Abstract | Crossref Full Text | Google Scholar

Mensah, I. K., Zeng, G., Luo, C., Lu, M., and Xiao, Z.-W. (2022). Exploring the E-learning adoption intentions of college students amidst the COVID-19 epidemic outbreak in China. SAGE Open 12:215824402210866. doi: 10.1177/21582440221086629

Crossref Full Text | Google Scholar

Mierzwa, E. (2019). Foreign language learning and teaching enjoyment: teachers’ perspectives. J. Educ. Cult. Soc. 10, 170–188. doi: 10.15503/jecs20192.170.188

Crossref Full Text | Google Scholar

Mubuke, F. (2017). The predictability of perceived enjoyment and its impact on the intention to use Mobile learning systems. Asian J. Comput. Sci. Informat. Technol. 7, 1–5. doi: 10.15520/ajcsit.v6i8.51

Crossref Full Text | Google Scholar

Najmul Islam, A. K. M. (2014). Sources of satisfaction and dissatisfaction with a learning management system in post-adoption stage: A critical incident technique approach. Comput. Hum. Behav. 30, 249–261. doi: 10.1016/j.chb.2013.09.010

Crossref Full Text | Google Scholar

Nikolopoulou, K., Gialamas, V., and Lavidas, K. (2021). Habit, hedonic motivation, performance expectancy and technological pedagogical knowledge affect teachers’ intention to use mobile internet. Comput. Educ. Open 2:100041. doi: 10.1016/j.caeo.2021.100041

Crossref Full Text | Google Scholar

Nikou, S. A., and Economides, A. A. (2017). Mobile-based assessment: investigating the factors that influence behavioral intention to use. Comput. Educ. 109, 56–73. doi: 10.1016/j.compedu.2017.02.005

Crossref Full Text | Google Scholar

Nuraeni, C. (2021). Maximizing Mobile-assisted language learning (MALL) amid COVID-19 pandemic: teachers’ perception. Metathesis 5:11. doi: 10.31002/metathesis.v5i1.3336

Crossref Full Text | Google Scholar

Oliver, R. L. (1977). Effect of expectation and disconfirmation on postexposure product evaluations: An alternative interpretation. J. Appl. Psychol. 62, 480–486. doi: 10.1037/0021-9010.62.4.480

Crossref Full Text | Google Scholar

Oliver, R. L. (1980). A cognitive model of the antecedents and consequences of satisfaction decisions. J. Mark. Res. 17, 460–469. doi: 10.1177/002224378001700405

Crossref Full Text | Google Scholar

Patra, I., Alazemi, A., Al-Jamal, D., and Gheisari, A. (2022). The effectiveness of teachers’ written and verbal corrective feedback (CF) during formative assessment (FA) on male language learners’ academic anxiety (AA), academic performance (AP), and attitude toward learning (ATL). Lang. Test. Asia 12:19. doi: 10.1186/s40468-022-00169-2

Crossref Full Text | Google Scholar

Phetsut, P., and Waemusa, Z. (2022). Effectiveness of Mobile assisted language learning (MALL)-based intervention on developing Thai EFL learners’ Oral accuracy. Int. J. Technol. Educ. 5, 571–585. doi: 10.46328/ijte.271

Crossref Full Text | Google Scholar

Pikhart, M., and Klímová, B. (2020). eLearning 4.0 as a Sustainability Strategy for Generation Z Language Learners: Applied Linguistics of Second Language Acquisition in Younger Adults. Societies, 10, 38. doi: 10.3390/soc10020038

Crossref Full Text | Google Scholar

Pingmuang, P., and Koraneekij, P. (2022). Mobile-assisted language learning using task-based approach and gamification for enhancing writing skills in EFL students. Electron. J. e-Learn. 20, 623–638. doi: 10.34190/ejel.20.5.2339

Crossref Full Text | Google Scholar

Qashou, A. (2021). Influencing factors in M-learning adoption in higher education. Educ. Inf. Technol. 26, 1755–1785. doi: 10.1007/s10639-020-10323-z

Crossref Full Text | Google Scholar

Rahimi, M., and Miri, S. S. (2014). The impact of Mobile dictionary use on language learning. Procedia. Soc. Behav. Sci. 98, 1469–1474. doi: 10.1016/j.sbspro.2014.03.567

Crossref Full Text | Google Scholar

Sabiri, M. S., and Shah, M. I. (2023). Vocabulary and Mobile Assisted Language Learning (MALL): A Survey on ESL Undergraduate Learners of Punjab. Research Journal of Social Sciences and Economics Review, 4, 187–200. doi: 10.36902/rjsser-vol4-iss2-2023(187-200)

Crossref Full Text | Google Scholar

Sadeghi, A., and Chalak, A. (2023). Utilization of hello talk Mobile application in ameliorating Iranian EFL learners’ autonomy. Interdiscipl. Stud. Eng. Lang. Teach. 2, 171–199. doi: 10.22080/iselt.2023.25810.1055

Crossref Full Text | Google Scholar

Saeed, K. A., and Abdinnour-Helm, S. (2008). Examining the effects of information system characteristics and perceived usefulness on post adoption usage of information systems. Inf. Manag. 45, 376–386. doi: 10.1016/j.im.2008.06.002

Crossref Full Text | Google Scholar

Sakkir, G., and Syamsuddin, N. A. (2023). Students’ perceptions of Duolingo Mobile assisted language learning (MALL) in learning English vocabulary. EduLine 3, 381–388. doi: 10.35877/454RI.eduline1970

Crossref Full Text | Google Scholar

Salehan, M., and Negahban, A. (2013). Social networking on smartphones: When mobile phones become addictive. Computers in Human Behavior, 29, 2632–2639. doi: 10.1016/j.chb.2013.07.003

Crossref Full Text | Google Scholar

Seidlhofer, B. (2017). “English as a lingua Franca and Multilingualism” in Language awareness and multilingualism. eds. J. Cenoz, D. Gorter, and S. May (New York: Springer International Publishing), 391–404.

Google Scholar

Shadiev, R., Hwang, W.-Y., and Liu, T.-Y. (2018). A study of the use of wearable devices for healthy and enjoyable English as a foreign language learning in authentic contexts. J. Educ. Technol. Soc. 21, 217–231.

Google Scholar

Shams, M. S., Niazi, M. M., Gul, H., Mei, T. S., and Khan, K. U. (2022). E-learning adoption in higher education institutions during the COVID-19 pandemic: A multigroup analysis. Front. Educ. 6:783087. doi: 10.3389/feduc.2021.783087

Crossref Full Text | Google Scholar

Shiau, W.-L., and Luo, M. M. (2013). Continuance intention of blog users: the impact of perceived enjoyment, habit, user involvement and blogging time. Behav. Inform. Technol. 32, 570–583. doi: 10.1080/0144929X.2012.671851

Crossref Full Text | Google Scholar

Shortt, M., Tilak, S., Kuznetcova, I., Martens, B., and Akinkuolie, B. (2023). Gamification in mobile-assisted language learning: A systematic review of Duolingo literature from public release of 2012 to early 2020. Comput. Assist. Lang. Learn. 36, 517–554. doi: 10.1080/09588221.2021.1933540

Crossref Full Text | Google Scholar

Sica, C., and Ghisi, M. (2007). “The Italian versions of the Beck anxiety inventory and the Beck depression inventory-II: Psychometric properties and discriminant power” in Leading-edge psychological tests and testing research. ed. M. A. Lange (Hauppauge, NY: Nova Science Publishers), 27–50.

Google Scholar

Soleimani, E., Ismail, K., and Mustaffa, R. (2014). The Acceptance of Mobile Assisted Language Learning (MALL) among Post Graduate ESL Students in UKM. Procedia - Social and Behavioral Sciences, 118, 457–462. doi: 10.1016/j.sbspro.2014.02.062

Crossref Full Text | Google Scholar

Soria-Barreto, K., Ruiz-Campo, S., Al-Adwan, A. S., and Zuniga-Jara, S. (2021). University students intention to continue using online learning tools and technologies: an international comparison. Sustain. For. 13:13813. doi: 10.3390/su132413813

Crossref Full Text | Google Scholar

Sung, Y.-T., Chang, K.-E., and Yang, J.-M. (2015). How effective are mobile devices for language learning? A meta-analysis. Educ. Res. Rev. 16, 68–84. doi: 10.1016/j.edurev.2015.09.001

Crossref Full Text | Google Scholar

Taber, K. S. (2018). The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res. Sci. Educ. 48, 1273–1296. doi: 10.1007/s11165-016-9602-2

Crossref Full Text | Google Scholar

Tantiwich, K., and Sinwongsuwat, K. (2021). Thai university students’ problems of language use in English conversation. LEARN J. 14, 598–626.

Google Scholar

Traxler, J. (2004). Mobile learning – the ethical and legal challenges. Rome: LSDA.

Google Scholar

Triandis, H. C. (1979). Values, attitudes, and interpersonal behavior. Neb. Symp. Motiv. 27, 195–259.

Google Scholar

Unal, E., and Güngör, F. (2021). The continuance intention of users toward mobile assisted language learning: The case of DuoLingo. Asian J. Dist. Educ. 16, 197–218. doi: 10.5281/zenodo.5811777

Crossref Full Text | Google Scholar

Venkatesh, V., Morris, M. G., Davis, G. B., and Davis, F. D. (2003). User acceptance of information technology: toward a unified view. MIS Q. 27, 425–478. doi: 10.2307/30036540

Crossref Full Text | Google Scholar

Viberg, O., and Grönlund, Å. (2012). Mobile assisted language learning: A Literature Review. 11th World Conference on Mobile and Contextual Learning, Helsinki, Finland.

Google Scholar

Voicu, M.-C., and Muntean, M. (2023). Factors that influence Mobile learning among university students in Romania. Electronics 12:938. doi: 10.3390/electronics12040938

Crossref Full Text | Google Scholar

Watson Todd, R. (2006). The myth of the native speaker as a model of English proficiency. Reflections 8, 1–7. doi: 10.61508/refl.v8i0.114302

Crossref Full Text | Google Scholar

Wu, Q. (2015). Pulling Mobile assisted language learning (MALL) into the mainstream: MALL in broad practice. PLoS One 10:e0128762. doi: 10.1371/journal.pone.0128762

PubMed Abstract | Crossref Full Text | Google Scholar

Wu, W.-C., and Perng, Y.-H. (2016). Research on the correlations among Mobile learning perception, study habits, and continuous learning. EURASIA J. Math. Sci. Tech. Ed. 12, 1665–1673. doi: 10.12973/eurasia.2016.1556a

Crossref Full Text | Google Scholar

Yang, F., Ren, L., and Gu, C. (2022). A study of college students' intention to use metaverse technology for basketball learning based on UTAUT2. Heliyon 8:e10562. doi: 10.1016/j.heliyon.2022.e10562

PubMed Abstract | Crossref Full Text | Google Scholar

Yeh, Y.-C., and Chu, L.-H. (2018). The mediating role of self-regulation on harmonious passion, obsessive passion, and knowledge management in e-learning. Educ. Technol. Res. Dev. 66, 615–637. doi: 10.1007/s11423-017-9562-x

Crossref Full Text | Google Scholar

Yoo, D. K., and Cho, S. (2020). Role of habit and value perceptions on m-learning outcomes. J. Comput. Inf. Syst. 60, 530–540. doi: 10.1080/08874417.2018.1550731

Crossref Full Text | Google Scholar

Yousafzai, A., Chang, V., Gani, A., and Noor, R. M. (2016). Multimedia augmented m-learning: issues, trends and open challenges. Int. J. Inf. Manag. 36, 784–792. doi: 10.1016/j.ijinfomgt.2016.05.010

Crossref Full Text | Google Scholar

Zacharis, G., and Nikolopoulou, K. (2022). Factors predicting university students’ behavioral intention to use eLearning platforms in the post-pandemic normal: an UTAUT2 approach with ‘learning value’. Educ. Inf. Technol. 27, 12065–12082. doi: 10.1007/s10639-022-11116-2

PubMed Abstract | Crossref Full Text | Google Scholar

Zarei, S., and Mohammadi, S. (2022). Challenges of higher education related to e-learning in developing countries during COVID-19 spread: a review of the perspectives of students, instructors, policymakers, and ICT experts. Environ. Sci. Pollut. Res. 29, 85562–85568. doi: 10.1007/s11356-021-14647-2

PubMed Abstract | Crossref Full Text | Google Scholar

Zheng, S., and Zhou, X. (2022). Positive influence of cooperative learning and emotion regulation on EFL learners’ foreign language enjoyment. Int. J. Environ. Res. Public Health 19:12604. doi: 10.3390/ijerph191912604

PubMed Abstract | Crossref Full Text | Google Scholar

Zhigang, W., Lei, Z., and Xintao, L. (2020). Consumer response to corporate hypocrisy from the perspective of expectation confirmation theory. Front. Psychol. 11:580114. doi: 10.3389/fpsyg.2020.580114

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: mobile-assisted language learning, technology acceptance model, expectation confirmation theory, behavioral intention, English as a foreign language, Thailand, structural equation modeling

Citation: Pan L, Ye Y and Li X (2024) Factors affecting Thai EFL students’ behavioral intentions toward mobile-assisted language learning. Front. Educ. 9:1333771. doi: 10.3389/feduc.2024.1333771

Received: 10 November 2023; Accepted: 18 January 2024;
Published: 01 February 2024.

Edited by:

Anatoliy Markiv, King's College London, United Kingdom

Reviewed by:

Can Mese, Kahramanmaraş Istiklal University, Türkiye
Layla Hasan, University of Technology Malaysia, Malaysia

Copyright © 2024 Pan, Ye and Li. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Yan Ye, yan.ye@stamford.edu

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.