Skip to main content

ORIGINAL RESEARCH article

Front. Hum. Neurosci., 26 May 2022
Sec. Brain-Computer Interfaces
This article is part of the Research Topic Methods and Applications in Brain-Computer Interfaces View all 9 articles

BCI-Based Consumers' Choice Prediction From EEG Signals: An Intelligent Neuromarketing Framework

  • 1Advanced Intelligent Multidisciplinary Systems (AIMS) Lab, Institute for Advanced Research (IAR), United International University, Dhaka, Bangladesh
  • 2School of Business and Economics, United International University, Dhaka, Bangladesh
  • 3Department of Mechanical Engineering and UK Dementia Research Institute Care, Research and Technology Centre (DRI-CR&T), Imperial College London, London, United Kingdom
  • 4Institute of Business Administration, University of Dhaka, Dhaka, Bangladesh
  • 5Department of Computer Science and Engineering, University of Liberal Arts Bangladesh, Dhaka, Bangladesh
  • 6Department of Computer Science & Engineering, United International University, Dhaka, Bangladesh

Neuromarketing relies on Brain Computer Interface (BCI) technology to gain insight into how customers react to marketing stimuli. Marketers spend about $750 billion annually on traditional marketing camping. They use traditional marketing research procedures such as Personal Depth Interviews, Surveys, Focused Group Discussions, and so on, which are frequently criticized for failing to extract true consumer preferences. On the other hand, Neuromarketing promises to overcome such constraints. This work proposes a machine learning framework for predicting consumers' purchase intention (PI) and affective attitude (AA) from analyzing EEG signals. In this work, EEG signals are collected from 20 healthy participants while administering three advertising stimuli settings: product, endorsement, and promotion. After preprocessing, features are extracted in three domains (time, frequency, and time-frequency). Then, after selecting features using wrapper-based methods Recursive Feature Elimination, Support Vector Machine is used for categorizing positive and negative (AA and PI). The experimental results show that proposed framework achieves an accuracy of 84 and 87.00% for PI and AA ensuring the simulation of real-life results. In addition, AA and PI signals show N200 and N400 components when people tend to take decision after visualizing static advertisement. Moreover, negative AA signals shows more dispersion than positive AA signals. Furthermore, this work paves the way for implementing such a neuromarketing framework using consumer-grade EEG devices in a real-life setting. Therefore, it is evident that BCI-based neuromarketing technology can help brands and businesses effectively predict future consumer preferences. Hence, EEG-based neuromarketing technologies can assist brands and enterprizes in accurately forecasting future consumer preferences.

1. Introduction

Neuromarketing is a subfield of marketing research that investigates customers' cognitive and emotive responses to promoted products or services. It is an emerging multidisciplinary area that brings together neuroscience, technology, and traditional marketing. Neuromarketing uses Brain-Computer Interface (BCI) technologies to gain insight into consumers' preferences and purchase intention triggered by marketing stimuli. Furthermore, one of the main objectives of marketing professional is to present their advertisement in such a way that the intended consumer response is elicited. They spend $750 billion or more every year on marketing, promotion, and advertising to achieve this (Guttmann, 2021). Hence, there is a significant motivation to investigate opportunities for targeting the appropriate market segments and customers.

Traditional research methods rely on consumers filling out questionnaires, focus group discussion, or one-on-one interviews to determine their attitudes toward products, mostly on post-facto basis (Hulland et al., 2018). Although these approaches are simple, they oftentimes fail to reflect the true state of mind of the customers, primarily because of the limitations associated with self-reported questionnaire surveys (Rawnaque et al., 2020). Neuromarketing, on the other hand, solves these issues by focusing on capturing the in-person response by taking into account brain response. As a result, there is a need for technology-enabled autonomous prediction of consumer preferences.

In the last 20 years, researchers proposed several automatic approaches with some of these considering the neurological mechanisms that drive marketing decision-making and contribute to the rapidly expanding field of neuromarketing research. In neuromarketing studies, researchers use biometric responses such as facial expression (Filipović et al., 2020), eye tracking (Khushaba et al., 2013), functional magnetic resonance imaging (fMRI) (Hsu and Cheng, 2018), galvanic skin response (Ohira and Hirao, 2015), and electroencephalography (EEG) (Golnar-Nik et al., 2019), magnetoencephalograpy (MEG) (Hege et al., 2014) to extract customers' insights. Previously, the neuromarketing community was primarily interested in fMRI, which assesses cerebral blood flow imaging and aids in the identification of areas triggered by stimuli (Rawnaque et al., 2020). Despite the fact that this technology has a higher spatial resolution than any other currently available technology, its lack of portability, high cost, and low temporal resolution compel researchers to seek out other options. EEG and MEG, on the other hand, are technologies with a better temporal resolution than fMRI but with a lower spatial resolution (Rawnaque et al., 2020). Due to the fact that MEG devices require a shielded environment to detect the brain's very low magnetic fields, they are usually expensive. EEG technology has appealed to the neuromarketing sector as a reasonably inexpensive, well-established, and portable instrument from Krugman's original usage in 1971 (Krugman, 1971). Taken together, EEG analysis as a realistic and efficient tool can aid our understanding of the brain's decision-making processes.

In the past, EEG-based neuromarketing-related studies examined how commercial and its design could affect customers' judgement and buying behavior. Khushaba et al. (2013) used photographs of crackers to study marketing stimulus in three different shapes, tastes, and topping to create a sequence of 57 options. The participants were asked to pick their preferred set and categorize their preferences across all sets. The change in EEG spectral activity that accompanied it was then measured. Yılmaz et al. (2014) investigated shoe images in order to obtain user feedback from EEG signals in terms of dislike or like of the corresponding image. A similar strategy was utilized by Yadava et al. (2017). They used 42 photographs of items in various hues and textures. Researchers then used the Hidden Markov model classifier to extract four features from EEG and classify them. Bastiaansen et al. (2018) used photographs of Bruges tourist attractions to split the participants into two groups. One group viewed 11 min and 42 s of the film “In Bruges” before seeing the images, whereas the other (control group) saw an unrelated 9 min and 23 s movie sample. Subsequently, EEG was used to record the differences in emotional responses within these groups.

One of the most concern in marketing research is how consumers deal with diverse product options depending on their own unique perceptions of advantages and costs. The prefrontal cortex (PFC), which is located in the frontal cortex (FC) of the brain, plays a key role in the underlying processes of human decision-making. Several studies show that the parts of PFC are involved in decision-making processes by weighing the pros and cons of various options and outcomes (Tremblay and Schultz, 1999; Daw et al., 2006). People can either be attracted to or repellent to a stimulus when they interact with it. Currently, researchers are looking into brain activity signals that are linked to an increase in emotional involvement when people interact with marketing stimuli (Langleben et al., 2009; Vecchiato et al., 2010). When people experience a consumer product the blood flow of a particular part increases which is usually captured by fMRI (Telpaz et al., 2015; Rawnaque et al., 2020). Simultaneously, the electrical activity of certain part of the human brain shows distinct pattern like oscillation in frequency which is captured by EEG (Telpaz et al., 2015; Rawnaque et al., 2020). While working with EEG, researchers discovered strong links between people's behavioral systems (both positive and bad) and their consumer actions. The activity of specific anatomical areas connected to emotional processing activity in humans, such as the PFC and FC, could be tracked to gather indirect variables of emotional processing (Davidson and Irwin, 1999). The anatomically and functionally various area of PFC are well-known for its role in emotion formation (Davidson, 2000). According to EEG spectral power analyses, left PFC appears to be a significant component of a brain circuit mediating appetitive approach behavior, while the right PFC appears to be a key component of a neural circuit mediating defensive withdrawal behavior (Davidson, 2000, 2004). Measuring the activity of these regions can thus provide useful information about marketing concepts like perceived value and the brain underpinnings of customer decision-making.

In other studies, researchers used Support Vector Machine (SVM) and K-Nearest Neighbor (KNN) to quantify user preferences for aesthetics displayed as virtual three-dimensional objects, with frequency bands acting as attributes for EEG segmentation into binary classes (Agarwal and Dutta, 2015; Ramadan et al., 2015). Hakim et al. (2018) used SVM to combine EEG measurements with questionnaire responses to identify the more and the less favored parts. The type of classification system used in a BCI system is mostly determined by the application's nature and location. With the recent application of deep learning (DL) in different domain (Mashrur et al., 2019, 2021a; Nazi et al., 2021), Teo et al. (2017) showed the subjects 3D virtual jewelry objects, asked to rate them on a Likert scale, and then categorized EEG signals using deep learning. Again, Aldayel et al. (2020) emphasized the need of spectral valence features to improve prediction accuracy and the merging of classifiers using deep learning to extract features. In another work, Aldayel et al. (2021) measured preference indices to classify like and dislike signals. Authors used data from Yadava et al. (2017) which used only product as stimuli and extracted time-frequency domain features. Using these features, they calculated preference indices which was later used to train multiple machine learning and deep learning (DL) models for the classification of EEG signals. Golnar-Nik et al. (2019) employed LDA and SVM classifiers to assess how effectively EEG signals could distinguish various customer preferences and predict the occurrence of decision-making in another study. Telpaz et al. (2015) published one of the most influential research articles in the field of neuromarketing in 2015. The researchers in this study proposed that EEG may be used to forecast future customer choices based on statistical significance. However, extant literature indicates that, there is hardly any validated and significantly accurate ML framework predicting consumer purchase intention from EEG signals. Moreover, EEG-based research on consumers' affective attitude toward advertising stimuli is almost non-existent in current literature. Therefore, in this study, we propose a ML framework for predicting consumer future choices by linking affective attitude (AA) and purchase intention (PI) from EEG signals.

Firstly, we collect EEG signals from the participants while they view three types of advertisements with three different dominant features: one focused on product features; one centered on endorsement and one centered on promotion or offers. After preprocessing, we extract features from the signals. Afterward, using feature selection techniques, we classify the EEG signals into positive and negative for both AA and PI using SVM-RBF classifier. It should be noted that as previous works only focused on only product stimuli (Telpaz et al., 2015; Yadava et al., 2017; Aldayel et al., 2021), we want to propose a more robust and generalize machine learning framework that can recognize beyond only product. Here, our main focus was to find EEG pattern of the participants for these combined heterogeneous stimuli setting. Therefore, we added endorsement and promotion which we are implementing for very first time. Taken together, we are using product, product + endorsement, and product + promotion to increase the generalizability of the proposed machine learning (ML) framework. Consequently, we combine these stimuli and treat as same while classifying of positive and negative AA and PI. as positive AA (PAA), negative AA (NAA), positive PI (PPI), and negative PI (NPI). The major contributions of this work are listed below.

As previous world only used product image as stimuli,

• To the best of authors' knowledge, this is most likely the first study that propose ML framework for predicting consumers' purchase intention and affective attitude (toward advertising stimuli) from EEG signals.

• We show the EEG signals differences between positive and negative response (AA and PI). In addition, we also report EEG signals differences among the advertising stimuli.

• A thorough experimental evaluation (hyperparameter tuning) is carried out to establish the feasibility of the proposed method.

• We also suggest consumer grade device to implement such Neuromarketing framework in real life setting.

2. Materials

This section discusses the research participants, stimuli, and data collection description.

2.1. Participants

Twenty healthy young volunteers (age: 24 ± 7.2) participated in this study with no history of neurological or mental disorders. Before the study, According to the Helsinki Declaration and Neuromarketing Science and Business Association Code of Ethics (NMSBA), all participants provided their consent. The study is also approved by the United International University, Institutional Research Ethics Board committee.

2.2. Stimuli Description

We use five different items in this research, each with its endorsement and promotion-based (offers) advertisement. A product endorsement is a tool in marketing communication that has a positive effect on customers. In the vast majority of cases, celebrities promote a product in a real-world setting. Nevertheless, in order to avoid biasing the participants, we use neutral endorsement in our research. On the other hand, sales promotion is a technique used by marketers where they give discounts, cashback or any other monetary offers so that the customers are attracted to buy the product. In our case, we offer a buy one get one free or a 50% discount with that product. The stimuli are shown in Figure 2, where each row represents a different product: burgers, sunglasses, cake, hats, and coats. The baseline products are in the first column, endorsements are in the second column, and promotion stimuli are in the third column for each product.

2.3. Data Collection

The data collection process is separated into three stages which are inspired by Levy et al. (2011) and Telpaz et al. (2015). In stage 1, the experimenter briefs the participants about the stimuli so that they will be at ease when watching them on screen. We do not show actual stimuli to the participants before the experiments, rather experimenters describe the promotion and endorsement beforehand using a different image that is not used as stimuli. This makes sure the participants watch the stimuli for the first time while collecting EEG signals. In the second stage, participants sit comfortably in front of a monitor that displays the stimuli at a 75–100 cm distance. Then, We set the Emotiv Epoch+ headset (electrode position illustrated in Figure 1) in the participant's head and ensure the electrode conduction is good enough to collect EEG data. After that, we use PsychoPy v3.0 (Peirce, 2007) to show the stimulus to the participants and collect EEG data simultaneously. The sampling rate of EEG signals is 128 Hz. We use six frontal channels for this work because previous studies suggest better performance with FC (Rawnaque et al., 2020; Mashrur et al., 2021b). Illustrated in Figure 3. Throughout the trial, each product was presented for 5 s, followed by an endorsement or promotion. Moreover, before showing each stimulus a black screen is shown with a white plus sign in the middle to keep the focus of the participants on the screen. In stage 3, we gave the participants a questionnaire in which each stimulus is accompanied by the following statements: 1. I would be happy to have x and 2. If given the opportunity, I am willing to buy x. The first question is demonstrating the affective attitude and the second one is purchase intention. Participants respond on a numeric scale of 1–10 (strongly disagree to strongly agree), which was later converted into: negative (1–5) and positive (6–10).

FIGURE 1
www.frontiersin.org

Figure 1. Electrode positioning of EMotiv epoch+ device.

FIGURE 2
www.frontiersin.org

Figure 2. Stimuli used in our experimental setup, with the first column representing the baseline product, the second column depicting endorsement stimuli, and the last column representing promotion stimuli.

FIGURE 3
www.frontiersin.org

Figure 3. The stimuli sequence while we collect the EEG data from participants. To begin, the participants are shown a blank screen to aid in visual stability. Then, it shows a set of stimuli for a specific product at random intervals (first a product, then its endorsement, or promotion). Note that before showing each stimulus a black screen is shown with a white plus sign in the middle to keep the focus of the participants on the screen.

3. Methods

The workflow of our proposed algorithm is illustrated in Figure 4. At first, we preprocess the raw EEG signals to eliminate the noise and then segment the data. Next, we extract features from signals. After that, the best features are selected to classify positive and negative AA and PI using SVM. The following notation is used throughout this paper: The dataset Y = [y1, y2, ..., yN], where N is the number of participants. For any participant YN, the segmented time series vector for one electrode is X(t)∈RT, where T represents the number of samples in time. Again, the feature matrix is denoted by F = [f1, f2, ..., ft], where ft is the vector (all samples) for a feature and t is the total number of features.

FIGURE 4
www.frontiersin.org

Figure 4. Illustration of the workflow of our proposed pipeline. At first, we preprocess the raw EEG signals to eliminate the noise and prepare the signals. Then three types of features, namely, time, frequency, and time-frequency domain features are extracted. Then, wrapper-based Support Vector Machine-Recursive Feature Elimination (SVM-RFE) along with correlation bias reduction is used for feature selection. Lastly, we use SVM with radial basis function (RBF) kernel for categorizing positive affective attitude and negative affective attitude.

3.1. Pre-processing

Both customized scripts in MATLAB 2020a (MathWorks, Natick, MA) and EEGLAB (Delorme and Makeig, 2004) are used to preprocess EEG signals. YN is first normalized by subtracting the mean from all sample points and dividing each point by the standard deviation. The power line noise is then removed using a notch filter (50 Hz). The signals are then filtered using a third-order Butterworth bandpass filter with a frequency range of 0.5–48 Hz to remove high and low-frequency noise. Furthermore, Independent component analysis (ICA) (Hyvärinen and Oja, 2000) is used to distinguish the source of the signals and eliminate noise such as eye blink, electrocardiogram, muscle movement, and line noise. Finally, YN are segmented and averaged (participants wise), resulting in our structured X(t) time series vector.

3.2. Feature Extraction

This subsection describes the extracted features for this study, categorized by: time domain, frequency domain, and time-frequency domain features similar as Mamun et al. (2015). Table 1 shows the feature list used in this work. According to the literature (Section 1) PFC and FC are mostly responsible for AA and PI (Davidson and Irwin, 1999; Davidson, 2000, 2004; Ramsøy et al., 2018). Therefore, we extract feature from FC in this work. When people watch a stimulus neurons within a certain brain become active and pass a small electric current which can be detected placing a sensor on the human scalp (Luck, 2014). Again, according to Davidson (2000) active area of the FC varies with corresponding neuromarketing stimuli. According to the extent literature, for the first time, we use ML based neuromarketing work that uses endorsement and promotion as stimuli. Therefore, we use a diverse feature set to capture any changes in the electrical signal of the brain. So, this work represents those features that captures distinct firing pattern from EEG signals. Previously, the power and some statistical features were widely used in Neuromarketing works (Golnar-Nik et al., 2019; Yadava et al., 2017). Along with these, we increased the feature set to capture more subtle changes in the EEG for the mixed stimuli setting. From f1 to f11, we use statistical and power features that were before for EEG signals pattern recognition (Inuso et al., 2007; Islam et al., 2013; Ahammad et al., 2014; Jenke et al., 2014; Golnar-Nik et al., 2019). Moreover, this study finds dispersion to be prominent feature for Neuromarketing, therefore we use features from f12 to f20. In addition, literature shows that, frequency band oscillation and spectral changes are significant while measuring EEG for decision making, attention, and consumer choice, consequently, we also used diverse spectral feature for this study (Foxe and Snyder, 2011; Nácher et al., 2013; Telpaz et al., 2015; Mashrur et al., 2021b).

TABLE 1
www.frontiersin.org

Table 1. List of base features used in this work.

3.2.1. Time Domain Features (TDFs)

TDFs are calculated from X(t) decomposed in time domain. Here, as mentioned in Table 1, feature index f1 to f20 are used as TDFs.

3.2.2. Frequency Domain Features (FDFs)

FDFs are extracted to find changes in the frequency domain of X(t). In this work, we estimate spectral features (SFs) described in Table 1 as feature index f21 to f29. In this study, the average value of the SFs obtained with MATLAB 2020a. Despite their ubiquitous usage in speech and audio signal classification, SFs have recently been used for EEG signal categorization (Hassan and Subasi, 2016; Rashid et al., 2018). SFs record the amplitude spectrum of EEG data, which gives discriminating information between classes.

3.2.3. Time-Frequency Domain Features (TFDFs)

EEG signals are complicated in that they have qualities in both the temporal and frequency domains. EEG signals are split into six bands in this work utilizing wavelet packet transformation (WPT), which may recover frequency information without leaving the temporal domain. In the literature, WPT has been routinely utilized to distinguish frequency bands from EEG data (Wali et al., 2013; Vidyaratne and Iftekharuddin, 2017; Phanikrishna and Chinara, 2021).

3.2.3.1. WPT

The signal is decomposed by WPT into both detailed and approximate coefficients. The extracted coefficients up to a defined level could be considered as features because their values are dependent on the time and frequency domain characteristics of the EEG signals. WPT creates a subspace tree of a signal with distinct frequency characteristics by recursively applying high-pass and low-pass filters (Percival and Walden, 2000). Let, a,b(k),n=0,..,2a-1, denote the WPT coefficients at level a. The wavelet packet coefficients are then computed using the two wavelet packet orthogonal bases equations:

a,2b(i)=l=0L-1H(s)a-1,b(2k+1-lmodNb-1)    (1)
a,2b+1(i)=l=0L-1G(s)a-1,b(2k+1-lmodNb-1)    (2)

Where H(s) and G(s) are the impulse responses which are highpass and lowpass filters of the wavelet packets respectively and i = 1…N and Nb = N/2b (Percival and Walden, 2000). Here, we use Meyer wavelet for computing the sub-bands as it showed better performance in previous work (Mamun, 2011) using EEG signals.

To extract TFDFs, X(t) is decomposed in five levels extracting six bands, namely, δ = 0−4Hz, θ = 4−8Hz, α = 8−12Hz, β1 = 12−20Hz, β2 = 20−32Hz, γ = 32−64Hz. Then all the features, as mentioned in Table 1, were extracted from each band, with a total of 246 features. Again, as power features performed well in the literature (Golnar-Nik et al., 2019), ratio of average and relative power also calculated as separate features. The ratios are: θδ,αδ,β1δ,β2δ,γδ,αθ,β1θ,β2θ,γθ,βα, β2α,γα,β2β1,γβ1,γβ2.

3.3. Feature Selection and Classification

To select the best feature set, we use wrapper-based Support Vector Machine-Recursive Feature Elimination (SVM-RFE) with correlation bias reduction (CBR) (Yan and Zhang, 2015). Initially, Guyon et al. (2002) propose SVM-RFE which evaluates features using criteria derived from SVM model coefficients, then recursively eliminates features with small criteria. This method can be used in both linear and nonlinear situations (Guyon et al., 2002; Rakotomamonjy, 2003). When the optimal decision function is nonlinear, the nonlinear SVM-RFE approach is preferred since it incorporates a novel kernel method. We also employed a non-linear variant with a radial basis function (RBF) as the kernel in our research. For its backward elimination method, SVM-RFE may represent feature dependencies. SVM-RFE does not use cross-validation (cv) accuracy on the training data as a selection criterion, which means it is less prone to overfitting, can fully utilize the training data, and has a substantially shorter execution time, especially when there are a high number of candidate features. As a result, it's been applied to a range of problems, such as gene selection (Guyon et al., 2002; Rakotomamonjy, 2003; Duan et al., 2005; Mundra and Rajapakse, 2009). However, when some of the features are highly associated, the assessing criteria of these features would be altered by underestimating their value. To address this, inspired by Toloşi and Lengauer (2011) and Yan and Zhang (2015) suggested a robust technique, SVM-RFE + CBR, for estimating gas sensor characteristics.

In this work, SVM is used for classification. The SVM identifies the appropriate boundary in the feature space where the model is trained using the structural risk reduction criterion by combining a maximal margin approach with a kernel method (Gunn et al., 1998; Hart et al., 2000). SVM utilizes a kernel function to translate the inputs into a high-dimensional feature space, whereas learning derives the decision boundaries directly from the training data set. Then, it constructs an optimal separation hyperplane in the feature space. The choice of an appropriate kernel function is crucial for optimizing SVM classifier performance (Gunn et al., 1998). We use RBF kernel for it's better performance earlier research based on EEG signals (Li et al., 2014; Zainuddin et al., 2018; Anuragi and Sisodia, 2019). To increase classification performance, an SVM classifier's hyper-parameters, notably the regularization parameter C and the gamma, are tuned during training as demonstrated most efficient and accurate in Hsu et al. (2003). We utilize the LIBSVM (Chang and Lin, 2011) function to classify our work. In addition, we use other classifiers too namely, Naive Bayes, Decision tree, K-Nearest Neighbor (Bonaccorso, 2017).

3.4. Metrics for Assessing Performance

In order to access the performance of our proposed pipeline, several metrics, namely, accuracy (Acc.), sensitivity (Sens.), and specificity (Spec.).

Sens=TPTP+FN    (3)
Spec=TNTN+FP    (4)
ACC=TP+TNTP+TN+FN+FP    (5)

where FP, FN, TP, and TN are the number of false positives, false negatives, true positives, and true negatives, respectively. We report the mean value of the metrices. The Shapiro-Wilk test is used to determine the normality of the data. Moreover, we use Wilcoxon Signed-Ranked Test for non parametric hypothesis testing. Again, Friedman test is used for matched, non parametric data to find differences among advertisements.

4. Results

This section represents the results obtained by the proposed model. We report the performance of channel pairs for both PI and AA. In addition, We present the report the dispersion differences between PAA and NAA. Furthermore, we report the most contributing feature domain and EEG bands while classifying the signals.

In this work, we use leave-one-subject-out(LOSO) evaluation techniques where the features are separated in 20 as the total number of subjects is 20. Every subject is used for the test set only once, while the rest is used as the training set.

Figure 5A illustrates the grand average of positive AA and negative AA in the time domain for AF3 channel. Similarly, Figure 5B also illustrates the same for PI. It is evident that negative and positive signals have N200 to N400 components respectively. Moreover, to test dispersion of negative and positive signals, a Wilcoxon Signed-Ranked Test (WSRT) indicates that the standard deviation of NAA is significantly higher than the standard deviation of PAA Z = 133, p = 0.0006. However, WSRT does not find dispersion between NPI and PPI.

FIGURE 5
www.frontiersin.org

Figure 5. Example of grand average 5 s EEG signals in time domain for AF3 channel. It is evident that negative (red) signals have higher dispersion than positive (green). (A) AA. (B) PI.

Figure 6 illustrates the average of EEG signals of product, endorsement, and promotion: Figure 6A (PAA), Figure 6B (NAA), Figure 6C (PPI), and Figure 6D (NPI). It is also evident from the PAA and PPI (Figures 6A,C) have less dispersion than NAA and NPI (Figures 6B,D) similar to Figure 5. Moreover, for NAA and NPI (Figures 6B,D), three advertising stimuli showed different EEG signatures (around 1.5–4.0 s). For endorsement, there is a negative peak and for promotion, there is a positive peak. However, the product shows neutrality in the signals.

FIGURE 6
www.frontiersin.org

Figure 6. Illustration of the average of EEG signals of product, endorsement, and promotion. (A) PAA, (B) NAA, (C) PPI, (D) NPI.

Again, in Table 2, we report the performance of our proposed model for four combinations. We take the first three symmetrical channels as pairs from EEG montage, namely AF3+AF4, F3+F4, and F7+F8. The fourth combination is all FC channels (combination of three pairs). The combination of all channels gives the best results of accuracy 84.00 and 87.00% for PI and AA, respectively. In addition, among three pairs F3+F4 performs the best with an accuracy of 81.50 and 85.50% for PI and AA, respectively. For all the combinations, sensitivity is higher than specificity meaning that the true positive is high in our proposed framework. We also use other classification methods for all FC channels. Naive Bayes, Decision Tree, K-Nearest Neighbors yields 67.14, 70.24, 72.14% for PI and 70.78, 72.62, 73.33% for AA, respectively.

TABLE 2
www.frontiersin.org

Table 2. Performance of our proposed framework.

Again, Figure 7 depicts the accuracy with respect to the number of features. Here, we present the same combination of channels reported in Table 2. It is evident that the performance of the model improves with the number of features. However, for AA the experimented total number of features is 45 as the increasing features more than that leads to poor performance. Again, for PI we report the highest 40 features as the performance stabilized around 35 features.

FIGURE 7
www.frontiersin.org

Figure 7. Performance of the proposed model with number of features. Here, for channel combination best results are started (*) marked with respective color vertical to number of features. (A) AA. (B) PI.

We also evaluate the difference of AA and PI among three advertisements, namely, product, endorsement, and promotion for both reported (reported outcome from the participant) and predicted (the outcome we get from our proposed framework). Friedman test of differences among repeated measures (reported outcome of three advertisements for AA) is conducted which yield a Chi-square value of 20.86 which was significant (P < 0.0001). The exact same test for predicted outcome result a Chi-square value of 12.50 which was significant (P = 0.0019). Again, for PI, Friedman test for reported outcome give a result of Chi-square value of 15.92 which was significant (P = 0.0003). Moreover, for predicted outcome the Chi-square value of 6.75 which was significant (P = 0.0343).

Again, Figure 8 depicts the percentage of features(domain wise) for best results reported in Table 2 for both AA and PI. Here, time-frequency domain features dominate the most significant features in the classification task. Again, we also illustrate the percentage of time-frequency domain features for six bands. Here, it can be seen that theta (θ) band mostly dominates followed by delta (δ), beta2 (β1), and beta1(β2) bands.

FIGURE 8
www.frontiersin.org

Figure 8. (A,C) Illustrate the percentage of features(domain wise) for working results reported in Table 2. (B,D) Illustrate the percentage of time-frequency domain features (band wise) for best results reported in Table 2.

5. Discussion

In this study, we demonstrate a framework to classify consumer choice from EEG signals. This is the initial work that predicts the purchase intention (PI) using the ML framework. In addition, this is most likely the first research adopting advertising stimuli as affective attitude (AA) prediction.

For the first time, we proposed that NAA has higher EEG signals dispersion than PAA which is illustrated in Figure 5. In addition, Figure 6 depicts that positive AA and PI (Figures 6A,C) have less dispersion than negative AA and PI (Figures 6B,D). Moreover, from Figure 5, it is evident that EEG signals show a negative peak after watching advertising stimuli. It should be mentioned that both NAA and NPI have the peak in N200 where the PAA and PPI show the peak in N400 which is aligned with previous works (Telpaz et al., 2015). Taken together, this indicates that subjects tend to decide NAA and NPI faster than PAA and PPI. Then, after taking the decisions subjects still think or revisit their decision about the negative attitude toward particular products which makes the EEG signals more dispersed than a positive attitude.

Moreover, to the best of authors knowledge, for the first time, we use time, frequency, and time-frequency domain features for the ML framework for the Neuromarketing application. It is evident from Figures 8A,B that subjects' EEG signals are most susceptible to the time-frequency domain which indicates that while choosing a product EEG signals shift among bands. Again, Figures 8B,D refer that θ band is the most significant TFDFs for both AA and PI as supported by previous studies (Telpaz et al., 2015; Rawnaque et al., 2020; Mashrur et al., 2021b). Interestingly, δ band is the second most used feature and for the first which is an unique finding in context of Neuromarketing research. According to a previous study, δ band is responsible for decision-making (Nácher et al., 2013) which may explain the significance of δ band in our study. Further study is needed to explore this band's importance.

Our methods improve the level of generalization by increasing the number of subjects along with rigorous hyperparameter tuning with the SVM RBF kernel. We chose wrapper-based SVM-RFE with CBR which uses an SVM classifier while selecting the best set of features. This method removes the highly correlated features first and then ranks the features based on the SVM-RBF kernel. We tune the α and C parameters in the kernel to find the best working models using the LOSO evaluation technique. As the feature selection is wrapper-based, this uses a classifier while selecting the feature set. We also use other classifiers such as Naive Bayes, Decision Tree, K-Nearest Neighbors which yield the accuracy of both AA and PI around 67–73% which is compared low compared to current results. Taken together, our model ensures a robust classification that works best with the SVM-RBF kernel classifier.

Our proposed framework also simulates the real-life results which are proved by significant results in the ANOVA test (Friedman test). At first, we test the reported results for three advertisements for both AA and PI which give significantly different results. Afterward, we perform the same with the predicted results and it is also yielding significant results.

Again, according to Figures 6B,D, NAA and NPI show that promotion stimuli trigger a positive peak around 1.5 and 4 s while endorsement stimuli trigger a negative peak. However, for product stimuli the EEG signals do not show any peak. This can be explained by promotion having a 50% off which creates the positive peak and endorsers bring the negative peak. Note that, PAA and PPI do not show any kind of peak for advertising differentiation. For additional investigation, a future study with simultaneous eye tracking is required.

Lastly, this work paves the way for implementing such a neuromarketing framework using consumer-grade EEG devices (CEEGDs) in a real-life setting. The most commonly used CEEGDs (provided channel/s) are Emotiv Insight (AF3, AF4, Pz, T7, T8), Neurosky Mindwave 2 (Fp1), Muse 2 (AF7, AF8), FocusCalm (FpZ). According to our result, Emotiv Insight can be a good choice for practical application as this gives comparatively better performance. Though due to our device limitation (Emotive epoch + does not has FpZ channel), we are not able to measure the performance of the channel FpZ, Focus Calm can be an interesting choice for future researchers to explore it's potential. Based on the search for available devices in the market, no CEEGDs offer F3, F4 channels. An integration of these channels in CEEGDs will improve their performances as supported by the findings of our research. Nevertheless, the performance will be largely dependent on the sensors of each device and the quality of the raw EEG signals.

6. Conclusion

This research presents a comprehensive machine learning framework to classify EEG signals based on consumers' future choices: affective attitude and purchase intention. We also propose that a negative attitude has higher dispersion and faster response. In addition, TFDFs have mostly used features in our proposed framework. Moreover, the proposed model is also able to replicate real-life reported results. In the future, researchers can work on different types of endorsements such as neutral endorsement and celebrity endorsement. Participants in this study are limited to young adult subjects considering them as target consumers of the marketing stimuli. In future, a more diverse subject group may be included alongside different intervals of purchase like daily required products, weekly or monthly, and product-groups like fresh, stationery, home or office appliances, etc. The future researchers may also add more features and fine-tune the classifier to improve the single-channel performance. Lastly, it is evident that neuromarketing is efficient in forecasting consumer preferences and behaviors.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by Institutional Research Ethics Board, United International University. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

KM, FM, KR, MM, FS, RV, and SA contributed to conception and design of the study. KR, MM, and KM revised the draft of the manuscript. FM performed the formal analysis and illustration and wrote the first draft of the manuscript. KM supervised and administered the project. All authors contributed to manuscript revision, read, and approved the submitted version.

Funding

This study was funded by Market-Brain: A Neuromarketing System for Advanced Market Research Project Under ICT innovation Fund, ICT Division, MoPTIT, GOB, Project Code No. 1280101-120008431-3631108 and Institute for Advanced Research, United International University, Bangladesh (Code: IAR/01/19/SE/10).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Agarwal, S., and Dutta, T. (2015). Neuromarketing and consumer neuroscience: current understanding and the way forward. Decision 42, 457–462. doi: 10.1007/s40622-015-0113-1

CrossRef Full Text | Google Scholar

Ahammad, N., Fathima, T., and Joseph, P. (2014). Detection of epileptic seizure event and onset using EEG. BioMed Res. Int. 2014, 450573. doi: 10.1155/2014/450573

PubMed Abstract | CrossRef Full Text | Google Scholar

Aldayel, M., Ykhlef, M., and Al-Nafjan, A. (2020). Deep learning for eeg-based preference classification in neuromarketing. Appl. Sci. 10, 1525. doi: 10.3390/app10041525

PubMed Abstract | CrossRef Full Text | Google Scholar

Aldayel, M., Ykhlef, M., and Al-Nafjan, A. (2021). Recognition of consumer preference by analysis and classification EEG signals. Front. Hum. Neurosci. 2020, 604639. doi: 10.3389/fnhum.2020.604639

PubMed Abstract | CrossRef Full Text | Google Scholar

Anuragi, A., and Sisodia, D. S. (2019). Alcohol use disorder detection using EEG signal features and flexible analytical wavelet transform. Biomed. Signal Process. Control 52, 384–393. doi: 10.1016/j.bspc.2018.10.017

CrossRef Full Text | Google Scholar

Bastiaansen, M., Straatman, S., Driessen, E., Mitas, O., Stekelenburg, J., and Wang, L. (2018). My destination in your brain: a novel neuromarketing approach for evaluating the effectiveness of destination marketing. J. Destin. Mark. Manage. 7, 76–88. doi: 10.1016/j.jdmm.2016.09.003

CrossRef Full Text | Google Scholar

Bonaccorso, G. (2017). Machine Learning Algorithms. Birmingham: Packt Publishing Ltd.

Google Scholar

Chang, C.-C., and Lin, C.-J. (2011). LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2, 1–27. doi: 10.1145/1961189.1961199

CrossRef Full Text | Google Scholar

Davidson, R. J. (2000). Affective style, psychopathology, and resilience: brain mechanisms and plasticity. Am. Psychol. 55, 1196. doi: 10.1037/0003-066X.55.11.1196

PubMed Abstract | CrossRef Full Text | Google Scholar

Davidson, R. J. (2004). What does the prefrontal cortex “do” in affect: perspectives on frontal EEG asymmetry research. Biol. Psychol. 67, 219–234. doi: 10.1016/j.biopsycho.2004.03.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Davidson, R. J., and Irwin, W. (1999). The functional neuroanatomy of emotion and affective style. Trends Cogn. Sci. 3, 11–21. doi: 10.1016/S1364-6613(98)01265-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Daw, N. D., O'doherty, J. P., Dayan, P., Seymour, B., and Dolan, R. J. (2006). Cortical substrates for exploratory decisions in humans. Nature 441, 876–879. doi: 10.1038/nature04766

PubMed Abstract | CrossRef Full Text | Google Scholar

Delorme, A., and Makeig, S. (2004). EEGlab: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009

PubMed Abstract | CrossRef Full Text | Google Scholar

Duan, K.-B., Rajapakse, J. C., Wang, H., and Azuaje, F. (2005). Multiple SVM-RFE for gene selection in cancer classification with expression data. IEEE Trans. Nanobiosci. 4, 228–234. doi: 10.1109/TNB.2005.853657

PubMed Abstract | CrossRef Full Text | Google Scholar

Filipović, F., Baljak, L., Naumović, T., Labus, A., and Bogdanović, Z. (2020). “Developing a web application for recognizing emotions in neuromarketing,” in Marketing and Smart Technologies, eds Á. Rocha, J. L. Reis, M. K. Peter and Z. Bogdanović (Maia: Springer), 297–308. doi: 10.1007/978-981-15-1564-4_28

CrossRef Full Text | Google Scholar

Foxe, J. J., and Snyder, A. C. (2011). The role of alpha-band brain oscillations as a sensory suppression mechanism during selective attention. Front. Psychol. 2, 154. doi: 10.3389/fpsyg.2011.00154

PubMed Abstract | CrossRef Full Text | Google Scholar

Golnar-Nik, P., Farashi, S., and Safari, M.-S. (2019). The application of EEG power for the prediction and interpretation of consumer decision-making: a neuromarketing study. Physiol. Behav. 207, 90–98. doi: 10.1016/j.physbeh.2019.04.025

PubMed Abstract | CrossRef Full Text | Google Scholar

Gunn, S. R. (1998). Support vector machines for classification and regression. ISIS Techn. Rep. 14, 5–16.

Google Scholar

Guttmann, A. (2021). Global Advertising Revenue. Available online at: https://www.statista.com/statistics/236943/global-advertising-spending/ (accessed March 1, 2022).

Google Scholar

Guyon, I., Weston, J., Barnhill, S., and Vapnik, V. (2002). Gene selection for cancer classification using support vector machines. Mach. Learn. 46, 389–422. doi: 10.1023/A:1012487302797

CrossRef Full Text | Google Scholar

Hakim, A., Klorfeld, S., Sela, T., Friedman, D., Shabat-Simon, M., and Levy, D. J. (2018). Pathways to consumers minds: using machine learning and multiple EEG metrics to increase preference prediction above and beyond traditional measurements. bioRxiv 2018, 317073. doi: 10.1101/317073

CrossRef Full Text | Google Scholar

Hart, P. E., Stork, D. G., and Duda, R. O. (2000). Pattern Classification. New York, NY: Wiley Hoboken.

Google Scholar

Hassan, A. R., and Subasi, A. (2016). Automatic identification of epileptic seizures from EEG signals using linear programming boosting. Comput. Methods Prog. Biomed. 136, 65–77. doi: 10.1016/j.cmpb.2016.08.013

PubMed Abstract | CrossRef Full Text | Google Scholar

Hege, M. A., Preissl, H., and Stingl, K. T. (2014). Magnetoencephalographic signatures of right prefrontal cortex involvement in response inhibition. Hum. Brain Mapp. 35, 5236–5248. doi: 10.1002/hbm.22546

PubMed Abstract | CrossRef Full Text | Google Scholar

Hsu, C. W., Chang, C. C., and Lin, C. J. (2003). A practical guide to support vector classification. Taipei: Department of Computer Science, National Taiwan University, 1–16.

Google Scholar

Hsu, M. Y.-T., and Cheng, J. M.-S. (2018). fMRI neuromarketing and consumer learning theory: Word-of-mouth effectiveness after product harm crisis. Eur. J. Mark. 52, 199–223. doi: 10.1108/EJM-12-2016-0866

CrossRef Full Text | Google Scholar

Hulland, J., Baumgartner, H., and Smith, K. M. (2018). Marketing survey research best practices: evidence and recommendations from a review of JAMS articles. J. Acad. Mark. Sci. 46, 92–108. doi: 10.1007/s11747-017-0532-y

CrossRef Full Text | Google Scholar

Hyvärinen, A., and Oja, E. (2000). Independent component analysis: algorithms and applications. Neural Netw. 13, 411–430. doi: 10.1016/S0893-6080(00)00026-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Inuso, G., La Foresta, F., Mammone, N., and Morabito, F. C. (2007). “Brain activity investigation by EEG processing: wavelet analysis, kurtosis and Renyi's entropy for artifact detection,” in 2007 International Conference on Information Acquisition (Seogwipo), 195–200. doi: 10.1109/ICIA.2007.4295725

CrossRef Full Text | Google Scholar

Islam, M., Ahmed, T., Mostafa, S. S., Yusuf, M. S. U., and Ahmad, M. (2013). “Human emotion recognition using frequency & statistical measures of EEG signal,” in 2013 International Conference on Informatics, Electronics and Vision (ICIEV) (Dhaka), 1–6. doi: 10.1109/ICIEV.2013.6572658

CrossRef Full Text | Google Scholar

Jenke, R., Peer, A., and Buss, M. (2014). Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5, 327–339. doi: 10.1109/TAFFC.2014.2339834

CrossRef Full Text | Google Scholar

Johnston, J. D. (1988). Transform coding of audio signals using perceptual noise criteria. IEEE J. Select. Areas Commun. 6, 314–323. doi: 10.1109/49.608

CrossRef Full Text | Google Scholar

Khushaba, R. N., Wise, C., Kodagoda, S., Louviere, J., Kahn, B. E., and Townsend, C. (2013). Consumer neuroscience: assessing the brain response to marketing stimuli using electroencephalogram (EEG) and eye tracking. Expert Syst. Appl. 40, 3803–3812. doi: 10.1016/j.eswa.2012.12.095

CrossRef Full Text | Google Scholar

Krugman, H. E. (1971). Brain wave measures of media involvement. J. Advert. Res. 11, 3–9.

Google Scholar

Langleben, D. D., Loughead, J. W., Ruparel, K., Hakun, J. G., Busch-Winokur, S., Holloway, M. B., et al. (2009). Reduced prefrontal and temporal processing and recall of high ”sensation value” ads. Neuroimage 46, 219–225. doi: 10.1016/j.neuroimage.2008.12.062

PubMed Abstract | CrossRef Full Text | Google Scholar

Levy, I., Lazzaro, S. C., Rutledge, R. B., and Glimcher, P. W. (2011). Choice from non-choice: predicting consumer preferences from blood oxygenation level-dependent signals obtained during passive viewing. J. Neurosci. 31, 118–125. doi: 10.1523/JNEUROSCI.3214-10.2011

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, X., Chen, X., Yan, Y., Wei, W., and Wang, Z. J. (2014). Classification of EEG signals using a multiple kernel learning support vector machine. Sensors 14, 12784–12802. doi: 10.3390/s140712784

PubMed Abstract | CrossRef Full Text | Google Scholar

Luck, S. J. (2014). An Introduction to the Event-Related Potential Technique. Cambridge, MA: MIT Press.

Google Scholar

Mamun, K. A., Steele, C. M., and Chau, T. (2015). Swallowing accelerometry signal feature variations with sensor displacement. Med. Eng. Phys. 37, 665–673. doi: 10.1016/j.medengphy.2015.04.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Mamun, K. A. E. A. (2011). “Decoding movement and laterality from local field potentials in the subthalamic nucleus,” in 2011 5th International IEEE/EMBS Conference on Neural Engineering (Cancun), 128–131. doi: 10.1109/NER.2011.5910505

CrossRef Full Text | Google Scholar

Mashrur, F. R., Islam, M. S., Saha, D. K., Islam, S. R., and Moni, M. A. (2021a). SCNN: scalogram-based convolutional neural network to detect obstructive sleep apnea using single-lead electrocardiogram signals. Comput. Biol. Med. 2021, 104532. doi: 10.1016/j.compbiomed.2021.104532

PubMed Abstract | CrossRef Full Text | Google Scholar

Mashrur, F. R., Miya, M. T. I., Rawnaque, F. S., Rahman, K. M., Vaidyanathan, R., Anwar, S. F., et al. (2021b). “Marketbrain: an EEG based intelligent consumer preference prediction system,” in 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC) (Mexico), 808–811. doi: 10.1109/EMBC46164.2021.9629841

PubMed Abstract | CrossRef Full Text | Google Scholar

Mashrur, F. R., Roy, A. D., and Saha, D. K. (2019). “Automatic identification of arrhythmia from ECG using alexnet convolutional neural network,” in 2019 4th International Conference on Electrical Information and Communication Technology (EICT) (Khulna), 1–5. doi: 10.1109/EICT48899.2019.9068806

PubMed Abstract | CrossRef Full Text | Google Scholar

Misra, H., Ikbal, S., Bourlard, H., and Hermansky, H. (2004). “Spectral entropy based feature for robust ASR,” in 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 1 (Montreal, QC), I–193. doi: 10.1109/ICASSP.2004.1325955

CrossRef Full Text | Google Scholar

Mundra, P. A., and Rajapakse, J. C. (2009). SVM-RFE with MRMR filter for gene selection. IEEE Trans. Nanobiosci. 9, 31–37. doi: 10.1109/TNB.2009.2035284

PubMed Abstract | CrossRef Full Text | Google Scholar

Nácher, V., Ledberg, A., Deco, G., and Romo, R. (2013). Coherent delta-band oscillations between cortical areas correlate with decision making. Proc. Natl. Acad. Sci. U.S.A. 110, 15085–15090. doi: 10.1073/pnas.1314681110

PubMed Abstract | CrossRef Full Text | Google Scholar

Nazi, Z. A., Mashrur, F. R., Islam, M. A., and Saha, S. (2021). Fibro-CoSANet: pulmonary fibrosis prognosis prediction using a convolutional self attention network. Phys. Med. Biol. 66, 225013. doi: 10.1088/1361-6560/ac36a2

PubMed Abstract | CrossRef Full Text | Google Scholar

Ohira, H., and Hirao, N. (2015). Analysis of skin conductance response during evaluation of preferences for cosmetic products. Front. Psychol. 6, 103. doi: 10.3389/fpsyg.2015.00103

PubMed Abstract | CrossRef Full Text | Google Scholar

Oon, H. N., Saidatul, A., and Ibrahim, Z. (2018). “Analysis on non-linear features of electroencephalogram (EEG) signal for neuromarketing application,” in 2018 International Conference on Computational Approach in Smart Systems Design and Applications (ICASSDA) (Kuching), 1–8. doi: 10.1109/ICASSDA.2018.8477618

CrossRef Full Text | Google Scholar

Peeters, G. (2004). A large set of audio features for sound description (similarity and classification) in the cuidado project. CUIDADO Ist Project Rep. 54, 1–25. Available online at: http://recherche.ircam.fr/equipes/analyse-synthese/peeters/ARTICLES/Peeters_2003_cuidadoaudiofeatures.pdf

Google Scholar

Peirce, J. W. (2007). Psychopy-psychophysics software in python. J. Neurosci. Methods 162, 8–13. doi: 10.1016/j.jneumeth.2006.11.017

PubMed Abstract | CrossRef Full Text | Google Scholar

Percival, D. B., and Walden, A. T. (2000). Wavelet Methods for Time Series Analysis, Vol. 4. Cambridge: Cambridge University Press. doi: 10.1017/CBO9780511841040

CrossRef Full Text | Google Scholar

Phanikrishna, V., and Chinara, S. (2021). Automatic classification methods for detecting drowsiness using wavelet packet transform extracted time-domain features from single-channel EEG signal. J. Neurosci. Methods 347, 108927. doi: 10.1016/j.jneumeth.2020.108927

PubMed Abstract | CrossRef Full Text | Google Scholar

Phinyomark, A., Phukpattaranont, P., and Limsakul, C. (2012). Feature reduction and selection for EMG signal classification. Expert Syst. Appl. 39, 7420–7431. doi: 10.1016/j.eswa.2012.01.102

CrossRef Full Text | Google Scholar

Rakotomamonjy, A. (2003). Variable selection using SVM-based criteria. J. Mach. Learn. Res. 3, 1357–1370.

Google Scholar

Ramadan, R. A., Refat, S., Elshahed, M. A., and Ali, R. A. (2015). “Basics of brain computer interface,” in Brain-Computer Interfaces, eds A. E. Hassanien and A. T. Aza (Springer), 31–50. doi: 10.1007/978-3-319-10978-7_2

CrossRef Full Text | Google Scholar

Ramsøy, T. Z., Skov, M., Christensen, M. K., and Stahlhut, C. (2018). Frontal brain asymmetry and willingness to pay. Front. Neurosci. 12, 138. doi: 10.3389/fnins.2018.00138

PubMed Abstract | CrossRef Full Text | Google Scholar

Rashid, M., Sulaiman, N., Mustafa, M., Khatun, S., and Bari, B. S. (2018). “The classification of EEG signal using different machine learning techniques for BCI application,” in International Conference on Robot Intelligence Technology and Applications (Kuala Lumpur: Springer), 207–221. doi: 10.1007/978-981-13-7780-8_17

CrossRef Full Text | Google Scholar

Rawnaque, F. S., Rahman, K. M., Anwar, S. F., Vaidyanathan, R., Chau, T., Sarker, F., et al. (2020). Technological advancements and opportunities in neuromarketing: a systematic review. Brain Inform. 7, 1–19. doi: 10.1186/s40708-020-00109-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Scheirer, E., and Slaney, M. (1997). “Construction and evaluation of a robust multifeature speech/music discriminator,” in 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing, Vol. 2 (Munich), 1331–1334. doi: 10.1109/ICASSP.1997.596192

CrossRef Full Text | Google Scholar

Sharmila, A., and Geethanjali, P. (2018). Effect of filtering with time domain features for the detection of epileptic seizure from EEG signals. J. Med. Eng. Technol. 42, 217–227. doi: 10.1080/03091902.2018.1464075

PubMed Abstract | CrossRef Full Text | Google Scholar

Telpaz, A., Webb, R., and Levy, D. J. (2015). Using EEG to predict consumers? future choices. J. Mark. Res. 52, 511–529. doi: 10.1509/jmr.13.0564

PubMed Abstract | CrossRef Full Text | Google Scholar

Teo, J., Hou, C. L., and Mountstephens, J. (2017). “Deep learning for EEG-based preference classification,” in AIP Conference Proceedings, Vol. 1891 (Kedah: AIP Publishing LLC.), 020141. doi: 10.1063/1.5005474

CrossRef Full Text | Google Scholar

Tkach, D., Huang, H., and Kuiken, T. A. (2010). Study of stability of time-domain features for electromyographic pattern recognition. J. Neuroeng. Rehabil. 7, 1–13. doi: 10.1186/1743-0003-7-21

PubMed Abstract | CrossRef Full Text | Google Scholar

Toledo-Pérez, D., Rodríguez-Reséndiz, J., and Gómez-Loenzo, R. A. (2020). A study of computing zero crossing methods and an improved proposal for EMG signals. IEEE Access 8, 8783–8790. doi: 10.1109/ACCESS.2020.2964678

CrossRef Full Text | Google Scholar

Toloşi, L., and Lengauer, T. (2011). Classification with correlated features: unreliability of feature ranking and solutions. Bioinformatics 27, 1986–1994. doi: 10.1093/bioinformatics/btr300

PubMed Abstract | CrossRef Full Text | Google Scholar

Tremblay, L., and Schultz, W. (1999). Relative reward preference in primate orbitofrontal cortex. Nature 398, 704–708. doi: 10.1038/19525

PubMed Abstract | CrossRef Full Text | Google Scholar

Vecchiato, G., Astolfi, L., De Vico Fallani, F., Cincotti, F., Mattia, D., Salinari, S., et al. (2010). Changes in brain activity during the observation of TV commercials by using EEG, GSR and HR measurements. Brain Topogr. 23, 165–179. doi: 10.1007/s10548-009-0127-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Vidyaratne, L. S., and Iftekharuddin, K. M. (2017). Real-time epileptic seizure detection using EEG. IEEE Trans. Neural Syst. Rehabil. Eng. 25, 2146–2156. doi: 10.1109/TNSRE.2017.2697920

PubMed Abstract | CrossRef Full Text | Google Scholar

Wali, M. K., Murugappan, M., and Ahmmad, B. (2013). Wavelet packet transform based driver distraction level classification using EEG. Math. Probl. Eng. 2013, 297587. doi: 10.1155/2013/297587

PubMed Abstract | CrossRef Full Text | Google Scholar

Waris, A., and Kamavuako, E. N. (2018). Effect of threshold values on the combination of EMG time domain features: surface versus intramuscular EMG. Biomed. Signal Process. Control 45, 267–273. doi: 10.1016/j.bspc.2018.05.036

CrossRef Full Text | Google Scholar

Yadava, M., Kumar, P., Saini, R., Roy, P. P., and Dogra, D. P. (2017). Analysis of EEG signals and its application to neuromarketing. Multim. Tools Appl. 76, 19087–19111. doi: 10.1007/s11042-017-4580-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Yan, K., and Zhang, D. (2015). Feature selection and analysis on correlated gas sensor data with recursive feature elimination. Sensors Actuat. B 212, 353–363. doi: 10.1016/j.snb.2015.02.025

CrossRef Full Text | Google Scholar

Yılmaz, B., Korkmaz, S., Arslan, D. B., Güngör, E., and Asyalı, M. H. (2014). Like/dislike analysis using EEG: determination of most discriminative channels and frequencies. Comput. Methods Prog. Biomed. 113, 705–713. doi: 10.1016/j.cmpb.2013.11.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Zainuddin, A., Mansor, W., Lee, K. Y., and Mahmoodin, Z. (2018). Performance of support vector machine in classifying EEG signal of dyslexic children using RBF kernel. Indones. J. Electr. Eng. Comput. Sci. 9, 403–409. doi: 10.11591/ijeecs.v9.i2.pp403-409

CrossRef Full Text | Google Scholar

Zhang, Y., Liu, B., Ji, X., and Huang, D. (2017). Classification of EEG signals based on autoregressive model and wavelet packet decomposition. Neural Process. Lett. 45, 365–378. doi: 10.1007/s11063-016-9530-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: Brain Computer Interface, neuromarketing, machine learning, electroencephalography, consumer behavior, pattern recognition, consumer neuroscience

Citation: Mashrur FR, Rahman KM, Miya MTI, Vaidyanathan R, Anwar SF, Sarker F and Mamun KA (2022) BCI-Based Consumers' Choice Prediction From EEG Signals: An Intelligent Neuromarketing Framework. Front. Hum. Neurosci. 16:861270. doi: 10.3389/fnhum.2022.861270

Received: 24 January 2022; Accepted: 02 May 2022;
Published: 26 May 2022.

Edited by:

Fares Al-Shargie, American University of Sharjah, United Arab Emirates

Reviewed by:

Aydin Akan, Ïzmir University of Economics, Turkey
Ahmad Rauf Subhani, National University of Sciences and Technology (NUST), Pakistan

Copyright © 2022 Mashrur, Rahman, Miya, Vaidyanathan, Anwar, Sarker and Mamun. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Khondaker A. Mamun, mamun@cse.uiu.ac.bd

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.