- 1BrainSigns, Rome, Italy
- 2University of the International Studies of Rome (UNINT), Rome, Italy
- 3Department of Molecular Medicine, Sapienza University of Rome, Rome, Italy
- 4Department of Communication and Social Research, Sapienza University of Rome, Rome, Italy
- 5Department of Anatomical, Histological, Forensic and Orthopedic Sciences, Sapienza University of Rome, Rome, Italy
- 6College of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou, China
Display and native ads represent two of the most widely used digital advertising formats employed by advertisers that aim to grab the attention of online users. In recent years, the native format has become very popular because it relies on deceptive features that make harder the recognition of its advertising nature, reducing avoiding behaviors such as the banner blindness phenomena, traditionally associated to display advertising, and so increasing its advertising effectiveness. The present study, based on a forefront research protocol specifically designed for the advertising research on smartphone devices, aims to investigate through neurophysiological and self-reported measures, the perception of display and native ads placed within article webpages, and to assess the efficacy of an integrated approach. Eye-tracking results showed higher visual attention and longer viewing time associated with native advertisements in comparison to traditional display advertisements, confirming and extending evidence provided by previous research. Despite a significantly higher rate of self-reported advertising intent was detected for articles containing display ads when compared to articles containing native ads, no differences have been found while performing the same comparison for the neurophysiological measures of emotional involvement and approaching motivation of for the self-reported measures of pleasantness and annoyance. Such findings along with the employment of an innovative research protocol, contribute to providing further cues to the current debate related to the effectiveness of two of the most widely used digital advertising formats.
Introduction
In the last decade, we have witnessed a significant shift in the advertising world from traditional media to online media, leading to a huge growth in digital advertising expenditure worldwide. For the first time, in 2015, in the UK, digital media took a 50% share of advertising spending (eMarketer, 2015), while in 2016, in the US, digital revenues surpassed those of cable and broadcast television (IAB, 2016). Another significant change was represented by the huge growth of mobile revenues at the expense of the desktop revenues, this latter being dominant till 2016, when digital revenues coming from mobile devices exceeded desktop ones, making in 2018 (full year) up 65.1% of total internet advertising revenues (Silverman, 2019). Currently, we are living in the “Mobile Age,” a world with more than 3.2 billion smartphone users (Statista, 2018) that, thanks to the internet access, could be potential viewers of digital advertisements at any time. In this context, the improved ability to successfully match advertisers and consumers allowed by multisided platforms, detailed data, and algorithms led to a substantial transformation of the advertising business programmatic advertising that allows to collect consumers data, monitor ads impressions, and automate the buying and selling of ads in order to reach an effective target audience (Wojdynski, 2016a; Bounie et al., 2017); it needs to deal with two main issues: the banner blindness phenomenon and the current difficulties in measuring affective and cognitive processes elicited by the ads.
One of the historical metrics widely used to evaluate digital advertising campaigns is the Ad impression, which has been meticulously refined in recent years to achieve more precise measurements, combining many pre-established criteria, such as the percentage of pixels within the viewable space and the length of time the ad is in the viewable space. In 2014, the Interactive Advertising Bureau (IAB) introduced the concept of viewable impression, different from the previous definition of impression (or served impression; MediaRatingCouncil IAB, 2014): from 2014, an ad impression was considered viewable only if the ad was contained in the viewable space of the browser window. Later on, in 2016, the IAB released another guideline specifically about the viewability of an Ad on mobile devices (MRC, 2016) stating that a mobile impression was viewable if the ad was contained in the viewable space of the device, either within an in-focus web browser (Web View) or a fully downloaded, opened, initialized application. In particular, nowadays, a viewable mobile ad needs to meet the following requirements (Interactive Advertising Bureau Technology Laboratory Mobile Marketing Association Media Rating Council, 2017):
• Pixel Requirement: an amount greater than or equal to 50% of the pixels in the advertisement has to be located on an in-focus browser or a fully downloaded, opened, initialized application, on the viewable space of the device.
• Time Requirement: The time the pixel requirement is met has to be greater than or equal to one continuous second, post ad render.
• Valid Traffic: viewable impressions will be counted only in case of valid traffic, excluding the traffic generated by bots and other automated tools.
Despite the promising development of the above-mentioned requirements, half of the ads purchased by the advertisers are never seen by internet users, leading to a huge budget waste (Bounie et al., 2017). One of the reasons ads may fail to achieve their goal is the so-called banner blindness phenomenon, primarily related to banner ads and that became known 4 years later the first commercial banner appeared on a website (Wired website in 1994; Ausiello, 2015). The term “banner blindness,” coined by Benway (1998), refers to the user's tendency to ignore banner-like information or anything else that resembles an advertisement. Such phenomenon relies on the increasing abilities of users in identifying banner ads and their persuasive purposes, along with the user development of strategies to resist them (Fransen et al., 2015) or avoid them entirely (Drèze and Hussherr, 2003; Cho and Cheon, 2004; Lee and Ahn, 2012). In a series of eye-tracking studies (Nielsen, 2007; Pernice, 2018), the Nielsen Norman Group stated that the banner blindness phenomenon is a type of selective attention and that users who navigate websites have learned how to pay attention to elements that can be helpful and how to ignore the one's void of information (Pernice, 2018). To increase the user attention toward the ad and deal with the banner blindness phenomena, strategies such as animation can be adopted (Griffith et al., 2001), although it could lead to an increase in the cognitive effort required for processing the ad and negatively affect memory performance associated to the ad recall (Bayles, 2002; Hong et al., 2004; Burke et al., 2005), along with a wide variety of paid advertising formats, more difficult to identify by the user (Mitra et al., 2008; Campbell et al., 2014). Regarding the introduction of new digital advertising formats, the so-called “native” format matches the look, feel, and function of the media format in which it appears (Wojdynski, 2016a; IAB, 2019) and such “deception” makes it more difficult to recognize by users (Most et al., 2001; Wasserman, 2013; Anni, 2014; IAB, 2019). The use of ambiguous words, small in size, like “sponsored” or “branded” content, represents the only cue (AdAge, 2014) for the user to distinguish between the advertisement and the native feed of the site, and for this reason, some researchers were wondering if the native format actually leads to an increased engagement or to an increased deception (Wojdynski, 2016a). The success of native advertising was confirmed by an eye-tracking study conducted by Sharethrough/IPG Media in 2015, showing that consumers looked at native ads 53% more frequently than display ads. Furthermore, native ads registered 18% higher lift in purchase intent and 9% lift for brand affinity responses than banner ads and 32% of consumers were willing to share a native ad with their family or friend, while only 19% would have shared a banner ad (Sharethrough, 2015). Beyond the success of native advertising, some authors warn that deceptive practices can lead consumer to avoid, distrust, or negatively perceive ads (Fransen et al., 2015; Wojdynski, 2016a; Taylor, 2017; Han et al., 2018; Iversen and Knudsen, 2019), negatively affecting the perceptions of the article, of the publisher, and of the advertising institution, and decreasing the intent to share the article (Wojdynski, 2016b; Amazeen and Wojdynski, 2020). In addition, a study reported that consumers actually evaluate banners more positively than article-style native ads, in terms of attitude and credibility (Harms et al., 2019).
A total of 40 years have passed since Zajonc disclosed the fundamental role of emotion in advertising (Zajonc, 1980), paving the way to studies that would have described emotion as an important mediator of cognitive and behavioral consumer responses when processing advertising (Batra and Ray, 1986). If it is clear that accurate measurement of emotions would be essential (Poels and Dewitte, 2011), the most widely used techniques in this context are represented by the traditional self-reports (Velásquez et al., 2011; Li et al., 2018), very convenient to use, but mainly relying on how users describe advertisements (Edell and Burke, 1987), sensible to biases (Paulhus, 2002), and hardly capable to measure affective and cognitive processes elicited by ads (Edell and Burke, 1987; Mano, 1996; Cherubino et al., 2019). In recent years, the exponential production of scientific articles related to the neuromarketing field generated new knowledge related to the application of neuroscientific tools in advertising testing (Cherubino et al., 2019) that may fill this gap and may help provide a better understanding of processes such as attention and emotion that play a crucial role in evaluating the effectiveness of ads (Edell and Burke, 1987; Harrington et al., 2006; Milosavljevic and Cerf, 2008). Even if neuroscientific technologies have been applied since the 1960's in consumer research (Cherubino et al., 2019), the current technological advances, at the basis of modern neuroscience, allow to deeply explore emotions and cognitive processes while users are interacting with a stimulus, like a website or an app by desktop or mobile devices. A recent neuroscientific study (Neurons Inc, 2021) involved the recordings of the eye-tracking and the electroencephalography (EEG) of 1,049 participants and turning in the world's largest consumer neuroscience study on mobile devices, providing a better understanding of the impact of digital advertising in terms of emotion and attention. This study revealed that 25% of ads are seen on mobile screens vs. the 5% on desktops, that the advertisement starts to generate emotional and cognitive responses only after 700 ms, and that 50% of the ads produce an emotional response if the ad is seen for at least 1,000 ms, leading to the definition of the “1-s ad strategy.” The integration of techniques such as the eye tracking and the EEG can provide real-time information to detect where a person is looking at (Vila and Gomez, 2016), which sequential strategies are being used (Goldberg and Helfman, 2011) and to identify approaching vs. avoiding behaviors toward a stimulus of interest such as a digital ad (Davidson, 1995; Davidson and Hugdahl, 1996; Di Flumeri et al., 2018; Modica et al., 2018).
Our study aims to demonstrate the potentiality of a forefront experimental protocol that involves the integration of neuroscientific tools and traditional techniques, focusing on the comparison of display and native advertising format in terms of visual attention, emotional involvement, and approaching behavior, while browsing several web pages by smartphone. Considering that only a few studies have previously addressed similar topics by the use of an integrated set of neuroscientific and standard tools (Sharethrough, 2015; Neurons Inc, 2021) and that previous research has also shown some counter-current results highlighting a more positive evaluation of display ads vs. native ads (Harms et al., 2019) or raising concerns related to the deceptive features at the base of native ads as a source of negative effects (Fransen et al., 2015; Wojdynski, 2016a; Taylor, 2017; Han et al., 2018; Iversen and Knudsen, 2019), we felt that further investigation was needed. According to our intentions, we developed several web pages showing online articles and containing display or native ads. Our participants, after being instructed, have been asked to read those online articles by smartphone and to fill up a questionnaire at the end of each reading. During the experimental session, the eye tracker has been used to investigate the visual attention and the viewing time associated to native and display ads, based respectively on two of the most widely used eye tracking metrics, namely fixation count (Kukkonen, 2005; Djamasbi et al., 2010; Siyanova-Chanturia et al., 2011; Wang et al., 2014) and visit duration (Dogusoy-Taylan and Cagiltay, 2014; Huddleston et al., 2015; Fashler and Katz, 2016; Katz et al., 2019). The EEG has been used to evaluate cognitive user's behavior during the experience, and in particular to quantify the type of motivation (degree of approach/avoidance) toward articles containing display or native ads, by the use of the Approach Withdrawal (AW) index. Such index, initially developed by Davidson et al. (1990), relies on the hemispheric asymmetries in the alpha frequency range over prefrontal electrodes and represents a widely accepted correlation of approach and withdrawal related motivation (Harmon-Jones et al., 2010; Briesemeister et al., 2013), extensively applied in advertising research (Ohme et al., 2009, 2010; Vecchiato et al., 2010, 2011; Modica et al., 2017; Cartocci et al., 2018, 2019). In addition, heart rate (HR) and galvanic skin response (GSR) have been explored as a measure of the emotional impact generated by articles containing display or native ads, being the HR and the GSR two autonomic parameters sensible to the emotional response (Mauss and Robinson, 2009). The information provided by the GSR and HR have been collected to compute the Emotional Index (EI), a neurophysiological conceptualization of the circumplex model of the effect of Russell and Barrett based on the arousal and valence values (Ariely and Berns, 2010), respectively obtained through the GSR and HR and already applied in advertising research (Vecchiato et al., 2014a,b; Cherubino et al., 2016, 2017).
According to the aforementioned theoretical framework, we aimed to:
1. Verify if native advertising format generates higher visual attention and longer viewing time than display advertising format, considering that previous findings showed a better capability of native ads in reducing visual avoiding behaviors compared to display ads that are highly affected by the banner blindness phenomena (Most et al., 2001; Wasserman, 2013; Anni, 2014; IAB, 2019).
2. Compare articles containing display ads and articles containing native ads in terms of approaching motivation, emotional involvement (EI), pleasantness, annoyance, and advertising intent, considering the concerns raised by some authors related to the deceptive features of native ads as a source of negative effects (Fransen et al., 2015; Wojdynski, 2016a; Taylor, 2017; Han et al., 2018; Iversen and Knudsen, 2019) and some counter-current results highlighting a more positive evaluation of display ads vs. native ads (Harms et al., 2019).
3. Demonstrate the effectiveness of an innovative research protocol specifically designed for advertising research on smartphone devices and based on the integration of both neuroscientific and traditional techniques.
Materials and Methods
Participants
The study involved 49 healthy participants (24 females and 25 males; mean age = 26.4 years; SD = 4.9 years). Participants, having no history of mental illnesses or drug abuse, were voluntarily recruited and after the explanation of the study, they signed informed consent, including the authorization related to the use of the video-graphical material (i.e., photos and videos of the experiment). The study was conducted following the principles outlined in the Declaration of Helsinki of 1975, as revised in 2008 and it was approved by the local institutional ethics committee.
Experimental Protocol
At the beginning of each experimental session, participants were asked to comfortably sit in front of a desk, where a mounting solution designed for facilitating eye tracking on mobile devices [92] and a Samsung Galaxy S8 smartphone (Device Solutions Korea 1, Samsung-ro, Giheung-gu, Yongin-si, Gyeonggi-do, Korea) were present. The recording of the eye movements, brain activity, HR, and GSR have been performed during the entire experimental session (see Figure 1). After 1 min training simply focused on the horizontal and vertical scrolling of the main smartphone's screens to help the participants to familiarized with the specific smartphone model and operative system, the participants were asked to close their eyes for 1 min and then to relax 1 min during the observation of the default Google home page visible on the smartphone screen. This latter recording segment was employed as a baseline.
Figure 1. The figure shows on the left side the setup for the electroencephalography (EEG), heat rate (HR), galvanic skin response (GSR), and Eye Tracking recording and on the right side the Mobile Device Stand (Tobii) that was employed specifically for holding the smartphone and performing the eye-tracking recording.
The participants were then invited to visit the “navigation screen,” a landing page we developed to facilitate the navigation throughout different instruction pages and articles containing display or native ads. Each participant was assigned to one of two groups (X and Y) by the use of the random assignment by blocks method, to preserve a similar sample size for both groups (X = 24, Y = 25), generated through a computer-based randomization procedure (“Research Randomizer” tool, available at the following link: https://www.randomizer.org). According to such assignment, each group (“X” and “Y”) saw the same version of each article except for the advertising format (native/display) that was swapped across groups. For instance, the article “A” provided to the group “X” included only native ads, while the same article (“A”) provided to group “Y” included only display ads. Such an approach allowed us to compare the impact of native and display advertisements while controlling all the other article features. In general, each participant was asked to read four articles, where two articles contained four display ads and two articles contained four native ads (see Figure 2 and Figure 3 for more details about the articles containing the ads and related area of interests). The articles faced topics that were consistent with the advertised products, related to sunglasses or cameras. In addition, the order of exposure to each of the four articles was randomized across subjects by the use of the random order assignment method of the “Research Randomizer” tool, to avoid any effect related to the presentation order. At the end of each article reading, participants were asked to rate the pleasantness, the annoyance, and the advertising intent associated with the previous reading, ranging from 1 (minimum) to 7 (maximum; see the whole experimental design in Figure 4). The entire experimental session lasted around 15 min.
Figure 2. Articles including the ads: on the left side two samples of articles including display ads are shown, while on the right side, the same samples including native ads are shown. Each sample, regardless of the ad format, shows three ads of the total four, since the fourth ad, to be seen by the user, is required to scroll, an action that each participant performed to read the article. The third ad located in each sample was fixed and always visible while scrolling the page.
Figure 3. Areas of interest (AOIs)/eye-tracking: the figure shows a sample article where the AOIs, associated with the advertising spaces, are highlighted in red. The third ad, placed in a bottom fixed position, was always visible while scrolling. The AOIs position and dimension were the same for both article formats (display and native).
Figure 4. The figure above shows the experimental design. Each participant was invited to read four articles, randomized across subjects, each of them preceded by instruction and followed by a short questionnaire. Regarding the ads, two articles contained four display ads while the other two articles contained four native ads. Each group (“X” ad “Y”) saw the same version of each article except for the advertising format (native/display) that was swapped across groups.
EEG Recording and Signal Processing
Regarding the recording of brain activity, a portable 16-channels EEG system (BEmicro and Galileo software, EBneuro, Italy) was employed. The EEG signal was recorded with a sampling rate of 256 Hz through a frontal headband including 10 Ag/AgCl electrodes placed according to the 10–20 International System (Fpz, Fp1, Fp2, AFz, AF3, AF4, AF5, AF6, AF7, and AF8), all referred to the right earlobe and grounded to the left earlobe. All the skin-electrode impedances were kept below 20 kΩ. The MATLAB software (MathWorks Inc., USA) was employed to process the recorded data offline.
Electroencephalography signals were digitally bandpass filtered by Notch filter (50 Hz), to avoid power line interferences, and a 5th order Butterworth band-pass filter ([2÷30] Hz), to remove high-frequency interferences and the continuous component.
To identify components associated with ocular blinks and saccades artifacts, the independent component analysis (ICA) was applied, in particular employing the SOBI algorithm (Belouchrani et al., 1997). The signal was decomposed in 10 Independent Components (ICs, equal to the number of EEG channels), two specific ICs related to eye blinks and saccades artifacts have been visually identified by an expert, and then the EEG signal was reconstructed (Di Flumeri et al., 2016). Afterward, the common average reference (CAR) was applied to re-referenced the EEG signal.
To identify other kinds of artifacts, automatic procedures of the EEGLAB toolbox (Delorme and Makeig, 2004) have been performed on the EEG signal, which was for this purpose segmented into 1-s-long epochs, shifted of 0.5 s to avoid any “boundary effect.” Such automatic procedures have been validated in several previous studies (Aricò et al., 2016, 2017; Di Flumeri et al., 2019) and rely on the following three main criteria:
(i) Threshold criterion: EEG epochs with a signal amplitude exceeding ±100 μV were labeled as an artifact
(ii) Trend criterion: EEG epochs were interpolated to check the slope of the trend within the considered epochs. If the slope of an epoch was higher than 10 μV/s, the considered epoch was marked as “artifact”
(iii) Sample-to-sample difference criterion: The EEG epoch was marked as “artifact” also if the amplitude difference between consecutive EEG samples was higher than 25 μV, inasmuch it would represent a non-physiological variation.
To obtain an EEG dataset free of artifacts, the EEG epochs labeled as “artifact,” employing the epoch rejection criteria (EEGLAB, 2017), were removed from the EEG dataset (11 ± 5% of data has been on average removed).
The EEG segment associated with the period of “closed eye” (see Experimental Protocol) was used to detect the individual peak of the signal power spectrum within the traditional alpha frequency range (8 – 12 Hz), known as the individual alpha frequency (IAF), that is generally employed for the calculation of the individual EEG frequency bands, according to Klimesch (1999) as follows: theta [IAF – 6–IAF – 2], alpha [IAF – 2–IAF + 2], upper alpha [IAF –IAF + 2], beta [IAF + 2–IAF + 16], and gamma [IAF + 16–IAF + 30]. In the present study, alpha and upper alpha rhythms have been considered, being the most informative brain activity features related to motivational (Davidson et al., 1990; Harmon-Jones et al., 2010; Briesemeister et al., 2013) and attentive (Klimesch et al., 1998; Kelly et al., 2003; Sauseng et al., 2005) processes.
For both datasets, the global field power (GFP) was performed, representing a summary of the activity associated with the frontal EEG channels and to the two frequency bands of interest (alpha and upper alpha; Lehmann and Michel, 1990), according to previous studies (Ohme et al., 2009, 2010; Vecchiato et al., 2010, 2011) that employed the GFP as a reference-independent descriptor of the field potential (Skrandies, 1990).
The GFP formula is specified in the following equation:
α represents the specific EEG band, Frontal represents the cortical area, N represents the number of electrodes related to a specific area, i represents the electrodes' index and x is the specific EEG sample at a time (t), filtered within the related EEG band (i.e., α) and for the specific channel i.
Afterward, the average GFP value on all the GFP values estimated over 1 s of EEG signal was calculated.
The approach/withdrawal (AW) index has been defined according to previous studies (Harmon-Jones et al., 2010; Briesemeister et al., 2013) and calculated employing the following formula:
In particular, GFPα_right is associated to right electrodes (Fp2, AF4, AF6, and AF8) for the alpha (α) band, while GFPα_right is associated to left electrodes (Fp1, AF3, AF5, and AF7) for the alpha (α), generating an approach/withdrawal (AW) index where higher AW values indicate higher approach motivation and lower AW values indicates withdrawal motivation.
In addition, in this study, we have explored also the average values related to GFPupperα, related to all the frontal electrodes (Fp2, AF4, AF6, AF8, AF7, AF3, Fp1, AF5) for the upper alpha band, that we defined as “Frontal Upper Alpha.”
Finally, the neurometric of AW and “Frontal Upper Alpha” have been normalized for each second by the use of the mean and the standard deviation of the same neurometric calculated on the individual baseline (see “Experimental Protocol”) as shown in the following formula:
Autonomic Recording and Signal Processing
The Shimmer System (Shimmer Sensing, Ireland), with a sampling rate of 64 Hz, was employed for the recording of the Blood Volume Pulse (BVP) and GSR, respectively through the placement of a pulse oximeter on the thumb and of two electrodes on the second and third fingers of the non-dominant hand, according to published procedures (Measures et al., 2012).
The Pan-Tompkins algorithm has been used to obtain the HR signal from the BVP (Pan and Tompkins, 1985), while the LEDAlab software has been used for estimating the tonic component of the skin conductance (Skin Conductance Level, SCL; Benedek and Kaernbach, 2010), that was recorded with a constant voltage method (0.5 V).
The Emotional Index was performed employing and matching both SCL and HR signals, taking into account the circumplex model of affect plan (Russell and Barrett, 1999; Posner et al., 2005), where the coordinates of a point in space are defined respectively by the HR (horizontal axis) to describe the valence and by the SCL (vertical axis) to describe the arousal phenomena (Mauss and Robinson, 2009).
The Emotional Index represents a monodimensional variable, associated with the emotional state of a subject (Vecchiato et al., 2014b) and is defined by the following formula:
where,
HRz and GSRz respectively represent the Z-score variables of HR and GSR, while ϑ is in radians and it is calculated as arctan (HRz, GSRz). The angle β varies between [−1, 1], as well as the values of the EI [−1, 1]. According to the result interpretation (Vecchiato et al., 2014b), negative (HRz <0) and positive (HRz > 0) values of the EI respectively indicate negative and positive emotions (valence).
Eye-Tracking Recording and Signal Processing
The Tobii Pro X2-30 screen-based eye tracker (Danderyd, Sweden), with a sampling rate of 30 Hz, was employed for the recording of eye-tracking data. The eye tracker was placed within the Tobii Pro Mobile Device Stand (Tobii, 2019), a solution designed for mobile device testing, and then plugged into the acquisition computer where the software Tobii Studio 3.4.8 (Danderyd, Sweden) was running and performing the eye-tracking data acquisition. In addition, the Epiphan's DVI2USB 3.0 (Palo Alto, CA, United States), a high-performance USB video grabber for lossless video capture, was employed to mirror the user screen related to the Samsung Galaxy S8 smartphone to Tobii Studio 3.4.8 with a resolution of 1,920 × 1,200 at 60 fps, to achieve an accurate matching of the transferred images and eye-tracking data. Tobii Studio 3.4.8 has been used to draw the areas of interest (AOI) associated with the entire user screen and to the four advertisements, for the time segment related to each article reading. The same software was employed to extract fixation data associated with each AOI and for each article reading, using the Tobii I-VT fixation filter (Danderyd, Sweden) (Olsen, 2012). The visual attention metric was performed by dividing the total number of fixations elicited by an AOI (i.e., advertisement) for the total number of fixations recorded on the user screen AOI, concerning each article reading. In addition, the viewing time metric associated with each advertisement was obtained, known also as “visit duration” and defined as the interval of time in seconds between the first fixation on the AOI and the next fixation outside the AOI (Tobii, 2016).
Self-Reports
After the exposure to each article, subjects have been asked to fill up a short questionnaire featured by a 7 points Likert scale. In particular, they have been asked: “Thinking about the article you just read how much you consider it:”
• Pleasant
• Annoying
• Having an advertising intent
The questionnaire variables associated with the self-reported measures of pleasantness, annoyance, and advertising intent have been normalized between 0 and 1 and will be reported in percentage.
Performed Analysis
As described in Section “Experimental Protocol,” two groups (“X” and “Y”) have been generated to show the same four articles to all participants, where only the advertising format associated with each article was swapped across groups. Considering that each participant saw both display and native advertising formats, paired Sample t-Test was performed to compare:
• Regarding eye tracking metrics, the visual attention/viewing time generated by all display ads included in the article (averaged for all articles containing display ads) vs. the visual attention/viewing time generated by all native ads included in the article (averaged for all articles containing native ads).
• Regarding neurometrics, the level of the approaching motivation (AW)/EI elicited by an article containing display ads (averaged for all articles containing display ads) vs. the level of approaching motivation (AW)/EI elicited by an article containing native ads (averaged for all articles containing native ads).
• Regarding self-report, the degree of pleasantness/annoyance/advertising intent associated with an article containing display ads (averaged for all articles containing display ads) vs. the degree of pleasantness/annoyance/advertising intent associated with an article containing native ads (averaged for all articles containing native ads).
Results
Visual Attention
Regarding the comparison performed between the visual attention generated by all display ads included in the article (averaged for all articles containing display ads) and the visual attention generated by all native ads included in the article (averaged for all articles containing native ads), results showed a statistically significant increase of visual attention for native ads in comparison to display ads (p = 0.021; see Figure 5).
Figure 5. Visual attention: comparison between the display and native ads (n = 49). Native ads showed a statistically significant increase in visual attention values in comparison to display ads (p = 0.021, d = 0.35). Error bars represent SD.
Viewing Time
Regarding the comparison performed between the viewing time elicited by all display ads included in the article (averaged for all articles containing display ads) and the viewing time elicited by all native ads included in the article (averaged for all articles containing native ads), results showed a statistically significant increase of viewing time for native ads in comparison to display ads (p = 0.041; see Figure 6).
Figure 6. Viewing time: comparison between the display and native ads (n = 49). Native ads showed a statistically significant increase in Viewing time values in comparison to display ads (p = 0.041, d = 0.31). Error bars represent standard deviation.
Approach/Withdrawal
Regarding the comparison performed between the level of the approaching motivation (AW) associated with an article containing display ads (averaged for all articles containing display ads) and the level of the approaching motivation (AW) associated with an article containing display ads (averaged for all articles containing display ads), results showed no significant differences (p = 0.408).
Frontal Upper Alpha Power
A further investigation has been performed for the alpha power while comparing between the level of the Frontal Upper Alpha Power associated with an article containing display ads (averaged for all articles containing display ads) and the level of the Frontal Upper Alpha Power associated with an article containing native ads (averaged for all articles containing native ads) has been performed. Results showed a statistically significant increase of Frontal Upper Alpha Power for an article containing native ads in comparison to an article containing display ads (p = 0.047; see Figure 7).
Figure 7. Frontal Upper Alpha Power: comparison between an article containing display ads and an article containing native ads (n = 49). An article containing native ads showed a statistically significant increase in Frontal Upper Alpha Power values in comparison to an article containing display ads (p = 0.047, d = 0.3). Error bars represent standard deviation.
Emotional Index
Regarding the comparison performed between the level of the EI associated with an article containing display ads (averaged for all articles containing display ads) and the level of the EI associated with an article containing native ads (averaged for all articles containing native ads), results showed no significant differences (p = 0.401).
Self-Reported Pleasantness
Concerning the comparison performed between the level of the self-reported Pleasantness associated with an article containing display ads (averaged for all articles containing display ads) and the level of the self-reported Pleasantness associated with an article containing native ads (averaged for all articles containing native ads), results showed no significant differences (p = 0.096).
Self-Reported Annoyance
Regarding the comparison performed between the level of the self-reported Annoyance associated with an article containing display ads (averaged for all articles containing display ads) and the level of the self-reported Annoyance associated with an article containing native ads (averaged for all articles containing native ads), results showed no significant differences (p = 0.907).
Self-Reported Advertising Intent
Concerning the comparison between the level of the self-reported Advertising Intent associated with an article containing display ads (averaged for all articles containing display ads) and the level of the self-reported Advertising Intent associated with an article containing native ads (averaged for all articles containing native ads), results showed a statistically significant increase of the self-reported Advertising Intent for an article containing display ads in comparison to an article containing native ads (p = 0.035; see Figure 8).
Figure 8. Self-reported Advertising Intent: comparison between an article containing display ads and an article containing native ads (n = 49). An article containing display ads showed a statistically significant increase in self-reported Advertising Intent values in comparison to an article containing native ads (p = 0.035, d = 0.31). Error bars represent standard deviation.
Discussion
During the experiment, the subjects have been exposed to articles including native ads or display ads while their neurophysiological responses were collected, to investigate, during the experience, affective and cognitive processes elicited by the target stimuli. Beyond the main findings related to the case study, which will be extensively discussed in the next paragraphs, we believe that the effectiveness of the integrated set of tools that have been employed to investigate the digital stimuli of interest would be the most deserving of attention in the first instance. In a context where advertising research still relies mostly on traditional research methods such as questionnaires, focus groups, and interviews along with web metrics (e.g., impressions) to assess advertising efficacy, our integrated approach demonstrated how to address some of the weaknesses that the advertising industry is dealing with. First, the investigation of the users' gaze behavior by the eye-tracking technique provides an objective measure of what is seen, in comparison to the results that are possible to obtain by web advertising platforms, this latter providing metrics such as the impression metric, that doesn't reliably reveal if an ad is seen. In particular, our research protocol, by the use of the “viewing time” and “visual attention” metric, showed how to map the attention of multiple users to a stimulus of interest, in terms of time and distribution, providing clear answers to the following questions: “How long, in seconds, do we focus on a specific ad?” “Concerning the attention elicited by the entire page, how much attention a specific ad is capable to draw?” The adoption of the mobile device stand along with the X2-30 fixed eye tracker allowed us to accurately track the user's gaze on the employed smartphone, without requiring subjects to wear eye-tracker glasses or adding further constraints. A the same time, an integrated set of tools that also allows the recording of the EEG, BVP, and GSR provides additional information that cannot be obtained by traditional research tools in a similar context. Such recordings provide insights related to the level of the approaching motivation and EI elicited during the user experience, offering the experts the following advantages during the investigation of affective and cognitive processes:
• Data samples are collected during the experience, without the risk of distracting subjects from their task, and not only in the following phases as usually performed in advertising research protocols that include only traditional methods.
• It is possible to assess sub-phases of each experience, through the segmentation of neurophysiological data (e.g., segmentation of the acquired signal related to articles showing native or display ads)
• Considering that the psychological processes elicited by digital ads might last only a few seconds, it is important to highlight that the techniques used make it possible to explore such processes on a scale from milliseconds to seconds.
• Technologies' portability and non-invasiveness
• The opportunity to study phenomena that can occur below the awareness' threshold, hardly accessible by individuals, but that still plays a key role in driving users' behavior in digital contexts.
• Integration with traditional methods (e.g., self-reports related to the perception of articles containing display/native ads)
Last, but non-least for importance in this context, it is worth highlighting that the digital stimuli explored by the aforementioned integrated approach have been accurately prototyped in high fidelity, to control the noise that usually negatively affects the proper investigation of digital stimuli. In other words, high fidelity prototyping allows researchers to deal with the continuous variability of digital ads, over which no type of control is possible in normal conditions, turning an extremely challenging operation into a valuable opportunity. This feature played a key role in the adopted protocol, where all subjects have been exposed to the same version of each article except for the advertising format (native/display) that was swapped across groups, allowing us to compare the impact of native and display advertisements while controlling all the other article features.
Focusing on the case study's main findings, our results confirmed the success of native advertising both in terms of visual attention and viewing time while comparing it with the traditional display advertising format. The “visual attention” metric, based on fixations, refers to the distribution of the visual attention on the entire article page, allowing the detection of the attention elicited by specific AOIs, represented by the advertisements. In particular, the native ads available in the article were able to draw altogether the 12% of the visual attention elicited by the whole article, significantly higher than the 10% of visual attention elicited by the display ads (see Figure 5). Results related to the viewing time metric, known also as “visit duration” and defined as the interval of time in seconds between the first fixation on the AOI and the next fixation outside the AOI (Tobii, 2016) showed that native ads were capable to grab the attention of the users for a significantly longer duration and with an increase of 584 ms in comparison to display ads, as shown by the results associated with the viewing time metric (see Figure 6). At the same time, it is important to point out that the observed differences are featured by small effect size. Beyond the eye-tracking results aimed to provide further insights associated with the user attention, another important area of investigation was related to the perception of articles containing display or native ads in terms of approaching motivation, EI, pleasantness, annoyance, and advertising intent. Regarding the concerns raised from some authors, mainly related to counter-current results highlighting a more positive evaluation of display ads vs. native ads (Harms et al., 2019) and to the deceptive features of native ads as a source of negative effects (Fransen et al., 2015; Wojdynski, 2016a; Taylor, 2017; Han et al., 2018; Iversen and Knudsen, 2019), our study aimed to integrate neurophysiological and traditional measures to further investigate user perceptions associated to articles containing display or native ads to provide further understanding. In this context, our results showed that no significant differences between an article containing display ads and an article containing native ads in terms of approaching motivation, EI, pleasantness, and annoyance have been detected. The approaching motivation, based on the approach/withdrawal (AW) index, was not affected by the advertising format. In other words, users are similarly motivated to engage/disengage with articles containing native and/or display ads. Similarly, the EI, investigated through the Emotional Index (Vecchiato et al., 2014b), is not influenced by the ad format itself. Despite that, considering the crucial role of emotion in terms of advertising effectiveness, as already mentioned by Zajonc 40 years ago (Zajonc, 1980), future research could further explore the brain response to different ad formats in deeper brain regions, by the use of neuroscientific tools featured by higher spatial resolution than those employed in this study. Consistently with the results obtained on the neurophysiological measures of approaching motivation and EI, the self-reported measures of pleasantness and annoyance did not show a clear preference for one of the two advertising formats. On the other hand, focusing on the users' ability to detect the advertising intent of an advertisement, the article containing display ads has been perceived with a significantly higher advertising intent in comparison to an article containing native ads, even if the observed difference was featured by small effect size. Taking into account all the results obtained through the investigated measures, the following consideration arises: even if display ads are seen with a lower extent than native ads and users self-reported higher advertising intent for an article containing display ads, our results demonstrated that there is no clear users' preference for one of the two advertising format, contributing to provide further evidence to the current debate on the preference associated with one of the two advertising formats and on the negative evaluation of native ads due to their deceptive features. At the same time, the capability of native ads to draw significantly higher attention than display ads should be taken into account by advertisers. In this direction, display ads are negatively affected by the user's tendency to ignore banner-like information or anything else that resembles an advertisement as demonstrated by previous research studies (Nielsen, 2007; Pernice, 2018). In this context, our study showed that the display format led to a higher recognition of the advertising intent that affects its power in drawing attention, highlighting the increasing abilities of users to recognize such advertising format along with the development of a set of strategies to resist to it (Fransen et al., 2015). An opportunity that we missed in this study, but that we encourage future research to focus on, is related to the assessment of the impact that the reported differences could have played on the participants' behavior associated with the use of the selected products. For instance, after the exposure to the web pages showing the advertisements, participants could be asked to use a camera or sunglasses (seen in ads during the experiment) for a given time, aiming to investigate how the different ads, affect the behavior associated with the use of the selected objects. Interestingly, our study pointed out a different activation of the pre-frontal cortex in terms of upper alpha rhythms during the experience, with higher values when reading an article including native ads in comparison to the reading of articles including display ads, although such difference was featured by small effect size. Previous neurophysiological research widely investigated brain cortical behavior concerning the different components of activation and pointed out the key role of alpha rhythms in this regard (Klimesch et al., 1998; Aftanas and Golocheikine, 2001). In general, alpha activity has been recognized to have an inhibition effect over brain cognitive functions, so that the decreasing of alpha activity has been often correlated with the beginning of attentive processes (Jensen and Mazaheri, 2010; Händel et al., 2011; Uusberg et al., 2013). However, attention is also a very wide and complex concept, for such a reason neuroscientific research shed light on the role of alpha sub-rhythms concerning different aspects of attention. In particular, Klimesch and colleagues (Klimesch et al., 1998) demonstrated that alpha desynchronization does not happen at the same time for external stimuli mental processing: while low alpha components are sensitive to pre-stimulus alertness, higher alpha component (i.e., upper alpha) reacts only once the stimulus is processed. Even more significant is the recent work of Milton and colleagues (Milton and Pleydell-Pearce, 2016), where it has been demonstrated that frontal upper alpha shows synchronizing behavior in the period between a stimulus cue and the actual stimulus presentation. In other words, upper alpha synchronization has been correlated with induced alertness and expectation phenomena. In this light, the results of the present study look coherent and consistent with previous scientific evidence, since higher upper alpha synchronization has been detected in correspondence of native ads, as a sign of induced expectation in the readers. Eye-tracking data actually confirmed that display ads, being affected by banner blindness, obtained lower visual attention than native ads. Focusing on such evidences, something that is less seen, reasonably could induce less expectations and even if this discussion has to be considered as pure deduction at this stage, it might really be worth exploring further in future studies. Finally, it is important to mention that the observed differences, as demonstrated by the analysis conducted on the effect size, were featured by a small effect. In this direction, we believe that there is still a chance that the effect's limited size might be due to the sample size, which influences the standard deviation of the results and it could be assessed by replicating the study on a larger experimental sample as suggested by a recent study (Vozzi et al., 2021).
Conclusion
The present study, through an innovative research protocol specifically designed for advertising research on smartphone devices, reported interesting findings associated with the perception of native and display ads. The investigation of user perceptions has been conducted by the integration of both neuroscientific and traditional techniques, with the aim to deeper explore psychological processes that play a key role in advertising research. According to our objectives, our study demonstrated the effectiveness of an integrated set of tools, shedding more light on the perception of two of the most widely used advertising formats in terms of attention, approaching motivation, EI, pleasantness, annoyance, and advertising intent. Native ads are generally harder to be recognized by the user as advertisements because they match the look, feel, and function of the media format in which they appear. In addition, the only cue that helps the user to identify them is represented by hidden words such as “branded” or “sponsored,” often shown in small size. Such deceptive feature of native ads looks to affect the visual attention and the viewing time elicited by an advertisement on smartphone devices, as shown by the results obtained through the comparison of display ads and native ads on those two indices of interest. In particular, the higher visual attention and viewing time elicited by native advertisements in comparison to traditional display advertisements indicates the effectiveness of this more recent type of advertisement format. In this direction, the investigation of eye-tracking data represents a great opportunity for advertisers and associations operating in the field of digital advertising (e.g., IAB) to develop more precise measurements (e.g., mobile viewable impression) based on objective data. At the same time, the analysis of neurometrics allows to objectively measure affective and cognitive processes elicited by articles containing different advertising formats, filling the current gap and well-integrating the results obtained through the traditional self-reports that mainly rely on how users describe advertisements. The integrated approach showed no clear preferences associated with articles containing display or articles containing native ads, although users reported a higher advertised intent for articles containing display ads. Our study did not report therefore evidence supporting the idea that native ads, because of their deceptive features, could negatively affect the perception of users to a greater extent than display ads.
The results associated with visual attention (eye-tracking) and the GFP in upper alpha (EEG), this latter showing higher upper alpha synchronization in correspondence of native ads, could support the idea that something that is less seen, reasonably could induce fewer expectations. The mentioned deduction, as previously mentioned, would require more studies to be confirmed. For example, the same tasks (i.e., an article to read) should be repeated against a control condition where no ads should be included, to verify if this expectation-related upper-alpha synchronization is still lower than in the case of articles including native ads. Also, it would be interesting to verify if a consequent desynchronization happens while the user clicks on the native ad and the redirection toward the advertising landing page is triggered. Unfortunately, these implications were not expected while designing the experiment, however, we will take these results into serious consideration for future studies as well as encourage further research in this way. Another aspect that could be interesting to explore in future studies, through the use of neurophysiological measures, is related to the comparison of several solutions of native ads based on the manipulation of the level of their deceptive features. In addition, in recent years we have witnessed an exponential growth of neuromarketing online solutions, based on webcam eye-tracking and facial coding, aimed to provide a better understanding of mechanisms underlying the visual attention and emotional response elicited by digital marketing stimuli. Despite most of such solutions are not still mature and would require additional testing, the promising technological advances in this direction will certainly allow in the next future to explore neurophysiological measures with a more flexible approach, reducing costs and analysis times and at the same time preserving data accuracy. Future research could play a key role in this context, where such a powerful set of online technologies need further exploration and validation.
Data Availability Statement
The datasets presented in this article are not readily available because release of study data will require approval of local ethics authority. Requests to access the datasets should be directed to FB (ZmFiaW8uYmFiaWxvbmkmI3gwMDA0MDt1bmlyb21hMS5pdA==).
Ethics Statement
The studies involving human participants were reviewed and approved by Sapienza University of Rome Ethical Committee in charge for the Department of Molecular Medicine. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
EM and MM: conceptualization. AS, CS, and EM: formal analysis. PC and AS: investigation. GC and GB: methodology. MM: project administration. AM, AV, and VR: resources. GF, AV, and GB: software. MM, AT, and FB: supervision. MM, AS, and CS: writing—original draft. MM, PC, GF, and GC: writing—review and editing. All authors contributed to the article and approved the submitted version.
Funding
This research was co-funded by European Commission through the Horizon2020 projects WORKINGAGE: Smart Working environments for all Ages (GA n. 826232), SAFEMODE: Strengthening synergies between Aviation and maritime in the area of human Factors toward achieving more Efficient and resilient MODE of transportation (GA n. 814961), MINDTOOTH: Wearable device to decode human mind by neurometrics for a new concept of smart interaction with the surrounding environment (GA n. 950998), FITDRIVE: Monitoring devices for overall FITness of Drivers (GA n. 953432), and H2020-SESAR-2019-2 project ARTIMATION: Transparent artificial intelligence and automation to air traffic management systems (GA n. 894238).
Conflict of Interest
MM, PC, GF, GC, AM, AS, CS, AT, GB, and FB were employed by BrainSigns, Rome, Italy.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
AdAge (2014). Five Things to Know About The New York Times. New Native Ads. Available online at: https://adage.com/article/media/york-times-debuts-native-ad-units-dell/290973 (accessed November 26, 2019).
Aftanas, L. I., and Golocheikine, S. A. (2001). Human anterior and frontal midline theta and lower alpha reflect emotionally positive state and internalized attention: high-resolution EEG investigation of meditation. Neurosci. Lett. 310, 57–60. doi: 10.1016/S0304-3940(01)02094-8
Amazeen, M. A., and Wojdynski, B. W. (2020). The effects of disclosure format on native advertising recognition and audience perceptions of legacy and online news publishers. Journalism 21, 1965–1984. doi: 10.1177/1464884918754829
Anni, P. (2014). In Native Advertising, Deception Is A Dangerous Game. Available online at: https://www.mediapost.com/publications/article/226511/in-native-advertising-deception-is-a-dangerous-ga.html (accessed November 26, 2019).
Aricò, P., Borghini, G., Di Flumeri, G., and Babiloni, F. (2017). Method for Estimating a Mental State. Part. a Workload. Relat. Appar. US Pat. EP3143933A1.
Aricò, P., Borghini, G., Di Flumeri, G., Colosimo, A., Pozzi, S., and Babiloni, F. (2016). “A passive brain–computer interface application for the mental workload assessment on professional air traffic controllers during realistic air traffic control tasks,” in Progress in Brain Research, ed D. Coyle (Amsterdam: Elsevier), 295–328. doi: 10.1016/bs.pbr.2016.04.021
Ariely, D., and Berns, G. S. (2010). Neuromarketing: the hope and hype of neuroimaging in business. Nat. Rev. Neurosci. 11, 284–292. doi: 10.1038/nrn2795
Ausiello, F. (2015). La pubblicità online: Le opportunità, le potenzialità e gli strumenti dell'Internet Advertising. Rome: Passerino Editore.
Batra, R., and Ray, M. L. (1986). Affective responses mediating acceptance of advertising. J. Consum. Res. 13:234. doi: 10.1086/209063
Bayles, M. E. (2002). “Designing online banner advertisements,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Changing Our World, Changing Ourselves - CHI '02. New York, NY: ACM Press, 363. doi: 10.1145/503376.503441
Belouchrani, A., Abed-Meraim, K., Cardoso, J.-F., and Moulines, E. (1997). A blind source separation technique using second-order statistics. IEEE Trans. Sign. Proces. 45, 434–444. doi: 10.1109/78.554307
Benedek, M., and Kaernbach, C. (2010). A continuous measure of phasic electrodermal activity. J. Neurosci. Methods 190, 80–91. doi: 10.1016/j.jneumeth.2010.04.028
Benway, J. P. (1998). Banner blindness: the irony of attention grabbing on the World Wide Web. Proc. Hum. Factors Ergon. Soc. 1, 463–467. doi: 10.1177/154193129804200504
Bounie, D., Vallrie, M., and Quinn, M. (2017). Do you see what i see? Ad viewability and the economics of online advertising. SSRN Electron. J. 2017:ssrn.2854265. doi: 10.2139/ssrn.2854265
Briesemeister, B. B., Tamm, S., Heine, A., and Jacobs, A. M. (2013). Approach the good, withdraw from the bad—a review on frontal alpha asymmetry measures in applied psychological research. Psychology 4:261. doi: 10.4236/psych.2013.43A039
Burke, M., Hornof, A., Nilsen, E., and Gorman, N. (2005). High-cost banner blindness: ads increase perceived workload, hinder visual search, and are forgotten. ACM Trans. Comput. Interact. 12, 423–445. doi: 10.1145/1121112.1121116
Campbell, C., Cohen, J., and Ma, J. (2014). Speaker's box: advertisements just aren't advertisements anymore: a new typology for evolving forms of online “advertising.” J. Advert. Res. 54:7. doi: 10.2501/JAR-54-1-007-010
Cartocci, G., Modica, E., Rossi, D., Cherubino, P., Maglione, A. G., Colosimo, A., et al. (2018). Neurophysiological measures of the perception of antismoking public service announcements among young population. Front. Hum. Neurosci. 12, 1–17. doi: 10.3389/fnhum.2018.00231
Cartocci, G., Modica, E., Rossi, D., Inguscio, B. M. S., Aricò, P., Martinez Levy, A. C., et al. (2019). Antismoking campaigns' perception and gender differences: a comparison among EEG indices. Comput. Intell. Neurosci. 2019:7348795. doi: 10.1155/2019/7348795
Cherubino, P., Cartocci, G., Trettel, A., Rossi, D., Modica, E., Maglione, A. G., et al. (2017). “Marketing meets neuroscience: useful insights for gender subgroups during the observation of TV ads,” in Applying Neuroscience to Business Practice (Pennsylvania, PA: IGI Global), 163–190. doi: 10.4018/978-1-5225-1028-4.ch008
Cherubino, P., Martinez-Levy, A. C., Caratù, M., Cartocci, G., Di Flumeri, G., Modica, E., et al. (2019). Consumer behaviour through the eyes of neurophysiological measures: state-of-the-art and future trends. Comput. Intell. Neurosci. 2019:1976847. doi: 10.1155/2019/1976847
Cherubino, P., Trettel, A., Cartocci, G., Rossi, D., Modica, E., Maglione, A. G., et al. (2016). “Neuroelectrical indexes for the study of the efficacy of TV advertising stimuli,” in Selected Issues in Experimental Economics, ed IGI Global (Berlin: Springer), 355–371. doi: 10.1007/978-3-319-28419-4_22
Cho, C.-H., and Cheon, H. J. (2004). Why do people avoid advertising on the internet? J. Advert. 33, 89–97. doi: 10.1080/00913367.2004.10639175
Davidson, R. J. (1995). “Cerebral asymmetry, emotion, and affective style,” in Brain Asymmetry, eds R. J. Davidson and K. Hugdahl (Cambridge, MA: The MIT Press), 361–387.
Davidson, R. J., Ekman, P., Saron, C. D., Senulis, J. A., and Friesen, W. V. (1990). Approach-withdrawal and cerebral asymmetry: emotional expression and brain physiology: I. J. Pers. Soc. Psychol. 58:330. doi: 10.1037/0022-3514.58.2.330
Delorme, A., and Makeig, S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009
Di Flumeri, G., Aricó, P., Borghini, G., Colosimo, A., and Babiloni, F. (2016). “A new regression-based method for the eye blinks artifacts correction in the EEG signal, without using any EOG channel,” in 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Piscataway, NJ: IEEE), 3187–3190. doi: 10.1109/EMBC.2016.7591406
Di Flumeri, G., De Crescenzio, F., Berberian, B., Ohneiser, O., Kramer, J., Aricò, P., et al. (2019). Brain–computer interface-based adaptive automation to prevent out-of-the-loop phenomenon in air traffic controllers dealing with highly automated systems. Front. Hum. Neurosci. 13:296. doi: 10.3389/fnhum.2019.00296
Di Flumeri, G., Di Modica, E., and Rossi, D. (2018). Assessing Olfactory Perception in Young Persons: A Neuroscience Perspective. Rome: International Journal of Bioelectromagnetism.
Djamasbi, S., Siegel, M., Tullis, T., and Dai, R. (2010). “Efficiency, trust, and visual appeal: usability testing through eye tracking,” in 2010 43rd Hawaii International Conference on System Sciences (Piscataway, NJ: IEEE), 1–10. doi: 10.1109/HICSS.2010.171
Dogusoy-Taylan, B., and Cagiltay, K. (2014). Cognitive analysis of experts' and novices' concept mapping processes: an eye tracking study. Comput. Human Behav. 36, 82–93. doi: 10.1016/j.chb.2014.03.036
Drèze, X., and Hussherr, F. X. (2003). Internet advertising: is anybody watching? J. Interact. Mark. 17, 8–23. doi: 10.1002/dir.10063
Edell, J. A., and Burke, M. C. (1987). Power of feelings effects in understandin advertising. J. Consum. Res. 14, 421–433. doi: 10.1086/209124
EEGLAB (2017). EEGLAB: Rejecting Artifacts. Available online at: https://eeglab.org/tutorials/06_RejectArtifacts/ (accessed December 20, 2019).
eMarketer (2015). UK to Achieve World First as Half of Media Ad Spend Goes Digital. Available online at: https://www.emarketer.com/Article/UK-Achieve-World-First-Half-of-Media-Ad-Spend-Goes-Digital/1012280 (accessed November 25, 2019).
Fashler, S. R., and Katz, J. (2016). Keeping an eye on pain: investigating visual attention biases in individuals with chronic pain using eye-tracking methodology. J. Pain Res. 9:551. doi: 10.2147/JPR.S104268
Fransen, M. L., Verlegh, P. W. J., Kirmani, A., and Smit, E. G. (2015). A typology of consumer strategies for resisting advertising, and a review of mechanisms for countering them. Int. J. Advert. 34, 6–16. doi: 10.1080/02650487.2014.995284
Goldberg, J., and Helfman, J. (2011). Eye tracking for visualization evaluation: reading values on linear versus radial graphs. Inform. Visual. 10:6623. doi: 10.1177/1473871611406623
Griffith, D. A., Krampf, R. F., and Palmer, J. W. (2001). The role of interface in electronic commerce: consumer involvement with print versus on-line catalogs. Int. J. Electron. Commer. 5, 135–153. doi: 10.1080/10864415.2001.11044219
Han, J., Drumwright, M., and Goo, W. (2018). Native advertising: is deception an asset or a liability? J. Media Ethics 33, 102–119. doi: 10.1080/23736992.2018.1477048
Händel, B. F., Haarmeier, T., and Jensen, O. (2011). Alpha oscillations correlate with the successful inhibition of unattended stimuli. J. Cogn. Neurosci. 23, 2494–2502. doi: 10.1162/jocn.2010.21557
Harmon-Jones, E., Gable, P. A., and Peterson, C. K. (2010). The role of asymmetric frontal cortical activity in emotion-related phenomena: a review and update. Biol. Psychol. 84, 451–462. doi: 10.1016/j.biopsycho.2009.08.010
Harms, B., Bijmolt, T. H. A., and Hoekstra, J. C. (2019). You don't fool me! Consumer perceptions of digital native advertising and banner advertising. J. Media Bus. Stud. 16, 275–294. doi: 10.1080/16522354.2019.1640517
Harrington, N. G., Lane, D. R., Donohew, L., and Zimmerman, R. S. (2006). An extension of the activation model of information exposure: the addition of a cognitive variable to a model of attention. Media Psychol. 8, 139–164. doi: 10.1207/s1532785xmep0802_5
Hong, W., Thong, J. Y. L., and Tam, K. Y. (2004). Does animation attract online users' attention? The effects of flash on information search performance and perceptions. Inf. Syst. Res. 15:17. doi: 10.1287/isre.1040.0017
Huddleston, P., Behe, B. K., Minahan, S., and Fernandez, R. T. (2015). Seeking attention: an eye tracking study of in-store merchandise displays. Int. J. Retail Distrib. Manag. 43:120. doi: 10.1108/IJRDM-06-2013-0120
IAB (2016). IAB Internet Advertising Revenue Report 2016 Full Year Results. Available online at: https://www.iab.com/wp-content/uploads/2015/06/MRC-Viewable-Ad-Impression-Measurement-Guideline.pdf (accessed November 26, 2019).
IAB (2019). IAB Native Advertising Playbook 2.0. Available online at: https://www.iab.com/insights/iab-native-advertising-playbook-2-0/ (accessed March 2, 2020).
Interactive Advertising Bureau Technology Laboratory Mobile Marketing Association Media Rating Council (2017). Mobile Web Advertising Measurement Guidelines Adapted from IAB (US) Impression Measurement Guidelines. New York, NY.
Iversen, M. H., and Knudsen, E. (2019). When politicians go native: the consequences of political native advertising for citizens' trust in news. Journalism 20, 961–978. doi: 10.1177/1464884916688289
Jensen, O., and Mazaheri, A. (2010). Shaping functional architecture by oscillatory alpha activity: gating by inhibition. Front. Hum. Neurosci. 4:186. doi: 10.3389/fnhum.2010.00186
Katz, T. A., Weinberg, D. D., Fishman, C. E., Nadkarni, V., Tremoulet, P., Te Pas, A. B., et al. (2019). Visual attention on a respiratory function monitor during simulated neonatal resuscitation: an eye-tracking study. Arch. Dis. Childhood-Fetal Neonatal Ed. 104, F259–F264. doi: 10.1136/archdischild-2017-314449
Kelly, S. P., Dockree, P., Reilly, R. B., and Robertson, I. H. (2003). “EEG alpha power and coherence time courses in a sustained attention task,” in First International IEEE EMBS Conference on Neural Engineering, 2003. Conference Proceedings. (Piscataway, NJ: IEEE), 83–86. doi: 10.1109/CNE.2003.1196761
Klimesch, W. (1999). EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Rev. 29, 169–195. doi: 10.1016/S0165-0173(98)00056-3
Klimesch, W., Doppelmayr, M., Russegger, H., Pachinger, T., and Schwaiger, J. (1998). Induced alpha band power changes in the human EEG and attention. Neurosci. Lett. 244, 73–76. doi: 10.1016/S0304-3940(98)00122-0
Kukkonen, S. (2005). Exploring eye tracking in design evaluation. Join. Forces 119–126. Available online at: http://www2.uiah.fi/joiningforces/papers/Kukkonen.pdf
Lee, J. W., and Ahn, J. H. (2012). Attention to banner ads and their effectiveness: an eye-tracking approach. Int. J. Electron. Commer. 17, 119–137. doi: 10.2753/JEC1086-4415170105
Lehmann, D., and Michel, C. M. (1990). Intracerebral dipole source localization for FFT power maps. Electroencephalogr. Clin. Neurophysiol. 76, 271–276. doi: 10.1016/0013-4694(90)90022-C
Li, S., Walters, G., Packer, J., and Scott, N. (2018). A comparative analysis of self-report and psychophysiological measures of emotion in the context of tourism advertising. J. Travel Res. 57, 1078–1092. doi: 10.1177/0047287517733555
Mano, H. (1996). Assessing emotional reactions to TV ads: a replication and extension with a brief adjective checklist. ACR North Am. Adv. 23, 63–69.
Mauss, I. B., and Robinson, M. D. (2009). Measures of emotion: a review. Cogn. Emot. 23, 209–237. doi: 10.1080/02699930802204677
Measures, S., Boucsein, W., Fowles, D. C., Grimnes, S., Ben-Shakhar, G., Roth, W. T., et al. (2012). Publication recommendations for electrodermal measurements. Psychophysiology 49, 1017–1034. doi: 10.1111/j.1469-8986.2012.01384.x
MediaRatingCouncil IAB (2014). MRC Viewable Ad Impression Measurement Guidelines. Available online at: https://www.thinkwithgoogle.com/marketing-resources/data-measurement/5-factors-of-viewability/ (accessed January 6, 2021).
Milosavljevic, M., and Cerf, M. (2008). First attention then intention: Insights from computational neuroscience of vision. Int. J. Advert. 27, 381–398. doi: 10.2501/S0265048708080037
Milton, A., and Pleydell-Pearce, C. W. (2016). The phase of pre-stimulus alpha oscillations influences the visual perception of stimulus timing. Neuroimage 133, 53–61. doi: 10.1016/j.neuroimage.2016.02.065
Mitra, A., Raymond, M. A., and Hopkins, C. D. (2008). Can consumers recognize misleading advertising content in a media rich online environment? Psychol. Mark. 25, 655–674. doi: 10.1002/mar.20230
Modica, E., Cartocci, G., Rossi, D., Martinez Levy, A. C., Cherubino, P., Maglione, A. G., et al. (2018). Neurophysiological responses to different product experiences. Comput. Intell. Neurosci. 2018:9616301. doi: 10.1155/2018/9616301
Modica, E., Rossi, D., Maglione, A. G., Venuti, I., Brizi, A., Babiloni, F., et al. (2017). “Neuroelectrical indices evaluation during antismoking public service announcements on a young population,” in 2017 IEEE 3rd International Forum on Research and Technologies for Society and Industry (RTSI) (Piscataway, NJ: IEEE), 1–5. doi: 10.1109/RTSI.2017.8065949
Most, S. B., Simons, D. J., Scholl, B. J., Jimenez, R., Clifford, E., and Chabris, C. F. (2001). How not to be seen: the contribution of similarity and selective ignoring to sustained inattentional blindness. Psychol. Sci. 12, 9–17. doi: 10.1111/1467-9280.00303
Neurons Inc (2021). What Is Your 1-Second Digital Ad Strategy? Available online at: https://neuronsinc.com/cases/mma/ (accessed May 27, 2021).
Nielsen, J. (2007). Banner Blindness: The Original Eyetracking Research, 10-Year Research Overview. Available online at: https://www.nngroup.com/articles/banner-blindness-original-eyetracking/ (accessed February 16, 2021).
Ohme, R., Reykowska, D., Wiener, D., and Choromanska, A. (2009). Analysis of neurophysiological reactions to advertising stimuli by means of EEG and galvanic skin response measures. J. Neurosci. Psychol. Econ. 2, 21–31. doi: 10.1037/a0015462
Ohme, R., Reykowska, D., Wiener, D., and Choromanska, A. (2010). Application of frontal EEG asymmetry to advertising research. J. Econ. Psychol. 31, 785–793. doi: 10.1016/j.joep.2010.03.008
Pan, J., and Tompkins, W. J. (1985). A real-time QRS detection algorithm. IEEE Trans. Biomed. Eng. 1985, 230–236. doi: 10.1109/TBME.1985.325532
Paulhus, D. L. (2002). “Socially desirable responding: the evolution of a construct,” in The Role of Constructs in Psychological and Educational Measurement, eds H. I. Braun, D. N. Jackson, and D. E. Wiley (Mahwah, NJ: Lawrence Erlbaum Associates Publishers), 49–69.
Pernice, K. (2018). Banner Blindness Revisited: Users Dodge Ads on Mobile and Desktop. Available online at: https://www.nngroup.com/articles/banner-blindness-old-and-new-findings/ (accessed July 26, 2020).
Poels, K., and Dewitte, S. (2011). How to capture the heart? reviewing 20 years of emotion measurement in advertising. SSRN Electron. J. 2011:48. doi: 10.2139/ssrn.944401
Posner, J., Russell, J. A., and Peterson, B. S. (2005). The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev. Psychopathol. 17:715. doi: 10.1017/S0954579405050340
Russell, J. A., and Barrett, L. F. (1999). Core affect, prototypical emotional episodes, and other things called emotion: dissecting the elephant. J. Pers. Soc. Psychol. 76:805. doi: 10.1037/0022-3514.76.5.805
Sauseng, P., Klimesch, W., Stadler, W., Schabus, M., Doppelmayr, M., Hanslmayr, S., et al. (2005). A shift of visual spatial attention is selectively associated with human EEG alpha activity. Eur. J. Neurosci. 22, 2917–2926. doi: 10.1111/j.1460-9568.2005.04482.x
Sharethrough (2015). Native Ads vs. Banner Ads. Available online at: https://www.sharethrough.com/resources/in-feed-ads-vs-banner-ads/ (accessed November 27, 2019).
Silverman, D. (2019). IAB Internet Advertising Revenue Report. Iab. Available online at: https://www.iab.com/wp-content/uploads/2019/05/Full-Year-2018-IAB-Internet-Advertising-Revenue-Report.pdf (accessed June 26, 2020).
Siyanova-Chanturia, A., Conklin, K., and Schmitt, N. (2011). Adding more fuel to the fire: an eye-tracking study of idiom processing by native and non-native speakers. Second Lang. Res. 27, 251–272. doi: 10.1177/0267658310382068
Skrandies, W. (1990). Global field power and topographic similarity. Brain Topogr. 3, 137–141. doi: 10.1007/BF01128870
Statista (2018). Number of Smartphone Users Worldwide 2014-2020. Available online at: https://www.statista.com/statistics/330695/number-of-smartphone-users-worldwide/ (accessed November 26, 2019).
Taylor, C. R. (2017). Native advertising: The black sheep of the marketing family. Int. J. Advertising 36, 207–209. doi: 10.1080/02650487.2017.1285389
Tobii, A. B. (2019). Make Mobile Device Testing. Tobii Pro. Available online at: https://www.tobiipro.com/product-listing/mobile-device-stand/ (accessed January 15, 2020).
Uusberg, A., Uibo, H., Kreegipuu, K., and Allik, J. (2013). EEG alpha and cortical inhibition in affective attention. Int. J. Psychophysiol. 89, 26–36. doi: 10.1016/j.ijpsycho.2013.04.020
Vecchiato, G., Astolfi, L., De Vico Fallani, F., Toppi, J., Aloise, F., Bez, F., et al. (2011). On the use of EEG or MEG brain imaging tools in neuromarketing research. Comput. Intell. Neurosci. 2011:643489. doi: 10.1155/2011/643489
Vecchiato, G., Astolfi, L., Fallani, F. D. V., Cincotti, F., Mattia, D., Salinari, S., et al. (2010). Changes in brain activity during the observation of TV commercials by using EEG, GSR and HR measurements. Brain Topogr. 23, 165–179. doi: 10.1007/s10548-009-0127-0
Vecchiato, G., Maglione, A. G., Cherubino, P., Graziani, I., Trettel, A., Herrera Ezquierro, M. T., et al. (2014a). Marketing and neuroscience: how electroencephalographic tools could help to design and analyze commercial advertising campaigns. Micro Macro Mark. 23, 279–292. doi: 10.1431/77724
Vecchiato, G., Maglione, A. G., Cherubino, P., Wasikowska, B., Wawrzyniak, A., Latuszynska, A., et al. (2014b). Neurophysiological tools to investigate consumer's gender differences during the observation of TV commercials. Comput. Math. Methods Med. 2014:912981. doi: 10.1155/2014/912981
Velásquez, J. D., Dujovne, L. E., and L'Huillier, G. (2011). Extracting significant website key objects: a semantic web mining approach. Eng. Appl. Artif. Intell. 24, 1532–1541. doi: 10.1016/j.engappai.2011.02.001
Vila, J., and Gomez, Y. (2016). Extracting business information from graphs: an eye tracking experiment. J. Bus. Res. 69, 1741–1746. doi: 10.1016/j.jbusres.2015.10.048
Vozzi, A., Ronca, V., Aric,ò, P., Borghini, G., Sciaraffa, N., Cherubino, P., et al. (2021). The sample size matters: to what extent the participant reduction affects the outcomes of a neuroscientific research. A case-study in neuromarketing field. Sensors 21:6088. doi: 10.3390/s21186088
Wang, Q., Yang, S., Liu, M., Cao, Z., and Ma, Q. (2014). An eye-tracking study of website complexity from cognitive load perspective. Decis. Support Syst. 62, 1–10. doi: 10.1016/j.dss.2014.02.007
Wasserman, E. (2013). Advertising Goes Native, and Deception Runs Free. Huffingt. Post, 1. Available online at: https://www.huffingtonpost.com/edward-wasserman/native-advertising-atlantic-scientology_b_2575945.html (accessed January 10, 2020).
Wojdynski, B. W. (2016a). Native Advertising: Engagement, Deception, and Implications for Theory. Santa Barbara, CA: Praeger/ABC Clio Santa Barbara. 203–236.
Wojdynski, B. W. (2016b). The deceptiveness of sponsored news articles: how readers recognize and perceive native advertising. Am. Behav. Sci. 60, 1475–1491. doi: 10.1177/0002764216660140
Keywords: EEG, eye tracking, autonomic recording, online users, mobile advertising, display advertising, native advertising
Citation: Mancini M, Cherubino P, di Flumeri G, Cartocci G, Martinez A, Sanchez A, Santillo C, Modica E, Vozzi A, Ronca V, Trettel A, Borghini G and Babiloni F (2022) Neuroscientific Methods for Exploring User Perceptions While Dealing With Mobile Advertising: A Novel and Integrated Approach. Front. Neuroergon. 3:835648. doi: 10.3389/fnrgo.2022.835648
Received: 14 December 2021; Accepted: 28 February 2022;
Published: 08 April 2022.
Edited by:
Jordan Navarro, Université de Lyon, FranceReviewed by:
Anna Borawska, University of Szczecin, PolandSiddharth Bhatt, Penn State Harrisburg, United States
Copyright © 2022 Mancini, Cherubino, di Flumeri, Cartocci, Martinez, Sanchez, Santillo, Modica, Vozzi, Ronca, Trettel, Borghini and Babiloni. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Marco Mancini, bWFyY28ubWFuY2luaSYjeDAwMDQwO2JyYWluc2lnbnMuY29t
†ORCID: Marco Mancini orcid.org/0000-0002-8707-5288
Patrizia Cherubino orcid.org/0000-0001-7669-5855
Gianluca di Flumeri orcid.org/0000-0003-4426-051X
Giulia Cartocci orcid.org/0000-0003-1347-1306
Ana Martinez orcid.org/0000-0003-3265-9806
Alessandro Sanchez orcid.org/0000-0002-8685-9144
Chiara Santillo orcid.org/0000-0003-0407-0244
Enrica Modica orcid.org/0000-0002-9793-6563
Alessia Vozzi orcid.org/0000-0002-8584-5023
Vincenzo Ronca orcid.org/0000-0002-7174-6331
Arianna Trettel orcid.org/0000-0002-8717-1421
Gianluca Borghini orcid.org/0000-0001-8560-5671
Fabio Babiloni orcid.org/0000-0002-4962-176X