Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 22 June 2021
Sec. Auditory Cognitive Neuroscience
This article is part of the Research Topic Loudness: From Neuroscience to Perception View all 10 articles

Toward an Individual Binaural Loudness Model for Hearing Aid Fitting and Development

  • Medizinische Physik and Cluster of Excellence Hearing4All, Universität Oldenburg, Oldenburg, Germany

The individual loudness perception of a patient plays an important role in hearing aid satisfaction and use in daily life. Hearing aid fitting and development might benefit from individualized loudness models (ILMs), enabling better adaptation of the processing to individual needs. The central question is whether additional parameters are required for ILMs beyond non-linear cochlear gain loss and linear attenuation common to existing loudness models for the hearing impaired (HI). Here, loudness perception in eight normal hearing (NH) and eight HI listeners was measured in conditions ranging from monaural narrowband to binaural broadband, to systematically assess spectral and binaural loudness summation and their interdependence. A binaural summation stage was devised with empirical monaural loudness judgments serving as input. While NH showed binaural inhibition in line with the literature, binaural summation and its inter-subject variability were increased in HI, indicating the necessity for individualized binaural summation. Toward ILMs, a recent monaural loudness model was extended with the suggested binaural stage, and the number and type of additional parameters required to describe and to predict individual loudness were assessed. In addition to one parameter for the individual amount of binaural summation, a bandwidth-dependent monaural parameter was required to successfully account for individual spectral summation.

Introduction

Being “too loud” is the most frequent descriptor for fitting problems with hearing aids (Jenstad et al., 2003), and current hearing aid fitting procedures take loudness into consideration (e.g., Moore and Glasberg, 1998; Byrne et al., 2001; Keidser et al., 2012). For instance, when deriving the widely used fitting formula NAL-NL1, loudness models were used to ensure that speech stimuli are not perceived louder by aided hearing impaired (HI) listeners than by normal hearing (NH) listeners (Byrne et al., 2001). Nevertheless, gains prescribed by NAL-NL1 or similar fitting procedures were still too high for many HI listeners (Keidser et al., 2012). This indicates that the loudness of HI listeners was underestimated by the loudness model and the prescribed gains were reduced in NAL-NL2 (Keidser et al., 2012).

Loudness perception differs significantly across individuals with similar audiometric hearing loss (Moore, 2000) and, to some extent, for NH listeners (e.g., Pieper et al., 2018). This suggests that loudness models with parameters based on averaged data, and with individualization of parameters for HI listeners inferred solely from their audiogram (e.g., Moore et al., 1999), might not be sufficient to predict individual loudness perception (Oetting et al., 2013; Pieper et al., 2018). Accordingly, if such models are involved in the first fitting of a hearing aid, subsequent manual adjustments are likely required. In order to improve individualized loudness predictions, existing parameters of loudness models need to be considered for individualization or additional parameter-controlled stages need to be introduced. Pieper et al. (2018) extended the physiologically motivated loudness model for average NH listeners for individualized loudness predictions of NH and HI listeners. In addition to typical assumptions like an expansive component (or reduced compression component) related to cochlear gain loss and an attenuation component (e.g., Launer, 1995; Derleth et al., 2001; Chalupper and Fastl, 2002; Moore and Glasberg, 2004; Chen et al., 2011a), they suggested a frequency-dependent post gain, potentially reflecting central gain mechanisms (for review, see Brotherton et al., 2015) to improve individual loudness predictions. Although the post gain improved the ability to fit the extended loudness model to individual loudness data for narrowband stimuli, predictions for broadband stimuli were not improved. Furthermore, their model was only applied to monaural stimuli. However, in realistic environments, sounds are typically perceived binaurally in addition to showing broadband properties, as observed for, e.g., speech and environmental noise.

With bilaterally aided HI listeners, it has been shown that binaurally presented broadband stimuli are perceived louder by aided HI listeners than by NH listeners at high levels, i.e., the uncomfortable level perceived as “too loud” is reached at lower levels (Oetting et al., 2018; van Beurden et al., 2020). For monaural presentation, this effect is smaller (Strelcyk et al., 2012; Oetting et al., 2016; Ewert and Oetting, 2018). Taken together, these findings suggest that binaural loudness summation can be affected by hearing loss and depend on the bandwidth of the stimulus. Parameters of binaural loudness summation might be related to physiological processes like the middle ear-muscle (MEM) reflex (Møller, 1962) or the medial olivocochlear (MOC) reflex (Berlin et al., 1993, 1995; Norman and Thornton, 1993; Guinan, 2006). Binaural loudness summation might as well be influenced by later stages of the central auditory system: Binaural inhibition was found in the inferior colliculus (see Li and Yue, 2002, for an overview) probably mediated in part by auditory neuronal stages prior to the inferior colliculus, such as the lateral superior olive (Finlayson and Caspary, 1991) or the dorsal nucleus of the lateral lemniscus (Faingold et al., 1993).

Most studies on binaural loudness summation use the loudness ratio between binaural loudness NB and monaural loudness NM in sones to quantify the amount of binaural loudness summation. The ratio NB/NM had been assumed to be close to 2 based on the assumption that binaural loudness is the sum of the monaural loudness in sones (e.g., Hellman and Zwislocki, 1963; ANSI S3.4, 2007), while more recent studies have suggested NB/NM < 2, i.e., binaural loudness in sones is less than twice the monaural loudness in sones (Zwicker and Zwicker, 1991; Sivonen and Ellermeier, 2006; Whilby et al., 2006; Epstein and Florentine, 2009). Current loudness models include a binaural inhibition stage to account for these findings (Moore et al., 2014, 2016): If assuming NB/NM = 1.5, a wide variety of averaged NH loudness data can be successfully predicted (Moore et al., 2016). For HI listeners, binaural level differences for equal loudness (BLDELs) were (slightly) underestimated (Moore et al., 2014), indicating that the assumed ratio of NB/NM = 1.5 might be too low to account for binaural loudness summation in HI individuals. Ewert and Oetting (2018) found higher ratios for HI listeners (NBNM= 2.1±0.5, mean ± standard deviation) than for NH listeners (NBNM= 1.7±0.4) using broadband stimuli. In combination, these results suggest that particularly in HI, individual differences in binaural loudness summation might exist.

The goal of this study is to develop a binaural loudness model that can be individualized for NH and HI listeners. Hearing aid fitting and development might benefit from individualized loudness models, enabling better adaptation of the processing to the individual needs, including model-based control of hearing aid signal processing to optimize loudness perception for arbitrary stimuli. Hereby, the critical question is how many and which parameters are required in addition to the commonly used cochlear gain or outer hair cell (OHC) loss and attenuation or inner hair cell (IHC) loss component, to allow for both the ability of the model to account for and to predict individual binaural loudness data in NH and HI listeners. Additional parameters should have a psychoacoustical or physiological motivation resulting in a structured functional model. In light of applicability for hearing aid development and fitting, loudness is modeled in four basic conditions covering the variety in bandwidth and binaurality occurring in natural sounds: (i) monaural narrowband, (ii) binaural narrowband, (iii) monaural broadband, and (iv) binaural broadband. For the model development and evaluation of this study, monaural and binaural loudness data were collected, focusing on narrowband stimuli with different center frequencies in order to be able to access the frequency dependency of binaural loudness summation. Additional loudness data were available from an earlier study of Oetting et al. (2016).

In a first experiment, a simplified binaural summation stage was devised and tested in a data-driven approach in which the binaural stage was applied directly to the measured monaural loudness data for the two ears of individual listeners. By this, binaural loudness summation can be assessed without relying on accurate loudness predictions for monaural stimulus presentation. The simplified binaural stage has a single parameter that controls the overall binaural gain. However, using monaural loudness data as input, this approach assumes that the binaural summation itself cannot be frequency- or bandwidth-dependent. Thus, in a second experiment, the monaural loudness model of Pieper et al. (2018) was extended with an augmented version of the above binaural summation stage where the binaural gain depends on the modeled internal excitation pattern after basilar membrane (BM) processing, which in turn depends on the bandwidth and level of the stimulus. Hereby, the modeled excitation pattern is influenced by individual properties of the peripheral auditory system, such as an individual OHC and IHC loss, and a central gain (Pieper et al., 2018). In order to improve monaural loudness predictions over those of Pieper et al. (2018), a bandwidth-dependent central gain is introduced into the monaural paths of the model prior to the binaural summation stage. Taken together, in addition to the frequency-dependent peripheral components OHC and IHC loss, commonly contained in HI loudness models, and the frequency-dependent post gain introduced in Pieper et al. (2018), four further frequency-independent parameters were introduced, which control a bandwidth-dependent monaural gain in each ear (two parameters), an overall binaural gain (one parameter), and the bandwidth dependency of the binaural gain (one parameter). The extended loudness model was then used to determine which of these individual parameters are required to describe loudness perception in the four basic conditions mentioned above. The improvement of the goodness of fit for each of the parameters was estimated in a hierarchic manner.

Suggestions are devised on which parameters and measurements are required to provide an individual loudness model applicable for hearing aid fitting and aided performance prediction.

Model Extensions and Modifications

The suggested binaural loudness model is based on the monaural loudness model of Pieper et al. (2018). Figure 1 shows the block diagram of the model. The colored parts contain model parameters used for individualization, with blue parts reflecting model extensions of this study. Here and in the following, subscripts L and R denote constants and variables of the left and right ear, respectively. Subscript B denotes constants and variables of the binaural summation stage. The model follows a signal processing chain structure where each stage receives input only from the previous stage.

FIGURE 1
www.frontiersin.org

Figure 1. Block diagram of the individual loudness model based on Pieper et al. (2018). Model parts colored in red and green contain frequency-dependent parameters to account for individual hearing loss. Red indicates attenuation and green indicates amplification. Here, the suggested model extensions for further individualization are colored in blue: the parameters βL and βR control a monaural bandwidth-dependent central gain for the left and right ears, respectively. αB controls the overall amount of binaural summation, and βB controls the binaural summation depending on the bandwidth of the input signals ZL,n,m + ZR,n,m.

The stimulus first passes through a fixed filter representing the transfer function from the sound source to the eardrums for free-field conditions. For frontal incident, the filter meets the ANSI S3.4 (2007) standard, in line with existing loudness models, e.g., Moore et al. (1997) and Chen et al. (2011b). If azimuth shifts from the frontal incidence were simulated, the same amplitude and phase shifts as for the stimuli were applied (see Section Apparatus, Procedure, and Stimuli).

The correction filter, attenuating low and amplifying high frequencies (see Pieper et al., 2016, 2018 for details), is applied to obtain a frequency-dependent absolute threshold according to ISO 389-7 (2005).

The middle ear transfer function is realized with a fixed finite impulse response filter that was fitted closely to the data of Puria (2003).

A physiologically plausible transmission-line model (TLM, e.g., Verhulst et al., 2018) of the cochlear simulates basilar membrane motion. The BM is divided in N = 1, 000 equidistant segments n. The cochlear gain of the BM can be reduced to account for OHC loss (indicated in red in Figure 1), typically referred to as compression loss component in the literature, accounting for steepening of the loudness function (loudness recruitment) as well as widening of auditory filter bandwidth. The TLM provides the segment velocities at the time steps m at a sampling frequency of 100 kHz. The absolute values (denoted |vL,n,m| for the left ear and |vR,n,m| for the right ear) are used as the input of the temporal integration stage.

Temporal integration is performed with a first-order low pass filter (time constant τ = 25 ms). Subsequently, the sampling frequency is reduced to 200 Hz.

IHC loss reflecting damage or loss of IHCs, often referred to as attenuation component in the literature, is implemented as linear attenuation prior to a constant internal threshold (referred to as pre attenuation, indicated red in Figure 1). The pre attenuation might be interpreted as a reduction of the summed spike rate of an adjacent IHC population, e.g., due to a reduction in the number of intact IHCs, attached synapses, or stereocilia (Pieper et al., 2018). The attenuation component shifts the entire loudness function to higher levels.

All signal parts below the internal threshold are set to 0, simulating the absolute hearing threshold. Thus, attenuation related to OHC and IHC loss prior to the internal threshold (shown in red) effectively increases the hearing threshold. The internal threshold might be interpreted as a specific summed spike rate, which has to be overcome in order to evoke responses in higher processing stages (Pieper et al., 2018).

The subsequent post gain (shown in green in Figure 1) is linear amplification applied to the signal part above the internal threshold, assumed to reflect effects of central gain (e.g., Heinz et al., 2005; Zeng, 2013). For HI listeners, a post gain exactly opposite to the pre attenuation counteracts the effect of the pre attenuation for high levels. This leads to the same uncomfortable level as in NH and steepening of the loudness function above the hearing threshold (see Figure 2 in Pieper et al., 2018). If the post gain is viewed as a part of the IHC loss component and depends on the pre attenuation, the current implementation of IHC loss as well as that of OHC loss are both functionally comparable to the respective components of other HI loudness models (e.g., Launer, 1995; Derleth et al., 2001; Chalupper and Fastl, 2002; Moore and Glasberg, 2004; Chen et al., 2011a). However, Pieper et al. (2018) demonstrated that the post gain is required to be a free parameter for both HI and NH listeners to account for individual differences in the steepness of loudness functions for narrowband stimuli.

FIGURE 2
www.frontiersin.org

Figure 2. Different theoretical assumptions of binaural summation, depicted as input-output functions. The output is the binaural loudness in sones NB. The input is the monaural loudness for the right ear NR, while the monaural loudness for the left ear NL is kept constant at 1 sone. In the suggested binaural stage, the individual amount of binaural summation can be controlled via a parameter αB. Gray solid line: the classical assumption that binaural loudness is the summed monaural loudness in sones. Gray dashed line: binaural stage of the loudness model of Moore et al. (2016). Black lines: simplified version (βB = 0, NL and NR as input) of the current binaural stage with αB = − 0.25 (dashed; comparable to Moore et al., 2016) and αB = − 0.36 (solid; obtained from the first experiment of this study).

In Pieper et al. (2018), the output of the post gain stage for each BM segment is denoted as Yn,m and is summed over the BM segments n at every time step m to yield the time-dependent internal loudness Im for a single ear (summation of specific loudness). In the current binaural model, Yn,m is calculated separately for each ear and is denoted as YL,n,m for the left ear and YR,n,m for the right ear.

At the output of the post gain stage, the model is extended (blue parts in Figure 1) by a monaural bandwidth-dependent central gain and a binaural summation stage. These extensions introduce four additional parameters that are considered for individualization:

i) Two monaural parameters, βL, and βR, for the left and right ears to adjust the monaural bandwidth-dependent central gain individually (see Equation 1),

ii) One parameter that controls the overall amount of binaural inhibition αB, and

iii) One parameter that controls the bandwidth dependency of binaural inhibition βB.

In the following, equations that are applied in both ears separately are described only for the left side.

Monaural Extension

In Pieper et al. (2018), the individually adjusted post gain did not improve the individual loudness predictions for broadband stimuli. No peripheral parameters (such as outer and middle ear transfer function, OHC and IHC loss, thresholds of BM compression) were identified, which quantitatively explain the remaining individual variations in spectral loudness summation. In principle, the physical BM properties could be individually altered in the TLM to change the auditory filter bandwidth and therefore affect the modeled spectral loudness summation. However, since auditory filters are already widened in HI models because of the OHC loss, and excitation patterns for narrowband stimuli already cover a large portion of the BM, further substantial changes in spectral loudness summation are not expected by such modifications (see, e.g., Zwicker and Scharf, 1965). Pieper et al. (2018) supposed that the medial olivocochlear reflex (Guinan, 2006) or more central mechanisms might be involved. These mechanisms might be altered as a consequence of hearing impairment and might therefore differ across ears. Therefore, as a first functional approach, an additional monaural bandwidth-dependent central gain [1 + βL · WL,m ] is introduced here (see Equation 1), which is multiplied with the output of the post gain stage YL,n,m in all segments of the BM at every time step m to obtain the final output of the monaural stage ZL,n,m (see Figure 1). The gain can be individualized with the constant parameter βL. The bandwidth estimator WL,m is calculated as a function of YL,n,m by dividing the average of YL,n,m across segments (Y¯L,m=1Nn=1NYL,n,m) by the mean of the absolute differences between YL,n,m and Y¯L,m (Equation 2).

ZL,n,m= [1+βL·WL,m ]·YL,n,m,    (1)
WL,m=Y¯L,m1Nn=1N|YL,n,m-Y¯L,m|-12·11-1N.    (2)

The second term -12·11-1N- 0.5 ensures that WL,m = 0 at the hearing threshold for a narrowband signal, for which YL,n,m > 0 occurs at a single segment only. Above hearing threshold, the excitation pattern broadens with level, particularly for narrowband stimuli, resulting in bandwidth estimations WL,m higher than 0. As a consequence, the bandwidth-dependent gain will alter the model output not only for broadband stimuli but for narrowband stimuli as well. However, as WL,m grows exponentially with the width of YL,n,m (in contrast to the linear growth of other bandwidth estimators used in, e.g., Rennies et al., 2009; Oetting et al., 2018), good separation between narrowband and broadband signals is maintained despite the broadening of excitation pattern for narrowband stimuli. The same is independently introduced in the right ear, resulting in the two monaural parameters βL and βR, respectively.

Binaural Stage

The binaural stage sums ZL,n,m and ZR,n,m present at the monaural paths of each segment. The sum is multiplied with a binaural gain to obtain the output ZB,n,m:

ZB,n,m=[1+ αBVB,n,m+ βBVB,n,mWB,m]·[ZL,n,m+ZR,n,m],    (3)

where VB,n,m denotes the binaural difference of ZL,n,m and ZR,n,m:

VB,n,m=1-|ZL,n,m-ZR,n,m|ZL,n,m+ZR,n,m.    (4)

Equation 4 is a simplified version of the equation that is used in Oetting et al. (2018) to estimate the binaural loudness difference. Here, VB,n,m equals 0 for monaural conditions (with either ZL,n,m = 0 or ZR,n,m = 0), in which case the stage does not alter loudness. VB,n,m equals 1 if the signals ZL,n,m and ZR,n,m are identical in the monaural paths (diotic stimuli), and is between 0 and 1 if a signal is present in both monaural paths.

Two constant parameters αB and βB are used to individualize the binaural stage. αB alters the gain as a function of the binaural difference VB,n,m. Binaural inhibition is modeled if αB < 0, as the gain is lower (and smaller than 1) the higher VB,n,m is, i.e., the more equal ZL,n,m and ZR,n,m are. βB alters the gain as a function of the binaural difference and the binaural bandwidth estimator WB,m. For WB,m, the same bandwidth estimation as for the monaural stage (Equation 2) is applied where YL,n,m is replaced by the binaural sum ZL,n,m + ZR,n,m. If βB is set to 0 and if the signal is identical in the monaural paths (VB,n,m = 1), αB directly reflects the amount by which ZL,n,m + ZR,n,m is altered.

Finally, summation of specific loudness is performed to derive the time-dependent internal binaural loudness:

Im=1Nn=1NZB,n,m    (5)

and transformed to loudness in sones by a power-law function and subsequently to loudness in categorical units CU by a non-linear transformation as described in the Appendix.

In order to test the binaural stage independently from the monaural stages of the loudness model, a slightly modified version of the suggested binaural stage was first used in a data-driven approach. This approach aims to predict binaural loudness from the monaural loudness measurements. For this, the empirically derived loudness in sones for monaural stimulus presentation NL and NR was used as input to the binaural stage, replacing the signals ZL,n,m and ZR,n,m of the monaural model paths. Given that only a single input value per ear exists and the bandwidth estimation WB,m is unknown in this case, the binaural bandwidth-dependent gain in Equation 4 is deactivated by setting βB to 0.

Figure 2 shows the input–output function of this simplified binaural stage in comparison to other assumptions for binaural loudness summation from the literature. The binaural loudness estimate NB is shown as a function of NR ranging from 0.01 to 1 sone, with NL kept constant at 1 sone. If αB is set to 0, the current binaural stage follows the classical assumption that the binaural loudness in sones NB is simply the sum of the monaural loudness in sones (gray solid line, Hellman and Zwislocki, 1963; ANSI S3.4, 2007). If αB is set to −0.25 (black dashed line), the input–output function is comparable to that of the binaural stage of Moore et al. (2016, gray dashed line), which accounts for a wide variety of averaged NH loudness data. If NR is much lower than NL (e.g., NR = 0.1, NL = 1), the contribution of NR to NB is still further reduced by the binaural inhibition, resulting in NB = 1.05, i.e., for large loudness differences between ears, the softer ear hardly contributes to binaural loudness.

Methods

Listeners

Eight NH listeners and eight HI listeners with slight-to-moderate sensorineural hearing loss (SNHL) participated in the study. The NH listeners had audiometric thresholds of 15 dB HL or better at the test frequencies 0.25, 0.5, 1, 2, 4, and 6 kHz. The mean audiometric thresholds and standard deviation of the HI group were 23 ± 11, 33 ± 12, 40 ± 11, 48 ± 18, 61 ± 12, and 59 ± 17 dB HL at the six test frequencies, respectively.

Apparatus, Procedure, and Stimuli

Adaptive categorical loudness scaling (Brand and Hohmann, 2002) was performed to obtain loudness estimates for narrowband low-noise noise (LNN) stimuli with center frequencies of 0.25, 0.5, 1, 2, 4, and 6 kHz and a bandwidth of one-third octave. In comparison to other loudness measurement procedures, loudness scaling offers an easy and fast method applicable in a clinical context. The listener judges loudness on a scale with 11 labeled and unlabeled categories. Labeled categories are “no heard” (0 CU), “very soft” (5 CU), “soft” (15 CU), “medium” (25 CU), “loud” (35 CU), “very loud” (45 CU), and “too loud” (50 CU). In between the categories “very soft” and “very loud,” the categories alternate between labeled and unlabeled categories (10, 20, 30, and 40 CU). In addition to the widely used narrowband stimuli, broadband stimuli were presented to a subset of four NH and four HI listeners. The broadband stimuli, referred to as international female (IF) speech noise, were stationary speech-shaped noise generated from the international speech test signal (Holube et al., 2010). The spectral shape of the signal is the same as the (international) long-term average speech spectrum for females (Byrne et al., 1994). IF noise stimuli were presented unaided or aided. For the aided condition, the monaural narrowband loudness compensation, as described in Oetting et al. (2016), was employed: The spectrum of the stimulus is divided in adjacent frequency bands, and the monaural loudness of the HI listener is restored to average NH loudness in each band. For HI listeners, this resulted in higher amplifications of frequency bands with lower power, resembling the non-linear, level-dependent gain in a hearing aid. Exactly the same procedure was applied for the individual NH listeners (with considerably smaller adjustments than required for HI) and is also referred to as “aided” for NH.

For each listener, the stimuli were presented monaurally in the left, in the right ear, and diotically via headphones (Sennheiser HDA200). The listeners were seated in a sound attenuating booth, and responses were collected from a touchscreen connected to a personal computer. Signal generation and experimental control were performed in MATLAB using the AFC package (Ewert, 2013). The headphones were free-field equalized. For the diotic presentation, this means a simulated frontal incident of the sound waves. For the IF noise stimuli, additional azimuth shifts of the incident to the left by 60° and to the right by 60° were simulated. For this, frequency-dependent interaural level and phase differences were applied derived from the interaural differences in the head-related binaural impulse responses for ±60° re frontal incidence of the database from Kayser et al. (2009).

Headphone calibration and equalization ensured level differences between the left and right ears in the binaural conditions of <3 dB for all tested frequencies. In the following, we refer to the outcome of the respective measurements performed in this study as Dataset 1.

As a second set of data (referred to as Dataset 2), categorical loudness scaling data of eight NH and 10 HI listeners of Oetting et al. (2016) were used in this study1. The monaural data for the left ear were the same as those used in Pieper et al. (2018). Data for the same narrowband LNN stimuli as used in this study were available but only for monaural presentation. However, data for a narrowband uniform exciting noise (UEN1, Fastl and Zwicker, 2007) with a center frequency of 1,370 Hz and a bandwidth of 210 Hz were available for both monaural aided and binaural aided conditions. For narrowband stimuli, aided conditions imply that not the same level but the same (monaural) loudness was presented to each ear. Broadband stimuli were the same IF noise stimuli used in this study. For NH listeners, only data for unaided conditions are available.

Estimation of Loudness Functions

The fitting procedure “BTUX,” as recommended by Oetting et al. (2014), was performed to derive individual loudness functions as well as the hearing thresholds from the raw data of Datasets 1 and 2. BTUX fits a loudness function proposed by Brand and Hohmann (2002) that consists of two straight lines connected with a Bezier curve to the loudness data. First, the hearing threshold level is estimated from all raw data points and assumed to correspond to loudness of 2.5 CU between categories 0 CU (“not heard”) and 5 CU (“very soft”). The function is then fitted to all data points above threshold with the prescribed threshold level at 2.5 CU using the least-squares method in the direction of the level (X-direction). If <5 data points are available between 35 and 50 CU, the slope of the upper straight line is set to a fixed value. The hearing threshold estimations of BTUX were used in the following experiment II.

The reference NH functions used for the narrowband loudness compensation (aided conditions) were the same as those shown in Table 2 in Oetting et al. (2016). These functions are the average loudness functions across nine NH listeners.

Experiment I: Binaural Loudness Summation and Data-Driven Binaural Stage

In the first experiment, the binaural summation ratios R were calculated for the individual loudness functions from Datasets 1 and 2. R was defined as:

R=2NBNL+NR,    (6)

where NB denotes the binaural loudness in sones and NL and NR the monaural loudness for the left and right ear, respectively. R>2 indicates that the binaural loudness NB is higher than the sum of the monaural loudness values. This is referred to as binaural excitation in the following. R < 2 indicates binaural inhibition (e.g., Moore et al., 2016). Given that loudness had been measured in CU, the CU values were transformed to sone values with the five-parameter cubic function as suggested by (Heeren et al., 2013). Contrary to the procedure commonly used in the literature, where loudness categories are calculated for fixed sound pressure levels, loudness ratios were calculated for the given loudness categories of the binaural (diotic) condition. This allows the comparison of loudness ratios across listeners for, e.g., medium loudness (25 CU) or the “very loud” category (45 CU) close to the uncomfortable level. To obtain the ratio R, the level at which the individual binaural loudness function yields the desired CU value was determined. For that level, the respective CU values of the individual monaural loudness functions were obtained. These binaural and monaural CU values at an equal level were then transformed to sone values.

The value of R is comparable to the binaural summation ratios given in earlier studies if the same loudness was present in both ears, i.e., NL equals NR. For the diotic data of this study, loudness can be unequal in both ears, in particular in the case of unaided asymmetric hearing loss, so that the individual values of R are expected to be closer to 2 compared with those found in the literature. Thus, the ratio R (Equation 6) does not directly indicate binaural inhibition or excitation if unequal loudness occurs across the ears. In order to enable comparisons with the literature and across listeners and conditions in the case of unequal loudness across ears, the simplified binaural summation stage (operating on the monaural empirical loudness data in sones, see model extensions above) can be used to derive “corrected” ratios as would have been observed for equal loudness in both ears (see below).

In order to quantify the possible benefit of individualizing the binaural stage, the simplified binaural summation stage (which was fitted to the individual binaural summation ratios for each listener) was compared with a binaural stage that only considers the average (non-individualized) binaural gain derived for NH. After transformation of the stage output in sones back to CUs, the error between CUs inferred with the individualized and non-individualized stage and measured loudness functions was calculated and compared.

The individualized implementation of the binaural stage was realized by allowing for individual values of the binaural gain αB. Individual values were derived by fitting the loudness ratios calculated from the model outputs R^s,c to the empirically derived loudness ratios Rs,c for the LNN stimuli, using αB as the fit parameter. The error function that was minimized in the fit was:

s=16c=1550(lg(R^s,c)-lg(Rs,c))2,    (7)

where s = 1, 2, …, 6 is the number of the six LNN stimuli, and c = 15, 20, …, 50 is the loudness category of the empirical loudness function for diotic conditions before transformation to loudness in sones. 5 and 10 CU were excluded in experiment I to ensure that the monaural loudness was always above the hearing threshold. The non-individualized stage used the mean value across the individual values for αB of the NH listeners.

The amount of binaural inhibition can be assessed more directly if the summation ratios are derived for equal monaural loudness in both ears. Since the hearing thresholds of the HI listeners are usually less symmetric than for the NH listeners, unequal loudness in both ears is to be expected in particular for unaided HI listeners if measurement conditions are diotic. Unequal loudness generally reduces the effect of binaural inhibition or excitation, leading to ratios of R closer to 2 compared with the case where loudness is equal in both ears2. Thus, in addition to the calculations of R for a diotic condition as given above (Equation 6), binaural summation ratios were estimated for equal loudness in both ears: substitution of the binaural loudness NB in Equation 6 with the simplified version of Equation 3 (internal loudness Zn,m replaced by loudness in sones N, βB = 0, see model extensions above) and inserting equal loudness NL = NR yields the “corrected” binaural summation ratio for assumed equal loudness in both ears:

R=2·(1+αB).    (8)

To obtain the binaural summation ratio for assuming equal loudness for a certain stimulus, the fit procedure described above was applied to the stimulus in isolation to determine αB in Equation 8. It should be noted that the binaural summation ratios resulting from this procedure are assumed to be independent of the loudness category.

In the fits, αB had a lower limit of αB = − 0.5. This constraint ensured that binaural loudness is not lower than monaural loudness in the stage predictions as well as in the ratios for equal loudness (R ≥ 1 in Equation 8).

Experiment II: Individual Parameters to Describe Monaural and Binaural Loudness

In the second experiment, the complete loudness model was individualized for each listener. In contrast to the isolated simplified binaural stage in experiment I, the loudness model accounts for the auditory preprocessing of the stimuli before they enter the binaural stage. Auditory preprocessing includes the frequency-place transformation on the BM, and thus spectral and bandwidth properties of the stimuli are available to the binaural summation stage and their effect on binaural loudness summation can be assessed.

Similar to experiment I, different model versions were tested for their ability to account for the empirical loudness data. Each version added an additional free parameter. In order to determine the individual parameter values, the individualized models were fitted to measured data for appropriate selected measurement conditions, e.g., monaural broadband data were added to the selection once the bandwidth-dependent individual monaural gain was enabled. The remaining loudness data were then predicted with the individualized models. The non-linear correlation coefficient (ncc), the root mean squared error (rmse), and the bias (bias) were used as performance measures. These measures are based on the level differences between modeled and measured loudness functions at a certain CU. The non-linear correlation coefficient ncc was calculated as:

ncc=1-sc=550(Ls,c-L^s,c)2sc=550(Ls,c-L¯)2.    (9)

L¯ denotes the mean of the empirically derived levels Ls, c across all stimuli s and 10 categories c = 5, 10, …, 50. L^s,c are the respective model predictions. The category 0 CU was excluded as the model output is 0 CU for all levels below the hearing threshold. If all predicted levels match the empirically derived levels, i.e., L^s,c equals Ls,c for all s and c, ncc = 1 is obtained. If ncc equals 0, the predictions are as good as with L¯ as predictor. Additionally, the adjusted ncc' was calculated when using all stimuli s to account for the number of individualized parameters p, i.e., the degrees of freedom of the model:

ncc=1-(1-ncc)n-1n-p-1,    (10)

where n = 10 · s is the number of observations. The adjusted ncc' was not calculated for a single stimulus where the number of parameters is higher than the number of observations.

The root mean square error rmse estimates the average deviation in dB between model and data:

rmse=110c=550(Lc-L^c)2.    (11)

The bias was calculated to identify systematic offsets in dB:

bias =110c=550(Lc-L^c).    (12)

Positive bias values indicate that the predicted loudness function is on average shifted to higher levels compared with the empirically derived loudness function (loudness is on average underestimated). rmse and bias were calculated for each stimulus in isolation.

The extension of the model with a binaural summation stage made it necessary to refine fixed parameters of the final transformations to loudness in sones and CU in the model (see Appendix). The procedure performed to refine those parameters also resulted in a non-individualized binaural stage modeling the average NH inhibition of the NH listeners in Datasets 1 and 2.

The following four model versions were considered, which incorporate a successively increasing number of free parameters in the above-described monaural and binaural stages:

1) Binaural stage with average NH binaural inhibition:

• Model version 1 is the loudness model of Pieper et al. (2018), modified to account for average NH binaural inhibition. As in Pieper et al. (2018), the individual OHC and IHC losses were derived from the hearing threshold, and the lower slope of the loudness functions for monaurally presented narrowband LNN stimuli at frequencies 0.25, 0.5, 1, 2, 4, and 6 kHz. The cochlear gains of the TLM were set to account for OHC loss, and the pre attenuations were set to account for the IHC loss. The monaural post gains were fitted to the loudness functions for the monaural LNN stimuli. These individualization steps were performed for each ear separately. No monaural or binaural bandwidth dependencies were assumed, i.e., βL = βR = βB = 0. The above-mentioned non-individualized binaural stage was used to account for average NH inhibition.

2) Addition of individualized bandwidth-dependent gain in the monaural paths:

• The bandwidth-dependent gain in the monaural paths was individualized by adding βL and βR to the set of free parameters and by adding the monaural loudness data for the aided IF noise stimuli with frontal incidence to the targeted empirical data3. For the NH data of Dataset 2, no aided conditions were available; thus, the unaided IF noise stimuli were used. As new data were added to the fit, the weightings in the error function needed to be reconsidered4. The same binaural stage as in model version 1 was used.

3) Individualized gain of the binaural stage, independent of bandwidth:

• Similar to experiment I, αB was used as the free parameter to fit the model to the diotic/binaural narrowband loudness functions. For the listeners measured in this study, the data from Dataset 1 were used for the six diotic LNN stimuli. From Dataset 2, only one binaural narrowband stimulus was available per group: aided UEN1 for HI and unaided UEN1 for NH.

4) Individualized bandwidth-dependent gain of the binaural stage:

• Here βB was considered as a free parameter in addition to αB in the binaural stage, and the loudness function for the aided binaural IF noise stimulus was added to the targeted empirical data. In order to ensure equal weighting of the narrowband and broadband data, the error for the IF noise stimulus was weighted by the number of narrowband stimuli used, which is 6 for Dataset 1 and 1 for Dataset 2. Again, for the NH listeners of Dataset 2, only unaided conditions were available and used.

It should be noted that adjustments of model parameters to the data are referred to as “fitting.” The modeled loudness data are only referred to as model “prediction” if the empirical data for the same stimulus were not used in the process of fitting model parameters.

Results

Experiment I: Binaural Loudness Summation and Data-Driven Binaural Stage

The data collected here characterize binaural loudness summation for narrowband stimuli with relatively fine frequency resolution for a wide range of frequencies (0.25, 0.5, 1, 2, 4, and 6 kHz) and for the whole level range from hearing threshold to or close to an uncomfortable level, as covered by the loudness functions. In addition, binaural loudness summation for broadband stimuli (IF noise aided and unaided) was assessed. The raw loudness data and the loudness functions are provided in the Supplementary Material. Here, Figures 3, 4 show the inferred loudness ratios R in sones/sones from the data for the NH and HI listeners, respectively. The empirically derived ratios of the NH listeners are usually lower than 2, indicating binaural inhibition in all the NH listeners (solid lines and x symbols of lightened colors). The values are similar across the NH listeners with the exception of NH3, whose data show basically no binaural summation (R close to 1). Nevertheless, as for the other NH listeners, the ratios for NH3 show no dependency of R on the loudness region (“soft,” “medium,” “loud–very loud” at 15, 25, and 40 CU, respectively), indicated by the loudness of the diotically presented stimulus (orange: 15 CU, gray: 25 CU, purple: 40 CU), and therefore R also does not depend on the stimulus level, as previously found by Marozeau et al. (2006). In some of the NH listeners, some unsystematic variation of the ratios with the stimulus frequency is observed. In contrast to the NH listeners in Figure 3, the ratios for the HI listeners in Figure 4 vary considerably across listeners and within listeners across stimuli. The ratios for HI3, HI4, and HI7 are predominantly higher than 2, indicating binaural excitation. Occasionally, quite high ratios are observed for few frequencies and mostly low levels (and low loudness categories) close to the hearing threshold (maximum ratio R = 7.9 at 0.5 kHz, 15 CU for HI4). On average, across the listeners (bottom panels), the ratios of NH and HI decrease slightly with increasing frequency.

FIGURE 3
www.frontiersin.org

Figure 3. Loudness ratios R = 2NB/(NL + NR) between loudness for diotic presentation NB in sones and summed monaural loudness NL + NR in sones for the NH listeners of Dataset 1. The lines indicate diotically presented narrowband LNN stimuli with different center frequencies (0.25, 0.5, 1, 2, 4, and 6 kHz). Broadband IF noise stimuli with frontal incidence for unaided (IFN) and aided (IFNa) conditions are indicated with symbols. The colors indicate the loudness in CU for the diotic condition (orange: 15 CU, “soft,” gray/black: 25 CU, “medium,” purple: 40 CU, “loud–very loud”). The empirical data are shown as solid lines (narrowband stimuli) and x symbols (broadband stimuli) in lightened colors. Dashed lines and + symbols indicate the respective model calculations of the individualized binaural stage (the individual values for αB are given for each listener). The bottom panel shows the averaged data across the NH listeners. Standard deviations are indicated with error bars.

FIGURE 4
www.frontiersin.org

Figure 4. As Figure 3 but for the HI listeners of Dataset 1.

For the NH listeners (Figure 3), the binaural model stage (dashed lines and + symbols) can be closely fitted to the ratios across all frequencies and loudness regions via parameter αB. For the HI listeners (Figure 4), the fit of the binaural model stage (dashed lines and + symbols) shows deviations to the empirically derived loudness ratios (solid lines and x symbols), particularly in the low loudness region (orange lines and symbols). However, because low loudness categories cover a high loudness range in sones if sones are plotted on a logarithmic scale (see Figure 3 in Heeren et al., 2013), ratios inferred after transformation to loudness in sones at low loudness categories are most sensitive to inconsistencies in the response of the listener and any biases in the method5. This is particularly true for the steep loudness functions found in HI listeners at low loudness categories (see, e.g., Oetting et al., 2016). Conversely, in the low loudness region, high deviations of the loudness ratios translate into relatively low deviations for the modeled binaural loudness in CUs.

Figure 5 shows the error of the binaural summation stage if the modeled binaural loudness in sones is transformed back to CUs (HI listeners only). Dashed lines and + symbols indicate the errors for the fits of the binaural stage via αB, i.e., the individualized binaural stage for which the modeled loudness ratios are shown as dashed lines in Figure 4. Solid lines and x symbols indicate errors if αB was fixed to the average value αB = − 0.36 of the NH listeners, i.e., for the non-individualized binaural stage using average NH binaural inhibition. Errors in CUs are indeed low for the low loudness region. The absolute errors are lower than 5 CU for (binaural) loudness values of 15 CU (orange lines and symbols). The errors increase with loudness (gray: 25 CU, purple: 40 CU), as reflected by the mean values of the absolute errors across listeners shown in the bottom panel of Figure 5.

FIGURE 5
www.frontiersin.org

Figure 5. Deviations between model calculations of binaural loudness in CUs and empirical binaural loudness data in CUs for the HI listeners of Dataset 1. As in Figure 4, the color indicates the loudness of the diotic signal. Dashed lines and x symbols are for the individualized binaural model stage (see Figure 4). Solid lines and + symbols of lightened color are for the model using average NH binaural inhibition (Figure 3, mean of αB = −0.36). The bottom panel shows the averaged absolute errors across listeners.

Individualized binaural summation reduces the errors of the modeled loudness for individual HI listeners at the high loudness region. This is shown by a comparison of the errors at 40 CU for the individualized binaural stage (purple dashed lines and + symbols) and the errors for the average NH binaural inhibition (purple solid lines and × symbols): For HI3 and HI4, the individualization reduces these errors by approximately 10 CU or two loudness categories. For HI7, these errors are reduced by more than a loudness category (5 CU) for the narrowband LNN stimuli with low center frequencies and for the broadband IFN stimuli. From the subgroup for which broadband data are available (HI 5–8), the two listeners HI6 and HI7 show decreased binaural inhibition for the narrowband stimuli (i.e., the fit to the narrowband data resulted in parameters αB = −0.1 and αB = 0.09, respectively). For these listeners, the accuracy of the binaural broadband predictions is increased (+ symbols in Figure 5) compared with no individualization (αB = −0.36, × symbols at “IFNa” label in Figure 5). However, ratios inferred with the binaural model stage are similar for all stimuli within a listener. Thus, the stage does not account for, e.g., the frequency dependencies of binaural summation ratios in HI2 (compare purple solid with a dashed line in Figure 4 and see purple dashed line in Figure 5) or the increased binaural summation for the aided broadband stimulus (IFNa) in HI7 (compare x with + symbols at “IFNa” label in Figure 4).

The model fits are mostly determined by high loudness categories and almost not affected by low loudness categories, as indicated by the differences in error between fitted (dashed lines and + symbols) and unfitted (solid lines and x symbols) models in Figure 5. These differences are highest for high loudness categories (purple) and almost nonexistent for low loudness categories (orange). This is beneficial for the ratios for “assumed equal loudness between ears” addressed below, which are based on the model fits, because, as mentioned above, the ratios inferred for low loudness categories are most sensitive to inconsistencies in the response of the listener and any biases in the method.

Tables 1, 2 show the binaural summation ratios for each stimulus in isolation averaged across categories (15 to 50 CU) and NH or HI listeners. Table 1 shows the resulting ratios (mean ± standard deviation across listeners) for the data collected in this study and discussed above (Dataset 1) and Table 2 for the additional Dataset 2 provided by Oetting et al. (2016). In both tables, columns 4 and 5 list the ratios averaged across NH and HI listeners, respectively. As in Figures 3, 4, the ratios listed in the upper half of the table are for diotic conditions.

TABLE 1
www.frontiersin.org

Table 1. Binaural summation ratios R averaged (mean ± standard deviation) across listeners of Dataset 1 (column 4: NH, column 5: HI) and across categories (15–50 CU).

TABLE 2
www.frontiersin.org

Table 2. Binaural summation ratios averaged across listeners of Dataset 2.

In both datasets, the standard deviations across the HI listeners (column 5) are more than twice as high as across the NH listeners (column 4) for all diotic conditions, indicating a higher inter-subject variability of binaural summation for the HI listeners. For the narrowband stimuli in Dataset 1, this observation is confirmed by a significant main effect of listeners group (p < 0.05) performing a two-way mixed-design ANOVA applied to Levene's absolute deviation estimate for each condition (column 6 of the upper part of Table 1 in the row labeled with ANOVA). For the individual narrowband LNN stimuli, Levene's test for equal variances between groups (NH and HI listeners) showed a significant difference in variances (p < 0.05) for most of the center frequencies (0.25, 0.5, 2, and 4 kHz) as well as for the broadband unaided IFN stimulus in Dataset 2 (column 6 in Table 2). Here and in the following, no correction for multiple comparisons was applied, as they were performed following a significant main effect of the ANOVA omnibus test.

In both datasets, the average binaural summation ratios are higher for the HI listeners than for the NH listeners, again for all diotic conditions: However, a significant main effect of the listeners group (p < 0.05) was not found performing a two-way mixed-design ANOVA (column seven in the row labeled with ANOVA). Significant differences in the average ratios (p < 0.05) between the groups were found for unaided IFN in Dataset 2 (Welch's t-test, column seven).

The lower halves of both Tables 1, 2 list the ratios for assumed equal loudness in both ears as described in the Method section of experiment I. The ratios for assumed equal loudness in the ears averaged across the NH listeners of Dataset 1 differ by 5.6, 5.8, 5.3, 5.2, 6.7, and 10.7% (median across absolute percentages) from the ratios for the original diotic measurement conditions at the stimuli center frequencies of 0.25, 0.5, 1, 2, 4, and 6 kHz, respectively. For the HI listeners of Dataset 1, the respective values are 5.7, 5.2, 7.1, 7.8, 9.2, and 15.3 %, and therefore similar to the values of the NH listeners at low frequencies but increased for medium to high frequencies.

For the NH listeners, inter-subject variability of the ratios for assumed equal loudness in ears is similar to the ratios for diotic conditions (compare standard deviations in column 4 between upper and lower halves in both tables). Contrary to the NH listeners, inter-subject variability is increased for the HI listeners (compare standard deviations in column 45 between upper and lower halves in both tables). As for the upper part of Table 1, a significant main effect of the listeners group (p < 0.05) on variance was found performing a two-way mixed-design ANOVA applied to Levene's absolute deviation estimate (column six in the row labeled with ANOVA). For the individual condition, significantly different variances were found for LNN with low to medium center frequencies (0.25, 0.5, 1, and 2 kHz) and aided IFN in Dataset 1. No significant differences are observed for LNN with high center frequencies (4 and 6 kHz) and unaided IFN. On the contrary, in Dataset 2 where more listeners participated in the measurements for broadband conditions (8 NH and 10 HI listeners in Dataset 2 compared with the subset of 4 NH and 4 HI listeners in Dataset 1), a significant difference is found for unaided IFN.

The mean loudness ratios are generally higher for the HI listeners than for the NH listeners for all conditions in both datasets; but no significant main effect of the listener group was found performing a two-way mixed-design ANOVA applied to Dataset 1.

Except for the IFN where only four listeners participated in the measurements for Dataset 1, comparable measurement conditions yielded similar results between datasets. The ratios of the NH groups are similar for both datasets for narrowband noises with a center frequency of approximately 1 kHz: The ratio for assumed equal loudness in ears inferred from Dataset 1 for the LNN stimulus with a center frequency of 1 kHz is 1.39 ± 0.3. The ratio for assumed equal loudness in ears inferred from Dataset 2 for the UEN1 stimulus (center frequency: 1.37 kHz) is 1.28 ± 0.16. The respective ratios for the HI groups are both higher than for the NH groups: the ratio is 1.97 ± 0.95 for Dataset 1 and 1.68 ± 0.69 for Dataset 2.

Binaural summation ratios derived from Dataset 2 suggest an increase in the ratio with bandwidth in the NH group, as the ratio for assumed equal loudness in the ears for the (unaided) IFN stimulus is higher (1.79 ± 0.35) than for the UEN1 stimulus (1.28 ± 0.16). On the contrary, ratios derived from Dataset 1 show only a slight increase for unaided IFN (1.49 ± 0.32 compared with 1.39 ± 0.3 for 1 kHz LNN) and no increase for aided IFN (1.27 ± 0.09). For the HI group of Dataset 1, the ratios for assumed equal loudness in the ears suggest increased binaural summation for aided IFN (2.69 ± 2.32 compared with 1.97 ± 0.95 for 1 kHz LNN) but a decrease for unaided IFN (1.55 ± 0.63). Ratios derived from Dataset 2 suggest an increase for both aided and unaided IFNs (3.65 ± 2.45 and 2.97 ± 1.27, respectively, compared with 1.68 ± 0.69 for aided UEN1).

Taken together, based on the binaural loudness summation data for narrowband stimuli, it was shown that for NH no level dependency and for HI no systematic level dependency of binaural summation exist. For both the NH and HI listeners, binaural summation ratios slightly decreased with frequency if averaged across listeners. Some of the HI listeners showed loudness ratios >2, i.e., indicating super additivity (binaural excitation). Individualization of the amount of binaural summation in the model can reduce the error in fitting the data by 10 CU (two loudness categories) in the high loudness region (or high stimulus levels). The binaural stage allows the calculation of “corrected” binaural summation ratios for assuming equal loudness, enabling better comparability between conditions, listeners, and other studies. The inter-subject variability of the “corrected” ratios is higher for the HI listeners than for the NH listeners. Mean ratios were higher in all the conditions for HI; however, the effect was not significant in most conditions, likely because of the small sample size.

Experiment II: Individual Parameters to Describe Monaural and Binaural Loudness

To exemplarily show the effects of individualized parameters for modeling loudness, Figures 6, 7 show the empirically derived loudness functions (thick solid lines, lightened colors), the underlying raw data (crosses), and modeled loudness functions (thin lines, darkened colors) of listeners HI5 and HI7. The corresponding figures for the subgroup of listeners for which broadband conditions were measured in Dataset 1 are provided in the Supplementary Material. The dashed lines show model version 1, for which only the monaural post gains have been individualized. The solid lines are for model version 4, for which all monaural (post gains, βL and βR) and binaural parameters (αB and βB) have been individualized. Red and blue indicate monaural presentation to the left and right ears, respectively. Gray and black indicate diotic presentation.

FIGURE 6
www.frontiersin.org

Figure 6. Empirical loudness functions of listener HI5 (brightened thick solid lines) and modeled loudness (thin lines) for monaural conditions (left ear: blue, right ear: red) and diotic conditions (gray/black) with simulated frontal sound incidence or from ±60° in the horizontal plane as indicated in the panels. The raw measurement data are indicated by crosses. Thin solid lines are for model version 4, for which all monaural (βL and βR) and binaural parameters (αB and βB) have been individualized by fitting the model to the LNN and the aided IFN stimuli. The loudness of four IFN stimuli in the lower panels and the unaided IFN are model predictions. Thin dashed lines are for model version 1, i.e., without bandwidth-dependent monaural and binaural gains (βL = βR = βB = 0) and with average NH binaural inhibition (αB = −0.273, see Appendix). For this model version, only the monaural LNN loudness data were used in the fitting procedure. The modeled loudness for the remaining binaural LNN stimuli and all IFN stimuli is a prediction.

FIGURE 7
www.frontiersin.org

Figure 7. As Figure 6 but for listener HI7.

The model output of model version 1 (dashed lines) closely fits the loudness functions of the monaural LNN stimuli, which have been targeted in the fit (upper six panels, center frequencies indicated inside the panels). Model predictions for the monaural broadband stimuli are inaccurate (compare thin dashed red and blue lines with thick solid red and blue lines in the panels indicated as IFN and IFN aided). This result is in line with Pieper et al. (2018) who have shown that the fit of the post gain to narrowband loudness data does not improve the model predictions for broadband loudness data.

In model version 4 (solid lines), the aided monaural IFN stimuli were added to the targeted stimuli. Consequently, the modeled loudness functions better account for these data. However, the fit slightly alters the modeled loudness functions for the monaural narrowband LNN stimuli. Particularly at low frequencies, this can result in decreased accuracy of the model for narrowband stimuli (see, e.g., Figure 6, red lines in the panels indicated as 0.5 kHz and 1 kHz). Model version 4 improves the predictions for the unaided and aided monaural and binaural broadband stimuli, which were not involved in the fitting procedure (see panels indicated as IFN, IFN 60° left, IFN 60° left aided, IFN 60° right, and IFN 60° right aided in Figures 6, 7), which also holds for the other two HI listeners (not shown).

To assess the performance of all the models and both data sets, Figures 8, 9 show the median (symbols) and the 25 and 75 percentiles (bars) of the performance measures (ncc, rmse, and bias) across the HI subgroup of Dataset 1 (Figure 8) and the HI listeners of Dataset 2 (Figure 9). While the figures show the performance measures for each stimulus in isolation, Table 3 lists the adjusted ncc' values across all the stimuli for the HI listeners, and Table 4 for the NH listeners.

FIGURE 8
www.frontiersin.org

Figure 8. Median (symbols) and 25 and 75 percentiles (bars) of the model performance measures (top panel: ncc, middle panel: rmse, bottom panel: bias) for monaural (red, mean value across left and right ear per listener) and diotic (black) conditions across the subgroup of four HI listeners for which loudness data of broadband IFN stimuli were collected in Dataset 1. The dashed lines indicate optimal performance. Four different model versions were tested as described in the Method section of experiment II (circles: version 1 with monaural post gain, squares: version 2 with additional monaural bandwidth-dependent gain, i.e., individualized parameters βL and βR, triangles: version 3 with additional overall binaural gain, i.e., individualized parameter αB, diamonds: version 4 with additional binaural-bandwidth-dependent gain, i.e., individualized parameter βB). Open symbols mark the conditions that were utilized in the model fits. Filled symbols indicate model predictions.

FIGURE 9
www.frontiersin.org

Figure 9. As Figure 8 but for the additional data of 10 HI listeners of Dataset 2. Performance measures from Figure 8 are replotted in brightened colors if measurement conditions are comparable. In contrast to Figure 8, the performance measures for the monaural narrowband LNN stimuli are not shown. Binaural or diotic data are not available for the LNN stimuli. Instead, the loudness data of the aided UEN1 stimulus were used to fit the parameters of the binaural stage.

TABLE 3
www.frontiersin.org

Table 3. Adjusted ncc' (Equation 10) across all conditions.

TABLE 4
www.frontiersin.org

Table 4. Same as Table 3 but for NH listeners.

For the HI listeners of both datasets, the monaural bandwidth-dependent gain in model versions 2–4 (disabled in model version 1, βL = βR = 0) improves the model predictions across listeners for monaural broadband conditions (IFN unaided and aided, model version 1: red circles, model versions 2–4: red squares in Figures 8, 9). For the aided IFN stimuli, the rmse is reduced from 11.6 to 2.6 dB for the HI subgroup of Dataset 1 and from 8.8 to 5.3 dB for the HI group of Dataset 2. For the respective unaided IFN stimuli, which were not considered in the fits, the rmse is reduced from 8.8 to 6.1 dB for the HI subgroup of Dataset 1 and from 5.7 to 3.8 dB for the HI listeners of Dataset 2. Performance improvements are nearly as high for the respective NH listeners of both Datasets (not shown in figures). Median rmse values for aided IFN are reduced from 7.6 to 4 dB for the NH subgroup of Dataset 1. Median rmse values for unaided IFN are reduced from 6.8 to 5.5 dB for the NH subgroup of Dataset 1 and from 6.7 to 4.5 dB for the NH listeners of Dataset 2. The median of the adjusted ncc' values across the HI listeners is increased from 0.84 for model version 1 to 0.936 for model version 2 for the subgroup of Dataset 1 and from 0.933 to 0.95 for Dataset 2 (Table 3). The respective values for the subgroup of NH listeners in Dataset 1 are 0.955 and 0.973 for model versions 1 and 2, and 0.965 and 0.974 for Dataset 2. The higher values and the smaller benefit for Dataset 2 reflect that this dataset contains fewer broadband conditions than Dataset 1.

It has already been shown in experiment I that the individualization of the overall binaural gain αB is necessary to describe the binaural data for certain listeners. In experiment II, benefits from individualized binaural summation are reflected in the performance measures for model version 3 in both datasets (black triangles in Figures 8, 9). Compared with the performance measures of model version 2 (without individualized binaural summation; black squares), individualization in model version 3 leads to a slight increase in the median nccs and a slight decrease in the median rmses for most conditions, indicating small overall improvements for the HI listeners. The reduced percentile ranges of the ncc and rmse measures for all the conditions indicate improvements in the model predictions for certain HI listeners. The median adjusted ncc' is slightly increased from 0.936 to 0.944 for the HI subgroup of Dataset 1 and from 0.950 to 0.959 for the HI listeners of Dataset 2. The respective 25 percentile is increased from 0.919 to 0.937 for the subgroup of Dataset 1 and increased from 0.905 to 0.947 for Dataset 2, indicating improvements in the worst-performing individual models. For the NH listeners, individualized predictions of model version 3 are almost not improved over model version 2.

The individualized model version 4 has been successfully fitted to the aided IFN without many tradeoffs for the narrowband stimuli (open diamonds in Figures 8, 9). However, the predictions of the HI data of Dataset 1 for all stimuli not used for the fitting procedure (closed diamonds) show no clear performance improvements in comparison with model version 3, whereas the predictions for the HI data of Dataset 2 are improved (unaided IFN only). For the HI group of Dataset 2, the median ncc for unaided IFN is increased from 0.89 for model version 3 to 0.96 for model version 4. The median rmse is reduced from 6.4 to 4.3 dB, and the median bias is reduced from 4 to 3 dB. The medians of the adjusted ncc' values are increased for both HI datasets (from 0.944 to 0.952 for the subgroup of Dataset 1 and from 0.959 to 0.964 for Dataset 2).

It has to be considered here that for version 4 the aided IFN data are added to the data used for fitting to allow a fit of the additional free parameter βB. However, nearly the same improvements can be archived when using model version 3 (i.e., no parameter βB) and including the same aided IFN data into the fitting procedure as well, referred to as model “version 3 modified.” The last row in the lower half of Table 3 shows the adjusted ncc' value of 0.961 for this modification for Dataset 2, which is almost as high as that for model version 4 (0.964). Likewise, the percentile values are comparable. The effect of this modification on the model performance was assessed for Dataset 1 as well. Again, aided IFN was added to the fitting data. Instead of the six binaural narrowband loudness functions originally used for fitting, only a single function (1 kHz) was used more comparable to the single UEN1 function (1.37 kHz) used for Dataset 2. Thus, comparable fitting data as for the above modified version 3 in Dataset 2 were used. Again, the resulting adjusted ncc' values are improved over the original model version 3 and are almost the same as those for model version 4 (see upper half in Table 3). Overall, although the additional parameter βB improves the ability to fit the model to the loudness data, predictions of model version 4 are almost not improved over the predictions of model version 3 if the same underlying data are used for fitting. Using one binaural narrowband and one binaural broadband loudness function to determine αB results in better performance than using the six binaural narrowband loudness functions.

The ncc' values only show a quite small increase for some of the models introducing binaural parameters. Given that the ncc' calculation includes more narrowband and monaural conditions than binaural and broadband conditions, differences between, e.g., models 2 and 3 might not be well-captured by the global ncc'.

To better illustrate the effect of the different model parameters, Figure 10 shows example aided binaural IF noise loudness functions (solid gray lines) of listeners HI5 and HI7 of Dataset 1 (also shown in Figures 6, 7) and two additional listeners of Dataset 2 (HI04 and HI11) together with the respective predictions of all individualized model versions. HI7 and HI04 are examples where model 2 (dash-dotted) considerably underestimates loudness by two categories (10 CU) at a level that is perceived as “too loud” (50 CU). Similar or worse mismatches are obtained for four more HI listeners (not shown). Model versions 3 (dotted black) and 4, (solid), and modified model version 3 (dotted green) considerably reduce the deviations for HI7 and HI04 and two other HI listeners. Two of 14 listeners remain with errors slightly higher than 10 CU (not shown). Thus, for realistic conditions with binaural speech-shaped noise, for six of 14 individuals model version 3 and higher avoid a severe underestimation of loudness in conditions that would otherwise lead to overly loud sensations, which are particularly problematic in the context of hearing aids. This demonstrates that even if the benefit of additional model parameters might be small on average, it can be highly relevant for individuals.

FIGURE 10
www.frontiersin.org

Figure 10. Examples of empirical loudness functions for aided binaural IF noise (solid gray lines) of listeners HI05 and HI07 of Dataset 1 (also shown in Figures 6, 7) and two listeners of Dataset 2 (HI04 and HI11), together with the respective predictions of all individualized model versions indicated in the legend.

Discussion

Binaural Loudness Summation and Hearing Impairment

Both the modeling approaches in experiment II and the more data-driven approach in experiment I indicate decreased binaural inhibition (or even binaural excitation) in some of the HI listeners. This result appears to contradict the findings of van Beurden et al. (2018), who found similar binaural loudness summation between HI and NH listeners. The reason for this apparent contradiction is the differences in the methods on how to access and calculate binaural loudness summation. Whereas, in this study binaural loudness summation is calculated from the ratios between binaural and monaural loudness in sones at a given level (experiment I) or by fitting a single model parameter that alters the modeled binaural inhibition to the empirical loudness data (experiments I and II), van Beurden et al. (2018) calculated the level differences between monaural and binaural loudness functions at given loudness categories, but if the loudness ratios (in sones or CUs) are kept constant, the increase in the steepness of the loudness functions caused by the hearing impairment decreases the level differences between the functions (Moore et al., 2014). The fact that van Beurden et al. (2018) did not find such a decrease in these level differences in HI (in case of high hearing losses they even found a slight but not significant—increase) indicates that the loudness ratios at a given level must have been increased, which is in line with the observations in this study. On the contrary, Moore et al. (2014) found reduced level differences at frequencies where hearing loss was present. However, as mentioned in the introduction, a model that assumed average NH loudness ratios/inhibition predicted even lower-level differences and therefore underestimated binaural loudness summation in HI. To avoid conversion from CU to sones, other methods to directly assess loudness in sones, such as absolute magnitude estimation, appear suited. However, categorical loudness scaling has been shown to be well-applicable in the clinical context and for hearing aid fitting. Using absolute magnitude estimation, Marozeau and Florentine (2009) found increased inter-subject variability of the ratios in HI listeners, in line with the results of this study, but overall lower ratios and therefore no binaural excitation (R > 2). Their overall lower ratios can be explained with differences in the method: In this study, loudness in CU was transformed to loudness in sones using the transformation of Heeren et al. (2013). This transformation is based on the (sone-) loudness function in ANSI S3.4 (2007) resembling the loudness function in Hellman and Zwislocki (1961). Their loudness functions are considerably steeper than the respective loudness function derived with the method used by Marozeau and Florentine (see Epstein and Florentine, 2005). Rerunning the calculations in experiment I using the shallower loudness function yielded no binaural excitation, except for few stimuli for individual HI listeners. The increased inter-subject variability in the HI group, compared with that in the NH group, was still significant.

Based on this consideration, we hypothesize that the underlying physiological basis for binaural excitation (R>2) could be: (1) super-additivity: neural excitation from both sides is not added, but excitation from the contralateral side causes excess excitation on the ipsilateral side; and (2) an internal loudness representation with another slope than the sone scale used in this study in which case one would not observe R = 2 even if the binaural summation was purely additive.

Another limitation of this study might be the low sample size of eight NH and eight HI listeners for Dataset 1, and eight NH and 10 HI listeners for Dataset 2.

Individualization of Loudness Models

It has been shown that for some HI individuals, severe deviations from average loudness perception exist, likely causing problems in daily life and with hearing aids (Oetting et al., 2018; van Beurden et al., 2020). Even if only a subgroup of HI listeners is affected, loudness models that aim to support hearing aid fitting and development need to account for these listeners. Current HI loudness models fail in this regard (Pieper et al., 2018).

In Pieper et al. (2018), a monaural frequency-dependent post gain was introduced. The post gain allows fitting of the loudness model to individual narrowband loudness data but does not improve the model predictions for broadband loudness. In experiment II of this study, a bandwidth-dependent gain has been added to the monaural paths, controlled via parameters βL, and βR. The monaural bandwidth-dependent gain improves the ability of the loudness model to describe and predict monaural broadband data for both the NH and HI listeners.

The results of experiments I and II show that accounting for individual increased binaural loudness summation can decrease prediction errors of binaural loudness for narrowband and broadband stimuli. This holds in particular for a subgroup of the HI listeners and is almost independent of frequency and bandwidth.

In order to allow for individual binaural loudness summation, a binaural gain has been introduced that is controlled via parameter αB. The binaural gain linearly attenuates (if αB < 0) or amplifies (if αB > 0) the signal, the more the signal amplitudes in the monaural paths are equal. Unlike the frequency-dependent post gain but like parameters βL and βR, αB is a single parameter, independent of BM location and therefore independent of stimulus frequency. If modeling average NH inhibition (by setting αB to the average value of −0.273 of the NH listeners), the predictions of individual binaural loudness data were inaccurate for the HI listeners compared with the more accurate predictions for the NH listeners. Allowing individual values αB for the NH listeners slightly improved the ability to fit the binaural narrowband data but did not improve the predictions of binaural broadband data. For the HI listeners, predictions were improved and similar prediction accuracies as for the NH listeners were obtained.

A mechanism similar to the monaural bandwidth-dependent gain has been added to the binaural path, controlled via parameter βB. The mechanism increases (for βB > 0) or decreases (for βB < 0) the binaural gain, the larger the bandwidths are and the more similar the signal amplitudes are in the monaural paths. This modification of the binaural gain did not further improve the predictions of the binaural broadband data, indicating that the individual amount of binaural inhibition would be almost independent of the bandwidth of the signal representation after monaural processing.

Therefore, it can be recommended that for the individualization of loudness models, the individual monaural spectral loudness summation should be addressed, independently of sensorineural hearing loss. If hearing loss is present, binaural loudness summation might be affected and therefore needs to be individualized as well. A single bandwidth-independent binaural gain (controlled here via parameter αB), i.e., model version 3, might be sufficient for most applications.

In this study, a subset of the individual loudness data has been used to determine the parameter values of an individual model. The “cost” for the measurement time to obtain this subset might be too high for certain applications, in particular for clinical use. Most time consuming are the 12 monaural narrowband loudness functions that were used to obtain the OHC loss, IHC loss, and post gain. Approximations of these functions could be derived from hearing thresholds and UCL measurements to reduce measurement time. Two monaural broadband loudness functions were used to determine the values of βL and βR. Values of βL and βR were similar for most but not all listeners (not shown), so that the required measurement time cannot be reduced. Using one binaural narrowband loudness function and one binaural broadband loudness function to determine the individual value of αB resulted in better model performance than using six binaural narrowband loudness functions.

Overall, to obtain a well-performing individual loudness model for an NH or HI listener, the measurement of 14 monaural loudness functions (12 narrowband, and two broadband) was required. For the HI listener, two additional binaural loudness functions (one narrowband, and one broadband) were required. Balancing “cost” and “value” of the measurements, a substantial reduction in measurement effort might be possible if the 12 monaural narrowband loudness functions are approximated based on more clinical data, such as the hearing threshold and uncomfortable level.

Frequency Dependency of Binaural Summation

The results of experiment I suggest high individual but only slight systematic frequency dependencies of binaural loudness summation averaged across listeners. Comparing the averaged results from NH and HI listeners, increased binaural loudness summation was found for the HI listeners (see Tables 1, 2). This might suggest a connection between hearing loss and binaural loudness summation, which might also occur for frequency-dependent hearing loss within a listener. Given that hearing loss is typically increased at high frequencies, one could, thus, expect increased binaural summation at high frequencies. Contrary to this consideration, all except one HI listener (HI04) show decreasing summation ratios with increasing stimulus frequency (Figure 4). On average across listeners, decreasing summation ratios with increasing frequency was observed for both the NH and HI listeners. However, the binaural summation (parameter αB) of the model was chosen to be independent of frequency. Consequently, on average, the binaural loudness summation is underestimated at low frequencies (compare positive bias values for binaural conditions with bias values close to zero for monaural conditions for LNN stimuli with low center frequencies in Figure 8) and overestimated at high frequencies (compare negative bias values for binaural conditions with bias values close to zero for monaural conditions for LNN stimuli with high center frequencies in Figure 8) in the model calculations of experiment II. Such underestimation at low frequencies was already observed in Moore et al. (2014) using a model that also assumed binaural inhibition to be independent of frequency. Thus, further small improvements can be expected for the predictions of narrowband signals if a slight decrease in binaural summation with increasing frequency would be considered. This can be realized in this model by a decrease in the value of αB as a function of the center frequency of the TLM segment.

Relations to Hearing Impairment and Physiologic Mechanisms

In this model, the binaural stage is located subsequent to the simulation of basilar membrane movements and monaural central gain mechanisms (post gain and bandwidth-dependent central gain). Therefore, binaural inhibition is considered to be a more central effect. Before its introduction into binaural loudness models (Moore and Glasberg, 2007), the idea of central binaural inhibition mechanisms has been used in binaural auditory models for sound localization and binaural unmasking (Lindemann, 1986; Breebaart et al., 2001). Breebaart et al. (2001) argued that a subgroup of cells in the mammalian lateral superior olive and the inferior colliculus are excited by signals from one ear and inhibited by signals from the other ear. Since there is evidence for homeostatic adaptations of the neurons to reduced firing rates at the inputs in case of hearing impairment (Qiu et al., 2000; Kotak et al., 2005), reduced binaural inhibition might be a side effect of these adaptations. However, although central inhibition can explain the mentioned psychoacoustic observations, the link between neural stimulus encoding and the neural representations of percepts, including loudness, is not well-understood (Schreiner and Malone, 2015). Further candidates that can potentially influence binaural loudness summation are efferent reflexes like the MEM or the medial olivocochlear (MOC) reflex. The MOC reflex is directly affecting the cochlear gain (e.g., Berlin et al., 1993), whereas the MEM reflex causes a reduction of sound transmission by the middle ear of up to 10 dB for high stimulus levels at frequencies below 1 kHz (Rabinowitz, 1977). In both MEM reflex and MOC reflex, threshold and strength depend on stimulus level, frequency, and bandwidth as well as stimulus presentation (monaural or binaural). Both reflexes are feedback mechanisms that are controlled by post cochlear processes, and they are affected by damages to the auditory path prior to the central processing stages. For example, the characteristics of the MEM reflex threshold depend on the different peripheral compression in the NH and HI listeners (Müller-Wehlau et al., 2005). Thus, these effects might provide a direct link between the individual state of outer and inner hair cells and the individual amount of binaural inhibition. If the influence of the hair cell states on binaural inhibition is high in comparison to central binaural inhibition effects, a proper implementation of these feedback mechanisms could reduce the number of parameters that are required for the individualization of loudness models.

By reducing the cochlear gain of the TLM, the proposed loudness model accounts for reduced spectral loudness summation in the HI listeners. Nevertheless, subsequent to the TLM, significant bandwidth-dependent gain changes (controlled via parameters βL and βR) were necessary to describe the individual monaural broadband data (results of experiment II). These subsequent corrections were not only necessary for the HI but for the NH listeners as well, for which only small cochlear gain losses were expected and therefore simulated. Together with the finding that a similar mechanism applied to the binaural path of the model did not improve binaural loudness predictions of broadband stimuli, the model simulations suggest an additional mechanism besides the cochlear non-linearities that influence spectral loudness summation, which is not related to hearing loss, as already hypothesized in Pieper et al. (2018).

Implications for Loudness Models and Application in Hearing Aid Fitting and Development

This model analysis estimated the number and type of monaural and binaural parameters required to improve fitting to and prediction of individual loudness data. It is generally expected that an increasing number of free parameters increase the ability of any model to fit the data. The goal was, therefore, to systematically assess the benefit of successively adding perceptually motivated and physiologically plausible, effective model stages with respective parameters and to devise the minimum number required for individualization. We show that, in fact, additional stages beyond commonly considered peripheral processes, such as non-linear gain loss and linear attenuation, typically associated with OHC and IHC, loss are required to account for individual loudness data in NH and HI. At least a bandwidth-dependent retro-cochlear gain parameter, likely reflecting central gain, is required to individualize the amount of spectral summation, and a frequency- and bandwidth-independent binaural gain parameter is required to individualize binaural summation (inhibition or excitation). The authors deem it unlikely that individual loudness can be accounted for with any improved peripheral model without the need for the suggested or similar additional parameters.

Although a specific loudness model was used in this study, the findings can be generally applied to other loudness models and do not depend on the front end of the current model. Other loudness models (e.g., Chalupper and Fastl, 2002; Chen et al., 2011a; Moore et al., 2014) could be extended with the suggested or modified retro-cochlear stages, which introduce additional individual parameters. The front ends of these models offer the advantage of strongly reduced computational complexity compared with the current TLM front end.

The potential of individualized loudness predictions is in hearing aid fitting, where a fitting rule can contain the individualized model and improved hearing aid gains can be devised for different situations based on the respective prominent signal properties and the wearers individual loudness perception. Further potential is in hearing aid development, where loudness can be predicted for a certain set of prototypical HI with different loudness perceptions. Future potential can be expected in hearing aid algorithms with real-time updates of their processing based on integrated individual loudness predictions. Although there is still room for further improvement of individual loudness predictions, the relevance of the already achieved, at times seemingly small differences or improvements in dB, should not be underestimated. Due to the steep progression of HI loudness functions, in particular close to uncomfortable levels, according gain changes in hearing aids can easily make the difference between acceptable and uncomfortable loudness.

Summary and Conclusions

Loudness perception of the NH and HI listeners with sensorineural hearing loss was measured by categorical loudness scaling for narrowband and broadband stimuli, presented monaurally, and binaurally. To assess the individual amount of binaural summation, binaural loudness ratios were calculated, and a data-driven model approach was employed to account for binaural loudness based on the measured monaural loudness by individually fitting a single binaural summation parameter, αB. Analysis of the loudness data showed a higher individual variability of binaural loudness summation for HI compared with the NH. While NH showed binaural inhibition in line with previous findings from the literature, the data of some of the HI listeners of this study suggest reduced binaural inhibition (αB < 0) or even super additive summation, i.e., binaural excitation (αB > 0).

In the second step, the monaural loudness model of Pieper et al. (2018) was extended by a functional binaural loudness summation stage (Equation 3). The stage sums the signals in the monaural paths and weights the result depending on the amplitude difference in the monaural paths and the value of the parameter αB that controls the overall amount of binaural inhibition or excitation. Loudness model predictions for binaural stimulus presentation were improved for individual HI listeners if the individual amount of binaural inhibition/excitation was considered. The introduction of an additional parameter βB that alters the amount of binaural inhibition/excitation depending on the bandwidth of the summed monaural signals did not substantially improve the model predictions. However, for the accuracy of the model predictions in both the NH and HI listeners, it was crucial to include bandwidth-dependent weightings of the signals in the monaural paths (Equation 1) that were controlled with parameters βL and βR for the left and right ears, respectively.

The following conclusions can be drawn:

1. Individual ratios of binaural loudness summation vary across the HI listeners and are sometimes increased compared with the NH listeners, indicating that binaural inhibition, as typically observed in NH, might be affected by sensorineural hearing loss.

2. The empirical data suggest a slight increase in binaural inhibition (or decrease in binaural excitation) with frequency for both the NH and HI listeners.

3. To correctly account for spectral loudness summation, individualized loudness models for NH and HI should include an individually adapted bandwidth-dependent retro cochlear gain stage in the monaural pathway.

4. Individualized loudness models for HI listeners should account for the individual amount of binaural inhibition/excitation.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author/s.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ethics Committee of the University of Oldenburg. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

IP, MM, and SE co-conceived the presented ideas. SE supervised the project. IP developed the test software and carried out the simulations and experiments. All the authors discussed the results and contributed to the manuscript.

Funding

This study was supported by the Deutsche Forschungsgemeinschaft (DFG, Cluster of Excellence EXC 2177 Hearing4all and project 352015383—SFB 1330 A2). Most of the simulations were performed on the HPC Cluster CARL funded by the DFG under INST 184/157-1 FUGG.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We are grateful to Dirk Oetting for sharing experimental data and discussion, to Hongmei Hu for comments on earlier versions of the manuscript, and to all the participants in the experiments.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.634943/full#supplementary-material

The loudness functions and the underlying raw loudness data of 8 NH and 8 HI listeners collected for the current study (Dataset 1) as well as model calculations are provided.

Footnotes

1. ^Listeners were the same as in Pieper et al. (2018). As in Pieper et al. (2018), a ninth NH listener was excluded from the original dataset because the listener's uncomfortable levels were identified as outliers at three of the six test frequencies.

2. ^The extreme case where the signal is only perceived in one, for example the left, ear (NL = NB and NR = 0) Equation 6 will result in a ratio R = 2.

3. ^The aided broadband condition was chosen because pretests revealed better overall predictions than for using the unaided condition.

4. ^Good convergence of the fits was achieved if the broadband IF noise data was weighted half as high as the narrowband LNN data and the weighting of the adjacent post gain differences was increased. Weighting of LNN = 1 (x6 signals), weighting of IFN = 3, weighting of post gain differences: 1 (Pieper et al., 2018: weighting of LNN = 1 (x6 signals), weighting of IFN = 0, weighting of post gain differences: 1/5).

5. ^Biases may be possible due to the choice of the loudness function that is used to fit the raw CU data. The function used is based on the assumption that low CUs are linearly related to the stimuli levels (Brand and Hohmann, 2002). Another possible cause for biases may be small inaccuracies in the transformation from CU to sones.

References

ANSI S3.4 (2007). Procedure for the Computation of Loudness of Steady Sounds. American National Standard Acoustical Society of America Accredited Standards Committee S3 Bioacoustics (New York, NY).

Berlin, C. I., Hood, L. J., Hurley, A. E., Wen, H., and Kemp, D. T. (1995). Binaural noise suppresses linear click-evoked otoacoustic emissions more than ipsilateral or contralateral noise. Hear. Res. 87, 96–103. doi: 10.1016/0378-5955(95)00082-F

PubMed Abstract | CrossRef Full Text | Google Scholar

Berlin, C. I., Hood, L. J., Wen, H., Szabo, P., Cecola, R. P., Rigby, P., et al. (1993). Contralateral suppression of non-linear click-evoked otoacoustic emissions. Hear. Res. 71, 1–11. doi: 10.1016/0378-5955(93)90015-S

PubMed Abstract | CrossRef Full Text | Google Scholar

Brand, T., and Hohmann, V. (2002). An adaptive procedure for categorical loudness scaling. J. Acoust. Soc. Am. 112, 1597–1604. doi: 10.1121/1.1502902

PubMed Abstract | CrossRef Full Text | Google Scholar

Breebaart, J., Van de Par, S., and Kohlrausch, A. (2001). Binaural processing model based on contralateral inhibition. I. Model structure. J. Acoust. Soc. Am. 110, 1074–1088. doi: 10.1121/1.1383297

PubMed Abstract | CrossRef Full Text | Google Scholar

Brotherton, H., Plack, C. J., Maslin, M., Schaette, R., and Munro, K. J. (2015). Pump up the volume: could excessive neural gain explain tinnitus and hyperacusis? Audiol. Neurotol. 20, 273–282. doi: 10.1159/000430459

PubMed Abstract | CrossRef Full Text | Google Scholar

Byrne, D., Dillon, H., Ching, T., Katsch, R., and Keidser, G. (2001). NAL-NL1 procedure for fitting non-linear hearing aids: characteristics and comparisons with other procedures. J. Am. Acad. Audiol. 12, 37–51.

Google Scholar

Byrne, D., Dillon, H., Tran, K., Arlinger, S., Wilbraham, K., Cox, R., et al. (1994). An international comparison of long-term average speech spectra. J.Acoust. Soc. Am. 96, 2108–2120. doi: 10.1121/1.410152

CrossRef Full Text | Google Scholar

Chalupper, J., and Fastl, H. (2002). Dynamic loudness model. (DLM). for normal and hearing-impaired listeners. Acta Acust. United Acust. 88, 378–386.

Google Scholar

Chen, Z., Hu, G., Glasberg, B. R., and Moore, B. C. J. (2011a). A new model for calculating auditory excitation patterns and loudness for cases of cochlear hearing loss. Hear. Res. 282, 69–80. doi: 10.1016/j.heares.2011.09.007

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, Z., Hu, G., Glasberg, B. R., and Moore, B. C. J. (2011b). A new method of calculating auditory excitation patterns and loudness for steady sounds. Hear. Res. 282, 204–215. doi: 10.1016/j.heares.2011.08.001

PubMed Abstract | CrossRef Full Text | Google Scholar

Derleth, R. P., Dau, T., and Kollmeier, B. (2001). Modeling temporal and compressive properties of the normal and impaired auditory system. Hear. Res. 159, 132–149. doi: 10.1016/S0378-5955(01)00322-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Epstein, M., and Florentine, M. (2005). A test of the Equal-Loudness-Ratio hypothesis using cross-modality matching functions. J. Acoust. Soc. Am. 118, 907–913. doi: 10.1121/1.1954547

PubMed Abstract | CrossRef Full Text | Google Scholar

Epstein, M., and Florentine, M. (2009). Binaural loudness summation for speech and tones presented via earphones and loudspeakers. Ear Hear. 30, 234–237. doi: 10.1097/AUD.0b013e3181976993

PubMed Abstract | CrossRef Full Text | Google Scholar

Ewert, S. D. (2013). “AFC—A modular framework for running psychoacoustic experiments and computational perception models,” in Proceedings of the International Conference on Acoustics AIA-DAGA (Merano), 1326–1329.

Ewert, S. D., and Oetting, D. (2018). Loudness summation of equal loud narrowband signals in normal-hearing and hearing-impaired listeners. Int. J. Audiol. 57:S71–S80. doi: 10.1080/14992027.2017.1380848

PubMed Abstract | CrossRef Full Text | Google Scholar

Faingold, C. L., Anderson, C. A. B., and Randall, M. E. (1993). Stimulation or blockade of the dorsal nucleus of the lateral lemniscus alters binaural and tonic inhibition in contralateral inferior colliculus neurons. Hear. Res. 69, 98–106. doi: 10.1016/0378-5955(93)90097-K

PubMed Abstract | CrossRef Full Text | Google Scholar

Fastl, H., and Zwicker, E. (2007). Psychoacoustics: Facts and Models, Third ed. Berlin: Springer. doi: 10.1007/978-3-540-68888-4

CrossRef Full Text | Google Scholar

Finlayson, P. G., and Caspary, D. M. (1991). Low-frequency neurons in the lateral superior olive exhibit phase-sensitive binaural inhibition. J. Neurophys. 65, 598–605. doi: 10.1152/jn.1991.65.3.598

PubMed Abstract | CrossRef Full Text | Google Scholar

Guinan, J. J. Jr. (2006). Olivocochlear efferents: anatomy, physiology, function, and the measurement of efferent effects in humans. Ear Hear. 27, 589–607. doi: 10.1097/01.aud.0000240507.83072.e7

PubMed Abstract | CrossRef Full Text | Google Scholar

Heeren, W., Hohmann, V., Appell, J. E., and Verhey, J. L. (2013). Relation between loudness in categorical units and loudness in phons and sones. J. Acoust. Soc. Am. 133, EL314–EL319. doi: 10.1121/1.4795217

PubMed Abstract | CrossRef Full Text | Google Scholar

Heinz, M. G., Issa, J. B., and Young, E. D. (2005). Auditory-nerve rate responses are inconsistent with common hypotheses for the neural correlates of loudness recruitment. J. Assoc. Res. Otolaryngol. 6, 91–105. doi: 10.1007/s10162-004-5043-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Hellman, R. P., and Zwislocki, J. (1961). Some factors affecting the estimation of loudness. J. Acoust. Soc. Am. 33, 687–694. doi: 10.1121/1.1908764

CrossRef Full Text | Google Scholar

Hellman, R. P., and Zwislocki, J. (1963). Monaural loudness function at 1000 cps and interaural summation. J. Acoust. Soc. Am. 35, 856–865. doi: 10.1121/1.1918619

CrossRef Full Text | Google Scholar

Holube, I., Fredelake, S., Vlaming, M., and Kollmeier, B. (2010). Development and analysis of an international speech test signal. (ISTS). Int. J. Audiol. 49, 891–903. doi: 10.3109/14992027.2010.506889

PubMed Abstract | CrossRef Full Text | Google Scholar

ISO 389-7 (2005). Acoustics - Reference Zero for the Calibration of Audiometric Equipment. Part 7: Reference Threshold of Hearing Under Free-Field and Diffuse-Field Listening Conditions. Geneva: International Organization for Standardization.

Jenstad, L. M., Van Tasell, D. J., and Ewert, C. (2003). Hearing aid troubleshooting based on patients' descriptions. J. Am. Acad. Audiol. 14, 347–360. doi: 10.1055/s-0040-1715754

PubMed Abstract | CrossRef Full Text | Google Scholar

Kayser, H., Ewert, S. D., Anemüller, J., Rohdenburg, T., Hohmann, V., and Kollmeier, B. (2009). Database of multichannel in-ear and behind-the-ear head-related and binaural room impulse responses. EURASIP J. Adv. Signal Process. 2009:6. doi: 10.1155/2009/298605

CrossRef Full Text | Google Scholar

Keidser, G., Dillon, H., Carter, L., and O'Brien, A. (2012). NAL-NL2 empirical adjustments. Trends Amplif. 16, 211–223. doi: 10.1177/1084713812468511

CrossRef Full Text | Google Scholar

Kotak, V. C., Fujisawa, S., Lee, F. A., Karthikeyan, O., Aoki, C., and Sanes, D. H. (2005). Hearing loss raises excitability in the auditory cortex. J. Neurosci. 25, 3908–3918. doi: 10.1523/JNEUROSCI.5169-04.2005

PubMed Abstract | CrossRef Full Text | Google Scholar

Launer, S. (1995). Loudness Perception in Listeners With Sensorineural Hearing Impairment. Oldenburg: Unpublished Ph D thesis, Oldenburg University.

Google Scholar

Li, L., and Yue, Q. (2002). Auditory gating processes and binaural inhibition in the inferior colliculus. Hear. Res. 168, 98–109. doi: 10.1016/S0378-5955(02)00356-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Lindemann, W. (1986). Extension of a binaural cross-correlation model by contralateral inhibition. I. Simulation of lateralization for stationary signals. J. Acoust. Soc. Am. 80, 1608–1622. doi: 10.1121/1.394325

PubMed Abstract | CrossRef Full Text | Google Scholar

Marozeau, J., Epstein, M., Florentine, M., and Daley, B. (2006). A test of the binaural equal-loudness-ratio hypothesis for tones. J. Acoust. Soc. Am. 120, 3870–3877. doi: 10.1121/1.2363935

PubMed Abstract | CrossRef Full Text | Google Scholar

Marozeau, J., and Florentine, M. (2009). Testing the binaural equal-loudness-ratio hypothesis with hearing-impaired listeners. J. Acoust. Soc. Am. 126, 310–317. doi: 10.1121/1.3133703

PubMed Abstract | CrossRef Full Text | Google Scholar

Møller, A. R. (1962). Acoustic reflex in man. J. Acoust. Soc. Am. 34, 1524–1534. doi: 10.1121/1.1918384

CrossRef Full Text | Google Scholar

Moore, B. C. J. (2000). Use of a loudness model for hearing aid fitting. IV. Fitting hearing aids with multi-channel compression so as to restore ‘normal’loudness for speech at different levels. Br. J. Audiol. 34, 165–177. doi: 10.3109/03005364000000126

PubMed Abstract | CrossRef Full Text | Google Scholar

Moore, B. C. J., Gibbs, A., Onions, G., and Glasberg, B. R. (2014). Measurement and modeling of binaural loudness summation for hearing-impaired listeners. J. Acoust. Soc. Am. 136, 736–747. doi: 10.1121/1.4889868

PubMed Abstract | CrossRef Full Text | Google Scholar

Moore, B. C. J., and Glasberg, B. R. (1998). Use of a loudness model for hearing-aid fitting. I. Linear hearing aids. Br. J. Audiol. 32, 317–335. doi: 10.3109/03005364000000083

PubMed Abstract | CrossRef Full Text | Google Scholar

Moore, B. C. J., and Glasberg, B. R. (2004). A revised model of loudness perception applied to cochlear hearing loss. Hear. Res. 188, 70–88. doi: 10.1016/S0378-5955(03)00347-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Moore, B. C. J., and Glasberg, B. R. (2007). Modeling binaural loudness. J. Acoust. Soc. Am. 121, 1604–1612. doi: 10.1121/1.2431331

CrossRef Full Text | Google Scholar

Moore, B. C. J., Glasberg, B. R., and Baer, T. (1997). A model for the prediction of thresholds, loudness, and partial loudness. J. Audio Engin. Soc. 45, 224–240.

Google Scholar

Moore, B. C. J., Glasberg, B. R., and Stone, M. A. (1999). Use of a loudness model for hearing aid fitting: III. A general method for deriving initial fittings for hearing aids with multi-channel compression. Br. J. Audiol. 33, 241–258. doi: 10.3109/03005369909090105

PubMed Abstract | CrossRef Full Text | Google Scholar

Moore, B. C. J., Glasberg, B. R., Varathanathan, A., and Schlittenlacher, J. (2016). A loudness model for time-varying sounds incorporating binaural inhibition. Trends Hear. 20, 1–16. doi: 10.1177/2331216516682698

PubMed Abstract | CrossRef Full Text | Google Scholar

Müller-Wehlau, M., Mauermann, M., Dau, T., and Kollmeier, B. (2005). The effects of neural synchronization and peripheral compression on the acoustic-reflex threshold. J. Acoust. Soc. Am. 117, 3016–3027. doi: 10.1121/1.1867932

PubMed Abstract | CrossRef Full Text | Google Scholar

Norman, M., and Thornton, A. R. D. (1993). Frequency analysis of the contralateral suppression of evoked otoacoustic emissions by narrow-band noise. Br. J. Audiol. 27, 281–289. doi: 10.3109/03005369309076705

PubMed Abstract | CrossRef Full Text | Google Scholar

Oetting, D., Brand, T., and Ewert, S. D. (2014). Optimized loudness-function estimation for categorical loudness scaling data. Hear. Res. 316, 16–27. doi: 10.1016/j.heares.2014.07.003

PubMed Abstract | CrossRef Full Text | Google Scholar

Oetting, D., Hohmann, V., Appell, J.-E., Kollmeier, B., and Ewert, S. D. (2016). Spectral and binaural loudness summation for hearing-impaired listeners. Hear. Res. 335, 179–192. doi: 10.1016/j.heares.2016.03.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Oetting, D., Hohmann, V., Appell, J.-E., Kollmeier, B., and Ewert, S. D. (2018). Restoring perceived loudness for listeners with hearing loss. Ear Hear. 39, 644–678. doi: 10.1097/AUD.0000000000000521

PubMed Abstract | CrossRef Full Text | Google Scholar

Oetting, D., Hohmann, V., Ewert, S. D., and Appell, J-E. (2013). “Model-based loudness compensation for broad- and narrow-band signals,” ISAAR-International Symposium on Auditory and Audiological Research Auditory Plasticity - Listening With the Brain (Ballerup), 365–372.

Google Scholar

Pieper, I., Mauermann, M., Kollmeier, B., and Ewert, S. D. (2016). Physiological motivated transmission-lines as front end for loudness models. J. Acoust. Soc. Am. 139, 2896–2910. doi: 10.1121/1.4949540

PubMed Abstract | CrossRef Full Text | Google Scholar

Pieper, I., Mauermann, M., Oetting, D., Kollmeier, B., and Ewert, S. D. (2018). Physiologically motivated individual loudness model for normal hearing and hearing impaired listeners. J.Acoust. Soc. Am. 144, 917–930. doi: 10.1121/1.5050518

PubMed Abstract | CrossRef Full Text | Google Scholar

Puria, S. (2003). Measurements of human middle ear forward and reverse acoustics: implications for otoacoustic emissions. J. Acoust. Soc. Am. 113, 2773–2789. doi: 10.1121/1.1564018

PubMed Abstract | CrossRef Full Text | Google Scholar

Qiu, C., Salvi, R., Ding, D., and Burkard, R. (2000). Inner hair cell loss leads to enhanced response amplitudes in auditory cortex of unanesthetized chinchillas: evidence for increased system gain. Hear. Res. 139, 153–171. doi: 10.1016/S0378-5955(99)00171-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Rabinowitz, W. M. (1977). Acoustic-reflex effects on the input admittance and transfer characteristics of the human middle-ear. (Ph.D. Thesis). Massachusetts Institute of Technology, United Stastes.

Google Scholar

Rennies, J., Verhey, J. L., Chalupper, J., and Fastl, H. (2009). Modeling temporal effects of spectral loudness summation. Acta Acust. United With Acust. 95, 1112–1122. doi: 10.3813/AAA.918243

CrossRef Full Text | Google Scholar

Schreiner, C. E., and Malone, B. J. (2015). Representation of loudness in the auditory cortex. Handbook Clin. Neurol. 129, 73–84. doi: 10.1016/B978-0-444-62630-1.00004-4

CrossRef Full Text | Google Scholar

Sivonen, V. P., and Ellermeier, W. (2006). Directional loudness in an anechoic sound field, head-related transfer functions, and binaural summation. J. Acoust. Soc. Am. 119, 2965–2980. doi: 10.1121/1.2184268

PubMed Abstract | CrossRef Full Text | Google Scholar

Strelcyk, O., Nooraei, N., Kalluri, S., and Edwards, B. (2012). Restoration of loudness summation and differential loudness growth in hearing-impaired listeners. J. Acoust. Soc. Am. 132, 2557–2568. doi: 10.1121/1.4747018

PubMed Abstract | CrossRef Full Text | Google Scholar

van Beurden, M., Boymans, M., van Geleuken, M., Oetting, D., Kollmeier, B., and Dreschler, W. A. (2018). Potential consequences of spectral and binaural loudness summation for bilateral hearing aid fitting. Trends Hear. 22:5690. doi: 10.1177/2331216518805690

PubMed Abstract | CrossRef Full Text | Google Scholar

van Beurden, M., Boymans, M., van Geleuken, M., Oetting, D., Kollmeier, B., and Dreschler, W. A. (2020). Uni-and bilateral spectral loudness summation and binaural loudness summation with loudness matching and categorical loudness scaling. Int. J. Aud. 60, 1–9. doi: 10.1080/14992027.2020.1832263

PubMed Abstract | CrossRef Full Text | Google Scholar

Verhulst, S., Altoe, A., and Vasilkov, V. (2018). Computational modeling of the human auditory periphery: auditory-nerve responses, evoked potentials and hearing loss. Hear. Res. 360, 55–75. doi: 10.1016/j.heares.2017.12.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Whilby, S., Florentine, M., Wagner, E., and Marozeau, J. (2006). Monaural and binaural loudness of 5-and 200-ms tones in normal and impaired hearing. J. Acoust. Soc. Am. 119, 3931–3939. doi: 10.1121/1.2193813

PubMed Abstract | CrossRef Full Text | Google Scholar

Zeng, F.-G. (2013). An active loudness model suggesting tinnitus as increased central noise and hyperacusis as increased non-linear gain. Hear. Res. 295, 172–179. doi: 10.1016/j.heares.2012.05.009

CrossRef Full Text | Google Scholar

Zwicker, E., and Scharf, B. (1965). A model of loudness summation. Psychol. Rev. 72, 3–26. doi: 10.1037/h0021703

CrossRef Full Text | Google Scholar

Zwicker, E., and Zwicker, U. T. (1991). Dependence of binaural loudness summation on interaural level differences, spectral distribution, and temporal distribution. J. Acoust. Soc. Am. 89, 756–764. doi: 10.1121/1.1894635

PubMed Abstract | CrossRef Full Text | Google Scholar

Appendix

Binaural Model Stage for Normal Hearing and Refinement of Loudness Transformations

To obtain loudness in sones Sm (at time step m), a power law with the exponent B is applied to the internal binaural loudness Im and the result scaled with the factor A (Pieper et al., 2016, 2018):

Sm=A·ImB

Loudness in CU can then be obtained using the five-parameter cubic function of Heeren et al. (2013):

CU=a3lg(S/sone+b)3+a2lg(S/sone+b)2      +a1lg(S/sone+b)+c

In Pieper et al. (2018) the parameters of the transformations have been fitted to averaged NH binaural (A and B) and monaural (a1, a2, a3 b, and c) narrowband loudness data at 1 kHz, resulting in the values: A = 2.1·106, B = 0.768, a1 = 8.8, a2 = 3.02, a3 = 4.47, b = 0.092, and c = 13.3. However, to fit the transformation from sones to CU, binaural loudness in sones was, for simplicity, divided by 2. Given that the current binaural summation stage differs from this assumption, these parameters needed to be refined. Furthermore, a binaural summation stage for averaged NH data was required for model versions 1 and 2 to access the benefit of its individualization in model version 3 and 4. For this, an iterative procedure was performed involving the fitting procedure of the loudness transformations and the individualization procedure of model version 3:

In the first iteration step, the parameter αB of the binaural summation stage (Equation 3) was set to a value that reflects average NH inhibition. The transformations from internal loudness to loudness in sones and from sones to CU were fitted to average NH loudness data from other studies as mentioned above. In the first iteration αB was set to −0.36 as inferred from experiment I.

In the second iteration step, the individual model version 3 was adjusted for all NH listeners of Datasets 1 and 2 as described in the method section of experiment II, using the loudness transformations from the first iteration step. The mean across the resulting individual values of αB was then used for the binaural summation stage in the first step of the next iteration.

The iteration was repeated until the average value of αB did not change by more than 1% from the previous iteration (here four iterations were sufficient). The resulting average value is αB = − 0.273. The resulting parameter values for the transformations are A = 1.44·106, B = 0.795, a1 = 6.23, a2 = 2.22, a3 = 3.709, b = 0.053, and c = 12.1. These transformations were used for all model versions in experiment II.

Keywords: loudness summation, hearing aid, hearing impairment, binaural inhibition, binaural summation, binaural loudness summation, loudness function

Citation: Pieper I, Mauermann M, Kollmeier B and Ewert SD (2021) Toward an Individual Binaural Loudness Model for Hearing Aid Fitting and Development. Front. Psychol. 12:634943. doi: 10.3389/fpsyg.2021.634943

Received: 29 November 2020; Accepted: 27 May 2021;
Published: 22 June 2021.

Edited by:

Sabine Meunier, Laboratoire de Mécanique et d'Acoustique—CNRS—Aix-Marseille University—Ecole Centrale Marseille, France

Reviewed by:

Jeremy Marozeau, Technical University of Denmark, Denmark
Daniel M. Rasetshwane, Boys Town National Research Hospital, United States

Copyright © 2021 Pieper, Mauermann, Kollmeier and Ewert. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Stephan D. Ewert, stephan.ewert@uni-oldenburg.de

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.