Abstract
Purpose
Objective measures of listening effort have been gaining prominence, as they provide metrics to quantify the difficulty of understanding speech under a variety of circumstances. A key challenge has been to develop paradigms that enable the complementary measurement of subjective listening effort in a quantitatively precise manner. In this study, we introduce a novel decision-making paradigm to examine age-related and individual differences in subjective effort during listening.
Method
Older and younger adults were presented with spoken sentences mixed with speech-shaped noise at multiple signal-to-noise ratios (SNRs). On each trial, subjects were offered the choice between completing an easier listening trial (presented at +20 dB SNR) for a smaller monetary reward and completing a harder listening trial (presented at either +4, 0, −4, −8, or −12 dB SNR) for a greater monetary reward. By varying the amount of the reward offered for the easier option, the subjective value of performing effortful listening trials at each SNR could be assessed.
Results
Older adults discounted the value of effortful listening to a greater degree than young adults, opting to accept less money in order to avoid more difficult SNRs. Additionally, older adults with poorer hearing and smaller working memory capacities were more likely to choose easier trials; however, in younger adults, no relationship with hearing or working memory was found. Self-reported measures of economic status did not affect these relationships.
Conclusions
These findings suggest that subjective listening effort depends on factors including, but not necessarily limited to, hearing and working memory. Additionally, this study demonstrates that economic decision-making paradigms can be a useful approach for assessing subjective listening effort and may prove beneficial in future research.
An increasing body of research indicates that, when faced with listening challenges, such as those caused by signal degradation and hearing loss, listeners may need to recruit additional cognitive resources to support speech processing. The allocation of these cognitive resources to meet processing demands is frequently referred to as listening effort (Pichora-Fuller et al., 2016). In this context, measuring the cognitive demands a listener faces during listening has taken on an important role in advancing our understanding of the factors that contribute to successful speech comprehension and how individual differences in cognitive ability may affect communication (Peelle, 2018).
Most approaches to quantifying cognitive demands during listening have focused on objective measures of behavioral performance. For example, when speech is acoustically degraded, cognitive resources that typically support memory encoding appear to be reallocated to speech processing (i.e., due to a limited-capacity system; Kahneman, 1973; Wingfield, 2016), resulting in poorer recall. Thus, recall of what has been heard can be negatively impacted by environmental noise or signal degradation, even when recognition accuracy is fairly high (Heinrich et al., 2008; Koeritzer et al., 2018; Ward et al., 2016). Additionally, even recall of words presented in quiet can be negatively affected when intermixed in lists containing acoustically degraded words (Cousins et al., 2014; Rabbitt, 1968). Another approach to measuring cognitive demand during listening is to track physiological responses, such as the task-evoked pupil response (for a review, see Van Engen & McLaughlin, 2018). Pupils increase in diameter during task engagement, and a widely held view is that the magnitude of the pupil response reflects the amount of cognitive effort required (Beatty, 1982; Hess & Polt, 1964). Using pupillometry, it has been demonstrated that listening effort increases for young adults as signal quality worsens (Winn et al., 2015) and as the intelligibility of speech decreases (Zekveld & Kramer, 2014; Zekveld et al., 2010). Harder signal-to-noise ratios (SNRs) also elicit larger and more sustained pupil responses in older adults with hearing loss, especially when there is a lexical competitor present (Kuchinsky et al., 2013).
Complementing measures of objective cognitive demand are estimates of subjective listening effort. Subjective impressions may play an important role in seeking treatment for hearing loss and outcome assessment for assistive devices (Humes, 1999) and for understanding emotional components (such as frustration) that are not fully explained by cognitive measures (Eckert, Matthews, & Dubno, 2017). Self-report questionnaires (Gatehouse & Noble, 2004) and rating scales (Brons et al., 2014; McAuliffe et al., 2012; Picou et al., 2011) have been used to measure subjective listening effort, and many studies examining physiological indexes of effort include these measures (e.g., Zekveld et al., 2010). Other studies have used self-report and/or interviews as the primary measure. For example, in a qualitative study of 61 workers with and without hearing loss, Hétu et al. (1988) used content analysis to extract themes from unstructured interviews.
However, despite ostensibly focusing on similar aspects of effort during listening, subjective and objective measures do not always converge (Strand et al., 2018). One potential explanation for this lack of convergent validity is that self-reported subjective effort relies on metacognitive assessment; thus, while researchers may be attempting to measure a single construct of “listening effort,” participants may actually be conflating multiple factors, such as general fatigue, objective processing demand, performance, and actual expended effort (McGarrigle et al., 2014). Indeed, Moore and Picou (2018) found that subjects are influenced by their task performance when self-rating mental effort, reflecting the effect of judgment heuristics on their self-evaluations. Thus, a favorable alternative to metacognitive probes would be an experimental paradigm that reveals participant preferences in a quantitatively tractable manner.
In behavioral economics, a large class of decision-making paradigms has been developed to assess subjective value through revealed preferences, by offering rewards paired with factors such as delay or risk (Green & Myerson, 2004; Myerson & Green, 1995). For example, in delay discounting paradigms, decisions are made between larger-later and smaller-sooner options (e.g., “Would you prefer $20 today, or $80 in ten days?”; Myerson & Green, 1995). More recently, discounting paradigms have been used to examine subjective cognitive effort associated with working memory (Westbrook et al., 2013, 2019) and reading tasks (Eckert, Vaden, et al., 2017). For example, Westbrook et al. (2013) developed the cognitive effort discounting (COG-ED) task, in which participants are offered a choice on each trial between performing a harder task for more monetary reward and performing an easier task for less monetary reward, with the amount of money offered for the easier task varied across choice trials. The subjective value of performing the more difficult task was thus revealed by the amount of money that a participant is willing to “give up” to avoid expending increased effort. In the context of communication effort, Eckert, Vaden, et al. (2017) compared delay discounting (using the Monetary Choice Questionnaire; Kirby, 2009) with hearing loss and “information demand,” a measure of how many times participants opted to reglimpse visually degraded target sentences (i.e., in order to better understand them). Their results indicated that delay discounting was unrelated to hearing thresholds but was related to information demand, such that subjects who reported they would wait longer in order to receive larger rewards were also more likely to reglimpse stimuli.
The goal of assessing subjective effort in a quantitatively precise manner has long been challenging, and only recently have paradigms using objective measures been developed. To accomplish this goal, in this study we apply, for the first time, a discounting paradigm adapted from the COG-ED. Specifically, we use a speech COG-ED to examine subjective listening effort 1 for speech in speech-shaped noise that was parametrically varied across multiple SNRs, ranging from +20 dB (very easy) to −12 dB (very difficult). We anticipated that individual differences in age, hearing, and cognitive ability would predict subjective listening cost during speech-in-noise perception. Numerous studies in the speech-in-noise perception literature have shown that listening effort and accuracy are poorer for subjects who are older (Humes, 1996; Sommers & Danielson, 1999), have smaller working memory capacities (DeCaro et al., 2016; Ward et al., 2016), and/or have greater hearing loss (Koeritzer et al., 2018; McCoy et al., 2005). Thus, we predicted that older adults would experience greater listening effort for speech-in-noise perception compared to young adults, resulting in greater “discounting” than young adults at the most difficult SNRs (i.e., accepting less monetary reward in order to avoid a harder listening task). Additionally, we tested a priori, preregistered hypotheses that measures of area under the curve (AUC) from the discounting task would positively correlate with working memory capacity and negatively correlate with hearing status; these hypotheses, in particular, were based on data indicating that subjective ratings of listening effort are related to individual differences in cognitive capacity and hearing status (Koelewijn et al., 2012; Rudner et al., 2012). Other factors, such as task performance and self-reported desire to do well, were also examined, but no hypotheses were preregistered for these analyses.
Method
Preregistration of sample size, primary outcome measures, and exclusion criteria can be found at https://osf.io/tfc83/, and experimental materials (including experiment programs and stimuli), raw data, and analysis scripts can be found at https://osf.io/8jpnx/files/. All procedures were approved by the Washington University in St. Louis Institutional Review Board.
Participants
Young and older adults were recruited using the Washington University Psychology Subject Pool and a local participant registry. Eligibility criteria included the following: English as a first language, no history of neurological difficulties, and no clinically diagnosed hearing loss or use of hearing aids. Five young adults were excluded and replaced due to failure to meet eligibility criteria or experiment malfunction. No older adults were excluded, but for one older adult, there was an experiment malfunction resulting in 19% trial loss; including or excluding this participant did not change the results of the analyses. The final sample included 50 young adults between the ages of 18 and 24 years (M = 19.9 years, SD = 1.5; 35 female) and 50 older adults between the ages of 65 and 79 years (M = 70.9 years, SD = 3.6; 33 female). Participants were compensated $10 per hour, $5 for travel expenses, and between $0 and $10 in bonus pay depending on choices made during the task (typically $25–$35 in total). All subjects provided informed consent prior to participation.
Materials
Speech materials were recordings of a female native speaker of American English reading 160 sentences developed by Van Engen et al. (2012), with four key words each (e.g., “the gray mouse ate the cheese”). For the familiarization phase of the task, an additional 40 Hearing in Noise Test sentences read by another female native speaker of American English (Nilsson et al., 1994) were used as filler items to increase the length of the phase, ensuring that subjects became sufficiently familiar with the difficulty of each noise level. Sentences were presented in speech-shaped noise that was created to have the same long-term average spectrum of the sound files. Stimuli were mixed with Praat Version 6.0.16 (Boersma & Weenink, 2019) and presented at SNRs of +20, +4, 0, −4, −8, and −12 dB.
Procedure
Pure Tone Audiometry
After the consent process, participants completed audiometric testing. Participants were seated in a sound-attenuating booth with headphones and a response clicker. A researcher administered the test from outside the booth. Pure tones were presented at 250, 500, 1000, 2000, 4000, and 8000 Hz. Thresholds were determined by decreasing a given tone's intensity in 10 dB intervals until the participant could not detect it and then increasing in 5 dB intervals until the participant correctly responded. The lowest intensity at which participants responded 2 or more times out of three opportunities was recorded. Thresholds at 500, 1000, and 2000 Hz were averaged to determine a pure-tone average (PTA) in each ear, 2 and values from the better ear were used for analyses.
Working Memory Capacity
We used the Word Auditory Recognition and Recall Measure to measure working memory capacity (Smith et al., 2016). The Word Auditory Recognition and Recall Measure is an auditory working memory task that provides measures of word recognition and recall for sets of two to six words. Words are presented one at a time, and participants are instructed to repeat the word aloud (to confirm recognition accuracy) and judge whether the first letter of the word is from the first (A–M) or second (N–Z) half of the alphabet. After all of the words in a set have been presented, participants are cued to recall as many words from the set as possible, in order.
Phase 1: Familiarization
We used PsychoPy Version 1.84.1 (Peirce, 2007) for the listening experiments. To introduce the range of difficulty levels, the discounting task began with a familiarization phase. During this phase, participants were presented with sentences in noise and instructed to repeat aloud as much of each sentence as possible. An experimenter in the room typed the participant's response to minimize typing errors (particularly for older adult subjects); additionally, the presence of an experimenter provided a social incentive while performing the task. Participants were instructed to guess if they were unsure of any words in a sentence.
There were 80 trials during the familiarization phase, 16 sentences per SNR (excluding the +20 SNR level). Half of the sentences per SNR were filler items included to increase the length of Phase 1 and are not included in the analyses. Each SNR was labeled with a color (see Figure 1) to reduce anchoring effects, which are cognitive biases that could cause subjects to base judgments off of an initial (or baseline) level of difficulty (Ariely et al., 2003). Thus, prior to the discounting phase, participants learned the difficulty of each color without an explicit numeric label. Stimuli were blocked by SNR, with four trials per block. Subjects completed blocks in order of difficulty, from easiest (i.e., 4 SNR) to hardest (i.e., −12 SNR), completing four cycles. The color of a given level was displayed on the screen prior to each trial.
Phase 2: Discounting
Following the familiarization phase, participants completed the discounting phase. Each trial, participants were offered the option of performing the trial at a harder SNR for a $2 reward or at an easier SNR for a lower reward amount; all offers were presented as colors (see Figure 1), and SNRs were not shown to the participant. The colors of the two difficulty levels offered in each trial (e.g., black vs. yellow, corresponding to +20 vs. −8 dB SNR) were presented on the screen with instructions to select an offer by way of key press (e.g., “Press ‘a' for $2.00” in a yellow box). Thus, because participants were extremely familiar with the difficulty of each color from the familiarization phase, there was minimal risk of uncertainty during selections. After making a selection, subjects then listened to a sentence presented at the chosen difficulty level and repeated what they heard aloud to the experimenter in the room. Prior to beginning, participants were informed that their bonus pay would be based on five of their actual choices from the task, chosen at random by the experiment. The easier trial was always +20 SNR (black), and the harder trial was either +4, 0, −4, −8, or −12 dB SNR, changing each block. The amount of reward for the easier choice was titrated to determine the lowest value that a participant was willing to accept (see Figure 1). The difference between the lowest reward selection and the maximum reward offered represents the value of performing the harder task (i.e., the amount of “discounting”). The first reward offers of a block were always $1 (for easier) and $2 (for harder), and for each subsequent trial, the amount of adjustment to the smaller offer depended on whether the participant had selected the smaller or larger offer; if the smaller offer was selected, then the next smaller offer would be decreased, and if the larger offer ($2) was selected, then the next smaller offer would be increased. The amount of adjustment halved each trial as the block progressed, as demonstrated in Figure 1. The discounting phase included 20 blocks in total, with four blocks per each of the “harder” SNRs (+4, 0, −4, −8, and −12 dB) contrasted against the “easier” SNR (20 dB). Participants completed six trials in each block, for a total of 120 trials.
Target sentences were divided into 20 lists of six using “Match” (Van Casteren & Davis, 2007). The target sentences were matched based on intelligibility scores (i.e., average proportion of key words correctly recognized) from a previous study; thus, the lists of target sentences for the discounting phase were matched for expected difficulty. Sentence lists and SNR were randomly assigned across blocks, such that all participants had a unique combination, and order, of sentence lists and SNR.
Participants were instructed that performance on the task (i.e., how many words they correctly recognized per sentence) would not affect their bonus pay. However, they were encouraged to contribute the same amount of effort during the discounting phase as they did in the familiarization phase. The advantage of ignoring accuracy (and explicitly informing participants of this fact) is that it reduces the influence on metalinguistic judgments; that is, we did not want participants to consider their potential performance in addition to the cognitive effort associated with the task.
Questionnaires
The last portion of the experiment involved a series of questionnaires. Participants first answered a survey assessing their motivation during the two phases of the discounting task. Next, they were given a demographics and an income questionnaire. Estimated annual family income was measured to control for differences in socioeconomic status (SES). Lastly, older adult participants completed the short version of the Hearing Handicap Inventory for the Elderly (Ventry & Weinstein, 1983). All participants were debriefed once the experiment was completed.
Results
Data and analysis scripts are available from https://osf.io/8jpnx/files/. Figure 2 shows the average discounting curves for young and older adults. Linear mixed-effects regression was implemented using the lme4 package in R (Version 3.5.1) to model the discounting data. This analysis was not preregistered. However, it allowed us to control for potential intelligibility (i.e., performance) and income differences between young and older adult participants, which is crucial for interpreting the relationship between speech perception ability (i.e., working memory and hearing threshold measures) and discounting. For the model analyses, the discounting task data were summarized by block, where the value of interest was the lowest monetary amount (i.e., between $0 and $2) chosen in that block. Subjects were included as random intercepts. 3
First, we constructed a base model with a fixed effect of SNR, which was coded as a categorical variable. The levels of SNR were ordered, such that they went in order from easiest (+4 dB) to hardest (−12 dB), where +4 dB is the reference level in the model. All levels of SNR were significant (ps < .05). Next, likelihood ratio tests were used to determine the significance of the effects of interest. Age Group, ordered so that the young adult group was the reference level in the model, and the Age Group × SNR interaction both significantly improved model fit (χ2 1 = 18.01, p < .001, and χ2 1 = 112.77, p < .001, respectively; see Figure 2). Additionally, the fixed effects of intelligibility and the Intelligibility × SNR interaction improved model fit (χ2 1 = 36.66, p < .001, and χ2 1 = 19.82, p < .001, respectively), as did the Intelligibility × Age Group interaction (χ2 1 = 14.06, p < .001). 4 Lastly, working memory capacity (χ2 1 = 12.18, p < .001) and better ear PTA (χ2 1 = 6.08, p = .01) were found to improve model fit, but estimated annual family income (a proxy for SES) did not (χ2 1 = 0.001, p = .97). Thus, SES was dropped from the full model. Model estimates are reported in Table 1.
Table 1.
Main effect | Estimate | SE | t Value | p |
---|---|---|---|---|
Intercept | 1.32 | .26 | 5.15 | < .001 *** |
Block SNR (0 dB SNR) | −0.02 | .20 | −0.12 | .91 |
Block SNR (−4 dB SNR) | 0.42 | .18 | 2.37 | .02 * |
Block SNR (−8 dB SNR) | −0.04 | .19 | −0.21 | .83 |
Block SNR (−12 dB SNR) | −0.35 | .20 | −1.74 | .08 |
Age group (older) | −0.44 | .20 | −2.20 | .03 * |
Intelligibility | 0.25 | .22 | 1.16 | .25 |
Working memory capacity | 0.09 | .03 | 2.97 | .004 ** |
Better ear PTA | −0.01 | .005 | −2.45 | .02* |
Block SNR (0 dB SNR): age group (older) | −0.03 | .05 | −0.54 | .59 |
Block SNR (−4 dB SNR): age group (older) | −0.09 | .05 | −1.73 | .08 |
Block SNR (−8 dB SNR): age group (older) | 0.11 | .11 | 0.98 | .33 |
Block SNR (−12 dB SNR): age group (older) | 0.17 | .16 | 1.07 | .28 |
Block SNR (0 dB SNR): intelligibility | −0.003 | .21 | −0.02 | .99 |
Block SNR (−4 dB SNR): intelligibility | −0.49 | .19 | −2.65 | .008 ** |
Block SNR (−8 dB SNR): intelligibility | −0.09 | .20 | −0.47 | .64 |
Block SNR (−12 dB SNR): intelligibility | 0.61 | .27 | 2.23 | .03 * |
Age group (older): intelligibility | 0.62 | .18 | 3.36 | < .001 *** |
Note. SNR = signal-to-noise ratio; PTA = pure-tone average.
Significant at p < .05 level.
Significant at p < .01 level.
Significant at p < .001
When controlling for all other factors, results of the full model indicated an overall effect of age group on discounting (β = −.44, SE = .20, p = .03) but no significant interactions between age group and SNR at any level (all ps > .05). However, preregistered direct comparisons of discounting between young and older adults were conducted at −8 and −12 dB SNR using Wilcoxon rank-sum tests and indicated that older adults made lower selections (discounted more) than younger adults (both ps < .001). Figure 2 demonstrates this trend with the average discounting curves for young and older adults.
The main effect of intelligibility on discounting was not significant (β = .25, SE = .22, p > .05). However, the interaction between intelligibility and age group was significant (β = .62, SE = .18, p < .001) and indicated that older adults made decisions based on their task performance to a greater degree than young adults (see Table 2). Additionally, there were significant interactions between intelligibility and SNR at −4 dB (β = −.49, SE = .19, p = .01) and −12 dB (β = .60, SE = .27, p = .03), but not at 0 or −8 dB (both ps > .05). These interactions reflect differences in the slope of the relationship between intelligibility and discounting at each level of SNR. 5 Similarly, the main effect of SNR indicated that only the −4 dB level was significantly different from the reference level, +4 dB (β = .42, SE = .18, p = .02), with a marginal difference for −12 dB (β = −.35, SE = .20, p = .08) and no differences for the remaining levels (all ps > .05).
Table 2.
Signal-to-noise ratio | Young adults | Older adults |
---|---|---|
+4 dB | 0.95 (0.05) | 0.90 (0.14) |
0 dB | 0.97 (0.05) | 0.86 (0.17) |
−4 dB | 0.91 (0.08) | 0.66 (0.25) |
−8 dB | 0.56 (0.16) | 0.30 (0.16) |
−12 dB | 0.17 (0.09) | 0.07 (0.07) |
Note. Intelligibility is a listening performance measure of the proportion of key words per sentence that the subject was able to repeat back to the experimenter.
Lastly, better ear PTA (β = −.01, SE = .005, p = .02) and working memory capacity (β = .09, SE = .03, p = .004) significantly predicted discounting, indicating subjects with poorer hearing and smaller working memory capacities tended to select lower reward values. The relationship between hearing, working memory capacity, and age group was further examined with preregistered correlation analyses. For these analyses, data from Phase 2 of the discounting task were first summarized into a single value of AUC for each subject. This value was calculated by averaging the lowest reward value a given subject selected (i.e., between $0 and $2) for each SNR, summing these lowest selection averages, and then dividing by the total possible ($10). Thus, the AUC values are all between 0 and 1, where a lower value indicates more “discounting” and a higher value indicates less “discounting.”
Figure 3 shows correlations of discounting AUC with working memory capacity (left panel), better ear PTA (middle panel), and hearing handicap (assessed for older adults only; right panel). Pearson correlations were conducted with the cor.test() function in R, and Bonferroni-corrected significance level was applied for the five tests conducted (p < .01). For older adults, working memory capacity (r = .55, p < .001), better ear PTA (r = −.54, p < .001), and self-reported hearing handicap (r = −.49, p < .001) all significantly correlated with discounting AUC. The directions of these correlations matched our predictions, indicating that older adults who discount more tend to have smaller working memory capacities and poorer hearing. However, for young adults, neither working memory capacity (r = .07, p = .62) nor better ear PTA (r = −.03, p = .86) correlated with discounting AUC (although it is possible that this is due to a restricted range in each measure; discussed further below).
To further investigate what motivated participants' decisions during the task, we conducted exploratory analyses on two of the posttask survey questions: (a) “How much did the amount of money offered guide your decisions during the task?” and (b) “How much did your desire to do well guide your decisions during the task?” Participants answered on a rating scale from 1 to 7, where 1 = not at all and 7 = very much. The former question was selected because estimated income did not contribute to model fit, and the latter question was selected because of the interaction between intelligibility and age group. Figure 4 shows the distribution of data for each question and age group. Young adults reported that they were more motivated by the amount of money offered than older adults (p < .001), and older adults reported that they were more motivated by a desire to do well than young adults (p = .01), although the mean response of both groups for the latter self-report was similarly high (young adult: M = 5.31, older adult: M = 5.94). Self-reported motivation based on monetary compensation did not significantly correlate with discounting AUC for younger (r = .10, p = .51) or older (r = .06, p = .67) adults, and self-reported desire to do well predicted greater discounting (i.e., lower AUC) in young (r = −.38, p = .01), but not older (r = −.12, p = .40), adults. Thus, while young and older adults both report that they made decisions based on a desire to do well—as we expected based on the relationship between intelligibility and discounting—this relationship between discounting and reported desire to do well was only reliable for the young adults.
Discussion
In the current study, we used a discounting paradigm (i.e., a novel speech COG-ED, adapted from the original COG-ED task; Westbrook et al., 2013) to assess subjective listening effort during speech-in-noise comprehension for young and older adult listeners. We found that older adults discounted more than young adults at difficult SNRs, settling for smaller monetary rewards to avoid expending additional cognitive effort. Differences in decision making between age groups appear to be primarily related to three factors: working memory capacity, hearing ability, and intelligibility (i.e., listening performance). In particular, older adults with poorer working memory capacities and hearing abilities discounted the most, while those with better memory and hearing behaved more similarly to young adults, who discounted less. Notably, even when controlling for all other factors, the overall effect of age on discounting remained. This indicates that there may be an additional motivational factor driving the results beyond the effects of cognitive, linguistic, and sensory abilities. Investigating what drives the difference in subjective value for listening to degraded speech in older and young adults will be a fruitful area for future research.
Results also indicated that older adults made discounting decisions based on their listening performance to a greater degree than young adults. Here, it should be reiterated that all subjects were explicitly informed that how well they performed on the listening task would not affect their bonus pay; for example, participants could opt to select the harder SNR for $2 every trial (guaranteeing a $10 bonus), and they would receive the full bonus regardless of how well they perceived the harder SNR stimuli. Nevertheless, it may be that older adult participants, when selecting the easier SNR option (which was always worth less reward), were choosing it in order to avoid doing poorly on task (and the negative affect associated with poor performance) and not purely to avoid additional cognitive demand. Considering that there was a researcher in the room during the task (to type the participants' verbal responses), it is also possible that older adults were more influenced by the social incentive to perform well on the task. Exploratory analyses were conducted on self-reported “desire to do well” to explore this interpretation and indicated that older adults were more motivated by a desire to do well than young adults. However, when comparing this self-report measure directly to the discounting data, a relationship only emerged for the young adult participants. Thus, it is unclear whether the interaction between intelligibility and age is related to participants' desire to do well. In future research, this could be explored by manipulating whether the researcher is in the room (i.e., manipulating the social incentive to perform well) and also by probing participants more directly regarding their affective reactions to their performance.
Individual differences in estimated annual family income (a proxy for SES) did not account for age differences in the data, but exploratory analyses of self-reported motivation did indicate that young adults' decisions, compared to older adults' decisions, were more guided by the amount of money offered. It is possible that this discrepancy is related to limitations of our income questionnaire, which did not explicitly differentiate between family- and personally earned income for the young adult group. Given that the young adult participants in this study were university students, it may be the case that they were more motivated to earn money in the task than older adults, as self-reported, but their family income did not reflect this. However, it should also be noted that, when comparing this self-report measure to the discounting data, no correlation was found for either group. Thus, it remains unclear whether older adults, in part, show greater discounting because they valued the reward offers less than the young adults. Alternatives to monetary rewards have been used in neuroeconomic delay discounting (Seaman et al., 2016) and cognitive effort (Yee et al., 2019) tasks and could be used in future listening effort research that uses discounting paradigms to compare young and older adults.
Given the novelty of the present experimental design as a measure of subjective listening cost, it should be noted that there are a number of alternate designs that can be used in future research. For example, we opted for a basic discounting design, wherein in each trial, the participants were always offered the same easy SNR (+20 dB) for a smaller monetary reward, and only the lower reward offer was titrated. This design provided some benefits for this foundational study, such as simplifying the subjective value calculation, but may also omit theoretically important contrasts. For example, the first trial in a block could provide equal monetary rewards for each offer, which might yield a stronger assessment of pure preference, and could also reveal “negative discounting” patterns, in which some participants might be willing to accept less (or equal) money to do the harder task (i.e., as could potentially occur if they had high need for cognition; Cacioppo et al., 1984). Additionally, future studies could opt to titrate the larger reward offers and/or increase the size of reward offers (e.g., $10 vs. $50); this study offered real monetary rewards, which restricted the size of rewards to a $2 maximum, but larger rewards could be offered if researchers opted for a “hypothetical” reward design (see Lagorio & Madden, 2005, for validation of this procedure). Our design also differed from the original COG-ED paradigm by requiring participants to perform a trial after every decision (as opposed to completing only a subset of repeated trials; Westbrook et al., 2013). Using a subset of repeated trials could substantially shorten the length of the experiment and allow researchers to test additional hypotheses.
For the present speech-in-noise discounting task, working memory capacity and hearing ability were related to discounting for older, but not young, adult participants. The relationships between age, working memory, hearing ability, and subjective listening cost are not surprising given the immense literature indicating that, for older adults, poorer hearing increases the difficulty of speech processing (for a review, see Mattys et al., 2012) and that working memory supports speech processing for adults with hearing impairment (Ng et al., 2013; Rudner et al., 2011); however, for young adults with normal hearing, working memory appears to play a much smaller role in supporting speech-in-noise comprehension (Füllgrabe & Rosen, 2016). However, one limitation of this study is the restricted range of the data from the hearing and working memory measures for the young adult sample. It could be the case that, in a more diverse sample of young adults with a greater range in cognitive and perceptual abilities, or when using a working memory measure with greater discriminative power (see Draheim et al., 2018), these relationships would emerge.
Neurological evidence from young adult subjects has indicated that a domain-general valuation network, including the ventromedial prefrontal cortex and ventral striatum, is engaged in decision making related to the subject costs of delay, risk, physical effort, and cognitive effort (Bartra et al., 2013; Levy & Glimcher, 2012; Westbrook et al., 2019). For subjective cognitive effort costs, Westbrook et al. (2019) also found evidence suggesting that state motivation (i.e., trial-to-trial fluctuations) may be incorporated with subjective value in ventromedial prefrontal cortex. Conversely, individual differences in cognitive effort costs were associated with activity in the ventral striatum. In future work, it will be important to determine whether the observed age differences may arise because of changes in valuation network activity among older adults or whether they are due to other neural mechanisms.
In summary, we demonstrate a novel application of a discounting task, the speech COG-ED, which relies on revealed preferences to provide a quantitative measure of subjective listening costs during speech-in-noise perception. Objective factors such as age, hearing ability, and working memory capacity are known to impact speech processing, but measuring the relationship between these factors and subjective listening effort has proven to be more difficult. Using the speech COG-ED, we were able to objectively measure subjective listening costs and determine which cognitive-, perceptual-, and motivation-based factors contributed to decision making.
Acknowledgments
This research was funded by Grants R01 DC014281 and R56 AG059265 (Principal Investigator: Jonathan E. Peelle) of the U.S. National Institutes of Health and supported by a National Science Foundation Graduate Research Fellowship awarded to Drew J. McLaughlin (DGE-1745038).
This research was conducted at and supported by Washington University in St. Louis. We are grateful to Jaida Dalton, Henry Greenstein, Olivia Murray, and Maggie Zink for assistance with data collection and scoring, and to Jennifer Crawford for her valuable input on the research design.
Funding Statement
This research was funded by Grants R01 DC014281 and R56 AG059265 (Principal Investigator: Jonathan E. Peelle) of the U.S. National Institutes of Health and supported by a National Science Foundation Graduate Research Fellowship awarded to Drew J. McLaughlin (DGE-1745038).
Footnotes
While our construct of interest is subjective listening effort, we acknowledge that the judgments in the listening task may not be solely “effort-based” judgments; rather, they likely represent an accumulation of factors that contribute to the “cost” of performance, which may include perceived difficulty, self-efficacy, motivation, and the desire to appear competent. Thus, when referring to the construct of interest, we use the term “subjective listening effort,” and when referring to how it is measured in the discounting task, we use the term “subjective listening cost.”
The frequencies used to calculate the PTAs are the ones typically used clinically in comparison with speech reception thresholds.
We were not able to include items as a random effect. The data for the mixed-effects regression analysis were not raw, by-item trial data, because the variable of interest was the lowest selection made within a block of six trials.
The intelligibility data used in the model are from Phase 1, not Phase 2. Intelligibility data from the concurrent task were not used because subjects did not perform an equal number of trials for each condition (and, in some cases, they could have performed no trials at a given SNR).
All five levels of SNR showed positive correlations with discounting. These interactions appear to be primarily driven by the restricted range of the intelligibility data, which were proportions of words correctly identified between 0 and 1. At +4 dB (the reference level), the range of the intelligibility scores is smaller (min = .34, max = 1; M = .93, SD = .11) than at −4 dB (min = 0, max = 1; M = .78, SD = .22), resulting in a shallower slope of the relationship between intelligibility and discounting. Conversely, at −12 dB, the range of intelligibility scores is smaller than that at the reference level (min = 0, max = .44; M = .12, SD = .10), resulting in a steeper slope. The 0 dB (min = .28, max = 1; M = .91, SD = .14) and −8 dB (min = 0, max = .91; M = .43, SD = .21) levels have ranges and slopes more similar to the reference level.
References
- Ariely, D. , Loewenstein, G. , & Prelec, D. (2003). “Coherent arbitrariness”: Stable demand curves without stable preferences. In Lichtenstein, S. & Slovic, P. (Eds.), The construction of preference (pp. 246–270). Cambridge University Press. https://doi.org/10.1017/CBO9780511618031.014 [Google Scholar]
- Bartra, O. , McGuire, J. T. , & Kable, J. W. (2013). The valuation system: A coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. NeuroImage, 76, 412–427. https://doi.org/10.1016/j.neuroimage.2013.02.063 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Beatty, J. (1982). Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91(2), 276–292. https://doi.org/10.1037/0033-2909.91.2.276 [PubMed] [Google Scholar]
- Boersma, P. , & Weenink, D. (2019). Praat: Doing phonetics by computer (Version 6.0.50) [Computer software] . http://www.praat.org/
- Brons, I. , Houben, R. , & Dreschler, W. A. (2014). Effects of noise reduction on speech intelligibility, perceived listening effort, and personal preference in hearing-impaired listeners. Trends in Hearing, 18, 2331216514553924. https://doi.org/10.1177/2331216514553924 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Cacioppo, J. T. , Petty, R. E. , & Feng Kao, C. (1984). The efficient assessment of need for cognition. Journal of Personality Assessment, 48(3), 306–307. https://doi.org/10.1207/s15327752jpa4803_13 [DOI] [PubMed] [Google Scholar]
- Cousins, K. A. Q. , Dar, H. , Wingfield, A. , & Miller, P. (2014). Acoustic masking disrupts time-dependent mechanisms of memory encoding in word-list recall. Memory & Cognition, 42, 622–638. https://doi.org/10.3758/s13421-013-0377-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- DeCaro, R. , Peelle, J. E. , Grossman, M. , & Wingfield, A. (2016). The two sides of sensory–cognitive interactions: Effects of age, hearing acuity, and working memory span on sentence comprehension. Frontiers in Psychology, 7, 236. https://doi.org/10.3389/fpsyg.2016.00236 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Draheim, C. , Harrison, T. L. , Embretson, S. E. , & Engle, R. W. (2018). What item response theory can tell us about the complex span tasks. Psychological Assessment, 30(1), 116–129. https://doi.org/10.1037/pas0000444 [DOI] [PubMed] [Google Scholar]
- Eckert, M. A. , Matthews, L. J. , & Dubno, J. R. (2017). Self-assessed hearing handicap in older adults with poorer-than-predicted speech recognition in noise. Journal of Speech, Language, and Hearing Research, 60(1), 251–262. https://doi.org/10.1044/2016_JSLHR-H-16-0011 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Eckert, M. A. , Vaden, K. I., Jr. , Teubner-Rhodes, S. , & Bentzley, B. S. (2017). A novel communication value task demonstrates evidence of response bias in cases with presbyacusis. Scientific Reports, 7(1), Article 16512. https://doi.org/10.1038/s41598-017-16673-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- Füllgrabe, C. , & Rosen, S. (2016). On the (un)importance of working memory in speech-in-noise processing for listeners with normal hearing thresholds. Frontiers in Psychology, 7, 1268. https://doi.org/10.3389/fpsyg.2016.01268 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Gatehouse, S. , & Noble, W. (2004). The Speech, Spatial and Qualities of Hearing Scale (SSQ). International Journal of Audiology, 43(2), 85–99. https://doi.org/10.1080/14992020400050014 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Green, L. , & Myerson, J. (2004). A discounting framework for choice with delayed and probabilistic rewards. Psychological Bulletin, 130(5), 769–792. https://doi.org/10.1037/0033-2909.130.5.769 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heinrich, A. , Schneider, B. A. , & Craik, F. I. M. (2008). Investigating the influence of continuous babble on auditory short-term memory performance. Quarterly Journal of Experimental Psychology, 61(5), 735–751. https://doi.org/10.1080/17470210701402372 [DOI] [PubMed] [Google Scholar]
- Hess, E. H. , & Polt, J. M. (1964). Pupil size in relation to mental activity during simple problem-solving. Science, 143(3611), 1190–1192. https://doi.org/10.1126/science.143.3611.1190 [DOI] [PubMed] [Google Scholar]
- Hétu, R. , Riverin, L. , Lalande, N. , Getty, L. , & St-Cyr, C. (1988). Qualitative analysis of the handicap associated with occupational hearing loss. British Journal of Audiology, 22(4), 251–264. https://doi.org/10.3109/03005368809076462 [DOI] [PubMed] [Google Scholar]
- Humes, L. E. (1996). Speech understanding in the elderly. Journal of the American Academy of Audiology, 7, 161–167. [PubMed] [Google Scholar]
- Humes, L. E. (1999). Dimensions of hearing aid outcome. Journal of the American Academy of Audiology, 10(1), 26–39. [PubMed] [Google Scholar]
- Kahneman, D. (1973). Attention and effort. Prentice-Hall. [Google Scholar]
- Kirby, K. N. (2009). One-year temporal stability of delay-discount rates. Psychonomic Bulletin & Review, 16(3), 457–462. https://doi.org/10.3758/PBR.16.3.457 [DOI] [PubMed] [Google Scholar]
- Koelewijn, T. , Zekveld, A. A. , Festen, J. M. , Rönnberg, J. , & Kramer, S. E. (2012). Processing load induced by informational masking is related to linguistic abilities. International Journal of Otolaryngology, 2012, Article 865731. https://doi.org/10.1155/2012/865731 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Koeritzer, M. A. , Rogers, C. S. , Van Engen, K. J. , & Peelle, J. E. (2018). The impact of age, background noise, semantic ambiguity, and hearing loss on recognition memory for spoken sentences. Journal of Speech, Language, and Hearing Research, 61(3), 740–751. https://doi.org/10.1044/2017_JSLHR-H-17-0077 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Kuchinsky, S. E. , Ahlstrom, J. B. , Vaden, K. I., Jr. , Cute, S. L. , Humes, L. E. , Dubno, J. R. , & Eckert, M. A. (2013). Pupil size varies with word listening and response selection difficulty in older adults with hearing loss. Psychophysiology, 50(1), 23–34. https://doi.org/10.1111/j.1469-8986.2012.01477.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lagorio, C. H. , & Madden, G. J. (2005). Delay discounting of real and hypothetical rewards III: Steady-state assessments, forced-choice trials, and all real rewards. Behavioural Processes, 69(2), 173–187. https://doi.org/10.1016/j.beproc.2005.02.003 [DOI] [PubMed] [Google Scholar]
- Levy, D. J. , & Glimcher, P. W. (2012). The root of all value: A neural common currency for choice. Current Opinion in Neurobiology, 22(6), 1027–1038. https://doi.org/10.1016/j.conb.2012.06.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Mattys, S. L. , Davis, M. H. , Bradlow, A. R. , & Scott, S. K. (2012). Speech recognition in adverse conditions: A review. Language and Cognitive Processes, 27(7–8), 953–978. https://doi.org/10.1080/01690965.2012.705006 [Google Scholar]
- McAuliffe, M. J. , Wilding, P. J. , Rickard, N. A. , & O'Beirne, G. A. (2012). Effect of speaker age on speech recognition and perceived listening effort in older adults with hearing loss. Journal of Speech, Language, and Hearing Research, 55(3), 838–847. https://doi.org/10.1044/1092-4388(2011/11-0101) [DOI] [PubMed] [Google Scholar]
- McCoy, S. L. , Tun, P. A. , Cox, L. C. , Colangelo, M. , Stewart, R. , & Wingfield, A. (2005). Hearing loss and perceptual effort: Downstream effects on older adults' memory for speech. Quarterly Journal of Experimental Psychology, 58(1), 22–33. https://doi.org/10.1080/02724980443000151 [DOI] [PubMed] [Google Scholar]
- McGarrigle, R. , Munro, K. J. , Dawes, P. , Stewart, A. J. , Moore, D. R. , Barry, J. G. , & Amitay, S. (2014). Listening effort and fatigue: What exactly are we measuring? A British Society of Audiology Cognition in Hearing Special Interest Group “white paper.” International Journal of Audiology, 53(7), 433–440. https://doi.org/10.3109/14992027.2014.890296 [DOI] [PubMed] [Google Scholar]
- Moore, T. M. , & Picou, E. M. (2018). A potential bias in subjective ratings of mental effort. Journal of Speech, Language, and Hearing Research, 61(9), 2405–2421. https://doi.org/10.1044/2018_JSLHR-H-17-0451 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Myerson, J. , & Green, L. (1995). Discounting of delayed rewards: Models of individual choice. Journal of the Experimental Analysis of Behavior, 64(3), 263–276. https://doi.org/10.1901/jeab.1995.64-263 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ng, E. H. N. , Rudner, M. , Lunner, T. , Pedersen, M. S. , & Rönnberg, J. (2013). Effects of noise and working memory capacity on memory processing of speech for hearing-aid users. International Journal of Audiology, 52(7), 433–441. https://doi.org/10.3109/14992027.2013.776181 [DOI] [PubMed] [Google Scholar]
- Nilsson, M. , Soli, S. D. , & Sullivan, J. A. (1994). Development of the Hearing in Noise Test for the measurement of speech reception thresholds in quiet and in noise. The Journal of the Acoustical Society of America, 95(2), 1085–1099. https://doi.org/10.1121/1.408469 [DOI] [PubMed] [Google Scholar]
- Peelle, J. E. (2018). Listening effort: How the cognitive consequences of acoustic challenge are reflected in brain and behavior. Ear and Hearing, 39(2), 204–214. https://doi.org/10.1097/AUD.0000000000000494 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Peirce, J. W. (2007). PsychoPy—Psychophysics software in Python. Journal of Neuroscience Methods, 162, 8–13. https://doi.org/10.1016/j.jneumeth.2006.11.017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Pichora-Fuller, M. K. , Kramer, S. E. , Eckert, M. A. , Edwards, B. , Hornsby, B. W. Y. , Humes, L. E. , Lemke, U. , Lunner, T. , Matthen, M. , Mackersie, C. L. , Naylor, G. , Phillips, N. A. , Richter, M. , Rudner, M. , Sommers, M. S. , Tremblay, K. L. , & Wingfield, A. (2016). Hearing impairment and cognitive energy: The Framework for Understanding Effortful Listening (FUEL). Ear and Hearing, 37(Suppl. 1), 5S–27S. https://doi.org/10.1097/AUD.0000000000000312 [DOI] [PubMed] [Google Scholar]
- Picou, E. M. , Ricketts, T. A. , & Hornsby, B. W. Y. (2011). Visual cues and listening effort: Individual variability. Journal of Speech, Language, and Hearing Research, 54(5), 1416–1430. https://doi.org/10.1044/1092-4388(2011/10-0154) [DOI] [PubMed] [Google Scholar]
- Rabbitt, P. M. (1968). Channel-capacity, intelligibility and immediate memory. The Quarterly Journal of Experimental Psychology, 20(3), 241–248. https://doi.org/10.1080/14640746808400158 [DOI] [PubMed] [Google Scholar]
- Rudner, M. , Lunner, T. , Behrens, T. , Thorén, E. S. , & Rönnberg, J. (2012). Working memory capacity may influence perceived effort during aided speech recognition in noise. Journal of the American Academy of Audiology, 23(8), 577–589. https://doi.org/10.3766/jaaa.23.7.7 [DOI] [PubMed] [Google Scholar]
- Rudner, M. , Rönnberg, J. , & Lunner, T. (2011). Working memory supports listening in noise for persons with hearing impairment. Journal of the American Academy of Audiology, 22(3), 156–167. https://doi.org/10.3766/jaaa.22.3.4 [DOI] [PubMed] [Google Scholar]
- Seaman, K. L. , Gorlick, M. A. , Vekaria, K. M. , Hsu, M. , Zald, D. H. , & Samanez-Larkin, G. R. (2016). Adult age differences in decision making across domains: Increased discounting of social and health-related rewards. Psychology and Aging, 31(7), 737–746. https://doi.org/10.1037/pag0000131 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Smith, S. L. , Pichora-Fuller, M. K. , & Alexander, G. (2016). Development of the word auditory recognition and recall measure: A working memory test for use in rehabilitative audiology. Ear and Hearing, 37(6), e360–e376. https://doi.org/10.1097/AUD.0000000000000329 [DOI] [PubMed] [Google Scholar]
- Sommers, M. S. , & Danielson, S. M. (1999). Inhibitory processes and spoken word recognition in young and older adults: The interaction of lexical competition and semantic context. Psychology and Aging, 14, 458–472. https://doi.org/10.1037/0882-7974.14.3.458 [DOI] [PubMed] [Google Scholar]
- Strand, J. F. , Brown, V. A. , Merchant, M. B. , Brown, H. E. , & Smith, J. (2018). Measuring listening effort: Convergent validity, sensitivity, and links with cognitive and personality measures. Journal of Speech, Language, and Hearing Research, 61(6), 1463–1486. https://doi.org/10.1044/2018_JSLHR-H-17-0257 [DOI] [PubMed] [Google Scholar]
- Van Casteren, M. , & Davis, M. H. (2007). Match: A program to assist in matching the conditions of factorial experiments. Behavior Research Methods, 39(4), 973–978. https://doi.org/10.3758/BF03192992 [DOI] [PubMed] [Google Scholar]
- Van Engen, K. J. , Chandrasekaran, B. , & Smiljanic, R. (2012). Effects of speech clarity on recognition memory for spoken sentences. PLOS ONE, 7(9), Article e43753. https://doi.org/10.1371/journal.pone.0043753 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Van Engen, K. J. , & McLaughlin, D. J. (2018). Eyes and ears: Using eye tracking and pupillometry to understand challenges to speech recognition. Hearing Research, 369, 56–66. https://doi.org/10.1016/j.heares.2018.04.013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ventry, I. M. , & Weinstein, B. E. (1983). Identification of elderly people with hearing problems. American Speech-Language-Hearing Association, 25(7), 37–42. [PubMed] [Google Scholar]
- Ward, C. M. , Rogers, C. S. , Van Engen, K. J. , & Peelle, J. E. (2016). Effects of age, acoustic challenge, and verbal working memory on recall of narrative speech. Experimental Aging Research, 42(1), 126–144. https://doi.org/10.1080/0361073X.2016.1108785 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Westbrook, A. , Kester, D. , & Braver, T. S. (2013). What is the subjective cost of cognitive effort? Load, trait, and aging effects revealed by economic preference. PLOS ONE, 8(7), Article e68210. https://doi.org/10.1371/journal.pone.0068210 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Westbrook, A. , Lamichhane, B. , & Braver, T. (2019). The subjective value of cognitive effort is encoded by a domain-general valuation network. The Journal of Neuroscience, 39(20), 3934–3947. https://doi.org/10.1523/JNEUROSCI.3071-18.2019 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Wingfield, A. (2016). Evolution of models of working memory and cognitive resources. Ear and Hearing, 37, 35S–43S. https://doi.org/10.1097/AUD.0000000000000310 [DOI] [PubMed] [Google Scholar]
- Winn, M. B. , Edwards, J. R. , & Litovsky, R. Y. (2015). The impact of auditory spectral resolution on listening effort revealed by pupil dilation. Ear and Hearing, 36(4), e153–e165. https://doi.org/10.1097/AUD.0000000000000145 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Yee, D. M. , Adams, S. , Beck, A. , & Braver, T. S. (2019). Age-related differences in motivational integration and cognitive control. Cognitive, Affective, & Behavioral Neuroscience, 19(3), 692–714. https://doi.org/10.3758/s13415-019-00713-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zekveld, A. A. , & Kramer, S. E. (2014). Cognitive processing load across a wide range of listening conditions: Insights from pupillometry. Psychophysiology, 51(3), 277–284. https://doi.org/10.1111/psyp.12151 [DOI] [PubMed] [Google Scholar]
- Zekveld, A. A. , Kramer, S. E. , & Festen, J. M. (2010). Pupil response as an indication of effortful listening: The influence of sentence intelligibility. Ear and Hearing, 31(4), 480–490. https://doi.org/10.1097/AUD.0b013e3181d4f251 [DOI] [PubMed] [Google Scholar]