Abstract
Objective:
Lack of trust toward medical research is a major barrier to research participation, particularly among some population groups. Valid measures of trust are needed to develop appropriate interventions. The study purpose was to compare two previously validated scales that measure trust in biomedical research – one developed by Hall et al. (H-TBR; 2006) and the other by Mainous et al. (M-TBR; 2006) – in relation to socio-demographic variables and attitudes toward research. Differences between Black and White respondents were explored.
Methods:
Two nearly identical surveys – one with H-TBR and the other with M-TBR – were systematically administered to a convenience sample. Internal consistency reliability of each scale was assessed. Associations were computed between scores on each scale with attitudes toward biomedical research and demographic variables (i.e., gender, age, race, and socioeconomic status). The difference between White and Black respondents on each TBR score while controlling for age, education, and race was also investigated.
Results:
A total of 2020 participants completed the H-TBR survey; 1957 completed the M-TBR survey. Mean item scores for M-TBR were higher (F = 56.05, p < 0.001) among Whites than Blacks. Whites also had higher mean item scores than Blacks on H-TBR (F = 7.09, p < 0.001). Both scales showed a strong association with participants’ perceived barriers to research (ps < 0.001) and significant, positive correlations with interest in research participation (ps < 0.001). Age and household income were positive predictors of TBR scores, but the effects of education differed.
Conclusions:
Both scales are internally consistent and show associations with attitudes toward research. Whites score higher than Blacks on both TBR scales, even while controlling for age and socioeconomic status.
Key words: Trust, research participation, psychometrics, assessment, attitudes toward research
Introduction
Lack of trust in the research process continues to affect the public’s confidence in research and their willingness to participate in medical studies [1–5]. Particularly, minority groups and individuals with low educational attainment continue to exhibit the lowest levels of trust in the research process. This contributes to low participation rates in clinical trials and exacerbates health and healthcare disparities [6,7]. According to the past studies, several factors influence an individual’s level of trust in research including socioeconomic status, cultural beliefs, and personal or interpersonal experiences with research and health care providers [2,8–10]. However, measuring this concept in biomedical research is likely different from measuring trust in healthcare and other areas, especially among those underrepresented in research [11,12].
Trust is a complex construct, and many scales have been developed that purport to measure trust. Scales vary in content, dimensionality, and targets of applications (e.g., healthcare, providers, and biomedical research), and validation procedures often lack inclusion of diverse populations [12–14]. The measures include content areas commonly associated with Whites – e.g., competency, fidelity, confidentiality, honesty, and global/system trust. Hence, a major disadvantage of these measures – especially those used in healthcare settings – is the neglect of domains that might be particularly important to people less likely to voluntarily participate in medical research – e.g., safety, fairness, communication, and honesty. This creates a critical gap in our understanding of trust across populations [11].
At the time of our study, two scales had been published as measures of trust in biomedical research (TBR) [12,14]. While limited in content areas, they appear to measure similar content in comparable populations. The trust content areas of the H-TBR are safety, honesty, fidelity, and system trust [14], while the content areas of the M-TBR are honesty, communication, and fairness [12]. The content areas of the M-TBR also address trust in minorities specifically. It is unknown whether the outcome of each scale is affected by variables involving individual characteristics and the context in which the scales are administered.
The objective of this study was to explore the extent to which the Hall et al. (2006) (H-TBR) and Mainous et al. (2006) (M-TBR) trust scales are similar or different in terms of their associations with sociodemographic variables and variables assessing attitudes toward research. We further determined if racial differences existed between both trust scales, other research variables, and sociodemographic variables. Findings from this study can identify (1) factors that threaten trust in biomedical research and if these factors differ by race, (2) if the current measures are rigorous in measuring trust and encompass all trust domains across race, and (3) interventional targets possibly developed using a tailored approach aimed to improve and sustain the public’s trust in research and if these targets should be tailored.
Materials and Methods
Sample and Recruitment
A cross-sectional study was conducted to compare the psychometric properties of the two published TBR scales and assess how each relates to socio-demographic variables and attitudes toward research. Participants (N = 3977) were a diverse, convenient sample of adults over the age of 18 recruited from the Mid-South region (Tennessee, Kentucky, Alabama, and the southwestern region of Virginia). Priority populations for this study, which were identified by the research team, were racial/ethnic minorities, individuals with multiple chronic conditions, low-income groups, rural and urban residents, and older adults. There were no other eligibility criteria.
Due to the diversity in the target audience, multiple strategies were required for recruitment. Recruitment was in-person at community health centers, neighborhood resource centers, minority-owned businesses (e.g., barbershops), and community health forums (e.g., health fairs). Online strategies were the Vanderbilt patient portal and ResearchMatch (RM). RM is an online, national registry for the recruitment of volunteers for clinical research [15]. All of these sites were chosen as we sought a broad audience to elicit perspectives on trust. This study was approved by Vanderbilt University’s Institutional Review Board, and all participants provided written consent prior to taking the survey.
Measures
In order to compare these two TBR scales, two parallel surveys were developed. The Hall et al. (2006) scale (H-TBR) was included on one survey (Hall-survey), while the Mainous et al. (2006) scale (M-TBR) was included on the other (Mainous-Survey). All other measures in both surveys were identical. A brief description of each study measure is provided below.
Demographics and background information. Participants reported their race/ethnicity, gender, year of birth, educational attainment, and household income. For race/ethnicity, respondents were able to check all applicable categories with nine options including “other” and “prefer not to answer.”
Trust in biomedical research. Each survey included one of the two, 12-item TBR scales. (See Table 1 for the items on each of the scales.) The H-TBR is typically treated as unidimensional yielding a single overall score. The M-TBR consists of two, 6-item subscales, “Researcher Honesty” and “Participant Deception,” which are sometimes scored separately and other time combined into a single score. For this study’s purpose, the two subscales of the M-TBR were combined into a single overall score to make it comparable to the H-TBR. Both instruments use a five-point Likert response scale ranging from “Strongly Disagree” to “Strongly Agree.” Both scales had negatively worded items (4 on H-TBR; 8 on M-TBR) that were reverse coded for scoring purposes. A high score on either scale signifies high levels of trust in biomedical research. Mean item scores were computed by dividing the total summed score by 12.
Table 1.
Mean item scores, total scores, and internal consistency measures for both trust in biomedical research (TBR) scales
| H-TBR scale | M-TBR scale | ||
|---|---|---|---|
| Items/reversed scored items | Mean (SD) | Items/reversed scored items | Mean (SD) |
| Doctors who do medical research care only about what is best for each patient. | 3.18 (0.91) | To get people to take part in a study, medical researchers usually do not explain all of the dangers about participation. | 3.65 (0.97) |
| Medical researchers treat people like guinea pigs. | 3.76 (0.84) | Participants should be concerned about being deceived or misled by medical researchers. | 3.55 (1.04) |
| It is safe to be in a medical research study. | 3.58 (0.74) | Usually, researchers who make mistakes try to cover them up. | 3.58 (0.91) |
| Some doctors do medical research for selfish reasons. | 3.14 (0.93) | Medical researchers act differently toward minority subjects than toward white subjects. | 3.76 (0.98) |
| Doctors tell their patients everything they need to know about being in a research study. | 3.32 (0.91) | Medical researchers unfairly select minorities for their most dangerous research studies. | 4.03 (0.92) |
| A doctor would never ask me to be in a medical research study if the doctor thought there was any chance it might harm me. | 3.52 (0.95) | Some medical research projects are secretly designed to expose minority groups to diseases such as AIDS. | 4.28 (0.90) |
| There are some things about medical research that I do not trust at all. | 3.21 (0.94) | Medical researchers are generally honest in telling participants about different treatment options available for their conditions. | 3.86 (0.82) |
| A doctor would never recommend something that is not the best treatment just so he or she can study how it works. | 3.28 (0.97) | Usually, medical researchers tell participants everything about possible dangers. | 3.78 (0.89) |
| Medical researchers have no selfish reasons for doing research studies. | 2.86 (0.88) | All in all, medical researchers would not conduct experiments on people without their knowledge. | 3.96 (0.90) |
| Medical researchers do not tell people everything they really need to know about being in a research study. | 3.35 (0.90) | Most medical researchers would not lie to people to try to convince them to participate in a research study. | 3.97 (0.88) |
| The only reason doctors do medical research is to help people. | 3.32 (0.96) | In general, medical researchers care more about doing their research than about the participants medical needs. | 3.49 (0.97) |
| I completely trust doctors who do medical research. | 3.39 (0.83) | Researchers are more interested in helping their careers than in learning about health and disease. | 3.82 (0.91) |
| H-TBR scale mean item score | 3.33 (0.56) | M-TBR scale mean item score | 3.81 (0.65) |
| Internal consistency measures | |||
| Cronbach’s α | 0.86 | Cronbach’s α | 0.905 |
| McDonald’s ω | 0.89 | McDonald’s ω | 0.93 |
Attitudes toward research. Both surveys included two questionnaires assessing attitudes toward research. The perceived barriers to research participation were assessed using a modified version of the barriers to research participation scale [16]. Two survey items – “Prefer study headed by Black scientist” and “Prefer study headed by Latino scientist” – were excluded because the past research participants expressed discomfort in responding to those questions. A total of 11 of the remaining 12 items were answered using a five-point Likert response scale. Certain items were reversed scored so that higher scores represented less perceived barriers. The final item (“In my opinion, research in the United States is …”) had three possible response options: “ethical,” “not ethical,” and “I don’t know.” To preserve how this item fit with the other 11 items, this item was recoded to be proportional to its weight in the original scale. Therefore, the response “ethical” was recoded as 2.54, “not ethical” was recoded as 0.83, and “I don’t know” was recoded as 1.69. Scores on the barrier measure ranged from 11.83 to 57.54, with higher scores signifying fewer barriers.
Interest in research participation was measured with a survey instrument derived from the “Willingness to Take Part in Research” survey, which was developed by health behavior and health services research experts in the National Patient-Centered Clinical Research Network [17]. The seven-item scale asked about interest in research participation using different research scenarios, such as “Giving a blood sample” or “Taking part in a study that requires medication.” The response options were “Not interested” (1), “Somewhat interested” (2), or “Very interested” (3). A mean score across the seven scenarios, ranging from 7 to 21, was computed. Higher scores signified greater interest in participating in research.
Data Collection
In order to achieve the equal distribution of the sample per survey, the Hall-survey and the Mainous-survey were alternatively distributed every two weeks. Both surveys were administered face-to-face or online during an 18-month period between March 2014 and September 2015. Within the community settings, liaisons were identified to seek approval for the survey distribution. After receiving approval, a member of the research team provided the survey via IPAD or paper. Participants took approximately 20–30 minutes to complete the survey. Compensation was a $10 Kroger gift card.
Statistical Methods
Following suggestions by Revelle and Zinbarg [18], internal consistency reliability was assessed for each TBR scale using Cronbach’s α and McDonald’s ω. In order to assess the direct associations between the H-TBR and M-TBR scores and sociodemographic and research-related variables, Pearson correlation coefficients were computed. Fisher’s r to z transformations were computed to compare the correlation coefficients between both TBR scales [19]. T-tests and Chi-Square tests were performed to assess racial differences between both TBR scales, other research variables, and sociodemographic variables. SPSS [20] and R 3.3.2 [21] with the psych package [22] were used for these analyses.
Results
The total sample consisted of 3977 adults. On average, respondents were in their late 40s. The majority of respondents (~80%) self-identified as White and ~14% identified as Black. Over two-thirds of the respondents were female. Approximately 60% reported having a college degree or higher, and more than half were employed full- or part-time. Table 2 provides separate and combined descriptive characteristics for the two survey subsamples. As would be expected with subsamples of this size, there were no differences on any background variable between the two subsamples.
Table 2.
Demographic characteristics for the two trust in biomedical research (TBR) scales
| Total (N = 3977) | H-TBR (N = 2020) | M-TBR (N = 1957) | |||||
|---|---|---|---|---|---|---|---|
| Mean (SD) | Mean (SD) | Mean (SD) | |||||
| 48.36 (15.29) | 48.11 (15.61) | 48.62(14.95) | |||||
| Age | N | % | N | % | N | % | |
| Gender | Male | 1203 | 30.2 | 598 | 29.6 | 605 | 30.9 |
| Female | 2744 | 69.0 | 1403 | 69.5 | 1341 | 68.5 | |
| Other | 3 | 0.1 | 2 | 0.1 | 1 | 0.1 | |
| Prefer not to answer | 7 | 0.2 | 4 | 0.2 | 3 | 0.2 | |
| N/A | 20 | 0.5 | 13 | 0.6 | 7 | 0.4 | |
| Race | Asian | 56 | 1.4 | 31 | 1.5 | 25 | 1.3 |
| Black | 565 | 14.2 | 284 | 14.1 | 281 | 14.4 | |
| Hispanic/Latino | 77 | 1.9 | 36 | 1.8 | 41 | 2.1 | |
| Other | 46 | 1.2 | 27 | 1.3 | 19 | 1 | |
| White | 3188 | 80.2 | 1622 | 80.3 | 1566 | 80 | |
| Prefer not to answer | 29 | 0.7 | 13 | 0.6 | 16 | 0.8 | |
| N/A | 16 | 0.4 | 7 | 0.3 | 9 | 0.5 | |
| Education | ≤12 years | 117 | 2.9 | 58 | 2.9 | 59 | 3.0 |
| High school degree | 402 | 10.1 | 193 | 9.6 | 209 | 10.7 | |
| Some college | 1042 | 26.2 | 500 | 24.8 | 542 | 27.7 | |
| College degree | 1135 | 28.5 | 593 | 29.4 | 542 | 27.7 | |
| After college studies | 1242 | 31.2 | 647 | 32.0 | 595 | 30.4 | |
| N/A | 39 | 1.0 | 29 | 1.4 | 10 | .5 | |
| Employment | Employed full time (32+ h per week) | 2012 | 50.6 | 1006 | 49.8 | 1006 | 51.4 |
| Employed part time (less than 32 h per week) | 352 | 8.9 | 185 | 9.2 | 167 | 8.5 | |
| Unemployed | 217 | 5.5 | 99 | 4.9 | 118 | 6 | |
| Volunteer | 34 | 0.9 | 22 | 1.1 | 12 | 0.6 | |
| Stay-at-home parent | 177 | 4.5 | 84 | 4.2 | 93 | 4.8 | |
| Retired | 665 | 16.7 | 325 | 16.1 | 340 | 17.4 | |
| Receiving disability | 279 | 7.0 | 151 | 7.5 | 128 | 6.5 | |
| Other | 223 | 5.6 | 134 | 6.6 | 89 | 4.5 | |
| N/A | 18 | 0.5 | 14 | 0.7 | 4 | 0.2 | |
| Income | Less than $10,000 | 242 | 6.1 | 123 | 6.1 | 119 | 6.1 |
| $10,000–$14,999 | 154 | 3.9 | 70 | 3.5 | 84 | 4.3 | |
| $15,000–$24,999 | 229 | 5.8 | 120 | 5.9 | 109 | 5.6 | |
| $25,000–$34,999 | 350 | 8.8 | 180 | 8.9 | 170 | 8.7 | |
| $35,000–$49,999 | 451 | 11.3 | 219 | 10.8 | 232 | 11.9 | |
| $50,000–$74,999 | 695 | 17.5 | 336 | 16.6 | 359 | 18.3 | |
| $75,000–$99,999 | 524 | 13.2 | 279 | 13.8 | 245 | 12.5 | |
| $100,000–$149,999 | 493 | 12.4 | 246 | 12.2 | 247 | 12.6 | |
| $150,000 or more | 405 | 10.2 | 210 | 10.4 | 195 | 10 | |
| N/A | 434 | 10.9 | 237 | 11.7 | 197 | 10.1 | |
Reliability of the H-TBR and M-TBR Scales
Each scale was tested for internal consistency reliability. Both scales were internally consistent, with both Cronbach’s α and McDonald’s ω higher than 0.8 (see the bottom of Table 1). On average, respondents completing the survey containing the M-TBR scale had higher mean scores (M = 3.81) than those who completed the survey with the H-TBR scale (M = 3.33, t (3975) = 24.97, p < 0.001), despite both scales having an equal score range.
Associations among TBR scale scores, socio-demographic variables, and attitudes toward research
Sociodemographic variables. Mean scores for the entire sample as well as Pearson correlation coefficients between the two TBR scales and sociodemographic are shown in Table 3. Household income is positively correlated with both TBR scales, but the correlation of income with M-TBR is higher than that of income with H-TBR (z = −5.29, p < 0.001). Education is also significantly correlated with both scales, although in opposite directions. The positive association of education with the M-TBR is significantly higher than education’s small, negative correlation with the H-TBR (z = −8.03, p < 0.001). Gender was uncorrelated with either TBR scale. Finally, age is significantly, positively associated with the H-TBR scores but not with the M-TBR scores.
Table 3.
Descriptive statistics and Pearson correlation coefficients for the two trust in biomedical research (TBR) scales with sociodemographics and attitude toward research for the entire sample
| H-TBR | M-TBR | za | |
|---|---|---|---|
| Sociodemographics | |||
| Household incomeb | 0.05* (n = 1783) | 0.22*** (n = 1760) | −5.29*** |
| Education | −0.05* (n = 1991) | 0.21** (n = 1947) | −8.03*** |
| Gender | −0.01 (n = 2001) | 0.04 (n = 1946) | −1.79* |
| Age | 0.07** (n = 1880) | −0.01 (n = 1798) | 2.65** |
| Attitudes | |||
| Barriers to research | 0.54*** (n = 1857) | 0.62*** (n = 1839) | −3.62*** |
| Interest in research | 0.32*** (n = 1833) | 0.30*** (n = 1853) | 0.50 |
*p < 0.05, **p < 0.01, ***p < 0.001.
The Fisher z statistic was used to test the significance of the difference in correlations between the two independent subsamples.
Participants were not required to answer this question. Household income was an ordinal variable from 1 to 9, ranging from “Less than $10,000” to “$150,000 or more” (see Table 2 for distribution).
Attitudes toward research variables. As also shown in Table 3, both TBR scales were strongly correlated with scores on the barriers to research participation measure; however, the correlation of the barrier measure with M-TBR is significantly higher than its relationship with H-TBR (z = −3.62, p < 0.001). In addition, both trust scales are equivalently, positively correlated with interest in research participation.
Racial Differences in Sociodemographic and Attitude Variables and TBR Scores
Given the number of respondents in each racial category, we only assessed TBR differences between Black (n = 565) and White (n = 3188) respondents. With the exception of gender, there were significant differences between Black and White respondents on each of the background and attitude variables (see Table 4). On average, the White respondents reported they were older, more highly educated, and had a higher household income than the Black respondents. Furthermore, Whites reported fewer barriers to research participation and greater interest in participating in medical research than Blacks. Finally, Whites scored higher than Blacks on both TBR scales, although the race difference was larger for the M-TBR scale than for the H-TBR scale (see Table 5).
Table 4.
Differences between White and Black respondents in attitudes toward research and sociodemographic variables
| Whites | Blacks | ||||
|---|---|---|---|---|---|
| N | Mean (SD) | N | Mean (SD) | t | |
| Attitudes toward research | |||||
| Barrier scale | 3037 | 44.38 (4.11) | 460 | 41.11 (5.03) | 15.39*** |
| Interest in research | 3036 | 2.17 (0.45) | 463 | 2.00 (0.56) | 7.44*** |
| Sociodemographic variables | |||||
| Age | 2823 | 49.53 (15.27) | 491 | 44.36 (14.21) | 7.00*** |
| N | Row (%) | N | Row (%) | Chi-Sq. | |
| Gender | |||||
| Male | 972 | 14.30 | 162 | 85.70 | 0.53 |
| Female | 2202 | 15.20 | 395 | 84.80 | |
| Education | |||||
| Eighth grade or less | 3 | 17.60 | 14 | 82.40 | 286.72*** |
| Some high school, but did not graduate | 34 | 41.00 | 49 | 59.00 | |
| High school graduate or GED | 271 | 70.90 | 111 | 29.10 | |
| Some college or 2-year degree | 854 | 86.00 | 139 | 14.00 | |
| College graduate | 943 | 88.90 | 118 | 11.10 | |
| More than a college degree | 1068 | 90.10 | 118 | 9.90 | |
| Household income | |||||
| Less than $10,000 | 80 | 35.70 | 144 | 64.30 | 602.19*** |
| $10,000–$14,999 | 102 | 69.40 | 45 | 30.60 | |
| $15,000–$24,999 | 148 | 74.00 | 52 | 26.00 | |
| $25,000–$34,999 | 276 | 83.90 | 53 | 16.10 | |
| $35,000–$49,999 | 366 | 84.70 | 66 | 15.30 | |
| $50,000–$74,999 | 586 | 89.50 | 69 | 10.50 | |
| $75,000–$99,999 | 470 | 94.00 | 30 | 6.00 | |
| $100,000–$149,999 | 455 | 95.00 | 24 | 5.00 | |
| $150,000 or more | 376 | 96.70 | 13 | 3.30 | |
p < .001.
Table 5.
Descriptive statistics for H-TBR and M-TBR scales and results of ANCOVAs controlling for covariates
| H-TBR | M-TBR | |
|---|---|---|
| White respondents | ||
| Initial item mean | 3.27 (SD: 0.56) n = 1314 | 3.95 (SD: 0.59) n = 1209 |
| Adjusted item meana | 3.28 (SE: 0.037) | 3.94 (SE: 0.017) |
| Black respondents | ||
| Initial item mean | 3.11 (SD: 0.55) n = 210 | 3.34 (SD: 0.61) n = 211 |
| Adjusted item meana | 3.10 (SE: 0.037) | 3.39 (SE: 0.043) |
| Predictors | t p p eta2 | t p p eta2 |
| Age | 1.980. 0480. 003 | −2.36 0.019 0.004 |
| Education | −3.98 <0.001 0.010 | 3.22 0.001 0.007 |
| Income | 0.68 0.495 0.000 | 1.91 0.056 0.003 |
| Race (Black) | −4.36 <0.001 0.012 | −11.53 <0.001 0.086 |
| Adjusted R-squared | 0.024 | 0.133 |
Initial item mean adjusted for the covariates: age, education, and income.
In one final analysis, we assessed whether the White–Black difference in TBR scores would remain once we controlled for age, education, and income. Separate ANCOVAs were run with H-TBR as the dependent variable for one ANCOVA, and M-TBR for the other. Race (White and Black) was the independent variable for both analyses, and age, education, and household income were the covariates. The results of these analyses are also found in Table 5. In neither case, did controlling for those three covariates change the fact that Whites reported more trust in biomedical research than Blacks.
Discussion
Our paper is the first to assess differential associations between the scores of the two most highly cited scales assessing trust in biomedical research and sociodemographic variables and attitudes toward research using a large, diverse cohort. Findings confirmed that both TBR scales are internally consistent, and both TBR scales demonstrated congruent validity as they had highly significant relationships with the barriers to research participation measure. This finding is similar to the past research that has found mistrust in research and barriers to participation to be highly associated [8–10]. Both TBR scales were also moderately, positively associated with interest in research participation. Associations between sociodemographic variables and the trust scales were higher for the M-TBR scale except for age. The models reported in Table 5 also show a higher percentage of variance explained by sociodemographic variables for the M-TBR scale than for the H-TBR scale.
There were some differential associations with the TBR scales. Indicators of socioeconomic status such as education and income are often positively associated with issues related to trust [23]. Both scales were positively correlated with household income, although the correlation for the H-TBR was very weak. Surprisingly, H-TBR scores were negatively correlated with education, while M-TBR scores were positively correlated with education. This anomaly is difficult to explain although it might suggest that the H-TBR is less influenced by socioeconomic status than M-TBR. Age has been associated with enrollment in clinical trials, with younger participants showing higher participation rates than older participants [24]. In our study, only the H-TBR was associated with age, although the correlation of H-TBR scores with age was weak. Thus, the role that age plays in the relationship between trust and participation in clinical trials needs further study.
For race, Whites had higher trust scores on both TBR scales compared to Blacks. This finding is unsurprising as race has been widely associated with trust in research [25]. However, this suggests that improving trust in medical research could potentially increase research participation especially among those commonly underrepresented in research [26]. Furthermore, there were racial differences in both variables assessing attitudes, and these differences were consistent with Blacks having less trust in biomedical research than Whites. Additional factors that differed by race were education and income. Because these are key variables influencing levels of trust in research, these differences could explain why Blacks exhibited lower trust scores on both scales. However, when we controlled for age, education, and income by treating them as covariates, Blacks’ adjusted TBR scores were as different from Whites’ as they were before controlling those background factors. One hypothesis that was not directly addressed in our study is whether there are cultural differences in the wording of the items on both the TBR scales, especially M-TBR, that contributed to the racial differences we found.
Limitations exist in the current study. In particular, the Hispanic/Latino response rate was very low (1.9%) considering that they are now the largest group of minorities in USA [27]. More data on this ethnic group need to be collected before it can be concluded that these scales adequately measure trust in biomedical research for the Hispanic/Latino population. Second, our sample was one of convenience, and distribution of certain variables shows significant differences, which limits generalizability of the results; however, we tried to minimize sample differences between surveys by distributing each survey quasirandomly across sites (alternating surveys every two weeks). Therefore, our samples for each TBR scale were very similar, allowing us to factor out variance associated with sampling error. Furthermore, we have identified potential confounding factors (such as education, age, and income) which must be considered when reviewing correlational studies. Fourth, this was a cross-sectional study, which means that there is a lack of temporal causation between the exposure and outcome variables. Furthermore, the data were collected by self-report which could contribute various types of response biases. Finally, participants filled out surveys in multiple settings including health fairs, barbershops, neighborhood research centers, and RM. While this likely increased respondent diversity, it may have created unforeseen variance for which we cannot account.
Implications
Further research should be conducted with larger samples including more underrepresented groups before definitively concluding that these scales are valid for all populations. These studies should also determine if the recruitment setting impacts the responses. For example, ResearchMatch participants could demonstrate a higher level of trust since they have volunteered for research participation compared to those who are underrepresented in research. In addition, there is a need to develop new measures of trust in biomedical research which specifically target underrepresented groups and comprehensively cover all trust domains. In the development of the content areas related to specific trust constructs, engaging larger sample sizes of groups known to have lower levels of trust in biomedical research would result in a more targeted scale that addresses specific concerns such as fairness and safety. Finally, this study’s findings can be used to inform public-focused, educational interventions to increase interest and participation in research by addressing barriers to research participation and dimensions that influence trust. Furthermore, it demonstrates that these messages may need to be tailored by race, age, and/or education levels.
Conclusion
In conclusion, the two TBR scales show adequate internal consistency and associations with trust variables previously described, suggesting that they are valid, at least for White respondents. Yet, the lack of similarity and congruency in measuring trust of biomedical research suggests ineffective assessment for certain populations. Therefore, the past research as well as our current research suggests that the information provided by an instrument to measure trust in research is highly dependent on one’s choice of scale and not always related to previously identified factors of research participation.
Acknowledgements
The authors would like to thank the researchers, recruiters, and survey participants throughout the Mid-South that allowed us to conduct this research.
Footnotes
Financial Support
This project was made possible via Patient-Centered Outcomes Research Institute-funded grant (R-1306-04869), Vanderbilt Institute for Clinical and Translational Research (VICTR): 5UL1TR000445-09, and the Meharry-Vanderbilt Alliance.
Disclosures
The authors have no conflicts of interest to declare.
References
- 1.George S, Duran N, Norris K. A systematic review of barriers and facilitators to minority research participation among African Americans, Latinos, Asian Americans, and Pacific Islanders. American Journal of Public Health 2014; 104(2): e16–e31. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Mullins CD, et al. Health disparities: a barrier to high-quality care. American Journal of Health-System Pharmacy 2005; 62(18): 1873–1882. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Luebbert R, Perez A. Barriers to clinical research participation among African Americans. Journal of Transcultural Nursing 2016; 27(5): 456–463. [DOI] [PubMed] [Google Scholar]
- 4.Scharff DP, et al. More than Tuskegee: understanding mistrust about research participation. Journal of Health Care for the Poor and Underserved 2010; 21(3): 879–897. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Ulrich A, et al. Issues in biomedical research: what do Hispanics think? American Journal of Health Behavior 2013; 37(1): 80–85. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Adams-Campbell LL, et al. Enrollment of African Americans onto clinical treatment trials: study design barriers. Journal of Clinical Oncology 2004; 22(4): 730–734. [DOI] [PubMed] [Google Scholar]
- 7.Baird KL. The new NIH and FDA medical research policies: targeting gender, promoting justice. Journal of Health Politics, Policy and Law 1999; 24(3): 531–565. [DOI] [PubMed] [Google Scholar]
- 8.Boulware LE, et al. Race and trust in the health care system. Public Health Reports (Washington, DC: 1974) 2003; 118(4): 358–365. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Halbert CH, et al. Intentions to participate in genetics research among African American smokers. Cancer Epidemiology, Biomarkers & prevention 2006; 15(1): 150–153. [DOI] [PubMed] [Google Scholar]
- 10.Lichtenberg PA, et al. Normative health research experiences among African American elders. Journal of Aging and Health 2004; 16(5 Suppl): 78 s–92 s. [DOI] [PubMed] [Google Scholar]
- 11.Baik SH, et al. Development and validation of the Biomedical Research Trust Scale (BRTS) in English and Spanish. Journal of Empirical Research on Human Research Ethics 2016; 11(4): 346–356. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Mainous AG, 3rd, et al. Development of a measure to assess patient trust in medical researchers. Annals of Family Medicine 2006; 4(3): 247–252. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Ozawa S, Sripad P. How do you measure trust in the health system? A systematic review of the literature. Social Science & Medicine (1982) 2013; 91: 10–14. [DOI] [PubMed] [Google Scholar]
- 14.Hall MA, et al. Measuring trust in medical researchers. Medical Care 2006; 44(11): 1048–1053. [DOI] [PubMed] [Google Scholar]
- 15.Harris PA, et al. ResearchMatch: a national registry to recruit volunteers for clinical research. Academic Medicine 2012; 87(1): 66–73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Mouton CP, et al. Barriers to black women’s participation in cancer clinical trials. Journal of the National Medical Association 1997; 89(11): 721–727. [PMC free article] [PubMed] [Google Scholar]
- 17.Fleurence RL, et al. Launching PCORnet, a national patient-centered clinical research network. Journal of the American Medical Informatics Association 2014; 21(4): 578–582. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Revelle WR, Zinbarg RE. Coefficients Alpha, Beta, Omega, and the glb: Comments on Sijtsma. Psychometrika 2008; 74(1): 145. [Google Scholar]
- 19.Fisher RA. Frequency distribution of the values of the correlation coefficient in samples from an indefinitely large population. Biometrika 1915; 10(4): 507–521. [Google Scholar]
- 20.IBM Corp. IBM SPSS Statistics for Windows, Version 23.0. Armonk, NY: IBM Corporation, 2016. [Google Scholar]
- 21.RC Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing 2013; http://www.R-project.org/.
- 22.Revelle W. Psych: Procedures for Psychological, Psychometric, and Personality Research 2017; = https://CRAN.R-project.org/package = psych.
- 23.Skinner CS, et al. Factors associated with African Americans’ enrollment in a national cancer genetics registry. Community Genetics 2008; 11(4): 224–233. [DOI] [PubMed] [Google Scholar]
- 24.Murthy VH, Krumholz HM, Gross CP. Participation in cancer clinical trials: race-, sex-, and age-based disparities. JAMA 2004; 291(22): 2720–2726. [DOI] [PubMed] [Google Scholar]
- 25.Durant RW, et al. Perspectives on barriers and facilitators to minority recruitment for clinical trials among cancer center leaders, investigators, research staff, and referring clinicians: enhancing minority participation in clinical trials (EMPaCT). Cancer 2014; 120(7): 1097–1105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Bero LA, et al. Closing the gap between research and practice: an overview of systematic reviews of interventions to promote the implementation of research findings. The Cochrane Effective Practice and Organization of Care Review Group. British Medical Journal (Clinical Research Ed.) 1998; 317(7156): 465–468. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Pew Research Center. How the U.S. Hispanic population is changing. FACTANK: News in the Numbers 2017; http://www.pewresearch.org/fact-tank/2017/09/18/how-the-u-s-hispanic-population-is-changing/.