Skip to main content
American Journal of Epidemiology logoLink to American Journal of Epidemiology
. 2020 Oct 21;190(5):707–717. doi: 10.1093/aje/kwaa231

Design and Implementation of the Puerto Rico Observational Study of Psychosocial, Environmental, and Chronic Disease Trends (PROSPECT)

Josiemer Mattei , Katherine L Tucker, Luis M Falcón, Carlos F Ríos-Bedoya, Robert M Kaplan, H June O’Neill, Martha Tamez, Sigrid Mendoza, Claudia B Díaz-Álvarez, Jonathan E Orozco, Edna Acosta Pérez, José F Rodríguez-Orengo
PMCID: PMC8096477  PMID: 33083832

Abstract

The Puerto Rico Observational Study of Psychosocial, Environmental, and Chronic Disease Trends (PROSPECT) is a prospective cohort study in Puerto Rico (PR) aiming to identify trends and longitudinal associations in risk factors for cardiovascular disease (CVD). In 2019, PROSPECT investigators started recruiting a sample of 2,000 adults aged 30–75 years in PR using multistage probabilistic sampling of households and community approaches. Culturally sensitive trained research assistants assess participants, at baseline and at 2-year follow-up, in private rooms at a network of partner clinics. The study collects comprehensive data on demographic factors, socioeconomic and environmental factors, medical history, health conditions, lifestyle behaviors, psychosocial status, and biomarkers of CVD and stress. PROSPECT will estimate the prevalence and incidence of psychosocial, lifestyle, and biological CVD risk factors, describe variations in risk factors by urbanicity (urban areas vs. rural areas) and exposure (before and after) to natural disasters, and determine predictors of longitudinal changes in CVD risk factors. The study has 4 coordinated operational strategies: 1) research productivity (including synergy with existing epidemiologic cohorts of Hispanics/Latinos for comparison); 2) research infrastructure (biorepository, ancillary studies, and clinical research network); 3) capacity-building, education, and training; and 4) community outreach, dissemination, and policy. PROSPECT will inform public health priorities to help reduce CVD in PR.

Keywords: chronic diseases, cohort studies, health disparities, longitudinal studies, minority populations

Abbreviations

COVID-19

coronavirus disease 2019

CVD

cardiovascular disease

PR

Puerto Rico

PROSPECT

Puerto Rico Observational Study of Psychosocial, Environmental, and Chronic Disease Trends

PRADLAD

Puerto Rico Assessment on Diet, Lifestyle, and Diseases

RA

research assistant

Adults living in the US island territory of Puerto Rico (PR) have high estimated prevalences of type 2 diabetes (16%), high cholesterol (37%), hypertension (45%), excess body weight (70%), and cardiovascular disease (CVD; 15%), as of 2018 (1). They also have unhealthy lifestyle behaviors, including poor diet quality, inadequate intake of several nutrients, and an 11% prevalence of tobacco use; only 6% of PR residents meet the US national guidelines for physical activity (1, 2). Few reports have documented the prevalences of psychosocial risk factors for CVD, such as depression, stress, and trauma, and available coping mechanisms in PR.

Scientific studies support a link between psychosocial, lifestyle, and environmental risk factors and eventual chronic disease (3–5), yet there is a lack of population-based research in PR on the prevalence and interconnections of CVD risk factors. The few extant epidemiologic studies either are outdated, are limited to the San Juan metropolitan area, have a cross-sectional design, have only partial data, or have nonprobabilistic or small samples. Thus, Puerto Ricans’ health remains markedly understudied at the population level, despite the clear and pressing need to alleviate their disease burden. To add to this, in September 2017 PR was devastated by 2 hurricanes (Irma and María), imposing urgency for studying risk factors for CVD under times of distress.

In response, the Puerto Rico Observational Study of Psychosocial, Environmental, and Chronic Disease Trends (PROSPECT) was established with funding from the National Heart, Lung, and Blood Institute. PROSPECT is an islandwide cohort of 2,000 adults aged 30–75 years residing in PR and recruited using a multistage probabilistic sampling approach. Its overall goal is to identify trends and longitudinal associations in psychosocial, lifestyle-related, and cardiometabolic risk factors that can guide public health priorities and future research needs aimed at reducing CVD-related disparities in PR. The project is a partnership between the Harvard T.H. Chan School of Public Health (Boston, Massachusetts), FDI Clinical Research (San Juan, PR; the core research site), and the University of Massachusetts Lowell (Lowell, Massachusetts). In this article, we describe the aims, design, data collection, and coordinated operational strategies of this novel study.

METHODS

Summary

PROSPECT is a prospective population-based cohort study consisting of a baseline examination, a 2-year follow-up examination, and annual follow-up telephone calls made to inquire about new diagnoses or significant clinical events. The study is recruiting 2,000 adults aged 30–75 years living in PR using a multistage sampling strategy. Examinations are carried out at one of more than 50 partner clinics across the island. Trained research assistants (RAs) conduct an in-person comprehensive interview to probe for sociodemographic and medical information, implement validated questionnaires, measure anthropometric characteristics, and obtain hair, urine, and fasting blood and saliva samples for laboratory analyses. Participants remain enrolled in the study for its duration, unless they are lost to follow-up. PROSPECT has approval from the institutional review boards of the Harvard T.H. Chan School of Public Health, Ponce Health Sciences University (Ponce, PR), and the University of Massachusetts Lowell. The study is registered under ClinicalTrials.gov identifier NCT03794531.

Scientific aims

PROSPECT’s analytical aims are to 1) estimate the baseline and 2-year prevalence of psychosocial, lifestyle, environmental, and biological CVD risk factors; 2) estimate incidence and trends in CVD and other major chronic diseases; 3) determine longitudinal associations between 2-year changes in psychosocial, lifestyle, or environmental factors and biological markers of CVD, as well as eventual chronic disease; and 4) estimate differences in prevalence and 2-year changes in risk factors for residents according to urbanicity of residence (urban vs. rural) and postdisaster exposures. The overall hypothesis is that adults in PR will show poor lifestyle and psychosocial health and that these qualities will be associated with unfavorable CVD risk factors. The prevalences and associations will differ between rural and urban areas and will be unfavorable after a natural disaster.

Participant sampling, recruitment, and eligibility

PROSPECT employs a multistage sampling strategy shown to capture a probabilistic and representative sample of residents in areas impacted by natural disasters (6, 7). The sampling design ensures a sufficient sample size for stratification by urbanicity. Sex-based and age-based oversampling are conducted to reach levels of 30% male participants and participants aged 45–75 years who exhibit most of the CVD risk factors. The multistage sampling procedure consists of both probability sampling and communitywide sampling. In probability sampling, we first identify potentially eligible participants using 2010 US Census block frames with socioeconomic and demographic data compiled by the Institute of Statistics of Puerto Rico. We use door-to-door household enumeration protocols implemented by previous studies inclusive of Puerto Ricans (8, 9). Blocks are visited 3–5 times, on different days of the week, and at varying times of the day or evening. Only 1 participant per qualified household is randomly invited to participate. Sampling weights are available for analysis. In communitywide sampling, we advertise the study at community locations (including partner clinics), events (e.g., health fairs, festivals), and in social and mass media via flyers and postings, and through referrals from other participants. As part of this sampling, we have invited a subset of potentially eligible adults who participated in the Puerto Rico Assessment of Diet, Lifestyles and Disease (PRADLAD), a pilot study of 380 adults conducted in 2015 (10, 11).

Up to 4 attempts are made to contact participants. Those who respond proceed to be screened for eligibility; otherwise they are deemed “unable to reach.” Interested individuals are screened using a phone-administered questionnaire for the following self-reported eligibility criteria: 1) age 30–75 years at the time of enrollment; 2) not being institutionalized at the time of enrollment; 3) living in PR at the time of enrollment and for at least the previous year, and not planning to move away from the island within the next 3 years; 4) living in a stable dwelling (owned, rented, or residing in, and without concerns about eviction) at the time of enrollment and for the prior and subsequent 2 months; and 5) being able to answer questions without assistance in Spanish or English—that is, not having any severe or untreated psychological disorder or mental/physical disability that would prevent completion of an interview (e.g., schizophrenia, aphasia, severe speech impairment, or advanced Alzheimer disease/dementia). Persons with pronounced impairments observed by RAs are excluded.

Recruitment will continue until 2,000 eligible participants have been enrolled with signed informed consent. We expect to screen 2,900 individuals at baseline to meet the goal. We estimate an 85% retention rate for visit 2; the projected 1,700 participants completing both visits will provide adequate power for testing all study aims. We record reasons for ineligibility, refusal, or loss to follow-up (including date and cause of death reported by contacts).

Examination overview

The primary-care clinics where PROSPECT study visits take place are distributed islandwide and are within 45 miles (72.4 km) or 45 minutes’ travel (by car), at most, from a given municipality (Figure 1). Partner clinics were selected on the basis of geographical coverage and to capture a diverse sociodemographic population by including primary-care clinics at research-based clinical sites, city hospitals, and community clinics encompassed by the Association for Primary Health of Puerto Rico, a nonprofit organization funded through the US Department of Health and Human Services. To date, more than 50 clinics have partnered with PROSPECT.

Figure 1.

Figure 1

Locations (stars) of partner clinics and hospitals where clinical procedures will be carried out and participants will be interviewed in the Puerto Rico Observational Study of Psychosocial, Environmental, and Chronic Disease Trends.

All clinic settings have state-of-the-art facilities, private rooms for interviews, adequate facilities and staff for blood draws, and easy access and familiarity for participants. Participants may request reimbursement for transportation or parking expenses; free transportation to the main study site is available (FDI Clinical Research). Appointments are scheduled at the closest participating clinic in the morning, as participants are asked to fast for 12 hours prior to the appointment. Participants are called to be reminded of their appointment and given detailed instructions on how to prepare for the visit. At this call, they are asked for their contact information, as well as information on 4 contact individuals who could locate them.

Bilingual (i.e., Spanish and English) RAs conduct all interviews and examinations except the blood draw, which is conducted by a licensed nurse. RAs undergo thorough periodic training in all standardized protocols, human subjects research considerations, safety measures, medical record abstraction, software use and data capturing, and culturally sensitive interviewing methods. Interviews and measurements take approximately 3–3.5 hours, with the following expected durations: 1) welcome and informed consent—10 minutes; 2) sociodemographic and medical history questions—20 minutes; 3) biological samples—30 minutes; 4) anthropometric measurements—15 minutes; 5) break for rest and a snack—5 minutes; 6) food frequency questionnaire—40 minutes; and 7) health behavior, psychosocial, and environmental questionnaires—1 hour and 15 minutes.

Procedures are ordered to first conduct all measurements that must be obtained in the fasting state, followed by a short break and a healthy snack before proceeding with questionnaires. Participants may pause or end the examination at any time. Depending on when the examination is interrupted, we reschedule another in-person visit or complete the interview over the phone. Participants are recontacted up to 3 times by phone within the subsequent 14 days to finish the interview. If the participant chooses not to reschedule, measurements are marked as missing data. If a participant chooses not to be recontacted, loss to follow-up is assigned. Participants receive a $50 gift card as an incentive upon signing the consent form at the baseline visit.

Detailed procedures

During the visit, assessments are made of demographic and socioeconomic characteristics, medical history and health care, biological and body measurements, health behaviors, psychosocial tests, and environmental factors (Table 1).

Table 1.

Key Data and Measures to Be Obtained at Baseline (2019–2021) and the 2-Year Follow-up (2021–2023) in the Puerto Rico Observational Study of Psychosocial, Environmental, and Chronic Disease Trends

Measure Description
Sociodemographic factors
 Demographic factors Age, sex at birth, marital status, ethnicity, municipality of residence
 Household composition Number, ages, and relationships of people living in the household
 Migration Migration history, including duration and reasons for moving
Socioeconomic factors
 Income Household income
 Occupation Employment history
 Education Duration (years) of formal education
Medical history
 Medical history Self-reported medically diagnosed diabetes (by type), high blood pressure, dyslipidemia, angina, heart attack, heart failure, atrial fibrillation, stroke/transient ischemic attack, heart or vascular procedures, kidney disease, liver disease, hepatitis, migraines, cancer, respiratory problems, thyroid conditions, gastrointestinal conditions, depression, arthritis, osteoporosis, eye disease, physical disabilities
Family history of major chronic diseases
 Medication use Use of prescription and over-the-counter medication, dose, duration
 Health-care access Health insurance, use of services, barriers to health care, self-rated health, and adherence to medical advice
 Women’s health Pregnancy and menopause history
Biological/body measurements
 Anthropometry Weight, height (or knee length), waist and hip circumferences, body composition through bioelectrical impedance
 Blood pressure Seated systolic and diastolic pressures and heart rate
 Hair sample Hair sample for cortisol assay
 Saliva sample Passive drool sample for storage
 Fasting blood sample Total, HDL, and LDL cholesterol, triglycerides, glucose, insulin, hemoglobin A1c, C-reactive protein, platelet count, fibrinogen, renal and liver panel, and DHEA-S
 Spot urine sample Epinephrine, norepinephrine, dopamine
Health behaviors
 Tobacco use History of tobacco use: type, amount, frequency, and secondhand exposure
 Alcohol drinking Alcohol use history: type, amount, and frequency
 Sleep Quantity and quality of sleep
 Physical activity Level and amount of physical activity and sedentary behaviors
 Dietary assessment Semiquantitative food frequency questionnaire
 Food-related behaviors Food purchases, cooking and eating habits, mealtime frequency, foods consumed away from home, drinking-water access, food security and assistance, disordered eating, diet quality, home food inventory
Psychosocial markers
 Depressive symptoms Center for Epidemiologic Studies Depression Scale
 Anxiety symptoms Generalized Anxiety Disorder Scale
 Trauma symptoms Abbreviated form of the PTSD Checklist—Civilian Version
 Stress Perceived Stress Scale and Chronic Stress Scale
 Loneliness UCLA Loneliness Scale
 Discrimination Perceived recent and lifetime discrimination questionnaire
 Social support Cohen’s ISEL-12; Norbeck Social Support Questionnaire
 Familial social network Social and community support and assistance
 Coping Brief Resilience Scale; Brief Resilient Coping Scale
 Social connectedness Social Connectedness Scale/Social Assurance Scale
Environmental factors
 Neighborhood safety Food access, walking environment, safety, violence, social cohesion, neighborhood activities
 Hurricane-related exposuresa Personal impact, property loss, loss of services and resources
 Pest-related exposures Exposure to various animal pests and contaminated water
 Adverse childhood experiencesa,b BRFSS ACE module

Abbreviations: ACE, adverse childhood experiences; BRFSS, Behavioral Risk Factor Surveillance System; DHEA-S, dehydroepiandrosterone sulfate; HDL, high density lipoprotein; ISEL-12, 12-item Interpersonal Support Evaluation List; LDL, low-density lipoprotein; PTSD, posttraumatic stress disorder; UCLA, University of California, Los Angeles.

a Not assessed at the 2-year follow-up.

b The BRFSS ACE module was adapted from the Adverse Childhood Experiences Study and collects information on child abuse and neglect and household challenges.

Demographic, socioeconomic, and medical history questionnaires.

RAs administer a questionnaire to ask about age, sex at birth, ethnicity, educational attainment, household income, marital status, work history, migration history, area of residence, and household composition. Medical history includes self-reported medical diagnoses of a comprehensive list of conditions, including cardiovascular procedures. For each affirmative diagnosis, we obtain detailed information on medication use, year of diagnosis, and current status of the disease. To assist with this, participants are asked before the visit to bring a list of their current medications and dosages, and RAs review the list with them. We probe for a family history of 8 major chronic diseases, self-rated health, use of health-care services, health insurance, and adherence to medical advice for major cardiometabolic conditions (10). Participants who respond “female” to the question on sex at birth are asked questions on history of pregnancies and menopause. The questions for this section were obtained from previous studies carried out among Puerto Ricans, with minor modifications for the PR context (8, 10, 12).

Biological samples.

Fasting blood samples (i.e., no food or drink other than water for 12 hours prior) are obtained via venipuncture by a licensed nurse trained following safety procedures from a standardized protocol. Plasma is separated within 2 hours onsite in a refrigerated centrifuge, and samples are refrigerated or frozen until collected by Toledo Clinical Laboratories (Arecibo, PR) on the same day as the blood draw. Toledo Clinical Laboratories is a certified laboratory facility with collection sites across PR for streamlined and centralized processing of biological samples. Samples are processed for analysis of total cholesterol, plasma triglycerides, high-density lipoprotein, low-density lipoprotein, blood glucose, insulin, hemoglobin A1c, C-reactive protein, platelet count, fibrinogen, dehydroepiandrosterone sulfate, and a comprehensive metabolic panel with liver and renal biomarkers. Consenting participants have a blood sample stored at −80°C for potential use in future studies.

Participants are given a collection cup and detailed instructions for spot urine collection. Urine samples are collected on the same day by Toledo Clinical Laboratories and analyzed for epinephrine, norepinephrine, and dopamine. Consenting participants have a urine sample stored at −80°C for potential use in future studies. Passive drool saliva samples are obtained and stored at −80°C for future studies.

To obtain a hair sample, 1–3 cm of hair is cut with clean scissors from the posterior vertex of the skull as close to the scalp as possible (13). The hair sample is wrapped in aluminum foil and placed in a clean paper envelope. A brief questionnaire on use of steroids and hair-care procedures (i.e., coloring, bleaching, straightening, exposure to chlorine) is administered for adjustment of cortisol levels during analysis, if appropriate. Samples are shipped at room temperature to the University of Massachusetts Amherst for analysis of cortisol using standard protocols (13). Residual hair samples of consenting participants are stored at room temperature for 1 year and then at −20°C for potential use in future studies.

Anthropometric measurements.

Participants are asked to wear light clothing and to remove outerwear. While the participant is standing with feet close together, arms at their side, body weight evenly distributed, and breathing normally, RAs measure waist and hip circumferences at the end of a normal expiration using a stretch-resistant measuring tape, weight using a portable clinical-grade scale, height using a portable stadiometer (or leg length from the knee to the ankle joint, converted to predicted height, for participants unable to stand), and body composition using a bioelectrical impedance scale, following standardized protocols (14, 15). Pregnancy and use of pacemakers are exclusions for bioelectrical impedance. Blood pressure and pulse are measured at the beginning, midpoint, and end of the visit with an electronic sphygmomanometer on either arm after a 5-minute rest with the participant seated and feet flat on the floor. All measurements are repeated twice, with a third measurement taken if the first 2 differ by a predefined margin of error; the averaged value is used for analysis.

Health behaviors.

A food frequency questionnaire adapted and validated against biomarkers of intake for this population is administered to assess the frequency and quantity of intake of various foods and beverages (8, 16, 17). A model of standard portion sizes is shown to participants to help them estimate serving sizes. The Minnesota Nutrient Data System (version 5.0_35) is used for food and nutrient analyses. In addition, we ask questions on cooking and eating behaviors, mealtime frequency, foods consumed away from home, and drinking-water access and administer a brief diet-quality screener referring to intake before Hurricane María (10, 18, 19). The Three-Factor Eating Questionnaire is used to assess cognitive restraint, uncontrolled eating, and emotional eating (20). We include a culturally adapted Fulkerson Home Food Inventory to assess foods available at home before, during, and after Hurricane María (21). Household food insecurity is assessed using the US Department of Agriculture’s Household Food Security Survey Module (22, 23).

Detailed data on alcohol intake and tobacco use and exposure are collected (8). Physical activity at various levels at work, outside, or at home on weekdays and weekends is captured using a modified version of the Paffenbarger questionnaire from the Harvard Alumni Activity Survey, which has been validated against objective measures of activity and tested in Puerto Rican adults (8, 24). Questions on hours of sleep over a 24-hour period and quality of sleep are asked (25).

Psychosocial measures.

All of the psychosocial measures have been validated and implemented in Puerto Rican or other Hispanic populations. Short-term stress is measured with the Perceived Stress Scale (26–28). A chronic stress inventory is used to assess ongoing stress in several life domains related to health problems in oneself or others (29, 30). Depressive symptomatology is captured using the Center for Epidemiologic Studies Depression Scale (31–33). The abbreviated form of the PTSD Checklist—Civilian Version asks about reexperiencing, avoidance, and hyperarousal regarding past traumatic events (34, 35), and the Generalized Anxiety Disorder screener assesses anxiety symptoms (36–38). The 3-item UCLA Loneliness Scale is used to measure overall loneliness (39). Measures of perceived major discrimination and everyday discrimination capture information on acute and observable experiences of discrimination and unfair treatment across various features (40).

We include questions on extent and frequency of social ties, along with associated perceived support and assistance from these ties (27). The Interpersonal Support Evaluation List-12 assesses social support in 3 domains: appraisal, belonging, and tangible support (41, 42). The Spanish Brief Resilience Scale assesses resilience as the ability to recover from stress (43). The Spanish Brief Resilient Coping Scale measures personal perceived competence, optimism, life satisfaction, positive affect, and coping tactics (44). We assess sense of belonging within a group using the Social Connectedness/Social Assurance Scale (45).

Environmental factors.

A neighborhood safety scale measures participants’ perceived availability of food access and walking environment, esthetic quality, safety, violence, social cohesion, and activities with neighbors (46). An adapted hurricane-related exposure questionnaire asks about personal impact, property loss, and loss of services and resources after Hurricane María (47, 48). A pest-related questionnaire asks about exposure to various animal and insect pests and water pollution. The Centers for Disease Control and Prevention’s Adverse Childhood Experiences Module gauges early negative or traumatic experiences (49).

Medical record.

Clinical assessments, diagnoses, medication use, and laboratory results from the last date available are abstracted from consenting participants’ paper-based or electronic medical record and entered into their study record. We will follow protocols previously used in PRADLAD (10). If a participant is not affiliated with a partner clinic, we request access to medical records from their primary-care physician. We validate self-reported data by comparing them with medical record data.

Follow-up examinations and alternative protocols

One year after each interview, participants are recontacted by phone to update all contact information, sociodemographic data, medical diagnoses or procedures, use of medication, and any major changes in their health and behaviors. Two years after baseline, participants are asked to return for an in-person visit to repeat all biosamples and clinical measurements, update medical diagnoses and medications, and repeat the behavioral and psychological questionnaires.

Because PR is vulnerable to natural disasters, we have contingency plans for pausing or modifying protocols in case of hurricanes or major storms, earthquakes, tsunamis, droughts, or other events such as political unrest. We record details of any event that may impact the study operations or the data provided by participants. In March 2020, the coronavirus disease 2019 (COVID-19) pandemic interrupted all in-person activities as PR imposed strict prevention measures. During this time, RAs called participants to complete any unanswered baseline questions by phone or video chat or to make annual follow-up calls to those on such a schedule. Retention strategies also continued during this time. Furthermore, we implemented a weekly COVID-19 questionnaire to monitor participants for signs and symptoms, testing, management, food access, and behavioral and psychosocial factors during the pandemic. In June 2020, PR eased restrictions, and RAs now take clinical measurements and collect biological samples in person at the clinic and administer all questionnaires by phone or video chat. We provide participants with culturally relevant and trustworthy information on COVID-19 and connect them to available resources for mental and clinical services (including COVID-19 testing sites). The study team meets weekly to adjust protocols, timelines, and ethical approval, as necessary.

Timeline

PROSPECT started recruiting in January 2019, and eligible participants were invited to their baseline interviews starting in March 2019. The investigators aimed to complete recruiting of the targeted 2,000 participants and corresponding baseline examinations by March 2021. However, delays from natural disasters, political unrest, and the COVID-19 pandemic shifted this timeline to December 2021 for completion of recruitment and baseline visits and December 2023 for completion of the 2-year follow-up. Preliminary analysis of the main study aims is conducted for every 500 enrolled participants, and final results will be reported upon enrollment of the target sample size (n = 2,000).

Safety, quality assurance, and data management

Several strategies are used to ensure consistency and integrity of protocol implementation and data collection, as well as the safety of staff and participants. First, standard operating procedures are in place for all protocols, including uniform biosample collection and processing, andquestionnaire implementation. RAs are thoroughly trained and retrained in these procedures. They follow scripted instructions for all communication with participants, including the consenting process. RAs wear laboratory coats identified with the study name, gloves, and any other protective gear needed. Participants’ confidentiality, safety, and comfort are highly safeguarded, with various checkpoints during the interview. Any minor or serious adverse event that affects the well-being of a participant or staff member or the study procedures is promptly reported and corrected. Process evaluation is conducted weekly with the whole team.

Instruments used for measurements are tested and calibrated periodically. RAs use identical portable instruments for uniformity across sites. To standardize laboratory assays, Toledo conducts all laboratory assays, quality assessment, and technical support and transfers results and extra biosamples to FDI Clinical Research securely and promptly. Assays, reagents, and equipment are monitored monthly. All freezers used for long-term storage of labeled biosamples at FDI have locks, temperature monitors, and backup generators to avoid loss of samples.

Nearly all data are entered in real-time software using handheld tablets, the exception being data collected during door-to-door enumeration, which is collected on paper forms and later entered into a database. The real-time Web-based electronic data capture tool REDCap (“Research Electronic Data Capture”) hosted at the Harvard T.H. Chan School of Public Health securely captures data and runs quality checks (50). RAs have hard (paper) copies of the questionnaires as a backup in case of power failure or loss of Internet service. Quality assurance efforts include training RAs in data collection and data entry, REDCap validation parameters, and weekly data checks for validity and completeness of data. Reports are shared with the team and monitored for corrections.

Participant engagement and follow-up

We implement multiple strategies to encourage attendance, participation, and continued interest in the study. Before a study visit, we make up to 4 attempts to schedule the participant’s visit, calling at different times of the day and on different days of the week. We communicate directly with participants about reminders and study information, using the participant’s preferred method of communication. We offer to cover or reimburse transportation expenses. Appointments are available on weekends or on 2 closely scheduled days for participants with time limitations.

During the visit, we have a standardized informed consent process in the form of a narrated video with clear and simple language and a large font for participants with visual or hearing impairments. Participants are allowed breaks and are given snacks after fasting measurements are taken. All instructions and interview content are presented at a suitable literacy level. RAs are trained in culturally sensitive interviewing (including familiarity, trust, and respect), handling sensitive information, and noninvasive measurement. We record multiple ways of contacting the participant, as well as the names and contact information of 4 people who would be able to reach the participant; this information is updated yearly. Lastly, we allow for completion of some questionnaires by phone if a participant requests to leave the visit early.

After the visit, we send a letter containing the clinical results to consenting participants for discussion with their primary-care provider, along with health-related educational materials with appropriate cultural, linguistic, and literacy content. We send birthday and holiday postcards on behalf of the study and give participants small gifts labeled with the study logo and contact information. In the case of natural disasters or situations that may disrupt residents of PR, the team sends information to our participants on how to access free or low-cost services (including mental health services) and how to stay in touch with us. Throughout the study, we reiterate our appreciation for their participation and the benefits of the study to the general PR community.

Coordinated operational strategies

PROSPECT was designed with 4 coordinated operational strategies (Figure 2). First, research productivity is at the forefront. PROSPECT is expected to fill a gap in existing knowledge on CVD risk factors in PR, as well as answer important research questions on how these risks are associated and potentially prevented. By synergizing our designs and protocols with those of other existing epidemiologic cohorts of Hispanics/Latinos (i.e., the Boston Puerto Rican Health Study and the Hispanic Community Health Study/Study of Latinos) (8, 12), we will be able to pool data from these studies for comparison and systematic reviews.

Figure 2.

Figure 2

Coordinated operational strategies led by the Puerto Rico Observational Study of Psychosocial, Environmental, and Chronic Disease Trends (PROSPECT).

Second, we aim to expand the research infrastructure in PR. This includes establishing a biorepository for future use in research studies, a registry of participants engaged in research, a source of skilled staff, and an islandwide network of primary-care clinics with access to medical records and the dedication and capacity to conduct clinical research. We have partnered with the Puerto Rico Vector Control Unit of the Puerto Rico Science, Technology, and Research Trust (San Juan, PR) to pilot-test a new cellphone-based application based on ArcGIS Workforce (ESRI, Redlands, California) and ArcGIS Survey123 (ESRI) that expedites assignment of enumeration tasks and displays up-to-date maps, accurate travel times, and real-time geolocation of enumerated households in a Web dashboard; its applicability in PROSPECT will enable implementation in other research studies. PROSPECT’s framework provides a unique opportunity for ancillary and future studies. To date, we are implementing 4 ancillary studies: 1) a mixed-methods study on food and water access, social support, and stress responses after natural disasters; 2) a study on seroprevalence of vectorborne diseases in partnership with the PR branch of the Centers for Disease Control and Prevention; 3) a mixed-methods project to assess food insecurity, access to food and health-care services, and glycemic control during the COVID-19 pandemic among participants with diabetes; and 4) a pilot program to improve access to healthy foods and cardiometabolic health by providing fresh produce from local farmers to participants with food insecurity. There is also a parallel study on CVD risk factors among young adults being led by the University of Massachusetts Medical School (Worcester, Massachusetts) and the University of Puerto Rico Medical Sciences Campus (San Juan, PR), the Puerto Rico Young Adults’ Stress, Contextual, Behavioral and Cardiometabolic Risk (PR-OUTLOOK) Study, which builds from and adapts PROSPECT’s framework.

Third, we support capacity-building, education, and training of established and new investigators. PROSPECT provides opportunities for career development and research experience for many investigators in multiple fields, especially underrepresented minorities. Besides offering these opportunities to our staff and external investigators, we work closely with higher education institutions in the mainland United States and PR to extend them to students and trainees.

Last, we conduct community outreach and dissemination of results in parallel with public health initiatives aimed at preventing and controlling chronic diseases in PR. For this, we have partnered with multiple professional and public health organizations, including the College of Nutritionists and Dietitians of Puerto Rico; the Society for Prevention of Cardiovascular Diseases of Puerto Rico; the Puerto Rico Science, Technology, and Research Trust; the Puerto Rico Public Health Trust; and the Puerto Rico Consortium for Clinical Investigation. Our team shares information about the study with partner clinics and the community at large. We regularly share a community report, which is a simple, brief, graphic-based pamphlet that summarizes preliminary results. As the study begins to identify priority needs for clinical and public health prevention programs and policies, we will connect with stakeholders and agents of change through an initiative supported by a Robert Wood Johnson Foundation Culture of Health Leaders Award.

DISCUSSION

PROSPECT has faced challenges, yet has attained many successes during its launch (Figure 3). We expected the household enumeration process to be strenuous and outdated, as we only had availability of 2010 US Census data, but Hurricane María deeply altered the infrastructure of the island. However, enumeration proved to be more time- and effort-consuming and has produced fewer participants than anticipated, due to the extent of missing, vacant, or unresponsive houses. Moreover, numerous unforeseen events have delayed the timeline. Having alternative plans has been key in surpassing these challenges. For example, use of community-based strategies has accelerated recruitment and suggests that this population is open to participating in health research. Our fast response to disasters has kept PROSPECT on track and has helped us gain real-time knowledge about health and behaviors in times of distress. The pilot study, PRADLAD, taught us challenges, opportunities, and lessons to implement in PROSPECT (10). One fundamental lesson is to gain the highest level of trust, respect, and full commitment to the study from participants, team members, and partners. To attain this, we have open and frequent communication, and we are genuinely attentive to the ideas and needs of all parties involved. As a result, PROSPECT has reached initial milestones with minimal delays, secured multiple ancillary projects, and gained multilevel partnerships and is actively informing policy and community health.

Figure 3.

Figure 3

Lessons learned from the Puerto Rico Observational Study of Psychosocial, Environmental, and Chronic Disease Trends.

Despite its groundbreaking nature, PROSPECT has some limitations. First, the sampling methodology—sampling through household enumeration—was designed to capture a probabilistic sample, but enumeration is challenging, and the community-based sampling may reduce full representation. However, the widespread community recruitment efforts increase the likelihood of selecting a general population, and we periodically check our sample’s characteristics against broader sociodemographic benchmarks to ensure representation. Second, while we designed the study similarly to other cohort studies of Hispanic/Latinos residing in the United States, it may not be feasible to directly compare all of our results with findings on other Puerto Rican populations or persons of other ethnic backgrounds. Finally, our study is limited to adults aged 30–75 years, since most chronic conditions occur at this life stage; further studies should assess CVD risk factors in other age groups.

To our knowledge, PROSPECT is the first islandwide longitudinal study designed to capture data on trends in chronic diseases and the psychosocial, lifestyle, and environmental contributors to these conditions and to inform health-care providers, public health agencies, and the general PR community on strategies for preventing disease. Novel aspects include the ability to survey the whole island, detect urban/rural variations, and assess disease after natural disasters. The comprehensive and meticulous data collection is helping establish a sustainable framework to support the study’s operational strategies. PR is at the juncture of socioeconomic, political, and environmental adversities, while simultaneously driving innovative scientific and technological advancements with homegrown talent. Our study helps address these issues and promote the local health sciences field, with much promise for broader application to other populations. Given its merits, PROSPECT has high potential for informing effective culturally tailored policies and programs designed to improve health in PR.

ACKNOWLEDGMENTS

Author affiliations: Department of Nutrition, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, United States (Josiemer Mattei, H. June O’Neill, Martha Tamez); Department of Biomedical and Nutritional Sciences, Zuckerberg College of Health Sciences, University of Massachusetts Lowell, Lowell, Massachusetts, United States (Katherine L. Tucker); Department of Sociology, College of Fine Arts, Humanities and Social Sciences, University of Massachusetts Lowell, Lowell, Massachusetts, United States (Luis M. Falcón); FDI Clinical Research, San Juan, Puerto Rico, United States (Carlos F. Ríos-Bedoa, Sigrid Mendoza, Claudia B. Díaz-Álvarez, Jonathan E. Orozco, José F. Rodríguez-Orengo); Division of Scholarly Inquiry, Graduate Medical Education, McLaren Health Care Corporation, Grand Blanc, Michigan, United States (Carlos F. Ríos-Bedoa); Department of Epidemiology and Population Health, Albert Einstein College of Medicine, Bronx, New York, United States (Robert M. Kaplan); Division of Public Health Sciences, Fred Hutchinson Cancer Research Center, Seattle Washington, United States (Robert M. Kaplan); Behavioral Sciences Research Institute, Graduate School of Public Health, University of Puerto Rico Medical Sciences Campus, San Juan, Puerto Rico, United States (Edna Acosta Pérez); and Department of Biochemistry, University of Puerto Rico Medical Sciences Campus, San Juan, Puerto Rico, United States (José F. Rodríguez-Orengo).

This work was supported by the National Heart, Lung, and Blood Institute (grants R01-HL143792 and K01-HL120951 to J.M.), the National Institute on Minority Health and Health Disparities (grant R21-MD013650 to J.M.), and the Robert Wood Johnson Foundation (Culture of Health Leaders Award to J.M.).

PROSPECT is successful thanks to the contributions of our research assistants, the staff at the partner clinics, and the participants. PROSPECT data and materials are available upon request from the corresponding author.

We recognize the following individuals and organizations: Dr. Orville M. Disdier, Institute of Statistics of Puerto Rico (San Juan, Puerto Rico (PR)); Dr. Jerrold S. Myers, University of Massachusetts Amherst (Amherst, Massachusetts); Dr. Michael Johansson, Centers for Disease Control and Prevention, Puerto Rico Branch (San Juan, PR); Dr. Charmaine Alfonso, College of Nutritionists and Dietitians of Puerto Rico (San Juan, PR) and Ana G. Mendez University System (San Juan, PR); Dr. Patrick Vinck, Harvard Humanitarian Institute and Harvard T.H. Chan School of Public Health (Boston, Massachusetts); Dr. Juan C. Martinez-Cruzado, University of Puerto Rico—Mayaguez Campus (Mayagüez, PR); Dr. Gladys Varela Agront, University of Puerto Rico—Aguadilla Campus (Aguadilla, PR); Cesar Piovanetti, Puerto Rico Vector Control Unit of the Puerto Rico Science, Technology, and Research Trust (San Juan, PR); Dr. Walter Willett, Harvard T.H. Chan School of Public Health (Boston, Massachusetts); Dr. Frank Hu, Harvard T.H. Chan School of Public Health (Boston, Massachusetts); Asociación de Salud Primaria de Puerto Rico (Río Piedras, PR); College of Nutritionists and Dietitians of Puerto Rico (San Juan, PR); Society for the Prevention of Cardiovascular Diseases of Puerto Rico (Ponce, PR); Puerto Rico Science, Technology, and Research Trust (San Juan, PR); Puerto Rico Public Health Trust (San Juan, PR); Puerto Rico Consortium for Clinical Investigation (San Juan, PR); Toledo Clinical Laboratories (Arecibo, Puerto Rico); Salud Integral en La Montaña, Inc. (Naranjito, PR); CRA Group (Redes del Sureste) (Guaynabo, PR); Concilio de Salud Integral de Loíza, Inc. (Loíza, PR); NeoMed Center, Inc. (Gurabo/Trujillo Alto, PR); Médiko Medicina Primaria Corporación (Caguas, PR); Migrant Health Center (Mayagüez, PR); Corporación de Servicios Médicos (Hatillo, PR); Med Centro, Inc. (Ponce, PR); HealthproMed (San Juan, PR); Centro Multidisciplinario de Medicina de la Asociación de Maestro de Puerto Rico, Hospital del Maestro (San Juan, PR); and the following research assistants and volunteers: Enrique Abreu Takemura, Carlos Acevedo, Gabriel E. de Jesús Astacio, Marcel de Jesús Vega, Maria del Mar Camacho Montero, Paola C. Díaz Arce, Brian Estrada, Gerardo A. Fuentes, Chrystal Galán, Alfredo A. García Casillas, Luis M. García Peña, Valeria Hernández Talavera, Natalia S. Laguna-Santiago, Carla Lassalle, Sylvia Lillquist Rodriguez, Melissa López Rosa, Yetzaida Márquez, Nahir J. Mártir Inchausty, Karla E. Medina Nieves, William Molina, Nicole Muñiz Sepúlveda, Paola O’Neill, Cristina V. Ortiz Pastrana, Frances Ostolaza, Litza N. Pabón Malavé, Viviana Quiñones Fabre, Yozette Ramos, José A. Reyes Rodríguez, Paollette Rivera Torres, Darwin D. Rugg Ramos, Juan C. Santiago de Jesus, Valeria M. Schleier Albino, and Kirstie Vázquez.

The funders played no role in the design of the study; in the collection, analysis, or interpretation of the data; in the writing of the manuscript; or in the decision to publish the results.

Conflict of interest: none declared.

REFERENCES

  • 1. Division of Population Health, National Center for Chronic Disease Prevention and Health Promotion, Centers for Disease Control and Prevention . BRFSS prevalence and trends data. https://www.cdc.gov/brfss/brfssprevalence/. Reviewed September 13, 2017. Accessed March 19, 2020.
  • 2. Mattei J, Tamez M, Bigornia SJ, et al. Dietary intake and its determinants among adults living in the metropolitan area of Puerto Rico. Nutrients. 2019;11(7):Article 1598. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3. Ortiz MS, Myers HF, Dunkel Schetter C, et al. Psychosocial predictors of metabolic syndrome among Latino groups in the Multi-Ethnic Study of Atherosclerosis (MESA). PLoS One. 2015;10(4):e0124517. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Willett WC, Koplan JP, Nugent R, et al. Chapter 44: Prevention of chronic disease by means of diet and lifestyle changes. In: Jamison DT, Breman JG, Measham AR, eds. Disease Control Priorities in Developing Countries. 2nd ed.New York, NY: Oxford University Press; 2006. https://www.ncbi.nlm.nih.gov/books/NBK11795/. Accessed January 27, 2021. [Google Scholar]
  • 5. Havranek EP, Mujahid MS, Barr DA, et al. Social determinants of risk and outcomes for cardiovascular disease: a scientific statement from the American Heart Association. Circulation. 2015;132(9):873–898. [DOI] [PubMed] [Google Scholar]
  • 6. Kessler RC, Keane TM, Ursano RJ, et al. Sample and design considerations in post-disaster mental health needs assessment tracking surveys. Int J Methods Psychiatr Res. 2008;17(suppl 2):S6–S20. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Galea S, Maxwell AR, Norris F. Sampling and design challenges in studying the mental health consequences of disasters. Int J Methods Psychiatr Res. 2008;17(suppl 2):S21–S28. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Tucker KL, Mattei J, Noel SE, et al. The Boston Puerto Rican Health Study, a longitudinal cohort study on health disparities in Puerto Rican adults: challenges and opportunities. BMC Public Health. 2010;10:Article 107. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Lavange LM, Kalsbeek WD, Sorlie PD, et al. Sample design and cohort selection in the Hispanic Community Health Study/Study of Latinos. Ann Epidemiol. 2010;20(8):642–649. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Mattei J, Rodriguez-Orengo JF, Tamez M, et al. Challenges and opportunities in establishing a collaborative multisite observational study of chronic diseases and lifestyle factors among adults in Puerto Rico. BMC Public Health. 2017;17(1):Article 136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Mattei J, Tamez M, Rios-Bedoya CF, et al. Health conditions and lifestyle risk factors of adults living in Puerto Rico: a cross-sectional study. BMC Public Health. 2018;18(1):Article 491. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Sorlie PD, Avilés-Santa LM, Wassertheil-Smoller S, et al. Design and implementation of the Hispanic Community Health Study/Study of Latinos. Ann Epidemiol. 2010;20(8):629–641. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Meyer J, Novak M, Hamel A, et al. Extraction and analysis of cortisol from human and monkey hair. J Vis Exp. 2014;(83):e50882. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. National Center for Health Statistics . National Health and Nutrition Examination Survey (NHANES): Anthropometry Procedures Manual. Hyattsville, MD: National Center for Health Statistics; 2020. https://wwwn.cdc.gov/nchs/data/nhanes/2019-2020/manuals/2020-Anthropometry-Procedures-Manual-508.pdf. Accessed September 30, 2020. [Google Scholar]
  • 15. World Health Organization . Waist Circumference and Waist-Hip Ratio: Report of a WHO Expert Consultation, Geneva 8–11 December 2008. Geneva, Switzerland: World Health Organization; 2011. http://apps.who.int/iris/bitstream/10665/44583/1/9789241501491_eng.pdf. Accessed September 30, 2020. [Google Scholar]
  • 16. Tucker KL, Bianchi LA, Maras J, et al. Adaptation of a food frequency questionnaire to assess diets of Puerto Rican and non-Hispanic adults. Am J Epidemiol. 1998;148(5):507–518. [DOI] [PubMed] [Google Scholar]
  • 17. Palacios C, Trak MA, Betancourt J, et al. Validation and reproducibility of a semi-quantitative FFQ as a measure of dietary intake in adults from Puerto Rico. Public Health Nutr. 2015;18(14):2550–2558. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Goodman AB, Blanck HM, Sherry B, et al. Behaviors and attitudes associated with low drinking water intake among US adults, Food Attitudes and Behaviors Survey, 2007. Prev Chronic Dis. 2013;10:E51. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Fernandez S, Olendzki B, Rosal MC. A dietary behaviors measure for use with low-income, Spanish-speaking Caribbean Latinos with type 2 diabetes: the Latino Dietary Behaviors Questionnaire. J Am Diet Assoc. 2011;111(4):589–599. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Cappelleri JC, Bushmakin AG, Gerber RA, et al. Psychometric analysis of the Three-Factor Eating Questionnaire-R21: results from a large diverse sample of obese and non-obese participants. Int J Obes (Lond). 2009;33(6):611–620. [DOI] [PubMed] [Google Scholar]
  • 21. Fulkerson JA, Nelson MC, Lytle L, et al. The validation of a home food inventory. Int J Behav Nutr Phys Act. 2008;5:Article 55. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Bickel G, Nord M, Price C, et al. Guide to Measuring Household Food Security. Revised 2000. Alexandria, VA: Office of Analysis, Nutrition, and Evaluation, Food and Nutrition Service, US Department of Agriculture; 2000. https://fns-prod.azureedge.net/sites/default/files/FSGuide.pdf. Accessed September 30, 2020. [Google Scholar]
  • 23. Coleman-Jensen A, Nord M, Andrews M, et al. Household Food Security in the United States in 2011. Statistical Supplement. Washington, DC: Economic Research Service, US Department of Agriculture; 2012. (Administrative Publication no. 058). https://www.ers.usda.gov/webdocs/publications/42784/30973_apn-058.pdf?v=1209.1. Accessed September 30, 2020. [Google Scholar]
  • 24. Paffenbarger RS Jr, Wing AL, Hyde RT. Physical activity as an index of heart attack risk in college alumni. Am J Epidemiol. 1978;108(3):161–175. [DOI] [PubMed] [Google Scholar]
  • 25. Li Y, Zhang X, Winkelman JW, et al. Association between insomnia symptoms and mortality: a prospective study of U.S. men. Circulation. 2014;129(7):737–746. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Cohen S, Kamarck T, Mermelstein R. A global measure of perceived stress. J Health Soc Behav. 1983;24(4):385–396. [PubMed] [Google Scholar]
  • 27. Falcón LM, Todorova I, Tucker K. Social support, life events, and psychological distress among the Puerto Rican population in the Boston area of the United States. Aging Ment Health. 2009;13(6):863–873. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Perera MJ, Brintz CE, Birnbaum-Weitzman O, et al. Factor structure of the Perceived Stress Scale-10 (PSS) across English and Spanish language responders in the HCHS/SOL Sociocultural Ancillary Study. Psychol Assess. 2017;29(3):320–328. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. McCurley JL, Mills PJ, Roesch SC, et al. Chronic stress, inflammation, and glucose regulation in U.S. Hispanics from the HCHS/SOL Sociocultural Ancillary Study. Psychophysiology. 2015;52(8):1071–1079. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Bromberger JT, Matthews KA. A longitudinal study of the effects of pessimism, trait anxiety, and life stress on depressive symptoms in middle-aged women. Psychol Aging. 1996;11(2):207–213. [DOI] [PubMed] [Google Scholar]
  • 31. Radloff LS. The CES-D Scale: a self-report depression scale for research in the general population. Appl Psychol Meas. 1977;1:385–401. [Google Scholar]
  • 32. González P, Nuñez A, Merz E, et al. Measurement properties of the Center for Epidemiologic Studies Depression Scale (CES-D 10): findings from HCHS/SOL. Psychol Assess. 2017;29(4):372–381. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Falcón LM, Tucker KL. Prevalence and correlates of depressive symptoms among Hispanic elders in Massachusetts. J Gerontol B Psychol Sci Soc Sci. 2000;55(2):S108–S116. [DOI] [PubMed] [Google Scholar]
  • 34. Lang AJ, Stein MB. An abbreviated PTSD Checklist for use as a screening instrument in primary care. Behav Res Ther. 2005;43(5):585–594. [DOI] [PubMed] [Google Scholar]
  • 35. Eisenman DP, Gelberg L, Liu H, et al. Mental health and health-related quality of life among adult Latino primary care patients living in the United States with previous exposure to political violence. JAMA. 2003;290(5):627–634. [DOI] [PubMed] [Google Scholar]
  • 36. Spitzer RL, Kroenke K, Williams JB, et al. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. 2006;166(10):1092–1097. [DOI] [PubMed] [Google Scholar]
  • 37. Lӧwe B, Decker O, Müller S, et al. Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Med Care. 2008;46(3):266–274. [DOI] [PubMed] [Google Scholar]
  • 38. García-Campayo J, Zamorano E, Ruiz MA, et al. Cultural adaptation into Spanish of the Generalized Anxiety Disorder-7 (GAD-7) Scale as a screening tool. Health Qual Life Outcomes. 2010;8:Article 8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Hughes ME, Waite LJ, Hawkley LC, et al. A short scale for measuring loneliness in large surveys: results from two population-based studies. Res Aging. 2004;26(6):655–672. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40. Williams DR, Yan Y, Jackson JS, et al. Racial differences in physical and mental health: socio-economic status, stress and discrimination. J Health Psychol. 1997;2(3):335–351. [DOI] [PubMed] [Google Scholar]
  • 41. Cohen S, Mermelstein R, Kamarck T, et al. Measuring the functional components of social support. In: Sarason IG, Sarason BR, eds. Social Support: Theory, Research and Applications. The Hague, the Netherlands: Martinus Nijhoff Publishers; 1985:73–94. [Google Scholar]
  • 42. Merz EL, Roesch SC, Malcarne VL, et al. Validation of Interpersonal Support Evaluation List-12 (ISEL-12) scores among English- and Spanish-speaking Hispanics/Latinos from the HCHS/SOL Sociocultural Ancillary Study. Psychol Assess. 2014;26(2):384–394. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43. Rodríguez-Rey R, Alonso-Tapia J, Hernansaiz-Garrido H. Reliability and validity of the Brief Resilience Scale (BRS) Spanish version. Psychol Assess. 2016;28(5):e101–e110. [DOI] [PubMed] [Google Scholar]
  • 44. Limonero JT, Tomás-Sábado J, Gómez-Romero MJ, et al. Evidence for validity of the Brief Resilient Coping Scale in a young Spanish sample. Span J Psychol. 2014;17:E34. [DOI] [PubMed] [Google Scholar]
  • 45. Lee RM, Robbins SB. Measuring belongingness: the Social Connectedness and the Social Assurance scales. J Couns Psychol. 1995;42(2):232–241. [Google Scholar]
  • 46. Mujahid MS, Diez Roux AV, Morenoff JD, et al. Assessing the measurement properties of neighborhood scales: from psychometrics to ecometrics. Am J Epidemiol. 2007;165(8):858–867. [DOI] [PubMed] [Google Scholar]
  • 47. Davidson TM, Price M, McCauley JL, et al. Disaster impact across cultural groups: comparison of whites, African Americans, and Latinos. Am J Community Psychol. 2013;52(1-2):97–105. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48. Lowe SR, Manove EE, Rhodes JE. Posttraumatic stress and posttraumatic growth among low-income mothers who survived Hurricane Katrina. J Consult Clin Psychol. 2013;81(5):877–889. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Division of Violence Prevention, National Center for Injury Prevention and Control, Centers for Disease Control and Prevention . Behavioral Risk Factor Surveillance System ACE data. https://www.cdc.gov/violenceprevention/aces/ace-brfss.html. Updated April 2, 2019. Accessed March 19, 2020.
  • 50. Harris PA, Taylor R, Thielke R, et al. Research Electronic Data Capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–381. [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from American Journal of Epidemiology are provided here courtesy of Oxford University Press

RESOURCES