Skip to main content
PLOS Global Public Health logoLink to PLOS Global Public Health
. 2026 Sep 30;6(9):e0006845. doi: 10.1371/journal.pgph.0006845

Rethinking wellbeing measurement: Learning from a scale development study with adolescents living with HIV in Zimbabwe

Webster Mavhu 1,2,‡,*, Jermaine M Dambi 3,4,‡, Victoria Simms 5, Faith Martin 6, Joni Lariat 7, Rufaro Mbundure 1, Leviticus Makoni 1, Laura Kafata 1, Carol Wogrin 8, Vivian Chitiyo 8, Abigail Mutsinze 8, Frances M Cowan 1,2, Nicola Willis 8, Sarah Bernays 7,9
Editor: Joel Msafiri Francis10
PMCID: PMC13626463  PMID: 42814789

Abstract

Adolescents living with HIV (ALHIV) in Eastern and Southern Africa experience challenges around medication adherence, mental health and wellbeing. Although interventions such as Zvandiri aim to strengthen mental health and wellbeing to impact HIV treatment outcomes, available measures often focus on negative outcomes or rely on positive psychology instruments developed in high-income settings. These tools may not adequately capture culturally embedded and relational dimensions of wellbeing. We describe the development of the Zvandiri Character Strength (ZCS) scale and draw methodological lessons for culturally grounded wellbeing measurement. The multi-stage scale-development process (2022–2025) comprised a scoping and systematic review, qualitative discussions, expert panel input, construct and item prioritisation, cognitive interviews, iterative item reduction, and exploratory factor and Rasch analyses. We reduced an initial item bank to a 53-item candidate scale, then to the ZCS 38 (38 items) and finally, the ZCS 25 (25 items), based on quantitative analyses and participant feedback. We subsequently assessed the ZCS 25 using retrospective pretest, post-test and follow-up administration. The review identified conceptually overlapping positive psychological constructs, many of which are measured using instruments developed in high-income settings and not adequately validated for ALHIV in Africa. Qualitative work highlighted connectedness, hope, self-acceptance, self-efficacy, purpose, and flourishing as key. Discussions also highlighted that wellbeing was relational, contextually situated, and often co-occurring with distress. Quantitative testing showed highly positive responses, disordered thresholds, ceiling effects, weak internal structure, and fluctuating retrospective ratings. Participant feedback suggested that positive responses likely reflected affirmations, and were partly linked to social desirability. In conclusion, the ZCS scale did not support a single interpretable total score, but its development offers important methodological lessons. Future measurement should begin with clearer construct definition, response-process validation, domain-level testing and explicit decisions about whether the measure aims to capture lived wellbeing, domain-specific positive outcomes or intervention-relevant change.

Introduction

Globally, adolescents living with HIV (ALHIV) have the highest rates of attrition from HIV treatment and care of any age group, resulting in higher rates of treatment failure, morbidity and mortality compared to children and adults [1,2]. In Eastern and Southern Africa, which is home to 84% of ALHIV globally, adolescents are the only population with increasing mortality rates [3,4]. Elevated mortality rates are exacerbated by the significant prevalence of common mental health conditions [5]. Poor mental health is important in its own right, but also because it impacts adherence to HIV medication. For example, depression and anxiety significantly hinder treatment adherence, which in turn results in higher mortality [6].

Zvandiri (meaning ‘As I am’ in Shona, www.zvandiri.org) is a theoretically-grounded, multi-component differentiated service delivery model for children, adolescents and young adults living with HIV (CAYALHIV) [2,7,8]. Zvandiri links CAYALHIV to Community Adolescent Treatment Supporters (CATS); peer counsellors who are also living with HIV. These trained and mentored supporters help improve CAYALHIV’s health, wellbeing, and engagement with HIV treatment and care [2,9–11]. In a cluster-randomised trial of the Zvandiri model, ALHIV receiving the Zvandiri intervention had 42% lower prevalence of virological failure or death after 2 years compared to ALHIV receiving standard care alone (95% CI: 0.36-0.94) [2,12,13]. A subsequent trial assessed the effect of training CATS in problem-solving therapy and found a five-fold reduction in the odds of common mental disorder symptoms [14].

Our past research suggests that improved mental health and wellbeing enable medication adherence [15,16]. Nevertheless, a gap persists in the comprehensive evaluation of wellbeing, since most of the research to date prioritises negative indicators such as depression and anxiety [17,18]. Of note, reliance on measuring negative outcomes undermines our capacity to identify and quantify the development of protective attributes, as proactive prevention.

Positive constructs have not been wholly absent from ALHIV research. Our review identified a range of positive psychological outcomes already used in this field, including resilience, self-esteem, self-efficacy, self-worth, coping, flourishing, and positive outlook [17]. The problem is that this literature is conceptually fragmented, with overlapping constructs often measured with instruments developed in high-income settings that are not adequately adapted or validated for ALHIV in Eastern and Southern Africa [19]. The task, therefore, is to develop culturally appropriate, meaningful and psychometrically defensible approaches to assessing the positive outcomes and mechanisms through which interventions may improve young people’s lives.

ALHIV interventions may plausibly affect outcomes such as belonging, self-worth, treatment confidence, future orientation, resilience and relational safety, even where symptom-based or virological outcomes do not fully capture change. Measuring these domains is therefore important, but it requires clarity about which construct is being assessed, why it matters to the intervention theory of change, and whether the measure is valid for the language, context and social conditions in which young people are responding.

Measurement of wellbeing is shaped by three overlapping traditions: hedonic or subjective wellbeing, typically indexed through affect and life satisfaction; eudaimonic or psychological wellbeing, which emphasises positive functioning, growth, purpose and self-acceptance; and social wellbeing, which foregrounds social integration, contribution, coherence, actualisation, and acceptance [20]. These traditions are related, but not interchangeable, and recent reviews confirm that overall wellbeing remains conceptually heterogeneous and is still measured using partly divergent frameworks, most of which were developed and validated in high-income settings [20–23]. High-income settings are more often characterised by individualistic cultures, which may place greater emphasis on eudaimonic than social wellbeing [17,24].

Promoting positive mental health remains essential for improving ALHIV’s wellbeing and long-term outcomes [17,25]. Intervention benefits may manifest as gains in belonging, recognition, future orientation, self-worth, or treatment confidence, even when distress remains [17,24]. We undertook a range of initiatives in collaboration with ALHIV to co-design a youth-focused, locally relevant quantitative positive psychology instrument; the Zvandiri Character Strength (ZCS) scale. The ZCS is a combination of learned and learnable attributes, virtues, skills, habits or capabilities that enable ALHIV to lead better lives.

Here, we report on our challenges and learnings to inform future initiatives. We frame the ZCS scale development process as a methodological case study within the psychometrics, patient-reported outcome measures, and wellbeing measurement literatures. The contribution is not to present relational wellbeing, response-process issues, social comparison, response shift, construct clarity or cross-cultural equivalence as new concerns; these are already well-established [26–30]. Rather, the ZCS case shows how these concerns became practically consequential when a relational HIV intervention in Zimbabwe required an interpretable positive wellbeing outcome measure.

Methods

Study overview

Fig 1 outlines the steps in the ZCS scale development process. For activities involving human subjects, we recruited participants from 1 March 2023 to 30 June 2025. For clarity, we use “adolescents” to refer to 13–19 year-olds and “young people” to 20–24 year-olds who took part in the various activities. Age-related considerations informed item wording, cognitive probing, and interpretation, with an emphasis on simple language, local meaning, and age-appropriate comprehension.

Fig 1. Steps leading to the 25-item wellbeing scale (ZCS 25).

Fig 1

We began by conducting a scoping and systematic review of positive psychological outcomes used in ALHIV (Fig 1, step 1) [17,31]. In brief, we searched relevant databases for articles published between 1 November 2022 and 28 February 2023. We initially planned to only extract items from outcome measures with robust validity and reliability. However, only a few outcome measures had been properly adapted and validated for use in low- and middle-income countries [17]. Consequently, we adopted a pragmatic approach by selecting items from measures with apparent content validity and using thematic analysis to identify and group conceptually equivalent or duplicate items, resulting in an initial bank of 263 items. Afterwards, three reviewers independently rated each item for relevance on a four-point scale, with ratings of 3 or 4 considered relevant. We assessed content validity using the item-level content validity index (I-CVI) and scale-level indices (S-CVI/Ave and S-CVI/UA), using modified kappa to adjust for chance agreement. Items with I-CVI = 1.00 were retained, those with I-CVI = 0.67 were revised, and those with I-CVI ≤ 0.33 were considered for removal; repeated or incomplete entries were excluded (Fig 1, step 2) [32].

We then conducted a complementary qualitative study that included six in-depth interviews with Zvandiri staff, eight focus group discussions with Zvandiri adolescents and young people (n = 73), and two expert panel meetings with Zvandiri adolescents and peer supporters (n = 11) (Fig 1, step 3). We applied narrative synthesis to map the key constructs emerging from the scoping review and conducted interpretive thematic analysis to generate themes from the qualitative data (Fig 1, step 4). We then worked with two separate groups of adolescents (n = 24) to identify the constructs/items they felt conveyed the most important thoughts or feelings that Zvandiri should aim for to help them think and feel their best (Fig 1, step 5). We consolidated both groups’ rankings, captured discussions of their thought processes, and analysed them qualitatively. The final product was a 53-item scale spanning 14 constructs (S1 Text). Items were scored on a Likert scale with responses: ‘strongly disagree’, ‘disagree’, ‘agree’, and ‘strongly agree’.

Next, we conducted cognitive interviews (n = 20) with ALHIV aged 13–19 years. Discussions were held in Shona or English, and used verbal probing [33] to assess comprehension of the scale’s preamble, whether respondents understood the items as intended, whether the response options worked as intended, and the preferred mode of scale administration (Fig 1, step 6). Findings informed revisions to the preamble, item wording, response format, and scale administration mode.

We then administered the 53-item scale to 530 ALHIV using an interviewer-administered card-ranking process (Fig 1, step 7). Participants included 240 Zvandiri beneficiaries and 290 ALHIV accessing treatment at a Harare tertiary facility who had not previously been in contact with Zvandiri. We included the latter to broaden the psychometric testing sample and increase response variability, but not necessarily as a formal comparison group. We subsequently held a group discussion with purposively-selected adolescents (n = 12) to explore emerging issues.

We used both factor and Rasch analyses to reduce the scale to 38 items (Fig 1, step 8). Next, we administered the ZCS 38 scale to 39 of 40 adolescents who had participated in a pilot intervention exploring whether targeting caregivers improved a young person’s relational environment and, therefore, their wellbeing, to assess the scale’s feasibility, particularly regarding respondent burden (Fig 1, step 9, one participant was unavailable). Following additional factor and Rasch analyses, we further reduced the items to 25, hence the ZCS 25 scale (Fig 1, step 10).

Lastly, we administered the ZCS 25 scale to eight adolescents who had participated in a second caregiver-intervention pilot. Participants first completed a retrospective pretest, in which they were asked to think back to before they began the programme and rate their wellbeing at that time; after a 30-minute break, they completed the same items based on their current wellbeing (post-test) (Fig 1, step 11).

Psychometric analyses

Analyses were iterative and examined item performance, dimensionality, response-category functioning, and reliability. Exploratory factor analysis of the 53- and 38-item versions used maximum likelihood with oblique rotations. Rasch analysis assessed item fit, residuals, and threshold ordering. Items were removed based on weak item-total correlations, poor Rasch fit, disordered thresholds, low loadings, cross-loadings, redundancy, and conceptual coverage. We assessed internal consistency using Cronbach’s alpha and intraclass correlation coefficients, interpreted alongside content validity and response-process evidence.

Ethics statement

This study was approved by the Medical Research Council of Zimbabwe (#A/2860). We obtained written informed consent from participants aged ≥18 years and assent, plus parental consent, from those <18 years. We removed names and other personal identifiers from transcripts and other data sources before analyses. Participants received US$5 as reimbursement for bus fare.

Results

Participant characteristics

Participant characteristics varied across study phases (Table 1). Zvandiri staff interviewees were aged 30–40 years, and comprised programme managers and counsellors. Youth focus group discussion (FGD) participants were aged 15–24 years, with an approximately equal sex distribution. Cognitive interview participants were aged 13–19 years. The largest sample was the ZCS-53 psychometric evaluation group (n = 530, mean age 16.3 years (SD 2.1); 342 (64.5%) female) (Table 1).

Table 1. Participant characteristics across phases of ZCS 25 development.

Study phase Variable Attribute/category Frequency, n (%)/ range
Qualitative study – staff interviews (n = 6) Age, years Range 30-40
Sex Male 3
Female 3
Professional role Programme managers 3
Counsellors 3
Qualitative study – youth FGDs (n = 73) Age, years Range 15-24
Sex Male 36 (50)
Female 37 (50)
Expert panel meetings (n = 11) Professional/expert background Psychometrics & global mental health epidemiology 1
Social Sciences 1
Clinical Psychology 1
Lived experiences experts 8
Cognitive interviews (n = 20) Age, years Range 13-19
Sex Male 10 (50)
Female 10 (50)
Psychometric evaluation – ZCS 53 (n = 530) Age, years Mean (SD) 16.3 (2.1)
Sex Male 188 (35.5)
Female 342 (64.5)
Caregiver-intervention pilot – ZCS 38 (n = 39) Age, years Range 13-19
Sex Male 15 (38%)
Female 24 (62%)
Final ZCS 25 assessment (n = 8) Age, years Range 13-17
Sex Male 5
Female 3

Notes. Values are presented as n (%) unless otherwise indicated. For cells with counts <10, absolute values are reported without percentages to avoid misleading interpretation. Continuous variables are presented as mean (SD) or range, where appropriate. Percentages may not total 100% because of rounding and/or missing data.

Review findings

The scoping and systematic review has been published elsewhere [17]. We identified 15 positive psychological constructs used to assess ALHIV: body appreciation, confidence, coping, flourishing, meaningfulness, personal control, positive outlook, resilience, self-management, self-compassion, self-concept, self-efficacy, self-esteem, self-worth, and transcendence [17]. Resilience, self-esteem, and self-efficacy were the most measured constructs [17]. Although the scales had been used in Africa, all but one were developed in high-income settings, and were not properly translated and validated before use in Africa.

Content validity findings

Of 263 candidate items, we included 217 with complete ratings from all three reviewers; we excluded 45 duplicate items and one item with a non-numeric rating. The overall S-CVI/Ave was 0.730, and S-CVI/UA was 0.369. Eighty items (36.9%) achieved unanimous agreement (I-CVI = 1.00), 100 (46.1%) had an I-CVI of 0.67 and were flagged for revision, and 37 (17.1%) had an I-CVI ≤ 0.33 and were considered for removal. Construct-level S-CVI/Ave values were highest for gratitude and perseverance (0.889 each) and lowest for flourishing (0.587) (S1 Data).

Qualitative findings

The initial qualitative piece, which complemented the scoping and systematic review, identified six dominant constructs emerging from the data: connectedness, hope, self-acceptance, self-efficacy, purpose, and flourishing. That initial piece and subsequent ones provided insights on the constructs’ context and nuances. For example, it emerged that, in this setting, “self-acceptance” emerges in relation to others and focuses on accepting oneself through participation in a community (i.e., I accept myself within this community). Further, adolescents mentioned that they considered their own wellbeing in comparison to others in the community (i.e., I am doing well compared to others). As one participant remarked, ‘Yes, I am positive [HIV], but I have a bright future. I can even compare myself with others... I can say that I am not the young person with the worst challenges…” (Participant #2 ZCS workshop 2). This has important implications for measurement as wellbeing is not only relational but also evaluated in comparison to other possibilities, i.e., (It could be worse, as I see it is for others; therefore, for me it is not too bad - even though I am struggling with my wellbeing).

In all discussions, adolescents and young people highlighted the fluctuating nature of all constructs and cautioned against assuming their continuous presence. They explained this in part because precarious contextual conditions continuously threaten their wellbeing. Finally, discussions highlighted how language around mental health and wellbeing is constrained. For example, it was difficult to differentiate between some constructs (e.g., hope and optimism) or at the very least, to find near-equivalent indigenous terms. These factors have implications for measuring the Zvandiri Character Strength and wellbeing more generally.

Scale administration findings

Data from the first 530 participants who completed the 53‑item scale showed consistently high endorsement across all items. Item‑level proportions for strongly agree ranged from 34% to 67%, while combined agree/strongly agree responses ranged from 81% to 98%. These figures reflect item-level endorsement patterns rather than participant‑level estimates, and clear ceiling effects across the scale. (Reporting both strongly agree and the combined category highlights the distinction between extreme endorsement and overall positive endorsement).

A scree plot identified four factors, but inter-item correlations were low and multiple items cross-loaded across factors. Rasch analysis of polytomous responses showed that the response thresholds were disordered (See S2 Data for detailed analyses, including item-level response distributions, factor loadings, Rasch diagnostics, threshold maps, and item-retention decisions). Since the ordinal responses yielded disordered thresholds, we used binary responses (agree/disagree) for the ZCS-38 scale after consulting with adolescents. Thirty-nine adolescents completed the ZCS-38 (reduced from 53 items). We identified order-related ceiling effects. For the first 15 scale items, agreement ranged from 80% to 90%; for items 16–38, agreement ranged from 92% to 100%. This indicated questionnaire fatigue and unreliable responses.

As stated above, we held a group discussion with adolescents to investigate the causes of the ceiling effects. The adolescents told us the statements were all positive affirmations that encouraged agreement, and that, in the presence of an interviewer, they were concerned about being judged if they did not report positive responses. We added a preamble explaining that there was no need to give responses which pleased the interviewer. This helped us interpret high scores as potentially reflecting a mixture of genuine positive appraisal, encouragement from the item wording, social desirability, demand characteristics, and concern about how disagreement would be judged (36, 37). To improve response variability, we reverted to a 4-item Likert scale of responses, using ‘never’, ‘seldom’, ‘some of the time’, and ‘most of the time’ rather than strength of agreement. We benchmarked the responses to ‘in the past two weeks’. To minimise questionnaire fatigue, we reduced the number of items to 25 (ZCS 25).

As stated earlier, eight adolescents completed a retrospective pretest (Phase 1), and a post-test (Phase 2) of the ZCS 25 scale with the new response options, and five of them completed the ZCS 25 scale again a month later (Phase 3). Scores were calculated as never = 0, seldom = 1, some of the time = 2, most of the time = 3 (range 0–75). Retrospective pretest and post-test responses fluctuated, making the results difficult to interpret (Fig 2). We expected the Phase 1 score to be lower than Phase 2, and Phase 2 to be similar to Phase 3, but the data did not support this. Two participants reported that their wellbeing after the intervention was considerably lower than it had been retrospectively, but in qualitative discussion, they said that, on the contrary, the intervention had positively impacted their wellbeing. We interpreted this discordance as a limitation of the scale. Ceiling effects continued; four participants reported scores of 70–75.

Fig 2. ZCS scale scores for three phases.

Fig 2

Taken together, persistent ceiling effects, fluctuating retrospective ratings, and discordance between qualitative accounts and ZCS 25 scores did not support using the ZCS 25 as an outcome measure without substantial further development. We, therefore, did not proceed to larger-scale quantitative validation at this stage.

Discussion

We aimed to develop a contextually relevant positive psychological outcome measure for adolescents living with HIV (ALHIV) in Zimbabwe, with potential application to Eastern and Southern Africa more broadly. We followed recognised best-practice standards for patient-reported outcome measure development and validation, including a systematic review and some qualitative interviews to generate candidate items [26]. However, the measure did not achieve the reliability and validity required for confident use. Here, we share lessons learned and recommendations for future studies.

One possible explanation lies in the alignment between the construct definition, item content, response process, and intended score interpretation. We initially explored whether the ZCS could support a single score for positive wellbeing or “character strength”, but the development process brought together several conceptually adjacent yet non-interchangeable domains. In the qualitative work with adolescents, six dominant constructs emerged: connectedness, hope, self-acceptance, self-efficacy, purpose, and flourishing. These domains span social experience, affective state, future orientation, motivational capacity and coping, and therefore, may not function as indicators of a single homogeneous latent trait.

The lack of a coherent factor and Rasch structure should not be interpreted as evidence that wellbeing among ALHIV cannot be measured, nor that reflective measurement is inherently inappropriate. Rather, it suggests that the proposed total score was not supported by the available evidence. This may reflect restricted variance due to ceiling effects, disordered response categories, interviewer/social desirability effects and insufficiently specified score interpretation [27,34–37]. Future work should therefore return to construct pruning, response-process validation and domain-level testing before attempting to justify a single ZCS total score.

The second issue is the construct jangle problem. The broader wellbeing and positive psychology literature includes many overlapping labels: self-worth, self-esteem, self-concept, confidence, self-efficacy, resilience, coping, hope, optimism, perseverance, and flourishing. These are not identical constructs, but they are often treated as if their boundaries are self-evident. The jingle-jangle problem is well established in psychological measurement: different labels may be used for highly similar constructs, while similar labels may conceal different constructs [37,38]. More recent critiques of psychological measurement also warn that weak construct specification and proliferation of partially overlapping measures can undermine validity before statistical modelling even begins [27]. Constructs identified through the systematic review should not automatically be treated as a coherent conceptual framework; rather, they may reflect underlying conceptual heterogeneity. Careful definition, differentiation, and pruning grounded in the lived experiences of ALHIV are therefore required before item generation and structural testing to produce measures that are both conceptually coherent and contextually fit.

Third, the factor and Rasch analyses results may have been compromised by response distributions. If most respondents cluster at the positive end of most items, the correlation matrix may not contain sufficient variation to recover structure, even if meaningful domains exist. Fourth, is the issue of response-process validity. Adolescents’ comments that the items sounded like positive affirmations, and that they worried about being judged by an interviewer, are response-process evidence. In this case, observed responses may have been shaped by social desirability, demand characteristics, acquiescence, interviewer effects, politeness norms, or loyalty to a valued programme, as well as by underlying wellbeing. Classic work on social desirability and demand characteristics is directly relevant here [39,40], as is the wider survey-methods literature on how respondents interpret questions and construct answers in context [33,41,42].

Fifth, cross-cultural survey research shows that response styles, including acquiescence and extreme responding, can vary across cultural and survey contexts [35,43,44]. There is also directly relevant evidence from adolescent and HIV-related research in Eastern and Southern Africa that the mode of administration and privacy can shape self-reports [45–47]. Although these studies concern sexual behaviour rather than wellbeing, they are relevant because they demonstrate that adolescent self-report in HIV-related and sexual-health research is vulnerable to administration mode, privacy, perceived judgement, and social desirability.

Another key issue is the centrality of relationality. In Africa, the philosophy of Ubuntu (humanity) positions personhood as fundamentally constituted through relationships with others [48,49]. Ubuntu therefore frames human flourishing not as an individual possession, but as something realised through mutual recognition and harmonious coexistence. From this perspective, wellbeing is not reducible to an internal psychological state located solely within the individual. Instead, it is both relational and socially embedded, and, as stated earlier, this has implications for measurement.

Our findings highlight a tension between capturing wellbeing as lived and measuring intervention-relevant change. Qualitative and participatory activities suggested that adolescents experience wellbeing as uneven, contextually-situated and often simultaneous with distress; earlier Zvandiri work similarly found that young people represented feelings as crooked rather than linear trajectories [50,51], reflecting lives in which adversity continued but support could provide comfort, connection, respite, and manageability. Further, adolescence is marked by rapid physical, hormonal, neural, psychosocial, cognitive, and emotional transitions [52]. Future ZCS work should therefore clarify whether the intended measure is capturing average wellbeing over a defined period, variability across contexts, or change in specific intervention mechanisms, and should consider context-specific items, repeated assessment, visual trajectory methods or mixed-method interpretation where fluctuation and appraisal are central to the construct.

To interpret our experiences of ZCS scale development, we draw on conceptualisations of wellbeing as multidimensional, relational, and dynamic [22,53–55]. The contribution of the ZCS process is more specific: it shows how these established issues became practically consequential when trying to develop an outcome measure for a relational intervention with ALHIV in Zimbabwe. Future work should therefore move beyond simple adaptation of imported, individual-level measures, but not because quantitative measurement is inappropriate. Rather, the measurement approach needs to be aligned with the intervention theory of change and the intended score interpretation. If the aim is to capture wellbeing as lived, then methods may need to attend to fluctuation, context, relationships and narrative meaning, using qualitative, vignette-based, visual, diary or ecological momentary assessment (EMA)-informed approaches where appropriate [56–58]. If the aim is to evaluate intervention benefit, however, the measure must also be capable of detecting theorised change in specific domains that an intervention seeks to influence, such as connectedness, self-worth, hope, treatment confidence, relational safety, or manageability. These aims are related but not identical. The practical lesson is that future ZCS measurement must decide what kind of change it is trying to detect, at what level, over what time frame, and using which combination of quantitative and qualitative methods.

Importantly, our results should not be read as evidence that positive wellbeing cannot be measured among ALHIV in Zimbabwe, nor that rigorous psychometric methods are irrelevant. We already have good examples to show that local concepts of self, family, spirituality, belonging and wellbeing can be operationalised psychometrically, but only when construct development precedes scoring. These include for example, the Shona Symptom Questionnaire in Zimbabwe, which developed an indigenous measure of common mental disorders from local idioms of distress [59]; the Hua Oranga, a Maori mental health outcome measure grounded in Maori models of health [60]; and the mixed-methods youth mental health scale development in Rwanda [61]. In that sense, the main contribution of this study is methodological as much as it is substantive.

Strengths and limitations

A strength of our approach is that we employed recognised best-practice standards for patient-reported outcome measure development and validation, including a systematic review and allied qualitative and participatory components to generate candidate items. A potential limitation is the small number of adolescents who took part in the three phases of ZCS 25 completion, necessitated by the desire to conduct an in-depth exploration of ceiling effects. We also did not compare different modes of scale administration. Future initiatives could include fuller item- and domain-level documentation, participant-characteristic reporting, administration-mode testing, domain-specific analyses, and systematic response-process evidence.

The retrospective pretest may also have been affected by recall bias, current mood and response shift. In addition, interviewer administration may have introduced social desirability, demand characteristics, politeness norms, and concern about judgement. Future studies should compare interviewer-administered and anonymous self-completion modes, include systematic response-process probes, report phase-specific participant characteristics and attrition, and test domain-specific scoring before attempting a single total score.

Conclusion

We implemented a series of initiatives to collaboratively develop a youth-focused, locally relevant, quantitative instrument to evaluate the Zvandiri Character Strength. Our experiences, consistent with those from similar settings [19,62], underscore the necessity of appropriately tailoring (wellbeing) scales originally designed elsewhere prior to their application to this context. Future ZCS measurement initiatives should, therefore, move beyond the simple adaptation of imported wellbeing scales and begin with a clear definition of each construct, locally grounded language, response-process evidence, and an explicit decision about what the measure is intended to capture: lived wellbeing, domain-specific positive outcomes, or intervention-relevant change. This decision should guide item content, recall period, response options, administration mode, scoring, and the balance between quantitative and qualitative evidence.

Supporting information

S1 Text. 53-item scale spanning 14 constructs.

(DOCX)

pgph.0006845.s001.docx (19.6KB, docx)
S1 Data. Panel of experts’ content validation results.

(XLSX)

pgph.0006845.s002.xlsx (39KB, xlsx)
S2 Data. Detailed psychometric evaluation results.

(DOCX)

pgph.0006845.s003.docx (270.5KB, docx)

Acknowledgments

The authors would like to thank the adolescents and young people who took part in the various activities. Thank you also to the scientific advisory committee for the expert guidance on scale development.

Data Availability

The minimal quantitative dataset required to reproduce the descriptive, content-validity, psychometric and figure-based findings reported in this article is provided in the supporting information files. Full qualitative transcripts are not publicly available because they contain sensitive information from adolescents and young people living with HIV. Data is held and available upon reasonable request via a non-author point of contact: Institution: Centre for Sexual Health and HIV/AIDS Research (CeSHHAR) Zimbabwe. Contact Person: Data Officer, Rangarirai Gava (rangarirai.gava@ceshhar.org).

Funding Statement

This project was made possible through the support of a grant from Templeton World Charity Foundation, Inc (funder DOI 501100011730) through grant https://doi.org/10.54224/20629. The opinions expressed in this publication are those of the authors and do not necessarily reflect the views of Templeton World Charity Foundation, Inc. For the purpose of open access, the authors have applied a CC-BY public copyright license to any author accepted manuscript version arising from this submission. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Enane LA, Vreeman RC, Foster C. Retention and adherence: global challenges for the long-term care of adolescents and young adults living with HIV. Curr Opin HIV AIDS. 2018;13(3):212–9. doi: 10.1097/COH.0000000000000459 [DOI] [PubMed] [Google Scholar]
  • 2.Mavhu W, Willis N, Mufuka J, Bernays S, Tshuma M, Mangenah C, et al. Effect of a differentiated service delivery model on virological failure in adolescents with HIV in Zimbabwe (Zvandiri): A cluster-randomised controlled trial. Lancet Glob Health. 2020;8(2):e264–75. doi: 10.1016/S2214-109X(19)30526-1 [DOI] [PubMed] [Google Scholar]
  • 3.Slogrove AL, Sohn AH. The global epidemiology of adolescents living with HIV: time for more granular data to improve adolescent health outcomes. Curr Opin HIV AIDS. 2018;13(3):170–8. doi: 10.1097/COH.0000000000000449 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Dzinamarira T, Moyo E. Adolescents and young people in sub-Saharan Africa: overcoming challenges and seizing opportunities to achieve HIV epidemic control. Front Public Health. 2024;12:1321068. doi: 10.3389/fpubh.2024.1321068 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Too EK, Abubakar A, Nasambu C, Koot HM, Cuijpers P, Newton CR, et al. Prevalence and factors associated with common mental disorders in young people living with HIV in sub-Saharan Africa: A systematic review. J Int AIDS Soc. 2021;24 Suppl 2(Suppl 2):e25705. doi: 10.1002/jia2.25705 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Olashore AA, Paruk S, Akanni OO, Tomita A, Chiliza B. Psychiatric disorders in adolescents living with HIV and association with antiretroviral therapy adherence in Sub-Saharan Africa: A systematic review and meta-analysis. AIDS Behav. 2021;25(6):1711–28. doi: 10.1007/s10461-020-03100-z [DOI] [PubMed] [Google Scholar]
  • 7.Willis N, Napei T, Armstrong A, Jackson H, Apollo T, Mushavi A, et al. Zvandiri-bringing a differentiated service delivery program to scale for children, adolescents, and young people in Zimbabwe. J Acquir Immune Defic Syndr. 2018;78 Suppl 2:S115–23. doi: 10.1097/QAI.0000000000001737 [DOI] [PubMed] [Google Scholar]
  • 8.Bernays S, Tshuma M, Willis N, Mvududu K, Chikeya A, Mufuka J, et al. Scaling up peer-led community-based differentiated support for adolescents living with HIV: Keeping the needs of youth peer supporters in mind to sustain success. J Int AIDS Soc. 2020;23 Suppl 5(Suppl 5):e25570. doi: 10.1002/jia2.25570 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Rich C, Mavhu W, France NF, Munatsi V, Byrne E, Willis N, et al. Exploring the beliefs, experiences and impacts of HIV-related self-stigma amongst adolescents and young adults living with HIV in Harare, Zimbabwe: A qualitative study. PLoS One. 2022;17(5):e0268498. doi: 10.1371/journal.pone.0268498 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Ferris France N, Byrne E, Nyamwanza O, Munatsi V, Willis N, Conroy R, et al. Wakakosha “You are Worth it”: Reported impact of a community-based, peer-led HIV self-stigma intervention to improve self-worth and wellbeing among young people living with HIV in Zimbabwe. Front Public Health. 2023;11:1235150. doi: 10.3389/fpubh.2023.1235150 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lariat J, Mavhu W, Mudhumo T, Shaba P, Sibanda S, Mbundure R, et al. Leaving no one behind? Addressing inequitable HIV outcomes by attending to diversity: A qualitative study exploring the needs of LGBTQI+ young people living with HIV in Zimbabwe. PLOS Glob Public Health. 2024;4(1):e0002442. doi: 10.1371/journal.pgph.0002442 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Grimsrud AT, Pike C, Bekker L-G. The power of peers and community in the continuum of HIV care. Lancet Glob Health. 2020;8(2):e167–8. doi: 10.1016/S2214-109X(19)30544-3 [DOI] [PubMed] [Google Scholar]
  • 13.Mangenah C, Mavhu W, Willis N, Mufuka J, Bernays S, Mangezi W, et al. Cost-effectiveness of Zvandiri, a community-based support intervention to reduce virological failure in adolescents living with HIV in Zimbabwe: Results of a decision analytical model. PLOS Glob Public Health. 2025;5(12):e0005545. doi: 10.1371/journal.pgph.0005545 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Simms V, Weiss HA, Chinoda S, Mutsinze A, Bernays S, Verhey R, et al. Peer-led counselling with problem discussion therapy for adolescents living with HIV in Zimbabwe: A cluster-randomised trial. PLoS Med. 2022;19(1):e1003887. doi: 10.1371/journal.pmed.1003887 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Mupambireyi Z, Simms V, Mavhu W, Mutasa C, Matsikire E, Ricotta A, et al. Clinical and psychosocial context of HIV perinatally infected young mothers in Harare, Zimbabwe: A longitudinal mixed-methods study. PLoS One. 2025;20(1):e0315299. doi: 10.1371/journal.pone.0315299 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Mupambireyi Z, Simms V, Mavhu W, Mutasa C, Matsikire E, Ricotta A, et al. Mental health and other clinical and social characteristics of young mothers living with HIV in Zimbabwe: a mixed-methods study. AIDS Care. 2025;37(6):931–41. doi: 10.1080/09540121.2025.2473948 [DOI] [PubMed] [Google Scholar]
  • 17.Dambi JM, Cowan FM, Martin F, Sibanda S, Simms V, Willis N, et al. A conceptualization and psychometric evaluation of positive psychological outcome measures used in adolescents and young adults living with HIV: A mixed scoping and systematic review. PLOS Glob Public Health. 2024;4(8):e0002255. doi: 10.1371/journal.pgph.0002255 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Orth Z, Moosajee F, Van Wyk B. Measuring mental wellness of adolescents: A systematic review of instruments. Frontiers in Psychology. 2022;13. doi: 10.3389/fpsyg.2022.835601 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Orth Z, Van Wyk B. Rethinking mental health wellness among adolescents living with HIV in the African context: An integrative review of mental wellness components. Frontiers in Psychology. 2022;13. doi: 10.3389/fpsyg.2022.955869 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Gallagher MW, Lopez SJ, Preacher KJ. The hierarchical structure of well-being. J Pers. 2009;77(4):1025–50. doi: 10.1111/j.1467-6494.2009.00573.x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Ryff CD, Keyes CL. The structure of psychological well-being revisited. J Pers Soc Psychol. 1995;69(4):719–27. doi: 10.1037/0022-3514.69.4.719 [DOI] [PubMed] [Google Scholar]
  • 22.Ryan RM, Deci EL. On happiness and human potentials: A review of research on hedonic and eudaimonic well-being. Annu Rev Psychol. 2001;52:141–66. doi: 10.1146/annurev.psych.52.1.141 [DOI] [PubMed] [Google Scholar]
  • 23.Zhang W, Balloo K, Hosein A, Medland E. A scoping review of well-being measures: Conceptualisation and scales for overall well-being. BMC Psychol. 2024;12(1):585. doi: 10.1186/s40359-024-02074-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Carries S, Nyasulu J, Moyo A, Davids EL, Odendaal W, Govindasamy D. A synthesis of dimensions of wellbeing among adolescents and young people living with HIV from Sub-Saharan Africa for measurement in economic evaluation: A qualitative overview of reviews. Health Qual Life Outcomes. 2026;24(1):30. doi: 10.1186/s12955-026-02487-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Harrison S, Li X. Toward an enhanced understanding of psychological resilience for HIV youth populations. AIDS Care. 2018;30(sup4):1–4. doi: 10.1080/09540121.2018.1556384 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Jung A, Challoumas D, Pagels L, Armijo-Olivo S, Braun T, Luedtke K. Guidelines for the development and validation of patient-reported outcome measures: A scoping review. BMJ Evid Based Med. 2024;29(6):363–73. doi: 10.1136/bmjebm-2023-112681 [DOI] [PubMed] [Google Scholar]
  • 27.Flake JK, Fried EI. Measurement Schmeasurement: Questionable Measurement Practices and How to Avoid Them. Advances in Methods and Practices in Psychological Science. 2020;3(4):456–65. doi: 10.1177/2515245920952393 [DOI] [Google Scholar]
  • 28.Reeve BB, Wyrwich KW, Wu AW, Velikova G, Terwee CB, Snyder CF, et al. ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013;22(8):1889–905. doi: 10.1007/s11136-012-0344-y [DOI] [PubMed] [Google Scholar]
  • 29.Terwee CB, Prinsen CAC, Chiarotto A, Westerman MJ, Patrick DL, Alonso J, et al. COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Qual Life Res. 2018;27(5):1159–70. doi: 10.1007/s11136-018-1829-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Patrick DL, Burke LB, Gwaltney CJ, Leidy NK, Martin ML, Molsen E, et al. Content validity--establishing and reporting the evidence in newly developed patient-reported outcomes (PRO) instruments for medical product evaluation: ISPOR PRO Good Research Practices Task Force report: part 2--assessing respondent understanding. Value Health. 2011;14(8):978–88. doi: 10.1016/j.jval.2011.06.013 [DOI] [PubMed] [Google Scholar]
  • 31.Dambi JM, Cowan FM, Martin F, Sibanda S, Simms V, Willis N, et al. Conceptualisation and psychometric evaluation of positive psychological outcome measures used in adolescents and young adults living with HIV: A mixed scoping and systematic review protocol. BMJ Open. 2022;12(9):e066129. doi: 10.1136/bmjopen-2022-066129 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Polit DF, Beck CT, Owen SV. Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Res Nurs Health. 2007;30(4):459–67. doi: 10.1002/nur.20199 [DOI] [PubMed] [Google Scholar]
  • 33.Mavhu W, Langhaug L, Manyonga B, Power R, Cowan F. What is “sex” exactly? Using cognitive interviewing to improve the validity of sexual behaviour reporting among young people in rural Zimbabwe. Cult Health Sex. 2008;10(6):563–72. doi: 10.1080/13691050801948102 [DOI] [PubMed] [Google Scholar]
  • 34.Bollen K, Lennox R. Conventional wisdom on measurement: A structural equation perspective. Psychological Bulletin. 1991;110(2):305–14. doi: 10.1037/0033-2909.110.2.305 [DOI] [Google Scholar]
  • 35.Harzing A-W. Response styles in cross-national survey research. Int’l Jnl of Cross Cultural Management. 2006;6(2):243–66. doi: 10.1177/1470595806066332 [DOI] [Google Scholar]
  • 36.Khadka J, Gothwal VK, McAlinden C, Lamoureux EL, Pesudovs K. The importance of rating scales in measuring patient-reported outcomes. Health Qual Life Outcomes. 2012;10:80. doi: 10.1186/1477-7525-10-80 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Marsh HW, Huppert FA, Donald JN, Horwood MS, Sahdra BK. The well-being profile (WB-Pro): Creating a theoretically based multidimensional measure of well-being to advance theory, research, policy, and practice. Psychol Assess. 2020;32(3):294–313. doi: 10.1037/pas0000787 [DOI] [PubMed] [Google Scholar]
  • 38.Marsh HW. Using the National Longitudinal Study of 1988 to evaluate theoretical models of self-concept: The Self-Description Questionnaire. J Educational Psychol. 1994;86(3):439–56. doi: 10.1037/0022-0663.86.3.439 [DOI] [Google Scholar]
  • 39.Crownw DP, Marlowe D. A new scale of social desirability independent of psychopathology. J Consult Psychol. 1960;24:349–54. doi: 10.1037/h0047358 [DOI] [PubMed] [Google Scholar]
  • 40.Orne MT. On the social psychology of the psychological experiment: With particular reference to demand characteristics and their implications. American Psychologist. 1962;17(11):776–83. doi: 10.1037/h0043424 [DOI] [Google Scholar]
  • 41.Krosnick JA. Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl Cognitive Psychol. 1991;5(3):213–36. doi: 10.1002/acp.2350050305 [DOI] [Google Scholar]
  • 42.Tourangeau R, Yan T. Sensitive questions in surveys. Psychol Bull. 2007;133(5):859–83. doi: 10.1037/0033-2909.133.5.859 [DOI] [PubMed] [Google Scholar]
  • 43.Smith PB. Acquiescent Response Bias as an Aspect of Cultural Communication Style. J Cross-Cultural Psychol. 2004;35(1):50–61. doi: 10.1177/0022022103260380 [DOI] [Google Scholar]
  • 44.van Herk H, Poortinga YH, Verhallen TM. Response styles in rating scales: evidence of method bias in data from 6 EU countries. J Cross-Cultural Psychol. 2004;35(3):346–60. [Google Scholar]
  • 45.Plummer ML, Ross DA, Wight D, Changalucha J, Mshana G, Wamoyi J, et al. “A bit more truthful”: the validity of adolescent sexual behaviour data collected in rural northern Tanzania using five methods. Sex Transm Infect. 2004;80 Suppl 2(Suppl 2):ii49-56. doi: 10.1136/sti.2004.011924 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Hewett PC, Mensch BS, Erulkar AS. Consistency in the reporting of sexual behaviour by adolescent girls in Kenya: a comparison of interviewing methods. Sex Transm Infect. 2004;80 Suppl 2(Suppl 2):ii43-8. doi: 10.1136/sti.2004.013250 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Langhaug LF, Cheung YB, Pascoe SJS, Chirawu P, Woelk G, Hayes RJ, et al. How you ask really matters: randomised comparison of four sexual behaviour questionnaire delivery modes in Zimbabwean youth. Sex Transm Infect. 2011;87(2):165–73. doi: 10.1136/sti.2009.037374 [DOI] [PubMed] [Google Scholar]
  • 48.Ewuoso C, Hall S. Core aspects of ubuntu: A systematic review. S Afr J BL. 2019;12(2):93. doi: 10.7196/sajbl.2019.v12i2.00679 [DOI] [Google Scholar]
  • 49.Mugumbate J, Chereni A. Using African Ubuntu theory in social work with children in Zimbabwe. African J Social Work. 2019;9(1). doi: 10.4314/ajsw.v9i1 [DOI] [Google Scholar]
  • 50.Mavhu W, Berwick J, Chirawu P, Makamba M, Copas A, Dirawo J, et al. Enhancing psychosocial support for HIV positive adolescents in Harare, Zimbabwe. PLoS One. 2013;8(7):e70254. doi: 10.1371/journal.pone.0070254 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Willis N, Mavhu W, Wogrin C, Mutsinze A, Kagee A. Understanding the experience and manifestation of depression in adolescents living with HIV in Harare, Zimbabwe. PLoS One. 2018;13(1):e0190423. doi: 10.1371/journal.pone.0190423 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Chaku N, Davis-Kean PE. Positioning adolescence in the developmental timeline. J Res Adolesc. 2024;34(4):1191–200. doi: 10.1111/jora.12928 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Ryff CD. Happiness is everything, or is it? Explorations on the meaning of psychological well-being. J Personality and Social Psychology. 1989;57(6):1069–81. doi: 10.1037/0022-3514.57.6.1069 [DOI] [Google Scholar]
  • 54.van de Vijver F, Tanzer NK. Bias and equivalence in cross-cultural assessment: An overview. European Rev Applied Psychol. 2004;54(2):119–35. doi: 10.1016/j.erap.2003.12.004 [DOI] [Google Scholar]
  • 55.White SC, Jha S. Exploring the relational in relational wellbeing. Social Sciences. 2023;12(11):600. doi: 10.3390/socsci12110600 [DOI] [Google Scholar]
  • 56.Barter C, Renold E. “I wanna tell you a story”: Exploring the application of vignettes in qualitative research with children and young people. Int J Social Research Methodol. 2000;3(4):307–23. doi: 10.1080/13645570050178594 [DOI] [Google Scholar]
  • 57.Bolger N, Davis A, Rafaeli E. Diary methods: capturing life as it is lived. Annu Rev Psychol. 2003;54:579–616. doi: 10.1146/annurev.psych.54.101601.145030 [DOI] [PubMed] [Google Scholar]
  • 58.Mink F, Lutz W, Hehlmann MI. Ecological Momentary Assessment in psychotherapy research: A systematic review. Clin Psychol Rev. 2025;117:102565. doi: 10.1016/j.cpr.2025.102565 [DOI] [PubMed] [Google Scholar]
  • 59.Patel V, Simunyu E, Gwanzura F, Lewis G, Mann A. The Shona Symptom Questionnaire: the development of an indigenous measure of common mental disorders in Harare. Acta Psychiatr Scand. 1997;95(6):469–75. doi: 10.1111/j.1600-0447.1997.tb10134.x [DOI] [PubMed] [Google Scholar]
  • 60.Houkamau CA, Sibley CG. The Revised Multidimensional Model of Māori Identity and Cultural Engagement (MMM-ICE2). Soc Indic Res. 2014;122(1):279–96. doi: 10.1007/s11205-014-0686-7 [DOI] [Google Scholar]
  • 61.Ng LC, Kanyanganzi F, Munyanah M, Mushashi C, Betancourt TS. Developing and validating the Youth Conduct Problems Scale-Rwanda: a mixed methods approach. PLoS One. 2014;9(6):e100549. doi: 10.1371/journal.pone.0100549 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Orth Z, Van Wyk B. Asking the Experts: Using Cognitive Interview Techniques to Explore the Face Validity of the Mental Wellness Measure for Adolescents Living with HIV. Int J Environ Res Public Health. 2023;20(5):4061. doi: 10.3390/ijerph20054061 [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

S1 Text. 53-item scale spanning 14 constructs.

(DOCX)

pgph.0006845.s001.docx (19.6KB, docx)
S1 Data. Panel of experts’ content validation results.

(XLSX)

pgph.0006845.s002.xlsx (39KB, xlsx)
S2 Data. Detailed psychometric evaluation results.

(DOCX)

pgph.0006845.s003.docx (270.5KB, docx)

Data Availability Statement

The minimal quantitative dataset required to reproduce the descriptive, content-validity, psychometric and figure-based findings reported in this article is provided in the supporting information files. Full qualitative transcripts are not publicly available because they contain sensitive information from adolescents and young people living with HIV. Data is held and available upon reasonable request via a non-author point of contact: Institution: Centre for Sexual Health and HIV/AIDS Research (CeSHHAR) Zimbabwe. Contact Person: Data Officer, Rangarirai Gava (rangarirai.gava@ceshhar.org).


Articles from PLOS Global Public Health are provided here courtesy of PLOS

RESOURCES