Abstract
Objective
To determine the effectiveness of a brief cognitive behavioural intervention in reducing the incidence of sexually transmitted infections among gay men.
Design
Randomised controlled trial with 12 months' follow up.
Setting
Sexual health clinic in London.
Participants
343 gay men with an acute sexually transmitted infection or who reported having had unprotected anal intercourse in the past year.
Main outcome measures
Number of new sexually transmitted infections diagnosed during follow up and self reported incidence of unprotected anal intercourse.
Results
72% (361/499) of men invited to enter the study did so. 90% (308/343) of participants returned at least one follow up questionnaire or re-attended the clinic and requested a check up for sexually transmitted infections during follow up. At baseline, 37% (63/172) of the intervention group and 30% (50/166) of the control group reported having had unprotected anal intercourse in the past month. At 12 months, the proportions were 27% (31/114) and 32% ( 39/124) respectively (P=0.56). However, 31% (38/123) of the intervention group and 21% (35/168) of controls had had at least one new infection diagnosed at the clinic (adjusted odds ratio 1.66, 95% confidence interval 1.00 to 2.74). Considering only men who requested a check up for sexually transmitted infections, the proportion diagnosed with a new infection was 58% (53/91) for men in the intervention group and 43% (35/81) for men in the control group (adjusted odds ratio 1.84, 0.99 to 3.40). Using a regional database that includes information from 23 sexual health clinics in London, we determined that few participants had attended other sexual health clinics.
Conclusions
This behavioural intervention was acceptable and feasible to deliver, but it did not reduce the risk of acquiring a new sexually transmitted infection among these gay men at high risk. Even carefully designed interventions should not be assumed to bring benefit. It is important to evaluate their effects in randomised trials with objective clinical end points.
What is already known on this topic
The need for effective HIV prevention strategies based on reducing sexual risk behaviour remains important
Few interventions to reduce sexual risk behaviour have been rigorously evaluated using randomised controlled trials
What this study adds
This is the first randomised controlled trial of an intervention addressing sexual behaviour in homosexual men that uses sexually transmitted infections and self reported behaviour as end points
The intervention was brief and feasible to use in a busy clinic, but it did not reduce the risk of participants acquiring new infections
The potential for behavioural interventions to do more harm than good needs to be taken seriously
Introduction
Each year in the United Kingdom about 1400 homosexual men are newly diagnosed as being infected with HIV; this figure has remained comparatively stable for a decade.1 Gay men attending sexual health clinics in London report engaging in significantly more high risk sexual behaviour than gay men surveyed in community settings.2 Effective behavioural interventions to reduce sexual risk taking and infection with HIV and other sexually transmitted diseases are clearly needed,3 and sexual health clinics are an appropriate setting for such interventions. We developed a small group intervention aimed at gay men, which draws on several psychological models of behavioural change.4–6 We evaluated its effects in a pragmatic randomised controlled trial using clinical end points (new sexually acquired infections) as well as self reported changes in behaviour.
Participants and methods
Participants
The study was approved by the University College London and University College London Hospitals ethics committee. From September 1995 to November 1997, we invited homosexual men attending a sexual health clinic in London to enter the trial if they presented with an acute sexually transmitted infection, reported having had unprotected anal intercourse with a partner of different HIV status in the past year, or expressed concern about their sexual practices. Men were only excluded if they were deemed by clinic staff to be unsuited for a group education and counselling intervention. Participants were randomly allocated using sealed opaque envelopes.
All participants received standard management consisting of a brief (20 minute) one to one counselling session about sexual risk behaviour; contact tracing was offered to those with a newly diagnosed infection; and participants could also be referred to clinic based or community based education on HIV prevention and counselling services. Additionally, participants assigned to the intervention were invited to a one day workshop. This had been shortened to one day because in a pilot study using an intervention spread across three occasions, too few men had attended all sessions. The intervention drew on the transtheoretical model of behavioural change4 and the model of relapse prevention5; it also included elements of social learning theory and motivational interviewing.6 (A description of the cognitive behavioural intervention is available on the BMJ's website.) Pairs of trained counsellors from the clinic facilitated the workshops. The quality of the intervention was assessed using participants' evaluations, reports from the facilitators' clinical supervisors, and focus groups. No payments were offered for attendance or follow up.
Behavioural outcomes were followed up using postal questionnaires. Clinic and laboratory databases were reviewed to identify new infections diagnosed at the clinic. Attendance at other clinics in greater London was determined by matching individuals to a regional database. Re-attendance at the clinic was not required by the protocol.
Data analysis
The sample size was calculated to detect a reduction of three fifths in the proportion of men acquiring a new sexually transmitted infection (from 20%, as estimated from recent clinic data, to 8%) in 12 months and a reduction of two fifths in the proportion reporting having unprotected anal intercourse in the past month (from 50% to 30%). The aim was to recruit 346 men, assuming a statistical power of at least 80% and 25% loss to follow up.
Sexual behaviour outcomes were collected using questionnaires at baseline, 6 months, and 12 months. Participants were asked about the number of sexual partners with whom they had had unprotected anal intercourse in the past month and the last year (at baseline and at 12 months) and the HIV status of those partners. We used two definitions of a new, sexually transmitted infection. The first was a broad definition including acute hepatitis B, syphilis, gonorrhoea, chlamydia, or non-specific urethritis, or the first clinical episode of herpes or genital warts. The second was a narrow definition that considered only acute bacterial infections (syphilis, chlamydia, or gonorrhoea); this was seen as a better proxy for unprotected anal intercourse.7
Assessors who were blind to the participant's allocation reviewed the clinic's and the laboratory's databases to determine clinic attendance and diagnoses during follow up. To determine whether participants had attended other clinics during follow up, we matched their information to that on a regional database from 23 sexual health clinics in greater London using date of birth, sexual orientation, ethnic group, and postcode.8
Screening for asymptomatic infection was not included in the original study protocol because we felt it would compromise recruitment. However, participants were more enthusiastic about the trial than expected. We therefore added an unlinked, anonymous urine analysis to detect undiagnosed infections the end of the trial. Specimens were returned by post and tested for Neisseria gonorrhoeae and Chlamydia trachomatis (LCx Probe, Abbott Laboratories, Chicago, IL).
Other outcomes assessed were psychological determinants of safer sex behaviours (such as self efficacy—for example, does the participant have confidence in his ability to use condoms properly) and uptake of other interventions in the clinic or community. Five psychometric measures were completed on the baseline questionnaire and each follow up questionnaire. These were the situational self confidence questionnaire, which measures self efficacy9; the Rosenberg self esteem questionnaire10; the readiness to change questionnaire, which identifies an individual's position relative to the model of stages of behavioural change4,11; the sexual risk cognition questionnaire, which measures beliefs associated with high risk sexual behaviour12; and the HIV related attitudes questionnaire.13 Scores on the situational self confidence questionnaire range from 0-10; higher scores suggest a higher level of self confidence. Scores on the Rosenberg questionnaire range from 10-40; lower scores suggest higher self esteem. Scores on the sexual risk cognition questionnaire range from 0-88; lower scores suggest that a respondent has thought about sexual risk taking less frequently. Scores on the component scales of the HIV attitudes questionnaire range from 0-5; higher scores suggest more positive attitudes towards taking control of one's risk of HIV.
Data from the questionnaires were double entered using EpiInfo software and analysed using SPSS and Stata software. The primary analysis included all participants who had been randomly allocated regardless of whether they had received the intervention (intention to treat analysis).
For clinical end points, we compared the cumulative proportion of men in each arm of the trial who had a new infection diagnosed at the clinic during follow up. For sexual behaviour outcomes, we compared the proportions reporting having had unprotected anal intercourse during the past month and the past year. For psychological measures, we analysed changes from baseline within the individual for each follow up questionnaire. For unadjusted comparisons between the arms of the trial we used the χ2 test for binary data and t tests or Mann-Whitney U tests for continuous data. For binary outcomes, we adjusted for possible confounding factors at baseline using logistic regression. We also compared those who had attended the intervention with the controls (on-treatment analysis).
Results
Baseline characteristics, attendance, and follow up
Altogether, 499 men were invited to enter the trial and 361 (72%) agreed. Of these, 343 were randomly allocated (175 to the intervention group and 168 to the control) and 18, who had a long term partner in the trial, were assigned to the same arm as their boyfriend (11 in the intervention group and 7 in the control) (fig 1). The 18 men who had not been randomly allocated were excluded from the analysis.
Participants were similar to those who declined to participate in terms of age, occupational classification, and eligibility criteria but were more likely to be white (P=0.06) and have more education (P=0.04) (table 1). At baseline, 2% of participants (four from the intervention group and two from the control) were known to be HIV positive, and 59% (201/343) (61% (106/175) of the intervention group and 57% (95/168) of the control group) had tested negative for HIV in the past three months. The HIV status of the remaining 40% (136/343) was considered to be unknown.
Table 1.
All randomly allocated participants (n=343) | Intervention group (n=175) | Control group (n=168) | Declined to participate (n=138) | |
---|---|---|---|---|
Median (range) age (years) | 29 (18-58) | 29 (18-49) | 29 (18-58) | 28 (17-59) |
Ethnicity: | ||||
White | 311 (91) | 160 (91) | 151 (90) | 116* (84) |
Education: | ||||
Beyond secondary school | 294 (86) | 150 (86) | 144 (86) | 106† (77) |
Occupation: | ||||
Skilled non-manual | 195 (57) | 91 (52) | 104 (62) | 76 (55) |
Sexually transmitted infection at recruitment | 172 (50) | 92 (53) | 79 (47) | 59 (43) |
HIV workshop attended previously | 59 (17) | 27 (15) | 31 (19) | NA |
NA=not available.
P=0.06 compared with all randomly allocated participants.
P=0.04 compared with all randomly allocated participants.
Of the 175 men allocated to the intervention, 124 (71%) attended. Compared with non-attenders, they were more likely to have attended a workshop before (20% (22/108) v 3% (1/40), P=0.01) and more likely to complete the questionnaire at 12 months (77% (95/124) v 41% (21/51), P<0.001) (data not shown). Altogether 80% (276/343) of participants returned a questionnaire at 6 months and 71% (244/343) did at 12 months. Those completing the 12 month questionnaire were older (median (range) age 30 (18-51) years v 27 (18-58) years, P<0.001). Follow up data from one or both questionnaires or from clinic and laboratory databases were available for 90% (308/343) of participants.
Impact of the intervention
Self reported changes in sexual behaviour were modest but generally there was more improvement in the intervention group (table 2): in this group the proportion of men engaging in unprotected anal intercourse in the past month decreased from 37% (63/172) at baseline to 24% (32/136) at 6 months and 27% (31/114) at 12 months. In the control group the proportion changed little: from 30% (50/166) at baseline to 32% (44/139) at 6 months and 32% (39/124) at 12 months. After adjusting for infections and unprotected anal intercourse at baseline, differences in these proportions between the arms of the trial were not significant (P=0.07 at 6 months and P=0.31 at 12 months). Findings were similar for the proportions having unprotected anal intercourse in the past 12 months (61% (106/174) in the intervention group and 63% (104/166) in the control group at baseline compared with 50% (58/116) and 59% (76/128) respectively at 12 months). Of those who reported at baseline that they had had unprotected anal intercourse in the past month, 63% (39/62) of the intervention group and 68% (34/50) of the control group reported that the last episode was with a partner of unknown or different HIV status. These proportions were 44% (14/32) and 65% (28/43), respectively, at 6 months (P=0.11) and 48% (15/31) and 46% (18/39) at 12 months (P=0.9).
Table 2.
Baseline
|
6 months
|
12 months
|
||||||||
---|---|---|---|---|---|---|---|---|---|---|
Intervention (n=175) | Control (n=168) | Intervention (n=137) | Control (n=139) | P value* | Intervention (n=116) | Control (n=128) | P value* | |||
Unprotected anal intercourse in the past year | 106/174 (61) | 104/166 (63) | NA | NA | NA | 58/116 (50) | 76/128 (59) | 0.28 | ||
Unprotected anal intercourse in the past month: | 63/172 (37) | 50/166 (30) | 32/136 (24) | 44/139 (32) | 0.07 | 31/114 (27) | 39/124 (32) | 0.31 | ||
Last episode with partner of different or unknown HIV status | 39/62 (63) | 34/50 (68) | 14/32 (44) | 28/43 (65) | 0.06 | 15/31 (48) | 18/39 (46) | 0.78 |
NA=Not applicable.
P value for intervention group v control after adjusting for sexually transmitted infections at baseline and whether the behaviour was reported at baseline.
A larger proportion of the intervention group had had a new sexually transmitted infection diagnosed during follow up (table 3). Around half of all men (53% (91/172) in the intervention group and 48% (81/168) of the control) returned to the clinic during follow up and requested a check up for sexually transmitted infections. Restricting the analysis to this subgroup had little effect on the adjusted odds ratio (1.84, 95% confidence interval 0.99 to 3.40 for the broad definition of infection and 1.84, 0.82 to 4.16 for the narrow definition). More men in the intervention group had a check up, and a higher proportion of them had a new infection than the control group (58% (53/91) v 43% (35/81) for the broad definition and 23% (21/91) v 14% (11/81) for the narrow definition) (data not shown). Findings did not differ appreciably when the 18 men who had not been randomly assigned were included (data not shown).
Table 3.
Group
|
Odds ratio (95% CI) | Adjusted odds ratio* (95% CI) | ||
---|---|---|---|---|
Intervention (n=175) | Control (n=168) | |||
New sexually transmitted infection diagnosed: | ||||
All new infections diagnosed† | 53/172 (31) | 35/168 (21) | 1.69 (1.03 to 2.77) | 1.66 (1.00 to 2.74) |
New bacterial infections diagnosed‡ | 21/172 (12) | 11/168 (7) | 1.98 (0.93 to 4.26) | 1.84 (0.85 to 3.99) |
Use of other clinic or community prevention services: | ||||
Clinic based prevention service | 7/110 (6) | 8/128 (6) | 1.02 (0.32 to 3.23) | 1.04 (0.36 to 2.98) |
Community based prevention service | 14/107 (13) | 10/123 (8) | 1.70 (0.67 to 4.35) | 1.75 (0.74 to 4.12) |
One to one counselling at a clinic | 18/112 (16) | 17/127 (13) | 1.24 (0.57 to 2.69) | 1.20 (0.57 to 2.48) |
One to one counselling in the community | 10/113 (9) | 5/128 (4) | 2.39 (0.72 to 8.32) | 2.46 (0.81 to 7.46) |
Contacted helpline | 16/113 (14) | 18/127 (14) | 1.00 (0.45 to 2.19) | 1.02 (0.48 to 2.17) |
Odds ratio adjusted for presenting with acute infection at recruitment.
Broad definition of new sexually transmitted infections included hepatitis B, first episodes of herpes or genital warts, syphilis, gonorrhoea, chlamydia, and non-specific urethritis.
Narrow definition of sexually transmitted infections included only common bacterial infections, specifically syphilis, chlamydia, and gonorrhoea.
We also analysed the data by site of infection to see whether new infections were likely to reflect high risk sexual behaviour (for example, rectal infections). Although the numbers were small, the incidence of rectal gonorrhoea was non-significantly higher (P=0.26) in the intervention group (9 cases) than the control group (4 cases) (data not shown). In the on-treatment analysis the risk of acquiring a new infection was similar to the that in the intention to treat analysis (broad definition 31% (38/123) v 21% (35/168); adjusted odds ratio for presenting with an acute infection at baseline 1.69 (95% confidence interval 0.98 to 2.90) and for the narrow definition 11% (14/123) v 7% (11/168) respectively; adjusted odds ratio 1.65 (0.71 to 3.84)) (data not shown).
The higher rate of new infections among participants in the intervention arm was unexpected. We therefore extended the review of the clinic's and laboratory's databases to beyond 12 months to see if the adverse effect persisted. An intention to treat analysis showed that the difference between the arms of the trial in the risk of new infection attenuated over time. At a median follow up of 22 months (range 18-36 months) for the broad definition the adjusted odds ratio was 0.96 (95% confidence interval 0.56 to 1.65) and for the narrow definition 1.30 (0.53 to 3.19) (data not shown).
We were able to match 56% of participants (98 in the intervention group and 93 controls) to the regional database of sexual health clinics. Four men in each arm were matched to an attendance at another clinic, and only one attendance resulted in the diagnosis of an infection. Uptake of other counselling or prevention services was comparatively low and was not significantly different between the trial arms (table 3).
For the survey of urine samples we received specimens from 52% (180) of the original 343 participants. Only one specimen from a member of the control group tested positive for N gonorrhoeae; four tested positive for C trachomatis (1 from the intervention group and 3 from the control).
Median scores for psychometric measures at baseline were similar in both arms (table 4). At the beginning of the study a high proportion of men were either in the “contemplation” stage (that is, considering adopting safer sex behaviour) or the “action” stage (that is, trying to practise safer sex) according to the transtheoretical model and the readiness to change scale (table 5). At 6 months, men in the intervention group had made significantly more progress in their scores on the readiness to change scales.
Table 4.
Questionnaire | Median (range) score at baseline
|
Difference in change in mean score between intervention and control groups (95% CI)†
|
|||
---|---|---|---|---|---|
Intervention (n=175) | Control (n=168 | 6 months | 12 months | ||
Sexual risk cognition12 | 12 (0-72) | 11 (0-55) | −1.15 (−3.80 to 1.49) | 0.645 (−2.70 to 3.99) | |
Situational self confidence9 | 8.0 (0.8-10) | 8.0 (1.2-10) | 0.25 (−0.08 to 0.58) | 0.02 (−0.35 to 0.39) | |
Rosenberg self esteem10 | 19 (10-33) | 18 (10-34) | −1.10 (−2.57 to 0.37) | −0.22 (−1.33 to 0.89) | |
HIV attitudes questionnaire13: | |||||
Self efficacy | 4.5 (2.0-5.0) | 4.75 (2.25-5.0) | 0.17 (0.02 to 0.32) | 0.12 (−0.05 to 0.29) | |
Social norms | 4.33 (2.33-5.0) | 4.67 (2.33-5.0) | 0.03 (−0.17 to 0.23) | 0.02 (−0.19 to 0.24) | |
Communication skills | 4.0 (1.0-5.0) | 4.0 (1.67-5.0) | 0.17 (−0.02 to 0.36) | 0.23 (0.02 to 0.45) | |
Self labelling | 3.33 (1.0-5.0) | 3.33 (1.3-5.0) | 0.25 (0.00 to 0.49) | 0.19 (−0.09 to 0.48) | |
Safer sex efficacy | 4.0 (1.5-5.0) | 4.0 (2.5-5.0) | 0.08 (−0.11 to 0.26) | 0.25 (0.03 to 0.47) | |
Interpersonal barriers | 4.0 (2.0-5.0) | 4.0 (2.0-5.0) | 0.25 (0.06 to 0.45) | 0.28 (0.07 to 0.49) |
Explanation of scores given in the methods section.
Mean within individual change from baseline. Intervention score minus control score.
Table 5.
Stage of readiness to change* | Baseline
|
6 months
|
12 months
|
|||||||
---|---|---|---|---|---|---|---|---|---|---|
Intervention (n=167) | Control (n=161) | Intervention (n=127) | Control (n=126) | P value† | Intervention (n=104) | Control (n=118) | P value* | |||
Pre-contemplation | 6 (4) | 3 (2) | 6 (5) | 10 (8) | 8 (8) | 10 (9) | ||||
Contemplation | 63 (38) | 60 (37) | 28 (22) | 44 (35) | 0.03 | 24 (23) | 34 (29) | 0.16 | ||
Action | 98 (59) | 98 (61) | 93 (73) | 72 (57) | 72 (69) | 74 (63) |
Explanation of stages given in the text.
χ2 test for linear association comparing within individual changes from baseline.
Discussion
There have been comparatively few randomised trials of interventions aimed at changing sexual behaviour to prevent the transmission of HIV and other sexually transmitted infections.14 Even fewer trials have used the incidence of infection as an end point together with reported sexual behaviour.3 This is the first such trial in a population of gay men to measure both clinical and behavioural outcomes.3,15,16 Analysis of the self reported behavioural outcomes suggested a weak beneficial effect, but analysis of the clinical end points indicated that the intervention was more likely to be harmful, although this was of borderline significance. However, the link between sexual behaviour and sexually transmitted infection is not simple.7,17–19 Some infections, such as gonorrhoea, are usually acquired through penetrative sex, but others, such as herpes, can be acquired through low risk, non-penetrative sex. Furthermore, new viral infections can be hard to distinguish clinically from recurrent episodes. Thus, a broad definition of new infections may include some that were not acquired through high risk sex or that preceded the intervention, whereas a narrow definition may miss infections that were acquired through high risk sex. We tried to avoid this problem by using two definitions. When it is not possible to mask a participant's allocation, as in this study, it is particularly important to include clinical end points and not rely solely on self reported behavioural outcomes because these tend to overestimate benefit.3,20
The higher risk of acquiring a sexually transmitted infection among participants in the intervention arm was unexpected, at odds with the data on sexual behaviour, and clearly a cause for concern. However, similar findings have been reported in other trials of behavioural interventions that used the clinical diagnosis of an infection as an end point.3 Three observations suggest that the increased risk of infection in our study is unlikely to be explained adequately by bias in the ascertainment of infection: screening rates at the clinic were similar in the two arms of the trial, and the proportion of men with a new infection was higher in the intervention group; matching using the regional database showed that we were unlikely to have missed many infections diagnosed elsewhere; and despite a comparatively low response rate, screening of urine samples suggested that the prevalence of asymptomatic infection in this population was low. Alternative explanations for the discrepancy between behavioural and clinical outcomes include bias due to loss to follow up or desirability bias, whereby participants in the intervention may have wished or felt obliged to report safer sexual behaviours.17,20,21
The attenuation of differences between the two arms of the trial in the risk of becoming infected over time (as suggested by the extended review of the databases) supports the conclusion that the intervention may have led to an increased, albeit transient, risk of acquiring a new infection. Another possible explanation is that the intervention engendered in the participants a misplaced sense of confidence in their ability to negotiate high risk sexual situations, but this was not borne out by changes in the appropriate psychometric measures (table 4). We also considered the possibility that other interventions may have affected the outcome of the trial, but the uptake of other HIV prevention and counselling services was comparatively low and similar between the two arms.
Despite its promise and acceptability, the brief cognitive intervention aimed at gay men at high risk of sexually transmitted infection did not reduce their risk of acquiring new infections. Even carefully formulated behavioural interventions should not be assumed to bring benefit. It is important to evaluate their effects in randomised trials using clinical end points wherever possible.
Supplementary Material
Acknowledgments
Other members of the Behavioural Intervention in Gay Men Project Study Group are: Richard Barrett, Paul Bean, Rebecca Bickersteth, John Develin, Sandy Gale, Dr Sue Gessler, Debbie Holland, Angela McCadden, Kevin Miles, Nikki Penny, Ann Petruckevitch, Gillian Rhind, Kaye Stratton, and Dawn Whittaker. We thank all the study participants and the nurses, health advisers, doctors, and reception staff at the clinic who supported the study team. We owe particular thanks to the facilitators: Richard Barrett, Rebecca Bickersteth, Emma Callow, David Cornforth, Ruth Cracknell, Rebecca French, Jo Greenway, Mike Jones, Theresa Melrose, Kevin Miles, Simon Paragreen, Michael van Djikhuizen, and Simon Wright. We also thank Caroline Carder and Dr Geoffrey Ridgway, Clinical Microbiology Department, University College London Hospital; Dr Stephen Sutton, Imperial Cancer Research Fund Health Behaviour Unit, Royal Free and University College Medical School; Maria Griffin, Ali Judd, and Matthew Hickman of the Department of Social Science and Medicine, Imperial College School of Medicine, participating on behalf of the North Thames Genitourinary Medicine Clinical Directorate, London; and Dr John Parry and Julie Newham, Hepatitis and Retrovirus Laboratory, Central Public Health Laboratory, London.
Footnotes
Funding: North Thames Regional Health Authority and the Camden and Islington Health Authority, London.
Competing interests: None declared.
A description of the cognitive behavioural intervention appears on the BMJ's website
References
- 1.Public Health Laboratory Service. AIDS/HIV quarterly surveillance tables. No.44:99/2; June 1999. http://www.phls.co.uk/facts/HIV/hivquarterly.htm (accessed Sept 2000).
- 2.Dodds J, Nardone A, Mercey DE, Johnson AM. Increase in high risk sexual behaviour among homosexual men, London 1996-8: cross sectional, questionnaire study. BMJ. 2000;320:1510–1511. doi: 10.1136/bmj.320.7248.1510. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Stephenson JM, Imrie J, Sutton SR. Rigorous trials of sexual behaviour interventions in STD/HIV prevention: what can we learn from them? AIDS. 2000;14(suppl 3):S115–S124. [PubMed] [Google Scholar]
- 4.Prochaska JO, DiClemente CC, Norcross JC. In search of how people change. Applications to addictive behaviors. Am Psychol. 1992;47:1102–1114. doi: 10.1037//0003-066x.47.9.1102. [DOI] [PubMed] [Google Scholar]
- 5.Marlatt GA, Gordon JR. Relapse prevention: maintenance strategies in the treatment of addictive behaviors. New York: Guildford; 1985. [Google Scholar]
- 6.Bandura A. Social cognitive theory and exercise of control over HIV infection. In: DiClemente RJ, Peterson J, editors. Preventing AIDS: theories and methods of behavioural interventions. New York: Plenum; 1994. [Google Scholar]
- 7.Young H, Moyes A, McKenna JG, McMillan A. Rectal gonorrhoea and unsafe sex. Lancet. 1991;337:853. doi: 10.1016/0140-6736(91)92561-f. [DOI] [PubMed] [Google Scholar]
- 8.Hickman M, Griffin M, Judd A, Renton A. STI surveillance and commissioning information system (SCIS): report of pilot project including standard tables for GUM clinics in the former North Thames region for 1997 and 1998. London: Centre for Research on Drugs and Health Behaviour, Imperial College of Science, Technology, and Medicine; 1999. [Google Scholar]
- 9.Wanigaratne S, Billington A, Williams M. Initiating and maintaining safer sex: evaluation of group work with gay men. In: Catalan J, Sherr L, Hedges B, editors. The impact of AIDS: psychological and social aspects of HIV infection. Singapore: Harwood Academic; 1997. pp. 27–41. [Google Scholar]
- 10.Rosenberg M. Society and adolescent self image. Princeton, NJ: Princeton University; 1965. [Google Scholar]
- 11.Rollnick S, Heather N, Gold R, Hall W. Development of a short “readiness to change” questionnaire for use in brief, opportunistic interventions among excessive drinkers. Br J Addict. 1992;87:743–754. doi: 10.1111/j.1360-0443.1992.tb02720.x. [DOI] [PubMed] [Google Scholar]
- 12.Shah D, Thornton S, Burgess A. Sexual risk cognitions questionnaire: a reliability and validity study. AIDS Care. 1997;4:471–480. doi: 10.1080/00222937500770361. [DOI] [PubMed] [Google Scholar]
- 13.Hays R, Kegeles S, Coates TJ. High HIV risk-taking among young gay men. AIDS. 1990;4:901–907. doi: 10.1097/00002030-199009000-00011. [DOI] [PubMed] [Google Scholar]
- 14.Oakley A, Fullerton D, Holland J. Behavioural interventions for HIV/AIDS prevention. AIDS. 1995;9:479–486. [PubMed] [Google Scholar]
- 15.Holland J, Arnold S, Fullerton D, Oakley A, Hart G. Review of effectiveness of health promotion interventions for men who have sex with men. London: Social Science Research Unit, Institute of Education; 1994. [Google Scholar]
- 16.Kegeles SM, Hart GJ. Recent HIV-prevention interventions for gay men: individual, small-group and community-based studies. AIDS. 1998;12(suppl A):S209–S215. [PubMed] [Google Scholar]
- 17.Aral SO, Peterman TA. Do we know the effectiveness of behavioural interventions? Lancet. 1998;351(suppl 3):33–36. doi: 10.1016/s0140-6736(98)90010-1. [DOI] [PubMed] [Google Scholar]
- 18.Peterman TA, Lin LS, Newman DR, Kamb ML, Bolan G, Zenilman J, et al. Does measured behavior reflect STD risk? An analysis of data from a randomized controlled behavioral intervention study. Sex Transm Dis. 2000;27:446–451. doi: 10.1097/00007435-200009000-00004. [DOI] [PubMed] [Google Scholar]
- 19.Fishbein M, Jarvis B. Failure to find a behavioral surrogate for STD incidence—what does it really mean? Sex Transm Dis. 2000;27:452–455. doi: 10.1097/00007435-200009000-00005. [DOI] [PubMed] [Google Scholar]
- 20.Stephenson J, Imrie J. Why do we need randomised controlled trials to assess behavioural interventions? BMJ. 1998;316:611–613. doi: 10.1136/bmj.316.7131.611. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Zenilman JM, Weisman CS, Rompalo AM, Ellish N, Upchurch DM, Hook EW, 3rd, et al. Condom use to prevent incident STDs: the validity of self-reported condom use. Sex Transm Dis. 1995;22:15–21. doi: 10.1097/00007435-199501000-00003. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.