Abstract
Background
Point-of-care tests for chlamydia (CT) and gonorrhoea (NG) could increase the uptake and timeliness of testing and treatment, contribute to improved disease control and reduce reproductive morbidity. The GeneXpert (Xpert CT/NG assay), suited to use at the point-of-care, is being used in the TTANGO randomised controlled trial (RCT) in 12 remote Australian health services with a high burden of sexually transmissible infections (STIs). This represents the first ever routine use of a molecular point-of-care diagnostic for STIs in primary care. The purpose of this study was to explore the acceptability of the GeneXpert to primary care staff in remote Australia.
Methods
In-depth qualitative interviews were conducted with 16 staff (registered or enrolled nurses and Aboriginal Health Workers/Practitioners) trained and experienced with GeneXpert testing. Interviews were digitally-recorded and transcribed verbatim prior to content analysis.
Results
Most participants displayed positive attitudes, indicating the test was both easy to use and useful in their clinical context. Participants indicated that point-of-care testing had improved management of STIs, resulting in more timely and targeted treatment, earlier commencement of partner notification, and reduced follow up efforts associated with client recall. Staff expressed confidence in point-of-care test results and treating patients on this basis, and reported greater job satisfaction. While point-of-care testing did not negatively impact on client flow, several found the manual documentation processes time consuming, suggesting that improved electronic connectivity and test result transfer between the GeneXpert and patient management systems could overcome this. Managing positive test results in a shorter time frame was challenging for some but most found it satisfying to complete episodes of care more quickly.
Conclusions
In the context of a RCT, health professionals working in remote primary care in Australia found the GeneXpert highly acceptable. These findings have implications for use in other primary care settings around the world.
Background
Point-of-care programs for sexually transmissible infections (STIs) have focused mainly on HIV and syphilis, due to funding priorities, and also the lack of accurate tests available for other STIs such as Chlamydia trachomatis (CT) and Neisseria gonorrhoeae (NG) which are easily curable with single-dose antibiotics. However with the recent availability of the first rapid, accurate, molecular diagnostic system (GeneXpert CT/NG assay) there is wider scope for the use of CT and NG point-of-care tests.[1,2] The GeneXpert system is also portable, in the sense that it can be packed and moved in a suitable case on wheels by one person, which adds to its utility.
The GeneXpert CT/NG assay is being utilised in the TTANGO (Test, Treat, ANd GO) trial.[3] TTANGO is a cross-over cluster randomised controlled trial underway in 12 remote Australian primary health care services in communities with a predominantly Aboriginal and Torres Strait Islander (hereafter referred to as Aboriginal) population. To our knowledge the trial represents the first use of a point-of-care molecular diagnostic test for STIs in a primary health care setting anywhere in the world.[3] GeneXpert platforms have been used for other infectious diseases, such as tuberculosis, but largely in laboratory settings.[4]
Provision of accurate testing and timely treatment through primary care services is a key STI control and prevention strategy. Point-of-care tests for CT and NG have the potential to increase the uptake and timeliness of testing and treatment and reduce the average duration of infectiousness,[5] thereby contributing to improved STI control in remote Australia and similar settings elsewhere. As utilisation of these new molecular point-of-care tests for CT/NG is a substantial change to clinical practice in these remote areas, and generally across the world, the TTANGO trial included comprehensive evaluation of the clinical, operational and cost-effectiveness of CT/NG point-of-care testing as well as its acceptability to health care staff and patients.
It is well established that the integration of point-of-care testing into STI clinical services in remote settings and elsewhere is not straightforward,[6] and that the mere availability of a point-of-care test does not ensure uptake by service providers or end users.[7,8] Acceptability of point-of-care testing to health care workers is necessary to support the introduction and sustainability of point-of-care testing, yet there has been a relative scarcity of qualitative research in this area.[9]
Acceptability of point-of-care test utilisation by health professionals is influenced by factors including: ease of use, in particular the number of manual steps involved and whether these are timed; reading and interpretation of results, especially if there is an element of subjectivity; specimen collection procedures and how complex or invasive they are; performance characteristics of the test (high sensitivity and specificity) and confidence in this; the extent to which point-of-care testing interrupts clinic workflow; and, the time taken to produce a result.[10–15] In the context of the TTANGO trial, we report on the acceptability of the GeneXpert CT/NG to primary health care staff working in remote Australian health services.
Methods
Ethics, consent and permissions
Ethical approval for the study was received from the West Australian Aboriginal Health Information and Ethics Committee, the West Australian Community Health Board Research Ethics Committee, the Townsville and Cairns Health Service District Human Research Ethics Committees and, the Aboriginal Health Research Ethics Committee of South Australia. Written informed consent was obtained from all participants. The trial is registered with the Australian and New Zealand Clinical Trials Registry (ACTRN12613000808741).
Setting
Health care in remote Aboriginal communities is mainly provided through primary health care services, which are staffed by nurses and Aboriginal Health Workers/Practitioners mainly, with most having ‘fly in’ and ‘fly out’ Medical Officer support. In many remote communities in Australia, CT positivity and NG positivity are both around 20%.[16] Health services in these communities follow guidelines which recommend presumptive treatment in patients with STI symptoms or for patients living in communities with high rates of STIs and considered at high risk.[17–19] Patients who are asymptomatic for CT and NG (about 80% of those infected)[20] are treated on the basis of a laboratory test conducted at urban laboratories. Large distances to these laboratories and difficulties recalling patients [21–26] may result in one in six patients with an STI not being treated and delays in treatment of three weeks on average.[27]
The TTANGO trial
TTANGO is a cross-over cluster randomised trial nearing completion in 12 Aboriginal community controlled health services in remote communities, mostly in Western Australia. TTANGO is measuring the impact of STI point-of-care testing on time to treatment and repeat infections, as well as its acceptability to clinicians and their patients. Participating health services were randomly assigned to either point-of-care or routine laboratory testing for CT and NG for one year before crossing to the opposite modality for another year. Nurses and Aboriginal Health Practitioners/Workers received on-site theory and hands on training of 2–3 hours duration, covering STI epidemiology, clinical management, and use of the GeneXpert and quality management practices. TTANGO Coordinators provided ongoing support via telephone, email and remote login access, with periodic visits (five over two years) offering face to face support and the opportunity to discuss STI testing data as a means of continuous quality improvement.[3]
Sampling and participants
Interviews were open to all staff in participating health services that were trained and had approximately one year’s experience with GeneXpert testing. However, participation was influenced by clinic workload and other commitments on the day of data collection, and by the fly-in-fly-out nature of staffing (some staff were on leave at the time of data collection). Staff willing but unable to take part in a face to face interview were invited to participate in a telephone interview (resulting in three telephone interviews and 13 face to face). Recruitment of interview participants continued until the data were saturated and no new themes emerged.[28]
Interviews
An interview guide was developed to explore staff experiences using the GeneXpert point-of-care test. Informed by a review of the literature, the guide included questions about a range of factors recognised to influence acceptability of point-of-care testing. The guide covered: the extent of participants’ involvement with GeneXpert testing; views on specimen collection, preparation, the testing process and accuracy of the test; the impact of point-of-care testing on traditional STI management practices and client flow; any particular ‘likes’ and ‘dislikes’ about the point-of-care device or the process/procedure; and associated attitudes about point-of-care testing. In addition, participants were asked if they could share any positive or negative anecdotes about testing patients. Interviews were conducted by the first author (who was also the project coordinator) and took 30–45 minutes.
Data management and analysis
Interviews were digitally-recorded and transcribed verbatim. Transcripts were checked for accuracy against the recordings and to ensure familiarisation prior to analysis. Transcripts were uploaded into QSR Nvivo (Version 10), a qualitative data management and analysis program (QRS International PTY Ltd, Melbourne, Australia). Each transcript was systematically coded by the first author, who performed content analysis to examine frequencies of recurring codes and allocate salient themes.[29]
Results
Participants
A total of 16 participants were interviewed. The majority of participants were registered or enrolled nurses (75%), 56% were female, 37% identified as Aboriginal and the average age was 44 years (range 28–59 years). Most had performed ≤50 GeneXpert tests. (Table 1)
Table 1. Participant characteristics.
Participant variable | n (%) |
---|---|
Australian jurisdiction where employed | |
Queensland | 2 (12.5%) |
Western Australia | 11 (68.7%) |
South Australia | 3 (18.8%) |
Professional category | |
Registered or enrolled nurse | 12 (75.0%) |
Aboriginal health worker/practitioner | 4 (25.0%) |
Age range (years) | |
26–35 | 3 (18.8%) |
36–45 | 6 (37.5%) |
46+ | 7 (43.8%) |
Sex | |
Male | 7 (43.8%) |
Female | 9 (56.2%) |
Aboriginal or Torres Strait Islander | |
Yes | 6 (37.5%) |
No | 10 (62.5%) |
Duration working in remote sector (years) | |
1–5 | 7 (43.8%) |
6–10 | 2 (12.5%) |
>10 | 7 (43.8%) |
Approximate number of GeneXpert tests performed since trial started | |
≤50 | 10 (62.5%) |
>50 | 6 (37.5%) |
Overview of themes
The data revealed a number of themes influencing the acceptability of the GeneXpert test including ‘Attitudes’, ‘Usefulness/utility’, ‘Ease of use’ and ‘Mediating factors: barriers and enablers’ (Fig 1).
Adapted with permission. Original Copyright 1989 INFORMS. Fred D. Davis, Richard P. Bagozzi, Paul R. Warshaw (1989) User Acceptance of Computer Technology: A Comparison of Two Theoretical Models. Management Science 35(8):982–1003, the Institute for Operations Research and the Management Sciences, 5521 Research Park Drive, Suite 200, Catonsville, Maryland 21228, USA.
Presenting the findings in this way represents an adaptation of the Technology Acceptance Model (TAM), which has previously been used to conceptualise technology acceptance. The model evolved from the information technology sector, but has also been applied in the area of health care.[30–32]
Attitudes
Staff empowerment
Having access to a point-of-care device empowered staff, as they felt they were responsible for new technology which could improve the health of people in the community. This was particularly true for Aboriginal Health Practitioners/Workers.
Getting my hands on that and knowing how to use that machine… I felt responsible yeah, made me feel a … part of it more … Like I’m not just a Aboriginal Health Worker, I was … helping and benefiting their health … [I]t’s exciting, and that’s what I tell a lot of the clients you know … I do feel like a scientist at times yeah … Makes you feel smart! (Participant #9).
Job satisfaction
Given the delays associated with receiving results from laboratories in remote communities, and the challenges in locating clients for treatment when positive results are returned, participants commonly reported high levels of satisfaction with being able to test and treat on the same day.
It most definitely had a big impact on my job … just the efficiency of testing someone there and then, treating them there and then … just cuts the [work] down a hell of a lot (Participant #8).
Several also reported satisfaction from being able to alleviate client suffering and take a more proactive role in preventing transmission through prompt identification and treatment of existing cases.
[W]e can interrupt that transmission of a positive case much more quickly … [I]n the past we had to wait three or four days and that person … can … see three or four other people within that three or four days before the test comes back (Participant #8).
Increased awareness of STIs
Approximately half of the participants commented that the presence of the point-of-care device led to heightened awareness of STIs and testing, but were unsure if this would be sustained.
It’s definitely made me think about STIs more. And because it’s been here for a year now, I’ve got more into the routine of doing a bit more of that, so I’ll probably still be doing more, but I think it will drop off—probably the amount of tests we’re doing overall anyway (Participant #6).
Some participants felt that having the GeneXpert in place also raised awareness of STIs among community members. However views about this were mixed.
There’s other people that have brought … their cousins … in because they’ve heard of the machine… and we still explain to them, you know, give them the whole education on the condoms and everything … not to go crazy just because we’ve got a machine that can pick it up in 90 minutes for ya [laughing] (Participant #7).
[E]ven though we’ve said just about every time that ‘we can test you on this machine and it will only take an hour and a half’, I don’t know if it’s actually got out there in the community. Because sexual health is already taboo … The machine isn’t known in the community, because people just don’t talk about this stuff (Participant #1).
Enables more comprehensive care
Some staff commented on how the point-of-care test approach (and the 90 minute wait for results) created the space for broader health education and also gave an opportunity to invite clients to take part in a complete adult health check [an Australian government initiative that targets Aboriginal people, 15–54 years, to facilitate early detection, diagnosis and management of common, treatable conditions].
[W]e had that 90 minutes to keep them around, so you’d use that opportunity to not just talk about sexual health but all kinds of health issues (Participant #5).
I can say … ‘You need an STI check, you want that today, it’s going to take an hour and a half for the result, you know what? … why don’t we knock out this ‘715’ … health check?’ And it gives that opportunity, and honestly like 70% of the time people will say ‘Oh well I’m gonna wait so let’s do that’ … and this gives us the opportunity to ask (Participant #1).
Perceived usefulness
Reducing loss to follow up
Many of the participants spoke of the significant population mobility in remote communities, and how delays associated with traditional laboratory testing meant that clients with positive results could not always be located for treatment. Participants felt that the point-of-care approach overcame this challenge.
[I]f you can test and treat on the same day … it’s so much easier, cos [because] the population is so mobile … and between … football and funerals … and then there’s just the general moving between communities because of family. And you know people go off to shopping in Alice [Springs] or wherever, so generally if they’re in town on the day that you test they’re gonna be in town to treat them that day, but by the next day not necessarily (Participant #12).
Reducing recall efforts
Delays in result turn-around associated with routine laboratory testing mean that clients with positive results need to be recalled to the clinic for treatment. Recall processes vary but are inevitably time consuming. Point-of-care testing virtually eliminates the need for client recall associated with routine laboratory testing, where clients are followed up days/weeks after specimen collection when laboratory results become available.
It’s so hard and so time consuming to chase someone up that wants to be found, let alone doesn’t want to be found … [Y]ou need to go and pick them up … bring them in … bring them back home…[T]he amount of work and time that goes into picking up and bringing a patient in to [name of service removed] is extraordinary … So to have … a patient being treated in an hour and a half, cuts out 1000’s and 1000’s of dollars, I’m not kidding you, of manpower (Participant #1).
Reducing time to treatment
For many participants, one of the overriding advantages of point-of-care testing was reducing the time between specimen collection and treatment provision. This was seen as particularly important in the context of high client mobility in many remote communities.
[T]he woman was just about to jump in a car to go a funeral in another community, and she said ‘Yep, I’ll come with you straight away’ … we went to the clinic, I treated her, we had a chat, I didn’t even have a chance to take the bloods because they were knocking on the door ready to go to the funeral. Now had we not had that turn around in result, that woman would have been gone from our community for perhaps up to a week … until she got back to us she wouldn’t have got treated (Participant #12).
Several participants highlighted the additional benefit of reducing the time to treatment for pregnant women, whose pregnancies might otherwise be at risk of the complications of STIs.
Avoiding unnecessary treatment
One participant shared the story of a symptomatic client where the clinician chose to deviate from recommended guidelines and wait for the point-of-care result rather than treat on the basis of symptoms. The point-of-care result was negative, and subsequently the client was treated for a urinary tract infection rather than an STI.
I had a lady that came who was concerned that she had an STI and tested her and came back negative and so we treated her for a urine infection rather than a STI which is really good (Participant #10).
Expediting contact tracing
Some participants commented that the point-of-care approach enabled the partner notification process to commence more quickly.
[A] guy came in and he got the test … tested positive, that was sort of in the morning, by the afternoon we had that same client’s partner back in the clinic here … we had them both treated (Participant #8).
Test limitations
Some of the participants commented it was disappointing that POC testing for trichomonas was not available, as it is highly prevalent in many remote communities. Several also noted that routine reference laboratory test reports often include antibiotic sensitivities, and that this information is not available via the point-of-care device (at this time) and would not be available if samples were no longer sent to the laboratory.
[I]t would also be good if it had trich [trichomonas] … that’s another thing, it doesn’t determine whether its amoxicillin resistant or not (Participant #14).
Perceived ease of use
Sample collection
Respondents liked the fact that the point-of-care device could process both urine and swab specimens (the specimen type collected varied by site according to local guidelines). One participant (from a health service where urine rather than swab specimens are routinely collected from women) indicated that clients found the collection process less invasive and more acceptable than that associated with swabs.
I just found the urine was less invasive, people were more compliant, people were more willing to do a urine specimen than do a swab … so I just used the urine (Participant #5).
Sample preparation
Many participants reported that it was easier to prepare a urine sample than a swab sample, although this tended to change over time with increasing experience.
Perhaps the urines were easier, a little less fiddly maybe, but I did so many swabs that it didn’t make any difference to me … It was easy, I think it took a few goes to get it correct, but then it was like you just ‘had it’ (Participant #12).
Participants had mixed views on using the disposable pipette, which was central to sample preparation. Some found it intuitive, but those who didn’t commonly modified practice to use a 1mL syringe rather that the pipette provided with the test kit.
It didn’t bother me- we’re pipette people anyway. We have to use pipettes for βHCGs, I use sterile pipettes when I do a UA [urinalysis] so it made no diff [difference] to me (Participant #15).
I didn’t use the pipette, I found it difficult, so I just used the 1mL syringe which I found easier to hold, easier to draw it up and more accurate (Participant #5).
A few participants commented that operators need to be very disciplined with aseptic technique during the sample preparation process, and that this could be time consuming.
Operation of point-of-care device
Most participants found the GeneXpert easy to use and reliable.
I’m not the most computer literate [laughing] … There were only a couple of screens you had to go to, the machine opened every time, you know ‘start the test’, look for the result- bang. It was simple, I don’t think you could make it much more simple, very user friendly (Participant #12).
However, several reported challenges in initially understanding which information was required to be entered in each field on the ‘start a test’ template on the computer- in particular the sample ID field. Some found the data entry process time consuming and suggested that this would be greatly simplified if the machine was linked to the patient management system and these data fields could self-populate.
Yeah, I wasn’t very happy with that, I found that quite difficult sometimes, and the confusion with, it had [a] UR number and then another number… I just felt it was ‘busy’ or confusing sometimes, I’m not a great computer person (Participant #15).
[T]he identification of the patient and the rest of the data that you’re supposed to [enter]–it’s more convenient if it’s in the computer already (Participant #11).
Several commented about the noise (beep and whirr) of the machine; this was raised more often by staff whose office space was co-located in a clinic/procedure room. Others also expressed frustration with the need to upgrade software periodically- which happened in the early stages of the CT/NG assay release.
Reading results
Participants liked the fact that there was no element of subjectivity in interpreting test results, which are displayed as either ‘detected’ or ‘not detected’ and with result text highlighted in corresponding red or green.
[It’s] pretty clear. Seeing the green and the red light there (Participant #11).
Time taken
Most participants indicated that the time required to perform and generate a test result was acceptable, given the many benefits of testing at the point-of-care.
[I]t was a pretty simple process, … it was ‘do the test, get the result, … make sure the paperwork’s done and that’, I mean honestly it was hardly any extra work … it just depends on your point of view … I thought it was an advantage to us and I didn’t think it was much extra work (Participant #12).
Connectivity
Several participants commented that the process of documentation (transcribing test results from the GeneXpert into patient notes) was time consuming. This seemed to be exacerbated if the point-of-care device and the computer being used to access patient files were located in a different room.
Modulating factors: barriers and enablers
Confidence in test
Participants generally expressed high levels of confidence in point-of-care test results and were happy to treat patients on this basis.
Yeah 100% confident, because even though we were doing the TTANGO test [trial], we still had to send our specimens to pathology and they were 100% spot on (Participant #3).
[T]he test results seemed to be pretty much completely accurate with what we got back from pathology… I was pretty confident … I think there were only one or two discrepancies… but if there was a positive result for chlamydia or gono I felt that I could treat it quite easily (Participant #6).
However, a few participants expressed concern about the potential for false positive results, based on a perceived risk of cross contamination from surrounding surfaces and circulating dust during sample preparation.
[B]ecause of the sensitivity of it and the way you can cross contaminate the specimens very easily … because there’s a lot of dust in the clinics … It’s very easy to contaminate your specimens, if you’re not diligent (Participant #14).
Confidence in the test appeared to be influenced by the frequency of experience with invalid results and perceived concerns (unfounded) related to the impact of power failures on the machine.
I was more confident in the urine results … I had a lot more … invalid results with the swabs, and I don’t know why … they watched my technique and there was nothing wrong with my technique (Participant #15).
[W]as the machine properly calibrated at all times … and if there was any like power failures or anything like that in the time that we were using it… because we’ve had a lot of interruptions with power, through like power works in the area and plus storms and cyclones and switching the machines off … making sure its re-programmed up properly (Participant #4).
Impact on workflow
At many health services, clients often left the clinic after the consultation while waiting for the results of the point-of-care test, with staff arranging to call them later in the day with results. At some health services clients were still in the clinic at the time results became available. Either way participants generally reported that the point-of-care testing was minimally disruptive. The exception to this was feedback from staff in very busy/understaffed services, who felt that the point-of-care approach created ‘another thing’ to remember and track in an already busy environment.
Acceptability to clients
When reflecting on their clients’ experience of point-of-care testing, more than half of the participants reported a high degree of acceptability. Participants thought that their clients were generally pleased to receive their test results more quickly.
[I]f it comes back negative then it’s peace of mind for them, but if it comes back positive they know they’re going to get treated straight away, I think either way it’s a positive … but from what I’ve seen people are really happy to get a faster result and get treated faster- or not, if it’s a negative (Participant #3).
Organisational support
Organisational and management support of staff involved in point-of-care testing and STI work in general may have influenced acceptability for some participants.
I had a big break away from the machine because I had time away and I got moved around in positions … and … all of a sudden it was all behind. If someone’s not driving it, um, tests slow down, people forget … Someone should drive it in house… I mean someone who does STIs full time … but unfortunately the STI coordinator here … doesn’t even have a day, one day any more to take care of STIs … That’s not cool, you need someone (Participant #1).
Managing results in shorter time frame
Participants were asked whether they felt that managing STI test results in a shorter time frame was more challenging for them. Responses were mixed. Some commented that the immediacy of the result made the testing experience more confronting for them and their clients.
You get a test that’s positive and usually it’s the partner finding out that the other partner must be doing the sly on them because they’ve got an STI and they haven’t been with anyone for years except for their partner … [W]ithin an hour and a half its [the result] very fresh … [I]t does start sooner which opens up a whole other field … because when you’ve got a person sitting there and they find out they’ve got an STI, particularly if they’re in a long term relationship … sometimes I really worry about the next couple of days of you know the partner coming in [having been] beat up or, which happens a lot here (Participant #1).
Other participants felt that it made it easier to discuss the result with the client, at a time when the testing was fresh in their mind. Respondents also indicated that actioning results is simpler in a shorter time frame, as patients can often be found more easily, treatment can be provided and the episode of care completed on the day of testing.
Materials and waste
One participant, admittedly from a very small clinic, remarked about the space and storage (air conditioned) requirements for test kits.
[S]torage was a bit of an issue at the start … because we had to figure out where they were going to be refrigerated and all that (Participant #13).
This same participant was worried about the environmental impact of testing, commenting on the numerous layers of packaging that surrounds the specimen collection kits. This participant also mentioned the yellow infectious waste bins that are required to enable safe disposal of used test cartridges (which must be destroyed in an enclosed incinerator). These bins then need to be trucked with other infectious waste to a suitable disposal facility.
Monthly quality control (QC) and quality assurance (QA) testing
The need for staff to perform quality control testing once per month and to test a panel of four external quality assurance swabs twice per year was seen by some as an important task to ensure the point-of-care test was performing well, rather than a burden. However some admitted to forgetting to do QC testing every month.
That’s always brilliant because it’s good to know that the machine is actually working and giving like correct results … Makes it feel like you know a little bit better … that it is reading ok …We probably could have done more, but … you get side tracked (Participant #10).
Monthly maintenance
Very few participants commented on the small amount of monthly module maintenance (approximately 10 minutes of work). Where comment was made this did not appear to raise concern.
That was easy, that was fine, it doesn’t take long, you just have to clean those rod things (Participant #6).
Discussion
Our findings indicate a high level of acceptability of the GeneXpert CT/NG among health professionals working in remote primary care in Australia where there is a high burden of STIs and significant distances from laboratories.
Most staff displayed positive attitudes towards the point-of-care device, and indicated that it was both easy to use and useful in their clinical context. They indicated that point-of-care testing had improved STI management, resulting in more timely and more targeted treatment, earlier commencement of partner notification, and reduced follow up efforts associated with client recall. Staff expressed confidence in point-of-care test results and treating patients on this basis, and reported greater job satisfaction—feeling more in control of STI testing and patient health, particularly Aboriginal staff. While point-of-care testing did not negatively impact on client flow, several found the required manual documentation processes time consuming, and felt that improved connectivity and automatic transfer of results between the GeneXpert and the patient management system could facilitate better workflow. Managing positive test results in a shorter time frame was challenging for some but most participants found it more satisfying being able to complete the episode of care on the same day.
The GeneXpert has largely been used in hospital settings for TB testing and more recently for other purposes,[33] [34,35]and deployed for TB testing in primary and remote health care settings.[36] While there is an increasing body of literature on test performance and clinical impact related to these applications, there are few studies that refer to acceptability [33,37] and none to our knowledge that formally use qualitative methods to explore acceptability or that were conducted in primary care settings. Goldenberg and colleagues explored acceptability and ease of use (using a short questionnaire) of GeneXpert testing for Clostridium Difficile in a hospital setting; most staff found the device easy to use, perceived point-of-care testing to be an acceptable part of their role, liked being able to perform testing themselves, agreed that results were available more quickly than the laboratory based test and that rapid result turn- around facilitated better management of patient beds.[33] The interview findings described here broadly align with those described by Goldenberg and colleagues, however due to the qualitative nature of our interviews, we provide more information about the reasons for high acceptability and the various factors that impact on this. Our findings also demonstrate for the first time that this technology is acceptable to staff working in small, remote health services, and that staff acceptability should be an enabler to implementation and uptake in this sector. Our findings are also consistent with the Technology Acceptance Model [30–32] and provide a case study of its application to new technology in remote primary health care settings.
Our data identified three strong acceptability themes. Consistent with other studies participants generally reported that the point-of-care test system was user-friendly, reliable, and resulted in benefits for them (reducing recall efforts) and for their patients (reducing time to treatment and reducing unnecessary treatment) without disrupting workflow.[10–15] When the study commenced, some stakeholders raised concerns about the 90-minute wait for results, identified as an important determinant of staff acceptability in previous research, with 20–30 minutes considered by frontline health professionals as acceptable for an STI test.[12,14,15] However the 90-minute wait was not raised as an issue by our participants, possibly because most clients opted to leave the clinic and return in the event of a positive result, so staff workflow was not negatively impacted. Participants may also have felt that this timeframe was acceptable and highly favourable when compared to the time taken to receive routine laboratory results in most remote settings.
Our finding of high acceptability and, in particular, benefits to staff and patients, needs to be interpreted in the context of sexual health care service delivery in remote Aboriginal communities. In most urban sexual health services, patients are sent their results by text message in a few days. However in remote Aboriginal communities, Aboriginal health practitioners/workers and nurses, who are often responsible for locating patients, are part of and known to the community, so they need to be careful and sensitive about how they seek out individuals, which in turn means recall can be very time consuming. Also mobility is high in remote Aboriginal communities, due to personal, family or cultural reasons, and additional efforts may be needed to locate patients, including contacting other health services to see if they can assist.[38] These processes in remote Aboriginal communities are similar to systems in countries in the Asia-Pacific region where village health workers or volunteers are tasked with locating community members for a range of health promotion interventions.[39,40]
There were also some minor points of dissatisfaction raised by staff interviewed. The lack of automated data flow between the GeneXpert and the patient management system and other concerns relating to connectivity will be addressed before wider implementation of the GeneXpert system in Australia. In addition, it will be important to work with implementing staff to ensure greater clarity around patient and sample identifiers used in the GeneXpert device; this issue could readily be resolved by modifying the software data fields and including additional resource material on this subject in future training materials.
A few staff had concerns about the risk of cross contamination between samples, however the closed cartridge system and the very low occurrence of discrepant results (specimens tested on the GeneXpert were also tested at reference laboratories for monitoring purposes during TTANGO) suggest that this is unlikely; it is possible that during training we over-emphasised the need to take care with specimen processing to reduce any risk of false positive results, but similarly, the attention to detail in training may be part of the reason that cross contamination of samples has not been an issue.
One participant noted that the GeneXpert CT/NG test result does not report on NG antibiotic sensitivity, which is otherwise conducted by Australian laboratories using cultured isolates (with one laboratory also using molecular methods to test for penicillinase producing N. gonorrhoea on all positive NG tests).[41] This issue has been raised by stakeholders in previous research [42] and it is critical that in the future point-of-care NG test processes support specimens to be available for NG antimicrobial resistance surveillance.
While our findings suggest that ideally one or two staff members should be allocated responsibility to ‘drive’ point-of-care testing within a service, this may be difficult to sustain given the realities of turnover of staffing in this context of remote Australia. Working in remote primary care is recognised to be extraordinarily challenging.[43,44] Staff face competing demands, with chronic under-staffing and over-reliance on temporary staff to fill essential positions. Those in permanent positions or on longer term contracts are often required to back fill critical roles. High level organisational and management support is therefore critical if point-of-care testing for CT/NG is to be successfully integrated into this sector. It is, however, particularly encouraging that there was a high level of acceptability among Aboriginal health practitioners/workers. These staff are often the most stable members of the remote health workforce, but may perceive themselves to be low in the health workforce hierarchy and have a limited scope of practice. Findings suggested that having a role in GeneXpert testing empowered staff, giving them added responsibility for something very important, that could help improve the health of their community.
This is the first study to explore acceptability of the GeneXpert CT/NG in remote primary care in Australia or elsewhere. The main strength of this study is that we used qualitative methods, which are well suited to open-ended enquiry or exploratory research where little is known about the issue under study. Our study also has several limitations. The small sample size and non-random nature of the sampling strategy limit the generalisability of the results, however we did interview key staff involved in GeneXpert testing in seven of the 12 services. The interviewer was not completely independent of trial implementation; however there is no reason to believe that her relationship to the project affected responses. At this stage we are unable to comment in detail on whether there were acceptability issues beyond the users themselves.
Conclusions
Use of the GeneXpert in primary care services is a substantial change to clinical practice. In the context of a RCT, health professionals working in remote primary care in Australia found the GeneXpert CT/NG highly acceptable. These findings have implications for use in other primary care settings around the world. The next phase will involve a long-term program of GeneXpert CT/NG testing and an evaluation of sustainability.
Acknowledgments
TTANGO is funded by a National Health and Medical Research Council (NHMRC) Project Grant #109902. The Kirby Institute receives funding from the Australian Government Department of Health and Ageing. We gratefully acknowledge the contribution to this work of the Victorian Operational Infrastructure Support Program received by the Burnet Institute.
TTANGO is a collaboration between researchers named in the authorship list, additional TTANGO investigators not named as authors (Basil Donovan, David Wilson, David Regan, Handan Wand from the Kirby Institute; David Whiley, The Queensland Paediatric Infectious Diseases Laboratory; Sepehr N. Tabrizi, The Royal Women’s Hospital; Christopher Fairley, Monash University) and the Queensland Aboriginal and Islander Health Council; Queensland Health; Aboriginal Health Council of Western Australia; West Australia Department of Health; West Australian Country Health Service; Aboriginal Health Council of South Australia; South Australia Health; National Reference Laboratory; and Medical Communication Associates. We are grateful to Cepheid for their generous in-kind support.
The study would not have been possible without the commitment of all participating health services and their staff and the ongoing support and advice from our partners. The authors acknowledge the important contributions of the TTANGO Reference Group. The authors are grateful to Western Diagnostic Pathology, WA; Pathwest Laboratory Medicine WA; Clinipath Pathology, WA; Queensland Health Pathology and Scientific Services; Sullivan Nicolaides Pathology, QLD; and SA Pathology; and their staff that undertook testing for STIs on behalf of participating health services, and provided the anonymous line record data for the trial.
Data Availability
Data cannot be made publicly available as study participants consented to interviews with the understanding that their data would remain anonymous and confidential. Study data are available upon request via the Sexual Health Program co-ordinator at the Kirby Institute (http://www.kirby.unsw.edu.au/research-program/sexual-health-program/about-program). Requests may be sent to: jcostello@kirby.unsw.edu.au.
Funding Statement
TTANGO is funded by a National Health and Medical Research Council (NHMRC) Project Grant #109902. The Kirby Institute receives funding from the Australian Government Department of Health and Ageing. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1. Tabrizi SN, Unemo M, Golparian D, Twin J, Limnios AE, Lahra M, et al. (2013) Analytical evaluation of GeneXpert CT/NG, the first genetic point-of-care assay for simultaneous detection of Neisseria gonorrhoeae and Chlamydia trachomatis. J Clin Microbiol 51: 1945–1947. 10.1128/JCM.00806-13 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Causer LM, Hengel B, Natoli L, Tangey A, Badman S, Tabrizi SN, et al. (2013) Field evaluation of three point-of-care tests for chlamydia and gonorrhoea in remote health services in Australia STI and AIDS World Congress. Vienna. [DOI] [PubMed] [Google Scholar]
- 3. Guy RJ, Natoli L, Ward J, Causer L, Hengel B, Whiley D, et al. (2013) A randomised trial of point-of-care tests for chlamydia and gonorrhoea infections in remote Aboriginal communities: Test, Treat ANd GO- the "TTANGO" trial protocol. BMC Infect Dis 13: 485 10.1186/1471-2334-13-485 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Drobniewski F, Cooke M, Jordan J, Casali N, Mugwagwa T, Broad A, et al. (2015) Systematic review, meta-analysis and economic modelling of molecular diagnostic tests for antibiotic resistance in tuberculosis. Health Technol Assess 19: 1–188, vii-viii. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Peeling RW (2011) Applying new technologies for diagnosing sexually transmitted infections in resource-poor settings. Sex Transm Infect 87 Suppl 2: ii28–30. 10.1136/sti.2010.047647 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Peeling RW, Mabey D, Ballard RC (2013) Introducing new diagnostics into STI control programmes: the importance of programme science. Sex Transm Infect 89: 115–119 10.1136/sextrans-2012-050617 [DOI] [PubMed] [Google Scholar]
- 7. Pai NP, Vadnais C, Denkinger C, Engel N, Pai M (2012) Point-of-care testing for infectious diseases: diversity, complexity, and barriers in low- and middle-income countries. PLoS Med 9: e1001306 10.1371/journal.pmed.1001306 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Engel N, Davids M, Blankvoort N, Pai NP, Dheda K, Pai M (2015) Compounding diagnostic delays: a qualitative study of point-of-care testing in South Africa. Trop Med Int Health 20: 493–500. 10.1111/tmi.12450 [DOI] [PubMed] [Google Scholar]
- 9. Engel N, Pant Pai N (2015) Qualitative research on point-of-care testing strategies and programs for HIV. Expert Rev Mol Diagn 15: 71–75. 10.1586/14737159.2015.960518 [DOI] [PubMed] [Google Scholar]
- 10. Shephard MD (2006) Cultural and clinical effectiveness of the 'QAAMS' point-of-care testing model for diabetes management in Australian aboriginal medical services. Clin Biochem Rev 27: 161–170. [PMC free article] [PubMed] [Google Scholar]
- 11. Benzaken AS, Galban EG, Antunes W, Dutra JC, Peeling RW, Mabey D, et al. (2006) Diagnosis of gonococcal infection in high risk women using a rapid test. Sex Transm Infect 82 Suppl 5: v26–28. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12. Hsieh YH, Hogan MT, Barnes M, Jett-Goheen M, Huppert J, Rompalo AM, et al. (2010) Perceptions of an ideal point-of-care test for sexually transmitted infections—a qualitative study of focus group discussions with medical providers. PLoS One 5: e14144 10.1371/journal.pone.0014144 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13. Benzaken AS, Sabido M, Galban EG, Pedroza V, Vasquez F, Araujo A, et al. (2008) Field evaluation of the performance and testing costs of a rapid point-of-care test for syphilis in a red-light district of Manaus, Brazil. Sex Transm Infect 84: 297–302. [DOI] [PubMed] [Google Scholar]
- 14. Hsieh YH, Gaydos CA, Hogan MT, Uy OM, Jackman J, Jett-Goheen M, et al. (2011) What qualities are most important to making a point of care test desirable for clinicians and others offering sexually transmitted infection testing? PLoS One 6: e19263 10.1371/journal.pone.0019263 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Hsieh YH, Gaydos CA, Hogan MT, Jackman J, Jett-Goheen M, Uy OM, et al. (2012) Perceptions on Point-of-Care Tests for Sexually Transmitted Infections—Comparison between Frontline Clinicians and Professionals in Industry. Point Care 11: 126–129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Guy R, Ward J, Wand H, Rumbold A, Garton L, Hengel B, et al. (2015) Coinfection with Chlamydia trachomatis, Neisseria gonorrhoeae and Trichomonas vaginalis: a cross-sectional analysis of positivity and risk factors in remote Australian Aboriginal communities. Sex Transm Infect 91: 201–206. 10.1136/sextrans-2014-051535 [DOI] [PubMed] [Google Scholar]
- 17. Centre for Disease Control (2008) NT Guidelines for the Management of Sexually Transmitted Infections in the Primary Health Care Setting. Darwin: Northern Territory Government Department of Health and Families; [Google Scholar]
- 18. Communicable Disease Control Directorate (2006) Guidelines for Managing Sexually Transmitted Infections. Perth: Department of Health, Western Australia. [Google Scholar]
- 19. Fagan P (2001) Sexual health service provision in remote Aboriginal and Torres Strait Islander settings in far north Queensland: sexual health symptoms and some outcomes of partner notification. Venereology, 2001;14(2):55–61 14: 55–61. [Google Scholar]
- 20. Detels R, Green AM, Klausner JD, Katzenstein D, Gaydos C, Handsfield H, et al. (2011) The incidence and correlates of symptomatic and asymptomatic Chlamydia trachomatis and Neisseria gonorrhoeae infections in selected populations in five countries. Sex Transm Dis 38: 503–509. [PMC free article] [PubMed] [Google Scholar]
- 21. Hengel B, Jamil MS, Mein JK, Maher L, Kaldor JM, Guy RJ (2013) Outreach for chlamydia and gonorrhoea screening: a systematic review of strategies and outcomes. BMC Public Health 13: 1040 10.1186/1471-2458-13-1040 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Huang RL, Torzillo PJ, Hammond VA, Coulter ST, Kirby AC (2008) Epidemiology of sexually transmitted infections on the Anangu Pitjantjatjara Yankunytjatjara Lands: results of a comprehensive control program. Med J Aust 189: 442–445. [DOI] [PubMed] [Google Scholar]
- 23. Farley TA, Cohen DA, Elkins W (2003) Asymptomatic sexually transmitted diseases: the case for screening Preventive Medicine 36: 502–509. [DOI] [PubMed] [Google Scholar]
- 24. Cecil JA, Howell MR, Tawes JJ, Gaydos JC, McKee KT Jr, Quinn TC, et al. (2001) Features of Chlamydia trachomatis and Neisseria gonorrhoeae infection in male Army recruits. J Infect Dis 184: 1216–1219. [DOI] [PubMed] [Google Scholar]
- 25. Korenromp EL, Sudaryo MK, de Vlas SJ, Gray RH, Sewankambo NK, Serwadda D, et al. (2002) What proportion of episodes of gonorrhoea and chlamydia becomes symptomatic? Int J STD AIDS 13: 91–101. [DOI] [PubMed] [Google Scholar]
- 26. Shephard M SB, Motta L, Shephard A, (2014) Chapter 48. Point-of-care testing in Australia: Practical advantages and benefits of community resiliency for improving outcomes In: KGaC C, editor. Global Point-of-Care—Strategies for Disasters, Complex Emergencies, and Public Health Resilience. Washington DC: AACC (American Association of Clinical Chemistry) Press; pp. pp 527–535. [Google Scholar]
- 27. Guy R, Ward JS, Smith KS, Su JY, Huang RL, Tangey A, et al. (2012) The impact of sexually transmissible infection programs in remote Aboriginal communities in Australia: a systematic review. Sex Health 9: 205–212. 10.1071/SH11074 [DOI] [PubMed] [Google Scholar]
- 28. Gibbs L, Kealy M, Willis K, Green J, Welch N, Daly J (2007) What have sampling and data collection got to do with good qualitative research? Aust N Z J Public Health 31: 540–544. [DOI] [PubMed] [Google Scholar]
- 29. Pope C, Ziebland S, Mays N (2000) Qualitative research in health care. Analysing qualitative data. British Medical Journal 320: 114–116. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Holden RJ, Karsh BT (2010) The technology acceptance model: its past and its future in health care. J Biomed Inform 43: 159–172. 10.1016/j.jbi.2009.07.002 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Yarbrough AK, Smith TB (2007) Technology acceptance among physicians: a new take on TAM. Med Care Res Rev 64: 650–672. [DOI] [PubMed] [Google Scholar]
- 32. Alakärppä I, Valtonen A (2011) Practice-based Perspective on Technology Acceptance: Analyzing Bioactive Point of Care Testing. International Journal of Marketing Studies 3: 13–29. [Google Scholar]
- 33. Goldenberg SD, Bisnauthsing KN, Patel A, Postulka A, Wyncoll D, Schiff R, et al. (2014) Point-of-Care Testing for Clostridium Difficile Infection: A Real-World Feasibility Study of a Rapid Molecular Test in Two Hospital Settings. Infect Dis Ther. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34. Al-Humaidan OS, El-Kersh TA, Al-Akeel RA (2015) Risk factors of nasal carriage of Staphylococcus aureus and methicillin-resistant Staphylococcus aureus among health care staff in a teaching hospital in central Saudi Arabia. Saudi Med J 36: 1084–1090. 10.15537/smj.2015.9.12460 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Chikkodi SV, Malhotra P, Naseem S, Khadwal A, Prakash G, Sahu KK, et al. (2015) Factors Affecting Early Molecular Response in Chronic Myeloid Leukemia. Clin Lymphoma Myeloma Leuk 15 Suppl: S114–119. 10.1016/j.clml.2015.03.014 [DOI] [PubMed] [Google Scholar]
- 36. Lebina L, Abraham PM, Motlhaoleng K, Rakgokong M, Variava E, Martinson NA (2015) The use of decentralized GeneXpert by trained non-laboratory technicians in rural clinics in South Africa. Tuberculosis (Edinb) 95: 625–626. [DOI] [PubMed] [Google Scholar]
- 37. Causer LM, Hengel B, Natoli L, Tangey A, Badman SG, Tabrizi SN et al. (2014) A field evaluation of a new molecular-based point-of-care test for chlamydia and gonorrhoea in remote Aboriginal health services in Australia. Sex Health. [DOI] [PubMed] [Google Scholar]
- 38. Hengel B, Maher L, Garton L, Ward J, Rumbold A, Taylor-Thomson D, et al. (2015) Reasons for delays in treatment of bacterial sexually transmissible infections in remote Aboriginal communities in Australia: a qualitative study of healthcentre staff. Sex Health. [DOI] [PubMed] [Google Scholar]
- 39. Natoli LJ, Wambo G, Gabong R, Kavang E, Luana S, Sawa A, et al. (2011) 'Stret tokers'—taking sexual health promotion to the village level in East New Britain Province, Papua New Guinea. P N G Med J 54: 123–131. [PubMed] [Google Scholar]
- 40. Lorent N, Choun K, Malhotra S, Koeut P, Thai S, Khun KE, et al. (2015) Challenges from Tuberculosis Diagnosis to Care in Community-Based Active Case Finding among the Urban Poor in Cambodia: A Mixed-Methods Study. PLoS One 10: e0130179 10.1371/journal.pone.0130179 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41. Speers DJ, Fisk RE, Goire N, Mak DB (2013) Non-culture Neisseria gonorrhoeae molecular penicillinase production surveillance demonstrates the long-term success of empirical dual therapy and informs gonorrhoea management guidelines in a highly endemic setting. J Antimicrob Chemother. [DOI] [PubMed] [Google Scholar]
- 42. Natoli L, Guy RJ, Shephard M, Whiley D, Tabrizi SN, Ward J, et al. (2015) Public health implications of molecular point-of-care testing for chlamydia and gonorrhoea in remote primary care services in Australia: a qualitative study. BMJ Open 5: e006922 10.1136/bmjopen-2014-006922 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Lenthall S, Wakerman J, Opie T, Dollard M, Dunn S, Knight S, et al. (2009) What stresses remote area nurses? Current knowledge and future action. Aust J Rural Health 17: 208–213. 10.1111/j.1440-1584.2009.01073.x [DOI] [PubMed] [Google Scholar]
- 44. Opie T, Dollard M, Lenthall S, Wakerman J, Dunn S, Knight S, et al. (2010) Levels of occupational stress in the remote area nursing workforce. Aust J Rural Health 18: 235–241. 10.1111/j.1440-1584.2010.01161.x [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Data cannot be made publicly available as study participants consented to interviews with the understanding that their data would remain anonymous and confidential. Study data are available upon request via the Sexual Health Program co-ordinator at the Kirby Institute (http://www.kirby.unsw.edu.au/research-program/sexual-health-program/about-program). Requests may be sent to: jcostello@kirby.unsw.edu.au.