Abstract
Background
Extent of resection is considered to be a prognostic factor in neuro‐oncology. Intraoperative imaging technologies are designed to help achieve this goal. It is not clear whether any of these sometimes very expensive tools (or their combination) should be recommended as standard care for people with brain tumours. We set out to determine if intraoperative imaging technology offers any advantage in terms of extent of resection over standard surgery and if any one technology was more effective than another.
Objectives
To establish the overall effectiveness and safety of intraoperative imaging technology in resection of glioma. To supplement this review of effects, we also wished to identify cost analyses and economic evaluations as part of a Brief Economic Commentary (BEC).
Search methods
We searched the Cochrane Central Register of Controlled Trials (CENTRAL) (Issue 7, 2017), MEDLINE (1946 to June, week 4, 2017), and Embase (1980 to 2017, week 27). We searched the reference lists of all identified studies. We handsearched two journals, the Journal of Neuro‐Oncology and Neuro‐oncology, from 1991 to 2017, including all conference abstracts. We contacted neuro‐oncologists, trial authors, and manufacturers regarding ongoing and unpublished trials.
Selection criteria
Randomised controlled trials evaluating people of all ages with presumed new or recurrent glial tumours (of any location or histology) from clinical examination and imaging (computed tomography (CT) or magnetic resonance imaging (MRI), or both). Additional imaging modalities (e.g. positron emission tomography, magnetic resonance spectroscopy) were not mandatory. Interventions included intraoperative MRI (iMRI), fluorescence‐guided surgery, ultrasound, and neuronavigation (with or without additional image processing, e.g. tractography).
Data collection and analysis
Two review authors independently assessed the search results for relevance, undertook critical appraisal according to known guidelines, and extracted data using a prespecified pro forma.
Main results
We identified four randomised controlled trials, using different intraoperative imaging technologies: iMRI (2 trials including 58 and 14 participants, respectively); fluorescence‐guided surgery with 5‐aminolevulinic acid (5‐ALA) (1 trial, 322 participants); and neuronavigation (1 trial, 45 participants). We identified one ongoing trial assessing iMRI with a planned sample size of 304 participants for which results are expected to be published around autumn 2018. We identified no trials for ultrasound.
Meta‐analysis was not appropriate due to differences in the tumours included (eloquent versus non‐eloquent locations) and variations in the image guidance tools used in the control arms (usually selective utilisation of neuronavigation). There were significant concerns regarding risk of bias in all the included studies. All studies included people with high‐grade glioma only.
Extent of resection was increased in one trial of iMRI (risk ratio (RR) of incomplete resection 0.13, 95% confidence interval (CI) 0.02 to 0.96; 1 study, 49 participants; very low‐quality evidence) and in the trial of 5‐ALA (RR of incomplete resection 0.55, 95% CI 0.42 to 0.71; 1 study, 270 participants; low‐quality evidence). The other trial assessing iMRI was stopped early after an unplanned interim analysis including 14 participants, therefore the trial provides very low‐quality evidence. The trial of neuronavigation provided insufficient data to evaluate the effects on extent of resection.
Reporting of adverse events was incomplete and suggestive of significant reporting bias (very low‐quality evidence). Overall, reported events were low in most trials. There was no clear evidence of improvement in overall survival with 5‐ALA (hazard ratio 0.83, 95% CI 0.62 to 1.07; 1 study, 270 participants; low‐quality evidence). Progression‐free survival data were not available in an appropriate format for analysis. Data for quality of life were only available for one study and suffered from significant attrition bias (very low‐quality evidence).
Authors' conclusions
Intra‐operative imaging technologies, specifically iMRI and 5‐ALA, may be of benefit in maximising extent of resection in participants with high grade glioma. However, this is based on low to very low quality evidence, and is therefore very uncertain. The short‐ and long‐term neurological effects are uncertain. Effects of image‐guided surgery on overall survival, progression‐free survival, and quality of life are unclear. A brief economic commentary found limited economic evidence for the equivocal use of iMRI compared with conventional surgery. In terms of costs, a non‐systematic review of economic studies suggested that compared with standard surgery use of image‐guided surgery has an uncertain effect on costs and that 5‐aminolevulinic acid was more costly. Further research, including studies of ultrasound‐guided surgery, is needed.
Keywords: Humans; Aminolevulinic Acid; Aminolevulinic Acid/therapeutic use; Brain; Brain/diagnostic imaging; Brain Neoplasms; Brain Neoplasms/diagnostic imaging; Brain Neoplasms/surgery; Glioma; Glioma/diagnostic imaging; Glioma/surgery; Intraoperative Care; Magnetic Resonance Imaging; Neuronavigation; Photosensitizing Agents; Photosensitizing Agents/therapeutic use; Tomography, X-Ray Computed
Plain language summary
Image‐guided surgery for brain tumours
Background Surgery has a key role in the management of many types of brain tumour. Removing as much tumour as possible is very important, as in some types of brain tumour this can help patients to live longer and to feel better. However, removing a brain tumour may in some cases be difficult because the tumour either looks like normal brain tissue or is near brain tissue that is needed for normal functioning. New methods of seeing tumours during surgery have been developed to help surgeons better identify tumour from normal brain tissue.
Question 1. Is image‐guided surgery more effective at removing brain tumours than surgery without image guidance? 2. Is one image guidance technology or tool better than another?
Study characteristics Our search strategy is up to date as of July 2017. We found four trials looking at three different types of tools to help improve the amount of tumour that is removed. The tumour being evaluated was high‐grade glioma. Imaging interventions used during surgery included:
• magnetic resonance imaging (iMRI) during surgery to assess the amount of remaining tumour; • fluorescent dye (5‐aminolevulinic acid) to mark out the tumour; or • imaging before surgery to map out the location of a tumour, which was then used at the time of surgery to guide the surgery (neuronavigation).
All the studies had compromised methods, which could mean their conclusions were biased. Other studies were funded by the manufacturers of the image guidance technology being evaluated.
Key results We found low‐ to very low‐quality evidence that use of image‐guided surgery may result in more of the tumour being removed surgically in some people. The short‐ and long‐term neurological effects are uncertain. We did not have the data to determined whether any of the evaluated technologies affect overall survival, time until disease progression, or quality of life. There was very low‐quality evidence for neuronavigation, and we identified no trials for ultrasound guidance. In terms of costs, a non‐systematic review of economic studies suggested that compared with standard surgery use of image‐guided surgery has an uncertain effect on costs and that 5‐aminolevulinic acid was more costly than conventional surgery.
Quality of the evidence Evidence for intraoperative imaging technology for use in removing brain tumours is sparse and of low to very low quality. Further research is needed to assess three main questions.
1. Is removing more of the tumour better for the patient in the long term? 2. What are the risks of causing a patient to have worse symptoms by taking out more of the tumour? 3. How does resection affect a patient's quality of life?
Summary of findings
Summary of findings 1. iMRI image‐guided surgery compared to standard surgery for high‐grade glioma.
iMRI image‐guided surgery compared to standard surgery for high‐grade glioma | ||||||
Patient or population: high‐grade glioma Settings: specialist centres Intervention: iMRI image‐guided surgery (based on post‐operative MRI) Comparison: standard surgery | ||||||
Outcomes | Illustrative comparative risk* (95% CI) | Relative effect (95% CI) | No. of participants (studies) | Quality of the evidence (GRADE) | Comments | |
Assumed risk | Corresponding risk | |||||
Control | Image‐guided surgery | |||||
Extent of resection: complete resection | 321 per 100 | 4 per 100 (1 to 31) | RR 0.13 (0.02 to 0.96) | 49 participants (1 study) | ⊕⊝⊝⊝1,2,3 verylow | Small trial of highly selected participants with potential bias in allocation and performance. One other trial reported this outcome but did not contribute towards the analysis. |
Adverse events | Inadequately and inconsistently reported in the trial | ⊕⊝⊝⊝4 verylow | Adverse events were reported in an inconsistent manner and not according to the manner prespecified in our protocol. Additionally, we were mainly interested in identifying serious adverse events, which were inadequately reported | |||
Overall survival | Not estimable | ⊕⊝⊝⊝4 verylow | Not reported by trial authors so graded as very low quality evidence | |||
Progression‐free survival | Not estimable | ⊕⊝⊝⊝4 verylow | Progression‐free survival or time to progression was not adequately reported in the trial | |||
Quality of life | Not estimable | ⊕⊝⊝⊝4 verylow | Quality of life was not reported in the trial | |||
*The basis for the assumed risk is only based on individual trials as only single trial reports were available. The corresponding risk (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval; iMRI: intraoperative magnetic resonance imaging; RR: risk ratio | ||||||
GRADE Working Group grades of evidence High quality: Further research is very unlikely to change our confidence in the estimate of effect. Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate. Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate. Very low quality: We are very uncertain about the estimate. |
1Expressed in terms of risk of incomplete resection (bad outcome). 2Small trial so quality of the evidence downgraded by one level. 3Highly selected participants with potential bias in allocation and performance as well as in other 'Risk of bias' domains, thus downgraded by two levels. 4Outcome was not reported (or inadequately reported for meaningful conclusions to be drawn), therefore giving lowest quality of evidence judgement.
Summary of findings 2. 5‐ALA image‐guided surgery compared to standard surgery for high‐grade glioma.
5‐ALA image‐guided surgery compared to standard surgery for high‐grade glioma | ||||||
Patient or population: high‐grade glioma Settings: specialist centres Intervention: 5‐ALA image‐guided surgery (based on post‐operative MRI) Comparison: standard surgery | ||||||
Outcomes | Illustrative comparative risk* (95% CI) | Relative effect (95% CI) | No. of participants (studies) | Quality of the evidence (GRADE) | Comments | |
Assumed risk | Corresponding risk | |||||
Control | Image‐guided surgery | |||||
Extent of resection: complete resection | 641 per 100 | 35 per 100 (27 to 45) | RR 0.55 (0.42 to 0.71) | 270 participants (1 study) |
⊕⊕⊝⊝2 low | Highly selected participants with potential bias in allocation and performance |
Adverse events | Inadequately and inconsistently reported in the trial | ⊕⊝⊝⊝3 verylow | Adverse events were reported in an inconsistent manner and not according to the manner prespecified in our protocol. Additionally, we were mainly interested in identifying serious adverse events, which were inadequately reported | |||
Overall survival | Not estimable due to reporting of HR and since just a single trial reported on this outcome we did not arbitrarily choose a snap shot in time in which to use as basis to calculate the assumed and corresponding risks as this may be misleading. | HR 0.82 (0.62 to 1.07) |
270 participants (1 study) |
⊕⊕⊝⊝2 low | The overall quality of this outcome was low in this trial and was downgraded for highly selected participants with potential bias in allocation and performance | |
Progression‐free survival | Not adequately reported in the trials | ⊕⊝⊝⊝3 verylow | Progression‐free survival or time to progression was not adequately reported in the trial | |||
Quality of life | Inadequately reported or not assessed at all in the included trials | ⊕⊝⊝⊝3 verylow | Quality of life was not reported in the trial | |||
*The basis for the assumed risk is only based on individual trials as only single trial reports were available. The corresponding risk (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). 5‐ALA: 5‐aminolevulinic acid; CI: confidence interval; HR: hazard ratio; RR: risk ratio | ||||||
GRADE Working Group grades of evidence High quality: Further research is very unlikely to change our confidence in the estimate of effect. Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate. Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate. Very low quality: We are very uncertain about the estimate. |
1Expressed in terms of risk of incomplete resection (bad outcome). 2Highly selected participants with potential bias in allocation and performance as well as in other 'Risk of bias' domains, thus downgraded by two levels. 3Outcome was not reported (or inadequately reported for meaningful conclusions to be drawn), therefore giving lowest quality of evidence judgement.
Summary of findings 3. Neuronavigation image‐guided surgery compared to standard surgery for high‐grade glioma.
Neuronavigation image‐guided surgery compared to standard surgery for high‐grade glioma | ||||||
Patient or population: high‐grade glioma Settings: specialist centres Intervention: neuronavigation image‐guided surgery (based on post‐operative MRI) Comparison: standard surgery | ||||||
Outcomes | Illustrative comparative risk* (95% CI) | Relative effect (95% CI) | No. of participants (studies) | Quality of the evidence (GRADE) | Comments | |
Assumed risk | Corresponding risk | |||||
Control | Image‐guided surgery | |||||
Extent of resection: complete resection | Not estimable | Not estimable | Not reported | 45 participants (1 study) | ⊕⊝⊝⊝1,2,4 verylow | Small study of highly selected participants at very high risk of allocation bias.Complete resection was achieved in three participants in the control group and five participants in the neuronavigation group. However, there was significant attrition, with not all participants completing imaging, and the denominators for these figures were not stated, precluding formal analysis |
Adverse events | Inadequately and inconsistently reported in the trial | ⊕⊝⊝⊝2 verylow | Adverse events were reported in an inconsistent manner and not according to the manner prespecified in our protocol. Additionally, we were mainly interested in identifying serious adverse events, which were inadequately reported | |||
Overall survival | Not estimable | ⊕⊝⊝⊝3 verylow | Not reported by trial authors so graded as very low quality evidence | |||
Progression‐free survival | Not estimable | ⊕⊝⊝⊝2 verylow | Progression‐free survival or time to progression was not reported in the trial | |||
Quality of life | Inadequately reported or not assessed at all in the included trials | ⊕⊝⊝⊝3 verylow | Quality of life was reported in the trial but only 19 participants (8 in the neuronavigation arm and 11 in the standard surgery arm) completed questionnaires postoperatively at 3 months', constituting only 64.5% of all eligible participants, and no statistical analysis was presented | |||
*The basis for the assumed risk is only based on individual trials as only single trial reports were available. The corresponding risk (and its 95% confidence interval) is based on the assumed risk in the comparison group and the relative effect of the intervention (and its 95% CI). CI: confidence interval | ||||||
GRADE Working Group grades of evidence High quality: Further research is very unlikely to change our confidence in the estimate of effect. Moderate quality: Further research is likely to have an important impact on our confidence in the estimate of effect and may change the estimate. Low quality: Further research is very likely to have an important impact on our confidence in the estimate of effect and is likely to change the estimate. Very low quality: We are very uncertain about the estimate. |
1Small trial so quality of the evidence downgraded by one level. 2Highly selected participants with potential bias in allocation and performance as well as in other 'Risk of bias' domains, thus downgraded by two levels. 3Outcome was not reported (or inadequately reported for meaningful conclusions to be drawn), therefore giving lowest quality of evidence judgement.
Background
Description of the condition
Tumours of the central nervous system constitute a large group characterised by a wide range of genetic, histological, and functional diversity (Louis 2016). Secondary brain tumours or metastases are the most common, accounting for almost half of all central nervous system tumours. Primary brain tumours typically occur as some variation of a glioma, so called because they arise from the supporting glial cell architecture; of these, glioblastoma is the most frequent and most malignant histological subtype (Ohgaki 2009).
Brain tumours may present with headaches, neurological deficits, or seizures, alone or in combination. Treatment choices include surgery (usually biopsy or resection), radiotherapy, and chemotherapy. National guidelines recommend that management of a central nervous system tumour should be discussed by a multidisciplinary team and individually tailored to patient needs (NICE 2006).
Description of the intervention
Intraoperative magnetic resonance imaging (iMRI) involves the use of an MRI during the actual operation to assess where there remains tumour that can be removed. Details on the fine anatomical structure of soft tissues provided by this technique have revolutionised the field of neuroscience, but the equipment is expensive and bulky. Intraoperative MRI requires a specific portable MRI scanner or a parallel stationary MRI scanner that is available for use in an adjacent diagnostic room. Acquisition of iMRI is aimed at providing high‐definition, easily interpreted images for real‐time assessment of tumour resection, allowing the possibility of immediate further resection during the same operative session (Black 1997; Seifert 2003). Uptake has been limited by low field strength scanners, which are associated with poor image quality, extended surgical time, and substantial capital costs.
Neuronavigation refers to representing a spatial position on the patient in imaging data. Preoperative imaging is used to localise a lesion, perform a tailored craniotomy, and guide resection. Postoperative MRI is performed to determine the extent of resection. A major limitation of this technique is the phenomenon of intraoperative brain shift, whereby the preoperative anatomy is altered during tumour resection and accuracy is consequently reduced. Advantages include the potential to use advanced imaging (functional MRI or tractography, for example) to define eloquent or invaded tissues.
Ultrasonography, performed in two or three dimensions (2D or 3D, respectively), enables visualisation of structures through recorded reflections of echoes of ultrasonic wave pulses (frequency > 20 MHz) directed into the tissue of interest. Freehand movement of an ultrasonography probe allows determination of image volume in 3D. Volumetric reconstruction allows neuronavigation accurate to within 1.4 mm. Updated 3D ultrasonography volumes can be created at any time during surgery. Advantages include relative affordability, easy repeatability, non‐invasiveness, lack of radiation, and the option for use in combination with other intraoperative technologies; the main disadvantage is operator variability, because efficacy depends on skill and experience (Unsgaard 2006).
Fluorescence‐guided surgery uses 5‐aminolevulinic acid (5‐ALA) as a natural biochemical precursor of haemoglobin that elicits synthesis and accumulation of fluorescent porphyrins preferentially in mitotically active tissue (Regula 1995). Porphyrin fluorescence can be visualised with the use of a modified microscope and ultraviolet light with the aim of identifying neoplastic tissue (Stummer 1998; Stummer 2000). Limitations include lack of a clear boundary between neoplastic and eloquent tissue, and variability in uptake of 5‐ALA depending on tumour characteristics. Distinct from iMRI and 3D ultrasonography, both of which involve little cost after the initial outlay, is the cost per patient of each dose of 5‐ALA, in addition to the requirement for a specific compatible operating microscope. Adverse events include hypotension, nausea, photosensitivity, and photodermatosis.
How the intervention might work
The extent of surgical resection is considered to be one of several important prognostic factors in neuro‐oncology. For some tumours this is clearly established, while for others the relationship is less clear (Hart 2011). Although high‐quality evidence is lacking, estimated benefits of gross total resection include a possible extension of survival from around 11 months to 14 months in glioblastoma, and from around 60 months to 90 months in low‐grade glioma, albeit based in highly selected patients in non‐randomised trials (Watts 2016). Limitations to the extent of surgical resection are related to difficulty in identifying residual tumour intraoperatively and proximity of the tumour to eloquent brain. Intraoperative imaging technologies have been developed to aid detection of residual tumour with the aim of extending resection. This information can be used by the surgeon to optimise resection, thereby potentially improving prognosis. Overall, prognosis for people with high‐grade glioma and low‐grade glioma depends on several factors of which extent of resection is one, and the importance of this prognostic factor may vary in different subgroups of these patients.
Why it is important to do this review
Maximising the extent of resection comes with the risk of encroaching upon eloquent brain. Potential benefits of more extensive tumour resection must be balanced against risks of causing new neurological deficits and reduced quality of life. This demands an objective assessment of risks and benefits for each technology.
Experience with each different technology is often limited within individual units. Often, technologies are seen as an evolution of established techniques and are not subjected to the rigorous scrutiny required for other new therapies, therefore evidence is potentially limited to small single‐institution case series. Direct comparisons between different intraoperative imaging technologies are necessary to limit overexpenditure on redundant technology and potential risk to patients.
This review aims to serve as a single comprehensive resource describing level of evidence and effectiveness for each technology.
Objectives
To establish the overall effectiveness and safety of intraoperative imaging technology in resection of glioma. To supplement this review of effects, we also wished to identify cost analyses and economic evaluations as part of a Brief Economic Commentary (BEC).
Methods
Criteria for considering studies for this review
Types of studies
Randomised controlled trials (RCTs).
Types of participants
This review included people of all ages with presumed new or recurrent glial tumours (of any location or histology) from clinical examination and imaging (computed tomography (CT) or MRI, or both). Additional imaging modalities (e.g. positron emission tomography, magnetic resonance spectroscopy) were not mandatory.
Types of interventions
Any of the following interventions could be compared with each other as well as within each intervention class (e.g. different forms of fluorescence‐guided surgery).
Intraoperative MRI (iMRI): defined as using a portable or fixed scanner (and moving scanner or patient, respectively) to acquire image data while the patient remains under anaesthesia. Can be integrated with neuronavigation (see below).
Neuronavigation or image guidance: defined as a system that integrates preoperative or intraoperative image data and creates a translation map between 'world space' and 'image space' to allow co‐registration of imaging and patient anatomy.
Intraoperative ultrasonography (2D or 3D): defined as a system that uses freehand movement of an ultrasonography probe over the region of interest and subsequently generates a volumetric reconstruction allowing intraoperative neuronavigation.
Fluorescence‐guided surgery: defined as administration of a contrast agent and intraoperative visualisation with the use of ultraviolet light (usually a specific mode of an operating microscope).
Types of outcome measures
Primary outcomes
Extent of resection: as shown on follow‐up imaging. Historically this has been broadly divided into complete resection, partial resection, and biopsy. Updated response criteria are available to enable dichotomising this into measurable and non‐measurable disease for contrast‐enhancing lesions (Wen 2010). Volumetric assessment is a better method of assessment in terms of accuracy and objectivity but requires additional imaging processing time and is not used routinely in many NHS (National Health Service) centres. Intraoperative evaluation of extent of resection by the operating surgeon is a biased and unverifiable method and therefore is not acceptable (Hensen 2008). We planned to use percentage resection, residual, mean volumes, and percentage of total/non‐total resection.
Adverse events: type (as defined by MedDRA (Medical Dictionary for Regulatory Authorities) criteria) and timing (MedDRA 2008). Examples include haematoma, wound complications, infection (and site), cerebrospinal fluid leak, oedema, seizures, and general medical complications. Additional procedures required for complications should be noted. Both the total number of complications and the number of complications per participant should be stated.
Secondary outcomes
Overall survival: length of time (in days, weeks, or months) from randomisation to death (from any cause).
Progression‐free survival (PFS): use of open and thorough criteria to define recurrence according to clinical symptoms, imaging, and increase in steroid therapy (Wen 2010).
Quality of life (QoL): use of a reliable and objective grading measure such as the EORTC QLQ‐C30/BN‐20 (European Organisation for Research and Treatment of Cancer QoL assessment specific to brain neoplasms) and FACT‐BrS (Functional Assessment of Cancer Therapy ‐ brain subscale) (Mauer 2008)
We planned to present a 'Summary of findings' table reporting the following outcomes, which are listed in order of priority (see Data synthesis).
Extent of resection
Adverse events
Overall survival
PFS
QoL
Search methods for identification of studies
Non‐English language journals were eligible for inclusion.
Electronic searches
We searched the following electronic databases:
Cochrane Central Register of Controlled Trials (CENTRAL; Issue 7, 2017) in the Cochrane Library.
MEDLINE (Ovid) (1946 to June week 4 2017).
Embase (Ovid) (1980 to 2017 week 27).
Search strategies for identification of RCTs in CENTRAL, MEDLINE, and Embase are depicted in Appendix 1; Appendix 2; Appendix 3, and for the brief economic commentary for MEDLINE in Appendix 4 and Embase in Appendix 5.
Searching other resources
We searched the references of all identified studies for additional trials.
Handsearching
We handsearched the Journal of Neuro‐Oncology, Neuro‐oncology, Journal of Neurosurgery, and Neurosurgery from 1991 to 2017, to identify trials that may not have been included in the electronic databases, including a search of all conference abstracts published in these journals.
Personal communication
We contacted neuro‐oncology experts to obtain information on current or pending RCTs as well as authors to clarify whether their study met the inclusion criteria or to request additional information where aspects of the publication were unclear.
We contacted the following neuro‐oncology experts for information on any current or pending RCTs: Professor Mitchel S Berger; Dr E Antiono Chiocca; Dr Michael Vogelbaum; Professor Hughes Duffau; Professor Joahn Pallud; Professor Walter Stummer; Professor Manfred Westphal; Professor Jorg Tonn; Professor Roland Goldbrunner; Professor Mark Bernstein; Professor Gelareh Zadeh; Professor Francesco di Mecco; Professor Franco Servadei; Professor Lorenzo Bello; Professor Domenico Davella; Professor Alessandro Olivi.
Data collection and analysis
Selection of studies
We identified studies in three stages. During title/abstract screening (for both intervention and economic analyses), we used a machine learning classifier designed to distinguish RCTs from non‐RCTs and applied this tool to de‐duplicated electronic search results (Wallace 2017). This classifier assigned a probability score to each retrieved citation (title‐abstract record) that reported an RCT. Citations with an assigned probability score greater than or equal to 0.1 were retained; we automatically discarded citations with a probability score less than 0.1.
Two review authors (MGH and DGB) independently examined and screened remaining abstracts to see if they met the inclusion or exclusion criteria. Next, we obtained the full texts of selected studies, which we further examined and compared against the inclusion and exclusion criteria. At all times, we resolved disagreements through discussion. If sufficient data were not available for assessment or there was uncertainty about inclusion criteria, we contacted the relevant trial authors for clarification.
Data extraction and management
For included studies, two review authors (MGH and DGB) independently abstracted data using a prespecified form designed to gather information required for characteristics of included studies and validity tables (Juni 2001). We resolved differences by discussion. Specific data extracted included the following.
Participant characteristics: age (mean and range), gender, performance status based on Karnofsky performance score (KPS) (Table 4) or WHO score (Table 5) (Karnofsky 1948; Oken 1982), tumour location, contrast enhancement, and tumour histology.
Trial characteristics: inclusion and exclusion criteria, randomisation methods and stratification, allocation concealment (if applicable), blinding (of whom and when), and statistics. Definitions identified will include extent of resection, progression, and adverse events.
Intervention: iMRI: field strength, timing, type of scanner (separate suite or 'double‐donut'), sequences performed, contrast administration, and reporting methods. Neuronavigation: imaging sequences and timing, brand of equipment. 5‐ALA: dose and timing, timing of ultraviolet light used intraoperatively, microscope used. Ultrasound: brand, timing, operator experience. Additionally, surgical decision making influenced by intraoperative imaging should be stated.
Outcome assessment: extent of resection (and measurement methods), overall survival, PFS, QoL, and adverse events. We recorded additional quality control information on follow‐up, as well as presence of an intention‐to‐treat cohort, deviations from protocol, and post‐recurrence management.
1. Karnofsky performance score.
Score | Definition |
100 | Normal, no complaints, no evidence of disease |
90 | Able to carry on normal activity: minor symptoms of disease |
80 | Normal activity with effort: some symptoms of disease |
70 | Cares for self: unable to carry on normal activity or active work |
60 | Requires occasional assistance but is able to care for needs |
50 | Requires considerable assistance and frequent medical care |
40 | Disabled: requires special care and assistance |
30 | Severely disabled: hospitalisation is indicated, death is not imminent |
20 | Very sick, hospitalisation is necessary: active treatment is necessary |
10 | Moribund, fatal processes are progressing rapidly |
0 | Dead |
2. WHO performance score.
Grade | Definition |
0 | Fully active, able to carry on all pre‐disease performance without restriction |
1 | Restricted in physically strenuous activity but ambulatory and able to carry out work of a light or sedentary nature, e.g. light house work, office work |
2 | Ambulatory and capable of all self care, but unable to carry out any work activities. Up and about more than 50% of waking hours |
3 | Capable of only limited self care, confined to bed or chair more than 50% of waking hours |
4 | Completely disabled. Cannot carry out any self care. Totally confined to bed or chair |
5 | Dead |
Assessment of risk of bias in included studies
We critically appraised trials deemed relevant according to the criteria reported in NHS CRD Report No. 4 (CRD 2008). We allocated trials according to risk of bias as described in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2011). We covered specific core 'Risk of bias' items including selection, performance, detection, attrition (deeming this to be adequate if at least 80% of participants were assessed for all outcomes specified in the review), reporting, and other biases. Operator blinding was not possible, but participant and outcome assessment blinding was desirable, although not mandatory. Two review authors (MGH and DGB) provided independent critical appraisal. We resolved disputes through discussion.
Measures of treatment effect
Time‐to‐event data (survival and PFS): We abstracted the log hazard ratio (HR) and standard error (SE) of the log HR for inputting into Review Manager 5 (Review Manager 2014). We additionally presented the overall numbers of participants experiencing the event of interest during the trial period. If the HR and its variance were not presented (i.e. other survival data were presented, e.g. median survival, ranges or percentages at stated time points), we attempted to abstract the data required to estimate these (Parmar 1998).
Continuous outcomes (QoL and extent of resection): We abstracted the final value and standard deviation (SD) of the outcome of interest for each treatment arm at the end of follow‐up.
Dichotomous outcomes (adverse events, mortality, and extent of resection): We abstracted the number of participants in each treatment arm who experienced the outcome of interest to estimate a risk ratio (RR).
Dichotomous and continuous data: We abstracted the number of participants assessed at each endpoint.
When possible, all data abstracted were those relevant to an intention‐to‐treat analysis. In the case of missing data required for review outcomes, we contacted study authors to request the pertinent information. Two review authors (MGH and DGB) extracted data and entered it into Review Manager 5.
Unit of analysis issues
We did not anticipate any unit of analysis issues, and there were none to note.
Dealing with missing data
In the case of missing data required for review outcomes, we contacted study authors. We did not impute missing outcome data for any of the outcomes.
Assessment of heterogeneity
We planned to assess heterogeneity between studies by visually inspecting forest plots, estimating the percentage of heterogeneity (I2 statistic) between trials that could not be ascribed to sampling variation (Higgins 2011), and performing a formal statistical test of the significance of identified heterogeneity (Deeks 2001). However, this was not applicable as we did not conduct meta‐analyses.
Assessment of reporting biases
We intended to construct funnel plots of treatment effect versus precision to investigate the likelihood of publication bias. Had these plots suggested that treatment effects may not have been sampled from a symmetrical distribution, as assumed by the random‐effects model, we planned to perform additional meta‐analyses using the fixed‐effect model.
Data synthesis
Two review authors (DGB and MGH) independently entered data into Review Manager 5. We planned to pool data if trial characteristics (methodology, participants, interventions, controls, and outcomes) were similar. We planned to use the following methods in the Data synthesis, Subgroup analysis and investigation of heterogeneity, and Sensitivity analysis to perform meta‐analyses.
Time‐to‐event data: We intended pool HR and variance using the generic inverse variance function of Review Manager 5.
Continuous outcomes: We intended to pool mean differences (MDs) between treatment arms at the end of follow‐up if all trials measured the outcome on the same scale, or otherwise use the standardised mean difference (SMD).
Dichotomous outcomes: We intended to calculate the RR for each study and then pool values for all studies.
We planned to use random‐effects models for all meta‐analyses (DerSimonian 1986), but to perform additional fixed‐effect analyses if an asymmetrical distribution was found (see Assessment of reporting biases).
We presented the overall quality of evidence for each outcome (see Types of outcome measures) according to the GRADE approach, which takes into account issues related not only to internal validity (risk of bias, inconsistency, imprecision, publication bias) but also to external validity (e.g. directness of results) (Langendam 2013). We created a 'Summary of findings' table based on the methods described in the Cochrane Handbook for Systematic Reviews of Interventions (Higgins 2011) and using GradePro GDT. We used the GRADE checklist and GRADE Working Group for quality of evidence definitions (Meader 2014). We downgraded evidence by one level for serious concerns (or two levels for very serious concerns) for each limitation, as follows.
High quality: We are very confident that the true effect lies close to that of the estimate of the effect.
Moderate quality: We are moderately confident in the effect estimate: the true effect is likely to be close to the estimate of the effect, but there is a possibility that it is substantially different.
Low quality: Our confidence in the effect estimate is limited: the true effect may be substantially different from the estimate of the effect.
Very low quality: We have very little confidence in the effect estimate: the true effect is likely to be substantially different from the estimate of effect.
Subgroup analysis and investigation of heterogeneity
Owing to differences in prognosis, we planned to perform subgroup analyses according to tumour type, including:
high‐grade glioma;
low‐grade glioma; or
primary versus recurrent disease in high‐grade glioma and primary disease versus disease progression in low‐grade glioma.
Sensitivity analysis
We planned to perform a sensitivity analysis to investigate how trial quality affected the robustness of findings. We planned to perform a subsequent sensitivity analysis of trials that included objective, blinded early postoperative MRI and histology in their assessment of extent of resection.
Results
Description of studies
See Characteristics of included studies and Characteristics of excluded studies.
Results of the search
The literature search revealed a total of 4109 of records: CENTRAL, 927 references; MEDLINE, 519 references; Embase, 887 references. After de‐duplication and use of the Cochrane RCT classifier, 790 records remained.
We utilised the Cochrane author support tool Covidence for title and abstract screening of the 790 records. Two review authors (MGH and DGB) then independently examined the remaining 20 references. We excluded those studies that clearly did not meet the inclusion criteria, and obtained full‐text copies of 8 potentially relevant references, choosing 6 trials (reported in 12 nested publications) for inclusion. Subsequently 1 trial was excluded following correspondence with the lead author (Wu 2007), and 1 trial was classified as on‐going (Wu 2014), resulting in 4 trials for inclusion. Any disagreements were resolved through discussion with a third review author (AB) (Figure 1).
We originally planned to include one study that was labelled as an RCT but without a description of the randomisation methods (scored as at unclear risk of selection bias) (Wu 2007). However, subsequent email correspondence with the lead author revealed that "randomisation methods were not strict, and that investigators were aware of allocation prior to enrolment". We therefore excluded this study.
Included studies
The four included studies are described in detail in Characteristics of included studies.
In summary, we identified two trials of intraoperative MRI (Kubben 2014; Senft 2011), one trial of fluorescence‐guided surgery (Stummer 2006), and one trial of neuronavigation (Willems 2006). We did not find any eligible studies of ultrasound‐guided surgery. All studies included people with presumed high‐grade glioma on preoperative imaging. None of the included trials included people with low‐grade glioma, although one ongoing trial includes this patient subgroup (Wu 2014).
Intraoperative MRI
Kubben 2014 recruited 14 participants from multiple centres in Belgium and the Netherlands between 2010 and 2012. Participants had to have a supratentorial brain tumour suspected to be a glioblastoma and an indication for gross total resection. The trial compared surgery with iMRI versus surgery without iMRI (of which either arm could include neuronavigation). Outcomes were residual tumour volume, complications, quality of life (EORTC QLQ‐C30), and overall survival. The final results were initially supposed to be an interim analysis, but ultimately the trial was stopped early thereafter. This unplanned interim analysis was not specified a priori, and as a consequence the sample size would not have taken this into account even if the trial had been fully completed. The size of the trial and circumstances around its early completion are reflected in the 'Risk of bias' assessment and GRADE profile (see below).
Senft 2011 recruited 58 participants from a single German neurosurgical centre between 2007 and 2010. Participants had to have a known or suspected glioma that was contrast enhancing and amenable to complete resection. The trial compared surgery with iMRI versus surgery without iMRI (of which either arm could include neuronavigation). The primary outcome was extent of resection. Secondary outcomes were volume of residual tumour on postoperative MRI, PFS at six months, duration of surgery, and treatment‐related morbidity.
Fluorescence‐guided surgery
Stummer 2006 recruited 322 participants from multiple centres in Germany between 1999 and 2004. Participants had to have a malignant glioma on imaging. The trial compared surgery with 5‐ALA versus surgery without 5‐ALA (of which either arm could include neuronavigation). Primary outcomes were complete tumour resection on MRI (< 72 hours' post‐operation and > 1.5 T) and PFS. Secondary outcomes were residual tumour volume, overall survival, type and severity of neurological deficits after surgery, and toxic effects.
Neuronavigation
Willems 2006 recruited 45 participants from a single Dutch centre between 1999 and 2002. Participants had to have a single space‐occupying lesion. The trial compared surgery with neuronavigation versus surgery without neuronavigation. Primary outcomes were extent of resection and survival. Secondary outcomes were procedure duration, usefulness of neuronavigation, extent of resection, QoL, and postoperative course (including neurological status and adverse events).
Excluded studies
We excluded 12 studies, as follows (see Characteristics of excluded studies).
Seven were not RCTs (Czyz 2011; Koc 2008; Stepp 2007; Wu 2003; Wu 2004; Zhang 2015).
Three were only presented as abstracts and we were unable to obtain sufficient information even after attempting correspondence with the original trial authors (Chen 2011; Chen 2012; Seddighi 2016).
Three did not directly compare an intraoperative imaging intervention with either another intraoperative imaging intervention or standard surgery (Eljamel 2008; Rohde 2011; Stummer 2017).
Risk of bias in included studies
Summary data for risk of bias are presented in table format (Figure 2; Figure 3). A detailed description is provided below and in the Characteristics of included studies.
Allocation
Randomisation methods
Randomisation methods were described and were satisfactory in all four included trials, for a judgement of low risk of bias (Kubben 2014; Senft 2011; Stummer 2006; Willems 2006).
Allocation concealment
We assessed one trial in which allocation concealment was potentially inadequate (i.e. sealed envelopes) and judged to be at high risk of bias (Senft 2011), one trial as at low risk of bias (Stummer 2006), and the remaining two trials as at unclear risk of bias (Kubben 2014; Willems 2006).
Blinding
Blinded assessment for extent of resection was performed in three trials (Kubben 2014; Senft 2011; Stummer 2006), and for histological assessment in one trial (Stummer 2006). Regarding overall survival, blinding would not affect outcome reporting but could affect subsequent treatment. For QoL, PFS, and adverse events, blinding would likely affect the outcomes reported. All trials were not blinded to participants or clinicians.
Incomplete outcome data
In one trial all participants were accounted for (Kubben 2014). In two trials all participants were accounted for, but an intention‐to‐treat analysis was not performed, as those participants that had alternative pathological diagnoses were excluded (Senft 2011; Stummer 2006). In the remaining trial there was evidence of attrition bias for extent of resection (analysis of 32 out of 42 participants) (Willems 2006).
Selective reporting
One trial reported all outcomes and was therefore at low risk of reporting bias (Senft 2011). Selective outcome reporting was apparent in three trials: one trial did not report quality of life outcomes (Kubben 2014); one trial did not report full outcome data in the form of figures and appropriate statistics for survival, PFS, and adverse events for 5‐ALA (Stummer 2006); and one trial did not present full data for survival, QoL, or adverse events (Willems 2006). Adverse event data in all studies were particularly poorly reported in terms of total number of events, number of participants with multiple events, and timing of events.
Other potential sources of bias
One of the issues with iMRI is attribution bias. Because a surgeon knows he can check for residual disease, he does not operate as aggressively as he might if he could not check for residual disease during the operation. So when a scan is done residual disease is more likely to be detected, removed, and the success of the removal attributed to the iMRI. This is likely to affect outcomes that report a difference between the first intraoperative and final postoperative MRI scans.
Early cessation of trial
All four trials were stopped early based on the results of interim analyses. Kubben 2014 was stopped early based on the results of an interim analysis not specified a priori. Given the low number of participants involved, we excluded this trial from quantitative analysis. Senft 2011 was stopped early based on the results of an interim analysis not specified a priori. Significance values were consequently adjusted (a P value of less than 0.04 was subsequently regarded as significant). Stummer 2006 was stopped early based on the results of a scheduled interim analysis with compensated power calculation. Willems 2006 was stopped early but no reason was given.
Industry sponsorship
Industry sponsorship was apparent in three trials. Kubben 2014 was financially supported by Medtronic Navigation, but the sponsors "were not involved in writing the protocol, had no access to the data, was not involved in writing the manuscript, and had no veto right for submission." Senft 2011 included authors that had received an honorarium from Medtronic (who manufactured the iMRI machine used in the study), although it was emphasised that the study received no funding from Medtronic. Stummer 2006 was sponsored by medac GmbH (who manufacture Gliolan), which was involved in the study design, quality assurance, and quality control but had no role in the interpretation of data, and the corresponding author had final responsibility for the article (although the author was a paid consultant to both medac GmbH and Zeiss, which manufactures the microscopes used for 5‐ALA). One trial did not state if there were conflicts of interest (Willems 2006).
Effects of interventions
See: Table 1; Table 2; Table 3
Extent of resection
Meta‐analysis was not appropriate due to differences in the tumours included (eloquent versus non‐eloquent locations) and variations in the image guidance tools used in the control arms (usually selected utilisation of neuronavigation). Due to the small number of studies (four), we did not construct a funnel plot. The risk ratio (RR) for the extent of resection in participants with high‐grade glioma favoured the experimental arms in two of the four trials reporting this outcome, indicating a lower risk of having an incomplete resection with the intervention.
iMRI was assessed in two trials (Kubben 2014; Senft 2011).
5‐ALA was assessed in the trial of Stummer 2006.
Neuronavigation was assessed in the trial of Willems 2006.
Complete resection
iMRI: In the trial of Senft 2011, complete tumour resection was achieved in 23/24 (96%) of participants in the intervention group compared with 17/25 (68%) of participants in the control group (RR for incomplete resection 0.13, 95% confidence interval (CI) 0.02 to 0.96; very low‐quality evidence). In the Kubben 2014 trial, tumour resection was reported using residual tumour volume and data for complete tumour resections were not available.
5‐ALA: Complete resection was performed in 90/139 (65%) of participants in the intervention group versus 47/131 (36%) of participants in the control group (RR for incomplete resection 0.55, 95% CI 0.42 to 0.71; low‐quality evidence).
Neuronavigation: Complete resection was achieved in three participants in the control group and five participants in the neuronavigation group. However, there was significant attrition, with not all participants having complete imaging, and the denominators for these figures were not stated, precluding meta‐analysis (very low‐quality evidence).
Adverse events
Adverse events (AEs) were reported in an inconsistent manner between trials and not according to the prespecified manner required in our protocol. Specifically, data were not available for participants at risk, participants with multiple events, timing of events, and outcomes of events. We therefore adopted a descriptive method using the data available to describe the AEs in each trial.
iMRI: In the trial of Senft 2011, new or aggravated neurological deficits were present in 2/25 (8%) of participants in the control group and 3/24 (13%) participants in the iMRI group; intraoperative imaging did not lead to continuation of tumour resection in any of the participants with AEs. Two participants had symptomatic haematomas, which were not attributable to the use of iMRI. In one participant, hemianopia was deliberately accepted due to tumour extension around the temporal horn of the lateral ventricle involving the optic radiation. In the Kubben 2014 trial, a single participant in the intervention arm experienced a postoperative haemorrhage.
5‐ALA: Adverse events were present in 58.7% of the intervention arm versus 57.8% of the control arm. Neurological AEs were present in 42.8% of the intervention arm (7.0% grade 3 to 4) and 44.5% of the control arm (5.2% grade 3 to 4). Significant neurological AEs were present in 12.4% of the intervention arm versus 11.6% of the control arm. The number of participants with a deterioration in the National Institutes of Health Stroke Scale compared to baseline tended to be higher in the intervention arm at 48 hours (26.2% with 5‐ALA versus 14.5% in the control arm) but not at 7 days (20.5% versus 10.7%), 6 weeks (17.1% versus 11.3%), and 3 months (19.6% versus 18.6%). No denominators were given for each result, preventing calculation of the RR and CI.
Neuronavigation: New or worsened neurological deficits were present at three months in 45.5% of participants in the control group and 18.2% of participants in the neuronavigation group. During the first three months after surgery, seven participants (31.8%) in the control group and seven (30.4%) in the neuronavigation group experienced a new, non‐neurological adverse event. In three participants in the neuronavigation group, these events were fatal (pulmonary embolism, cardiac arrest with pulseless electrical activity, and postoperative pulmonary insufficiency). Other adverse events included pulmonary or urinary tract infection, surgical removal of an epidural haematoma, surgical cyst drainage, repeated tumour debulking, cerebrospinal fluid leakage, postoperative delirium, and insufficiently treated steroid‐induced diabetes.
Survival
iMRI: Senft 2011 did not assess this outcome, while Kubben 2014 did not report overall survival in the prespecified manner for inclusion.
5‐ALA: There was no difference in overall survival between the intervention and control arms (hazard ratio (HR) 0.82, 95% CI 0.62 to 1.07). Median survival was also reported and this was 15.2 months (95% CI 12.9 to 17.5) in the intervention arm versus 13.5 months (95% CI 12.0 to 14.7) in the control arm.
Neuronavigation: The median survival time was 9 months in the control arm and 5.6 months in the intervention arm and the HR was reported to be 1.6. However, no confidence intervals were available or able to be calculated.
Time to progression or progression‐free survival
iMRI: In Senft 2011, the median PFS in the intervention arm was 226 days (95% CI 0.0 to 454) versus 154 days (95% CI 60 to 248) in the control arm. HRs or their respective CIs were not available and could not be calculated. Kubben 2014 did not assess these outcomes.
5‐ALA: Median PFS was 5.1 months (95% CI 3.4 to 6.0) in the intervention arm versus 3.6 months (95% CI 3.2 to 4.4 months) in the control arm. HRs and their respective CIs were not available and could not be calculated.
Neuronavigation: These outcomes were not assessed.
Quality of life
iMRI: Senft 2011 and Kubben 2014 did not report data for this outcome.
5‐ALA: This outcome was not assessed.
Neuronavigation: Quality of life questionnaires at 3 months' postoperatively were completed by 19 participants (eight in the neuronavigation arm and 11 in the standard surgery arm), constituting 64.5% of all eligible participants. The questionnaire included one part with 30 general questions and another part with 20 brain‐specific questions (BN‐20). Out of 26 outcome measures that were presented, the direction of change differed in seven (all in the BN‐20 group): four were in favour of the neuronavigation group and three were in favour of standard surgery. No statistical analysis was presented.
We considered this evidence to be of low to very low quality for all reported outcomes (Table 1; Table 2; Table 3).
Discussion
Summary of main results
We identified two RCTs for iMRI (Kubben 2014; Senft 2011), one for fluorescent‐guided surgery with 5‐ALA (Stummer 2006), and one assessing neuronavigation using standard preoperative MRI sequences (Willems 2006). Formal meta‐analysis was not possible due to the different comparisons and variability in the control arm population between trials. We were therefore limited to performing a narrative analysis of the included trials.
Two trials demonstrated a benefit for intraoperative imaging technology (iMRI and 5‐ALA, respectively) in terms of extent of resection (the primary outcome) (Senft 2011; Stummer 2006). Overall survival data were available for 5‐ALA only; there was no clear evidence that 5‐ALA improved overall survival. Data for PFS were only available for two trials, and were not available in the format specified (hazard ratios and their variance). Nevertheless, there was a suggestion that 5‐ALA increased PFS compared with standard surgery. Quality of life data were only reported in a single trial, and there was significant attrition and reporting bias. Adverse event reporting varied considerably between trials but in general was poorly performed. With 5‐ALA, it appears that neurological deterioration is more common after fluorescence‐guided surgery. The studies that reported on this effect noted that it occurred mainly among those with fixed deficits and early after surgery, but there was subsequently a trend towards recovery (Stummer 2006). Other adverse events appeared to be rare and similar in frequency between study arms.
To supplement the main systematic review of effects, we sought to identify cost analyses and economic evaluations that compared the interventions with each other or between different variants of the same intervention. A search of MEDLINE and Embase identified six such studies (Eljamel 2016; Esteves 2015; Hall 2003; Kowalik 2000; Makary 2011; Schulder 2003; Slof 2015) (one study was reported in two papers ‐ Hall 2003; Kowalik 2000).
Of the six studies, three studies compared iMRI to conventional surgery (Kowalik 2000; Makary 2011; Schulder 2003); two compared 5‐ALA with white light surgery (Esteves 2015; Slof 2015); and one compared conventional, 5‐ALA, fluorescein, ultrasound, and iMRI surgery (Eljamel 2016). Three studies were conducted in the USA (Kowalik 2000; Makary 2011; Schulder 2003), one in Portugal (Esteves 2015), and one in Spain (Slof 2015), and for one it was unclear (but was probably the USA) (Eljamel 2016). Four studies were based on non‐randomised retrospective comparative cohorts (Kowalik 2000; Makary 2011; Schulder 2003; Slof 2015); one was based on a review and pairwise meta‐analyses (Eljamel 2016), and one used data from a trial and retrospective cohorts (Esteves 2015). The cohort studies all involved fewer than 100 participants, except for the study by Slof 2015, which included 254 participants who received 5‐ALA and 120 who received white light surgery. All the studies except one (Esteves 2015), which integrated data using a Markov model, were based on comparisons of individual patient level data.
In terms of costs, what costs were included and over what time horizon varied markedly. Only one study considered costs over the patient lifetime (Esteves 2015), and one only considered the drug cost (Slof 2015). The other studies considered costs incurred in hospital for the index surgery. Costs were reported in US dollars in four studies (Esteves 2015; Kowalik 2000; Makary 2011; Schulder 2003), but the price year (2005/6) was stated only in one study (Makary 2011). The other two studies reported costs in Euros, and the price year was 2012 in one study, Esteves 2015, and not stated in the other (Slof 2015). Two studies were cost analyses only (Kowalik 2000; Schulder 2003). Effects were resection rates (Eljamel 2016), resection‐free years (Makary 2011), quality‐adjusted life years (Eljamel 2016; Esteves 2015; Slof 2015) PFS (Esteves 2015), and life years (Esteves 2015).
For the comparison of iMRI with conventional surgery, two studies reported a potential cost saving driven by reductions in length of stay (Kowalik 2000; Schulder 2003), and third study reported lower mean costs that were not statistically significant (Makary 2011). The one cost‐effectiveness analysis reported a longer interval to resection (20.1 versus 6.7 months; P = 0.02); further results suggested iMRI was more cost‐effective in terms of cost per resection‐free years. Another study reported that iMRI was the most costly of conventional, 5‐ALA, fluorescein, and ultrasound‐assisted surgery (Eljamel 2016). iMRI was the least cost‐effective, but the results could not be replicated from the data presented in the study. Estimates of cost‐effectiveness (and cost over a longer follow‐up) need to considered in the light of the very limited evidence for iMRI where there is a benefit shown in terms of extent of resection but no evidence in the review of clinical effectiveness on overall survival.
For the comparison of 5‐ALA and standard surgery, 5‐ALA was on average more costly in both studies, but results in more quality‐adjusted life years over the patient lifetime or over the time to progression of disease (Esteves 2015; Slof 2015). In both cases the study authors concluded that the extra costs were worth the extra quality‐adjusted life years and that these conclusions were consistent over all sensitivity analyses conducted. These findings of extra effectiveness in the economic studies need to be considered in context of the findings of the review of the best available clinical effectiveness data summarised above. National Institute for Health and Care Excellence (NICE) guidance on the cost‐effectiveness of 5‐ALA is expected to be published in June 2018.
Overall completeness and applicability of evidence
All the identified trials included highly selected participants in specialised centres, and the applicability of these findings to a more general population needs to be carefully considered. Participants included int he trials tended to be generally young and of good performance status. In addition, most trials also clearly specified the types of tumours that were to be included, and would not have randomised those patients with eloquent tumours or where a complete resection was not feasible. Potentially those enrolled in one of the iMRI trials (Senft 2011) were likely to have more resectable or less eloquent tumours than those in the 5‐ALA trial (Stummer 2006), given the far higher resection rates in both arms of the iMRI study (96% iMRI and 68% control versus 65% 5‐ALA and 36% control).
The majority of included trials only enrolled participants with probable high‐grade glioma. We identified no RCTs for ultrasound‐guided surgery, which may reflect the less widespread application of this particular technology. There are theoretical advantages to this technology, such as relative affordability, repeatability, and possibly better sensitivity in low‐grade tumours than the other included intraoperative imaging modalities. Nevertheless, it currently does not have the same evidence base as other intraoperative imaging modalities to recommend its use in routine clinical practice.
Quality of the evidence
It is clearly feasible to perform RCTs for new surgical interventions, and it appears now to have become standard practice to perform an RCT for assessing new intraoperative imaging technologies. The openness of major centres to enrolling participants in RCTs to provide clear outcome data is a major step forward in neuro‐oncology. Some aspects of the included trials were at low risk of bias, such as randomisation methods and blinded, objective reporting for extent of resection. However, the overall the risk of bias was high, and there were consistent concerns with stopping trials early and the role of industry involvement (Table 1; Table 2; Table 3).
Extent of resection was the primary outcome for all of the included trials. This has the advantage of being the outcome most directly influenced by intraoperative imaging. However, there is still no evidence from RCTs that resection (either total or less than total) improves outcomes for high‐grade glioma over biopsy alone (Hart 2011). Subgroup analyses, particularly for the 5‐ALA trial (Stummer 2006), have shown that those participants that have a complete resection of all contrast‐enhancing tumour survive longer than those with residual tumour (Pichlmeier 2008). Studies of chemotherapy have also found that those without residual tumour survive longer (Stupp 2005). While this is not direct evidence in favour of complete resection, but rather a post hoc non‐randomised subgroup analysis, it is becoming increasingly apparent that a complete tumour resection is desirable, particularly when it can be achieved safely. Precisely how much a complete resection contributes towards the overall outcome is unclear. New methods of imaging (e.g. amino acid positron emission tomography) have found that tumours frequently extend out from the contrast‐enhancing margin on MRI (Miwa 2004). However, validation of this approach has yet to be established, and the need for a cyclotron makes widespread application and testing a challenge in the UK, therefore MRI in assessing residual tumour remains the current standard of care.
After extent of resection, studies tended to focus on PFS rather than overall survival. There are certain advantages to this in that possibly fewer participants are required and the results may be available sooner. Additionally, it may provide a more direct assessment of the effect of the primary intervention that is not confounded by subsequent therapy. However, it can be argued that overall survival should still remain the main outcome of interest. Firstly, survival is so short in high‐grade glioma that the practical benefits of assessing PFS are less relevant. Secondly, assessment of PFS can be more subjective, and is critically dependent on the timing and interpretation of imaging, which can often be complicated (Wen 2010).
Quality control for surgical neuro‐oncology trials is an emerging area (GNOSIS 2007). Standardisation of reporting is required to allow clear comparisons between trials in meta‐analyses. Detailed reporting is required for tumour location with regard to eloquent brain; operative technique used; postoperative imaging protocol; assessment of extent of resection; and recording of adverse events (including total numbers of events, total number of participants at risk, number of participants with multiple events; severity, timing, and outcome of events, i.e. resolution or persistence of neurological deficits).
Potential biases in the review process
We took multiple steps in the review process to minimise bias, including double independent literature sift and data extraction, not pooling results due to heterogeneity, and using strict inclusion criteria. Overall, these steps acted to minimise bias and restrict the review to the best available evidence. Notably this led to one trial that was titled as an RCT and included in an earlier version of this review being excluded. Specificially, the lead author stated that randomisation was not strict, surgeons were aware of allocations prior to enrolment, and that bias of participant allocation was inevitable. In a previous Cochrane Review (Barone 2014), this study was included to allow open discussion of its methodology, while for this review we felt it more appropriate to concentrate on the highest‐quality evidence in order to generate the most robust findings.
Notably, the majority of trials identified through the search strategy were not RCTs. It could be argued that excluding this volume of data biases our review and that it would be more appropriate to consider a Cochrane Review of non‐randomised studies (NRS). However, the issue of selection bias is critical, particularly in surgical trials. Participants enrolled in a NRS are likely to have a better prognosis than a control population, and it is impossible to accurately account for this bias without using randomisation. It would therefore not be clear what benefit intraoperative imaging had on the overall outcome. Meta‐analysis of RCTs remains the most reliable way of assessing the benefits of specific intraoperative imaging modalities. However, NRS may also have a role, particularly regarding technology development and reporting of adverse events.
This review included two specific groups of technologies, those that used imaging obtained intraoperatively and those that used imaging obtained preoperatively for use in an intraoperative manner. We felt that both methods were suitable for comparison, as the goals are similar: namely, to achieve maximal safe resection via the application of surgical technology. A major concern with preoperative imaging is intraoperative brain shift, whereby anatomical localisation is affected by events that occur during surgery (e.g. anaesthesia, brain retraction, tumour resection, dural opening, and cerebrospinal fluid drainage). Imaging obtained intraoperatively can theoretically account for brain shift and allow more accurate navigation than imaging obtained preoperatively. In this review we found that a single trial did not demonstrate an effect for intraoperative imaging utilising preoperatively acquired data (Willems 2006).
Another technique that is commonly used in neuro‐oncology surgery is awake craniotomy. This is often perceived as a technology to make surgery safer by allowing intraoperative mapping of eloquent brain. It is not typically regarded as a technique to maximise extent of resection and was therefore not included in this review.
We did not subject these studies to critical appraisal, and we do not attempt to draw any firm or general conclusions regarding the relative costs or efficiency of the interventions being compared. For the comparison of iMRI surgery with conventional surgery, it is clear that the available economic evidence is, at best, equivocal. For the comparison of 5‐ALA with white light surgery, the available economic evidence indicates that, from an economic perspective, use of 5‐ALA could be a promising strategy but effectiveness data used in the economic studies is not consistent with the findings of the review of effectiveness.
Agreements and disagreements with other studies or reviews
We are not aware of any other similar reviews that compare all the different types of intraoperative imaging or other interventions to maximise the extent of resection in neuro‐oncology. Currently, there are no national guidelines appraising the use of any of the technologies, for example by NICE, but guidance on 5‐ALA and iMRI is expected in 2018 when the NICE guidelines for the management of primary brain tumours are published. Many of the trials are relatively recent and appraisal is often limited to a linked editorial. In addition, many of the techniques have only been used in specialised trial centres, and real‐world experience is limited. Further prospective data reporting such real‐world experience would help inform future clinical guidelines and NHS (National Health Service) policy by reporting data on patients who are unsuitable for RCTs, for example due to co‐morbidities.
An interim analysis of an on‐going trial of iMRI is broadly in agreement with the findings of this review (Wu 2014). This reported outcomes on 114 out of a projected 304 participants. Complete resection was achieved in 86% of the iMRI arm versus 53% of the control arm. There was no difference in AEs or PFS while OS was not reported.
Authors' conclusions
Implications for practice.
Intra‐operative imaging technologies, specifically iMRI and 5‐ALA, may be of benefit in maximising extent of resection in participants with high grade glioma. However, this is based on low to very low quality evidence, and is therefore very uncertain. The short‐ and long‐term neurological effects are uncertain.
The purpose of these technologies is to make surgical resection safer and more effective. Patient selection, patient‐specific information, and informed consent are all essential to ensure that these technologies are used appropriately in the pathway of care. Standardisation of patient management through the use of evidence‐based clinical practice will ensure consistent surgical standards of care wherever a patient is treated.
Patient selection must be emphasised. All the trials included predominantly young participants of good performance status and with a well‐defined tumour in a non‐eloquent region that was amenable to safe complete resection.
Implications for research.
The current studies provide a limited knowledge base upon which to consider implementing such technologies. Important questions remain about benefit in terms of overall survival, progression‐free survival, and the risk of adverse events. Future trials could be done with a similar design to those already performed but with simple improvements to the trial methodology and outcome reporting.
A direct comparison between individual intraoperative imaging technologies could be of benefit to compare their relative merits and in particular help to provide cost‐effectiveness data. The most logical comparison would be between iMRI and 5‐ALA, while ultrasound and advanced imaging neuronavigation (e.g. tractography of functional imaging based) have theoretical advantages but currently have not been the subject of a randomised controlled trial (RCT). However, units with access to all technologies are likely to be rare, and patients who are suitable for either procedure are likely to be very highly selected, although experience‐based RCTs are a possible way around this. Nevertheless, there are ongoing RCTs comparing different forms of image‐guided surgery, and these can hopefully be incorporated into an update of this review once they are completed (Ongoing studies). A network meta‐analysis may allow indirect comparisons of each technology, and a formal economic analysis could allow financial factors to be facilitated into the equation.
Evidence regarding extent of resection and the means with which to achieve this is becoming stronger, but this still needs to be balanced with making surgery safer. Awake craniotomy is probably the main means of enabling a maximal safe resection, particularly with tumours in eloquent areas. A comparison of tractography or functional MRI guided surgery versus awake craniotomy is potentially a relevant question for resection of tumours in eloquent areas.
What's new
Date | Event | Description |
---|---|---|
20 May 2021 | Amended | This review has been superseded as an NMA: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD013630.pub2/full |
History
Protocol first published: Issue 9, 2017 Review first published: Issue 1, 2018
Date | Event | Description |
---|---|---|
19 January 2018 | Amended | Minor text amendment. |
Notes
This review has been superseded as an NMA: https://www.cochranelibrary.com/cdsr/doi/10.1002/14651858.CD013630.pub2/full
Acknowledgements
We would like to thank Robin Grant (Co‐ordinating Editor), Gail Quinn, Clare Jess (Managing Editors), and Tracey Harrison (Assistant Managing Editor), for the Cochrane Gynaecological, Neuro‐oncology, and Orphan Cancer Group, for providing editorial support, as well as Jo Platt, Information Specialist, for devising the MEDLINE search strategy. We would also like to thank Ian Shemilt, EPPI‐Centre, UCL, and Luke Vale, Institute of Health & Society, Newcastle University, for support provided in development of economic search strategies and associated methods.
This project was supported by the National Institute for Health Research (NIHR), via Cochrane Programme Grant funding (SRPG Project: 16/114/18), to the Cochrane Gynaecological, Neuro‐oncology, and Orphan Cancer Group. The views and opinions expressed therein are those of the authors and do not necessarily reflect those of the Systematic Reviews Programme, NIHR, the NHS, or the Department of Health.
Appendices
Appendix 1. CENTRAL search strategy
#1. MeSH descriptor: [Central Nervous System Neoplasms] explode all trees #2. ((central nervous system or CNS or brain* or cerebral* or intracerebral or intra‐cerebral or intracranial or intra‐cranial or spine or spinal or astrocytic or oligodendroglial or ependymal) near/5 (cancer* or tumor* or tumour* or malignan* or neoplas* or carcinoma* or metastat*)) #3. MeSH descriptor: [Neoplasms, Neuroepithelial] explode all trees #4. ((cranial or paraspinal or meninges or haematopoietic system or germ cell or germ‐cell or sellar or glioneural or neuroectodermal or embryonal or neuroepithelial or pineal or choroid plexus or teratoid or rhabdoid) near/5 (tumor* or tumour*)) #5. MeSH descriptor: [Glioma] explode all trees #6. glioma* or glial* or astrocytoma* or xanthoastrocytoma* or glioblastoma* or gliosarcoma* or oligodendrogli* or oligoastrocyt* or ependym* or subependym* or astroblastoma* or ganglioglioma* or gangliocytoma* or neurocytoma* or liponeurocytoma* or pineocytoma* or pineoblastoma* or medulloblastoma* or neuroblastoma* or ganglioneuroblastoma*or medulloepithelioma* or GBM* #7. #1 or #2 or #3 or #4 or #5 or #6 #8. MeSH descriptor: [Magnetic Resonance Imaging] explode all trees #9. intra operative magnetic resonance imag* or intra‐operative magnetic resonance imag* or intra operative MRI or intra‐operative MRI or iMRI or ioMRI or IOMRI or IoMRI or MRI or MRi or NMRI or NMRi or magnetic resonance imag* or tractography #10. MeSH descriptor: [Ultrasonography] explode all trees #11. (2D or 3D) near/5 (ultras* or US) #12. ((intra‐operative or intraoperative) near/5 (ultras* or US or IOUS or imag* or navigat* or technolog* or modalit* or eval* or monitor*)) #13 volumetric reconstruction or Sonowand or SonoWand #14. MeSH descriptor: [Neuronavigation] this term only #15. MeSH descriptor: [Surgery, Computer‐Assisted] this term only #16. navigat* or neuronavigat* or neuro‐navigat* or image guid* #17. Brainlab or Stealth #18. MeSH descriptor: [Monitoring, Intraoperative] explode all trees #19. MeSH descriptor: [Fluorescence] this term only #20. MeSH descriptor: [Aminolevulinic Acid] this term only #21. fluorescen* or immunofluorescen* #22. aminolevulinic acid or 5‐aminolevulinic acid #23. ALA or 5‐ALA or Gliolan #24. #8 or #9 or #10 or #11 or #12 or #13 or #14 or #15 or #16 or #17 or #18 or #19 or #20 or #21 or #22 or #23 #25. #7 and #24
Appendix 2. MEDLINE RCT search strategy
1. exp Central Nervous System Neoplasms/ 2. ((central nervous system or CNS or brain* or cerebral* or intracerebral or intra‐cerebral or intracranial or intra‐cranial or spine or spinal or astrocytic or oligodendroglial or ependymal) adj5 (cancer* or tumor* or tumour* or malignan* or neoplas* or carcinoma* or metastat*)).mp. 3. exp neoplasms, neuroepithelial/ 4. ((cranial or paraspinal or meninges or haematopoietic system or germ cell or germ‐cell or sellar or glioneural or neuroectodermal or embryonal or neuroepithelial or pineal or choroid plexus or teratoid or rhabdoid) adj5 (tumor* or tumour*)).mp. 5. exp Glioma/ 6. (glioma* or glial* or astrocytoma* or xanthoastrocytoma* or glioblastoma* or gliosarcoma* or oligodendrogli* or oligoastrocyt* or ependym* or subependym* or astroblastoma* or ganglioglioma* or gangliocytoma* or neurocytoma* or liponeurocytoma* or pineocytoma* or pineoblastoma* or medulloblastoma* or neuroblastoma* or ganglioneuroblastoma*or medulloepithelioma* or GBM*).mp. 7. 1 or 2 or 3 or 4 or 5 or 6 8. exp Magnetic Resonance Imaging/ 9. (intra operative magnetic resonance imag* or intra‐operative magnetic resonance imag* or intra operative MRI or intra‐operative MRI or iMRI or ioMRI or IOMRI or IoMRI or MRI or MRi or NMRI or NMRi or magnetic resonance imag* or tractography).mp. 10. exp Ultrasonography/ 11. ((2D or 3D) adj5 (ultras* or US)).mp. 12. ((intra‐operative or intraoperative) adj5 (ultras* or US or IOUS or imag* or navigat* or technolog* or modalit* or eval* or monitor*)).mp. 13. (volumetric reconstruction or Sonowand or SonoWand).mp. 14. Neuronavigation/ 15. Surgery, Computer‐Assisted/ 16. (navigat* or neuronavigat* or neuro‐navigat* or image guid*).mp. 17. (Brainlab or Stealth).mp. 18. exp Monitoring, Intraoperative/ 19. Fluorescence/ 20. Aminolevulinic Acid/ 21. (fluorescen* or immunofluorescen*).mp. 22. (aminolevulinic acid or 5‐aminolevulinic acid).mp. 23. (ALA or 5‐ALA or Gliolan).mp. 24. 8 or 9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 25. 7 and 24 26. randomized controlled trial.pt. 27. controlled clinical trial.pt. 28. randomized.ab. 29. placebo.ab. 30. clinical trials as topic.sh. 31. randomly.ab. 32. trial.ti. 33. 26 or 27 or 28 or 29 or 30 or 31 or 32 34. (animals not (humans and animals)).sh. 35. 33 not 34 36. 25 and 35
Key mp = title, abstract, original title, name of substance word, subject heading word, keyword heading word, protocol supplementary concept word, rare disease supplementary concept word, unique identifier ab = abstract sh = subject heading ti = title pt = publication type
Appendix 3. Embase RCT strategy
1. exp central nervous system tumor/ 2. ((central nervous system or CNS or brain* or cerebral* or intracerebral or intra‐cerebral or intracranial or intra‐cranial or spine or spinal or astrocytic or oligodendroglial or ependymal) adj5 (cancer* or tumor* or tumour* or malignan* or neoplas* or carcinoma* or metastat*)).mp. 3. exp neuroepithelioma/ 4. ((cranial or paraspinal or meninges or haematopoietic system or germ cell or germ‐cell or sellar or glioneural or neuroectodermal or embryonal or neuroepithelial or pineal or choroid plexus or teratoid or rhabdoid) adj5 (tumor* or tumour*)).mp. 5. exp glioma/ 6. (glioma* or glial* or astrocytoma* or xanthoastrocytoma* or glioblastoma* or gliosarcoma* or oligodendrogli* or oligoastrocyt* or ependym* or subependym* or astroblastoma* or ganglioglioma* or gangliocytoma* or neurocytoma* or liponeurocytoma* or pineocytoma* or pineoblastoma* or medulloblastoma* or neuroblastoma* or ganglioneuroblastoma*or medulloepithelioma* or GBM*).mp. 7. 1 or 2 or 3 or 4 or 5 or 6 8. exp nuclear magnetic resonance imaging/ 9. (intra operative magnetic resonance imag* or intra‐operative magnetic resonance imag* or intra operative MRI or intra‐operative MRI or iMRI or ioMRI or IOMRI or IoMRI or MRI or MRi or NMRI or NMRi or magnetic resonance imag* or tractography).mp. 10. exp echography/ 11. ((2D or 3D) adj5 (ultras* or US)).mp. 12. ((intra‐operative or intraoperative) adj5 (ultras* or US or IOUS or imag* or navigat* or technolog* or modalit* or eval* or monitor*)).mp. 13. (volumetric reconstruction or Sonowand or SonoWand).mp. 14. neuronavigation/ 15. computer assisted surgery/ 16. (navigat* or neuronavigat* or neuro‐navigat* or image guid*).mp. 17. (Brainlab or Stealth).mp. 18. exp intraoperative monitoring/ 19. fluorescence/ 20. aminolevulinic acid/ 21. (fluorescen* or immunofluorescen*).mp. 22. (aminolevulinic acid or 5‐aminolevulinic acid).mp. 23. (ALA or 5‐ALA or Gliolan).mp. 24. 8 or 9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 25. 7 and 24 26. crossover procedure/ 27. double‐blind procedure/ 28. randomized controlled trial/ 29. single‐blind procedure/ 30. random*.mp. 31. factorial*.mp. 32. (crossover* or cross over* or cross‐over*).mp. 33. placebo*.mp. 34. (double* adj blind*).mp. 35. (singl* adj blind*).mp. 36. assign*.mp. 37. allocat*.mp. 38. volunteer*.mp. 39. 26 or 27 or 28 or 29 or 30 or 31 or 32 or 33 or 34 or 35 or 36 or 37 or 38 40. 25 and 39 41. (exp animal/ or nonhuman/ or exp animal experiment/) not human/ 42. 40 not 41
Key
mp=title, abstract, original title, name of substance word, subject heading word, keyword heading word, protocol supplementary concept word, rare disease supplementary concept word, unique identifier ab=abstract sh=subject heading ti=title pt=publication type
Appendix 4. MEDLINE economic search strategy
1. exp Central Nervous System Neoplasms/ 2. ((central nervous system or CNS or brain* or cerebral* or intracerebral or intra‐cerebral or intracranial or intra‐cranial or spine or spinal or astrocytic or oligodendroglial or ependymal) adj5 (cancer* or tumor* or tumour* or malignan* or neoplas* or carcinoma* or metastat*)).mp. 3. exp neoplasms, neuroepithelial/ 4. ((cranial or paraspinal or meninges or haematopoietic system or germ cell or germ‐cell or sellar or glioneural or neuroectodermal or embryonal or neuroepithelial or pineal or choroid plexus or teratoid or rhabdoid) adj5 (tumor* or tumour*)).mp. 5. exp Glioma/ 6. (glioma* or glial* or astrocytoma* or xanthoastrocytoma* or glioblastoma* or gliosarcoma* or oligodendrogli* or oligoastrocyt* or ependym* or subependym* or astroblastoma* or ganglioglioma* or gangliocytoma* or neurocytoma* or liponeurocytoma* or pineocytoma* or pineoblastoma* or medulloblastoma* or neuroblastoma* or ganglioneuroblastoma*or medulloepithelioma* or GBM*).mp. 7. 1 or 2 or 3 or 4 or 5 or 6 8. exp Magnetic Resonance Imaging/ 9. (intra operative magnetic resonance imag* or intra‐operative magnetic resonance imag* or intra operative MRI or intra‐operative MRI or iMRI or ioMRI or IOMRI or IoMRI or MRI or MRi or NMRI or NMRi or magnetic resonance imag* or tractography).mp. 10. exp Ultrasonography/ 11. ((2D or 3D) adj5 (ultras* or US)).mp. 12. ((intra‐operative or intraoperative) adj5 (ultras* or US or IOUS or imag* or navigat* or technolog* or modalit* or eval* or monitor*)).mp. 13. (volumetric reconstruction or Sonowand or SonoWand).mp. 14. Neuronavigation/ 15. Surgery, Computer‐Assisted/ 16. (navigat* or neuronavigat* or neuro‐navigat* or image guid*).mp. 17. (Brainlab or Stealth).mp. 18. exp Monitoring, Intraoperative/ 19. Fluorescence/ 20. Aminolevulinic Acid/ 21. (fluorescen* or immunofluorescen*).mp. 22. (aminolevulinic acid or 5‐aminolevulinic acid).mp. 23. (ALA or 5‐ALA or Gliolan).mp. 24. 8 or 9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 25. 7 and 24 26. economics/ 27. exp "costs and cost analysis"/ 28. economics, dental/ 29. exp "economics, hospital"/ 30. economics, medical/ 31. economics, nursing/ 32. economics, pharmaceutical/ 33. (economic$ or cost or costs or costly or costing or price or prices or pricing or pharmacoeconomic$).ti,ab. 34. (expenditure$ not energy).ti,ab. 35. (value adj1 money).ti,ab. 36. budget$.ti,ab. 37. 26 or 27 or 28 or 29 or 30 or 31 or 32 or 33 or 34 or 35 or 36 38. ((energy or oxygen) adj cost).ti,ab. 39. (metabolic adj cost).ti,ab. 40. ((energy or oxygen) adj expenditure).ti,ab. 41. 38 or 39 or 40 42. 37 not 41 43. letter.pt. 44. editorial.pt. 45. historical article.pt. 46. 43 or 44 or 45 47. 42 not 46 48. Animals/ 49. Humans/ 50. 48 not (48 and 49) 51. 47 not 50 52. 25 and 51
Key mp = title, abstract, original title, name of substance word, subject heading word, keyword heading word, protocol supplementary concept word, rare disease supplementary concept word, unique identifier ab = abstract sh = subject heading ti = title pt = publication type
Appendix 5. Embase economic search strategy
1. exp central nervous system tumor/ 2. ((central nervous system or CNS or brain* or cerebral* or intracerebral or intra‐cerebral or intracranial or intra‐cranial or spine or spinal or astrocytic or oligodendroglial or ependymal) adj5 (cancer* or tumor* or tumour* or malignan* or neoplas* or carcinoma* or metastat*)).mp. 3. exp neuroepithelioma/ 4. ((cranial or paraspinal or meninges or haematopoietic system or germ cell or germ‐cell or sellar or glioneural or neuroectodermal or embryonal or neuroepithelial or pineal or choroid plexus or teratoid or rhabdoid) adj5 (tumor* or tumour*)).mp. 5. exp glioma/ 6. (glioma* or glial* or astrocytoma* or xanthoastrocytoma* or glioblastoma* or gliosarcoma* or oligodendrogli* or oligoastrocyt* or ependym* or subependym* or astroblastoma* or ganglioglioma* or gangliocytoma* or neurocytoma* or liponeurocytoma* or pineocytoma* or pineoblastoma* or medulloblastoma* or neuroblastoma* or ganglioneuroblastoma*or medulloepithelioma* or GBM*).mp. 7. 1 or 2 or 3 or 4 or 5 or 6 8. exp nuclear magnetic resonance imaging/ 9. (intra operative magnetic resonance imag* or intra‐operative magnetic resonance imag* or intra operative MRI or intra‐operative MRI or iMRI or ioMRI or IOMRI or IoMRI or MRI or MRi or NMRI or NMRi or magnetic resonance imag* or tractography).mp. 10. exp echography/ 11. ((2D or 3D) adj5 (ultras* or US)).mp. 12. ((intra‐operative or intraoperative) adj5 (ultras* or US or IOUS or imag* or navigat* or technolog* or modalit* or eval* or monitor*)).mp. 13. (volumetric reconstruction or Sonowand or SonoWand).mp. 14. neuronavigation/ 15. computer assisted surgery/ 16. (navigat* or neuronavigat* or neuro‐navigat* or image guid*).mp. 17. (Brainlab or Stealth).mp. 18. exp intraoperative monitoring/ 19. fluorescence/ 20. aminolevulinic acid/ 21. (fluorescen* or immunofluorescen*).mp. 22. (aminolevulinic acid or 5‐aminolevulinic acid).mp. 23. (ALA or 5‐ALA or Gliolan).mp. 24. 8 or 9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17 or 18 or 19 or 20 or 21 or 22 or 23 25. 7 and 24 26. Health Economics/ 27. exp Economic Evaluation/ 28. exp Health Care Cost/ 29. pharmacoeconomics/ 30. 26 or 27 or 28 or 29 31. (econom$ or cost or costs or costly or costing or price or prices or pricing or pharmacoeconomic$).ti,ab. 32. (expenditure$ not energy).ti,ab. 33. (value adj2 money).ti,ab. 34. budget$.ti,ab. 35. 31 or 32 or 33 or 34 36. 30 or 35 37. letter.pt. 38. editorial.pt. 39. note.pt. 40. 37 or 38 or 39 41. 36 not 40 42. (metabolic adj cost).ti,ab. 43. ((energy or oxygen) adj cost).ti,ab. 44. ((energy or oxygen) adj expenditure).ti,ab. 45. 42 or 43 or 44 46. 41 not 45 47. 25 and 46 48. (exp animal/ or nonhuman/ or exp animal experiment/) not human/ 49. 47 not 48
Key mp=title, abstract, original title, name of substance word, subject heading word, keyword heading word, protocol supplementary concept word, rare disease supplementary concept word, unique identifier ab=abstract sh=subject heading ti=title
pt=publication type
Characteristics of studies
Characteristics of included studies [ordered by study ID]
Kubben 2014.
Study characteristics | ||
Methods | Randomised controlled trial. Randomisation: Participants were randomised and allocated to either conventional neurosurgery or iMRI. Randomisation was performed by the first author using specific software for randomisation in clinical trials. No randomisation blocks were used. Sample size: "To reduce the chance for type I errors (false positive) we used an alpha value of 0.05. To reduce the chance for type II errors (false negative) we used a beta value of 0.2 leading to a power of 0.8. We considered a 10% additional resection of the preoperative tumor volume as the minimal clinically relevant difference, with an estimated standard deviation of approximately 12%. This led to 23 patients in each treatment group. To compensate for loss to follow‐up we intended to include a total of 54 patients for the complete study." Blinding: "The neurosurgeon could not be blinded for the procedure. We did not intend to blind the physicians on the ward, nor the patients. Volumetric assessment of pre‐ and postoperative tumor volume was performed by a single blinded researcher." |
|
Participants | Inclusion criteria: Supratentorial brain tumour suspected to be glioblastoma on contrast‐enhanced diagnostic MRI, indication for gross total resection of the tumour, age 18 years or older, WHO Performance Scale 2 or better, ASA class 3 or better, adequate knowledge of the Dutch or French language, and informed consent. Exclusion criteria: Recurrent brain tumour, multiple brain tumour localisations, earlier skull radiotherapy, earlier chemotherapy for glioblastoma, chronic kidney disease or other renal function disorder, and a known magnetic resonance‐contrast allergy. |
|
Interventions | Intervention: Low field intraoperative MRI (Medtronic PoleStar N20 0.15 Tesla moveable magnet and the StarShield tent). Control: Neuronavigation guided tumour resection. |
|
Outcomes | Residual tumour volume; complications; quality of life (EORTC QLQ‐C30); overall survival | |
Notes | Sponsored by Medtronic: "This study is part of the PhD thesis of the first author, and has been financially supported by Medtronic Navigation. Medtronic Navigation was not involved in writing the protocol, had no access to the data, was not involved in writing the manuscript, and had no veto right for submission." Definitions: Residual tumour volume (RTV) percentage is used as the primary endpoint to assess extent of tumour resection. Pre‐ and postoperative tumour volume was calculated by segmenting the hyperintense area on contrast‐enhanced T1 MRI (including enclosed central necrosis) and subtracting the hyperintense area on native T1 MRI to compensate for blood in the resection cavity. Measurements were performed using OsiriX software (Pixmeo SARL, Bernex, Switzerland) on Mac OS X using a Wacom Bamboo pen mouse for contour drawing. Postoperative tumour volume was divided by preoperative tumour volume to calculate the fraction of RTV. Multiplying the fraction with 100% provided the RTV. In formula: RTV = (postoperative contrast enhancement/preoperative contrast enhancement) × 100% |
|
Risk of bias | ||
Bias | Authors' judgement | Support for judgement |
Random sequence generation (selection bias) | Low risk | Randomisation was performed by the first author using TEN‐ALEA software for randomisation in clinical trials. |
Allocation concealment (selection bias) | Unclear risk | Not stated |
Blinding of participants and personnel (performance bias) All outcomes | High risk | "The neurosurgeon could not be blinded for the procedure. We did not intend to blind the physicians on the ward, nor the patients. Volumetric assessment of pre‐ and postoperative tumor volume was performed by a single blinded researcher." |
Blinding of outcome assessment (detection bias) All outcomes | Low risk | "The neurosurgeon could not be blinded for the procedure. We did not intend to blind the physicians on the ward, nor the patients. Volumetric assessment of pre‐ and postoperative tumor volume was performed by a single blinded researcher." |
Incomplete outcome data (attrition bias) All outcomes | Low risk | All participants are accounted for and included in the analysis. |
Selective reporting (reporting bias) | High risk | Quality of life data not reported: "After consultation of a health‐technology assessment expert we decided to refrain from any further statistical analyses due to the small sample size." |
Other bias | High risk | 1. Interim analysis/abbreviated study. Stopped on the basis of the interim analysis, although this was not specified a priori. Reasons for stopping included slow recruitment, technical issues with the equipment, prolonged duration of surgery, and concerns over effect size ("the main reason was that we estimated that our minimally required difference of 10% would not be consistent with the actual results"). 2. Industry sponsorship: "This study is part of the PhD thesis of the first author, and has been financially supported by Medtronic Navigation. Medtronic Navigation was not involved in writing the protocol, had no access to the data, was not involved in writing the manuscript, and had no veto right for submission." |
Senft 2011.
Study characteristics | ||
Methods | Randomised controlled trial. Randomisation of participants was done in blocks of 4 on a 1‐to‐1 ratio using BiAS for Windows 9.01 by an assistant who had no clinical involvement in the trial. Sample size: The sample size calculation was done to detect a difference of 25% between groups for the primary endpoint with a power of 80%. Blinding: Investigators who assessed eligibility of participants and scheduled surgeries were masked to treatment group assignment by use of a sealed envelope design. Surgeons and participants were not masked to the treatment group assignment, but the neuroradiologist who analysed MRI data was masked. |
|
Participants | Inclusion criteria: Adults ( ≥ 18 years) with known or suspected gliomas showing distinct contrast enhancement on T1‐ weighted MRI amenable to radiologically complete resection were eligible. Exclusion criteria: Presence of cardiopulmonary or hepatorenal comorbidities; tumours that crossed the midline or were located in the basal ganglia, cerebellum, brain stem, or otherwise in close proximity to eloquent brain structures prohibiting or questioning complete resectability; contraindications to MRI examination (e.g. pacemaker); and inability to give consent due to neuropsychological deficits or a language barrier. |
|
Interventions | Intervention: Mobile intraoperative ultralow field (0.15 Tesla) MRI system (PoleStar N‐20, Odin Medical Technologies, Yokneam, Israel and Medtronic, Louisville, CO, USA). Control: "Conventional micro neurosurgical resection" including Cavitron Ultrasonic Aspirator (CUSA) and neuronavigation. The use of intraoperative ultrasound or fluorescence‐guided surgery with 5‐aminolevulinic acid was not allowed in either group. |
|
Outcomes | Primary: Extent of resection. Secondary: "Volume of residual tumour on postoperative MRI and progression‐free survival (PFS) at 6 months. We also compared the duration of surgery and treatment‐related morbidity." |
|
Notes | Definitions: All participants underwent high‐field MRI at 1.5 T or 3.0 T with and without contrast agent within 7 days before surgery and within 72 h after surgery. 1 masked, independent, and experienced neuroradiologist (AB) assessed MRIs to establish the extent of resection and undertake volumetric analyses of the tumours and tumour residues. Residual tumour was defined as detectable contrast enhancement on T1‐weighted imaging with a volume of more than 0.175 cm3 on postoperative MRI as done previously. |
|
Risk of bias | ||
Bias | Authors' judgement | Support for judgement |
Random sequence generation (selection bias) | Low risk | Randomisation of participants was done in blocks of 4 on a 1‐to‐1 ratio using BiAS for Windows 9.01 by an assistant who had no clinical involvement in the trial. |
Allocation concealment (selection bias) | High risk | Sealed envelope design |
Blinding of participants and personnel (performance bias) All outcomes | High risk | Surgeons and participants were not blinded. |
Blinding of outcome assessment (detection bias) All outcomes | Low risk | Only the neuroradiologist analysing the MRI data was blinded, which is important for assessing extent of resection. Assessors of clinical outcomes were not masked, which would have affected PFS and treatment‐related morbidity. |
Incomplete outcome data (attrition bias) All outcomes | High risk | 49 of 58 participants analysed (4 excluded in each arm due to diagnosis of a metastasis, and 1 in the iMRI arm withdrew consent). |
Selective reporting (reporting bias) | Low risk | All prespecified outcomes reported (extent of resection, residual tumour volume, PFS, and treatment‐related morbidity). |
Other bias | High risk | 1. Interim analysis/abbreviated trial. Stopped early due to an interim analysis resulting in a reduced sample size from 80 to 58. Due to the possible effect of this adjustment on the alpha error and to avoid over‐interpretation of the data, a P value of less than 0.04 was considered significant for the primary endpoint. 2. Industry sponsorship. No external funding source for the study declared, but one of the authors received an honorarium from Medtronic, which manufactures the scanner used. |
Stummer 2006.
Study characteristics | ||
Methods | Randomised controlled trial. Randomisation was done by use of a dynamic allocation algorithm at a separate research unit, in which participants were allocated to minimise the imbalance between treatment groups. No permuted block randomisation was applied. Treatment allocation was communicated to local investigators first by telephone and additionally by fax. Sample size: Initial power calculations estimated 350 participants were required for an 80% power, but to allow premature study termination an interim analysis was scheduled after 270 participants whereby a 20\5 difference in PFS could be identified with a power of 80%. |
|
Participants | Inclusion criteria: People aged 18 to 72 years with suspected (as assessed by study surgeon) newly diagnosed and untreated malignant glioma. Tumours were to have a distinct ring‐like pattern of contrast enhancement with thick irregular walls on MRI and a core area of reduced signal suggestive of tumour necrosis. Exclusion criteria: Tumours in the midline, basal ganglia, cerebellum, or brain stem; more than 1 contrast‐enhancing lesion; substantial, non‐contrast‐enhancing tumour with areas suggesting low‐grade glioma with malignant transformation; medical reasons precluding MRI; inability to give consent; a tumour location that did not enable complete resection; KPS of 60 or less; renal or liver insufficiency; and a history of previous systemic malignancy. |
|
Interventions | Intervention: 5‐aminolevulinic acid (20 mg/kg body weight; medac, Wedel, Germany) in freshly prepared solutions orally 3 h (range 2 to 4) preoperatively. Solutions were prepared by dissolving the contents of a vial (1.5 g) in 50 mL of drinking water. Surgery was done by use of a modified neurosurgical microscope (OPMI Neuro/NC4 system with fluorescence kit, Carl Zeiss Surgical GmbH, Oberkochen, Germany), which enabled switching from conventional white xenon illumination to violet–blue excitation light. Control: Conventional microsurgery with white light. There was no placebo. For participants assigned white light, the tumour was resected by use of conventional illumination. |
|
Outcomes | Primary endpoints: complete tumour resection on MRI (< 72 hours post‐operation and > 1.5 T) and PFS. Secondary endpoints: residual tumour volume, overall survival, type and severity of neurological deficits after surgery, and toxic effects. Follow‐up was at 6 weeks then 3 months and subsequently at 3 monthly intervals until 18 months. |
|
Notes | Residual tumour was defined as contrast enhancement with a volume more than 0.175 cm3. Progression was defined as the occurrence of a new tumour lesion with a volume greater than 0.175 cm3, or an increase in residual tumour volume of more than 25%. Progression‐free survival was defined radiologically in the initial trial and by combined measures in the follow‐up paper (radiological criteria as above plus any new tumour or neurological worsening as defined by an NIHSS score increase over 1). Adverse events were classified according to the US National Cancer Institute common toxicity criteria (version 1.0). The NIHSS was used to measure postoperative deficits at 2 and 7 days after surgery, radiological progression at 6 weeks, then at 3, 6, 9, 12, 15, and 18 months' postsurgery. Intercentre consistency was not presented. The manufacturer of 5‐aminolevulinic acid (medac GmbH) was involved in the trial, and authors received assistance from the sponsor. |
|
Risk of bias | ||
Bias | Authors' judgement | Support for judgement |
Random sequence generation (selection bias) | Low risk | Performed independently with a dynamic allocation algorithm |
Allocation concealment (selection bias) | Low risk | Treatment allocation was communicated by telephone and fax. |
Blinding of participants and personnel (performance bias) All outcomes | High risk | There was no blinding of surgeons, participants, or those involved with treatment. |
Blinding of outcome assessment (detection bias) All outcomes | Low risk | Neuropathology and neuroradiological assessments were blinded, which is important for assessing extent of resection. Clinical outcome assessment was not blinded, which would have affected PFS and adverse events. |
Incomplete outcome data (attrition bias) All outcomes | High risk | 13 participants were excluded for major violations of MRI inclusion criteria. 34 participants were excluded for histological criteria. In total, out of 322 randomly assigned participants, 270 were analysed intention to treat and 251 per protocol. |
Selective reporting (reporting bias) | High risk | Full outcome data were not presented for survival, PFS, and adverse events (particularly in the earlier article and less so in the follow‐up paper). For example, Kaplan‐Meier plots with hazard ratio, 95% confidence interval and log‐rank analyses for the full cohort were not present for survival, PFS (no hazard ratio with 95% confidence interval), or time to deteriorate in the NIHSS (subgroup only of those with complete resection). Timing and severity of all adverse events were not fully documented (e.g. there were no data on wound infections or related complications and medical complications such as pulmonary thromboembolism). |
Other bias | High risk | 1. Industry involvement. The sponsor was involved in the study. It was emphasised that there was no direct link with data interpretation. In addition, selected authors received remuneration from the sponsor. |
Willems 2006.
Study characteristics | ||
Methods | Randomised controlled trial. Participants were stratified by age (< 45 or ≥ 45) and KPS (≤ 70 or > 70), and they were evenly randomised to SS (without neuronavigation) or SN (with neuronavigation) using a computer‐generated list with allocation codes in random order, balanced for each stratum using blocks of 4. Sample size: Based on the results of a power analysis (details not specified in the paper), the authors planned to include 182 participants in the study, but the trial was stopped at 45 participants after an early pilot analysis. There was no blinding. |
|
Participants | Inclusion criteria: Solitary intracerebral space‐occupying lesion with (partial) contrast enhancement eligible for surgical debulking with the intention of gross total resection. Exclusion criteria: Previous neurosurgical treatment or any other known primary tumour elsewhere in the body. |
|
Interventions | Intervention: Neuronavigation was performed with bone fiducial markers. Preoperative magnetic resonance images were obtained using a 0.5‐Tesla system with contrast‐enhanced T1 weighted images. Volumetric measurements were performed to assess total lesion volume. Functional grading was recorded according to the MD Anderson scheme (Sawaya 1998). Planning involved localisation using fiducial markers, trajectory planning, and segmentation of the tumour boundary. Tools included an infrared pointer or mechanically tracked operating microscope. |
|
Outcomes | The primary outcome was extent of resection and survival. Other outcomes were procedure duration, usefulness of neuronavigation, extent of resection, quality of life, and postoperative course (including neurological status and adverse events). | |
Notes | There were 3 early deaths in the navigation arm from systemic causes, which with the low numbers in each arm skewed the results. Interim analysis/abbreviated study. Definitions: Postoperative magnetic resonance images were obtained within 72 hours and subject to volumetric analysis. Clinical assessment was performed postoperatively within 3 days, 1 week, 6 weeks, and 3 months to assess adverse events and neurological status (using KPS and BI scores). A quality of life questionnaire (EORTC QLQ‐C30 and BR‐20) was filled out preoperatively and approximately 3 months after surgery. |
|
Risk of bias | ||
Bias | Authors' judgement | Support for judgement |
Random sequence generation (selection bias) | Low risk | The participants were randomised to SS (without neuronavigation) or SN (with neuronavigation) using a computer‐generated list with allocation codes in random order, balanced for each stratum using blocks of 4. However, groups were not evenly distributed at baseline, with more eloquently located tumours in the standard surgery arm and histology with more metastasis in the navigation arm (although the latter was a variable not able to be determined preoperatively). |
Allocation concealment (selection bias) | Unclear risk | Unclear risk |
Blinding of participants and personnel (performance bias) All outcomes | High risk | Not blinded |
Blinding of outcome assessment (detection bias) All outcomes | High risk | Not blinded |
Incomplete outcome data (attrition bias) All outcomes | High risk | 1 participant was excluded due to an alternative diagnosis (meningioma). Postoperative imaging was only assessed in 34/45 participants for tumour volume and 40/45 for contrast‐enhancing volume. Data for quality of life at 3 months were only reported on 64.5% of the total eligible population. |
Selective reporting (reporting bias) | High risk | All outcome measures were reported to a degree. However, full data with suitable presentation and analysis were not available for survival (no Kaplan‐Meier plots), quality of life (no statistical analysis), and adverse events (no presentation of numbers of events). |
Other bias | High risk | The trial was significantly underpowered and was terminated prematurely. Out of 280 potentially eligible participants, only 46 participants were included, with a planned target of 182. |
ASA: American Society of Anesthesiologists EORTC QLQ‐C30: European Organisation for Research and Treatment of Cancer quality of life assessment KPS: Karnofsky performance score iMRI: intraoperative magnetic resonance imaging MRI: magnetic resonance imaging NIHSS: National Institutes of Health Stroke Scale PFS: progression‐free survival
Characteristics of excluded studies [ordered by study ID]
Study | Reason for exclusion |
---|---|
Chen 2011 | Only abstract available (report is of published conference proceedings). Contacted authors but no reply. Insufficient information available to fully assess trial for either qualitative or quantitative inclusion. |
Chen 2012 | Only abstract available (report is of published conference proceedings). Contacted authors but no reply. Insufficient information available to fully assess trial for either qualitative or quantitative inclusion. |
Czyz 2011 | Not a randomised controlled trial |
Eljamel 2008 | The addition of repetitive photodynamic therapy essentially precludes analysis of this trial as a test of intraoperative imaging alone. |
Koc 2008 | Prospective study; participants were not randomised. |
Rohde 2011 | This trial assessed specificity and sensitivity of intraoperative 3D ultrasound as diagnostic test rather than treatment option. |
Seddighi 2016 | Only abstract available (report is of published conference proceedings). Contacted authors but no reply. Insufficient information available to fully assess trial for either qualitative or quantitative inclusion. |
Stepp 2007 | Further report of Stummer 2006 trial; only new data are on spectroscopy and photodynamic therapy. |
Stummer 2017 | A randomised controlled trial on the diagnostic effects of different doses of 5‐aminolevulinic acid (clinical, spectrophotometric, pathological). |
Wu 2003 | Author stated that this was not a randomised controlled trial. |
Wu 2004 | Author stated that this was not a randomised controlled trial. |
Wu 2007 | Author stated that this was not a randomised controlled trial. |
Zhang 2015 | Not a randomised controlled trial; "patient selection was based on economic status and the availability of iMRI'" |
iMRI: intraoperative magnetic resonance imaging
Characteristics of ongoing studies [ordered by study ID]
NCT00752323.
Study name | Imaging procedure using ALA in finding residual tumor in grade IV malignant astrocytoma |
Methods | "Randomised" ‐ possibly diagnostic only trial design |
Participants | Newly diagnosed and recurrent grade IV glioma |
Interventions | 2 doses of 5‐ALA |
Outcomes |
|
Starting date | August 2008 |
Contact information | Andrew Sloan |
Notes | Case Medical Center, Cleveland, Ohio, USA |
NCT00977327.
Study name | Comparison of neuronavigational systems for resection‐control of brain tumors |
Methods | Randomised trial |
Participants | Neuroradiological evidence of a brain lesion |
Interventions | Intraoperative magnetic resonance (PoleStar N‐20) versus intraoperative ultrasound (SonoWand) |
Outcomes |
|
Starting date | 2009 |
Contact information | Andrew Kanner |
Notes | Tel Aviv, Israel |
NCT01502280 (BALANCE).
Study name | Fluorescence‐guided surgery for low‐ and high‐grade gliomas |
Methods | Randomised. Single‐blind |
Participants | Newly diagnosed glioma (high and low grade) |
Interventions | 5‐ALA (Gliolan) versus placebo (ascorbic acid) |
Outcomes |
|
Starting date | November 2010 |
Contact information | Nader Sanai (principal investigator), Norissa Honea (overall contact) |
Notes | Barrow, Phoenix, Arizona, USA |
NCT01798771 (IMAGER).
Study name | Intraoperative MRI and 5‐ALA Guidance to Improve the Extent of Resection in Brain Tumor Surgery (IMAGER) |
Methods | Randomised |
Participants | Newly diagnosed supratentorial intra‐axial brain tumour suspicious for malignant glioma. Deemed resectable |
Interventions | Intervention: 5‐ALA and intraoperative MRI Control: 5‐ALA |
Outcomes |
|
Starting date | February 2013 |
Contact information | Christian Senft |
Notes | Johann Wolfgang Goethe University Hospitals, Germany |
Wu 2014.
Study name | |
Methods | Randomised controlled trial. Randomisation was done by 2 clinical research associates (QY Wu and Ye Wang) at the clinical research institute, Huashan Hospital, using software specially designed for this trial according to a dynamic allocation algorithm. This software ensured that no one could predict the randomisation result. This dynamic allocation algorithm ensured the minimum imbalance between groups after recruiting each participant within 6 covariates with different weights, including tumour grade · 3 (HGG versus LGG), age · 2 (18 to 44, 45 to 64, or 65 to 70 years), KPS · 2 (70 to 90 versus 100), the vicinity of tumour to eloquent brain regions · 1 (non‐eloquent versus eloquent), tumour site · 1 (frontal, parietal, temporal, insular, or occipital lobe), and hemisphere mainly involved by tumour · 1 (non‐dominant versus dominant). Sample size: The estimated sample size was 320 participants to detect a difference of 15% between the study arms for the primary endpoint in the full analysis set, given 90% complete power (e.g. probability of rejecting all false null hypotheses) with an experiment‐wise type I error of 0.05. |
Participants | Inclusion criteria: 18 to 70 years of age with newly diagnosed (diagnosed presurgically by board‐certified radiologists and neurosurgeons), untreated malignant cerebral glioma (WHO grade II‐IV); with supratentorial lesion involving the frontal, temporal, parietal, occipital, and/or insular lobe; with or without the lesion in an eloquent area; with preoperative assessment of attainable radiologically gross total tumour resection (by board‐certified anaesthesiologists and neurosurgeons); and with presurgical KPS score 70. Exclusion criteria: Recurrent glioma after initial surgical intervention (except needle biopsy); primary glioma with prior radiotherapy or chemotherapy; lesions of the midline, basal ganglia, cerebellum, or brainstem; renal insufficiency or hepatic insufficiency; history of malignancy at the body site; other critical tumour location or physical status that did not enable complete resection of the tumour or restricted life expectancy; and contraindications precluding iMRI acquisition. |
Interventions | Intervention: All resections were completed as safely as possible by the consultant surgeons in the same 3‐Tesla iMRI integrated neurosurgical suite by IMRIS Neuro (IMRIS, Inc). Control: No further surgery. |
Outcomes | Primary: Extent of resection (EOR). Secondary: Progression‐free survival; overall survival; and surgery‐related morbidity. |
Starting date | September 2011 |
Contact information | Jinsong Wu |
Notes | Interim analysis ‐ awaiting full results. Definitions: Gross total resection (GTR) was defined as the complete disappearance of all enhancing lesions (T1‐weighted) for HGG and the complete disappearance of all non‐enhancing (T2‐weighted fluid‐attenuated inversion recovery) lesions for LGG. The EORs were assessed quantitatively in volumetric analyses and stratified as follows: GTR, 100% resection; subtotal resection, 90% resection; partial resection, 70% resection; and biopsy. |
5‐ALA: 5‐aminolevulinic acid HGG: high‐grade glioma iMRI: intraoperative magnetic resonance imaging LGG: low‐grade glioma MRI: magnetic resonance imaging
Differences between protocol and review
There were no differences between the protocol and review.
Contributions of authors
Damiano G Barone and Michael G Hart conceptualised the review and wrote the original protocol and the review. Michael D Jenkinson and Colin Watts provided senior clinical commentary. Andrew Bryant and Theresa Lawrie provided expert methodological and statistical commentary. Luke Vale provided the brief economic commentary. Helen Bulbeck contributed to the writing of the review.
Sources of support
Internal sources
None, Other
External sources
NIHR SRPG Project: 16/114/18, UK
Declarations of interest
Michael Jenkinson: no conflict of interest related to this review. Damiano Barone: no conflict of interest related to this review. Andrew Bryant: no conflict of interest related to this review. Luke Vale: no conflict of interest related to this review. Helen Bulbeck: no conflict of interest related to this review. Theresa Lawrie: no conflict of interest related to this review. Michael Hart: no conflict of interest related to this review. Colin Watts: no conflict of interest related to this review.
Edited (no change to conclusions)
References
References to studies included in this review
Kubben 2014 {published data only (unpublished sought but not used)}
- Kubben PL, Scholtes F, Schijns OEMG, Ter Laak-Poort MP, Teernstra OPM, Kessels AGH, et al. Intraoperative magnetic resonance imaging versus standard neuronavigation for the neurosurgical treatment of glioblastoma: a randomized controlled trial. Surgical Neurology International 2014;5:70. [DOI] [PMC free article] [PubMed] [Google Scholar]
Senft 2011 {published data only (unpublished sought but not used)}
- Senft C, Bink A, Franz K, Gasser T, Seifert V. Intra-operative MRI-guided vs. conventional microsurgical brain tumor resection - results of a prospective randomized trial. In: Journal of Neurosurgery: Abstract number 602.. Vol. 115. 2011.
- Senft C, Bink A, Franz K, Vatter H, Gasser T, Seifert V. Intraoperative MRI guidance and extent of resection in glioma surgery: a randomised, controlled trial. Lancet Oncology 2011;12(11):997-1003. [DOI] [PubMed] [Google Scholar]
- Senft C, Bink A, Heckelmann M, Gasser T, Seifert V. Glioma extent of resection and ultra-low-field iMRI: interim analysis of a prospective randomized controlled trial. Acta Neurochirurgica Supplementum 2011;109:49-53 [CRSREF: 3298840]. [DOI] [PubMed] [Google Scholar]
Stummer 2006 {published data only}
- Pichelmeier U, Bink A, Schackert G, Stummer W, ALA Glioma Study Group. Resection and survival in glioblastoma multiforme: an RTOG recursive partitioning analysis of ALA study patients. Neuro-oncology 2008;10(6):1025-34 [CRSREF: 3298842]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Stummer W, Pichlmeier U, Meinel T, Wiestler OD, Zanella F, Roulen HJ, ALA Glioma Study Group. Fluorescence-guided surgery with 5-aminolevulinic acid for resection of malignant glioma: a randomised controlled multicentre phase III trial. Lancet Oncology 2006;7(5):392-401. [DOI] [PubMed] [Google Scholar]
- Stummer W, Reulen H-J, Meinel T, Pichelmeier U, Schumacher W, Tonn J-C, et al, ALA-Glioma Study Group. Extent of resection and survival in glioblastoma multiforme: identification of and adjustment for bias. Neurosurgery 2008;62:564-76 [CRSREF: 32988]. [DOI] [PubMed] [Google Scholar]
- Stummer W, Tonn J-C, Mehdorn HM, Nestler U, Franz K, Goetz C, et al, ALA-Glioma Study group. Counterbalancing risks and gains from extended resections in malignant glioma surgery: a supplemental analysis from the randomized 5-aminolevulinic acid glioma resection study. Journal of Neurosurgery 2011;114(3):613-23 [CRSREF: 3298845]. [DOI] [PubMed] [Google Scholar]
Willems 2006 {published data only}
- Willems PW, Taphoorn MJ, Burger H, Berkelbach van der Sprenkel JW, Tulleken CAF. Effectiveness of neuronavigation in resecting solitary intracerebral contrast-enhancing tumors: a randomized controlled trial. Journal of Neurosurgery 2006;104(3):360-8. [DOI] [PubMed] [Google Scholar]
References to studies excluded from this review
Chen 2011 {published data only}
- Chen X, Meng X, Zhang J, Wang F, Zhao Y, Xu B-N. Low-grade insular glioma resection with 1.5T intra-operative MRI: preliminary results of a prospective randomized trial. Neuro-oncology 2011;13:iii57. [Google Scholar]
Chen 2012 {published data only (unpublished sought but not used)}
- Chen X, Meng X, Zhang J, Li F, Li J, Xu B-N. Low-grade insular glioma resection with 1.5t intra-operative MRI: preliminary results of a prospective randomized trial. Journal of Neurosurgery 2012;117(2):A406-A407. [Google Scholar]
Czyz 2011 {published data only}
- Czyz M, Tabakow P, Lechowicz-Glogowska B, Jarmundowicz W. Prospective study on the efficacy of low-field intraoperative magnetic resonance imaging in neurosurgical operations. Neurologia i Neurochirurgia Polska 2011;45(3):226-34. [DOI] [PubMed] [Google Scholar]
Eljamel 2008 {published data only}
- Eljamel MS, Goodman C, Moseley H. ALA and Photofrin fluorescence-guided resection and repetitive PDT in glioblastoma multiforme: a single centre phase III randomised controlled trial. Lasers in Medical Science 2008;23(4):361-7. [DOI] [PubMed] [Google Scholar]
Koc 2008 {published data only}
- Koc K. Fluorescein sodium-guided surgery in glioblastoma multiforme: a prospective evaluation. British Journal of Neurosurgery 2008;22(1):99-103. [DOI] [PubMed] [Google Scholar]
Rohde 2011 {published data only}
- Rohde V, Coenen VA. Intraoperative 3-dimensional ultrasound for resection control during brain tumour removal: preliminary results of a prospective randomized study. Acta Neuropathologica. Supplementum 2011;109:187-190. [DOI] [PubMed] [Google Scholar]
Seddighi 2016 {published data only (unpublished sought but not used)}
- Seddighi A, Seddighi AS, Nikouei A, Mohseni G. Image guided surgery using neuronavigation system in resection of cerebral gliomas involving eloquent cortical areas in pediatric population. Neuro-oncology 2016;18:iii128. [Google Scholar]
Stepp 2007 {published data only}
- Stepp H, Beck T, Pongratz T, Meinel T, Kreth FW, Tonn JCh, et al. ALA and malignant glioma: fluorescence-guided resection and photodynamic treatment. Journal of Environmental Pathology, Toxicology and Oncology 2007;26(2):157-64. [DOI] [PubMed] [Google Scholar]
Stummer 2017 {published data only}
- Stummer W, Stepp H, Wiestler OD, Pichlmeier U. Randomized, prospective double-blinded study comparing 3 different doses of 5-aminolevulinic acid for fluorescence-guided resections of malignant gliomas. Neurosurgery 2017;81(2):230-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
Wu 2003 {published data only (unpublished sought but not used)}
- Wu J-S, Zhou L-F, Hong X-N, Mao Y, Du G-H. Role of diffusion tensor imaging in neuronavigation surgery of brain tumors involving pyramidal tracts. Zhonghua Wai Ke za Zhi [Chinese Journal of Surgery] 2003;41(9):662-6. [PubMed] [Google Scholar]
Wu 2004 {published data only (unpublished sought but not used)}
- Wu J-S, Zhou L-F, Gao G-J, Mao Y, Du G-H. Integrating functional magnetic resonance imaging in neuronavigation surgery of brain tumors involving motor cortex. Chinese Medical Journal 2004;84(8):632-6. [PubMed] [Google Scholar]
Wu 2007 {published data only}
- Wu J-S, Mao Y, Zhou L-F, Tang W-J, Hu J, Song Y-Y, et al. Clinical evaluation and follow-up outcome of diffusion tensor imaging-based functional neuronavigation: a prospective, controlled study in patients with gliomas involving pyramidal tracts. Neurosurgery 2007;61(5):935-9. [DOI] [PubMed] [Google Scholar]
Zhang 2015 {published data only}
- Zhang J, Chen X, Zhao Y, Wang F, Li F, Xu B. Impact of intraoperative magnetic resonance imaging and functional neuronavigation on surgical outcome in patients with gliomas involving language areas. Neurosurgical Review 2015;38(2):319-30. [DOI] [PubMed] [Google Scholar]
References to ongoing studies
NCT00752323 {published data only}
- Sloan A. Imaging procedure using ALA in finding residual tumor in grade IV malignant astrocytoma. ClinicalTrials.gov 2008.
NCT00977327 {published data only}
- Kanner A. Comparison of Neuro-navigational Systems for Resection-Control of Brain Tumors. ClinicalTrials.gov August 2009.
NCT01502280 (BALANCE) {published data only}
- Honea N. Fluorescence-guided Surgery for Low- and High-grade Gliomas. ClinicalTrials.gov December 2011.
NCT01798771 (IMAGER) {published data only}
- Senft C. Intraoperative MRI and 5-ALA Guidance to Improve the Extent of Resection in Brain Tumor Surgery (IMAGER). ClinicalTrials.gov February 2013.
Wu 2014 {published data only (unpublished sought but not used)}
- Wu J-S, Gong X, Song Y-Y, Zhuang D-X, Yao C-J, Qiu T-M, et al. 3.0T iMRI guided resection in cerebral glioma surgery: interim analysis of a prospective, randomized, triple-blind, parallel-controlled trial. Clinical Neurosurgery 2013;60:167. [DOI] [PubMed] [Google Scholar]
- Wu J-S, Gong X, Song Y-Y, Zhuang D-X, Yao C-J, Qiu T-M, et al. 3.0-T intraoperative magnetic resonance imaging-guided resection in cerebral glioma surgery: interim analysis of a prospective, randomized, triple-blind, parallel-controlled trial. Neurosurgery 2014;61(Suppl 1):145-54. [DOI] [PubMed] [Google Scholar]
Additional references
Barone 2014
- Barone BG, Lawrie TA, Hart MG. Image guided surgery for the resection of brain tumours. Cochrane Database of Systematic Reviews 2014, Issue 1. Art. No: CD009685. [DOI: 10.1002/14651858.CD009685.pub2] [DOI] [PMC free article] [PubMed] [Google Scholar]
Black 1997
- Black PM, Moriarty T, Alexander E 3rd, Stieg P, Woodard EJ, Gleason PL, et al. Development and implementation of intraoperative magnetic resonance imaging and its neurosurgical applications. Neurosurgery 1997;41(4):831-42. [DOI] [PubMed] [Google Scholar]
CRD 2008
- Centre for Reviews and Dissemination. Systematic Reviews: CRD’s guidance for undertaking reviews in health care. York: York Publishing Services Limited, 2008. www.york.ac.uk/inst/crd.
Deeks 2001
- Deeks JJ, Altman DG, Bradburn MJ. Systematic review in healthcare: meta-analysis in context. In: Egger M, Davey Smith G, Altman DG, editors(s). Statistical Methods for Examining Heterogeneity and Combining Results From Several Studies in Meta-analysis. 2nd edition. London: BMJ Publication Group, 2001. [Google Scholar]
DerSimonian 1986
- DerSimonian R, Laird N. Meta-analysis in clinical trials. Controlled Clinical Trials 1986;7:177–88. [DOI] [PubMed] [Google Scholar]
Eljamel 2016
- Eljamel S, Mahboob SO. The effectiveness and cost-effectiveness of intraoperative imaging in high-grade glioma resection; a comparative review of intraoperative ALA, fluorescein, ultrasound and MRI. Photodiagnostic and Photodynamic Therapy 2016;16:35-43. [DOI] [PubMed] [Google Scholar]
Esteves 2015
- Esteves S, Alves M, Castel-Branco M, Stummer W. A pilot cost-effectiveness analysis of treatment in newly diagnosed high-grade gliomas: the example of 5-aminolevulinic acid compared to white-light surgery. Neurosurgery 2015;76(5):552-62. [DOI] [PMC free article] [PubMed] [Google Scholar]
GNOSIS 2007
- Chang S, Vogelbaum M, Lang FF, Haines S, Kunwar S, Chiocca EA, et al. GNOSIS: guidelines for neuro-oncology: standards for investigational studies - reporting of surgically based therapeutic clinical trials. Journal of Neuro-Oncology 2007;82:211-20. [DOI] [PubMed] [Google Scholar]
Hall 2003
- Hall WA, Kowalik K, Liu H, Truwit CL, Kucharezyk J. Costs and benefits of intraoperative MR-guided brain tumor resection. Acta Neurochirurgica. Supplement 2003;85:137-42. [DOI] [PubMed] [Google Scholar]
Hart 2011
- Hart MG, Grant R, Metcalfe SE. Biopsy versus resection for high grade glioma. Cochrane Database of Systematic Reviews 2011, Issue 2. Art. No: CD002034. [DOI: 10.1002/14651858.CD002034] [DOI] [PMC free article] [PubMed] [Google Scholar]
Hensen 2008
- Hensen JW, Ulmer S, Harris GJ. Brain tumor imaging in clinical trials. American Journal of Neuroradiology 2008;24(3):419-24. [DOI] [PMC free article] [PubMed] [Google Scholar]
Higgins 2011
- Higgins JPT, Green S, (editors). Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [updated March 2011]. The Cochrane Collaboration, 2011. Available at handbook.cochrane.org.
Juni 2001
- Juni P, Altman DG, Egger M. Assessing the quality of controlled clinical trials. BMJ 2001;323:42–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
Karnofsky 1948
- Karnofsky DA. The use of nitrogen mustards in the palliative treatment of carcinoma. Cancer 1948;1:634–56. [Google Scholar]
Kowalik 2000
- Kowalik K, Truwit C, Hall W, Kucharczyk. Initial assessment of costs and benefits of MRI-guided brain tumor resection. European Radiology 2000;10 (Suppl 3):s366-7. [DOI] [PubMed] [Google Scholar]
Langendam 2013
- Langendam MW, Akl EA, Dahm P, Glasziou P, Guyatt G, Schunemann HJ. Assessing and presenting summaries of evidence in Cochrane Reviews. Systematic Reviews 2013;23(2):81. [DOI] [PMC free article] [PubMed] [Google Scholar]
Louis 2016
- Louis DN, Perry A, Reifenberger G, Deimling A, Figarella-Branger D, Cavenee WK, et al. The 2016 WHO Classification of Tumours of the Central Nervous System: a summary. Acta Neuropathologica 2016;131:803-20. [DOI] [PubMed] [Google Scholar]
Makary 2011
- Makary M, Chiocca EA, Erminy N, Antor M, Bergese S, Abdel-Rasoul M, et al. Clinical and economic outcomes of low-field intraoperative MRI-guided tumor resection neurosurgery. Journal of magnetic resonance imaging 2011;34:1022-1033. [DOI] [PubMed] [Google Scholar]
Mauer 2008
- Mauer ME, Bottomley A, Taphoorn MJB. Evaluating health-related quality of life and symptom burden in brain tumour patients: instruments for use in clinical trials and clinical practice. Current Opinion in Neurology 2008;21:741–53. [DOI] [PubMed] [Google Scholar]
Meader 2014
- Meader N, King K, Llewellyn A, Norman G, Brown J, Rodgers M, et al. A checklist designed to aid consistency and reproducibility of GRADE assessments: development and pilot validation. Systematic Reviews 2104;3:82. [DOI] [PMC free article] [PubMed] [Google Scholar]
MedDRA 2008
- Medical Dictionary for Regulatory Authorities (MedDRA). www.meddramsso.com/MSSOWeb/index.htm (accessed prior to 14 December 2017) 2008.
Miwa 2004
- Miwa K, Shinoda J, Yano H, Okumura A, Iwama T, Nakashima T, et al. Discrepancy between lesion distributions on methionine PET and MR images in patients with glioblastoma multiforme: insight from a PET and MR fusion image study. Journal of Neurology, Neurosurgery and Psychiatry 2004;75:1457-62. [DOI] [PMC free article] [PubMed] [Google Scholar]
NICE 2006
- NICE: National Collaborating Centre for Cancer. Improving outcomes for people with brain and other CNS tumours - evidence review. www.nice.org.uk/nicemedia/live/10905/28965/28965.pdf (accessed prior to 14 December 2017).
Ohgaki 2009
- Ohgaki H. Epidemiology of brain tumors. Methods in Molecular Biology 2009;472:323-42. [DOI] [PubMed] [Google Scholar]
Oken 1982
- Oken MM, Creech RH, Tormey DC, Horton J, Davis TE, McFadden ET, et al. Toxicity and response criteria of the Eastern Cooperative Oncology Group. American Journal of Clinical Oncology 1982;5(6):649–55. [PubMed] [Google Scholar]
Parmar 1998
- Parmar MKB, Torri V, Stewart L. Extracting summary statistics to perform meta-analyses of the published literature of endpoints. Statistics in Medicine 1998;17:2815–34. [DOI] [PubMed] [Google Scholar]
Pichlmeier 2008
- Pichlmeier U, Bink A, Schackert G, Stummer W, ALA Glioma Study Group. Resection and survival in glioblastoma multiforme: an RTOG recursive partitioning analysis of ALA study patients. Neuro-oncology 2008;10:1025-34. [DOI] [PMC free article] [PubMed] [Google Scholar]
Regula 1995
- Regula J, MacRobert AJ, Gorchein A, Buonaccorsi GA, Thorpe SM, Spencer GM, et al. Photosensitisation and photodynamic therapy of oesophageal, duodenal, and colorectal tumours using 5 aminolaevulinic acid induced protoporphyrin IX - a pilot study. Gut 1995;36:67–75. [DOI] [PMC free article] [PubMed] [Google Scholar]
Review Manager 2014 [Computer program]
- Review Manager (RevMan). Version 5.3.5. Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014.
Schulder 2003
- Schulder M, Carmel P. Intraoperative magnetic resonance imaging: impact on brain tumor surgery. Cancer Control 2003;10(2):115-24. [DOI] [PubMed] [Google Scholar]
Seifert 2003
- Seifert V. Intraoperative MRI in neurosurgery: technical overkill or the future of brain surgery? Neurology India 2003;51:329-32. [PubMed] [Google Scholar]
Slof 2015
- Slof J, Diez Valle R, Galvin J. Cost-effectiveness of 5-aminolevulinic acid-induced fluorescence in malignant glioma surgery. Neurologia 2015;30(3):163-8. [DOI] [PubMed] [Google Scholar]
Stummer 1998
- Stummer W, Stocker S, Wagner S, Stepp H, Fritsch C, Goetz C, et al. Intraoperative detection of malignant gliomas by 5-aminolevulinic acid-induced porphyrin fluorescence. Neurosurgery 1998;42:518–25. [DOI] [PubMed] [Google Scholar]
Stummer 2000
- Stummer W, Novotny A, Stepp H, Goetz C, Bise K, Reulen HJ. Fluorescence-guided resection of glioblastoma multiforme by using 5-aminolevulinic acid-induced porphyrins: a prospective study in 52 consecutive patients. Journal of Neurosurgery 2000;93:1003–13. [DOI] [PubMed] [Google Scholar]
Stupp 2005
- Stupp R, Mason WP, den Bent MJ, Weller M, Fisher B, Taphoorn MJB, et al. Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. New England Journal of Medicine 2005;352:987-96. [DOI] [PubMed] [Google Scholar]
Unsgaard 2006
- Unsgaard G, Rygh OM, Selbekk T, Müller TB, Kolstad F, Lindseth F, et al. Intra-operative 3D ultrasound in neurosurgery. Acta Neurochirurgica 2006;148(3):235-53. [DOI] [PubMed] [Google Scholar]
Wallace 2017
- Wallace BC, Noel-Storr A, Marshall IJ, Cohen AM, Smalheiser NR, Thomas J. Identifying reports of randomized controlled trials (RCTs) via a hybrid machine learning and crowd sourcing approach. Journal of the American Medical Informatics Association 2017;24(06):1165-8. [DOI] [PMC free article] [PubMed]
Watts 2016
- Watts C, Sanai N. Surgical approaches for the gliomas. Handbook of Clinical Neurology 2016;134:51-69. [DOI] [PubMed] [Google Scholar]
Wen 2010
- Wen PY, Macdonald DR, Reardon DA, Cloughesy TF, Sorensen AG, Galanis E, et al. Updated response assessment criteria in high grade gliomas: response assessment in Neuro-Oncology Working Group. Journal of Clinical Oncology 2010;28(11):1963–72. [DOI] [PubMed] [Google Scholar]
References to other published versions of this review
Jenkinson 2017
- Jenkinson MD, Barone DG, Hart MG, Bryant A, Lawrie TA, Watts C. Intraoperative imaging technology to maximise extent of resection for glioma. Cochrane Database of Systematic Reviews 2017, Issue 9. Art. No: CD012788. [DOI: 10.1002/14651858.CD012788] [DOI] [PMC free article] [PubMed] [Google Scholar]