Abstract
Background
Detecting a benefit from closure of patent foramen ovale (PFO) in patients with cryptogenic stroke (CS) is hampered by low rates of stroke recurrence and uncertainty about the causal role of PFO in the index event. A method to predict PFO-attributable recurrence risk is needed. However, individual databases generally have too few stroke recurrences to support risk modeling. Prior studies of this population have been limited by low statistical power for examining factors related to recurrence.
Aims
To develop a database to support modeling of PFO-attributable recurrence risk by combining extant data sets.
Methods
We identified investigators with extant databases including subjects with CS investigated for PFO; determined the availability and characteristics of data in each database; collaboratively specified the variables to be included in the Risk of Paradoxical Embolism (RoPE) database; harmonized the variables across databases, and collected new primary data when necessary and feasible.
Results
The RoPE database has individual clinical, radiologic, and echocardiographic data from 12 component databases including subjects with CS both with (n=1925) and without (n=1749) PFO. In the PFO subjects, a total of 381 outcomes (stroke, TIA, death) occurred (median follow-up = 2.2yrs). While there were substantial variations in data collection between studies, there was sufficient overlap to define a common set of variables suitable for risk modeling.
Conclusion
While individual studies are inadequate for modeling PFO-attributable recurrence risk, collaboration between investigators has yielded a database with sufficient power to identify those patients at highest risk for a PFO-related stroke recurrence who may have the greatest potential benefit from PFO closure.
Keywords: cryptogenic stroke, patent foramen ovale, secondary stroke prevention, risk modeling, endovascular closure, individual patient metaanalysis
Introduction
The association between cryptogenic stroke (CS) and patent foramen ovale (PFO) was described in 1877 by Cohnheim. Since then, progress has been slow at identifying the characteristics of those who are at high risk of recurrent paradoxical embolism. Some factors have been identified, eg atrial septal aneurysm,1 but have been inconsistently replicated.2 There is renewed interest in the subject given new diagnostic tools (transcranial ultrasound and contrast echocardiography) and therapeutic options, especially implantable closure devices. Given that PFOs are highly prevalent in the general population,3 and that CS has many potential causes, it is rarely possible to determine with certainty whether a discovered PFO is pathogenic or incidental in an individual patient.4
Aims
The aim of the Risk of Paradoxical Embolism (RoPE) Study is to develop mathematical models that can be used to stratify patients by the conditional probability that 1) an index CS is "PFO-related"; and 2) stroke will recur.5 These models can then be used to stratify patients in on-going PFO closure trials with the goal of informing patient-selection for PFO closure in clinical practice. Past studies attempting to identify risk factors for recurrent paradoxical embolism have yielded conflicting results1,6 and have been limited by extremely low statistical power due to a very low overall stroke recurrence rate.7 Therefore, the first aim of the RoPE study was to combine databases in order to perform an individual-patient meta-analysis that could overcome these methodological and statistical limitations.8 Here we report our experience creating the largest database yet of CS subjects with and without PFO.
Methods
Selection of published and unpublished databases of patients with CS and the development of a collaborative team of international investigators
Potential databases of CS subjects were identified from a systematic review article9 supplemented by our own literature search and personal communications among investigators. Corresponding authors were contacted directly and invited to participate in the RoPE Study. We invited their participation after reviewing their inclusion criteria, data elements, and availability of primary data (echocardiograms and neuroimaging studies) with the principal investigators. CS is defined according to the TOAST classification10 and excludes subjects with large artery atherosclerosis, cardioembolism, small vessel disease, and strokes of other determined etiology (e.g. arterial dissection, arterial hypercoagulable states. For the ROPE Study, subjects with medium risk sources are considered cryptogenic. “Stroke” is a sudden onset neurological deficit in a vascular territory presumed to be due to focal ischemia after a complete workup. If the deficit lasts for <24h, it must be accompanied by acute MRI or CT changes in appropriate locations. otherwise it was considered a TIA. If the deficit is >24h, MRI or CT changes are not required. “Complete workup” requires 1) MRI or CT, 2) intra- and extracranial vascular imaging, 3) inpatient or outpatient cardiac monitoring sufficient for the investigator to exclude atrial fibrillation, and 4) transesophageal echocardiography. The 12 studies (Appendix 1) are CODICIA,11 French PFO/ASA,1 APRIS,12 Bern,13 Bern unpublished, PICSS,6 Lausanne, Toronto,14 Sapienza,15 Tufts,16 German,2 and NOMASS.17 The principal investigators of each of the 12 databases were included in the RoPE Study Group, with additional co-investigators as appropriate. The project is highly interactive requiring frequent communications between the RoPE coordinating center at Tufts Medical Center and the investigators at sites in North America and Europe. Communication has been through email, telephone, teleconference and annual face-to-face RoPE Investigator Meetings.
Determining the characteristics of data in each data base and specifying dependent and independent variables
Detailed summaries of each database were compiled from study protocols, data codebooks and case report forms, and compared with candidate RoPE variables, previously identified as potentially related to the presence or absence of PFO and to the risk of stroke recurrence.5 For each variable, we determined its definition, how the data were obtained, how the variable was coded, and what effect, if any, the relevant study’s inclusion/exclusion criteria might have on the variable. The decision to include a variable was informed by the quality of data collection across databases, and on a consensus among investigators regarding their importance.
Clinical variables
Included clinical variables are: age (at index event), sex, race, hypertension, diabetes, coronary artery disease, hypercholesterolemia, smoking, a history of cerebral ischemia (transient ischemic attack (TIA) or stroke) prior to the index event, medications being taken at the time of the index event (antithrombotics, statins, hormone replacement therapy (HRT), oral contraceptives (OCP)) and treatment medications after the index event (antiplatelets, anticoagulants). Index events were both strokes and TIAs. Some variables of interest were collected on a minority of databases. While these variables will not be included in the main analyses, they are potentially available for substudies. They are: history of deep vein thrombosis (DVT)/pulmonary embolism (PE), Valsalva at symptom onset, history of migraine, alcohol, and neurological outcome scales.
Echocardiographic variables
The echocardiographic variables included in the RoPE database are: hypermobility of the interatrial septum (yes/no), shunting across the PFO at rest, i.e. not requiring Valsalva (yes/no), and physiological shunt size (large/small).
Septal excursion was measured as the maximum distance from an estimated midline into either atrium (Bern published, German, Lausanne, Tufts) or as a total excursion between the left and right atria (APRIS, PICSS, CODICIA, French PFO/ASA, Toronto). We used the objective measurement of septal movement rather than the subjective impression of the shape of the septum to determine whether or not it was considered “aneurysmal” (Figure 1). The RoPE-defined “hypermobile” septum is roughly equivalent to “atrial septal aneurysm” used in the literature.
Figure 1. RoPE-defined septal mobility.
Numbers refer to interatrial septal excursion (mm) during the cardiac cycle during TEE. Mobility in the green range was defined by RoPE as “hypermobile.”
Regarding shunt size, past studies have used anatomy (e.g. tunnel length18 or separation distance of the septum primum and secundum19). Within the constraints of the existing data and the TEE images available for review we concluded that a dichotomous variable (large versus small) based on the number of bubbles detected in the left atrium would be used (Figure 2), based on a consensus that finer gradations are unreliable particularly given the effects of time-varying factors such as volume status, depth of sedation, and strength of the Valsalva.
Figure 2. RoPE-defined PFO shunt size.
Numbers refer to the maximum number of observed bubbles in the left atrium ≤3 cardiac cycles after right atrial opacification during TEE. Most studies had a cutoff at ≥10. In the French PFO/ASA, German, and Sapienza studies 1, 2 or 3 bubbles were considered “no PFO.” For RoPE, blue range=small; green=large; grey=indeterminable.
Neuroradiology variables
The neuroradiological variables from index event imaging are: infarct seen (yes/no), infarct location (superficial, deep), infarct size (large/small), multiple acute infarcts (yes/no), chronic (prior) stroke (yes/no). MRI images took precedence over CT.
Infarct seen is an infarct in a location consistent with the clinical presentation. Restricted diffusion on acute MRI, or FLAIR/T2 hyperintensity on subacute imaging (especially with evidence of mass effect and/or T1 hypointensity but not as dark as CSF) would fit this criterion. The CT definition is an area that has decreased density compared with surrounding brain parenchyma but not as low as CSF, especially if associated with mass effect.
A superficial infarct is located in the cerebral or cerebellar cortex, or in the cortical borderzones of the middle cerebral artery. Deep strokes are located in the deep white matter of the cerebral or cerebellar hemispheres, the subcortical grey matter, or the internal borderzone of the middle cerebral artery.
Infarct size was collected by some studies as a continuous variable and so a large/small dichotomy can be made easily. However, other studies already dichotomized the variable using millimeters (Lausanne) or “lobes” (PICSS, NOMASS, APRIS) as units of measurement. The cutoff for the large/small dichotomy is roughly 15mm (Appendix 2). Infarcts which are small in size by this definition should not be interpreted as being due to small vessel (“lacunar”) disease. Subjects with this infarct sub-type would not have been included in these CS cohorts.
Multiple acute infarcts is ≥2 infarcts corresponding to the index event.
The prior stroke definition, adapted from the Cardiovascular Health Study,20 is: a focal brain lesion seen on MRI that is hyperintense on T2 sequences, hypointense on T1 and ≥3mm (maximum linear measurement in any direction). Surrounding FLAIR hyperintensity was seen as supportive. Prior stroke on CT was defined as a focal brain lesion ≥3mm that is isodense with cerebrospinal fluid, or more hypodense than brain parenchyma with associated volume loss. For some subjects whose imaging could not be obtained, we reviewed clinically-derived reports (n=93). We tested the validity of this approach by assessing whether clinical reports agreed with data derived from direct review of neuroimaging in 183 cases where both types of data were available. For “prior stroke” agreement was 148/183 cases; 81%, Kappa 0.43, p=0.0637. This compares to 15/27 cases, 56% perfect agreement for prior stroke variable [Kappa between reviewer pairs ranged from 0.27 to 0.56], when three readers read the neuroimages directly.
Outcomes
The outcome of interest is recurrent stroke: a sudden onset neurological deficit in a vascular territory presumed to be due to cerebral ischemia. If the deficit lasts less than 24 hours, it must be accompanied by MRI/CT changes in an appropriate location. If the deficit is greater than 24 hours, MRI/CT changes are not required. This is more consistent with the “tissue definition” of TIA21 than with the arbitrary time-based definitions. We include TIA as a potential outcome but recognize its diagnostic subjectivity and unclear clinical significance without persisting neurological deficits.
All outcomes from the component databases were re-adjudicated. There were 3 goals to this process. First, we applied the “tissue definition” of TIA21 and re-categorized events as strokes where appropriate, or as non-events when the clinical presentation did not suggest cerebral ischemia. Second, we categorized the mechanism of recurrent ischemia to distinguish those of known cause (unlikely to be due to paradoxical embolism) from those that were again cryptogenic or not otherwise specified. And third, we categorized death as stroke if it was due to stroke recurrence. Study sites completed a case report form (CRF) for each outcome in their database. A narrative was written that described the event including symptoms, pace, duration, deficit, investigations (with reports) and the clinical impression of mechanism. The Outcome Adjudication Committee consisted of 3 vascular neurologists (ME, PM, CW) and was chaired by a 4th (DET). Each member reviewed each CRF and categorized the event as a stroke, TIA, death, or no-event and assigned an ischemic mechanism (Appendix 3). Outcomes with insufficient data to determine an ischemic mechanism were classified as “Stroke/TIA: not otherwise specified.” Any disagreement (i.e. an absence of unanimity) was discussed at a consensus meeting where final adjudications were made.
Acquiring new primary data
In order to create a data set that would support the development of accurate predictive models, we identified the need to obtain additional primary data from medical records, neuroradiologic scans, transesophageal (TEE) studies, or by telephone contact of study subjects. The reasons for needing additional primary data included: 1) missing data in some databases for variables potentially critical to the models; 2) inconsistent definitions across databases for variables potentially critical to the models; and 3) inadequate follow-up data with regard to outcome events. Institutional review board approval was obtained as required at all local sites.
Clinical data
Some variables that were either not available in the original database or incomplete were obtained at the site through review of the written case report forms or medical record. This included medications that were being taken at baseline and following the index event (French PFO/ASA).
Echocardiography and neuroradiology
TEE data unavailable in the original databases were needed for review from 3 sites: Bern, Lausanne, and Tufts. We determined that RoPE echo variables were incompletely ascertained for 356 PFO subjects, and we were able to obtain echocardiograms for 222 of these. Three echocardiographers were trained to use RoPE-specific definitions that maximized consistency with the other echo variables already present in the RoPE database. Interatrial septal excursion was defined as maximal excursion of the interatrial septum away from the midline within a cardiac cycle. A hypermobile septum was defined as a maximal excursion of greater than 10mm. While the grading of intracardiac shunting was inconsistently defined across databases, a simple grading system was devised to reconcile these inconsistencies and minimize the need for re-reading. This was determined by counting the “maximal bubbles in a single frame within 3 cardiac cycles after arrival of bolus in the right atrium.” Shunt grades are defined as follows: Grade I = 1–10 bubbles; Grade II = between Grades I and III; Grade III = a “cloud” of bubbles. Shunt grading was done both at rest and with Valsalva when possible. All centrally reviewed echoes were read by one of 3 echocardiographers without double reading. Variables were extracted and recorded for inclusion into RoPE. Echocardiographers were blinded to the clinical and radiologic data for those subjects. After deciding how best to harmonize this variable with the pre-existing shunt size estimations in the other databases, we determined that Grades II and III in the re-read studies would be considered large. Agreement between the 3 readers for all echocardiographic variables was assessed on a subset of 29 echos from the French PFO/ASA study: hypermobile septum variable, Kappa 0.57; large PFO, Kappa 0.42; shunt at rest, Kappa 0.75. Similarly, agreement was also tested using 31 echoes from the PICSS study: hypermobile septum variable, Kappa 0.33; large PFO, Kappa 0.14; shunt at rest, Kappa 0.33.
The process for obtaining missing neuroradiological data was analogous to the missing echo data. We identified 1853 subjects from 5 sites that needed review of the neuroimaging studies: Bern published, CODICIA, German, Lausanne, and Tufts. Of these, we were able to retrieve 1012, which were read either locally or transferred to Tufts Medical Center for central review under the direction of DET.
Follow-up and outcomes
Outcome ascertainment protocols differ amongst the RoPE databases. In an effort to avoid ascertainment bias, we required one-year follow-up (defined as last follow-up in the 12th month or beyond) on over 85% of patients for all databases. For databases in which follow-up was too short, or only done as clinically indicated (rather than with scheduled visits), subjects were contacted, consented, then administered a validated, structured questionnaire to determine stroke free status22 (sensitivity 0.97–1.0, negative predictive value 0.96–1.0). Positive responses, suggesting recurrent stroke/TIA, were reviewed by the local neurologist by telephone, medical records, or in person if clinically indicated. This protocol was applied to the Bern, Tufts and Lausanne databases.
Results
The RoPE database includes a total of 12 component databases – 4 enrolled CS subjects only with PFO, and 8 enrolled CS subjects with and without PFO. The PFO prevalence in these 8 studies ranges from 21% to 63%. Complete database descriptions and data have been published by 9 RoPE collaborating sites.1,2,6,11,13–15,17,23 The remaining 3 databases are either unpublished (Bern-unpublished, Lausanne) or have published substudies without a complete database description.16 Two sites (Tufts, Lausanne) are continuing to enroll subjects while the rest are no longer recruiting. The prevalence of each RoPE variable is shown in Table 1.
Table 1.
Prevalence of each variable by database
ALL | BOTH | PFO ONLY | CODICIA | French PFO/ASA | APRIS | Bern | Bern_Unpub | PICSS | Lausanne | Toronto | Sapienza | Tufts | German | NOMASS | ||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
N | 3674 | 3023 | 651 | 485 | 581 | 90 | 159 | 249 | 250 | 92 | 121 | 343 | 122 | 1122 | 60 | |
Clinical Variables | ||||||||||||||||
Age | Mean | 54.6 | 55.3 | 51.6 | 56.2 | 42.5 | 69.9 | 51 | 51.9 | 57.8 | 46.7 | 46.2 | 61.6 | 57.3 | 58.1 | 63.8 |
Male | % | 59 | 59 | 60 | 60 | 57 | 50 | 59 | 65 | 57 | 58 | 53 | 58 | 59 | 62 | 45 |
White | % | 83 | 82 | 87 | . | 98 | 22 | . | . | 57 | 92 | . | 100 | 87 | . | 12 |
History of | ||||||||||||||||
Coronary Artery Disease | % | 10 | 10 | 13 | 5 | . | 26 | 8 | 18 | 18 | 0 | . | 8 | 6 | 10 | 15 |
Diabetes | % | 13 | 15 | 8 | 12 | 4 | 37 | 9 | 6 | 19 | 5 | 6 | 17 | 14 | 18 | 21 |
Hypertension | % | 42 | 45 | 31 | 35 | 15 | 82 | 32 | 33 | 47 | 28 | 17 | 57 | 42 | 57 | 65 |
Hypercholesterolemia | % | 29 | 28 | 34 | . | 18 | 34 | 30 | 40 | . | 49 | 23 | 24 | 37 | 32 | 21 |
Current smoker | % | 32 | 35 | 22 | 32 | 48 | 20 | 33 | 22 | 29 | 33 | 15 | 34 | 16 | 32 | 24 |
Stroke | % | 8 | 9 | 8 | 0 | 3 | 0 | 9 | 6 | 10 | 8 | 3 | 28 | 14 | 10 | 0 |
TIA | % | 9 | 8 | 12 | 6 | 6 | 2 | 19 | 10 | 15 | 14 | 6 | 16 | 11 | 7 | 8 |
Stroke or TIA | % | 16 | 15 | 18 | 6 | 9 | 2 | 26 | 14 | 23 | 18 | 9 | 39 | 23 | 15 | 8 |
Statins | % | 15 | 13 | 29 | . | . | 34 | . | . | 8 | 3 | . | 13 | 29 | . | 21 |
Antiplatelets | % | 19 | 14 | 35 | 7 | 2 | 66 | 16 | 66 | 21 | 8 | 9 | 28 | 27 | 23 | 15 |
Anticoagulants | % | 4 | 1 | 12 | . | 0 | 12 | 2 | 25 | 0 | 1 | 7 | 2 | 6 | 1 | 0 |
HRT/OCP (females only) | % | 20 | 23 | 5 | 11 | 46 | 0 | 3 | . | 0 | 34 | . | . | 7 | . | 3 |
Index stroke (vs. TIA) | % | 87 | 89 | 77 | 83 | 100 | 100 | 75 | 77 | 100 | 100 | 69 | . | 87 | 82 | 100 |
Treatment Medication | ||||||||||||||||
Antiplatelet | % | 68 | 71 | 53 | 79 | 46 | 78 | 44 | . | 54 | 95 | 59 | 78 | 61 | 80 | 45 |
Anticoagulant | % | 36 | 35 | 46 | 20 | 80 | 21 | 52 | . | 46 | 5 | 28 | 22 | 60 | 24 | 18 |
Neuroradiology | ||||||||||||||||
Index stroke seen | % | 59 | 67 | 16 | 74 | 81 | 80 | 15 | . | 82 | 29 | . | . | 72 | 76 | 82 |
Superficial | % | 30 | 34 | 11 | 47 | 36 | 64 | 9 | . | 51 | 17 | . | . | 51 | 30 | 63 |
Multiple | % | 9 | 9 | 6 | 8 | 8 | 21 | 5 | . | 15 | 8 | . | . | 27 | 10 | 18 |
Large | % | 37 | 43 | 10 | 54 | 33 | 56 | 9 | . | 32 | 28 | . | . | 43 | 57 | 75 |
Prior stroke | % | 28 | 28 | 28 | 29 | 12 | 64 | 18 | . | 34 | 54 | . | . | 31 | 29 | 36 |
Total for prior stroke | N | 2288 | 2139 | 141 | 269 | 562 | 75 | 28 | 0 | 235 | 76 | 0 | 0 | 113 | 866 | 56 |
Echocardiography | ||||||||||||||||
Total (All PFO by TEE) | N | 1748 | 1114 | 634 | 197 | 267 | 19 | 159 | 249 | 98 | 58 | 121 | 133 | 105 | 319 | 23 |
Large PFO | % | 66 | 65 | 69 | 74 | 82 | 19 | 67 | 75 | 39 | 57 | . | . | 57 | 56 | . |
Hypermobile septum | % | 23 | 26 | 18 | 42 | 19 | 11 | 21 | 10 | 15 | 48 | 24 | 26 | 27 | 23 | . |
Shunt at rest | % | 68 | 66 | 76 | . | 60 | 92 | 62 | . | 73 | 53 | . | 55 | 86 | 81 | . |
Grey columns represent databases of CS and PFO. Otherwise databases included subjects both with and without PFO. Green cells show variables with ≥20% missingness. A dot indicates no data.
The total number of subjects with CS in the RoPE database is 3674. Most of the subjects, n=3023, are from CS studies that included those with and without PFO. The other 651 subjects come from databases that only included those with PFO. There are 1925 subjects with and 1749 without a PFO. A small subgroup of subjects (n=120) had a known PFO by transthoracic echocardiography or transcranial doppler but without TEE data.
The mean age of subjects is 54.6 years. The youngest subject was 15 at the time of the index event and the oldest was 92. There is a slight excess of males. Almost all subjects were white except for US-based studies (PICSS, NOMASS, APRIS) where other races were common. Overall, 16% had a clinical history of stroke/TIA prior to their index event but 28% had evidence of prior stroke on baseline imaging.
Appendix 4 outlines the echocardiographic data that were available from the outset, obtained through primary review, and those that could not be obtained. Prevalences of PFO characteristics vary widely between studies: large PFO (19–82%), hypermobile septum (10–48%), and shunting at rest (53–92%).
Appendix 4 also outlines the neuroradiological process. The prevalence of subjects with positive neuroimaging across the studies varies widely perhaps due to the inclusion of TIA subjects in 7 of the 12 studies or the use of different imaging modalities. There was a range of MRI use of 29% (PICSS) and 45% (NOMASS) to 96% (Tufts) and 100% (Bern) in part reflecting MRI availability when the studies were conducted.
In PFO subjects, there were 370 outcomes (stroke/TIA/death) over a median follow-up of 2.2 years (interquartile range 1.0–3.6). prior to readjudication. Of the adjudicated events, 10.3% of strokes (17/165) and 4.2% of TIAs (5/119) were recategorized into ischemia of known cause and so are not cryptogenic (Table 2). The mechanisms of these 22 events were cardioembolic (6), large vessel atherosclerosis (7), small vessel disease (6), and other (3). Four deaths were recategorized as stroke. Adjudication eliminated 9% of the original outcomes as non-events. Clinical data for adjudication were not available from 3 studies – the etiology for all events from these studies was categorized as “not otherwise specified.”
Table 2.
Outcomes by site before and after adjudication.
Prior to Adjudication | Final Adjudication | |||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Total | Stroke | TIA | Death | Stroke: Cryptogenic |
Stroke: NOS |
Stroke: Known Cause |
TIA: Cryptogenic |
TIA: NOS |
TIA: Known Cause |
Non-stroke Death |
No Event | |
APRIS | 21 | 9 | 0 | 12 | 6 | 1 | 1 | 0 | 0 | 0 | 12 | 1 |
Bern (pub) | 24 | 7 | 14 | 3 | 5 | 3 | 0 | 2 | 3 | 2 | 3 | 6 |
CODICIA | 40 | 10 | 18 | 12 | 2 | 6 | 2 | 5 | 7 | 0 | 12 | 6 |
French PFO/ASA | 43 | 24 | 13 | 6 | 7 | 12 | 4 | 2 | 9 | 0 | 6 | 3 |
German | 133 | 61 | 43 | 29 | 27 | 15 | 9 | 16 | 14 | 2 | 35 | 15 |
Lausanne | 5 | 2 | 2 | 1 | 1 | 0 | 1 | 1 | 0 | 1 | 1 | 0 |
PICSS | 47 | 24 | 14 | 9 | - | 24 | - | - | 14 | - | 9 | - |
Sapienza | 36 | 17 | 8 | 11 | - | 17 | - | - | 8 | - | 11 | - |
Toronto | 14 | 6 | 6 | 2 | - | 6 | - | - | 6 | - | 2 | - |
Tufts | 7 | 5 | 1 | 1 | 2 | 3 | 0 | 1 | 0 | 0 | 1 | 0 |
Total | 370 | 165 | 119 | 86 | 50 | 87 | 17 | 27 | 61 | 5 | 92 | 31 |
Outcomes in grey are not likely to be PFO-related.
NOS = not otherwise specified
Missingness was assessed for each variable in each component database. For many variables collection was perfect (missingness = 0%). The following variables had ≤5% missingness from every database: age, sex, diabetes, hypertension, smoking, prior stroke/TIA. For patients with PFO, one year follow-up was perfect (0% missing) for 3 databases (French PFO/ASA, PICSS, NOMASS), ≤10% for 3 databases (Bern, Toronto, German), and 10–15% missing for 4 databases (CODICIA, APRIS, Lausanne, Tufts). Thus, in those databases that will be used for modeling recurrence, the proportion of PFO subjects with ≥1 year follow-up was 93% total, (90% among all CS subjects).
Discussion
While no studies are sufficiently large on their own to support risk modeling for stratification of patients with CS and PFO, we were able to combine extant databases that will provide a substrate sufficient for the predictive models. Eight databases will contribute to the model that predicts the presence or absence of a PFO in patients with CS (CODICIA, French PFO/ASA, APRIS, PICSS, Lausanne, Sapienza, German, NOMASS). The variables that we anticipate will be used for this model, e.g. vascular risk factors and age, were collected with essentially no missingness. In turn, the predictive model can be transformed through the application of Bayes theorem to estimate the PFO-attributable fraction.4,24
Ten databases will be used to model recurrence risk (APRIS, Bern, CODICIA, French PFO/ASA, German, Lausanne, NOMASS, PICSS, Toronto, Tufts). Together these databases have 133 outcomes (stroke/TIA). Eleven of those 133 events were adjudicated as being of known cause. Based on the heuristic of 10 outcomes per variable,25 this should be sufficient for modeling recurrence risk. While missingness of some variables is a concern, imputation techniques will be used to retain patients in the database and avoid bias.
The Bern unpublished study will not be used for either model, since it is a PFO-only database (inappropriate for predicting presence of PFO) and did not collect sufficient outcome data (inappropriate for predicting recurrence). It will nonetheless be retained in the RoPE database, since it may contribute to other RoPE studies. During our modeling process, we will continually assess consistency of effects across databases. If there is large heterogeneity of effects, we will seek explanations in the variable definition, collection, or in the component study’s inclusion and exclusion criteria. We will pay careful attention to variables with definitions that vary somewhat between databases (e.g. large versus small stroke). These steps during modeling will serve as additional checks on data quality, such that a variable in a component database felt to correspond to a RoPE-defined variable may not in fact be useable or that a database may need to be excluded from a model based on anomalous effects. Modeling procedures will also account for clustering within databases, by including the component site as a random effect using a generalized linear (or other similar) modeling approach.
The process of combining individual patient data from multiple studies is laborious and methodologically fraught. However, since individual databases are not sufficiently large and outcomes are relatively rare, there is no single database that can provide sufficient information and statistical power to answer the clinical question of interest. Further, the effort, time and expense required for an adequate prospective study is incrementally much more than that required to pool data from prior studies. For these reasons, investigating stroke recurrence in patients with CS and PFO seems an excellent candidate for this approach.
In addition to statistical power, combining databases provides other advantages. Predictive models developed on data from multiple sources can be checked for consistency across sources, thereby improving generalizability. As in any multicenter database, the development of a model using data acquired at different locations lessens the dependency on any particular database and thereby reduces susceptibility to the idiosyncrasies of specific data sets. Additionally, combining datasets permits models to be developed and tested on a wider range of patients then might otherwise be available, providing a better substrate to model risk heterogeneity. There are large differences in the distribution of risk factors and outcomes as can be seen by comparing patients in published studies. For example, APRIS12 and the French PFO/ASA1 differ greatly in mean age (70 vs. 43 years), hypertension (82% vs. 15%), diabetes (37% vs. 4%), and 1-year stroke recurrence (6.1%, se=2.9% vs 2.0%, se=0.6%).
The RoPE Study marks a large collaborative effort to pool research on CS and PFO. We have successfully merged a dozen databases of existing cohort studies of subjects with CS and known PFO status. This is the largest database of such patients with detailed clinical, neuroradiological, and echocardiographic data. Outcome events have been adjudicated so that recurrent stroke can be modeled excluding those with a non-PFO-related mechanism. These data should be able to describe the natural history of this group of patients and inform decisions regarding CS diagnosis and secondary prevention strategies.5 This database can also provide a substrate to explore hypotheses in this population that are as yet unanticipated.
Appendix 1: Details of the RoPE Component Databases
RoPE Name for Database |
Original Name of Database |
Name of PI | PI Speciality | Country | Single center or Multicenter Study |
Index Date Range |
Median follow-up (yr) |
TEE Performed (All or in selected) |
---|---|---|---|---|---|---|---|---|
APRIS | Aortic Plaques and Risk of Ischemic Stroke Study | Marco R. Di Tullio, MD | Cardiology | USA | Single | Oct 1997–May 2003 | 2.2 [1.2–3.1] | All |
Bern published | - | Heinrich Mattle, MD | Neurology | Switzerland | Single | Oct 1990–Jul 2000 | 8.2 [2.3–11.4] | All |
Bern unpublished | - | Krassen Nedeltchev, MD, FESC; Marie-Luise Mono, MD |
Neurology; Neurology |
Switzerland | Single | Jan 2000–Nov 2008 | 0.3 [0.3–0.4] | All |
CODICIA | Recurrent Stroke and Massive Right-to-Left Shunt Prospective Spanish Multicenter Study | Joaquín Serena, MD, PhD | Neurology | Spain | Multicenter | Feb 2000–Feb 2006 | 2 [1–3] | Selected |
French PFO/ASA | Patent Foramen Ovale and Atrial Septal Aneurysm Study Group | Jean-Louis Mas, MD | Neurology | France | Multicenter | Feb 1996–Jan 1999 | 3.1 [2.5–3.7] | All |
German | - | Christian Weimar, MD | Neurology | Germany | Multicenter | Sep 2002–Dec 2006 | 1.6 [0.6–3.1] | Selected |
Lausanne | - | Patrik Michel, MD | Neurology | Switzerland | Single | Jan 2003–Dec 2008 | 3 [0.8–5.4] | Selected |
NOMASS | Northern Manhattan Stroke | Mitchell S. V. Elkind, MD, MS | Neurology | USA | Single | Jul 1993–Jun 1997 | 4 [1.7–5] | Selected |
PICSS | Patent Foramen Ovale In Cryptogenic Stroke Study | Shunichi Homma, MD, FACC | Cardiology | USA | Multicenter | Jun1993–May 1998 | 2 [2–2] | All |
Sapienza | - | Emanuele Di Angelantonio, MD, MSc; Federica Papetti, MD |
Cardiology; Cardiology |
Italy | Single | Jun 2004–Sep 2007 | 2.3 [1.5–3.8] | All |
Toronto | - | Cheryl Jaigobin, MD, FRCP, MSc | Neurology | Canada | Single | Oct 1997–Mar 2003 | 1.5 [1–3] | All |
Tufts | Tufts Medical Center | David Thaler, MD, PhD, FAHA | Neurology | USA | Single | Aug 1998–Apr 2009 | 1 [0.3–4.9] | Selected |
Appendix 2: Definitions of infarct size by study (only those from which size data were available)
Study | Small | Large |
---|---|---|
CODICIA | ≤3cc = small | >3cc = large |
French PFO/ASA | Subcortical < 15mm | Deep subcortical >15mm |
<1/2 hemisphere | ≥1/2 hemisphere | |
PICSS | <1cm, deep only | ≥1cm deep only |
<1/2 lobe, if lobar | ½ - 1 lobe, if lobar | |
>1 lobe, if lobar | ||
Tufts | ≤15mm | >15mm |
German | ≤15mm | >15mm |
NOMASS | <1cm | < ½ lobe |
<1 lobe | ||
>1 lobe |
Appendix 3: Definitions of stroke mechanisms used for adjudication of endpoints
Complete evaluation
Neuroimaging (CT or MRI)
Vascular imaging (Ultrasound, MRA, CTA, or conventional angiography)
Cardiac monitoring (at least 24 hours)
Stroke mechanisms
Cardioembolic: the presence of one or more high-risk cardioembolic sources:
Mechanical prosthetic valve
Atrial fibrillation
Left atrial/atrial appendage thrombus
Sick sinus syndrome
Recent myocardial infarction (<4 weeks)
Left ventricular thrombus
Dilated cardiomyopathy
Akinetic left ventricular segment
Left-sided cardiac tumors (myxoma, fibroelastoma, etc)
Infective endocarditis
Large vessel disease: Atherosclerosis or other arteriopathy of the intracranial and extracranial vessels of >50% of lumen diameter supplying the involved lesion
Small vessel disease: Ischemic stroke in the distribution of a single, small deep penetrating vessel in a patient with any of the following: 1) a history of hypertension (except in the first week post stroke); 2) history of diabetes mellitus; 3) Age >/= 50; or 4) MRI or CT shows leukoaraiosis greater than symmetric, well-defined periventricular caps or bands (European Task Force on Age-Related White Matter Changes rating scale score > 0)
Cryptogenic: None of the diagnoses above or other known mechanisms despite a complete evaluation
Appendix 4: Development of the RoPE database and assimilation of variables from primary data
![]() |
Solid-colored cells represent variables received in full at the start of the RoPE Study. Patterned cells represent data retrieved through primary data collection and re-reading. Grey cells indicate data which were unobtainable. Check marks indicate adequate data collection for that variable. X indicates a variable that was not obtainable for that database.
Appendix 5: List of German centers and investigators who contributed data to the RoPE project
*Indicates centers that did not provide additional imaging data.
Ostalbklinikum Aalen (M. Heyden, MD)
Klinikum Bernburg (M. Müller, MD)
Krankenanstalten Gilead Bielefeld (C. Hagemeister, MD; G. Wittenberg, MD)
Krankenhaus Buchholz (K. Luckner, MD)
Klinikum Bremen-Mitte (F. Brunner-Beeg, MD; M. Lentschig, MD)
Klinikum Duisburg (K. Ulrich, MD),
University of Essen (C. Weimar, MD)
University of Greifswald (U. Schminke, MD; B. von Sarnowski, MD)
Kreiskrankenhaus Heidenheim (S. Kaendler, MD)
*University of Jena (C. Terborg, MD)
University of Leipzig (D. Michalski, MD; D. Fritzsch, MD)
*University of Magdeburg (M. Goertler, MD)
Ruppiner Kliniken Neuruppin (G. Zindler, MD)
University of Rostock (U. Walter, MD; K. Hauenstein, MD)
Bürgerhospital Stuttgart (E. Schmid, MD)
University of Ulm (R. Huber, MD)
Heinrich-Braun-Krankenhaus Zwickau (J. Thalwitzer, MD)
Appendix 6: List of centers and investigators from the French PFO-ASA study who contributed data to the RoPE project
Centre Hospitalier Universitaire (CHU) Besançon, France (T. Moulin, MD)
CHU Lariboisière and Saint-Antoine, Paris, France (F. Woimant, MD; P. Amarenco, MD)
Sainte-Anne Hospital, Paris, France (J.L. Mas, MD)
CHU Nancy, France (X. Ducrocq, MD)
CHU Tours, France (D. Saudeau, MD)
CHU Rennes, France (J.F. Pinel, MD)
Medical University of Warsaw, Poland (H. Kwiecinski, MD)
CHU Poitiers, France (J.P. Neau, MD)
CHU Vaudois, Lausanne, Switzerland (P. Arnold, MD)
CHU Rouen, France (E. Guégan-Massardier, MD)
CHU Pitié-Salpêtrière, Paris, France (R. Manai, MD)
CHU La Timone, Marseille, France (L. Milandre, MD)
CHU Lille, France; (D. Leys, MD)
Centre Hospitalier Général, Meaux, France (F. Chedru, MD)
CHU Saint-Etienne, France (P. Garnier, MD)
Santa Maria Hospital, University of Lisbon, Portugal (T. Pinho e Melo, MD)
CHU Bordeaux, France (P. Gaïda, MD)
CHU Grenoble, France (G. Besson, MD)
CHU Purpan, Toulouse, France (J.F. Albucher, MD)
Klinikum Grosshadern, Ludwig Maximilians University, Munich, Germany (T. Pfefferkorn, MD)
Lens, France (F. Mounier-Véhier, MD)
CHU Rangueil, Toulouse, France (V. Larrue, MD)
CHU Nice, France (M.H. Mahagne, MD)
CHU Brest, France (Y. Mocquard, MD)
CHU Angers, France (H. Brugeilles, MD)
Jolimont Hospital, Haine-Saint-Paul, Belgium (G. Devuyst, MD)
Tenon Hospital, CHU Saint-Antoine, Paris (S. Alamowitch, MD)
E. Muller Hospital, Mulhouse, France (G. Rodier, MD)
Erasme Hospital, Université Libre de Bruxelles, Belgium (S. Blecic, MD)
CHU Clermont-Ferrand, France (A. Coustes-Durieux, MD)
Footnotes
Conflicts of interest: David E. Thaler and David M. Kent have consulted for WL Gore Associates. David E. Thaler has also consulted for AGA Medical Corporation.
Reference List
- 1.Mas JL, Arquizan C, Lamy C, et al. Recurrent cerebrovascular events associated with patent foramen ovale, atrial septal aneurysm, or both. New England Journal of Medicine. 2001;345:1740–1746. doi: 10.1056/NEJMoa011503. [DOI] [PubMed] [Google Scholar]
- 2.Weimar C, Holle DN, Benemann J, et al. Current management and risk of recurrent stroke in cerebrovascular patients with right-to-left cardiac shunt. Cerebrovasc Dis. 2009;28:349–356. doi: 10.1159/000229553. [DOI] [PubMed] [Google Scholar]
- 3.Thaler DE, Saver JL. Cryptogenic stroke and patent foramen ovale. Curr Opin Cardiol. 2008;23:537–544. doi: 10.1097/HCO.0b013e32831311bd. [DOI] [PubMed] [Google Scholar]
- 4.Alsheikh-Ali AA, Thaler DE, Kent DM. Patent foramen ovale in cryptogenic stroke: incidental or pathogenic? Stroke. 2009;40:2349–2355. doi: 10.1161/STROKEAHA.109.547828. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Kent DM, Thaler DE. The Risk of Paradoxical Embolism (RoPE) Study: Developing risk models for application to ongoing randomized trials of percutaneous patent foramen ovale closure for cryptogenic stroke. Trials. 2011;12:185. doi: 10.1186/1745-6215-12-185. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Homma S, Sacco RL, Di Tullio MR, Sciacca RR, Mohr JP. Effect of medical treatment in stroke patients with patent foramen ovale: patent foramen ovale in Cryptogenic Stroke Study. Circulation. 2002;105:2625–2631. doi: 10.1161/01.cir.0000017498.88393.44. [DOI] [PubMed] [Google Scholar]
- 7.Kitsios GD, Dahabreh IJ, Abu Dabrh A, Thaler DE, Kent DM. PFO closure and medical treatments for secondary stroke prevention: a systematic review of observational and randomized evidence. Stroke. 2011 doi: 10.1161/STROKEAHA.111.631648. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Kent DM, Thaler DE. Is patent foramen ovale a modifiable risk factor for stroke recurrence? Stroke. 2010;41:S26–S30. doi: 10.1161/STROKEAHA.110.595140. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Homma S, Sacco RL. Patent foramen ovale and stroke. Circulation. 2005;112:1063–1072. doi: 10.1161/CIRCULATIONAHA.104.524371. [DOI] [PubMed] [Google Scholar]
- 10.Adams HP, Bendixen BH, Kappelle LJ, et al. Classification of subtype of acute ischemic stroke. Definitions for use in a multicenter clinical trial. TOAST. Trial of Org 10172 in Acute Stroke Treatment. Stroke. 1993;24:35–41. doi: 10.1161/01.str.24.1.35. [DOI] [PubMed] [Google Scholar]
- 11.Serena J, Marti-Fabregas J, Santamarina E, et al. Recurrent stroke and massive right-to-left shunt: results from the prospective Spanish multicenter (CODICIA) study. Stroke. 2008;39:3131–3136. doi: 10.1161/STROKEAHA.108.521427. [DOI] [PubMed] [Google Scholar]
- 12.Di Tullio MR, Homma S, Jin Z, Sacco RL. Aortic atherosclerosis, hypercoagulability, and stroke the APRIS (Aortic Plaque and Risk of Ischemic Stroke) study. J Am Coll Cardiol. 2008;52:855–861. doi: 10.1016/j.jacc.2008.04.062. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Nedeltchev K, Arnold M, Wahl A, et al. Outcome of patients with cryptogenic stroke and patent foramen ovale. J Neurol Neurosurg Psychiatry. 2002;72:347–350. doi: 10.1136/jnnp.72.3.347. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Casaubon L, McLaughlin P, Webb G, Yeo E, Merker D, Jaigobin C. Recurrent stroke/TIA in cryptogenic stroke patients with patent foramen ovale. Can J Neurol Sci. 2007;34:74–80. doi: 10.1017/s0317167100005825. [DOI] [PubMed] [Google Scholar]
- 15.De Castro S, Papetti F, Di AE, et al. Feasibility and clinical utility of transesophageal echocardiography in the acute phase of cerebral ischemia. Am J Cardiol. 2010;106:1339–1344. doi: 10.1016/j.amjcard.2010.06.066. [DOI] [PubMed] [Google Scholar]
- 16.Kitsios GD, Lasker A, Singh J, Thaler DE. Recurrent stroke on imaging and presumed paradoxical embolism: a cross-sectional analysis. Neurology. 2011 doi: 10.1212/WNL.0b013e31824d58bc. (In Press). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Steiner MM, Di Tullio MR, Rundek T, et al. Patent foramen ovale size and embolic brain imaging findings among patients with ischemic stroke. Stroke. 1998;29:944–948. doi: 10.1161/01.str.29.5.944. [DOI] [PubMed] [Google Scholar]
- 18.Marshall AC, Lock JE. Structural and compliant anatomy of the patent foramen ovale in patients undergoing transcatheter closure. Am Heart J. 2000;140:303–307. doi: 10.1067/mhj.2000.108236. [DOI] [PubMed] [Google Scholar]
- 19.Homma S, Di Tullio MR, Sacco RL, Mihalatos D, Li MG, Mohr JP. Characteristics of patent foramen ovale associated with cryptogenic stroke. A biplane transesophageal echocardiographic study. Stroke. 1994;25:582–586. doi: 10.1161/01.str.25.3.582. [DOI] [PubMed] [Google Scholar]
- 20.Bryan RN, Wells SW, Miller TJ, et al. Infarctlike lesions in the brain: prevalence and anatomic characteristics at MR imaging of the elderly--data from the Cardiovascular Health Study. Radiology. 1997;202:47–54. doi: 10.1148/radiology.202.1.8988191. [DOI] [PubMed] [Google Scholar]
- 21.Easton JD, Saver JL, Albers GW, et al. Definition and evaluation of transient ischemic attack: a scientific statement for healthcare professionals from the American Heart Association/American Stroke Association Stroke Council; Council on Cardiovascular Surgery and Anesthesia; Council on Cardiovascular Radiology and Intervention; Council on Cardiovascular Nursing; and the Interdisciplinary Council on Peripheral Vascular Disease. The American Academy of Neurology affirms the value of this statement as an educational tool for neurologists. Stroke. 2009;40:2276–2293. doi: 10.1161/STROKEAHA.108.192218. [DOI] [PubMed] [Google Scholar]
- 22.Meschia JF, Brott TG, Chukwudelunzu FE, et al. Verifying the stroke-free phenotype by structured telephone interview. Stroke. 2000;31:1076–1080. doi: 10.1161/01.str.31.5.1076. [DOI] [PubMed] [Google Scholar]
- 23.DiTullio M, Sacco RL, Gopal A, Mohr JP, Homma S. Patent foramen ovale as a risk factor for cryptogenic stroke. Ann Intern Med. 1992;117:461–465. doi: 10.7326/0003-4819-117-6-461. [DOI] [PubMed] [Google Scholar]
- 24.Kent DM, Trikalinos TA, Thaler DE. Patent foramen ovale and cryptogenic stroke. N Engl J Med. 2008;358:1519–1520. [PubMed] [Google Scholar]
- 25.Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49:1373–1379. doi: 10.1016/s0895-4356(96)00236-3. [DOI] [PubMed] [Google Scholar]