Table 2.
Functions and Indicators Assessed During the Proof of Concept Trial Run of the EAR Portal Bioanalyst Working Model
| Function | Indicator Type | Definition | Proxy | Results |
|---|---|---|---|---|
| Monitoring | Input | Average number of incoming news items filtered into the EAR platform/week | Average workload expected for biological threat monitoring | 716 items/week |
| Monitoring | Input | Number of hours/week dedicated by on-duty analysts to EAR platform monitoring | Average weekly working hours required to apply the EAR working model in the testing period | 10 hrs or more (64% of rotations); 3-10 hrs (36%) |
| Monitoring | Process | Continuity of rotations maintained throughout the testing period (% of expected rotations covered) | Possibility of managing EAR-related duties alongside bioanalyst's other activities | 92% |
| Risk assessment | Process | % of rotations involving other institutional/EAR bioexperts in risk assessments | Capacity of the EAR work model to involve the bioanalyst EAR network and other subject matter experts within participating institutions in the risk assessment | 55% |
| Risk assessment | Output | Number of events generated/testing period | 11 | |
| Risk assessment | Outcome | Number of false alarms issued during the testing period | Provides some indication of the reliability of the outputs of the EAR portal bioanalyst work model | None |
| Risk assessment | Outcome | Number of intentional releases of biological agents missed by the system during the testing period | Provides some indication of the sensitivity of the EAR portal bioanalyst work model | None |
| Risk assessment | Outcome | Number of correctly identified false news items (hoaxes) on intentional releases of biological agents | Provides some indication of the specificity of the EAR portal bioanalyst work model | 3 |
| Risk assessment | Impact | % of rotations for which the on-duty analysts used information assessed in the EAR platform also to make decisions or take further action in their country/institution | Added value of the EAR working model for participating bioanalysts at institutional (national/international) level | 45% |
| Reporting | Output | % of rotating bioanalysts who produced a hand-over email during the testing period | Possibility of managing EAR-related duties alongside bioanalyst's other activities | 100% |
| Reporting | Output | Number of alerts generated during the testing period | 3 |