Table 3.

Summary of testing scenarios for developing calibration algorithms, benefits (B) and risks (R) of various testing protocols in terms of the representativeness of the test results, and compatibility with technology on the market (TD = tested device; Ref = reference monitor; AQI = Air Quality Index).

Description	Scenario A TDoffline; Ref offline	Scenario B TD offline; Ref online	Scenario C TD online; Ref offline	Scenario D TD online; Ref online
Test results demonstrate how TD performs in isolation.	B	B
TD is “blind” to the Ref.	B	B	B
May encourage technology to include offline mode of use valuable for some applications.	B	B
Allows Ref data to be used for other purposes (e.g., AQI communication).		B		B
Approach compatible for all sensor devices on the market, in terms of allowable forms of data transmission and access.			B	B
Test results may not represent real-world performance for some applications (e.g., remote areas) if TD incorporates external data.			R	R
Potential over-the-air updates to the TD or other forms of performance modification such as firmware updates testing.			R	R
Potential data privacy or security threat.			R	R
Possibility that the Ref is incorporated into TD data adjustment algorithms.				R