Table A.4 Outline of the appraisal questions for field effect experiments with bees

Section	Acronym	Question
External validity	Q1_EV	How confident are we that the assessment endpoint can be used to inform the risk assessment of bees?
	Q2_EV	Are the test organisms exposed to either flupyradifurone or acetamiprid in isolation (without any other active substances)?
	Q3_EV	Are the tested organisms relevant for Europe?
	Q4_EV	Is the study location representative of any EU biogeographical region?
	Q5_EV	Is the study setting representative of an EU agricultural landscape?
	Q6_EV	Do the experimental conditions represent a reasonable worst‐case for both exposure and possible triggering of the effects?
Internal validity	Q1_IV	Is the origin of the tested organism trustable?
	Q2_IV	Were the test organisms properly acclimatised to the study setup before the exposure started?
	Q3_IV	Are the test organisms healthy and stress‐free at the start of the experiment?
	Q4_IV	Is the methodology used (including the experimental setup) for measuring the assessment endpoint reliable?
	Q5_IV	Is the negative control free from contamination and performing adequately?
	Q6_IV	Are the treatments and exposure levels well characterised?
	Q7_IV	Is the test item clearly identified and characterised?
	Q8_IV	Is the duration of the test appropriate to characterise the assessment endpoint?
	Q9_IV	Is the presence of other stressors checked and accounted for?
	Q10_IV	Is the derivation of the measured endpoint(s) performed with sound statistical methods?
Precision	Q1_PR	Are the sample size and replication appropriate?