Table 2.

Summary of technical, personal, and organizational lessons learned from development and implementation of web-based apps for infectious disease outbreak response.

Lessons learned			Number of mentions and number of apps		References
Technical
	Ensure detection methods are automatic and signals are verified by users	12 mentions; 8 apps		Hulth et al (2010) [37]; Li et al (2014) [39]; Cakici et al (2010) [41]; Kling et al (2012) [42]; Rolfhamre et al (2006) [43]; Faensen et al (2006) [44]; Krause et al (2007) [45]; Salmon et al (2016) [46]; Straetemans et al (2008) [47]; Guzman-Herrador et al (2016) [48]; Yang et al (2011) [51]; Zhang et al (2014) [52]; Widdowson et al (2003) [55]; Groeneveld et al (2017) [56]
	Ensure flexibility and ease of use	10 mentions; 5 apps		Hulth et al (2010) [37]; El-Khatib et al (2018) [38]; Cakici et al (2010) [41]; Kling et al (2012) [42]; Rolfhamre et al (2006) [43]; Faensen et al (2006) [44]; Krause et al (2007) [45]; Salmon et al (2016) [46]; Straetemans et al (2008) [47]; Karo et al (2018) [49]; Sheel et al (2019) [50]; Stelling et al (2010) [53]; Widdowson et al (2003) [55]; Vinas et al (2013) [57]
	Maintain security	2 mentions; 2 apps		Li et al (2013) [27]; Groeneveld et al (2017) [56]
	Ensure the app integrates with other software	2 mentions; 2 apps		Hulth et al (2010) [37]; Cakici et al (2010) [41]; Kling et al (2012) [42]; Rolfhamre et al (2006) [43]
Personal
	Increase user awareness and engagement with the app	2 mentions; 2 apps		Hulth et al (2010) [37]; Faensen et al (2006) [44]; Krause et al (2007) [45]; Salmon et al (2016) [46]; Straetemans et al (2008) [47]; Guzman-Herrador et al (2016) [48]
Organizational
	Develop and maintain resources for operational support of the app	13 mentions; 6 apps		Li et al (2013) [27]; Hulth et al (2010) [37]; El-Khatib et al (2018) [38]; Li et al (2014) [39]; Faensen et al (2006) [44]; Krause et al (2007) [45]; Salmon et al (2016) [46]; Straetemans et al (2008) [47]; Guzman-Herrador et al (2016) [48]; Karo et al (2018) [49]; Sheel et al (2019) [50]; Yang et al (2011) [51]; Zhang et al (2014) [52]
	Conduct rigorous evaluations of the app	7 mentions; 5 apps		Hulth et al (2010) [37]; Wu et al (2011) [40]; Cakici et al (2010) [41]; Kling et al (2012) [42]; Rolfhamre et al (2006) [43]; Faensen et al (2006) [44]; Krause et al (2007) [45]; Salmon et al (2016) [46]; Straetemans et al (2008) [47]; Vaux et al (2009) [54]; Groeneveld et al (2017) [56]
	Education and training	4 mentions; 2 apps		Hulth et al (2010) [37]; El-Khatib et al (2018) [38]; Faensen et al (2006) [44]; Krause et al (2007) [45]; Salmon et al (2016) [46]; Straetemans et al (2008) [47]
	Coverage of uptake of the app	3 mentions; 3 apps		Hulth et al (2010) [37]; Widdowson et al (2003) [55]; Groeneveld et al (2017) [56]