Table 3:

Quality assessment criteria for evaluating program evaluating studies

Criteria of evaluation	Rogers et al. 1996	Flynn et al. 2008
1. Research question/objective is clearly described and relevant to educational program evaluation in teenage pregnancy.	Yes	Yes
2. The type of approach is empirical.	Yes	Yes
3. The context/country of the study is described.	Yes	Yes
4. The theoretical framework is stated.	Yes	Yes
5. Variables/domains are evaluated/outlined.	Yes	Yes
6. Data collection method is described.	Yes	Yes
7. Reliability and validity of data collection tools are reported.	Yes	No
8. Study sample is defined.	Yes	Yes
9. Data analysis is clearly described.	Yes	Yes
10. Results and conclusion are reported in sufficient detail.	Yes	Yes
Total score	1	0.9

Adapted from Kmet, L. M., Lee, R. C., & Cook, L. S. (2004). Standard quality assessment criteria for evaluating primary resea rch papers from a variety of fields (copyright 2004 by the Alberta Heritage Foundation for Medical Research), pp. 4 & 5; and from Kraft, M., Kastel, A., Eriksson, H., & Hedman, A. R. (2016). “Global nursing—A literature review in the field of education and practice.” Nursing Open, 4, 125 and modified by Al Alawi, R. and G. L. Alexander (2020). “Systematic review of program evaluation in baccalaureate nursing programs.” Journal of Professional Nursing 36(4): 236–244.