Table 5.

Analytical review of primary works according to a GREOM adaptation (Portell et al., 2015).

Number	References	Domain A	Domain B: method					Domain C: results	Comments
		Observational method	Observ. design	Instrument		Record parameter	Quality of data	Data analysis and results
				Observation	Recording
1	Almeida et al., 2014	Direct observation	Not	FF/CS [Field format combined with category systems]	MATCH VISION STUDIO	Freq	Kappa	Descriptive analysis Multivariate logistic regression	Criteria are called variables. They use independent and dependent variables.
2	Andrade et al., 2012	Direct observation	Not	CS [Category System]	Video (from TV)	Freq	Kappa	Descriptive analysis Shapiro-Wilk test Mean comparation
3	Ardá et al., 2014	Direct observation	N/S/M	FF/SC	Video (from TV)	Freq	Kappa Consensual agreement	Descriptive analysis Chi-square Logistic regression (SPSS)	Dimensions are called variables
4	Armatas and Yiannakos, 2010	Direct observation	Not	Scoreboard	Video SPORTSCOURT	Freq	Kappa	Descriptive analysis Chi-square
5	Armatas et al., 2009	Direct observation	Not	Scoreboard	Video SPORTSCOURT	Freq	Kappa Correlation coefficient	Descriptive analysis Chi-square
6	Barbosa et al., 2014	Direct observation	I/S/M	FF/CS	SDIS-GSEQ	Order	Kappa Consensual agreement	Lag sequential analysis
7	Barreira et al., 2014	Direct observation	N/S/M	FF/CS	SoccerEye	Order	Kappa	Lag sequential analysis
8	Barros et al., 2007	Direct observation	Not	Distances	Automated tracking system	Freq	Not	Descriptive analysis Kruskal-Wallis test ANOVA
9	Bradley et al., 2009	Direct observation	Not	Categories (Does not meet the category system requirements)	Computerized tracking system (Stadium Manager, ProZone)	Freq	Variation coefficient	Descriptive analysis Normality test ANOVA Tukey's post-hoc tests
10	Braz and Marcelino, 2013	Indirect observation	Not	Zonas	Video Excel	Freq Duration	Not	Descriptive analysis D'Agostino-Pearson test ANOVA Tukey test	Data downloaded from the web http://pt.fifa.com/index.html
11	Buraczewski et al., 2013	Direct observation	Not	CS	Not	Freq	Not	Descriptive analysis Mean comparison
12	Buscá Safont-Tria et al., 1996	Indirect observation	Not	CB (Catalog of behaviors]	Video	Freq	Agreement coefficient	Descriptive analysis	Data provided by Televisió de Catalunya
13	Camerino et al., 2012a	Direct observation	N/P/M	FF/CS	MATCH VISION STUDIO	Order	Kappa	T-Patterns
14	Carey et al., 2001	Direct observation	Not	CB	Video	Freq	Agreement percentage	Descriptive analysis Correlation
15	Carling, 2011	Direct observation	Not	Categories	Computerized tracking AMISCO	Freq	Not	Descriptive analysis Normality test ANOVA Bonferroni test Effect sizes
16	Casáis et al., 2011	Indirect observation	Not	CB	Not	Freq	Kappa	Descriptive analysis Kruskal-Wallis test Discriminant analysis	Data downloaded from the www.sdifutbol.com website Dimensions/behaviors are named variables Observation is called “notation system”
17	Casal et al., 2014	Direct observation	N/F/M	FF	NAC SPORT ELITE 42	Freq	Kappa	Descriptive analysis Chi-square Logistic regression
18	Casal et al., 2016	Direct observation	N/F/M	FF/CS	NAC SPORT ELITE 42 and LINCE	Freq	Kappa	Descriptive analysis Chi-square Logistic regression	Dimensions are called variables
19	Casal et al., 2015a	Direct observation	N/S/M	FF/CS	Video	Freq	Kappa	Descriptive analysis Chi-square Logistic regression	Dimensions are called variables
20	Casal et al., 2017	Direct observation	Not	FF/CS	Video	Freq Duration	Kappa	Kruskal-Wallis test Welch test Logistic regression
21	Casal et al., 2015b	Direct observation	N/S/M	FF	NAC SPORT ELITE 42	Freq	Kappa	Chi-square Logistic regression	Dimensions are called variables
22	Castañer et al., 2016	Direct observation	I/F/M	FC/SC (OSMOS)	LINCE	Order	Kappa	Proportions comparison Lag sequential analysos Polar coordinates
23	Castañer et al., 2017	Direct observation	N/F/M	FC/SC (OSMOS)	LINCE	Order	Kappa	T-Patterns detection Polar coordinates
24	Castelão et al., 2015	Direct observation	Not	CB	Video (from TV) Excel SDIS-GSEQ	Order	Not	Descriptive analysis Lag sequential analysis (SDIS-GSEQ)
25	Castellano and Hernández-Mendo, 2000	Direct observation	Lag-log	FC/SC	Video SDIS-GSEQ	Order	Kappa Consensual agreement Kendall Pearson Spearman TG	Lag seqüencial analysis (SDIS-GSEQ)
26	Castellano and Hernández-Mendo, 2002a	Direct observation	Lag-log	FC/SC (SOCCAF)	Video	Order	Kappa Correl. TG	TG Lag sequential analysis (SDIS-GSEQ)
27	Castellano and Álvarez, 2013	Direct observation	Not	CB Distances	Video EXCEL Computerized tracking AMISCO	Freq	Not	Descriptive analysis Kolmogorov-Smirnov test Levene test Lineal regression Correlations	Dimensions/behaviors are named variables They use independent and dependent variables
28	Castellano et al., 2013	Direct observation	Not	Distances	AMISCO Pro	Freq	Kappa	Descriptive analysis Mean comparison ANOVA Bonferroni test Effect size	Dimension “distance” is called “variable” Semiautomatic registration System
29	Castellano et al., 2011	Direct observation	Not	Distances and CS	Amisco	Freq	Not	Descriptive analysis Mauchly's test of sphericity General linear model Repeated measures ANOVA
30	Castellano et al., 2012	Indirect observation	Not	CS		Freq	Kappa	Descriptive analysis Dunnett post-hoc test Discriminant analysis	Data downloaded from the web: http://fifa.com/worldcup/index.html Behaviors are named indicators Dimensions/criteria are named variables
31	Castellano et al., 2009	Direct observation	Not	CS	Video EXCEL	Freq	Consensual agreement	Multidimensional scaling Correspondence analysis
32	Cavalera et al., 2015	Direct observation	N/F/M	FC/SC	Video LINCE	Order	Kappa	T-Patterns
33	Clemente, 2012	Indirect observation	Not	CB	Not	Freq	Not	Descriptive analysis ANOVA Kolmogorov-Smirnov test Levene test	Data downloaded from the web (http://www.fifa.com/worldcup/archive/southafrica2010/index.html) Observation is called “notation analysis” Behaviors are named variables, they also call them indicators The terms independent and dependent variable are used
34	Collet, 2013	Indirect observation	Not	CS Duration	Video STATA	Freq Duration	Not	Odds ratio Correlation Logistic regression	Some data was downloaded from websites: http://www.uefa.com/memberassociations/uefarankings/club/index.html http://www.fifa.com/worldranking/rankingtable/index.html
35	Di Salvo et al., 2010	Direct observation	Not	CB	Semi-automated image recognition system (Prozone®)	Freq	Not	Descriptive analysis Mean comparison Size effect
36	Di Salvo et al., 2007	Direct observation	Not	Categories Rating scale Distances	Computerized tracking AMISCO	Freq	Not	Descriptive analysis ANOVA Tukey test
37	Di Salvo et al., 2008	Direct observation	Not	Rating scale	Video	Freq	Not	Descriptive analysis Pearson correlation
38	Di Salvo et al., 2009	Direct observation	Not	Distances and some behaviors	Semi-automated image recognition system (Prozone ®)	Freq	Coefficient of variation	Mixed linear modeling Bonferroni test
39	Fleury et al., 2009	Indirect observation	Not	Indicators	Excel	Freq	Not	Descriptive analysis	Data downloaded from the web http://www.cbf.com.br
40	Gómez-Ruano et al., 2012	Indirect observation	Not	CB	Not	Freq	Kappa	Mixed linear model Factor analysis (using principal components and varimax rotation)	Data downloaded from the web www.sdifutbol.com They use independent and dependent variables Observation is called “notation system”
41	Holienka and Farkasovsy, 2017	Direct observation	Not	CB	Not	Freq	Not	Binomial test Mann-Whitney test	Authors consider it indirect observation
42	Hughes and Franks, 2005	Direct observation	Not	CB Scoreboard	Video	Freq	Percentage agreement	Mean comparison Regression analysis	Observation is called “notation system”
43	James et al., 2002	Direct observation	Not	CB Scoreboard	Video computerized System (Noldus Observer Video Pro)	Freq	Agreement percent	Chi-square
44	Lago-Ballesteros and Lago-Peñas, 2010	Indirect observation	Not	CB	Not	Freq	Kappa	Descriptive analysis ANOVA	Data downloaded from the web www.sdifutbol.com Dimensions/behaviors are named variables
45	Lago-Peñas and Anguera, 2003	Direct observation	Not	FF	Video	Order	Consensual agreement Kappa	Lag sequential analysis
46	Lago-Peñas and Lago-Ballesteros, 2011	Indirect observation	Not	BC	Not	Freq	Kappa	Descriptive analysis Kolmogorov-Smirnov test Mean comparison (t and Mann-Whitney) Structural coefficients	Dimensions/behaviors are named variables Observation is called “notation system”
47	Lago-Peñas et al., 2010	Indirect observation	Not	BC	Not	Freq	Kappa	Descriptive analysis Kruskal-Wallis test Chi-square Discriminant analysis	Data downloaded from the web www.sdifutbol.com Dimensions/behaviors are named variables Observation is called “notation system”
48	Lago-Peñas and Martín, 2007	Indirect observation	Not	BC	Not	Freq and duration	Not	Determination coefficient Regression analysis	They use independent and dependent variables Observation is called “notation system”
49	Lago-Peñas and Dellal, 2010	Indirect observation	Not	BC	Not	Freq	Kappa	Descriptive analysis Variation coefficient Regression analysis	They use independent and dependent variables Dimensions/behaviors are named variables
50	Lago-Peñas et al., 2003	Direct observation	I/F/M	FF	Video SDIS-GSEQ	Order	Kappa Consensual agreement	Descriptive analysis Lag sequential analysis
51	Lago-Peñas et al., 2009	Direct observation	Not	Categories Rating scales	Computerized tracking AMISCO	Freq	Kappa	Descriptive analysis Lineal regression	Dimensions/behaviors are named variables They use independent and dependent variables
52	Lago-Peñas et al., 2010	Direct observation	Not	Categories	Computerized tracking AMISCO	Freq	Not	Descriptive analysis Lineal regression	Dimensions/behaviors are named variables
53	Lago-Peñas et al., 2011	Indirect observation	Not	BC	Not	Freq	Kappa	Descriptive analysis ANOVA Discriminant analysis Structural coefficients	Criteria are named variables
54	Leite, 2013	Indirect observation	Not	Scoreboard	Archive data	Freq	Not	Descriptive analysis	Data downloaded from the web www.fifa.com
55	Losada, 2012	Direct observation	N/F/M	FC/SC	MATCH VISION STUDIO	Freq	Kappa	Descriptive analysis ANOVA Log-linear analysis Correspondence analysis
56	Machado et al., 2013	Direct observation	N/F/M	FF/SC	SoccerEye	Order	Kappa	Lag sequential analysis
57	Maneiro et al., 2017a	Direct observation	N/S/M	FC/SC	Video	Freq	Kappa	Descriptive analysis Chi-square	Dimensions are named variables
58	Maneiro et al., 2017b	Direct observation	N/S/M	FC/SC	Video	Freq	Kappa	Descriptive analysis Chi-square Logistic regression
59	Moraes et al., 2012	Indirect observation	Not	Categories	Video	Freq Duration	Kappa	Descriptive analysis Chi-square	Data provided by Central Digital de Dados–GFPA Dimensions are named variables
60	Njororai, 2013	Indirect observation	Not		Archive data	Freq	Kappa	Descriptive analysis	Data downloaded from the web http://www.fifa.com/worldcup/statistics
61	Novaes de Souza et al., 2012	Indirect observation	Not	Categories	Video	Freq	Third observer when disagreement existed	Kolmogorov-Smirnov test Levene test ANOVA Newman-Keuls test Friedman test	Data downloaded from the webs: Esporte.uol.com.br/futebol/campeonatos/brasileiro/, globoesporte.globo.com, www.youtube.com
62	Pino et al., 1998	Direct observation	Not	SC Rating scale	Video	Freq	Correlation coefficient	Descriptive analysis Chi-square
63	Planes and Anguera, 2015	Direct observation	N/F/M	FF/SC	MOTS LINCE	Order	Kappa	Comparison proportions
64	Pollard, 2006	Indirect observation	Not	Scoreboard	Not	Freq	Not	Descriptive analysis Regression analysis	Data downloaded from the webs: www.soccerway.com, www.rsssf.com and the Rothmans Football Yearbook independent and dependent variables are used
65	Ramos and Oliveira, 2008	Direct observation	Not	BC	Video	Freq	Not	Descriptive analysis
66	Rampinini et al., 2007	Direct observation	Not	Categories	Video Semiautomatic system PROZONE	Freq Duration	Not	Descriptive analysis Normality test Sphericity test ANOVA Bonferroni post-ho test
67	Ric et al., 2016	Direct observation	Not	Categories	SPI Pro GPSports	Freq Duration	Not	Hierarchical principal components Kruskal-Wallis test
68	Sainz de Baranda and López-Riquelme, 2012	Direct observation	Not	CS	Video DARTFISH TEAM PRO	Freq	Kappa	Descriptive analysis Chi-square Phi coefficient Cramer statistic	Observation is also called “notation system”
69	Sáinz de Baranda et al., 2011	Direct observation	Not	CS	Not	Freq	Kappa Correlation coefficient	Descriptive analysis Chi-square
70	Sánchez et al., 2009	Indirect observation	Not	Scoreboard	archived data	Freq	Not	Mean comparation ANOVA	Data downloaded from the web www.lfp.es
71	Sánchez-Flores et al., 2012	Direct observation	Not	CS	Video OBSERVER	Freq	Kappa Consensual agreement	Descriptive analysis Chi-square Binomial test (Poisson)	The observation instrument consists of categories and subcategories. Interplay sequentially is implicit.
72	Santos et al., 2016	Direct observation	Not	CS	Video Excel	Freq	Kappa	Descriptive analysis Kolmogorov-Smirnov test Kruskal-Wallis test
73	Sarmento et al., 2011	Direct observation	Not	FF	Not	Order	Inter- and intra-agreement	T-Patterns
74	Sarmento et al., 2017	Direct observation	Not	CS	Video	Freq	Kappa	Chi-square Logistic regression
75	Scoulding et al., 2004	Direct observation	Not	CS	Video NOLDUS OBSERVER VIDEO PRO	Freq Duration	Agreement	Chi-square Mann-Whitney test	Observation is called “notational system”
76	Sgrò et al., 2016	Direct observation	Not	Indicators	Video LONGOMATCH	Freq	ICC coefficient	OTP Ratio ANOVA Logistic regression	Behaviors are named indicators
77	Sgrò et al., 2015	Direct observation	Not	BC	Video LONGOMATCH	Freq	Correlation coefficient	Descriptive analysos Shapiro-Wilk test Kruskal-Wallis test Discriminant analysis	Observation is called “notation system” Behaviors are named indicators The denomination of independent and dependent variables is used
78	Shafizadeh et al., 2013	Direct observation	Not	BC Technical data	Video SPORTS PERFORMER SOFTWARE	Freq	Not	Time-series analysis	Behaviors are named indicators
79	Siegle and Lames, 2012	Direct observation	Not	FF/CS	Video	Freq Duration	Kappa Correlation coefficient	Descriptive analysis ANOVA MANOVA
80	Silva et al., 2009	Indirect observation	Not	BC Distances	archived data	Freq	Not	Spearman correlation	Behaviors to be observed are called ‘technical indicators’ Data downloaded from the web: www.globo.com/globoesporte
81	Silva et al., 2005	Direct observation	N/F/M	BC	Video SDIS-GSEQ	Order	Kappa	Lag sequential analysis
82	Soroka, 2014	Direct observation	Not	BC	Video Semiautomatic system FIFA's Castrol Performance	Freq	Not	Efficacy index Efficiency index Descriptive analysis Mean comparison
83	Stanculescu et al., 2014	Direct observation	Not	Categories	Video	Freq	Not	Descriptive analysis Means comparation	Observation is called “notation system” Behaviors to be observed are called “parameters”
84	Szwarc, 2008	Direct observation	Not	BC	Video	Freq	Not	Descriptive analysis
85	Taylor et al., 2008	Direct observation	Not	Categories	Video NOLDUS OBSERVER VIDEO PRO	Freq	Agreement coefficient	Log-linear analysis Logit analysis	Observation is called “notation system”
86	Tenga et al., 2010c	Direct observation	Not	BC	Not	Freq	Not	Descriptive analysis Logistic regression	Criteria/behaviors are named variables Control sample was used
87	Tenga et al., 2010b	Direct observation	Not	BC	Video FINAL CUT PRO	Freq	Kappa	Descriptive analysis Logistic regression ROC curve	Dimensions/behaviors are named variables They use independent and dependent variables
88	Thomas et al., 2006	Indirect observation	Not	Rating scale	Not	Freq	Not	Descriptive analysis Chi-square	Data downloaded from the web: www.soccerbase.com
89	Tierney et al., 2016)	Direct observation	Not	BC	Not	Freq	Not	Descriptive analysis MANOVA	It is combined with an experimental method
90	Vigne et al., 2010	Direct observation	Not	BC	Video	Freq	Kappa	Descriptive analysis ANOVA
91	Vogelbein et al., 2014	Direct observation	Not	BC Scoreboard	German PAL MathBall software	Freq and duration	Kappa α de Cronbach	Descriptive statistics Kruskal-Wallis test Mann-Whitney test Point-biserial correlation
92	Wallace and Norton, 2014	Direct observation	Not	FF/CS	SportsTec Australia	Freq Duration	Inter e intra (binomial test)	Regression analysis Trend analysis	Also, it is a correlational study Observation is called “notation system”
93	Yiannakos and Armatas, 2006	Direct observation	Not	BC Distances	Video SPORTSCOURT	Freq	Correlation coefficient	Descriptive analysis Chi-square
94	Zurloni et al., 2014	Direct observation	N/P/M	BC	LINCE	Order	Kappa	T-Patterns