Table 6.
Limitations of the instructional interventions described in the empirical studies reviewed.
| Research | Background limitations | Limitations on participants | Limitations of the instrument | Program limitations | Limitations of results | Discussion on limitations and conclusions | General limitations | Comments |
|---|---|---|---|---|---|---|---|---|
| Alfonzo and Batson (2014) | The research question is missing Missing assumptions or forecasts Missing targets |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data | Non-grouping | No graphs or tables They do not analyze each variable Not analyzing generalization effects |
Does not indicate reliability and validity assessment | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Ata and Yildirim (2019) | The research question is missing | Lack of inclusion and exclusion criteria | No tasks Do not record the entire process |
Non-grouping | They do not analyze each variable | They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Few evaluation strategies |
| Ball (2019) | The research question is missing Missing assumptions or forecasts |
No method | Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Non-grouping | No graphs or tables They do not analyze each variable |
They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Does not indicate the sample |
| Botturi (2019) | The research question is missing | Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Non-grouping | They do not analyze each variable | They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Few evaluation strategies |
| Campbell and Kapp (2020) | The research question is missing Missing assumptions or forecasts |
Lack of inclusion and exclusion criteria | No tasks Do not record the entire process |
Non-grouping | They do not analyze each variable | Does not indicate reliability and validity assessment current previews |
No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Carl and Strydom (2017) | The research question is missing Missing assumptions or forecasts Missing targets |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Non-grouping No duration |
No graphs or tables They do not analyze each variable Not analyzing generalization effects |
Does not indicate reliability and validity assessment | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Domingo-Coscolla et al. (2020) | The research question is missing Missing assumptions or forecasts |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Non-grouping | They do not analyze each variable | They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Elliott et al. (2018) | The research question is missing Missing assumptions or forecasts |
Lack of inclusion and exclusion criteria Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Non-grouping | No graphs or tables They do not analyze each variable |
They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Elphick (2018) | The research question is missing Missing assumptions or forecasts |
Lack of inclusion and exclusion criteria | Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
No number of sessions | They do not analyze each variable | They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | The application of standardized chords and instruments is lacking. Few evaluation strategies |
| Gabriele et al. (2019) | Obsolete fonts | Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Non-grouping | Only the publication is compared | They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Gill et al. (2015) | The research question is missing Missing assumptions or forecasts Missing targets |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data | Non-grouping | No graphs or tables They do not analyze each variable Not analyzing generalization effects |
They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Hamutoglu et al. (2019) | The research question is missing | Lack of inclusion and exclusion criteria | No tasks | Non-grouping | Only the publication is compared | The answer to the research question is not indicated | No ethical controls (informed acceptance to participate, confidentiality...) | Few evaluation strategies |
| Istenic et al. (2016) | The research question is missing Missing assumptions or forecasts Missing targets |
Lack of inclusion and exclusion criteria | Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Non-grouping | No graphs or tables They do not analyze each variable Not analyzing generalization effects |
They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | The application of standardized chords and instruments is lacking. Few evaluation strategies |
| Kajee and Balfour (2011) |
Obsolete fonts The research question is missing Missing assumptions or forecasts |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Not who implemented | No graphs or tables They do not analyze each variable Not analyzing generalization effects |
Does not indicate Reliability and Validity Assessment | Key information to replicate the intervention is missing | Sample must be larger |
| Kuhn (2017) | The research question is missing Missing assumptions or forecasts Missing targets |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
No number of sessions Not who implemented |
No graphs or tables They do not analyze each variable |
They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Lerdpornkulrat et al. (2019) | Missing assumptions or forecasts | Lack of inclusion and exclusion criteria | No tasks Do not record the entire process |
Does not indicate instruction procedure | No practical and theoretical applications | No explicit limitations | No ethical controls (informed acceptance to participate, confidentiality...) | Does not use the wallet |
| Paige et al. (2016) | The research question is missing Missing assumptions or forecasts Missing targets |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
Non-grouping | No graphs or tables They do not analyze each variable Not analyzing generalization effects |
They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Pequeño et al. (2017) | The research question is missing Missing assumptions or forecasts Missing targets |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
No number of sessions Not who implemented |
No graphs or tables They do not analyze each variable |
They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Sample must be larger |
| Robertson et al. (2012) | Obsolete fonts The research question is missing Missing assumptions or forecasts Missing targets |
Reduced sample Non-representative sample |
Non-validity and reliability of instruments with their own data Inadequacy of the age course of the instruments Instruments unknown and not provided for in the Annex |
Not who implemented | No graphs or tables They do not analyze each variable Not analyzing generalization effects |
Does not indicate Reliability and Validity Assessment | It's not an experimental intervention study, it's just a pre-post group Key information to replicate the intervention is missing No ethical controls (informed acceptance to participate, confidentiality...) |
The application of standardized chords and instruments is lacking. Few evaluation strategies |
| Sharp (2018) | The research question is missing Missing assumptions or forecasts |
Lack of inclusion and exclusion criteria |
Non-validity and reliability of instruments with their own data Instruments unknown and not provided for in the Annex |
No number of sessions Not who implemented |
No graphs or tables They do not analyze each variable |
They do not compare with previous current studies | Key information to replicate the intervention is missing | The application of standardized chords and instruments is lacking. Few evaluation strategies |
| Tomczyk et al. (2020) | Missing research question Missing assumptions or forecasts | Lack of inclusion and exclusion criteria | No tasks Do not record the entire process |
Non-grouping | They do not analyze each variable | They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Few evaluation strategies |
| Vinokurova et al. (2021) | The research question is missing Missing assumptions or forecasts Missing targets |
Lack of inclusion and exclusion criteria | No tasks Do not record the entire process |
Non-grouping | They do not analyze each variable | They do not compare with previous current studies | No ethical controls (informed acceptance to participate, confidentiality...) | Does not indicate the procedure or the participants or the sessions |