Abstract
Abstract
Introduction
Randomised controlled trials (RCTs) are considered the gold standard for evaluating the efficacy and safety of healthcare interventions. For valid systematic reviews and evidence-based clinical guidelines, it is essential that results of all eligible RCTs are accessible. However, articles about trials published in languages other than English are often not listed in well-known and open trial databases like Medline and therefore scarcely findable. Handsearching national journals is an important approach to identify these articles and enhance their global visibility. Consequently, the results of trials conducted and published in non-English-speaking countries are not lost but rather integrated into the global body of evidence.
The present study aims to evaluate the benefits of extensive handsearching in Hungary and to identify key medical fields for future efforts. We will also assess the extent of grey literature in Hungary. We will appraise the risk of bias in the identified RCTs and controlled clinical trials (CCTs; indicating quasi-randomised or possibly randomised controlled trials) and examine the reporting quality of articles in Hungarian medical journals. Additionally, we will explore whether the automation tool Paperfetcher, recommended by Cochrane for handsearching, can effectively support these efforts in a non-English language context.
Methods and analysis
We will conduct a cover-to-cover handsearch of all Hungarian medical journals publishing content in the year 2023 to identify all controlled clinical trials, including RCTs, CCTs and non-RCTs, which are trials that use a clearly non-random method for allocating participants to groups. We will also search conference proceedings submitted to the Hungarian National Széchényi Library, abstract supplements from journals available via the Hungarian Medical Bibliography database, preprints available on medRxiv, Hungarian theses and dissertations, as well as Google Scholar to identify grey literature.
Two independent researchers will screen the identified records, assess their eligibility, extract data and evaluate the risk of bias and reporting quality according to the CONSORT statement. To verify the availability of reports and publications derived from the identified trials in electronic databases, we will systematically search MEDLINE, the Cochrane Central Register of Controlled Trials (CENTRAL), Embase and Scopus. All identified RCTs and CCTs not yet included in CENTRAL will be added to the database. Additionally, we will compare handsearching supported by the Paperfetcher tool with unsupported handsearching to evaluate the tool’s effectiveness in a Hungarian language context.
Ethics and dissemination
Since the publication resulting from the handsearching activity is a retrospective review of publicly available sources of evidence, ethical approval is not required. The study findings will be submitted for publication in a peer-reviewed journal and will be presented at international conferences.
Keywords: Randomized Controlled Trial, Information Storage and Retrieval, Research Design, Clinical Trial
STRENGTHS AND LIMITATIONS OF THIS STUDY.
Dedicated experts from diverse clinical fields identify all Hungarian medical and health science journals for an entire year, conduct handsearching to ensure comprehensive coverage. The results of handsearching will be published in the Cochrane Library.
Study selection and data extraction will be performed independently by two researchers, which will ensure that all relevant studies are included without personal biases.
Searching for grey literature is a cumbersome task, so despite our best intentions and diligence, we may not find everything we would like to include in our research.
Introduction
Background and rationale
Systematic reviews of healthcare interventions and evidence-based clinical practice guidelines should include all information from medical research on the clinical question under consideration. Randomised controlled trials (RCTs) are the most reliable evidence showing whether a cause-effect relation exists between treatment and outcome.1
The Cochrane Central Register of Controlled Trials (CENTRAL) is a database of the Cochrane Library containing randomised controlled trial (RCT) and controlled clinical trial (CCT) records. RCTs involve the random assignment of participants to intervention groups, whereas CCTs use a quasi-random method of allocation—such as alternation, date of birth, or case record number—or feature unclear reporting of randomisation. CENTRAL is currently the most comprehensive database of information on RCTs and CCTs worldwide. It is maintained by Cochrane’s Centralised Search Service (CSS), which routinely identifies RCT/CCT records from MEDLINE, Embase, CINAHL, ClinicalTrials.gov and WHO ICTRP. Besides, records identified through handsearching are also added.
Handsearching refers to the meticulous, manual review of each page within a journal issue or conference proceeding to identify all eligible trial reports.2 Handsearching enables the identification of reports of trials not included in electronic bibliographic databases, for example, because the published articles are not written in English, as well as reports of trials which are available in electronic databases but could not be identified because they are not sufficiently described and indexed.
Additionally, RCTs presented at a conference are often published as short abstracts in a conference abstract book and cannot be found by searching electronic databases. Thus, handsearching is an essential and critical activity to find all relevant trials related to a clinical question.3 As part of the handsearching activity, journals, conference proceedings and other sources serve as valuable resources for identifying trials within articles, conference abstracts, society reports, news, editorials, letters or other types of text.4
As part of the CENTRAL-related handsearching activities, some Cochrane Fields search journals relevant to their scope, while certain Cochrane Geographic groups search journals in their respective languages (eg, German, Dutch, Italian and Chinese).5 About three-quarters of the randomised trials identified by the Cochrane Collaboration through various handsearching projects were published in English and German journals.6 In Germany, handsearching effort began in 1995. In the first ten years, 79 German-language medical journals were searched, resulting in the recording of approximately 17 000 RCTs and controlled clinical trials (CCTs).7,9
Outside Western Europe, extensive handsearching was conducted, for example in Turkey with the aim to compensate for the lack of a database of national medical journals,10 or in Russia, where handsearching has proven essential for identifying additional relevant RCTs and quasi-RCTs due to challenges in character recognition.11 In other regions, handsearching was limited to a few relevant journals. This way, for example, 21 RCTs/q-RCTs not included in the main databases were identified across fourteen volumes of the Annals of Saudi Medicine,12 while 50 trials in twelve volumes of twelve medical journals in Cuba,13 and 15 RCTs and 24 non-randomised CCTs in nineteen volumes of five medical journals in Sri Lanka.14
Language-specific handsearching is important as it aims to identify RCTs and q-RCTs published in local journals that are not included in large electronic databases. Without the targeted efforts of handsearching, this trial information would remain unrecognised, rendering it unavailable for informing systematic reviews of interventions and evidence-based clinical practice guidelines. Failure to consider study results published in non-English languages might lead to incomplete and biased systematic reviews.
In Hungary, handsearching has not been conducted yet, although two decades ago a pilot study showed that in the field of neuroscience, a considerable number of RCTs and q-RCTs were published exclusively in Hungarian language.15 Therefore, till now, the Cochrane CENTRAL database does not contain study results published in the Hungarian language.
Recently we performed a national survey among researchers who published medical or health-related research as first or last author in 2020 with a Hungarian affiliation in a PubMed-indexed journal. As part of this survey, we tried to assess in advance the extent of research results published in Hungarian journals. Out of 469 Hungarian first and last authors participating in our survey, 150 researchers (32%) answered the question, ‘Have you ever made a decision to publish your research results exclusively in a Hungarian journal?’ with a ‘Yes’. When we asked for further explanation, 105 researchers answered that they ‘feel this will make it easier for my research to reach the right target audience’ (detailed survey results are under publication). Our research results confirm that there may be specific fields or research areas in Hungary where the number of research results published in domestic journals is significant.
In addition to the clinical trial results published in Hungarian language journals, we currently do not have accurate information on the extent of the Hungarian grey literature. Grey literature is usually defined as literature not formally published in sources such as books or journal articles16 and not controlled by commercial publishers.2 17 It can exist in many formats: reports including preprints; preliminary progress and advanced reports; institutional, internal; research memoranda; reports of commissions and study groups; as well as conference proceedings, even translations, or diverse official documents.18 19 Access to grey literature remains difficult.20 Although a Cochrane Methodology Review indicated that studies published in journal articles showed a greater treatment effect than studies published in the grey literature, there is still a possibility that the failure to identify studies published in conference proceedings and other grey literature may affect the results of a systematic review.16 21 The aim of the present meta-epidemiological study is to answer the question whether there are relevant medical studies in Hungary that may not be captured in traditional databases, to specify medical fields where handsearching would be valuable and worthwhile and to compare the effectiveness of automated and traditional handsearching within the Hungarian language context.
Objective
The primary objectives of the present meta-epidemiological study are as follows:
Identify those healthcare-related intervention studies which have at least two groups and can be classified as RCTs, CCTs or non-randomised controlled studies.
To determine the extent of grey literature in Hungary by assessing all 133 Hungarian medical journals publishing content in the year 2023.
Our secondary aims are as follows:
Evaluate the reporting quality by measuring adherence to the CONSORT guideline.
Assess the risk of bias in RCTs/q-RCTs published in Hungarian medical journals by using Cochrane risk-of-bias and ROBINS-I tools.
Compare the effectiveness of handsearching supported by the automation tool Paperfetcher22 with unsupported handsearching by measuring the number of unique trial records identified and accuracy in the Hungarian language environment.
Methods and analysis
Our project will be realised with the support of the Pekár Mihály Medical and Life Sciences Library, Medical School, University of Pécs, Hungary. This collaboration will grant our research team the necessary access to journals and other grey literature, such as conference proceedings. In addition, the library’s well-established networks and comprehensive cataloguing systems will facilitate the identification and retrieval of a wide range of medical publications, including those not included in the main databases.
We commenced this study in 2024 by inviting experts from various medical fields to contribute to our project. We identified non-indexed Hungarian journals relevant to their areas of expertise and began conducting handsearching in 2025 on a selected number of these journals. This work is currently ongoing.
Journals selected for handsearching
We identified 133 eligible Hungarian journals (see online supplemental material) that published articles in the field of medical sciences in 2023. While a limited number of these journals are included in indexed databases, their contents are only partially displayed, so handsearching of these journals might be relevant as well.
Criteria for inclusion
All 133 Hungarian medical journals publishing content in the year 2023 will be included. We will handsearch these journals cover to cover for controlled clinical trials.
The decision algorithm for determining whether a trial report qualifies as a controlled clinical trial will closely resemble the eligibility criteria used to decide if a record should be added to the CENTRAL database.23 However, it will also include the identification of controlled clinical trials that employ a clearly non-random method for allocating participants to groups:
Participants in reports must be living human beings.
All trial reports must involve an intervention related to healthcare.
Experimental studies, but not observational studies.
The study has to include at least two groups (both an intervention and a comparator group).
Must have definitely or possibly used some form of randomisation (RCT) or quasi-randomisation or possibly randomisation (CCT) to form the different intervention groups, as well as trials defined as non-randomised (non-RCTs).
The following report types will be considered as eligible sources for a controlled clinical trial:
Report with the primary results of the trial.
Report with secondary or subgroup analysis.
Report that presents details regarding the study design or protocol of a trial, without presenting results.
Report that describes a pilot for a trial that is being planned.
Report that describes the development or implementation of an intervention for a trial that is planned, underway, or completed.
Report of a retrospective analysis of the randomised data of a trial.
Report providing patient-level data for a trial.
Report describing baseline characteristics of an RCT/q-RCT.
Report on a trial-based economic evaluation.
Erratum to a RCT/q-RCT.
Reply/comment/letter that presents new information about the conduct, methods, or results of a trial.
We will exclude reports of observational studies using participants or materials from a trial if these reports no longer relate to the randomised comparison. We will also exclude a report of an open-label extension study where all participants receive the intervention in a single-arm way.
Data collection and management
Print journals will be searched page by page for controlled clinical trials, from the most recent, backward in time.24
Electronic journals (ie, journals that are available in electronic format) will be searched in a similar way as print journals. We will screen the journal content webpage by webpage or pdf by pdf for controlled clinical trials. Two researchers will independently screen the articles in the journals and decide on their eligibility.2 In case of disagreement, they will discuss their decision with a third researcher with a strong methodological background, to make an appropriate final decision.
We will document the following information in an Excel sheet for each reviewed journal:
Name of handsearched journal.
Print or electronic journal.
Year.
Volume.
Issue.
Screeners’ name.
Whether a controlled clinical trial was found in the given issue of the journal, and if so, the number of controlled clinical trials identified in the journal.
Identified controlled clinical trials will be categorised as RCT, CCT or non-RCT. Trials in which participants are definitely assigned to intervention groups using randomisation will be classified as RCTs. Trials in which participants are assigned to intervention groups using quasi-randomisation will be classified as quasi-RCTs. Within the quasi-RCT category, there are two subcategories: (1) trial reports in which the method of allocation is known but is considered quasi-random (eg, alternating assignment) rather than strictly random and (2) trial reports where the method of allocation is not clearly reported but may be either random or quasi-random. We will also identify studies that can be classified as non-randomised controlled clinical trials (non-RCTs), which involve participants being allocated to two or more groups without the use of randomisation.23 These studies do not meet the criteria for RCTs or q-RCTs.
From the identified clinical trials, we will record the bibliographical reference (authors, authors’ affiliation, journal and title) and extract information on participants, intervention, comparator, outcomes and study design. We will develop our data extraction tool according to the CONSORT 2024 checklist.25
Identification of grey literature
In order to get a comprehensive picture of Hungarian grey literature, we are planning to review not only Hungarian health journals but also other sources, including society reports and conference abstracts.
In Hungary, there are no grey literature databases, such as the European multidisciplinary OpenGrey26 or the UK English-language resource collection website at Newcastle University.27 Conference proceedings are covered by the Legal Deposit Act,28 so a copy must be sent to the Hungarian National Széchényi Library and made available in the library. We will use the Hungarian National Széchényi Library’s search interface (https://nektar2.oszk.hu/librivision_hun.html). This search interface also provides access to the National Bibliography, which will also be searched.
Another source of conference abstracts is the abstract supplements of different journals. We will search for these abstract supplements by performing systematic searches in the Hungarian Medical Bibliography (MOB) database (https://mob.aeek.hu/search.jsp).
We will search preprints through medRxiv (which is an online preprint disciplinary repository of health sciences).29 Our preliminary search identified nearly 800 Hungarian manuscripts available as preprints via medRxiv.
To search for Hungarian theses/dissertations (either completed or available as a preprint), we will use the database of the Scientific Document Common Search Service.30 We will also search the multidisciplinary Hungarian database called Hungarian Electronic Library (MEK),31 which is a well-known repository for publications and manuscripts that are not published, have low circulation or are not available in book circulation. Additionally, we will explore Google Scholar.
For each search interface, we develop an appropriate search strategy to achieve the most relevant results, using the Hungarian equivalent of search terms like ‘medic*’, ‘conference*’, ‘proceed*’, ‘trial*’, ‘clinical*’, ‘RCT*’, ‘randomi?ed*’ and combine them with Boolean operators.32
Identified records will be classified into the following format categories: articles, letters, conference abstracts/proceedings, reports, dissertations and preprints. We then independently assess the topic of the reports and the relevance of the reports to the Cochrane Collaboration.33
Examining the originality of research published in Hungarian-language journals
To check whether the identified RCTs, q-RCTs and CCTs were also reported in scientific publications available in indexed databases, we will conduct systematic searches in the databases MEDLINE (via Ovid), Cochrane CENTRAL, Embase (via embase.com) and Scopus. As search terms, we will combine various study information such as the registry identification number (if available), study title, acronym, information on the content of the study (participants, intervention, comparator and outcomes) and/or name of the applicant or principal investigator.
The identified English language publications will be categorised into one of the following four categories: (1) a study independent of the study described in the Hungarian publication, (2) a study identical to the study described in the Hungarian publication but reporting completely different results, (3) a study identical to the study described in the Hungarian publication but reporting partially different results and (4) a study identical to the study described in the Hungarian publication reporting completely identical results.
Inclusion of Hungarian RCTs and q-RCTs in the CENTRAL database
RCTs and q-RCTs identified within this project will be added via the Cochrane CRS (Cochrane Register of Studies) interface to CENTRAL, taking into account the HarmoniSR guidance.34
Comparison of unsupported handsearching and automated handsearching
In the case of manual handsearching, the first step is visiting each journal’s website or hard copies and browsing through the tables of contents of different issues. In contrast, when Paperfetcher is used,22 first the list of journals or conference proceedings has to be entered. Paperfetcher—the algorithm which queries the database of academic content registered with Crossref—returns bibliographic metadata, which can be imported first into a citation management tool (eg, EndNote), and in a subsequent step into a systematic review screening tool (eg, Covidence) for screening based on inclusion or exclusion criteria. The step of screening is the same for both methods.
In our research, we will be investigating whether Paperfetcher is suitable for supporting handsearching in a Hungarian language environment. According to the article on Paperfetcher, the programme can be used to look up journals that use a DOI number based on CrossRef (Digital Object Identifier Registration Agency). According to data from the Hungarian Medical Bibliography, about one-third of Hungarian journals have a DOI. We will process a few years of data with both methods (ie, supported and unsupported with Paperfetcher).
Reporting quality and risk of bias assessment in RCTs/q-RCTs published in Hungarian medical journals
Adherence to the CONSORT guideline25 will be evaluated by two independent researchers. We will use a 19-item checklist described by Elagami et al,35 each scored from 0 to 2 (maximum of 38 points). To evaluate the risk of bias, we will use the Cochrane risk-of-bias (RoB 2) tool for RCTs and the ROBINS-I tool for q-RCTs. The RoB 2 tool comprises five specific domains: bias arising from the randomisation process, bias due to deviations from intended interventions, bias due to missing outcome data, bias in the measurement of the outcome and bias in the selection of the reported results. The ROBINS-I tool has seven domains, including confounding, selection bias, bias in measurement classification of interventions, bias due to deviations from intended interventions, bias due to missing data, bias in measurement of outcomes and bias in selection of the reported result. Any discrepancies in evaluation will be resolved through consultation with a third expert reviewer.
We will conduct a descriptive analysis of the characteristics of the included studies. Qualitative variables will be summarised using frequency distributions, while quantitative variables will be described by means and SD. Analyses will be performed with R Statistical Software (V. 4.4.3; R Core Team 2024).36 We will conduct regression analyses to investigate the association between exploratory variables and CONSORT adherence/RoB overall assessment (outcome variable).
Patient and public involvement
None.
Ethics and dissemination
Since the publication resulting from the handsearching activity is a retrospective review of publicly available sources of evidence, ethical approval is not required. The results of the Hungarian handsearching study will be disseminated through peer-reviewed publications, workshops and academic conferences.
Supplementary material
Footnotes
Funding: This document has been issued with the support of MTA (Hungarian Science Academy) within the framework of the Lendület Program.
Prepublication history and additional supplemental material for this paper are available online. To view these files, please visit the journal online (https://doi.org/10.1136/bmjopen-2024-096489).
Provenance and peer review: Not commissioned; externally peer reviewed.
Patient consent for publication: Not applicable.
Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research.
References
- 1.Sibbald B, Roland M. Understanding controlled trials. Why are randomised controlled trials important? BMJ. 1998;316:201. doi: 10.1136/bmj.316.7126.201. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Lefebvre C, Glanville J, Briscoe S, et al. In: Cochrane handbook for systematic reviews of interventions version 6.4. Higgins JPT, Thomas J, Chandler J, et al., editors. Cochrane; 2024. Technical supplement to chapter 4: searching for and selecting studies. [Google Scholar]
- 3.Hopewell S, Clarke M, Lefebvre C, et al. Handsearching versus electronic searching to identify reports of randomized trials. Cochrane Database Syst Rev. 2007;2007:MR000001. doi: 10.1002/14651858.MR000001.pub2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Cochrane Information Specialist Support Team . Cochrane information specialists’ handbook. Cochrane; 2023. Handsearching. [Google Scholar]
- 5.How CENTRAL is created. [12-Jul-2024]. https://www.cochranelibrary.com/central/central-creation Available. Accessed.
- 6.McDonald S, Lefebvre C, Antes G, et al. The Contribution of Handsearching European General Health Care Journals to the Cochrane Controlled Trials Register. Eval Health Prof . 2002;25:65–75. doi: 10.1177/0163278702025001005. [DOI] [PubMed] [Google Scholar]
- 7.Blümle A, Antes G. AB Cochrane Colloquium, Melbourne, Australia; 2005. [12-Jul-2024]. Ten years of handsearching in germany - results and future prospects [poster]https://abstracts.cochrane.org/2005-melbourne/ten-years-handsearching-germany-results-and-future-prospects Available. Accessed. [Google Scholar]
- 8.Blümle A, Antes G. Handsuche nach randomisierten kontrollierten Studien in deutschen medizinischen Zeitschriften. Dtsch med Wochenschr. 2008;133:230–4. doi: 10.1055/s-2008-1017501. [DOI] [PubMed] [Google Scholar]
- 9.Blümle A, Antes G, Diener MK. Handsuche nach kontrollierten klinischen Studien in deutschsprachigen chirurgischen Zeitschriften. Chirurg. 2007;78:1052–8. doi: 10.1007/s00104-007-1372-y. [DOI] [PubMed] [Google Scholar]
- 10.Gurkan OU, Celik G, Kumbasar O, et al. Sarcoidosis in Turkey: 1954-2000. Ann Saudi Med. 2004;24:36–9. doi: 10.5144/0256-4947.2004.36. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Vlassov V. Is there epidemiology in Russia? J Epidemiol Community Health. 2000;54:740–4. doi: 10.1136/jech.54.10.740. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Cathey J, Al Hajeri AA, Fedorowicz Z. A comparison of handsearching versus EMBASE searching of the Annals of Saudi Medicine to identify reports of randomized controlled trials. Ann Saudi Med. 2006;26:49–51. doi: 10.5144/0256-4947.2006.49. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Torres-Pombert A, Santana-Arroyo S. Handsearching and electronic search of clinical trials in Cuban medical journals: analysis of terminology. Medwave. 2019;19:e7603. doi: 10.5867/medwave.2019.02.7603. [DOI] [PubMed] [Google Scholar]
- 14.Abeysena C, Poddalgoda I. Quality of reporting clinical trials published in five leading Sri Lankan medical journals. J Evid Based Med. 2013;6:243–9. doi: 10.1111/jebm.12069. [DOI] [PubMed] [Google Scholar]
- 15.Bereczki D, Gesztelyi G. A Hungarian example for handsearching specialized national healthcare journals of small countries for controlled trials. Is it worth the trouble? Health Libr Rev . 2000;17:144–7. doi: 10.1046/j.1365-2532.2000.00280.x. [DOI] [PubMed] [Google Scholar]
- 16.Higgins JPT, Green S, editors. Cochrane handbook for systematic reviews of interventions version 5.1.0. The Cochrane Collaboration; 2011. [Google Scholar]
- 17.Farace DJ, Frantzen J, editors. Sixth International Conference on Grey Literature. Work on grey in progress; New York. Amsterdam: TextRelease; 2004. [Google Scholar]
- 18.Alberani V, De Castro Pietrangeli P, Mazza AM. The use of grey literature in health sciences: a preliminary survey. Bull Med Libr Assoc. 1990;78:358–63. [PMC free article] [PubMed] [Google Scholar]
- 19.Farace DJ, Schöpfel J, editors. Grey literature in library and information studies. Berlin, New York: K. G. Saur; 2010. [Google Scholar]
- 20.Dickersin K, Scherer R, Lefebvre C. Identifying relevant studies for systematic reviews. BMJ. 1994;309:1286–91. doi: 10.1136/bmj.309.6964.1286. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Hopewell S, McDonald S, Clarke M, et al. Grey literature in meta-analyses of randomized trials of health care interventions. Cochrane Database Syst Rev. 2007;2007:MR000010. doi: 10.1002/14651858.MR000010.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Pallath A, Zhang Q. Paperfetcher: A tool to automate handsearching and citation searching for systematic reviews. Res Synth Methods. 2023;14:323–35. doi: 10.1002/jrsm.1604. [DOI] [PubMed] [Google Scholar]
- 23.Dickersin K, Larson K, Brodney S, et al. US Cochrane Center; 2002. Training manual for handsearchers; pp. 1–81. [Google Scholar]
- 24.Oxford: UK Cochran Center; 1993. Biomed proposal: European contribution to an international register of randomized controlled trials (RCTs) of health care; pp. 1–15. [Google Scholar]
- 25.Tunn R, Boutron I, Chan A-W, et al. Methods used to develop the SPIRIT 2024 and CONSORT 2024 Statements. J Clin Epidemiol. 2024;169:111309. doi: 10.1016/j.jclinepi.2024.111309. [DOI] [PubMed] [Google Scholar]
- 26.Data station social sciences and humanities. [17-Jul-2024]. https://ssh.datastations.nl/ Available. Accessed.
- 27.Newcastle University Library; [17-Jul-2024]. Grey literature.https://libguides.ncl.ac.uk/greylit Available. Accessed. [Google Scholar]
- 28.Wolters Kluwer, Hungarian; [17-Jul-2024]. 717/2020. (XII. 30.) Korm. rendelet a kiadványok kötelespéldányainak szolgáltatásáról, megőrzéséről és használatáról. [Government decree no. 717/2020. Legal deposit act.]https://net.jogtar.hu/jogszabaly?docid=a2000717.kor Available. Accessed. [Google Scholar]
- 29.medRxiv The preprint server for health sciences. [17-Jul-2024]. https://www.medrxiv.org/ Available. Accessed.
- 30.A Magyar Tudományos Akadémia Tudományos Dokumentumok Közös Keresője (TuDoKK). [Scientific Document Common Search Service] [17-Jul-2024]. https://tudokk.mtak.hu/ Available. Accessed.
- 31.Magyar Elektronikus Könyvtár (MEK). [Hungarian electronic library] [17-Jul-2024]. https://mek.oszk.hu/hu/ Available. Accessed.
- 32.Kele I, Bereczki D, Furtado V, et al. Searching a biomedical bibliographic database from Hungary—the ‘Magyar Orvosi Bibliográfia’. Health Info Libraries J . 2005;22:293–5. doi: 10.1111/j.1471-1842.2005.00577.x. [DOI] [PubMed] [Google Scholar]
- 33.Milne R, Thorogood M. Hand searching the Journal of Epidemiology and Community Health as part of th Cochrane Collaboration. J Epidemiol Community Health. 1996;50:178–81. doi: 10.1136/jech.50.2.178. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Noel-Storr A, Stovold L, Doney L, et al. HarmoniSR: final project report. [17-Jul-2024]. https://community.cochrane.org/sites/default/files/uploads/inline-files/HarmoniSR%20-%20final%20report%20-Sept%202015_22-09-2015.pdf Available. Accessed.
- 35.Elagami RA, Reis TM, Hassan MA, et al. CONSORT statement adherence and risk of bias in randomized controlled trials on deep caries management: a meta-research. BMC Oral Health. 2024;24:687. doi: 10.1186/s12903-024-04417-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.R Core Team: Vienna, Austria; 2024. R: a language and environment for statistical computing.https://www.R-project.org/ Available. [Google Scholar]