Skip to main content
Exploratory Research in Clinical and Social Pharmacy logoLink to Exploratory Research in Clinical and Social Pharmacy
. 2023 Jan 20;9:100229. doi: 10.1016/j.rcsop.2023.100229

Improving the quality of publications in and advancing the paradigms of clinical and social pharmacy practice research: The Granada Statements

Fernando Fernandez-Llimos a, Shane Desselle b,, Derek Stewart c, Victoria Garcia-Cardenas d, Zaheer-Ud-Din Babar e, Christine Bond f, Ana Dago g, Ramune Jacobsen h, Lotte Stig Nørgaard i, Carlo Polidori j, Manuel Sanchez-Polo k, Bernardo Santos-Ramos l, Natalia Shcherbakova m, Fernanda S Tonin n
PMCID: PMC9971279  PMID: 36866074

Abstract

Pharmacy and pharmaceutical sciences embrace a series of different disciplines. Pharmacy practice has been defined as “the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on health care systems, medicine use, and patient care”. Thus, pharmacy practice studies embrace both clinical pharmacy and social pharmacy elements. Like any other scientific discipline, clinical and social pharmacy practice disseminates research findings using scientific journals. Clinical pharmacy and social pharmacy journal editors have a role in promoting the discipline by enhancing the quality of the articles published. As has occurred in other health care areas (i.e., medicine and nursing), a group of clinical and social pharmacy practice journal editors gathered in Granada, Spain to discuss how journals could contribute to strengthening pharmacy practice as a discipline. The result of that meeting was compiled in these Granada Statements, which comprise 18 recommendations gathered into six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work.

Keywords: Pharmacy practice, Scientific paradigm, Social and behavioral pharmacy

1. Scientific fields and their achieving scientific paradigm

Disciplines are shaped by and in turn help to shape human behavior.1 Several models developed over the past 50 years attempted to classify disciplines objectively. For instance, Biglan and Becher, grounded in Lodahl & Gordon's and Kuhn's ideas,2, 3, 4 argued that fields with established paradigms (e.g., physics, chemistry) have a high degree of consensus about theory, methods, and problems, while the opposite is observed for so-called “low-consensus” disciplines such as in humanities and the social sciences.5 According to the Recommendation Relating to the International Normalisation of Statistics on Science and Technology issued by the United Nations Educational, Scientific and Cultural Organization (UNESCO), fields of study or scientific disciplines broadly consists of: Exact and Natural Sciences, Engineering and Technology, Medical Sciences (including Pharmacy), Agricultural Sciences, Social Sciences, and Humanities. Yet, disciplines are not rigid, well-defined entities. Conversely, they are fluid, context-dependent and multi-scale phenomena built on repeated contributions (publications, academic works) and interactions (collaboration among researchers and other stakeholders).1 In this sense, it is even harder to describe, consistently define, and to attribute appropriate terminology to research areas where inter- and multi-disciplinarity exist (reflecting different practices and interactions between disciplines), such as those within Pharmacy. Traditionally, chemistry, biochemistry, physics, and physiology form Pharmacy's core knowledge base, but the social component (e.g., humanistic, and social sciences) should also be recognized as a pillar of the practice of pharmacy.6

A lack of consistency and consensus attenuates a discipline's progress and has a deleterious impact on its constituent scholars. Some of the findings from previous research indicate that scholars in low-consensus fields have a more difficult time publishing, tend to persist at “re-creating the wheel”, are less successful with acquisition of extramural grants, and have a poorer outlook on research and scholarship.7 This translates even to those scholars in university settings being less likely promoted in academic rank and even having lower salaries and poorer benefits than those who are in disciplines that have achieved greater scientific paradigm.8 The impact of research findings on professional practice and wider societal levels may be less in low-consensus fields.9

Clinical and social pharmacy practice are important research areas within Pharmaceutical Sciences9,10 that have undergone (and are still undergoing) substantial changes. As what might be considered lower consensus fields, these two research areas are currently beset by a lack of agreement and a common understanding of what constitutes their very core, often being associated only with evaluating narrowly focused pharmacy services.6,11 Although no universally accepted definition for pharmacy practice research exists, the International Pharmaceutical Federation Pharmacy Practice Special Interest Group (FIP PPR-SIG) defined it as ‘the scientific discipline that studies the different aspects of the practice of pharmacy and its impact on health care systems, medicine use, and patient care’.12 A common misinterpretation of the nature of this field is confounding the term ‘practice’ with ‘practical issues’ and ignoring the theoretical bases that ultimately will support clinical and social pharmacy interventions. Kerlinger and Lee point out that the aim of science is theory; and theory is “a set of interrelated constructs, definitions, and propositions that present a systematic view of phenomena by specifying relations among variables, with the purpose of explaining and predicting the phenomena”.13Furthermore, clinical pharmacy aims to optimize the utilization of medicines through and practice and research in order to achieve person-centered and public health goals.14

The scope of pharmacy practice has expanded over the past decades to encompass clinical, behavioral, economic, and humanistic implications of the practice of pharmacy, as well as the implementation of innovations in practice (e.g., health interventions, patient-care services), which are often provided in collaboration with other health care professionals (e.g., physicians, nurses).12,15 Thus, it may not be easy to identify clinical and social pharmacy practice as basic research within an applied research discipline. Both types of research produce “new knowledge”, with basic research disciplines creating “knowledge of the underlying foundations of phenomena and observable facts”, while for applied research disciplines the knowledge created is “directed primarily towards a specific, practical aim or objective”.16 Clinical and social pharmacy practice researchers do both.

Publication patterns and practices are one of these differential characteristics of a scientific discipline. Publishing refereed work is a hallmark of science, primarily aiming at disseminating new, advanced, and high-quality research knowledge and findings as widely as possible in a timely and efficient manner. Regardless of the scientific publishing mechanisms – which have significantly evolved over the years especially in response to technological progress,1,17 – this practice traverses all different academic or scientific disciplines, but customs and habits (e.g., paper length and structure, title details, citation patterns) are different across disciplines. The aforementioned on scientific progress would indicate a need for a discipline's journals, its authors, reviewers, and even its readers/followers to come together on important aspects that help propel its scientific paradigm.7,18

With the aim to identify the elements that may reinforce clinical and social pharmacy practice as a scientific discipline by consolidating common publication patterns, a group of pharmacy practice journal editors met in June 2022 in Granada, Spain. As a consequence of this meeting, a series of recommendations to improve publication patterns in pharmacy practice was created, i.e., these “Granada Statements”. This type of initiative is not unprecedented. In 1978, a group of medical journal editors gathered in Vancouver, Canada to create the Uniform Requirements to submit a paper to a medical journal. Years later, this group became the International Committee of Medical Journal Editors (ICMJE - https://www.icmje.org/), which is now one of the most used standards in scholarly publishing. A similar initiative was created approximately 30 years ago for nursing with the International Academy of Nursing Editors (INANE - https://nursingeditors.com/).

With this paper, which will be simultaneously published in several clinical and social pharmacy practice journals, the Pharmacy Practice Journal Editors Group offers the Granada Statements as a set of recommendations for pharmacy practice authors, reviewers, and journal editors aiming to strengthen pharmacy practice as a discipline. The Granada Statements comprise 18 recommendations grouped in six topics: the appropriate use of terminology, impactful abstracts, the required peer reviews, journal scattering, more effective and wiser use of journal and article performance metrics, and authors' selection of the most appropriate pharmacy practice journal to submit their work.

2. The appropriate use of terminology in publishing

One of the differential characteristics of disciplines with a high degree of consensus is the consistent use of precise terms to refer to each concept. Several areas have created task forces to maintain glossaries. The International Union of Pure and Applied Chemistry (https://iupac.org/) and the International Union of Basic and Clinical Pharmacology (https://www.guidetopharmacology.org/) are good examples of this procedure.

Clinical and social pharmacy practice have been accused of inconsistent terminology use, whether in journal titles or in articles.19,20 This inconsistent terminology use is evident in the lack of a common branding: clinical pharmacy, pharmacy practice, social pharmacy, administrative pharmacy. This confusion is even greater when considering the terminology used to describe pharmacists' interventions or services: medicines management, polypharmacy management, pharmaceutical care, medication therapy management, comprehensive medication management, etc.1,21 One could argue that slight differences exist among these terms. However, several consequences emerge when using many different terms for slightly different concepts, which were probably insufficiently defined.22 A first consequence is the existence of a variety of terms that should be used in search strategies of evidence-gathering exercises such as systematic reviews, which renders them not so systematic, after all.23 The final goal of a systematic review is to support evidence-based policymaking. A systematic review that insufficiently compiles the evidence about a topic may lead to inappropriate policy decisions. But perhaps the most harmful consequence for the visibility and relevance of the clinical and social pharmacy practice field is the invisibility of many articles resulting from their inability to be retrieved from bibliographic databases.24

One might think that subject headings (e.g., Medical Subject Headings – MeSH) were created to classify articles and are especially important when authors do not use standardized terminology. MeSH terms have been known in pharmacy since their inception.25 Unfortunately, clinical and social pharmacy practice were highlighted as a field where MeSH use is scarce in comparison with other areas.26 It is important to keep in mind that new MeSH terms can be suggested to the National Library of Medicine (NLM), but MeSH staff will only consider MeSH that correspond to terms frequently used in the literature.27

Granada Statements:
1. Clinical and social pharmacy practice researchers should establish a commonly accepted glossary and use terms in a consistent manner.
2. Pharmacy practice and social pharmacy reviewers and journal editors should ensure standardized terminology is used in the articles they review and publish.

3. Impactful abstracts

In addition to the reduced number of MeSH terms defining clinical and social pharmacy practice elements, a poor allocation of existing MeSH to pharmacy practice articles has been reported.28,29Also, an excessive indexing delay (i.e., MeSH allocation) was observed for pharmacy articles.30,31 MeSH terms are crucial to ensure a more efficient literature retrieval, which will result in a higher visibility of the article and subsequently of the field. The role MeSH plays in systematic search is not substituted by the author-listed keywords commonly used by journals. These keywords are not indexed in the abstract field of bibliographic databases and, although some databases have specific fields for them (i.e., PubMed's OT – Other Terms), they are only retrieved as abstract words (no additional benefit to use these words as keywords).

In the recent past, allocation of MeSH terms to articles indexed in MEDLINE was a responsibility of NLM catalogers. Since the NLM announcement of the complete implementation of the Medical Text Indexer First Line indexing (MTIFL) that will select the MeSH, authors, reviewers and journal editors should take responsibility for the appropriate allocation of MeSH terms to the articles.

MTIFL is an automated natural language processing system which identifies the appropriate MeSH terms from the MeSH thesaurus using only the text in article title and abstract. As stated by the NLM, after mid-2022, all articles indexed in MEDLINE will have MeSH terms allocated by MTIFL, more mechanistically rather than through human judgment/intervention. This modification of the process increases even more the relevance of the title and abstract, that in the past had a role only in summarizing the content of the article and helping potential readers to decide proceeding to the full text article.

The MTIFL system tries to match words and n-grams included in the title and the abstract not only with the MeSH term (i.e., descriptor), but also with the other ‘concept terms’ associated to the descriptor, which can be easily identified as “Entry Terms” in the MeSH database (https://www.ncbi.nlm.nih.gov/mesh/). Thus, if an article's title or abstract includes the exact wording of any of these descriptors or entry terms, the system will allocate the given MeSH to that article.20

Granada Statements:
3. Clinical and social pharmacy practice researchers should use existing MeSH terms as part of their titles and abstracts.
4. Clinical and social pharmacy practice reviewers and journal editors should ensure that authors included the most appropriate MeSH terms in the articles they review and publish.

4. The required peer reviews

Since the 18th century,32 scholarly publishing has been based on the contribution of colleagues in assessing and improving the original text submitted by the authors by means of the peer review process.33 Based on Linus's law (i.e., “given enough eyeballs, all bugs are shallow”), the rationale of peer review is to avoid errors34 and to increase the quality of publications.35 Although peer review has been strongly criticized36 and systematic reviews could not demonstrate the added value of this process,37,38 more reliable alternative systems do not exist.39 Pre-prints with post-publication review have been proposed as a solution to have scientific publications more rapidly accessible. Many forces, mainly outside the research workforce, are insisting on the benefits of publishing findings in a preprint server and waiting for future comments, but in-depth analyses of the consequences of this practice have not been undertaken. The scientific community, and not external influencers, should decide if the scholarly publication system should move into a social media publication system, or if pre-publication peer review is prerequisite. This is an urgent decision because all the participants in the publication process might appear to be unhappy:

  • Authors tend to complain about peer review for several reasons (i.e., excessive reviewers' criticism40), but the most common complaint is related to the duration of the publication process.41 However, studies have demonstrated that the time to get a manuscript accepted in biomedical journals is about 100 days, and clinical and social pharmacy practice journals do not substantially differ.42

  • Editors tend to complain about the difficulty of having at least two reviewers accepting the task of reviewing each manuscript43 and about the timeliness and quality of the reviewers' comments. Although shortage of reviewers is affecting journal operations and practices, editors should keep in mind that the workload of reviewing articles can be onerous for individuals and institutions44 and that reviewers provide the service altruistically.45

  • Reviewers tend to complain about the excessive number of peer review requests they receive. But they should consider that the number of review invitations they receive depends only on the number of reviewers requested for each manuscript and the journal's rejection rate.46 Editors can reduce the number of review requests by considering desk rejection rates (i.e., rejection without external peer review) of papers unlikely to be accepted by reviewers, even if that is not the most favorable outcome to most authors, even while doing so expeditiously helps authors “move on”.47

It is important to understand that these three participants (i.e., authors, reviewers and editors) are in fact only one group of researchers acting in three different roles at different points in time.48

Granada Statements:
5. Clinical and social pharmacy practice researchers should be more proactive in becoming involved as peer reviewers to reduce the duration of the publication processes.
6. Clinical and social pharmacy practice educators and supervisors should mentor their students to serve as peer reviewers.
7. Clinical and social pharmacy practice journal editors should carefully find a balance between the number of manuscripts they submit to external peer review and those that are desk rejected.
8. Clinical and social pharmacy practice journal editors and publishers should consider systems to reward peer reviewers' efforts, including public recognition of their contribution at an article level.
9. Clinical and social pharmacy practice peer reviewers should be reminded that their highly valuable role improves the quality of the manuscripts; hence it is incumbent upon them to provide constructive, quality reviews within the given timeframe.

5. Journal scattering

Studies have demonstrated that pharmacy practice authors tend to scatter their articles among a huge number of journals outside the area.28,29 It is often argued that this dispersion enhances the visibility of findings for the authors and for the discipline. With more than one million articles published in biomedical journals each year, one should accept that bibliographic databases are the correct way of accessing articles published. The prior alternative of paying attention to a limited number of tables of contents is insufficient and may bias or attenuate the knowledge gained. Researchers can hardly complain about limited exposure and impact of journals in the discipline when they submit and publish their “best work” outside of it.

Despite the existence of some meta-journals (i.e., journals without a clear scope), most journals have not only precisely defined scope, but also publication priorities. For instance, in clinical and social pharmacy practice, some journals are interested in a more clinical approach, while others prefer more methodological papers, or social aspects of the practice. And for sure, any of these journals has a deeper knowledge in clinical and social pharmacy practice than any journal from other scientific areas.

To ensure the effectiveness of the peer review process, reviewers should have a deep knowledge of the concepts and the recent advances in clinical and social pharmacy practice. These colleague reviewers, together with the editor-in-chief and the associate editors, possess a deep knowledge of the area and the topic of the manuscript submitted, which should result in more constructive and contributing comments that will improve the paper. These persons should also be responsible for ensuring the use of consistent terminology and that the abstracts contain the terms that will be mapped into the appropriate MeSH terms.

Granada Statements:
10. Clinical and social pharmacy practice researchers should prioritize pharmacy practice and social pharmacy journals for some of their “best” papers and work to ensure the of quality of the publication process considering the specific details of the area, even while seeking wider audiences as appropriate for various components of their work.
11. Clinical and social pharmacy practice educators and supervisors should promote pharmacy practice journal centeredness among their students.
12. Clinical and social pharmacy practice journal editors should give priority to clinical and social pharmacy practice articles.

6. Using the metrics wisely

One of the hidden reasons why researchers tend to publish their pharmacy practice articles outside of pharmacy practice journals may be the search for higher impact metrics. Inappropriate researchers' performance assessment processes converted the “publish or perish” into an “aim high” obsessive goal for authors.49

Among several bibliometric indexes, impact metrics, such as the Impact Factor Score, have achieved an overwhelming position, or level of currency in discussing the weight or gravitas of journals.50 Journal-based impact metrics have been criticized for several conceptual errors in the formulae,51 for poor transparency in their calculation,52,53 but more importantly for their relative inability to ascribe quality to papers published in these journals.54, 55, 56 Recognition of these issues led to the San Francisco Declaration on Research Assessment (https://sfdora.org/), which issued a plea to avoid use of journal-based metrics for the assessment of individual authors' quality of papers and scientific prowess and productivity. Alternatives to journal-based metrics exist, i.e., individual-based metrics, which might sometimes be more useful to evaluate the impact of a stream of scholarship, if not the contribution of individual papers.57The European Commission has signed the Agreement on Reforming Research Assessment, which discusses moving away from use of metrics like the Impact Factor Score in evaluating quality of a scientific contribution.58

Notably, impact metrics have often underrated the scientific contribution of papers in the clinical and social pharmacy practice areas.59 They provide low coverage of many journals in the databases used to extract citations and often lack any semblance of a pharmacy practice subject category910, often including pharmacy practice journals under Pharmacology and Pharmacy,60 thus placing papers from our discipline into a category with high-consensus bench, or biological sciences where higher citations are the norm.

Biomedical researchers and some librarians61 may not be sufficiently aware about the methods to compute these impact metrics. It would be important to demystify the role of these metrics, whether journal-based or individual-based, and to clarify among researchers what is the role of their articles and the references they have in the metrics calculations.

Granada Statements:
13. Clinical and social pharmacy practice researchers should promote among their institutions the use of individual-based metrics to assess the performance of individuals.
14. Clinical and social pharmacy practice researchers, while maintaining autonomy, should be aware of the importance of the references they include in their published papers and consider the need to strengthen the discipline and its component journals in their manuscript bibliographies.
15. Clinical and social pharmacy practice educators and supervisors should educate undergraduate and postgraduate students in the responsible use of metrics.
16. Stakeholders in clinical and social pharmacy practice should consider broader bases rather than only journal-based metrics to connote quality and achievement in the disciplines.

7. Selecting the most appropriate pharmacy practice journal

Pharmacy practice and social pharmacy, themselves, are composed of a broad swath of topics. Among the signatories of the Granada Statements several different scopes or foci can be found, including but not limited to: clinical, methodological, political, social, economic, educational, behavioral, hospital-based and community-based, practitioner considerations, patient considerations, pharmacoepidemiogical issues, and many other. Submitting a clinical article to a methodologically oriented journal, or vice versa, may lead to an immediate desk rejection, regardless of the quality of the manuscript.

Similar to what happens with journals from other heath areas, pharmacy practice journals have not only their preferences and interests, but also editorial board members with deep knowledge in specific sub-areas of pharmacy practice.

Granada Statements:
17. Clinical and social pharmacy practice journal editors should work with authors to identify the most appropriate journal to submit their scholarly work early in the process (i.e., during and even prior to submission, if possible).
18. Clinical and social pharmacy practice authors should heed advice and direction coming from journal editors, editorial boards, and reviewers to not only improve the quality of the original manuscript, but also be positively inclined toward the recommendations given rather than create unnecessary acrimony among scholars in the discipline.

8. The Granada Group journals' joint description

The journals comprising the Granada Group producing these Statements stand in unison in their endeavor to promote the quality and status of research in clinical and social pharmacy practice, as well as to advance the scientific paradigm of the discipline and broaden the impact of our respective journals to an international audience within and outside of pharmacy. The journals recognize that they are part of a larger phenomenon in health services research having much in common with journals outside of pharmacy practice, per se, yet focusing on some aspect of the medication use process. In light of the Statements offered here and in recognition of the need for the journals to recognize their commonality, assist authors with selecting the most appropriate venue to publish their work, and unite in their mission to promote all journals in the area, the Granada Group journals have agreed to a common introductory description among all. The shared description among all the Granada Group journals will then be followed by specific descriptions that then help to establish the unique niches and processes associated with each of them. The common introductory description used for all Granada Group journals is as follows.

[Name of journal] is one of several journals in comportment with the Granada Statements publishing high-quality, peer-reviewed content in health services research specifically as it relates to some aspect of the medication use process. The medication use process includes but is not limited to the prescribing, preparation, dispensing, administration, adherence to, evaluation, monitoring, and outcomes associated with legend or with over-the-counter medications, incorporating the concept of clinical pharmacy which aims to optimize utilization of medicines to achieve person-centered and public health goals. The medication use process includes attitudes, perspectives, knowledge, and behaviors of any actor in this process, including prescribers, pharmacists, pharmacy personnel, other health practitioners, patients, and caregivers. As such, the Granada Group journals often refer to “pharmacy” in their title or description, as these persons are central to medication use process; however, research articles reviews, and commentaries can refer to any person involved in this process, as well as any evaluation (e.g., pharmaceoepidemiological) of the drug products themselves or systems employed to optimize the use process.

The Granada Group journals share certain commonalities and also goals to improve the medication use process and the outcomes emanating from this endeavor; however, each journal has an established niche and optimally suited for certain types of manuscripts. Further description of the aims and scopes of [this journal] follows below:

9. In summary

The Granada Statements were created with the strong conviction that pharmacy practice is a scientific discipline that deserves reaching the high-consensus discipline category. The recommendations in these Statements aim to contribute to increase the quality of the articles that pharmacy practice researchers try to publish to disseminate their scientific contributions. At the end of the day, a scientific area and the profession behind it will benefit from the advancements published in these articles. The advancement of pharmacy practice is a conjoint responsibility between pharmacy practice researchers, peer reviewers, editors, and publishers, where scientific articles should be seen as the means to disseminate new knowledge that will improve practice.

Declaration of Competing Interest

No conflict of interest.

Footnotes

This article is being published jointly under proper publication and copyright agreement in all of the following journals: Ars Pharmaceutica; European Journal of Hospital Pharmacy; Exploratory Research in Clinical and Social Pharmacy, Farmacia Hospitalaria; International Journal of Clinical Pharmacy; International Journal of Pharmacy Practice; Journal of Pharmaceutical Policy and Practice; Pharmaceutical Care Espana; Pharmacy Education; Research in Social and Administrative Pharmacy; Revista Brasileira de Farmacia Hospitalar e Servicos de Saude.

Contributor Information

Fernando Fernandez-Llimos, Email: fllimos@ff.up.pt.

Shane Desselle, Email: shane.desselle@tu.edu.

Derek Stewart, Email: d.stewart@qu.edu.qa.

Victoria Garcia-Cardenas, Email: Victoria.GarciaCardenas@uts.edu.au.

Zaheer-Ud-Din Babar, Email: z.babar@hud.ac.uk.

Christine Bond, Email: c.m.bond@abdn.ac.uk.

Ramune Jacobsen, Email: ramune.jacobsen@sund.ku.dk.

Lotte Stig Nørgaard, Email: lotte.norgaard@sund.ku.dk.

Carlo Polidori, Email: carlo.polidori@unicam.it.

Manuel Sanchez-Polo, Email: mansanch@ugr.es.

Bernardo Santos-Ramos, Email: bernardo.santos.sspa@juntadeandalucia.es.

Natalia Shcherbakova, Email: natalia.shcherbakova@wne.edu.

Fernanda S. Tonin, Email: fernanda.tonin@estesl.ipl.pt.

References

  • 1.McGillivray B., Jenset G., Salama K., et al. Investigating patterns of change, stability, and interaction among scientific disciplines using embeddings. Humanit Soc Sci Commun. 2022;9:285. [Google Scholar]
  • 2.Biglan A. The characteristics of subject matter in different academic areas. JAppl Psychol. 1973;57(3):195–203. [Google Scholar]
  • 3.Becker T. Towards a definition of disciplinary cultures. Studies in Higher Educ. 1982;6(2):109–122. [Google Scholar]
  • 4.Lodahl J., Gordon G. The structure of scientific fields and the functioning of university graduate departments. Am Sociolog Rer. 1972;37(1):57–72. [Google Scholar]
  • 5.Perry R.P., Smart J.C. Springer Science+Business Media; Dordrecht, The Netherlands: 2007. The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective. [Google Scholar]
  • 6.Almarsdottir A.B., Granas A.G. Social pharmacy and clinical pharmacy-joining forces. Pharmacy (Basel) 2015;4(1 doi: 10.3390/pharmacy4010001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Holmes E.R., Desselle S.P. Is scientific paradigm important for pharmacy education? Am J Pharm Educ. 2004;68(5):118. [Google Scholar]
  • 8.Marsh H.W., Hattie J. The relation between research productivity and teaching effectiveness. J High Educ. 2016;73(5):603–641. [Google Scholar]
  • 9.Williams K. Playing the fields: theorizing research impact and its assessment. Res Eval. 2020;29(2):191–202. [Google Scholar]
  • 10.Mendes A.M., Tonin F.S., Buzzi M.F., et al. Mapping pharmacy journals: a lexicographic analysis. Res Social Adm Pharm. 2019;15(12):1464–1471. doi: 10.1016/j.sapharm.2019.01.011. [DOI] [PubMed] [Google Scholar]
  • 11.Sørensen E., Mount J., Christensen S. The concept of social pharmacy. Chronic Illn. 2003;7:8–11. [Google Scholar]
  • 12.Garcia-Cardenas V., Rossing C.V., Fernandez-Llimos F., et al. Pharmacy practice research - a call to action. Res Social Adm Pharm. 2020;16(11):1602–1608. doi: 10.1016/j.sapharm.2020.07.031. [DOI] [PubMed] [Google Scholar]
  • 13.Kerlinger F.N., Lee H.B. 4th ed. Wadsworth; Belmont, CA: 1999. Foundations of Behavioral Research. ISBN: 978–0155078970. [Google Scholar]
  • 14.Dreischulte T., van den Bemt B., Steurbaut S. European Society of Clinical Pharmacy definition of the term clinical pharmacy and its relationship to pharmaceutical care: a position paper. Int J Clin Pharmacol. 2022;44:1–6. doi: 10.1007/s11096-022-01422-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Scahill S.L., Atif M., Babar Z.U. Defining pharmacy and its practice: a conceptual model for an international audience. Integr Pharm Res Pract. 2017;6):121-9 doi: 10.2147/IPRP.S124866. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.OECD . OECD; Paris: 2015. Frascati Manual 2015: Guidelines for Collecting and Reporting Data on Research and Experimental Development, the Measurement of Scientific, Technological and Innovation Activities. ISBN: 978-926423901-2. [Google Scholar]
  • 17.Clapham P. Publish or perish. BioScience. 2005;55:390–391. [Google Scholar]
  • 18.Desselle S.P., Amin M., Aslani P., et al. Moving the needle-what does RSAP look for and what does it aim to do? Res Social Adm Pharm. 2019;15(1):1–2. doi: 10.1016/j.sapharm.2018.10.026. [DOI] [PubMed] [Google Scholar]
  • 19.Fernandez-Llimos F., Mendes A.M., Tonin F.S. Confusing terminology used in the abbreviation of pharmacy journal names. Res Social Adm Pharm. 2022;18(8):3463–3465. doi: 10.1016/j.sapharm.2022.01.003. [DOI] [PubMed] [Google Scholar]
  • 20.Fernandez-Llimos F., Garcia-Cardenas V. The importance of using standardized terminology in titles and abstracts of pharmacy practice articles. Res Social Adm Pharm. 2022;19(2):190–191. doi: 10.1016/j.sapharm.2022.08.017. [DOI] [PubMed] [Google Scholar]
  • 21.Gernant S.A., Bacci J.L., Upton C., et al. Three opportunities for standardization: a literature review of the variation among pharmacists’ patient care services terminology. Res Social Adm Pharm. 2020;16(6):766–775. doi: 10.1016/j.sapharm.2019.08.034. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.van Mil J.W., Henman M. Terminology, the importance of defining. Int J Clin Pharmacol. 2016;38(3):709–713. doi: 10.1007/s11096-016-0294-5. [DOI] [PubMed] [Google Scholar]
  • 23.MacLure K., Paudyal V., Stewart D. Reviewing the literature, how systematic is systematic? Int J Clin Pharmacol. 2016;38(3):685–694. doi: 10.1007/s11096-016-0288-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Al Saeedy D., Thomas D., Palaian S. Visibility of evidence-based pharmacy on PubMed - identity crisis? Res Social Adm Pharm. 2019;15(11):1374. doi: 10.1016/j.sapharm.2019.03.004. [DOI] [PubMed] [Google Scholar]
  • 25.McCann A. Advantages of a universal coding and classification system for drugs. Implications of classification for medical subject headings. Am J Hosp Pharm. 1966;23(2):87–88. [PubMed] [Google Scholar]
  • 26.Minguet F., Van Den Boogerd L., Salgado T.M., et al. Characterization of the medical subject headings thesaurus for pharmacy. Am J Health Syst Pharm. 2014;71(22):1965–1972. doi: 10.2146/ajhp140073. [DOI] [PubMed] [Google Scholar]
  • 27.Fernandez-Llimos F., Salgado T.M. Standardization of pharmacy practice terminology and the medical subject headings (MeSH) Res Social Adm Pharm. 2021;17(4):819–820. doi: 10.1016/j.sapharm.2020.07.005. [DOI] [PubMed] [Google Scholar]
  • 28.Minguet F., Salgado T.M., van den Boogerd L., et al. Quality of pharmacy-specific medical subject headings (MeSH) assignment in pharmacy journals indexed in MEDLINE. Res Social Adm Pharm. 2015;11(5):686–695. doi: 10.1016/j.sapharm.2014.11.004. [DOI] [PubMed] [Google Scholar]
  • 29.Tonin F.S., Gmunder V., Bonetti A.F., et al. Use of “Pharmaceutical services” medical subject headings (MeSH) in articles assessing pharmacists’ interventions. Explor Res Clin Soc Pharm. 2022;7:100172. doi: 10.1016/j.rcsop.2022.100172. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Rodriguez R.W. Comparison of indexing times among articles from medical, nursing, and pharmacy journals. Am J Health Syst Pharm. 2016;73(8):569–575. doi: 10.2146/ajhp150319. [DOI] [PubMed] [Google Scholar]
  • 31.Irwin A.N., Rackham D. Comparison of the time-to-indexing in PubMed between biomedical journals according to impact factor, discipline, and focus. Res Social Adm Pharm. 2017;13(2):389–393. doi: 10.1016/j.sapharm.2016.04.006. [DOI] [PubMed] [Google Scholar]
  • 32.Kronick D.A. Peer review in 18th-century scientific journalism. JAMA. 1990;263(10):1321–1322. [PubMed] [Google Scholar]
  • 33.Kassirer J.P., Campion E.W. Peer review. Crude and understudied, but indispensable. JAMA. 1994;272(2):96–97. doi: 10.1001/jama.272.2.96. [DOI] [PubMed] [Google Scholar]
  • 34.Schroter S., Black N., Evans S., et al. What errors do peer reviewers detect, and does training improve their ability to detect them? J R Soc Med. 2008;101(10):507–514. doi: 10.1258/jrsm.2008.080062. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Bailar J.C., 3rd, Patterson K. The need for a research agenda. N Engl J Med. 1985;312(10):654–657. doi: 10.1056/NEJM198503073121023. [DOI] [PubMed] [Google Scholar]
  • 36.Jirschitzka J., Oeberst A., Göllner R., et al. Inter-rater reliability and validity of peer reviews in an interdisciplinary field. Scientometrics. 2017;113(2):1059–1092. [Google Scholar]
  • 37.Jefferson T., Alderson P., Wager E., et al. Effects of editorial peer review: a systematic review. JAMA. 2002;287(21):2784–2786. doi: 10.1001/jama.287.21.2784. [DOI] [PubMed] [Google Scholar]
  • 38.Jefferson T., Rudin M., Brodney Folse S., et al. Editorial peer review for improving the quality of reports of biomedical studies. Cochrane Database Syst Rev. 2007;2:MR000016. doi: 10.1002/14651858.MR000016.pub3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Kovanis M., Trinquart L., Ravaud P., et al. Evaluating alternative systems of peer review: a large-scale agent-based modelling approach to scientific publication. Scientometrics. 2017;113(1):651–671. doi: 10.1007/s11192-017-2375-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Walbot V. Are we training pit bulls to review our manuscripts? J Biol. 2009;8(3):24. doi: 10.1186/jbiol125. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Huisman J., Smits J. Duration and quality of the peer review process: the author’s perspective. Scientometrics. 2017;113(1):633–650. doi: 10.1007/s11192-017-2310-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Mendes A.M., Tonin F.S., Mainka F.F., et al. Publication speed in pharmacy practice journals: a comparative analysis. PLoS One. 2021;16(6) doi: 10.1371/journal.pone.0253713. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Fernandez-Llimos F. Peer review and publication delay. Pharm Pract (Granada) 2019;17(1):1502. doi: 10.18549/PharmPract.2019.1.1502. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Aczel B., Szaszi B., Holcombe A.O. A billion-dollar donation: estimating the cost of researchers’ time spent on peer review. Res Integr Peer Rev. 2021;6(1):14. doi: 10.1186/s41073-021-00118-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Desselle S.P., Chen A.M., Amin M., et al. Generosity, collegiality, and scientific accuracy when writing and reviewing original research. Res Social Adm Pharm. 2020;16(2):261–265. doi: 10.1016/j.sapharm.2019.04.054. [DOI] [PubMed] [Google Scholar]
  • 46.Fernandez-Llimos F., Salgado T.M., Tonin F.S. How many manuscripts should I peer review per year? Pharm Pract (Granada) 2020;18(1):1804. doi: 10.18549/PharmPract.2020.1.1804. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Donato H., Marinho R.T. Acta Medica Portuguesa and peer-review: quick and brutal! Acta Med Port. 2012;25(5):261–262. [PubMed] [Google Scholar]
  • 48.Fernandez-Llimos F. Authors, peer reviewers, and readers: what is expected from each player in collaborative publishing? Pharm Pract (Granada) 2021;19(1):2284. doi: 10.18549/PharmPract.2021.1.2284. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Desselle S.P., Andrews B., Lui J., et al. The scholarly productivity and work environments of academic pharmacists. Res Social Adm Pharm. 2018;14(8):727–735. doi: 10.1016/j.sapharm.2017.09.001. [DOI] [PubMed] [Google Scholar]
  • 50.Karimi-Sari H., Rezaee-Zavareh M.S. Citation metrics for appraising scientists: misuse, gaming and proper use. Med J Aust. 2020;213(5):238–9 e1. doi: 10.5694/mja2.50739. [DOI] [PubMed] [Google Scholar]
  • 51.Liu X.L., Gai S.S., Zhou J. Journal impact factor: do the numerator and denominator need correction? PLoS One. 2016;11(3) doi: 10.1371/journal.pone.0151414. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Rossner M., Van Epps H., Hill E. Show me the data. J Cell Biol. 2007;179(6):1091–1092. doi: 10.1083/jcb.200711140. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Fernandez-Llimos F. Bradford’s law, the long tail principle, and transparency in journal impact factor calculations. Pharm Pract (Granada) 2016;14(3):842. doi: 10.18549/PharmPract.2014.03.842. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Paulus F.M., Cruz N., Krach S. The impact factor fallacy. Front Psychol. 2018;9:1487. doi: 10.3389/fpsyg.2018.01487. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Dougherty M.R., Horne Z. Citation counts and journal impact factors do not capture some indicators of research quality in the behavioural and brain sciences. R Soc Open Sci. 2022;9(8) doi: 10.1098/rsos.220334. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Ritchie A., Seubert L., Clifford R., et al. Do randomised controlled trials relevant to pharmacy meet best practice standards for quality conduct and reporting? A systematic review. Int J Pharm Pract. 2020;28(3):220–232. doi: 10.1111/ijpp.12578. [DOI] [PubMed] [Google Scholar]
  • 57.Hirsch J.E. An index to quantify an individual’s scientific research output. Proc Natl Acad Sci U S A. 2005;102(46):16569–16572. doi: 10.1073/pnas.0507655102. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Directorate-General for Research and Innovation Agreement on Reforming Research Assessment. 2022. https://www.scienceeurope.org/media/y41ks1wh/20220720-rra-agreement.pdf Available at. [Accessed 02-Nov-2022]
  • 59.van Mil J.W.F., Green J. Citations and science. Int J Clin Pharmacol. 2017;39(5):977–979. doi: 10.1007/s11096-017-0539-y. [DOI] [PubMed] [Google Scholar]
  • 60.Minguet F., Salgado T.M., Santopadre C., et al. Redefining the pharmacology and pharmacy subject category in the journal citation reports using medical subject headings (MeSH) Int J Clin Pharmacol. 2017;39(5):989–997. doi: 10.1007/s11096-017-0527-2. [DOI] [PubMed] [Google Scholar]
  • 61.Malone T., Burke S. Academic librarians’ knowledge of bibliometrics and altmetrics. Evid Based Libr Inf Pract. 2016;11):3 [Google Scholar]

Articles from Exploratory Research in Clinical and Social Pharmacy are provided here courtesy of Elsevier

RESOURCES