Skip to main content
PLOS One logoLink to PLOS One
. 2021 May 27;16(5):e0252357. doi: 10.1371/journal.pone.0252357

Double-blinded randomized controlled trial to reveal the effects of Brazilian propolis intake on rheumatoid arthritis disease activity index; BeeDAI

Yoshinari Matsumoto 1,2, Kanae Takahashi 3, Yuko Sugioka 4, Kentaro Inui 5, Tadashi Okano 5, Koji Mandai 5, Yutaro Yamada 5, Ayumi Shintani 3, Tatsuya Koike 1,4,*
Editor: Yuanyuan Wang6
PMCID: PMC8158978  PMID: 34043719

Abstract

Background and aims

Brazilian propolis reportedly contributed to suppressing disease activity in a mouse model of rheumatoid arthritis (RA), suggesting new treatment options using Brazilian propolis. However, only results from animal experiments have been available, and the suppressive effects of Brazilian propolis on disease activity in humans with RA remain unknown. The purpose of this study was to clinically validate how Brazilian propolis intake changes disease activity in RA patients.

Methods

This study was conducted as a multicenter, double-blinded, randomized, placebo-controlled, parallel-group study of 80 women with RA (median age, 61.5 years; interquartile range, 56.0 to 67.3 years) showing moderate disease activity on Disease Activity Score in 28 joints using erythrocyte sedimentation rate (DAS28-ESR). Test tablets containing Brazilian propolis were used in Group P (40 patients), and Brazilian propolis-free placebo tablets were used as control in Group C (40 patients). Group P received 5 tablets of propolis (508.5 mg of propolis) daily, and Group C received 5 tablets of placebo daily. The intervention lasted 24 weeks, with change in DAS28-ESR set as the primary endpoint. As secondary endpoints, other disease activity assessment (DAS28 using C-reactive protein, simplified disease activity index, clinical disease activity index), ultrasonographic evaluation of synovitis, activities of daily living, quality of life, changes in cytokine levels, and adverse events over the course of the study were also assessed. Data were statistically analyzed by analysis of covariance.

Results

No significant differences in the primary endpoint were identified between groups (Group P vs Group C, effect: 0.14, 95% confidence interval: -0.21 to 0.49, p = 0.427). Likewise, no significant differences were seen between groups for any secondary endpoints. The adverse event rate during the study period was 28% in Group P and 33% in Group C.

Conclusions

Brazilian propolis exerted no effects on disease activity in patients with RA.

Introduction

Rheumatoid arthritis (RA) is an autoimmune disease that has an unknown cause. RA is thought to be triggered by exposure to environmental factors such as smoking and periodontal disease under some genetic background [1]. When an autoimmune reaction begins, joint or systemic inflammation results in joint swelling and pain that progresses to joint destruction and deformity [1]. In RA, osteoclasts are activated by inflammatory cytokines, resulting in bone destruction [2]. The prevalence of RA in adults is about 1% worldwide, with a high incidence in women between 30 and 50 years old [3]. Currently, the main treatments for RA include pharmacotherapy and surgical intervention, with the former as the cornerstone of RA treatment [4]. Medications include conventional synthetic disease-modifying anti-rheumatic drugs (csDMARDs), biological or targeted synthetic DMARDs (b-/ts-DMARDs), and glucocorticoids aimed at reducing inflammation [4]. All the pharmacotherapies show problems such as side effects or high medical cost, especially with the use of b-/ts DMARDs.

Propolis is a sticky, resinous substance produced by bees through the collection of plant buds, sap and pollen that are mixes with bee saliva and beeswax. Brazilian propolis mainly contains cinnamic acid derivatives such as artepirin C, dorpanin and p-cumulanic acid, and also contains other caffeine oil quinacids, such as flavonoids and chlorogenic acid [5, 6]. Various pharmacological properties of Brazilian propolis have been reported, including antioxidant activity [7], improvement in periodontal disease [8] and inhibition of cognitive decline [9]. Brazilian propolis has also been reported to contribute to the suppression of disease activity against arthritis in a mouse model of RA [10]. As a potential mechanism of action, Brazilian propolis has been reported to suppress interleukin (IL)-17 production by inhibiting the phosphorylation of signal transducer and activator of transcription (STAT)3, which is necessary for the process of differentiation of naïve helper T cells into IL-17-producing helper T cells (Th17 cells) [11]. Brazilian propolis may contribute to the suppression of disease activity in patients with RA, and confirmation of such contributions in humans may lead to the development of alternative therapies for RA. However, at present, only the results from animal experiments in the mouse RA model are available, and the suppressive effects of propolis on disease activity in RA patients remain unclear. The present study was therefore designed to clinically validate changes to disease activity resulting from Brazilian propolis in RA patients.

Subjects and methods

Patients in the study

This multicenter, double-blinded, randomized, placebo-controlled, parallel-group study was conducted with the approval of Osaka City University Hospital Certified Review Board (approval number; 203966; March 28, 2018). The study was registered as a clinical trial in the University Hospital Medical Information Network (UMIN 000032149) and the Japan Registry of Clinical Trials (jRCTs051180142). Written informed consent was obtained from all subjects prior to their participation in this study, in accordance with the Declaration of Helsinki. Patients were enrolled between July 3, 2018 and March 14, 2019. First of all, the trial was registered with UMIN Clinical Trials Registry and the registration date was April 7, 2018. However, Japan’s Clinical Trials Act went into effect on April 1, 2018, and our research applicable under the category of Specified Clinical Research. Because the study could not be completed within the registration grace period, we again registered our study with jRCTs as Specified Clinical Research. The registration date for jRCT was March 20, 2019. We confirm that all ongoing and related trials for this intervention are registered. This study was conducted at Osaka City University Hospital (Osaka, Japan), Shirahama Hamayu Hospital (Wakayama, Japan), and Kitade Hospital (Wakayama, Japan). All RA patients attending outpatient clinics for these three hospitals were initially considered eligible for inclusion. All participants met the 2010 American College of Rheumatology (ACR)/European League against Rheumatic Diseases (EULAR) classification criteria for RA [12], and eligibility criteria for the study were as follows: 1) age between 30 and 70 years old; 2) female sex; 3) moderate disease activity (MDA) according to the EULAR disease activity classification [13] (3.2 < Disease Activity Score in 28 joints using erythrocyte sedimentation rate (DAS28-ESR) ≤ 5.1 [14], where DAS28-ESR < 2.6 is classified as remission, 2.6 ≤ DAS28-ESR < 3.2 as low disease activity, and DAS28-ESR > 5.1 as high disease activity; and 4) history of taking stable doses of b-/ts-DMARDs, csDMARDs, non-steroidal anti-inflammatory drugs (NSAIDs) and/or glucocorticoid (≤ 10 mg/day prednisolone-equivalents) for 12 weeks prior to study entry. Exclusion criteria included: 1) inability to attend regular checkups; 2) intake of propolis ≤ 4 weeks prior to providing study consent; 3) obesity (body mass index (BMI) ≥ 30 kg/m2); 4) abnormal liver function (aspartate aminotransferase or alanine aminotransferase > 3 times the upper limit of normal range); 5) abnormal renal function (blood urea nitrogen ≥ 25 mg/dl or serum creatinine ≥ 2.0 mg/dl); 6) current pregnancy or breastfeeding; 7) history of food allergy; or 8) other characteristic deemed as unsuitable in study subjects by the physician responsible for the study. During the 24 weeks of the study, concomitant medications were left unchanged wherever possible, unless disease activity could not be adequately controlled.

Study design

Among the 82 patients with RA initially considered eligible, 80 patients were randomized by the research electronic data capture (REDCap; https://redcap.med.osaka-cu.ac.jp/redcap/redcap_v9.5.30/index.php?pid=830) system for computerized random assignment to a propolis administration group (Group P; receiving a total of 5 tablets containing 101.7 mg of propolis extract powder per tablet, representing 508.5 mg/day for 24 weeks, n = 40) or a control group (Group C; 5 placebo tablets daily for 24 weeks, n = 40).

The test and placebo tablets were manufactured at Yamada Bee Company, Inc. (Okayama, Japan), then assembled as a set providing a 3-month supply for one person at the Yamada Bee Company, Inc. The propolis powder (lot. LY008), standardized to contain 8.0% artepillin C and 0.14% culifolin was obtained from Yamada Bee Company, Inc. Test food allocation codes were then randomly assigned to the entire patient cohort at the Yamada Bee Company, Inc., and assignment tables were sent to REDCap randomization staff only. To ensure the unidentifiability of test foods: 1) all test tablets were coated in white; 2) the test food layout code table was kept only at Yamada Bee Company, Inc. and by REDCap test food allocation and coding staff, until the key was opened; 3) keys were not to be opened until the study was completed and data for each case were fixed, except in cases of emergency evacuation for relevant cases. Test tablets were packaged individually as a daily supply of five tablets, and distributed on the day they were assigned. The timing of dosing was not specified. Ingestion of more than five tablets per day was prohibited, and study participants were allowed to divide up intake into portions, as long as they were able to take all required tablets during the course of the day. To ensure compliance with the dosage, the patients were instructed that if they did not take five tablets in one day, they should not take them the next day and return the entire bag at their next visit. Sachets were collected at each visit, and any leftover intake was checked and recorded at the time of the visit.

Clinical assessment

Various surveys were conducted in accordance with the schedule. Blood tests were performed under fasting conditions to exclude the effects of diet at 0, 12, 24, and 36 weeks. Serum was stored at -80°C until the measurement of various laboratory parameters. The following data were obtained: 1) patient background characteristics of age, lifestyle (smoking, drinking, exercise habits, exercise restrictions, and supplement use), and degree of RA dysfunction according to ACR criteria [15]; 2) intake of the test food at every visit; 3) subjective symptoms and objective observations (DAS28-ESR, DAS28 using C-reactive protein (DAS28-CRP) [16], simplified disease activity index (SDAI) [17], and clinical disease activity index (CDAI)) [17]; 4) height and weight; 5) blood and biochemical data; 6) cytokines and RA-specific blood tests (anti-cyclic citrullinated peptide antibody (CCP), matrix metalloproteinase (MMP)-3, interleukin (IL)-6, IL-17A, IL-10; laboratory testing for these items were performed by LSI Medience Corp, Tokyo, Japan); 7) quality of life (QOL) using the 36-item short-form health survey (SF-36) [18]; 8) activities of daily living (ADL) using the modified health assessment questionnaire (mHAQ) [19]; 9) sonographic examination of synovitis in 7 joints on the side with stronger symptom at baseline (unchanged during the observation period) (2nd and 3rd metacarpophalangeal (MP) joints, 2nd and 3rd proximal interphalangeal (PIP) joints, wrist, and 2nd and 5th metatarsophalangeal (MTP) joints) using both grayscale (GS) (grade 0–3) and power-Doppler (PD) scale (grade 0–3) [20], calculated as the sum of GS and PD scores for the seven joints; and 10) adverse events (mild: treatment-free status; moderate: administration can be continued with some treatment; severe: condition to be stopped or discontinued). Serious adverse events were also assessed for any unfavorable medical event, regardless of the dose, that would result in death, life-threatening status, or a requirement for hospitalization for treatment.

Study outcomes

The change (Δ) in DAS28-ESR from baseline (BL) to 24 weeks (24 w) was considered as the primary outcome of the study. DAS28-ESR values at 12 weeks and 36 weeks were also analyzed as a complementary analysis to the primary outcome. Secondary outcomes were evaluated as: 1) ΔDAS28-CRP, ΔSDAI and ΔCDAI from BL to 24 w, and DAS28-CRP, SDAI and CDAI at 12, 24 and 36 weeks (at 3 time points); 2) ΔSF-36 score from BL to 24 w; 3) Δ each cytokines from BL to 24 w; 4) ΔmHAQ score from BL to 24 w, and mHAQ score at the 3 time points; 5) Δsum of GS and PD joint grades from BL to 24 w, and sum of joint grades at the 3 time points; 6) adverse events requiring interruption or discontinuation of the test food up to 24 weeks; 7) serious adverse events up to 36 weeks; and 8) all adverse events up to 36 weeks.

Statistical analysis

Statistical analysis was performed after all test data became available, with no disclosure of patient allocations. Power calculations were performed before starting the study, with reference to a clinical trial testing the effects of an intervention with a Mediterranean diet for RA patients as a similar study [21]. In that clinical trial, mean ΔDAS28-ESR between control and intervention groups after 12 weeks was 0.4. In our data from another cohort study of RA patients and non-RA subjects [22], mean ΔDAS28-ESR under standard of care for RA patients with MDA over 1 year was -0.22 and an add-on effect for propolis of -0.5 was assumed. To detect with 80% power by two-sample t-test with σ = 0.78 and α = 0.05, at least 39 patients were needed in each group. A total of 80 patients (40 in each group) was thus set as the number of cases required to provide adequate statistical power for this investigation.

Two-tailed tests and two-tailed 95% confidence intervals (CIs) were used for hypothesis testing at the 5% level of significance. Categorical data are presented as percentages and frequencies, and continuous data are presented as medians and quartile ranges. For efficacy analysis, the full analysis set (FAS) was analyzed, defined as the population of participants not meeting the following conditions: 1) participants who never consumed the test food; 2) participants who were never assessed regarding the primary endpoint after consuming the study food; 3) participants who withdrew consent to provide information; 4) participants with the failure to satisfy major entry criteria; 5) participants with the lack of any data post randomization. A complementary statistical analysis was also performed with the per protocol set (PPS), excluding participants meeting the following conditions: 1) participants with < 70% intake of the test food; 2) participants who did not complete the study; 3) visits with missing data on the primary endpoint; and 4) visits for the primary endpoints collected outside the acceptable date range (±7 days); and 5) participants found to be ineligible after randomization. For missing data caused by 3) and 4), values were completed using last observation carried forward (LOCF) when performing the main analysis. Among randomized cases, the population excluding cases meeting the following criteria was defined as the safety analysis set (SAS): 1) participants who had never been evaluated for safety after consumption of the study food; and FAS exclusion criteria 3). In the main analysis of the primary endpoint, a model in which the objective variable was the ΔDAS28-ESR from 0 to 24 weeks, groups (Groups P and C) were used as the explanatory variables, and the value of DAS28-ESR at 0 weeks was the covariate, with significance for the coefficients between groups determined by analysis of covariance (ANCOVA). The normality of residuals was checked using Normal QQ plots. If the plots suggest that the residuals are not normally distributed, the log transformation of the outcome variable was performed, and the bootstrap CI (number of repetitions set to 1000) was also calculated when the assumption of normality regarding the residuals of the log-transformed model. The following analyses were performed as the complementary analyses. First, mixed-effects model analyses were performed for the primary endpoints to confirm the robustness of results on the LOCF completion of missing values. The covariance structure within patients in the model was unstructured. The objective variable was set as DAS28-ESR at 12 and 24 weeks, and the explanatory variables were set as group (Groups P and C), time point, and group and time point interaction, with the value of DAS28-ESR at 0 weeks as a covariate and subjects as a random effect. Second, a mixed-effects model analysis with DAS28-ESR at 12, 24, and 36 weeks data was also performed. The analyses for secondary endpoints 1, 2, 3, 4 and 5 were also performed in the same way as for the primary endpoint (ANCOVA). For the safety analysis, a frequency table was created for secondary endpoints 6, 7, and 8 in the SAS. Statistical analysis was performed using R version 4.0.0 (R Core Team (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/.).

Results

Study participants

The flowchart of study participants is shown in Fig 1. In Group P, the study was discontinued in 4 cases and intake of the test food was < 70% in 2 cases, resulting in a PPS of 34 cases. In Group C, intake of the test food was < 70% in 4 cases, resulting a PPS of 36 cases.

Fig 1. Study flowchart.

Fig 1

FAS, full analysis set; PPS, per protocol set; SAS, safety analysis set.

Baseline and demographic characteristics

Demographic and baseline characteristics are presented in Table 1. The median and interquartile range of age of the overall study cohort was 61.5 (56.0, 67.3) years.

Table 1. Demographic and baseline characteristics of patients.

Group C (n = 40) Group P (n = 40)
Age (years) 63.5 (56.8, 68.0) 60.0 (55.8, 65.3)
Height (cm) 153.8 (149.7, 157.5) 155.8 (152.7, 160.0)
Weight (kg) 51.1 (47.6, 56.6) 54.1 (46.8, 57.3)
BMI (kg/m2) 21.2 (19.9, 23.8) 22.1 (19.1, 24.5)
Smoking 8 (20) 7 (18)
Alcohol drinking 20 (50) 19 (48)
Exercise habits 11 (28) 9 (23)
Exercise restriction 0 (0) 1 (3)
Supplement user 12 (30) 12 (30)
GC user 6 (15) 6 (15)
GC dose (mg/day) 2.5 (1.3, 3.8) 2 (1.3, 2.0)
MTX user 34 (85) 36 (90)
MTX dose (mg/week) 12 (10.0, 16.0) 12 (10.0, 12.9)
csDMARD other than MTX user 16 (40) 21 (53)
b-/ts-DMARD user 10 (25) 11 (28)
NSAID user 18 (45) 17 (43)
Anti-CCP antibody (U/ml) 189.0 (31.5, 637.0) 120.00 (13.1, 230.5)
MMP-3 (ng/ml) 40.8 (33.1, 58.8) 41.7 (30.4, 89.7)

Data are shown as median (25th, 75th percentiles) or number of patients (%).

b-/ts-DMARD; biological or targeted synthetic disease-modifying antirheumatic drug; BMI, body mass index; C, control; CCP, cyclic citrullinated peptide; csDMARD, conventional synthetic disease-modifying anti-rheumatic drug, GC, glucocorticoid; P, propolis; MMP, matrix metalloproteinase; MTX, methotrexate; NSAID, non-steroidal anti-inflammatory drug.

Primary endpoint and complementary statistical analyses

No significant difference in ΔDAS28-ESR from 0 to 24 weeks was seen between groups in the FAS (Fig 2), and analysis of the PPS showed similar results (data not shown). The result of the mixed-effects model analysis was also described in Fig 2. It showed the main effects of group at each time point. The effect of group was not statistically significant at any time point.

Fig 2. Changes in DAS28-ESR over the course of the study in the FAS.

Fig 2

Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. ANCOVA; analysis of covariance, C, control; CI, confidence interval; DAS, disease activity score; ESR, erythrocyte sedimentation rate; P, propolis.

Secondary endpoints

The same analyses were performed for DAS28-CRP, SDAI, CDAI, and joint sonographic assessment, but no significant differences were apparent between groups (S1S3 Figs). SF-36 score (Fig 3) and mHAQ score (S4 Fig) also showed no significant differences between groups. The results for cytokines also showed no significant differences (Fig 4). All adverse events that occurred during the study are shown in Table 2. The number of patients with adverse events was 13 (33%) in Group C and 11 (28%) in Group P.

Fig 3. Changes in SF-36 score over the course of the study in the FAS.

Fig 3

Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. ANCOVA; analysis of covariance, BP, bodily pain; C, control; CI, confidence interval; GH, general health; MH, mental health; P, propolis; PF, physical functioning; RE, role emotional; RP, role physical; SF, social functioning; SF-36, 36-item short-form health survey; VT, vitality.

Fig 4. Changes in cytokines over the course of the study in the FAS.

Fig 4

Bootstrap confidence intervals are calculated because the normality of the residuals is problematic (repeated 1000 times). The IL-6 value is shown as a log10 value due to the large variability of values. ANCOVA; analysis of covariance, C, control; CI, confidence interval; IL, interleukin; P, propolis.

Table 2. Adverse events over the course of the study in the SAS.

Adverse event Group C Group P
(n = 13) (n = 11)
Common cold 4 (30.7) 1 (9.1)
Influenza 0 (0) 1 (9.1)
Pneumonia 1 (7.7) 0 (0)
Cough 1 (7.7) 0 (0)
Gastroenteritis 1 (7.7) 1 (9.1)
Bacteriogenic enteritis 1 (7.7) 0 (0)
Herpes 1 (7.7) 1 (9.1)
Eruption 0 (0) 1 (9.1)
Fall 0 (0) 1 (9.1)
Sprain (shoulder) 1 (7.7) 0 (0)
Fracture 0 (0) 3 (27.3)
Gonitis 0 (0) 1 (7.1)
Acute low back pain 1 (7.7) 0 (0)
Spinal canal stenosis and worsening back pain 1 (7.7) 0 (0)
Carpal tunnel syndrome 0 (0) 1 (9.1)
Cramp 0 (0) 1 (9.1)
Increased blood levels of tacrolimus 0 (0) 1 (9.1)
Anemia 2 (15.4) 0 (0)
Nail loss (foot) 1 (7.7) 0 (0)
Weight gain 1 (7.7) 0 (0)

Data are shown as number of patients (%).

SAS, safety analysis set; C, control; P, propolis.

Discussion

This study comprised a multicenter, double-blind, randomized, controlled trial to examine the effects of propolis on disease activity in RA patients. In the present study, no effect of propolis on suppression of disease activity or improvement of QOL was found for patients with RA. Okamoto et al. found that in a mouse model of RA, propolis contributed to suppression of disease activity in RA. The contributing mechanism was reported to involve propolis inhibition of the phosphorylation of STAT3 and subsequent suppression of IL-17 production [11]. However, IL-17A of the IL-17 family was measured in our study, and no significant reduction was apparent with propolis intake. Since IL-17 induces the expression of pro-inflammatory cytokines such as IL-6 and tumor necrosis factor-α in cells such as macrophages [23], we also measured IL-6. As with IL-17A, no significant decrease was seen following propolis intake. Since pro-inflammatory cytokines are strongly associated with disease activity in RA, propolis was assumed to exert no suppressive effects on disease activity. Since disease activity affects QOL, no effects on QOL were identified because of the lack of findings on suppression of disease activity. A similar interpretation could be made with regard to joint sonographic assessments and ADLs. In this study, reasons for the null finding of effects of propolis on the suppression of disease activity in RA patients may be that the participating patients were already receiving pharmacotherapy under a strategy of treat-to-target [4]. It A medication might be considered to exert strong effects on disease activity, propolis may not have shown suppressive effects on disease activity that surpassed drug effects. In addition, in our study, baseline IL17A levels were similar to those reported in other RA patients [24], but levels of IL-6 were lower compared to another study even at the same level of disease activity [25]. Therefore, testing in populations with higher cytokine levels might thus be warranted. In addition, since diets such as vegetarian diets [26], Mediterranean diets [21], and anti-inflammatory diets [27] have been reported to suppress disease activity in RA patients, examination of add-on effects of propolis in addition to these dietary treatments on disease activity in patients with RA may be necessary.

In this study, we reported the status of adverse events in RA patients treated with propolis as an intervention study. One serious adverse event, a fracture, was observed in the propolis-treated group, but the relationship between the fracture and propolis treatment was unclear. No characteristic increase in all adverse events with propolis administration was identified during the conduct of this study. Although no inhibitory effect of propolis on disease activity of RA was observed in our study, since beneficial reports (such as preventive effects of propolis on cognitive decline) have been reported [9], our data suggest that propolis could serve as a resource for RA patients who expect these functions to take propolis under the guidance of their physicians.

Our study was a double-blind, randomized controlled trial, but some limitations should be considered. First, the reason for including patients with MDA in this study was that patients with high disease activity require more intensive medication. Propolis is not a drug and was considered unlikely to be as powerful as regular RA treatments. However, even with MDA, patients did not reach efficacy targets, and one possibility is that this group might still have needed intense treatment. Other perspectives on examining the effect of propolis on disease activity in RA might be needed, such as examining effects on the duration of remission or low disease activity. We need to have an improved power calculation based on more realistic effect sizes in a representative population. Second, we used only one commercially available dose with a dosing period of 6 months. Different results might be obtained with higher doses or longer dosing periods. Third, this study was conducted only on women. It would be desirable to verify the effect of propolis on male patients with RA in the future.

Conclusions

No effect of Brazilian propolis administration was seen on disease activity suppression in RA patients with moderate disease activity.

Supporting information

S1 Fig. Changes in DAS28-CRP over the course of the study in the FAS.

Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. P values are calculated using a mixed-effects model. C, control; CI, confidence interval; CRP, C-reactive protein; DAS, disease activity score; P, propolis.

(TIF)

S2 Fig. Changes in SDAI and CDAI over the course of the study in the FAS.

Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. Bootstrap confidence intervals are calculated because the normality of the residuals is problematic (repeated 1000 times). C, control; CDAI, clinical disease activity index; CI, confidence interval; SDAI, simplified disease activity index; P, propolis.

(TIF)

S3 Fig. Changes in total joint sonographic scores in 7 joints over the course of the study in the FAS.

Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. Because the normality of residuals in the model was problematic, statistical analysis is performed after log-transforming total joint sonographic scores at each time point. P values are calculated using a mixed-effects model. C, control; CI, confidence interval; P, propolis.

(TIF)

S4 Fig. Changes in mHAQ score over the course of study in the FAS.

Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. Bootstrap confidence intervals are calculated because the normality of the model’s residuals is problematic (repeated 1000 times). C, control; CI, confidence interval; mHAQ, modified health assessment questionnaire disability index; P, propolis.

(TIF)

S1 File. Data set.

(CSV)

S2 File

(DOCX)

S3 File

(PDF)

S4 File

(DOC)

Acknowledgments

We wish to thank Osaka City University Hospital Center for Clinical Research and Innovation and Atsuko Kamiyama for collecting and managing the data, Tomoko Nakatsuka for monitoring the study, and all study subjects for their participation.

Data Availability

Since there are no restrictions, we upload the data set as a Supporting Information file.

Funding Statement

Y.M. received Yamada Research Grant (grant No.249YM) from a commercial source: Yamada Bee Company, Inc. (https://www.3838.com). The funders had a role in preparing and blinding propolis and placebo tablets and in decision to publish but had no further role in study design, data collection and analysis, or preparation of the manuscript.

References

  • 1.Smolen JS, Aletaha D, McInnes IB. Rheumatoid arthritis. Lancet. 2016; 388: 2023–2038. 10.1016/S0140-6736(16)30173-8 [DOI] [PubMed] [Google Scholar]
  • 2.Jung SM, Kim KW, Yang CW, Park SH, Ju JH. Cytokine-mediated bone destruction in rheumatoid arthritis. J Immunol Res. 2014; 263625: 10. 10.1155/2014/263625 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Woolf AD, Pfleger B. Burden of major musculoskeletal conditions. Bull World Health Organ. 2003; 81: 646–656. [PMC free article] [PubMed] [Google Scholar]
  • 4.Smolen JS, Landewé RBM, Bijlsma JWJ, Burmester GR, Dougados M, Kerschbaumer A, et al. EULAR recommendations for the management of rheumatoid arthritis with synthetic and biological disease-modifying antirheumatic drugs: 2019 update. Ann Rheum Dis. 2020; 79: 685–699. 10.1136/annrheumdis-2019-216655 [DOI] [PubMed] [Google Scholar]
  • 5.Tazawa S, Warashina T, Noro T, Miyase T. Studies on the constituents of Brazilian propolis. Chem Pharm Bull. 1998; 46: 1477–1479. [Google Scholar]
  • 6.Tazawa S, Warashina T, Noro T. Studies on the constituents of Brazilian propolis. II. Chem Pharm Bull. 1999; 47: 1388–1392. [Google Scholar]
  • 7.Imai H, Era S, Hayashi T, Negawa T, Matsuyama Y, Okihara K, et al. Effect of propolis supplementation on the redox state of human serum albumin during high-intensity kendo training. Adv Exerc Sports Physiol. 2005; 11: 109–113. [Google Scholar]
  • 8.El-Sharkawy HM, Anees MM, Van Dyke TE. Propolis improves periodontal status and glycemic control in patients with type 2 diabetes mellitus and chronic periodontitis: a randomized clinical trial. J Periodontol. 2016; 87: 1418–1426. 10.1902/jop.2016.150694 [DOI] [PubMed] [Google Scholar]
  • 9.Zhu A, Wu Z, Zhong X, Ni J, Li Y, Meng J, et al. Brazilian green propolis prevents cognitive decline into mild cognitive impairment in elderly people living at high altitude. J Alzheimers Dis. 2018; 63: 551–560. 10.3233/JAD-170630 [DOI] [PubMed] [Google Scholar]
  • 10.Tanaka M, Okamoto Y, Fukui T, Masuzawa T. Suppression of interleukin 17 production by Brazilian propolis in mice with collagen-induced arthritis. Inflammopharmacology. 2012; 20: 19–26. 10.1007/s10787-011-0088-2 [DOI] [PubMed] [Google Scholar]
  • 11.Okamoto Y, Tanaka M, Fukui T, Masuzawa T. Brazilian propolis inhibits the differentiation of Th17 cells by inhibition of interleukin-6-induced phosphorylation of signal transducer and activator of transcription 3. Immunopharmacol Immunotoxicol. 2012; 34: 803–809. 10.3109/08923973.2012.657304 [DOI] [PubMed] [Google Scholar]
  • 12.Aletaha D, Neogi T, Silman AJ, Funovits J, Felson DT, Bingham CO, 3rd, et al. 2010 rheumatoid arthritis classification criteria: an American College of Rheumatology/European League Against Rheumatism collaborative initiative. Ann Rheum Dis. 2010; 69: 1580–1588. 10.1136/ard.2010.138461 [DOI] [PubMed] [Google Scholar]
  • 13.van Gestel AM, Prevoo ML, van ’t Hof MA, van Rijswijk MH, van de Putte LB, van Riel PL. Development and validation of the European League Against Rheumatism response criteria for rheumatoid arthritis. Comparison with the preliminary American College of Rheumatology and the World Health Organization/International League Against Rheumatism Criteria. Arthritis Rheum. 1996; 39: 34–40. 10.1002/art.1780390105 [DOI] [PubMed] [Google Scholar]
  • 14.van der Heijde DM, van ’t Hof MA, van Riel PL, Theunisse LA, Lubberts EW, van Leeuwen MA, et al. Judging disease activity in clinical practice in rheumatoid arthritis: first step in the development of a disease activity score. Ann Rheum Dis. 1990; 49: 916–920. 10.1136/ard.49.11.916 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Hochberg MC, Chang RW, Dwosh I, Lindsey S, Pincus T, Wolfe F. The American College of Rheumatology 1991 revised criteria for the classification of global functional status in rheumatoid arthritis. Arthritis Rheum. 1992; 35: 498–502. 10.1002/art.1780350502 [DOI] [PubMed] [Google Scholar]
  • 16.Inoue E, Yamanaka H, Hara M, Tomatsu T, Kamatani N. Comparison of Disease Activity Score (DAS)28-erythrocyte sedimentation rate and DAS28-C-reactive protein threshold values. Ann Rheum Dis. 2007; 66: 407–409. 10.1136/ard.2006.054205 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Aletaha D, Smolen J. The Simplified Disease Activity Index (SDAI) and the Clinical Disease Activity Index (CDAI): a review of their usefulness and validity in rheumatoid arthritis. Clin Exp Rheumatol. 2005; 23: 100–108. [PubMed] [Google Scholar]
  • 18.Fukuhara S, Ware JE, Jr, Kosinski M, Wada S, Gandek B. Psychometric and clinical tests of validity of the Japanese SF-36 health survey. J Clin Epidemiol. 1998; 51: 1045–1053. 10.1016/s0895-4356(98)00096-1 [DOI] [PubMed] [Google Scholar]
  • 19.Pincus T, Summey JA, Soraci SA Jr, Wallston KA, Hummon NP. Assessment of patient satisfaction in activities of daily living using a modified Stanford Health Assessment Questionnaire. Arthritis Rheum. 1983; 26: 1346–1353. 10.1002/art.1780261107 [DOI] [PubMed] [Google Scholar]
  • 20.Backhaus M, Ohrndorf S, Kellner H, Strunk J, Backhaus TM, Hartung W, et al. Evaluation of a novel 7-joint ultrasound score in daily rheumatologic practice: a pilot project. Arthritis Rheum. 2009; 61: 1194–1201. 10.1002/art.24646 [DOI] [PubMed] [Google Scholar]
  • 21.Sköldstam L, Hagfors L, Johansson G. An experimental study of a Mediterranean diet intervention for patients with rheumatoid arthritis. Ann Rheum Dis. 2003; 62: 208–214. 10.1136/ard.62.3.208 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Okano T, Inui K, Tada M, Sugioka Y, Mamoto K, Wakitani S, et al. Loss of lean body mass affects low bone mineral density in patients with rheumatoid arthritis—results from the TOMORROW study. Mod Rheumatol. 2017; 27: 946–952. 10.1080/14397595.2017.1289645 [DOI] [PubMed] [Google Scholar]
  • 23.Iwakura Y, Ishigame H, Saijo S, Nakae S. Functional specialization of interleukin-17 family members. Immunity. 2011; 34: 149–162. 10.1016/j.immuni.2011.02.012 [DOI] [PubMed] [Google Scholar]
  • 24.McDonald S, Reed R, Baricevic-Jones I, Biologics in Rheumatoid Arthritis Genetics and Genomics Study Syndicate , Ling S, Plant D, et al. Can serum interleukin-17 and interleukin-10 levels predict response to biologic treatments in patients with rheumatoid arthritis? Rheumatology (Oxford). 2019; 58: 1872–1873. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Takeuchi T, Miyasaka N, Tatsuki Y, Yano T, Yoshinari T, Abe T, et al. Inhibition of plasma IL-6 in addition to maintenance of an efficacious trough level of infliximab associated with clinical remission in patients with rheumatoid arthritis: analysis of the RISING Study. Ann Rheum Dis. 2012; 71: 1583–1585. 10.1136/annrheumdis-2011-201069 [DOI] [PubMed] [Google Scholar]
  • 26.Smedslund G, Byfuglien MG, Olsen SU, Hagen KB. Effectiveness and safety of dietary interventions for rheumatoid arthritis: a systematic review of randomized controlled trials. J Am Diet Assoc. 2010; 110: 727–735. 10.1016/j.jada.2010.02.010 [DOI] [PubMed] [Google Scholar]
  • 27.Vadell AKE, Bärebring L, Hulander E, Gjertsson I, Lindqvist HM, Winkvist A. Anti-inflammatory Diet In Rheumatoid Arthritis (ADIRA)-a randomized, controlled crossover trial indicating effects on disease activity. Am J Clin Nutr. 2020; 111: 1203–1213. 10.1093/ajcn/nqaa019 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Yuanyuan Wang

9 Mar 2021

PONE-D-20-39470

Double-blinded randomized controlled trial to reveal the effects of Brazilian propolis intake on rheumatoid arthritis disease activity index; BeeDAI

PLOS ONE

Dear Dr. Koike,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Apr 23 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Yuanyuan Wang, PhD

Academic Editor

PLOS ONE

Additional Editor Comments:

The reviewers have raised methodological issues, in particular statistical analyses. The authors will need to appropriately address these issues to make the manuscript scientifically sound.

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for submitting your clinical trial to PLOS ONE and for providing the name of the registry and the registration number. The information in the registry entry suggests that your trial was registered after patient recruitment began. PLOS ONE strongly encourages authors to register all trials before recruiting the first participant in a study.

As per the journal’s editorial policy, please include in the Methods section of your paper:

1) your reasons for your delay in registering this study (after enrolment of participants started);

2) confirmation that all related trials are registered by stating: “The authors confirm that all ongoing and related trials for this drug/intervention are registered”.

3. Thank you for stating the following in the Financial Disclosure section:

"YM received Yamada Research Grant

Specific grant numbers

Yamada Research Grant (grant No.249)

Full names of commercial companies that funded the study or authors

Yamada Bee Company, Inc.

Initials of authors who received salary or other funding from commercial companies

There were no authors.

URLs to funder websites

https://www.3838.com

Also state whether any sponsors or funders (other than the named authors) played any role in: YES

・Preparing and blinding propolis and placebo tablets

・Decision to publish"

We note that you received funding from a commercial source: Yamada Bee Company, Inc.

Please provide an amended Competing Interests Statement that explicitly states this commercial funder, along with any other relevant declarations relating to employment, consultancy, patents, products in development, marketed products, etc.

Within this Competing Interests Statement, please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your amended Competing Interests Statement within your cover letter. We will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

4. Thank you for stating the following in the Competing Interests section:

"Yoshinari Matsumoto; Grant/research support from: Yamada Research Grant

Kanae Takahashi; Grant/research support/ Speakers bureau: no COI

Kentaro Inui; Grant/research support: Janssen Pharmaceutical K.K., Astellas Pharma Inc., Sanofi K.K., Abbvie GK, Takeda Pharmaceutical Co. Ltd., QOL RD Co. Ltd., Mitsubishi Tanabe Pharma, Ono Pharmaceutical Co. Ltd., Eisai Co., Ltd., Speakers bureau: Daiichi Sankyo Co. Ltd., Mitsubishi Tanabe Pharma, Janssen Pharmaceutical K.K., Astellas Pharma Inc., Takeda Pharmaceutical Co. Ltd., Ono Pharmaceutical Co. Ltd., Abbvie GK, Pfizer Inc., Eisai Co., Ltd., Chugai Pharmaceutical Co., Ltd.,

Tadashi Okano; Grant/research support: AbbVie, Eisai, Mitsubishi Tanabe Pharma Corporation and Nipponkayaku, Speakers bureau: AbbVie, Asahikasei, Astellas Pharma Inc, Ayumi Pharmaceutical, Bristol-Myers Squibb, Chugai Pharmaceutical, Daiich Sankyo, Eisai, Janssen, Lilly, Mitsubishi Tanabe Pharma Corporation, Novartis Pharma, Ono Pharmaceutical, Pfizer, Sanofi, Takeda Pharmaceutical, Teijin Pharma and UCB

Koji Mandai; Speakers bureau: Asahikasei, Eisai

Yutaro Yamada; Speakers bureau: Abbvie, Chugai, Eisai, and Mitsubishi Tanabe

Ayumi Shintani: Grant/research support: no COI, Speakers bureau: Chugai Pharmaceutical Co., Ltd.

Tatsuya Koike; Grant/research support: AbbVie, Astellas Pharma Inc, Bristol-Myers Squibb, Chugai Pharmaceutical, Eisai, Janssen, Lilly, Mitsubishi Tanabe Pharma Corporation, MSD, Ono Pharmaceutical, Pfizer, Roche, Takeda Pharmaceutical, Teijin Pharma, and UCB, Speakers bureau: AbbVie, Astellas Pharma Inc, Bristol-Myers Squibb, Chugai Pharmaceutical, Eisai, Janssen, Lilly, Mitsubishi Tanabe Pharma Corporation, MSD, Ono Pharmaceutical, Pfizer, Roche, Takeda Pharmaceutical, Teijin Pharma, and UCB. This study has not received specific funding from any source.

This research was supported (in part) by Yamada Research Grant."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

5. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear authors,

Thank you for this well written and thoroughly designed study on the effect of propolis on disease activity in RA. i have to admit I did not know this substance, so first of all thank you for this. Although this is a negative trial, eg the effect is missing, I believe this study to be sound and deserves publication. However, before this is warranted, a few questions should be answered

- In this RCT only women were included. Why?

- Moderate disease activity is perhaps not an ideal state to discover very small effects in inflammation changes. One could also think of inhibition of flares, or as adjuvans in early RA with intensive treatment strategies. However, doing this in practice is perhaps a lost effort as this trial clearly shows no benefit at all of the supplements.

- For the power calculation, there is an effect size of 0.5 assumed. Perhaps this was too ambitious and more persons were needed to detect very small effect sizes... I would write such a statement in limitations.

- I now have mastered all knowledge on propolis via Wikipedia and have read that propolis is very heterogeneous in content. Could it be that one specific type of propolis does work better than the other? Why was the Brazilian propolis chosen?

Good luck!

Reviewer #2: A two-arm randomized placebo-controlled clinical trial (n=80) was conducted to compare the effects of Brazilian propolis to placebo on change in disease activity in RA patients. No significant differences were observed in Disease Activity Score or any secondary endpoints between the two arms.

Minor revisions:

1- Line 226: Consider editing the phrase “If no normality was observed...”

2- Line 230: Indicate the underlying covariance structure used in the mixed-effects models and the criteria for selecting it.

3- Line 252: Provide a measure of dispersion (range or interquartile range) for the median age.

4- The abstract indicates that analysis of covariance methods were used to analyze the data; the statistical analysis section, however, states that mixed-effects models were used. Please clarify. The statistical analysis section should include a comprehensive listing and explanation of all the statistical methods used for the analysis.

5- The study is likely underpowered to test the interaction of arm by time. Plus the sample size justification/power calculation is based upon a t-test, not a test of the interaction effect. Please edit the manuscript for clarification. If tests of interaction effects were conducted, the results have not been presented. If tests of interactions are conducted indicate if the following procedure was implemented when testing interaction effects and main effects. If the interaction effect is significant, provide an interpretation of the results, but do not test main effects because the tests for main effects are uninteresting in light of significant interactions. If interaction effects are non-significant, drop the interaction effects from the model and test the main effects. Determining which results to present when testing interactions is often a multi-step process.

6- When presenting results from mixed effect models, please clarify what, if any, other variables than those listed in the tables were included in the model.

7- Indicate the date range subjects were enrolled in the study.

Reviewer #3: Line 39: please elaborate on the term moderate disease activity, was that assessed by use of DAS28-CRP, or?

Line 42: the abstract describes the use of propolis tablets containing 508.5 mg of propolis whereas the trial registration describes the use of tablets containing 378 mg propolis, please clarify (https://rctportal.niph.go.jp/en/detail?trial_id=jRCTs051180142)

Line 43: were the tablets similar in shape and color?

Line 204: I would recommend including an analysis of the ITT population, defined as every patient randomized as that would minimize a potential bias due to exclusion of patients. Moreover, the ITT analysis reflects the practical clinical scenario because it admits noncompliance and protocol deviations, pls see https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3159210/.

Line 207: I would recommend adapting the FAS population to all patients randomly assigned to a treatment group having at least one efficacy assessment after randomization and participants who never consumed the test food.

As highlighted by EMA (https://www.ema.europa.eu/en/documents/scientific-guideline/ich-e-9-statistical-principles-clinical-trials-step-5_en.pdf) there a only very few circumstances that may lead to the exclusion of randomized subjects in an FAS analysis (one circumstance already being mentioned in the manuscript, “participants who never consumed the test food”).

If the criteria “participants found to be ineligible after randomization” is to be used this paragraph must be expanded (pls see link above).

Line 218: I would recommend defining the Safety Analysis Set as all randomized patients with at least one safety assessment after randomization.

Line 230: why include week 12 data in the analysis of the primary endpoint?

Table 1: did none of the patients receive csDMARDS of ts-DMARDs?

Figure 1: needs to be updated to include i.e. reasons for discontinued intervention (box-row 5 from the top, pls see https://www.equator-network.org/reporting-guidelines/consort/)

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Diederik De Cock

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Yuanyuan Wang

4 May 2021

PONE-D-20-39470R1

Double-blinded randomized controlled trial to reveal the effects of Brazilian propolis intake on rheumatoid arthritis disease activity index; BeeDAI

PLOS ONE

Dear Dr. Koike,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jun 18 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Yuanyuan Wang, PhD

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

The reviewers have made additional comments that will help improve the manuscript.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: No

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: (No Response)

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear authors,

Please put in limitations that

1. These results only apply to women, and that studies in men should be considered.

2. Refrase line 324-326: "We might have overestimated the effectiveness of propolis and might need to develop clinical studies to verify less efficacy in the future." You dont want to verify less efficacy, you want to make sure that propolis has or do not has an effect. Therefore, you need to have an improved power calculation based on more realistic effect sizes in a representative population.

Reviewer #2: (No Response)

Reviewer #3: Thanks for your replies to the comments provided

As previously pointed out I would strongly urge you to adapt the description of your FAS population according to ICH as there are a limited number of circumstances that might lead to excluding randomized subjects from the full analysis set including

- the failure to satisfy major entry criteria (eligibility violations),

- the failure to take at least one dose of trial medication and

- the lack of any data post randomisation

The trial figure is to be updated according to the CONSORT guideline (https://www.equator-network.org/reporting-guidelines/consort/)

The manuscript describes that in Group C the study was discontinued in 4 cases, this is not reflected in figure 1

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Diederik De Cock

Reviewer #2: No

Reviewer #3: Yes: Henrik Gudbergsen

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 May 27;16(5):e0252357. doi: 10.1371/journal.pone.0252357.r004

Author response to Decision Letter 1


7 May 2021

Dear Editor and Reviewers;

We would like to thank you for your very constructive criticisms and editorial suggestions regarding our manuscript. These were very helpful in our sincere efforts to improve our manuscript. We addressed all the concerns point-by-point, depicting Reponses by use of bold font, and revised the manuscript accordingly. We hope that our response meets with your approval. We indicate revised wording with yellow highlighting in the text.

Reviewer #1: Dear authors,

Please put in limitations that

1. These results only apply to women, and that studies in men should be considered.

Response: Thank you for your comment. We have added a note about the need for studies with men. We added a sentence in the text, “Third, this study was conducted only on women. It would be desirable to verify the effect of propolis on male patients with RA in the future.”

2. Refrase line 324-326: "We might have overestimated the effectiveness of propolis and might need to develop clinical studies to verify less efficacy in the future." You dont want to verify less efficacy, you want to make sure that propolis has or do not has an effect. Therefore, you need to have an improved power calculation based on more realistic effect sizes in a representative population.

Response: Thank you for your comment. We have corrected the description in this section. We changed the sentence to “We need to have an improved power calculation based on more realistic effect sizes in a representative population.”.

Reviewer #3: Thanks for your replies to the comments provided

As previously pointed out I would strongly urge you to adapt the description of your FAS population according to ICH as there are a limited number of circumstances that might lead to excluding randomized subjects from the full analysis set including

- the failure to satisfy major entry criteria (eligibility violations),

- the failure to take at least one dose of trial medication and

- the lack of any data post randomisation

Response: Thank you for your advice. Actually, no participant violated the above conditions, but we added 2 items to the definition part of FAS as 4) and 5). Participants who have never taken the test tablet have already been mentioned.

The trial figure is to be updated according to the CONSORT guideline (https://www.equator-network.org/reporting-guidelines/consort/)

Response: Thank you for pointing this out, we have modified the flowchart in Fig.1 to match the CONSORT diagram.

The manuscript describes that in Group C the study was discontinued in 4 cases, this is not reflected in figure 1

Response: Thank you for pointing out our misleading statement. No one in the control group failed to complete the test. It was correct that the number of discontinued intervention is zero. At the final check stage, four subjects took less than 70% of test tablets. The description in the text and Figure 1 have been revised to make it easier to understand.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Yuanyuan Wang

14 May 2021

Double-blinded randomized controlled trial to reveal the effects of Brazilian propolis intake on rheumatoid arthritis disease activity index; BeeDAI

PONE-D-20-39470R2

Dear Dr. Koike,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Yuanyuan Wang, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Yuanyuan Wang

20 May 2021

PONE-D-20-39470R2

Double-blinded randomized controlled trial to reveal the effects of Brazilian propolis intake on rheumatoid arthritis disease activity index; BeeDAI

Dear Dr. Koike:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Yuanyuan Wang

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Changes in DAS28-CRP over the course of the study in the FAS.

    Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. P values are calculated using a mixed-effects model. C, control; CI, confidence interval; CRP, C-reactive protein; DAS, disease activity score; P, propolis.

    (TIF)

    S2 Fig. Changes in SDAI and CDAI over the course of the study in the FAS.

    Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. Bootstrap confidence intervals are calculated because the normality of the residuals is problematic (repeated 1000 times). C, control; CDAI, clinical disease activity index; CI, confidence interval; SDAI, simplified disease activity index; P, propolis.

    (TIF)

    S3 Fig. Changes in total joint sonographic scores in 7 joints over the course of the study in the FAS.

    Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. Because the normality of residuals in the model was problematic, statistical analysis is performed after log-transforming total joint sonographic scores at each time point. P values are calculated using a mixed-effects model. C, control; CI, confidence interval; P, propolis.

    (TIF)

    S4 Fig. Changes in mHAQ score over the course of study in the FAS.

    Data are presented as box-and-whisker plots. White box, Group C; gray box, Group P. Bootstrap confidence intervals are calculated because the normality of the model’s residuals is problematic (repeated 1000 times). C, control; CI, confidence interval; mHAQ, modified health assessment questionnaire disability index; P, propolis.

    (TIF)

    S1 File. Data set.

    (CSV)

    S2 File

    (DOCX)

    S3 File

    (PDF)

    S4 File

    (DOC)

    Attachment

    Submitted filename: Response to Reviewers (1).docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    Since there are no restrictions, we upload the data set as a Supporting Information file.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES