Abstract
Purpose
Pertaining to the Colorectal Surgery Society of Australia and New Zealand (CSSANZ) Executive and Research Support Committee, this study aimed to assess the usefulness and outcomes of surveys sent out by the society to its members.
Methods
From 2009 to 2017, CSSANZ members received 38 surveys, most of which were distributed from within the society, and a few of which originated from other affiliated groups. Surveys were categorised by type, topics, times required for completion, delivery method, response rates, and advancement to publication.
Results
Of 38 surveys, 20 (53%) were published and 18 remain unpublished. Four surveys were distributed annually on average, with 2.2 published annually on average, with a mean impact factor of 2.41 ± 1.55. Mean time to publication was 31 ± 17 months. Surveys contributed to 13 publications (34%). The most common survey topics were rectal cancer decisionmaking, in 6 publications (16%), preoperative assessment of colorectal patients, in 5 publications (13%), and anal physiology: continence and defaecation, in 4 publications (11%). Publication of surveys was not related to the number of surveys distributed per year, the number of questions per survey, or the time required by respondents to complete the surveys.
Conclusion
Most of the CSSANZ-distributed surveys resulted in publications, and one third of the surveys contributed to higher degrees obtained by investigators. These surveys aid research into areas that are otherwise difficult to assess, often indicating areas for future research.
Keywords: Survey, Questionnaire, Colorectal surgery, Clinical equipoise
INTRODUCTION
Some academic surgeons feel that the number of surveys sanctioned by the Colorectal Surgery Society of Australia and New Zealand (CSSANZ) should be culled due to high nuisance effects and limited academic value of the surveys. We aim to present an opposing viewpoint in defence of surveys. Some surgeons within the CSSANZ argue that surveys do not sufficiently meet the research standards mandated for trainees. The Research Support Committee (RSC) within the CSSANZ oversees all matters pertaining to surveys. The RSC approves 4 to 6 surveys per year, although this number may increase to include surveys not requiring reminders or those sent from affiliate organisations. Researchers often acknowledge their collaboration and cooperation with frequent partners including General Surgeons Australia, New Zealand Association of General Surgeons, the Gastroenterology Society of Australia, and other medical or social coloproctology-focused groups.
Anecdotally, most CSSANZ surveys have had high response rates (RRs) in comparison to RRs for general surgical surveys, and CSSANZ surveys largely result in publications. Surveys with opaque conclusions due to poor responses struggle to get published unless they are well constructed with interesting topics. Four or more researchers often draft surveys in collaboration before submission to CSSANZ for consideration. The logistical processes of submitting and completing surveys are achievable, consistent, and clearly known. Submissions undergo rigorous screening and scrutiny by RSC officers, often with 9 to 13 passes in the drafting process, before progressing to general committee review. Successfully screened surveys that are circulated traditionally return quick, helpful, and much-appreciated responses by assiduous members. In recent years, RSC officers have anecdotally noticed a reduction in RR in cycles wherein higher numbers of surveys are distributed, or in cases where surveys are spearheaded by non-members (regardless of investigators’ level of training). Surveys tend to be more successful if they are sponsored by CSSANZ members (especially for non-member applications), if they are well constructed, if they avoid repetitive topics, and in correspondence to online versus paper copies. Between the 2 countries of Australia and New Zealand, surveys distributed by post present great challenges, which are slightly mitigated when researchers use prestamped, self-addressed return envelopes. Some responding surgeons have kindly scanned paper surveys and returned them by email.
Following completion of their research, investigators face the arduous task of securing publication in reputable journals. Anecdotally, journal houses in our region disfavour publishing survey-related research, preferring instead to change survey-based articles to Perspective papers of 800–1,000 words. Researchers are then driven to publish externally in other international journals with higher impact factors with larger readership numbers. Hence, opportunities are lost to locally showcase homegrown research.
Surveys struggle to gain acceptance in the discourse on general surgery, and not surprisingly, the same hurdles are faced in colorectal surgery. Surveys face the challenge of overcoming many biases both intrinsic and extrinsic. Intrinsic biases in cross-sectional studies can include selection bias, nonresponse bias, information biases such as recall bias and detection bias, and confounding bias. Extrinsic biases can come from individual readers, editorial organisations, journal houses, and speciality group prejudices. We hope that the present study reduces some of the extrinsic biases toward colorectal surveys in Australia and New Zealand.
METHODS
This study aims to assess the outcomes and benefits of CSSANZ-distributed surveys over a 9-year period. It addresses several questions, as follows. (1) In typical surveys, what topics are being investigated and which question types are being asked? (2) What rate of CSSANZ surveys formally progresses to positive literary outcomes in publications and/or dissertations for higher degrees? (3) How does the publication rate for these CSSANZ surveys compare to the publication rate for submitted Royal Australasian College of Surgeons research abstracts?
Between 1st January 2009 and 31st December 2017, the CSSANZ distributed 38 surveys to its members. Subsequently, all of the surveys were retrospectively analysed as of census date 30th June 2018. The majority of these surveys (92%) were spearheaded by CSSANZ members. A few surveys (8%) were looked after by other affiliate groups—namely, the Lowry Cancer Research group of the University of New South Wales, Crohn’s and Colitis Australia, and the Gastroenterology and Liver Services at Concord Hospital NSW of the University of Sydney. Each survey had its own initial ethics approval, and later, the CSSANZ Executive Committee approved a comparative “survey of these surveys.” We reviewed all questionnaires held by the Secretariat and manually counted the number of questions for each. All publications were found via PubMed, MEDLINE, and/or Google Scholar. For our purposes of analysis herein, survey types are categorised into discrete categories of referral pathways, current practices, decision-making, or knowledge and skills assessment. For consensus, our authors independently categorised each survey based on their title wording, questionnaire structure, or conclusions from subsequent publications. Where initial consensus was not met on categorisation, agreement was later finalised by panel discussion. Survey topics are categorised into one of the listed chapters from the Table of Contents from the American Society of Colon and Rectal Surgeons Textbook of Colon and Rectal Surgery [1]. Survey times refer to the estimated minutes required for participants to complete a survey as stated by investigators. Time to publication in months measures the time from survey submission to the Secretariat for distribution to the acceptance date for publication according to the article title page or the electronic-publication date in the citation.
The survey delivery method is listed as either “paper” (for telephone or postal mail) or “electronic” (online platforms or emailed questionnaires) depending on response collection as opposed to questionnaire-distribution. Those with online questionnaires used platforms including KeySurvey (Braintree, MA, USA); SurveyMonkey (SurveyMonkey, San Mateo, CA, USA); Google Docs (Google, Mountain View, CA, USA); or Vista (Vanguard Software Corp., Cary, NC, USA). Links to questionnaires were sent by email or by advertisements in relevant societies’ newsletters or journals. Commonly, after a questionnaire was dispersed, 1 or (on rare occasion) 2 reminders were issued as follow-up at intervals of 2 weeks apart. After the passage of 2 months, many investigators ceased to accept survey responses.
RRs from CSSANZ members were calculated with respondent numbers reported by investigators functioning as the numerator and questionnaire-distribution numbers reported by the Secretariat functioning as the denominator. RRs from non-members were chart listed, but not included in our analysis. An RR was “not defined” for surveys generically sent to non-CSSANZ members of large organisations where only the numerator of respondent numbers was known. Due to missing data from unpublished surveys for some of the defined elements above, complete analysis of RR for all 38 surveys was not possible.
The authors individually scored all surveys with the newly developed yet unvalidated qualitative Young’s Survey Score (YSS), shown in Fig. 1, as developed by this paper’s senior author (CJY). The YSS gives a rating according to 5 questions asked of each survey, with scores marked out of 10 for a maximum total of 50 points. The scores examined for each survey include dimensions of the topic’s interest and importance to CSSANZ membership, currency of similar topics in circulation, length of time required for respondents to complete surveys, and ease of answering based on delivery method. The summative score intends to quantify these 5 variables as a novel quality scoring system for surveys in colorectal surgery. For consensus, an average was taken of individual authors’ scores for each survey.
Fig. 1.
Young’s Survey Score developed by the senior author.
RRs from unpublished surveys were unknown by the Secretariat or were not obtainable from the primary investigators at the time of this study. Based on published surveys, we listed the topics of each survey according to their topic subject matter, and divided them into high RR (≥50%) or low RR (<49%) by CSSANZ members. As of the study census date, we did not have full details regarding the fate of unpublished surveys. Two surveys are confirmed to have ceased—1 due to poor responses and 1 that did not progress. The other surveys are currently facing the ongoing challenge of finding a suitable journal organisation for publication.
RESULTS
Over the 9-year study period, the CSSANZ annually distributed a mean ± standard deviation (SD) of 4 ± 2 surveys with a mean annual publication rate of 2.2 (55%), as shown in Fig. 2. Regarding the 38 surveys overall, the 3 most common survey topics, as shown in Supplementary Table 1, were rectal cancer decision-making, in 7 publications (16%), preoperative assessment of colorectal patients, in 6 publications (13%), and anal physiology: continence and defaecation, in 5 publications (11%). The collective outcomes of the surveys’ delivery methods, number of questions, number of pages, survey quality, distribution per year, and survey type frequency of use are shown in Table 1.
Fig. 2.
Number of surveys distributed and subsequently published each year by CSSANZ from 2009 to 2017. CSSANZ, Colorectal Surgery Society Australia and New Zealand.
Table 1.
Demographics and survey types of CSSANZ surveys, 2009–2017 (n = 38)
| Variable | Value |
|---|---|
| Published | |
| Yes | 20 (53) |
| No | 18 (47) |
| Higher degree | |
| Yes | 13 (34) |
| No | 25 (66) |
| Method of delivery | |
| Electronic | 23 (60) |
| Paper | 15 (40) |
| No. of questions per survey | 37 ± 24 (7–20) |
| No. of pages of questionnaire (median = 5) | |
| ≤5 Pages | 27 (73)a |
| ≥6 Pages | 10 (27)a |
| No. of questions per survey (median = 28) | |
| ≤28 Questions | 19 (51)a |
| ≥29 Questions | 18 (49)a |
| Survey quality (YSS) | 37 ± 5 (24–46) |
| Distribution amount per year | |
| 2–4 Surveys/yr | 16 (42) |
| 5–6 Surveys/yr | 22 (58) |
| Survey types frequency of use | |
| Referral pathways | 1 (3) |
| Current practices | 33 (87) |
| Decision-making | 17 (45) |
| Knowledge and skills assessment | 16 (42) |
| Published surveys (n = 20) | |
| Response rate | 52.5 ± 18.3 (7.3–75.3) |
| Time to publication (mo) | 31 ± 17 (5–59) |
| IF of publishing journals | 2.41 ± 1.55 (0.03–7.20) |
Values are presented as number (%) or mean ± standard deviation (range).
CSSANZ, Colorectal Surgery Society of Australia and New Zealand; IF, impact factor; YSS, Young’s Survey Score.
Data missing from one survey.
Regarding positive literary outcomes, 20 surveys (53%) were published as of census date 30th June 2018. The survey results are shown to have contributed to 13 higher degrees, comprising 3 PhDs and 10 Masters degrees, as shown in Supplementary Table 2. Fig. 3A [2-21] and Supplementary Table 3, respectively, show a summarised and expanded list of these surveys and their RRs. For published surveys, the mean ± SD of RR from CSSANZ members was 53% ± 18.3%, as depicted in Fig. 3B, and the mean ± SD impact factor was 2.41 ± 1.55 for publishing journals, as shown in Fig. 4A [22-24]. Fig. 4B shows a mean ± SD time to publication for relevant surveys of 31 ± 17 months. Fig. 5 shows a Kaplan-Meier analysis with “publication” being the event of interest. Surveys with a YSS of ≥37/50 were more likely to be accepted for publication (P = 0.027), with a mean publication time of 36.5 months for this subgroup.
Fig. 3.
Summary of CSSANZ surveys 2009–2017 subsequently published. (A) Number of individual surveys sent to candidates and received from respondents. (B) Response rates to each survey project from all respondents and from CSSANZ members. CSSANZ, Colorectal Surgery Society Australia and New Zealand.
Fig. 4.
Summary of CSSANZ surveys 2009–2017 subsequently published. (A) Impact factor of journal of publication for each survey project. (B) Time to publication for each survey project. CSSANZ, Colorectal Surgery Society Australia and New Zealand.
Fig. 5.
Time to publication by Survey Score groups for CSSANZ surveys 2009–2017 subsequently published. CSSANZ, Colorectal Surgery Society Australia and New Zealand; SE, standard error; CI, confidence interval; KM, Kaplan-Meier; HR, hazard ratio.
For the 38 surveys, comparison analyses of the methods of delivery and progression to publication are shown in Tables 2 and 3. The progression of surveys to publication was not influenced by the number of survey questions, number of pages, time required to complete the survey, or the number of surveys distributed in a year. Investigators undertaking a higher degree were more likely (P < 0.001) to use paper-based surveys. The factors used for univariate and multivariate analysis were surveys’ methods of delivery, YSSs, and occurrence in the first or second half of the study period to remove lead-time biases, as shown in Table 4. From these analyses, surveys with a YSS of ≥37/50 were significantly more likely to be accepted for publication. Table 5 shows topics from 20 published surveys and their categorised RR with no obvious correlation between the topic subject matter and the incidence of high or low RRs.
Table 2.
Comparison of CSSANZ surveys 2009–2017 by method of delivery (n = 38)
| Variable | Electronic | Paper | P-value |
|---|---|---|---|
| Published | |||
| Yes | 11 (29) | 9 (24) | 0.34a |
| No | 12 (32) | 6 (16) | |
| Impact factor of journal | 2.50 ± 1.86 (0.48–7.20) | 2.30 ± 1.16 (0.03–3.57) | 0.78b |
| Higher degree associated | |||
| Yes | 2 (5) | 11 (29) | <0.001a |
| No | 21 (55) | 4 (11) |
Values are presented as number (%) or mean ± standard deviation (range).
CSSANZ, Colorectal Surgical Society of Australia and New Zealand.
Fisher exact test.
t-test.
Table 3.
Demographic comparisons of published and unpublished CSSANZ surveys, 2009–2017 (n = 38)
| Variable | Published | Unpublished | P-value |
|---|---|---|---|
| Total | 20 (53) | 18 (47) | |
| Survey questions | 36.2 ± 18.6 (9–75)a | 38.1 ± 30 (7–120)a | 0.81c |
| Median number of questions (95% CI) | 34a | 27a | 0.68d |
| ≤Median | 10 (27)a | 9 (24)a | 0.56b |
| >Median | 10 (27)a | 8 (22)a | |
| Median number of pages (95% CI) | 8a | 12a | |
| ≤Median | 17 (46)a | 15 (41)a | 0.58b |
| >Median | 3 (8)a | 2 (5)a | |
| Time required to complete questionnaire | |||
| 5–10 Minutes | 15 (11)a | 11 (30)a | 0.54, χ² = 1.24, df = 2 |
| 11–15 Minutes | 2 (5)a | 4 (11)a | |
| 16–30 Minutes | 3 (8)a | 2 (5)a | |
| Survey outcomes | |||
| Higher degrees achieved | |||
| Yes | 9 (24) | 4 (11) | 0.13b |
| No | 11 (29) | 14 (37) | |
| Survey demographics | |||
| Distribution amount per year | |||
| 2–4 Surveys | 10 (26) | 6 (16) | 0.24b |
| 5–6 Surveys | 10 (26) | 12 (32) | |
| Survey type frequency of use | |||
| Referral pathways | 1 (3) | 0 (0) | ND |
| Current practices | 18 (47) | 15 (40) | |
| Decision-making | 9 (24) | 8 (21) | |
| Knowledge and skills assessment | 9 (24) | 7 (18) |
Values are presented as number (%) or mean ± standard deviation (range) unless otherwise indicated.
CSSANZ, Colorectal Surgical Society of Australia and New Zealand; CI, confidence interval; ND, statistics not done as some surveys had more than one survey type.
Data missing from one survey.
Fisher exact test.
t-test.
Mann-Whitney U-test.
Table 4.
Univariate categorical analysis and Cox regression analysis of factors affecting time to publication of surveys
| Variable | Published, n (%) |
Univariate P-value (Fisher exact) | P-value (HR [95% CI]) |
||
|---|---|---|---|---|---|
| Yes | No | Univariate | Multivariate | ||
| Survey score | 0.021 | 0.036 (2.9 [1.1–8.1]) | 0.033 (3.0 [1.1–8.4]) | ||
| ≥37/50 | 15 (40) | 6 (16) | |||
| <37/50 | 5 (13) | 12 (32) | |||
| Survey method | 0.522 | 0.550 (0.8 [0.3–1.9]) | 0.478 (0.7 [0.3–1.8]) | ||
| Electronic | 11(29) | 12 (32) | |||
| Paper | 9 (24) | 6 (16) | |||
| Survey sent | 0.022 | 0.883 (1.1 [0.4–2.9]) | 0.896 (1.1 [0.4–2.9]) | ||
| April 2009–Feb 2013 | 14 (37) | 5 (13) | |||
| June 2013–Aug 2017 | 6 (16) | 13 (34) | |||
HR, hazard ratio; CI, confidence interval.
Table 5.
Comparison of response rate and topic subject matter
| RR | RR by CSSANZ | CSSANZ respondents (surveys sent) | RR overall | Overall respondents (total surveys sent) | Survey year | Study (publication year) | Survey topica | Survey type | Focus subject matter |
|---|---|---|---|---|---|---|---|---|---|
| Low RR | 7.3% | 12 (165) | ND | 1,064 (-) | 2012 | Holt et al. [13] (2017) | IBD diagnosis and Evaluation | CP, KSA | Attitudes of patients and clinicians about the role of diet and body weight in IBD. |
| 18.2% | 12 (66) | 67.3% | 33 (49) | 2009 | Spigelman et al. [2] (2013) | Preoperative assessment of colorectal patients | RP | Referral pathways of patients with newly diagnosed colorectal cancer sent to surgeons. | |
| 27.66% | 52 (188) | 3.4% | 72 (2100) | 2017 | Chittleborough et al. [21] (2018) | Endoscopy | CP, KSA | Quality in colonoscopic surveillance. | |
| 36.0% | 46 (128) | 49.0% | 264 (539) | 2010 | Leong et al. [6] (2015) | IBD diagnosis and evaluation | CP, KSA | Dysplasia screening and surveillance in IBD: knowledge and predictors of practice. | |
| 42.9% | 66 (154) | 42.9% | 66 (154) | 2011 | Behrenbruch et al. [10] (2015) | Rectal cancer decision-making | CP, DM | Consensus for treatment (decision-making and management) of rectal cancer patients with complete clinical response to neoadjuvant chemotherapy. | |
| 45.6% | 73 (160*) | ND | 181 (-) | 2015 | Chen et al. [18] (2017) | Colorectal neoplasm: screening and surveillance after polypectomy | CP, KSA | Study of clinicians’ attitudes towards the use of aspirin as a risk-reducing medication specifically in people at high risk for cancer due to an inherited cancer syndrome (Lynch syndrome) with no personal history of colorectal cancer (i.e., mutation carriers). | |
| High RR | 49.5% | 99 (200) | 50.0% | 118 (236) | 2015 | Jaung et al. [17] (2016) | Diverticular disease | CP | Current practices in the management of acute diverticulitis in Australasia. |
| 49.8% | 102 (205) | 49.8% | 102 (205) | 2016 | Siddiqui et al. [20] (2017) | Diverticular disease | CP, KSA | Correlation of current practices in management of diverticulitis with recent guidelines. | |
| 53.9% | 82 (152) | 53.9% | 82 (152) | 2010 | Kahokehr et al. [5] (2011) | Surgical management of colon cancer | CP | Current state and perceived barriers of perioperative colorectal practice in Australia and New Zealand. | |
| 58.4% | 111 (190) | 27.6% | 216 (782) | 2014 | Burnett et al. [16] (2018) | Pilonidal disease | CP, DM | Pilonidal sinus disease. | |
| 60.3% | 114 (189) | 60.3% | 114 (189) | 2010 | Warrier et al. [9] (2013) | Colon cancer: preoperative evaluation and staging | CP, DM | Clinical practice assessment regarding management of colorectal cancer in younger patients. | |
| 62.1% | 108 (174) | 62.1% | 108 (174) | 2010 | Ooi et al. [7] (2012) | Anal physiology: continence and defaecation | CP, DM | The management of rectal cancer by colorectal surgeons using MRI for locally advanced disease. | |
| 62.4% | 126 (202) | 62.4% | 126 (202) | 2015 | Zahid et al. [19] (2017) | Anal physiology: continence and defaecation | CP, DM | Surgical decision-making in the management of rectal prolapse. | |
| 62.7% | 128 (204) | 62.7% | 128 (204) | 2012 | Smart et al. [12] (2013) | Preoperative ssessment of colorectal patients | CP, KSA | Examining risk profiles for thromboembolic disease in colorectal cancer patients: comparison of guidelines and current practices. | |
| 64.2% | 106 (165) | 64.2% | 106 (165) | 2013 | Ansari et al. [15] (2015) | Rectal cancer: neoadjuvant therapy | CP, DM, KSA | Decision-making and certainty in the use of radiotherapy as neoadjuvant treatment in rectal cancer. | |
| 64.9% | 96 (148) | 64.9% | 96 (148) | 2010 | Suen et al. [8] (2015) | Large bowel obstruction | CP, DM | Self-expanding metallic stents for the management of large bowel obstruction: surgeon survey and review of barriers to conducting randomized controlled trials. | |
| 68.5% | 113 (165) | 68.5% | 113 (165) | 2012 | Al-Mozany et al. [14] (2017) | Anal physiology: continence and defaecation | CP, KSA | Barriers to management of obstructed defecation in Australia and New Zealand. | |
| 69.9% | 102 (146) | 69.9% | 102 (146) | 2009 | Jorgensen et al. [3] (2011) | Colorectal cancer: postoperative adjuvant therapy | CP, KSA | Older patients and adjuvant therapy for colorectal cancer: surgeon knowledge, opinions, and practices. | |
| 70.4% | 107 (152) | 70.4% | 107 (152) | 2011 | Hong et al. [11] (2014) | Rectal cancer: neoadjuvant therapy | CP, DM | Decision-making in the use of radiotherapy for patients with rectal cancer; perception of hierarchy of variables. | |
| 75.3% | 110 (146) | 75.3% | 110 (146) | 2009 | MacDermid et al. [4] (2014) | Anastomotic complications | DM | Decision-making with defunctioning stomas and rectal anastomoses. |
RR, response rate; CSSANZ, Colorectal Surgery Society Australia and New Zealand; RP, referral pathways; CP, current practices; DM, decision-making; KSA, knowledge and skills assessment; IBD, inflammatory bowel disease; MRI, magnetic resonance imaging; ND, not defined.
Based on Table of Contents of ASCRS Textbook of Colon and Rectal Surgery. 3rd ed. 2016 [1].
DISCUSSION
This study showed that CSSANZ-distributed surveys had a high RR from members, with the majority resulting in publication and with one third of completed surveys contributing to investigators’ advancement to higher degrees. Investigators doing higher degrees more commonly (P < 0.001) used paper-based questionnaires, probably due to the clerical structure, research support resources, and preference of common research offices wherein many of them matriculated. There was no significant influence on the progression of surveys to publication due to the number of surveys distributed each year, the number of questions, number of pages, method of delivery, or the time required for participants to complete the surveys. This refutes previously held beliefs about disincentives in potential respondents’ desire to participate in surveys among CSSANZ members. There were combinations of surveys types used with the following frequencies: referral pathways, in 1 survey (3%), current practice, in 33 surveys (87%), decision-making, in 17 surveys (45%), and knowledge and skills assessment, in 16 surveys (42%). Through analysis herein, surveys are shown to aid research into areas that are otherwise hard to assess. Moreover, surveys often indicate areas for future research. For example, a questionnaire on diverticulitis circulated by Siddiqui et al. [20] revealed a lack of consensus, and highlights practices that disagree with current treatment guidelines. This meaningful discrepancy certainly needs further explanation via future research. These findings are not discernible from randomized controlled trial (RCTs), which cannot predict opinions. Areas of investigation and question types that are typically addressed in surveys cannot be answered by RCTs. Importantly, surveys tend to lead to or unearth areas where RCTs may be needed for more robust understanding of current topics.
In comparison to regional trends for all research types from all surgical disciplines, CSSANZ surveys are shown to have a high mean publication rate (53%), but a long mean ± SD publication time of 31 ± 17 months. The investigative work of Khajehnoori et al. [25] shows that 26% of abstracts submitted to the Annual Scientific Congress of the Royal Australasian College of Surgeons were subsequently published, with 74% of these accepted ≤24 months from original submission of the abstract.
Of the 38 surveys, 6 surveys (16%) were published in regional journals. Despite reviewing 117 self-administered surveys from 34 high impact factor international journals over 1 year, Bennett et al. [26] found that most journals provided no guidance to authors for reporting survey research. The work asserts that survey-based research needs to be reported transparently so readers and reviewers can critically assess the strengths and weaknesses of the design, methodology, and analysis therein. Currently, there is no quality scoring system for surveys in colorectal surgery. Thus, we propose our YSS for internal assessment of CSSANZ-distributed surveys. In the future, we hope to analyse whether there are correlations between YSSs, rates of responses, and publication.
The work of Edwards et al. [27] gives practical tips for improving survey-based RR data collection in postal and electronic questionnaires, although our study shows that neither method influences progression to publication. The work of Hing et al. [28] suggests that questionnaire RR can be improved by optimising study design and including incentives. Despite assessing survey design, our study is not able to analyse the influence of incentives due to missing information from our cohort. According to Alderman and colleagues, the medical research field uses 3 main types of surveys: (1) epidemiological surveys, (2) surveys on attitudes toward a health service or intervention, and (3) questionnaires assessing knowledge on an issue or topic [29]. In CSSANZ-distributed surveys, our categorisation was into 4 survey types, closely paralleling the above.
We advise future survey investigators to consider the following:
• Dutifully report to the Secretariat all positive literary outcomes including public showcasing at scientific meetings (oral presentations, posters, and/or abstracts), or at workshops (oral presentations).
• Analyse how your survey influences policy changes in your organisation at various levels (surgical units, department-wide, hospital-wide, and/or area/regional health districts).
• Utilise smartphone technologies with applications linked to secure online survey platforms for more efficient and rapid questionnaire delivery, reminder distribution, and response collection. Numerous commercial applications currently exist, and in the future, applications may be custom-developed for the CSSANZ.
• Consider sending up to 4 reminders fortnightly, ideally electronically, as one reminder seems politely insufficient.
Following this study, we will advocate for an increase from 4–6 surveys to 7–8 surveys per year, with similar expectations for positive literary outcomes, as proven herein. Changes in journal submission policies, along with consistent and clear reporting guidelines for colorectal surgery survey research, may help retain publication of future surveys in Australasia. Surveys indicate areas of equipoise where further research may be useful. We advocate for greater discussion within the CSSANZ to use each sanctioned survey as an impetus for greater policy discussion, for more frequent scrutiny of guidelines, and for further research by its membership.
Future investigators are encouraged to clearly state the immediate aims and long-term goals of their surveys. When CSSANZ surveys appear to forecast trends, deviations from guidelines, or insights beyond the scope of opinion polls or practice audits, this shift may lead to increased survey acceptance by colorectal surgeons and to better survey assessment of benefits in clinical practice. All past investigators fully appreciate the support of CSSANZ membership in assisting in projects that stand to help all practitioners in colorectal surgery understand areas for further research. The invaluable amount of time spent, contributions made, and the innate culture of research camaraderie among members facilitates cooperative participation and commendable RRs to these important surveys.
This was a retrospective review with all the intrinsic limitations of nonrandomisation. In addition, our review is limited by the nonresponse bias, which is a weakness of all surveys. As highlighted in this study, the impact factor only represents a score for the popularity of journal readership, and not for research quality. Missing information about respondents’ locations, duration of time spent to collect data, distribution of reminders, and RRs from unpublished surveys prevent a more in-depth analysis of non-RRs.
The present study does not explore the multifactorial factors that influence RRs (negatively or positively). Our data collection was significantly incomplete, and hence, contrary to the plan of study, no analysis was made in areas including time taken by investigators to collect data, number of reminders sent, method of reminder, timing of reminder, recruitment incentives used, geographical location (country, state, and city) of surveyed participants, and age of participants. The small sample size may have accounted for the study’s inability to reach significance in showing the influence on publication rate by the number of surveys distributed each year, the number of questions, number of pages, method of delivery, and participant time required for completion of surveys. This information would have facilitated better assessment of the ways to more effectively deliver surveys to CSSANZ membership, whether pertaining to delivery method (paper versus electronic), the use of incentives, and/or specific geographical challenges, with the common aim of increasing participation by colorectal surgeons. Again, we intuitively forecast that RRs may be improved by a trial of a CSSANZ custom-designed mobile phone application, together with a system of continual professional development points awarded to respondents.
The study also does not review the reasons for surgeons’ deviation from conventional guidelines. Any deviation from standard practice should be a cause for concern, as it either points to better treatment options or to an inadequacy of the guidelines. Whereas the opinions of the expert masses should not be followed blindly to determine policy, deviations from policy by the masses should prompt a prudent review. Robust discourse should take place among our experienced and knowledgeable membership regarding the best ways to customise guidelines to align with existing regional experiences.
Lastly, our study does not assess how the results of completed surveys have influenced further research or have led to policy implementations or changes in respective healthcare centres. This is a matter for future review by CSSANZ membership, as it should specifically investigate how these surveys may have influenced clinical governance and administration throughout the region.
In conclusion, surveys in colorectal surgery can be very useful and should continue to be considered for use by the CSSANZ. Surveys overall benefit the CSSANZ by providing a valuable and productive research methodology for auditing and reviewing the membership’s clinical practices and adherence to national and regional guidelines. Ideally, CSSANZ surveys should address a popular, trendy, or even controversial topic, should specifically or exclusively target proctology colleagues (members and affiliates), and should be of high quality according to YSS assessment. To specify dimensions of high quality, optimal surveys are interesting, important, pertinent to topics not surveyed within the last 2 years, require less than 10 minutes to complete, and are easy to return by any means.
Acknowledgments
We would like to thank the participating surveyors for sharing aspects of their research. We also send special thanks to Liz Neilson and Kerri Buczynkyj of the CSSANZ Secretariat for providing listings and data of past surveys conducted under the auspices of the CSSANZ.
Footnotes
No potential conflict of interest relevant to this article was reported.
SUPPLEMENTARY MATERIAL
Supplementary material can be found via https://doi.org/10.3393/ac.2019.09.17.
Supplementary Table 1. List of general categories in survey topics with frequency of topics surveyed. Supplementary Table 2. List of survey topics used with listed outcomes. Supplementary Table 3. Expanded list of published surveys with participant groups and responses.
List of survey topics general categories for CSSANZ surveys 2009–2017 (n=38)
List of survey topics as taken from ASCRS Textbook of Colon and Rectal Surgery [1]
Summary list of CSSANZ surveys from 2009 to 2017 that were published
REFERENCES
- 1.Steele SR, Hull TL, Read TE, Saclarides TJ, Senagore AJ, Whitlow CB, editors. The ASCRS Textbook of Colon and Rectal Surgery. 3rd ed. Cham (Switzerland): Springer International Publishing; 2016. p. 1292. [Google Scholar]
- 2.Spigelman AD, Pascoe SW, Harris MF, Beilby JJ, Crossland LJ, Gett RM, et al. Referral pathways in colorectal cancer: an audit of surgeons’s records. Aust Health Rev. 2013;37:449–52. doi: 10.1071/AH13038. [DOI] [PubMed] [Google Scholar]
- 3.Jorgensen ML, Young JM, Solomon MJ. Older patients and adjuvant therapy for colorectal cancer: surgeon knowledge, opinions, and practice. Dis Colon Rectum. 2011;54:335–41. doi: 10.1007/DCR.0b013e3181ff43d6. [DOI] [PubMed] [Google Scholar]
- 4.MacDermid E, Young CJ, Young J, Solomon M. Decision-making in rectal surgery. Colorectal Dis. 2014;16:203–8. doi: 10.1111/codi.12487. [DOI] [PubMed] [Google Scholar]
- 5.Kahokehr A, Robertson P, Sammour T, Soop M, Hill AG. Perioperative care: a survey of New Zealand and Australian colorectal surgeons. Colorectal Dis. 2011;13:1308–13. doi: 10.1111/j.1463-1318.2010.02453.x. [DOI] [PubMed] [Google Scholar]
- 6.Leong RW, Perry J, Campbell B, Koo J, Turner IB, Corte C, et al. Knowledge and predictors of dysplasia surveillance performance in inflammatory bowel diseases in Australia. Gastrointest Endosc. 2015;82:708–14. doi: 10.1016/j.gie.2015.04.004. [DOI] [PubMed] [Google Scholar]
- 7.Ooi K, Frizelle F, Ong E, Faragher I. Current practice in preoperative therapy and surgical management of locally advanced rectal cancer: a bi-national survey. Colorectal Dis. 2012;14:814–20. doi: 10.1111/j.1463-1318.2011.02813.x. [DOI] [PubMed] [Google Scholar]
- 8.Suen MK, Zahid A, Young JM, Rodwell L, Solomon MJ, Young CJ. How to decide to undertake a randomized, controlled trial of stent or surgery in colorectal obstruction. Surgery. 2015;157:1137–41. doi: 10.1016/j.surg.2015.01.022. [DOI] [PubMed] [Google Scholar]
- 9.Warrier SK, Lynch AC, Heriot AG. A bi-national perspective on the management of young patients with colorectal cancer. ANZ J Surg. 2013;83:636–40. doi: 10.1111/ans.12071. [DOI] [PubMed] [Google Scholar]
- 10.Behrenbruch C, Ryan J, Lynch C, Wynn G, Heriot A. Complete clinical response to neoadjuvant chemoradiotherapy for rectal cancer: an Australasian perspective. ANZ J Surg. 2015;85:103–4. doi: 10.1111/ans.12441. [DOI] [PubMed] [Google Scholar]
- 11.Hong JS, Young CJ, Solomon MJ. Observational study of decision making concerning radiotherapy in rectal cancer. Int J Surg. 2014;12:390–3. doi: 10.1016/j.ijsu.2014.03.016. [DOI] [PubMed] [Google Scholar]
- 12.Smart P, Burbury K, Lingaratnam S, Lynch AC, Mackay J, Heriot A. Thromboprophylaxis among Australasian colorectal surgeons. ANZ J Surg. 2013;83:646–50. doi: 10.1111/j.1445-2197.2012.06245.x. [DOI] [PubMed] [Google Scholar]
- 13.Holt DQ, Strauss BJ, Moore GT. Patients with inflammatory bowel disease and their treating clinicians have different views regarding diet. J Hum Nutr Diet. 2017;30:66–72. doi: 10.1111/jhn.12400. [DOI] [PubMed] [Google Scholar]
- 14.Al-Mozany N, Wright C, O’Grady G, Young CJ, Solomon MJ. Barriers to the management of obstructed defaecation according to colorectal surgeons. Colorectal Dis. 2017;19:649–55. doi: 10.1111/codi.13665. [DOI] [PubMed] [Google Scholar]
- 15.Ansari N, Young CJ, Schlub TE, Dhillon HM, Solomon MJ. Understanding surgeon decision making in the use of radiotherapy as neoadjuvant treatment in rectal cancer. Int J Surg. 2015;24(Pt A):1–6. doi: 10.1016/j.ijsu.2015.10.004. [DOI] [PubMed] [Google Scholar]
- 16.Burnett D, Smith SR, Young CJ. The surgical management of pilonidal disease is uncertain because of high recurrence rates. Cureus. 2018;10:e2625. doi: 10.7759/cureus.2625. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Jaung R, Robertson J, Rowbotham D, Bissett I. Current management of acute diverticulitis: a survey of Australasian surgeons. N Z Med J. 2016;129:23–9. [PubMed] [Google Scholar]
- 18.Chen Y, Peate M, Kaur R, Meiser B, Wong T, Kirk J, et al. Exploring clinicians’ attitudes about using aspirin for risk reduction in people with Lynch Syndrome with no personal diagnosis of colorectal cancer. Fam Cancer. 2017;16:99–109. doi: 10.1007/s10689-016-9933-1. [DOI] [PubMed] [Google Scholar]
- 19.Zahid A, Wright CM, Young CJ. Surgical management of rectal prolapse: a cross-sectional perspective. Pelvi Perineologie. 2017;36:17–20. [Google Scholar]
- 20.Siddiqui J, Zahid A, Hong J, Young CJ. Colorectal surgeon consensus with diverticulitis clinical practice guidelines. World J Gastrointest Surg. 2017;9:224–32. doi: 10.4240/wjgs.v9.i11.224. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Chittleborough TJ, Luck A, Boussioutas A, Warrier S, Heriot AG. The conundrum of quality in colonoscopy. ANZ J Surg. 2018;88:263–4. doi: 10.1111/ans.14265. [DOI] [PubMed] [Google Scholar]
- 22.Zhu C. ResearchGate; 2018 Journal Impact Factor (JCR 2018) [Internet] c2018 [cited 2019 Jul 11]. Available from: https://www.researchgate.net/publication/326007449_2019_Journal_Impact_Factor_SCI_JCR_2019. [Google Scholar]
- 23.Padova (IT): Pelvi-Perinologie Journal; Pelvi-Perineologie Impact Factor [Internet] c2013 [cited 2018 Sep 7]. Available from: https://www.scijournal.org/impact-factor-of-PELVI-PERINEOLOGIE.shtml. [Google Scholar]
- 24.ResearchGate . Researchgate; The New Zealand medical journal (New Zeal Med J) 2015 [Internet] c2015 [cited]. Available from: https://www.researchgate.net/journal/0028-8446_The_New_Zealand_medical_journal. [Google Scholar]
- 25.Khajehnoori M, Stupart D, Watters D. Publication rate of General Surgery abstracts presented at the Royal Australasian College of Surgeons Annual Scientific Congress. ANZ J Surg. 2018;88:16–9. doi: 10.1111/ans.14103. [DOI] [PubMed] [Google Scholar]
- 26.Bennett C, Khangura S, Brehaut JC, Graham ID, Moher D, Potter BK, et al. Reporting guidelines for survey research: an analysis of published guidance and reporting practices. PLoS Med. 2010;8:e1001069. doi: 10.1371/journal.pmed.1001069. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Edwards PJ, Roberts I, Clarke MJ, Diguiseppi C, Wentz R, Kwan I, et al. Methods to increase response to postal and electronic questionnaires. Cochrane Database Syst Rev. 2009;(3):MR000008. doi: 10.1002/14651858.MR000008.pub4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Hing CB, Smith TO, Hooper L, Song F, Donell ST. A review of how to conduct a surgical survey using a questionnaire. Knee. 2011;18:209–13. doi: 10.1016/j.knee.2010.10.003. [DOI] [PubMed] [Google Scholar]
- 29.Alderman AK, Salem B. Survey research. Plast Reconstr Surg. 2010;126:1381–9. doi: 10.1097/PRS.0b013e3181ea44f9. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
List of survey topics general categories for CSSANZ surveys 2009–2017 (n=38)
List of survey topics as taken from ASCRS Textbook of Colon and Rectal Surgery [1]
Summary list of CSSANZ surveys from 2009 to 2017 that were published