Abstract
This debate paper asserts that implementation science needs to incorporate a key concept from entrepreneurship—market demand—and demonstrates how assessing an innovation’s potential market viability might advance the pace and success of innovation adoption and sustainment. We describe key concepts, language distinctions, and questions that entrepreneurs pose to implementation scientists—many of which implementation scientists appear ill-equipped to answer. The paper concludes with recommendations about how concepts from entrepreneurship, notably market viability assessment, can enhance the translation of research discoveries into real-world adoption, sustained use, and population health benefits. The paper further proposes activities that can advance implementation science’s capacity to draw from the field of entrepreneurship, along with the data foundations required to assess and cultivate market demand.
Keywords: Implementation science, Demand, Markets, Entrepreneurship, Adoption, Sustainment, Scalability
Contributions to the literature.
This article introduces and explains the relevance of market viability, a new concept in implementation science.
This article articulates similarities and differences between entrepreneurship and implementation science, and how these disciplines complement each other and advance their common goal of impact.
This article highlights specific concepts and methods from entrepreneurship that could strengthen implementation practice and implementation science.
This article responds to burgeoning calls to include assessments of outcomes such as cost within implementation science by highlighting market viability assessment as a candidate method.
Introduction
Too often, questions such as, “Who will adopt interventions? “Why and how much are they willing to pay?” and “What market forces are required to sustain an intervention?” are afterthoughts in the process of intervention development. Researchers often drive the implementation of new interventions after they have developed and tested those interventions through grant-supported research. Purveyor organizations [1] and quality improvement initiatives push for adoption, sustainment, and scale-up of proven interventions, often with too little attention to demand. Whether for innovation adoption or increased use of new and better evidence-based treatments, implementation has emphasized “push out” by intervention developers more than “pull” from intervention users. All implementation requires buy-in; someone must pay if any new discovery or improvement to care is to be adopted, sustained, and scaled. Innovations must be fitted to market realities, whether that market be commercial, health system, third party payment, or fee for service. Market forces are an underemphasized concept in implementation science, as are skills for assessing and cultivating market demand.
This debate article argues that implementation science needs to more fully leverage perspectives from entrepreneurship and particularly the concept of market viability. Implementation science and entrepreneurship share a common goal, the adoption, and scale-up of innovations. These two fields differ widely in many ways—ways that are explored in this manuscript, yet entrepreneurship perspectives can benefit implementation science, practice, and training.
Background
Implementation science
For more than a decade, the implementation science literature has reflected the importance of acceptability, feasibility, and cost as key implementation outcomes, bearing on the uptake of innovative practices [2–4]. Further, this literature has identified treatment providers, purveyors, administrators, and payers as key stakeholders to be engaged in implementation efforts [1, 4, 5]. With few exceptions [5], too little research has addressed demand and cost considerations in adoption decisions [6–8]. Kreuter and colleagues [9] argue that marketing and distribution efforts in health and public health are “unassigned, underemphasized, and/or underfunded.” Most cost analyses of implementation focus on intervention costs, are conducted retrospectively [10, 11], and thus do not capture the potential of up-front market analysis for facilitating implementation decisions.
In implementation science, the discoveries are typically policies, procedures, protocols, interventions, care delivery pathways (guidelines), team approaches, and checklists to ensure that proven discoveries are delivered in real-world care. Evidence of an innovation’s effectiveness is a precondition for implementation, toward which a variety of strategies such as training, infrastructure redesign, protocols and checklists, and data feedback are employed to increase its adoption, sustainment, and scale-up [11]. Yet, persistent quality gaps reflect the fact that evidence alone is insufficient for implementation.
Growing evidence points to the need for researchers to consider a quality improvement initiative or an innovation’s “implementability” while developing it, specifically anticipating its potential for adoption, sustainment, and scale-up [12–16]. Implementation science has responded by embracing stakeholder engagement, considering inner- and outer-setting contexts, and using hybrid trials and user-center designs—all components of “designing for dissemination” [17–19].
Yet implementation science’s traditional skill sets seem inadequate to overcome persistent and formidable sustainment challenges. Recent literature encourages implementation researchers to get outside the “research bubble” to partner with business, the corporate sector, and healthcare payers [12, 20]. Specifically, it cites a need for expanded competencies—for understanding the business perspective on healthcare and learning how to “apply an entrepreneurial approach to spread and scale” [12]. Spread, scale, and impact are thwarted without the ability to market innovations.
Entrepreneurship
The primary objectives of entrepreneurship are the creation, delivery, and extraction of the value of monetized products, services, or processes. Private capital has a key role in enabling the translation of basic science into financially sustainable and high social impact enterprises. According to the Angel Capital Association, in 2013, 298,000 angel investors invested $24.8 billion in about 71,000 early-stage startup companies, with pharma, biotech, and healthcare comprising 21% of angel investments in 2015 [21]. This role has become increasingly important with the past decade’s decline in the National Institutes of Health (NIH) funding [22].
Entrepreneurship involves the presence of lucrative opportunities and enterprising individuals [23]. The field can be defined as “the scholarly examination of how, by whom, and with what effects opportunities to create future goods and services are discovered, evaluated, and exploited” [24, 25]. Conceptualizing entrepreneurship as a method can help push its uses beyond technology commercialization and economic development and put it to work to build social innovations that make a positive difference in human health.
The key question entrepreneurs first ask is, “if we were to build this, would they buy?” (and if so, at what price and in what quantities?). To entrepreneurs, acceptability is understood as “willingness and ability to pay a certain price that enables a sustainable and scalable enterprise,” with market forces providing ultimate validation of innovation success [26]. Entrepreneurs recognize that to achieve long-term financial sustainability, the adequate value must be extracted (in the form of profits) to maintain the production and distribution of the innovation, and to enable the development of other related innovations. Entrepreneurs use such strategies as trialing, conducting market viability assessments, prototyping, estimating costs, and leveraging market pull forces. Entrepreneurship offers a heightened sense of urgency to deliver important solutions to the patient/marketplace. The objective is to translate a new “discovery /knowledge” to a final commercial product and to define discrete, value-generating milestones that serve as key decision points for garnering support (including financial) for subsequent steps. Prioritization of value is critical in an environment where the number of proposals for translational support greatly exceeds the available funding.
While commercialization may represent a small proportion of investments supporting health innovation, private sources of funding could be leveraged more. The National Institutes of Health’s Small Business Innovation Research (SBIR) and Small Business Technology Transfer (STTR) encourage partnerships between small businesses and non-profit research institutions, typically university-based health research programs [27]. A key objective is to translate promising technologies to the private sector and enable life-saving innovations to reach consumer markets. These “technologies” include digital health delivery platforms including patient data submitted to electronic health records via Apps or sensors, video-supported provider training programs, and patient-facing implementation strategies for behavior change. The SBIR and STTR programs invest over one billion dollars into health and life science companies that create innovative technologies aligned with NIH’s mission to improve health and save lives [27]. Implementation science seems well poised to leverage such programs, providing that it leverages demand and market forces, be they consumer, private, public, or commercial payers.
Implementation science and entrepreneurship
This debate paper reflects our team’s recognition that implementation science and entrepreneurship share a common goal: improving the translation and spread of new discoveries. Three propositions form the crux of this debate article, built upon foundational work in the field as cited throughout, and generating implications for the field of implementation science.
Proposition one: communication is challenging between implementation scientists and entrepreneurs
Each discipline has a distinct language. Unique terms are meaningful to those within a discipline but jargon typically serves as barriers to communication with those outside the discipline. The concepts of one discipline often seem foreign at best and off-putting or irrelevant at worst.
Communication between implementation science and entrepreneurship is a pre-requisite to learning and working together. In many NIH-supported Clinical and Translational Science Award programs—including that at Washington University—investigators come together across disciplines and stages of translational science in meetings and work groups. In one such event, our CTSA program employed an IDEABounce® meeting to explore the potential of pilot projects for uptake and rollout for broader application [28]. Two schools of medicine researchers who believed their work could benefit from feedback about commercial or tech support were invited to pitch, or “bounce an idea off,” a group of entrepreneurs—investors, members of start-up companies, or tech transfer groups. Researchers described the health-related problem, discovery or innovation, and opportunities for adoption and implementation. Each researcher had worked with the ICTS Dissemination and Implementation Research Core, expressing interest in how they could accelerate the uptake of the innovation and study its implementation. After the initial presentation, researchers and entrepreneurs gave feedback and asked questions of the researcher. A member of our team (a medical anthropologist) observed the meeting to observe the transdisciplinary interaction and to capture the terminology used by participants.
We observed several key communication challenges, reflected in vastly different terminology. When describing their innovations (interventions, protocols, training for new surgical techniques), the researchers emphasized the processes of development and testing, the evidence for effectiveness, service system contexts, details about research designs and analysis, potential implementation strategies, and expected outcomes. Entrepreneurs spoke about patents, scale, performance metrics organized by industry verticals, techniques for forecasting financial performance of start-ups, key benchmark performance data, start-ups, and risk/reward assessment analysis by hospital systems, digital tech companies, and insurers. The IdeaBounce meetings revealed that language differences pose a fundamental challenge to the scientific synergy between these two fields. As a result, our team asserts that implementation science could benefit from greater familiarity with the terminology around market forces, risk, reward, and return on investment analysis, and investment potential and pitch.
Proposition two: entrepreneurs are keenly focused on market forces
The IdeaBounce meetings further revealed differences in the information assumed to be necessary for innovation adoption and roll-out. As they listened to the “pitch” by the researchers, entrepreneurs posed questions about the market demand. They asked implementation researchers such questions as: How many people could benefit from your innovation? How great is the demand for the innovation? From whom? Who would be willing to pay for the innovation and why? What is the basis for assuming that an intervention can be profitable to potential investors? How will your innovation be sustained overtime?
For health implementation researchers, some of these questions are answered more easily than others. Most researchers can answer questions about the problem their innovation seeks to solve, the form and elements of the new treatment innovations they seek to advance, their roll-out plans, and the stakeholders and team members involved, given their consistency with the field’s foundational principles [29] and key elements of grant writing [30]. However, many of the questions about market demand, payment source options, actual costs to payers, thresholds for return on investment, and long-term sustainment plans proved extremely challenging for intervention developers and implementation researchers. Questions about who would pay, and how much they would pay, to support innovation adoption seem to stump most implementation researchers.
Some investment is typically needed for implementation. Accordingly, we argue that intervention and implementation researchers need to be better equipped for market viability assessment. Minimally, they need to be able to make data-based projections about demand and market for innovations, estimate their benefit, know who would or should pay, and forecast sustainment and scale-up challenges. If implementation researchers do not acquire these skills themselves, they need comfort and skills in partnering with entrepreneurs, payers, or investors who bring those skills.
To facilitate “designing for dissemination,” we propose a Market Viability Assessment Guide to help intervention developers, implementation researchers, and practice implementers anticipate an innovation’s adoption, sustainment, and spread. This guide draws on questions posed by entrepreneurs during the IdeaBounce and our team’s experience. Table 1 lists the questions in the guide.
Table 1.
Topic | Questions from an entrepreneurial perspective |
---|---|
Problem or condition |
What medical or public health or social problem does your innovation address? How many people are afflicted with problem? How great is the public health burden or health burden of the condition your innovation addresses? |
The innovation (new treatment, diagnostic procedure, protocol, device) |
How ready is your innovation for adoption in the real world? What is its readiness for adoption? How strong is the empirical evidence supporting its effectiveness? |
Innovation benefit |
How many people could benefit from your innovation? How soon would the benefit be realized? What is the reduction in adverse outcomes from your innovation? |
Adopters |
Who would use your innovation (who would put it into practice)? Who or what is the adopter group? (individual providers? Hospitals? Health systems? Patients? Communities? |
Market opportunity, size, and demand |
What indication do you have that your innovation is wanted? Who wants it? What is the scale and level of demand? |
Comparative advantage |
Do other solutions to this problem exist, and how does your innovation compare to other available solutions? What are the barriers or challenges to the adoption of your innovation? |
How viable is the innovation in the adopter market? |
Is the product you want to implement what the market is willing to pay for? How much will your innovation cost to develop, deliver, and market to users? (Cost) Who would pay, and why? (payer) |
Innovation sustainment |
What is the “invest-ability” threshold? (input/return) What is the internal rate of return (IRR) potential and potential % reduction in adverse outcomes attributable to your innovation? What will make the innovation sustainable over time? |
Marketing strategy |
Who is the initial target audience? How much market share can you capture? |
Proposition three: implementation researchers and entrepreneurs have different but potentially complementary priorities, values, and norms
In addition to differences in communication and priority questions, our observations suggest that implementation researchers and entrepreneurs have fundamental differences in priorities, values, and norms. One example is the emphasis on data and valuations of different data types. In implementation science, an innovation’s readiness for implementation is viewed as a primary function of the strength of evidence for its effectiveness [30–32]. Within a private enterprise, reliance on data varies. Institutional venture capital firms deploy data-driven metrics to assess new venture viability. However, the literature suggests that most early-stage start-ups assess viability subjectively based largely on experience and perceived market demand [33, 34].
Risk tolerance is another factor perceived differently. Entrepreneurs may couch risk in terms of willingness and ability to take a financial risk, while the healthcare system might focus more on preventing adverse outcomes. For angel-invested early-stage start-ups, failure rates of nearly 75% are common [35], contributing to greater comfort with failure—at least financial failure because the next venture’s success could cover financial loss. By contrast, health administrators and researchers may approach risk more warily due to financial constraints and the prevailing ethic of “do no harm” [13]. Most entrepreneurs and investors base their decisions on the assumption that potential reduction in adverse healthcare outcomes determines profitability and therefore, investability with adverse outcomes broadly defined as anything that costs the healthcare system money.
As shown in Table 2, implementation science and entrepreneurship valued different products, processes of development, and perceived return on investment. Such differences in norms and cultures likely affect the ease of collaboration. Researchers vary in their comfort with technology supports and business/entrepreneurial partnerships: many intervention developers and implementation researchers express distrust for working with potential investors from commercial enterprise: “I don’t’ want to share my idea with investors because I’m afraid they might steal my idea.” More fundamentally, business, cost, and market analysis have been viewed as irrelevant to implementation science—as somebody else’s concern.
Table 2.
Readiness | Implementation science | Entrepreneurship |
---|---|---|
Evidence | Market demand | |
Return on investment |
Quality of care Public health reach Health status |
Profitability Market share Market size (size of customer base) |
Process |
Sequential Incremental |
Iterative Big leaps: “think big, start small” Risk/reward profile |
Risk tolerance | Low | High |
Products |
Grants Publications |
Services Products |
Implications for implementation science
Research translation will be accelerated and strengthened when implementation science can benefit from entrepreneurship. Implementation science needs to leverage several key lessons from the entrepreneurial world [36, 37], particularly its emphasis on market demand and return. We propose several directions for leveraging these benefits for the field of implementation science.
Increase emphasis on adoption markets
Adoption is a widely used term and a key concept in implementation science, constituting a key goal of implementation processes and hence a key implementation outcome [4, 38]. Yet, implementation science evidences only sparse attention to adoption markets. Intervention developers and implementation researchers need to appreciate not only the importance of their discoveries but also the potential demand for them. Implementers need to know who the potential adopters are, who are the key decision makers in an adoption, how the adoption context affects receptivity to and demand for new interventions, and how they compare to available or potentially available alternatives. Innovations may be less acceptable in already crowded markets [39].
Increase ability to communicate with payers and how to communicate in market-relevant terms
The individuals and groups who make final decisions about adopting new interventions, particularly those making investment decisions for provider organizations, consider concepts that rarely appear in the implementation science literature, such as those reflected in Table 2 above. Adopters consider the return on investment, investment rates of return (IRR) potential and time to investment return, and reduction in adverse outcomes attributable to the intervention and its implementation. Implementation science training should incorporate fluency in these terms as well as an understanding of various risk calculations [13, 20].
Forge working relationships with entrepreneurs, investors, and innovators from corporate sectors to explore market viability
Implementation scientists frequently partner with other disciplines, such as communication and decision science, organizational psychology, systems engineering, medicine, psychology, anthropology, social work, and increasingly economics. Entrepreneurship experts can provide valuable feedback on the clarity of the idea, the persuasion of presenters’ messages, and the project’s potential for advancing health. To date, published literature reflects few examples of partnering with corporate investors or entrepreneurs. However, CTSAs across the country are forging such partnerships and offering new courses and training programs in entrepreneurship, and the National Cancer Institute has launched the SPRINT program to harness business principles to accelerate research translation [10, 15, 16, 40](https://www.uab.edu/ccts/training-academy/trainings/innovation-and-entrepreneurship/i-corps). Our team’s experience confirms the benefits of such initiatives [13]. IdeaBounce events such as we convened can be particularly helpful to investigators with projects in the early stages of development, better equipping them to “design for dissemination” [17, 41]. Convening “jargon translation clinics” can enhance the ability of intervention developers and implementation researchers to communicate the comparative advantage of new discoveries and clarify terminology that may be familiar to investors and payers. Entrepreneurs can help assess market, demand, and potential commercialization of discoveries, and early assessment of feasibility and market viability may accelerate adoption and sustained implementation.
Prioritize development of data to support market analysis for health innovations and advance cost assessment methods
Market viability requires knowledge of implementation costs as well as the range of payers. Competitive insurance markets, formularies, and a mix of fee-for-service and bundled payment schemes make intervention costs difficult if not impossible to determine. Psychosocial interventions are particularly hard to cost, as are implementation strategies required for adoption, sustainment, and scale-up. Implementation scientists need to be able to identify, if not to calculate, costs associated with developing an innovation, along with costs and savings to healthcare systems from using an innovation. Presently, the data needed are under-developed, imprecise, incomplete, and often obscured or hidden within insurance costs and preferred provider markets [42, 43]. Although cost concerns are associated with stakeholder reluctance to implement evidence-based interventions, and often are the most significant barrier to their implementation [44, 45], implementation science training has not sufficiently emphasized skills for costing or market analysis. Guidance on methods to cost implementation initiatives are a growing and welcome addition to the literature [2, 46, 47], particularly those that include long-term benefit [42] and include downstream costs that are highly relevant to decision makers [48].
Entrepreneurship relies on key performance metrics, based on historical data generated by prior new ventures. However, such data for health is extremely fragmented and has not yet been accumulated, curated, and organized in a national database. Having access to historical key performance metrics collected from other similar innovation rollouts would be extremely helpful to stakeholders in quantifying risk/reward profile assessments of innovations. For example, a hospital’s data on “time required to train in new procedures” can inform their assessment of the value in investing in new technologies, based on the “time to investment return.”
Feasibility analysis clinics
Implementation research cores, training programs, and labs can convene “clinics” or workshops to bring entrepreneurs and researchers together. Insurance officials, healthcare chief financial officers, and experts in social and commercial entrepreneurship can help intervention developers and implementation researchers identify business-driven tools for evaluating the need and assessing demand in real-world healthcare. Their expertise can help dissemination and implementation researchers develop skills for assessing feasibility and market viability [49] and creating “business plans” for adoption, scale-up, and sustainment for improvements to care.
Expand research toolkits by including resources from each field—implementation science and entrepreneurship—and provide investigators opportunities to use them
Within each field—entrepreneurship and implementation science—a growing number of toolkits provide resources to support research and commercial rollout [50]. Existing toolkits should be made available across disciplinary boundaries. Moreover, toolkits should be developed that provide market viability assessment tools for the implementation science field.
Activities such as these can help accelerate the translation of research findings by equipping the research workforce with core competencies not only in their own disciplines but in complementary areas—in this case, implementation science and entrepreneurship, and also to effectively communicate and collaborate as members of multidisciplinary teams.
Summary
Implementation science and entrepreneurship share the goal of moving discoveries from the lab to the bedside. Yet, in most university settings, their paths barely cross. We need to better understand the ways implementation science can benefit from entrepreneurial conceptualizations and tools, including those for marketing and design. A primary lesson from entrepreneurship is the importance of understanding and effectively leveraging market forces for implementation. Push-out is important but insufficient for implementation success. Cultivating demand is also important, as leveraging market forces can facilitate adoption and sustainment. Entrepreneurship can provide a network of expertise outside the academic community to bring in diverse, expert, and critical feedback to evaluate the feasibility of proposals and aid in the design of viable projects, consistent with implementation science’s high value on stakeholder engagement. A 2014 Implementation Science editorial stated, “The question is how economic evaluation can most efficiently be incorporated into implementation decisions, not whether it should” [8]. We extend this position by stating, “The question is how market analysis can best inform and facilitate implementation processes, not whether it should.”
Acknowledgements
The authors acknowledge members of the Washington University Dissemination and Implementation Research (WUNDIR) group and Dr. Ana Baumann for being helpful in the early stages of this work.
Abbreviations
- CTSA
Clinical and Translational Science Awards Program
- ICTS
The Washington University in St. Louis Institute for Clinical and Translational Science (ICTS)
- ISE
Implementation Science-Entrepreneurship Unit
- NIH
National Institutes of Health
Authors’ contributions
EP, ET, and BE led the conception and design of the Implementation Science-Entrepreneur Unit at Washington University’s ICTS; EP, ET, and VMcK conceived and led the IdeaBounce group; VMcK and CH observed and took notes during the IdeaBounce meetings; RT and CH helped develop and ask questions of implementation researchers; all authors helped conceptualize and write iterations of the paper, and read/reviewed the final manuscript; CH wrote the added contributions to implementation science. The author(s) read and approved the final manuscript.
Funding
Dr. Proctor’s effort was supported by the Implementation Science-Entrepreneurship Unit of the Washington University Institute of Clinical and Translational Sciences grant UL1TR002345 from the National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH) and the National Institute of Mental Health grant R25 MH080916; P50CA244431.
Mr. Toker’s effort was supported by the Implementation Science-Entrepreneurship Unit of the Washington University Institute of Clinical and Translational Sciences grant from the National Center for Advancing Translational Sciences grant (NCATS) of the National Institutes of Health (NIH) UL1 TR000448 and the National Institute of General Medical Sciences grant R25 GM116727-01A1.
Dr. Tabak’s effort was supported by the Washington University in St. Louis CDTR (Grant Number P30DK092950 from the NIDDK) and by the Washington University Institute of Clinical and Translational Sciences grant UL1TR002345 from the National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH).
Dr. McKay’s effort was supported by the Washington University Institute of Clinical and Translational Sciences grant UL1TR002345 (VRM, BE, EKP) from the National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH).
Dr. Hooley’s effort was supported by the Washington University Institute of Clinical and Translational Sciences grant UL1TR002345 (VRM, BE, EKP) from the National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH) and an Institutional National Research Service T32 grant MH019960 from the National Institute of Mental Health (NIMH).
Dr. Evanoff’s effort was supported by the Washington University Institute of Clinical and Translational Sciences grant UL1TR002345 (VRM, BE, EKP) from the National Center for Advancing Translational Sciences (NCATS) of the National Institutes of Health (NIH).
Availability of data and materials
Notes from our team’s work in the Implementation Science-Entrepreneurship Unit, specifically IdeaBounce meetings and implementation researchers’ responses to questions posed by entrepreneurs, are available from the corresponding author upon request.
Declarations
Ethics approval and consent to participate
Participants in the IdeaBounce group provided consent to participate; procedures were approved by the Washington University in St. Louis Institutional Review Board.
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Footnotes
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Proctor EK, Hooley C, Morse A, McCrary S, Kim H, Kohl PL. Intermediary/purveyor organizations for evidence-based interventions in the US child mental health: characteristics and implementation strategies. Implementation Sci. 2019;14(3). 10.1186/s13012-018-0845-3. [DOI] [PMC free article] [PubMed]
- 2.Cidav Z, Mandell D, Pyne J, Beidas R, Curran G, Marcus S. A pragmatic method for costing implementation strategies using time-driven activity-based costing. Implement Sci. 2020;15:28. doi: 10.1186/s13012-020-00993-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Robert G, Harlock J, Williams I. Disentangling rhetoric and reality: an international Delphi study of factors and processes that facilitate the successful implementation of decisions to decommission healthcare services. Implementation Sci. 2014;9:123. doi: 10.1186/s13012-014-0123-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Proctor EK, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. 2011;38(2):65–76. doi: 10.1007/s10488-010-0319-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Quanbeck AR, Madden L, Edmundson E, Ford JH, McConnell KJ, McCarty D, et al. A business case for quality improvement in addiction treatment: evidence from the NIATx collaborative. J Behav Health Serv Res. 2012;39(1):91–100. doi: 10.1007/s11414-011-9259-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Dopp AR, Mundey P, Beasley LO, Silovsky JF, Eisenberg D. Mixed-method approaches to strengthen economic evaluations in implementation research. Implementation Sci. 2019;14(2). 10.1186/s13012-018-0850-6. [DOI] [PMC free article] [PubMed]
- 7.Raghavan R. The role of economic evaluation in dissemination and implementation research. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health: translating science to practice. New York: Oxford University Press; 2018. pp. 89–106. [Google Scholar]
- 8.Hoomans T, Severens JL. Economic evaluation of implementation strategies in health care. Implementation Sci. 2014;9:168. doi: 10.1186/s13012-014-0168-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Steensma JR, Kreuter MW, Casey CM, Bernhardt JM. Enhancing dissemination through marketing and distribution systems: a vision for public health. In: Brownson RC, Colditz GA, Proctor EK, editors. Dissemination and implementation research in health (Second Edition). Oxford; 2018. p. 191–200.
- 10.Sohn H, Tucker A, Ferguson O, Gomes I, Dowdy D. Costing the implementation of public health interventions in resource-limited settings: a conceptual framework. Implementation Sci. 2020;15:86. doi: 10.1186/s13012-020-01047-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Rabarison KM, Bish CL, Massoudi MS, Giles WH. Economic evaluation enhances public health decision making. Front Public Health. 2015;3(164). [DOI] [PMC free article] [PubMed]
- 12.Laur C, Corrado AM, Grimshaw JM, Ivers N. Trialists perspectives on sustaining, spreading, and scaling-up of quality improvement interventions. Implement Sci Commun. 2021;2:35. doi: 10.1186/s43058-021-00137-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Proctor EK, McKay VR, Toker E, et al. Partnered innovation to implement timely and personalized care: a case study. J Clin Transl Sci. 2021;5(1):e121. doi: 10.1017/cts.2021.778. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Nearing K, Rainwater J, Morrato EH, Neves S, Bhatti P, Hafer N, Rajguru S, Conway B, Harter K, Wasko M. I-Corps@NCATS: a novel designing-for-dissemination learning laboratory for clinical and translational researchers to increase intervention relevance and speed dissemination. Arlington: Oral presentation in the Novel Approaches in D&I Training Session at the 12th Annual Conference on the Science of Dissemination and Implementation in Health; 2019. [Google Scholar]
- 15.Nearing K, Rainwater J, Neves S, et al. I-Corps@NCATS trains clinical and translational science teams to accelerate translation of research innovations into practice. J Clin Transl Sci. 2021;5(1):e66. doi: 10.1017/cts.2020.561. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Chambers DA. Sharpening our focus on designing for dissemination: lessons from the SPRINT program and potential next steps for the field. Transl Behav Med. 2020;10(6):1416–1418. doi: 10.1093/tbm/ibz102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Brownson RC, Jacobs JA, Tabak RG, Hoehner CM, Stamatakis KA. Designing for dissemination among public health researchers: findings from a national survey in the United States. Am J Public Health. 2013;103(9):1693–1699. doi: 10.2105/AJPH.2012.301165. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–226. doi: 10.1097/MLR.0b013e3182408812. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Dopp AR, Parisi KE, Munson SA, Lyon AR. Aligning implementation and user-centered design strategies to enhance the impact of health services: results from a concept mapping study. Implement Sci Commun. 2020;1:17. doi: 10.1186/s43058-020-00020-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Ramsey AT, Proctor EK, Chambers DA, Garbutt JM, Malone S, Powderly WG, Bierut LJ. Designing for accelerated translation (DART) of emerging innovations in health. J Clin Transl Res. 2019;3:53–58. doi: 10.1017/cts.2019.386. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Angel Capital Association: Predictive Analytics Startups. https://angel.co/predictive-analytics. Accessed 9 Mar 2021.
- 22.Boadi K. Erosion of funding for the National Institutes of Health threatens U.S. leadership in biomedical research. 2014. [Google Scholar]
- 23.Venkataraman S. The distinctive domain of entrepreneurship research. In: Katz JA, Corbett AC, editors. Seminal ideas for the next twenty-five years of advances, volume 21. Emerald Publishing Limited. 2019. pp. 5–20. [Google Scholar]
- 24.Sarasvathy SD, Venkataraman S. Entrepreneurship as method: open questions for an entrepreneurial future. Entrepp Theory Pract. 2011;35(1):113–135. doi: 10.1111/j.1540-6520.2010.00425.x. [DOI] [Google Scholar]
- 25.Shane S, Venkataraman S. The promise of entrepreneurship as a field of research. Acad Manage Rev. 2000;25(1):217–226. [Google Scholar]
- 26.Thorp H, Goldstein B. Engines of innovation: the entrepreneurial university in the twenty-first century. Chapel Hill: The University of North Carolina Press; 2010. [Google Scholar]
- 27.NIH Small Business Innovation Research/Small Business Technology Transfer. 2020. https://sbir.nih.gov/. Accessed 27 Apr 2021.
- 28.IdeaBounce. Welcome to IdeaBounce. 2020. https://www.ideabounce.com/#/howworks. Accessed 9 Mar 2021.
- 29.Rogers EM. Diffusion of innovations. 4. The Free Press; 1995. [Google Scholar]
- 30.Proctor EK, Powell BJ, Baumann AA, Hamilton AM, Santens RL. Writing implementation research grant proposals: ten key ingredients. Implementation Sci. 2012;7(96). 10.1186/1748-5908-7-96. [DOI] [PMC free article] [PubMed]
- 31.Florez ID, Brouwers MC, Kerkvliet K, et al. Assessment of the quality of recommendations from 161 clinical practice guidelines using the Appraisal of Guidelines for Research and Evaluation–Recommendations Excellence (AGREE-REX) instrument shows there is room for improvement. Implement Sci. 2020;15(1):1–8. doi: 10.1186/S13012-020-01036-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Ashcraft LE, Quinn DA, Brownson RC. Strategies for effective dissemination of research to United States policymakers: a systematic review. Implement Sci. 2020;15(1):89. doi: 10.1186/s13012-020-01046-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Blume B, Covin J. Attributions to intuition in the venture founding process: do entrepreneurs actually use intuition or just say that they do? J Bus Ventur. 2011;26:137–151. doi: 10.1016/j.jbusvent.2009.04.002. [DOI] [Google Scholar]
- 34.Scott EL, Shu P, Lubynsky RM. Entrepreneurial uncertainty and expert evaluation: an empirical analysis. Manage Science. 2019;66(3):1278–1299. doi: 10.1287/mnsc.2018.3244. [DOI] [Google Scholar]
- 35.Aminova M, March E. The role of innovation on start-up failure vs. its success. Int J Gov Bus Ethics. 2021. 10.51325/ijbeg.v4i1.60.
- 36.Lee N, Kotler P. Social marketing : influencing behaviors for good. 4th ed. SAGE Publications. 2011. [Google Scholar]
- 37.Fogarty DJ. Lean six sigma and big data: continuing to innovate and optimize business processes. J Manage Innov. 2015;1.
- 38.Shortell SM, Blodgett JC, Rundall TG, Mosher Henke R, Reponen E. Lean management and hospital performance: adoption vs. implementation. JT Comm J Qual Saf. 2021. 10.1016/j.jcjq.2021.01.010. [DOI] [PubMed]
- 39.Ponsford R, Ford J, Korjonen H, Hughes E, Keswani A, Pliakas T, et al. Competing for space in an already crowded market: a mixed methods study of why an online community of practice (CoP) for alcohol harm reduction failed to generate interest amongst the group of public health professionals at which it was aimed. Implementation Sci. 2017. 10.1186/s13012-017-0622-8. [DOI] [PMC free article] [PubMed]
- 40.Gaysynsky A, Vinson CA, Oh A. Development and evaluation of the SPeeding Research-tested INTerventions (SPRINT) training program. Transl Behav Med. 2020;10(6):1406–1415. doi: 10.1093/tbm/ibz099. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Tabak RG, Padek M, Kerner J, Stange KC, Proctor EK, Dobbins M, et al. Training needs for dissemination and implementation science: insights from practitioners and researchers. Under review. . [DOI] [PMC free article] [PubMed]
- 42.Wagner TH. Rethinking how we measure costs in implementation research. J Gen Intern Med. 2020;35:870–874. doi: 10.1007/s11606-020-06104-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Tamblyn R, Winslade N, Qian CJ, Moraga T, Huang A. What is in your wallet? A cluster randomized trial of the effects of showing comparative patient out-of-pocket costs on primary care prescribing for uncomplicated hypertension. Implementation Sci. 2018. 10.1186/s13012-017-0701. [DOI] [PMC free article] [PubMed]
- 44.Aarons GA, Wells RS, Zagursky K, Fettes DL, Palinkas LA. Implementing evidence-based practice in community mental health agencies: a multiple stakeholder analysis. Am J Public Health. 2009;99:2087–2095. doi: 10.2105/AJPH.2009.161711. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Hoeft TJ, Wilcox H, Hinton L, Unützer J. Costs of implementing and sustaining enhanced collaborative care programs involving community partners. Implementation Sci. 2019. 10.1186/s13012-019-0882-6. [DOI] [PMC free article] [PubMed]
- 46.Ament SM, de Kok M, van de Velde CJ, Roukema JA, Bell TVRJ, van der Ent FW, et al. A detailed report of the resource use and costs associated with implementation of a short stay programme for breast cancer surgery. Implementation Sci. 2015. 10.1186/s13012-015-0270-9. [DOI] [PMC free article] [PubMed]
- 47.Saldana L, Chambers P, Bradford WD, Campbell M, Landsverk J. The cost of implementing new strategies (COINS): a method for mapping implementation resources using the stages of implementation completion. Child Youth Serv Rev. 2014;39:177–182. doi: 10.1016/j.childyouth.2013.10.006. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Niyibizi N, McIntosh S, Hudson B, Sipocz A, Paku E, Dykes C. CTSA recruitment resources: an inventory of what CTSA hubs are currently offering. Journal of Clinical and Translational Science. 2020;4(6):529–536. doi: 10.1017/cts.2020.44. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Baumann AA, Morshed AB, Tabak RG, Proctor EK. Toolkits for dissemination and implementation research: preliminary development. Journal of Clinical and Translational Science. 2018;2:239–244. doi: 10.1017/cts.2018.316. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Dopp AR, Saranga Coen A, Smith AB, Reno J, Bernstein DH, Kerns SEU, et al. Economic impact of the statewide implementation of an evidence-based treatment: multisystemic therapy in New Mexico. Behav Ther. 2018;49:551–66. [DOI] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
Notes from our team’s work in the Implementation Science-Entrepreneurship Unit, specifically IdeaBounce meetings and implementation researchers’ responses to questions posed by entrepreneurs, are available from the corresponding author upon request.