Abstract
With rapid advances in genetics and genomics, the commercialization and access to new applications has become more widespread and omnipresent throughout biomedical research. Thus, increasingly more patients will have personal genomic information they may share with primary care providers (PCPs) to better understand the clinical significance of the data. To be able to respond to patient inquiries about genomic data, variant interpretation, disease risk and other issues, PCPs will need to be able to increase or refresh their awareness about genetics and genomics, and identify reliable resources to use or refer patients. While provider educational efforts have increased, with the rapid advances in the field, ongoing efforts will be needed to prepare PCPs to manage patient needs, integrate results into care, and refer as indicated.
1. Introduction
The scope and accessibility to genetic information is changing rapidly in response to advances in genome sciences and medicine. While not all clinical genomic applications have yet to demonstrate the desired evidence basis of clinical utility and cost-effectiveness [1], many of these tests are increasingly being used in various clinical settings. Furthermore, patients may obtain their genetic information through direct-to-consumer (DTC) testing companies or through participation in a research study. It has been recognized that the successful implementation of genetics and genomics in healthcare will require the participation of non-geneticist specialists [2]. Indeed, primary care providers (PCP) will play a central role in helping patients understand genomic information as PCPs will likely be the first point of contact for patients wanting to understand more about the clinical significance of genomic information [3–6]. Thus, even though they may not have ordered the test, PCPs will need to be prepared to respond to patient inquiries, review test results, direct them to accurate and reliable resources, or refer to specialists as warranted. For more than a few decades, papers have repeatedly reported the lack of provider knowledge of genetics and related clinical applications, even within their area of practice [7–9, 4]. Strategies to raise PCPs’ awareness will depend on continuing education, development of resources for providers and patients, and potentially more resources regarding clinical interpretation and evidence basis of genomic test results [10]. Incorporating PCPs’ views and extending from their knowledge base will be essential to successfully increasing awareness and competencies around genetics and genomics [11–13]. This paper will consider current and potential approaches to guiding PCPs to navigate this likely novel and unfamiliar terrain.
2. Rise of Genetics & Genomics
Since the completion of the first sequenced genomes in 2001 [14, 15], there has been a massive movement to understand the genetic etiology or role of genes in health and disease. The availability of a reference genome sequence and development of new technologies and analytical techniques has enabled more rapid and cheaper detection of genetic variants associated with various phenotypes. Known as genome-wide association studies (GWAS), genetic variants have been associated with hundreds of phenotypes [16, 17]. In addition, other types of technologies have enabled targeted analysis of genetic variants (e.g., microarrays), as well as assessment of gene expression, proteins, or metabolites, or the microbial composition of various tissues (known as the microbiome). Each layer of data can provide a more comprehensive understanding of the impact of DNA variation and environmental factors to inform development of screening and diagnostic tests and interventions [18, 19].
In the midst of this massive data generation period, the ability to identify genetic variants and associate them with various phenotypes has outpaced the understanding of the clinical significance and utility of the information. Furthermore, testing capabilities have also outpaced scientific understanding of the broader psychosocial implications of the information. As a result, while many clinical genetic and genomic tests are commercially available today, there is uncertainty for both patients and providers about how to evaluate some of the data and what actions, if any, should be taken based upon the data and how to minimize harms.
In the early 2000’s, the rise of DTC testing enabled consumers to purchase genetic tests through a website without health provider authorization as is typically required of clinical tests [20]. These online companies were the subject of much debate and scrutiny from scientists, clinicians, and federal agencies alike regarding the quality of their products and potentially misleading claims, and possible harms to consumers [21]. In 2010, the US Food and Drug Administration (FDA) halted the sale of DTC tests, requiring companies to first obtain clearance or approval from the agency [22]. Despite concerns, most consumers perceive value from testing and have not experienced any or minimal harms [23, 24]. In 2017, the company 23andMe gained FDA approval and re-initiated sale of a limited set of tests. In 2018, 23andMe gained additional approvals for the sale of limited breast and ovarian risk testing and pharmacogenetic testing. Some consumers who order DTC testing may opt to share the results with health providers to gain a better understanding of the implications for future disease risks and opportunities for screening or intervention [25]. While some encounters with health providers about DTC results have been reported as satisfying [25], providers have expressed concern about their knowledge to interpret genomic results, the actionability of results and potential harms to patients [26, 27]. Some companies will also make available the raw data in addition to a test report, or alternatively, sequence the DNA and provide only the raw data, leaving the consumer to identify another company to analyse and interpret the raw data [28, 29]. Again, in this instance, consumers may share the data or report with a general health provider [30, 31] or genetic specialist if accessible [32].
Furthermore, sequencing technologies are increasingly used in biomedical research studies. With the need to enroll many participants to have sufficient power to ascertain a significantly associated variant with a given genotype, many individuals are being enrolled and sequenced. In some studies, researchers may provide either raw, summary (aggregate), or individual results [33].
3. Evaluating Genetic & Genomic Tests
When evaluating a test, determining whether a test is a ‘good’ test may be difficult, depending on what parameters of the test are assessed and whether information is available through the testing laboratory or publications to even enable assessment. Several different groups have developed matrices to evaluate genetic tests [34]. With increasing scrutiny about the quality of genetic tests, in the early 2000’s, the US Centers for Disease Control and Prevention (CDC) supported the development of a framework to evaluate genetic tests based on analytical validity, clinical validity, clinical utility and ethical, legal and social issues framework, otherwise known as ACCE [35]. These test features and definitions are described in detail by Teutsch et al [36]. This framework has been used for a variety of genetic tests and by various groups [37].
While many laboratories may offer similar or identical tests, providers should not consider the performance of these tests to be equivalent. It is important to understand the limitations of different testing platforms when comparing tests offered by different laboratories for similar indications. For example, labs may choose to use next-generation sequencing (targeted, whole exome, whole genome), microarrays (limited to analysis of known genetic variations), or another methodology (or more than one). Several reports have compared the outcomes of one or more genetic tests with similar indications, often comparing tests with different platforms [38, 39] or use of different types of specimens [40]. If a limited set of variants are analysed in a test, providers should also consider the prevalence of those variants in different populations to insure the test is appropriate for individuals of different racial/ethnic backgrounds given differences in allele prevalence between populations. The prevalence of the genetic variant impacts the predictive value of the test. As clinical studies tend to predominantly enroll individuals of European descent [41], the value of the test may be limited for individuals of other backgrounds.
Furthermore, given the rapid changes in knowledge about the clinical significance of genetic variants, laboratories may interpret the same finding differently. Genetic variants are classified into one of five categories: pathogenic, likely pathogenic, uncertain significance, likely benign, and benign [42]. The category of ‘uncertain significance’ is often referred to as a ‘variant of uncertain significance’ or VUS or VOUS. Several papers have demonstrated discordance in the variant interpretation between labs [43–48]. The recommended evidence basis for determining variant pathogenicity still allows for some subjective conclusions and information about rare variants remains limited [49, 50]. Some laboratories may draw upon in-house data collected from years of testing that is not available to other labs, drawing calls for greater sharing and curation of genetic variant data [51]. Test reports are only likely to include pathogenic and likely pathogenic variants, and other variants detected may not be mentioned. As described in the subsequent section (Resources), there are several public genetic databases that provide information/evidence about the clinical significance of a given variant. Re-analysis of variant interpretation is offered by some laboratories due to the rapidly changing evidence basis, which may result in a re-classification of pathogenicity.
In addition to considering the test characteristics, the ethical, legal and social implications should be considered and discussed with the patient. Many issues have given pause regarding the appropriate use of testing (e.g., children vs. adults), the balance of benefits and harms, inaccurate results, psychological implications, familial implications, genetic discrimination and clinical actionability [52–57]. Given the range of issues, PCPs are unlikely to have the time and knowledge to help patients make an informed decision about testing and to comprehend the results and implications if testing is sought. Referral to a genetic specialist such as a genetic counselor can raise awareness of the myriad issues [58], but access to genetic counselors may be limited [59].
For patients that opt to obtain testing through a DTC company or other means and share the results with their PCP, PCPs should consider the above mentioned issues when reviewing the test report. If the test has already been ordered and there is uncertainty about the validity of the results, one initial fact that should be confirmed is whether the laboratory is accredited. All clinical laboratories are required to comply with the Clinical Laboratory Improvements Act (CLIA) and gain accreditation through the state or an approved accrediting organization. If they are CLIA-certified, an annual record of suspensions or other sanctions noted on biannual inspections is publicly available. In instances that patients share results obtained through research studies, the clinical validity of the testing may be lacking, and therefore, it may be appropriate for the PCP to recommend or refer for clinical confirmation in a CLIA-certified laboratory.
4. Education
In the past few decades, many different approaches to educate non-geneticist providers have been developed and evaluated [60–63]. While medical school curricula include basic science lectures on cell and molecular biology, genetics, and some applications such as prenatal screening, diagnosis of inherited disorders, cancer susceptibility and precision medicine, the material is not likely consistent and the depth may vary [64, 65]. Various approaches to incorporating genetics and genomics into curricula and residency programs [66–69] have been developed including genomic autopsies or genomic analysis to determine a cause of death [70, 71], continuing education [72], and personal sequencing [73]. To inform development of curricula and training, several groups have develop genetics and genomics competencies [74–76].
But providers will need to update their knowledge continuously given the rapid developments in the field [60]. Similar to formal training, various approaches have been developed for continuing education including web-based interactive modules [77, 78, 72, 79, 80], and personal sequencing [81, 82, 73, 83]. While some interactive educational intervention efforts have been shown to increase PCP knowledge, translation into behaviour changes may be more difficult to achieve [77, 84, 85]. In addition, several massive open online courses (MOOCs) are available on personalized or precision medicine, genetics and genomics, which can provide a good refresher on new tests. To guide content of educational programs, several core competencies in genetics for non-geneticist providers and milestone templates have been developed [86–88]. At the point of care, efforts have focused on developing clinical decision support (CDS) to raise provider awareness about availability of testing, clinical guidelines, or recommended action items based on a patient’s test result [89, 90]. Accessibility of such supports may be limited in community practice settings depending on their electronic medical record vendor.
While there are several resources to gain a better understanding of a disease and evidence basis for a particular genetic variant, education about the ethical, legal, and social issues (ELSI) is also critical [91]. More comprehensive resources for ELSI and skills-based learning opportunities such as patient communication about genetics are needed. For example, use of the term ‘variation’ and descriptors of ‘pathogenic’ or ‘benign’ is recommended in place of ‘mutation’, but general practitioners may not be aware about the change [42]. The absence of a detection of a pathogenic variant on a test report does not necessarily absolve a patient’s risk for a given disease, and providers should be able to explain some of the principles of genetics, multi-factorial diseases, and risk.
5. Resources
While there are some resources available about genetics, genomics, and variant interpretation and guidelines, sometimes they are not easy to find or identify [92]. For example, there are numerous genetic variation databases available to help decipher the clinical significance of a genetic variant or obtain information about a genetic condition [93, 94], but there is no single primary or comprehensive resource (Table 1). ClinVar is a public database of genetic variations and evidence of clinical pathogenicity operated by the US National Institutes of Health (NIH) [95, 96]. New variants and evidence of clinical pathogenicity are submitted by registered laboratories and researchers. Users can look up a specific phenotype, gene, or variant. A related NIH database, Clinical Genome Resource (ClinGen), provides comprehensive gene-disease information along with multiple curation interfaces, for example, on clinical pathogenicity and actionability [97]. Several disease-specific working groups review data and evidence in their respective areas for both ClinGen and ClinVar [98–101]. Some limitations should be noted about genetic and genomic databases -- not all of them may be very user-friendly for the general practitioner in search of gathering more information about a particular genetic variant. Some of these databases are broad (non-disease specific) or limited to a group of diseases (cancer) or genome (e.g., mitochondrial) [102, 103]; the source of the data deposited may vary as well as the quality of data [104]. Analysis of genetic variants in databases for the same disease have shown some disparities [105], and thus, it may be necessary to review multiple databases to gain a comprehensive assessment of the mutational spectrum.
Table 1.
Provider and patient resources for genetic diseases and genetic variant interpretation.
Resource (URL) | Description |
---|---|
ClinVar (https://www.ncbi.nlm.nih.gov/clinvar/) | Maintained by the NIH/National Center for Biotechnology Information, this site has information about genomic variation and disease; can search by disease name, gene name or specific genetic variants; many clinical domain expert working groups responsible for data curation |
ClinGen (https://www.clinicalgenome.org/) | A National Institutes of Health (NIH)-funded resource about the clinical relevance of genes and variants |
Genetic Home Reference (https://ghr.nlm.nih.gov/) | A very patient-friendly National Institutes of Health/National Library of Medicine website with lots of general descriptions of genetic terms and principles as well as disease-specific descriptions; many links to other NIH websites provided. |
NIH Genetic Testing Registry (https://www.ncbi.nlm.nih.gov/gtr/) | Another National Institutes of Health/National Library of Medicine searchable database of genetic testing laboratories; listings are based on submissions (no verification) |
Online Mendelian Inheritance in Man (https://www.omim.org/) | An online, curated catalog of inherited diseases; a rich resource that is well-linked to other resources |
Gene Reviews (https://www.ncbi.nlm.nih.gov/books/NBK1116/) | A comprehensive e-book of >700 chapters of clinically relevant and medically actionable information for inherited conditions authored by experts; chapters are regularly updated every 2-4 years |
DiseaseInfoSearch (https://www.diseaseinfosearch.org/) | Provides quality information for 10,000 diseases, including support groups, resources, clinical trials, articles, and more; initially was a feature of the Genetic Alliance website (2005) to enable broader sharing of disease support group information; in 2013, it became a standalone websites with more extensive information |
Gene-Equip (Genetics Education for Primary Care) (www.primarycaregenetics.org) | Co-funded by the EU and Erasmus+ the content of this site is Developed/contributed by a team of clinical geneticists, genetic counselors, and educators from six EU countries. The multi-lingual site provides continuing medical or professional education in genetics in online learning modules and webinars, practical tools, and patient stories. |
Genetics Education Canada-Knowledge Organization (https://geneticseducation.ca/) | A not-for-profit organization supported with funding from two Canadian hospitals, this site includes several provider, patient resources and specific materials for hereditary breast/ovarian cancer, epilepsy, and prenatal and carrier testing. |
Genetics/Genomic Competency Center (g-2-c-2.org) | Funded and maintained by the US National Human Genome Research Institute, this site provides educational resources for group instruction or self-directed learning in genetics/genomics by health care educators and practitioners. It also includes curriculum competencies for various types of health providers. |
The Jackson Laboratory - Clinical and Continuing Education (https://www.jax.org/education-and-learning/clinical-and-continuing-education) | This site includes a range of online courses in personalized medicine and clinical genomics as well as resources for various conditions and factsheets. |
While PCPs can always search the biomedical literature through PubMed or Google Scholar, there are some databases with curated publications focused specifically on genetics and genomics, saving learners valuable time in identifying relevant publications. For example, the Public Health Genomics Knowledge Base [106], maintained by the CDC, is an extensive database of publications that are easily searchable [107]. More recently, publications related to disorders of the heart, lung, blood, and sleep (HLBS) and population genomics can be found in the HLBS-PopOmics database [108, 109]. Several reviews have been published on various types of technologies like next-generation sequencing [38, 110], interpretation of genetic variants [111], or current clinical applications in specific disciplines [112].
The laboratory report can also be a good resource. Depending on the laboratory and the type of test, some of these reports are quite lengthy, including more descriptive information about variants and clinical recommendations than typical of a standard clinical report and references [113, 114]. Given some of the complexity of the test results and clinical pathogenicity, some groups are re-evaluated the test format of molecular reports [115]. Standardized formatting of test reports can facilitate integration into EHRs and enable inclusion of additional informational resources (e.g., Infobuttons) [116]
6. Conclusion
Precision medicine will be integrated into many clinical practice settings, including primary care. In addition to ordering tests for their own patients, PCPs are likely to be consulted about results obtained from tests ordered by other providers or patients themselves, or even raw data obtained from an online testing laboratory or research study. Thus, PCPs will need to become adequately knowledgeable to either respond to patient inquires, consult resources to gain further understanding about a particular phenotype or genotype, and/or if needed, recognize when and to whom to refer patients for follow-up care. Several educational efforts and resources have been developed to raise provider awareness and knowledge about genetic and genomics and specific applications. However, with the complexity of variant interpretation, more widespread genomic testing, the rapidly changing evidence basis, and commercialization of new tests, provider learning will be ongoing for the foreseeable future in this field.
Key Points.
Primary care providers will increasingly face clinical situations warranting consideration of genetic testing or integration of test results into care.
One of the major barriers to the appropriate integration of genetics and genomics into general practice is the limited training of on-geneticist providers and the rapidly changing genetics and genomics applications that require ongoing training.
Many genetics and genomics competencies have been developed to inform course curricula and training programs, as well as development of novel learning opportunities such as personal sequencing or inclusion of genetics/genomics in non-traditional disciplines such as anatomy.
Acknowledgments
Funding: SBH is supported by National Institutes of Health (Grant No. R01GM081416).
Footnotes
Conflicts of interest: SBH declares no conflicts of interest.
References
- 1.Slomski A PCPs Can Manage Genomic Results but Clinical Utility Is LimitedPCPs Can Manage Genomic Results but Clinical Utility LimitedClinical Trials Update. JAMA. 2017;318(16):1532-. [DOI] [PubMed] [Google Scholar]
- 2.Guttmacher AE, Jenkins J, Uhlmann WR. Genomic medicine: who will practice it? A call to open arms. Am J Med Genet. 2001;106(3):216–22. [DOI] [PubMed] [Google Scholar]
- 3.Greendale K, Pyeritz RE. Empowering primary care health professionals in medical genetics: how soon? How fast? How far? Am J Med Genet. 2001;106(3):223–32. [DOI] [PubMed] [Google Scholar]
- 4.Carroll JC, Makuwaza T, Manca DP, Sopcak N, Permaul JA, O’Brien MA, et al. Primary care providers’ experiences with and perceptions of personalized genomic medicine. Can Fam Physician. 2016;62(10):e626–e35. [PMC free article] [PubMed] [Google Scholar]
- 5.Burke W Genetic testing in primary care. Annu Rev Genomics Hum Genet. 2004;5:1–14. [DOI] [PubMed] [Google Scholar]
- 6.Lose EJ. The emerging role of primary care in genetics. Curr Opin Pediatr. 2008;20(6):634–8. [DOI] [PubMed] [Google Scholar]
- 7.Hamilton JG, Abdiwahab E, Edwards HM, Fang ML, Jdayani A, Breslau ES. Primary care providers’ cancer genetic testing-related knowledge, attitudes, and communication behaviors: A systematic review and research agenda. J Gen Intern Med. 2017;32(3):315–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Laforest F, Kirkegaard P, Mann B, Edwards A. Genetic cancer risk assessment in general practice: systematic review of tools available, clinician attitudes, and patient outcomes. Br J Gen Pract. 2019;69(679):e97–e105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Harding B, Webber C, Ruhland L, Dalgarno N, Armour CM, Birtwhistle R, et al. Primary care providers’ lived experiences of genetics in practice. J Community Genet. 2018;10(1):85–93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Mikat-Stevens NA, Larson IA, Tarini BA. Primary-care providers’ perceived barriers to integration of genetics services: a systematic review of the literature. Genet Med. 2015;17(3):169–76. [DOI] [PubMed] [Google Scholar]
- 11.Trinidad SB, Fryer-Edwards K, Crest A, Kyler P, Lloyd-Puryear MA, Burke W. Educational needs in genetic medicine: primary care perspectives. Community Genet. 2008;11(3):160–5. [DOI] [PubMed] [Google Scholar]
- 12.Burke W, Acheson L, Botkin J, Bridges K, Davis A, Evans J, et al. Genetics in primary care: a USA faculty development initiative. Community Genet. 2002;5(2):138–46. [DOI] [PubMed] [Google Scholar]
- 13.Burke W, Emery J. Genetics education for primary-care providers. Nat Rev Genet. 2002;3(7):561–6. [DOI] [PubMed] [Google Scholar]
- 14.Lander ES, Linton LM, Birren B, Nusbaum C, Zody MC, Baldwin J, et al. Initial sequencing and analysis of the human genome. Nature. 2001;409(6822):860–921. [DOI] [PubMed] [Google Scholar]
- 15.Venter JC, Adams MD, Myers EW, Li PW, Mural RJ, Sutton GG, et al. The sequence of the human genome. Science. 2001;291(5507):1304–51. [DOI] [PubMed] [Google Scholar]
- 16.Visscher PM, Wray NR, Zhang Q, Sklar P, McCarthy MI, Brown MA, et al. 10 Years of GWAS Discovery: Biology, Function, and Translation. Am J Hum Genet. 2017;101(1):5–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Stranger BE, Stahl EA, Raj T. Progress and promise of genome-wide association studies for human complex trait genetics. Genetics. 2011;187(2):367–83. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Hasin Y, Seldin M, Lusis A. Multi-omics approaches to disease. Genome Biol. 2017;18(1):83. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Shen H, Laird PW. Interplay between the Cancer Genome and Epigenome. Cell. 2013;153(1):38–55. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Allyse MA, Robinson DH, Ferber MJ, Sharp RR. Direct-to-Consumer Testing 2.0: Emerging Models of Direct-to-Consumer Genetic Testing. Mayo Clin Proc. 2018;93(1):113–20. [DOI] [PubMed] [Google Scholar]
- 21.Niemiec E, Kalokairinou L, Howard HC. Current ethical and legal issues in health-related direct-to-consumer genetic testing. Per Med. 2017;14(5):433–45. [DOI] [PubMed] [Google Scholar]
- 22.Brower V FDA to regulate direct-to-consumer genetic tests. J Natl Cancer Inst. 2010;102(21):1610–2, 7. [DOI] [PubMed] [Google Scholar]
- 23.Roberts JS, Gornick MC, Carere DA, Uhlmann WR, Ruffin MT, Green RC. Direct-to-Consumer Genetic Testing: User Motivations, Decision Making, and Perceived Utility of Results. Public Health Genomics. 2017;20(1):36–45. [DOI] [PubMed] [Google Scholar]
- 24.Covolo L, Rubinelli S, Ceretti E, Gelatti U. Internet-Based Direct-to-Consumer Genetic Testing: A Systematic Review. J Med Internet Res. 2015;17(12):e279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.van der Wouden CH, Carere DA, Maitland-van der Zee AH, Ruffin MTt, Roberts JS, Green RC. Consumer Perceptions of Interactions With Primary Care Providers After Direct-to-Consumer Personal Genomic Testing. Ann Intern Med. 2016;164(8):513–22. [DOI] [PubMed] [Google Scholar]
- 26.Pet DB, Holm IA, Williams JL, Myers MF, Novak LL, Brothers KB, et al. Physicians’ perspectives on receiving unsolicited genomic results. Genet Med. 2019;21(2):311–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Christensen KD, Bernhardt BA, Jarvik GP, Hindorff LA, Ou J, Biswas S, et al. Anticipated responses of early adopter genetic specialists and nongenetic specialists to unsolicited genomic secondary findings. Genet Med. 2018;20(10):1186–95. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Wang C, Cahill TJ, Parlato A, Wertz B, Zhong Q, Cunningham TN, et al. Consumer use and response to online third-party raw DNA interpretation services. Mol Genet Genomic Med. 2018;6(1):35–43. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Badalato L, Kalokairinou L, Borry P. Third party interpretation of raw genetic data: an ethical exploration. Eur J Hum Genet. 2017;25(11):1189–94. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Allen CG, Gabriel J, Flynn M, Cunningham TN, Wang C. The impact of raw DNA availability and corresponding online interpretation services: A mixed-methods study. Transl Behav Med. 2018;8(1):105–12. [DOI] [PubMed] [Google Scholar]
- 31.Carere DA, VanderWeele TJ, Vassy JL, van der Wouden CH, Roberts JS, Kraft P, et al. Prescription medication changes following direct-to-consumer personal genomic testing: findings from the Impact of Personal Genomics (PGen) Study. Genet Med. 2017;19(5):537–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Koeller DR, Uhlmann WR, Carere DA, Green RC, Roberts JS. Utilization of Genetic Counseling after Direct-to-Consumer Genetic Testing: Findings from the Impact of Personal Genomics (PGen) Study. J Genet Couns. 2017;26(6):1270–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Thorogood A, Bobe J, Prainsack B, Middleton A, Scott E, Nelson S, et al. APPLaUD: access for patients and participants to individual level uninterpreted genomic data. Hum Genomics. 2018;12(1):7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Pitini E, De Vito C, Marzuillo C, D’Andrea E, Rosso A, Federici A, et al. How is genetic testing evaluated? A systematic review of the literature. Eur J Hum Genet. 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Haddow JEPG. ACCE: A Model Process for Evaluating Data on Emerging Genetic Tests In: Khoury MLJ, Burke W, editor. Human Genome Epidemiology: A Scientific Foundation for Using Genetic Information to Improve Health and Prevent Disease. Oxford, UK: Oxford University Press; 2003. p. 217–33. [Google Scholar]
- 36.Teutsch SM, Bradley LA, Palomaki GE, Haddow JE, Piper M, Calonge N, et al. The Evaluation of Genomic Applications in Practice and Prevention (EGAPP) Initiative: methods of the EGAPP Working Group. Genet Med. 2009;11(1):3–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Sanderson S, Zimmern R, Kroese M, Higgins J, Patch C, Emery J. How can the evaluation of genetic tests be enhanced? Lessons learned from the ACCE framework and evaluating genetic tests in the United Kingdom. Genet Med. 2005;7(7):495–500. [DOI] [PubMed] [Google Scholar]
- 38.Misyura M, Zhang T, Sukhai MA, Thomas M, Garg S, Kamel-Reid S, et al. Comparison of Next-Generation Sequencing Panels and Platforms for Detection and Verification of Somatic Tumor Variants for Clinical Diagnostics. J Mol Diagn. 2016;18(6):842–50. [DOI] [PubMed] [Google Scholar]
- 39.Hampel KJ, de Abreu FB, Sidiropoulos N, Peterson JD, Tsongalis GJ. Variant call concordance between two laboratory-developed, solid tumor targeted genomic profiling assays using distinct workflows and sequencing instruments. Exp Mol Pathol. 2017;102(2):215–8. [DOI] [PubMed] [Google Scholar]
- 40.Muller JN, Falk M, Talwar J, Neemann N, Mariotti E, Bertrand M, et al. Concordance between Comprehensive Cancer Genome Profiling in Plasma and Tumor Specimens. J Thorac Oncol. 2017; 12(10): 1503–11. [DOI] [PubMed] [Google Scholar]
- 41.Spratt DE, Chan T, Waldron L, Speers C, Feng FY, Ogunwobi 00, et al. Racial/Ethnic Disparities in Genomic Sequencing. JAMA Oncol. 2016;2(8):1070–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Richards S, Aziz N, Bale S, Bick D, Das S, Gastier-Foster J, et al. Standards and guidelines for the interpretation of sequence variants: a joint consensus recommendation of the American College of Medical Genetics and Genomics and the Association for Molecular Pathology. Genet Med. 2015;17(5):405–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Bousman CA, Dunlop BW. Genotype, phenotype, and medication recommendation agreement among commercial pharmacogenetic-based decision support tools. Pharmacogenomics J. 2018;18(5):613–22. [DOI] [PubMed] [Google Scholar]
- 44.Amendola LM, Jarvik GP, Leo MC, McLaughlin HM, Akkari Y, Amaral MD, et al. Performance of ACMG-AMP Variant-Interpretation Guidelines among Nine Laboratories in the Clinical Sequencing Exploratory Research Consortium. Am J Hum Genet. 2016;98(6):1067–76. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Pepin MG, Murray ML, Bailey S, Leistritz-Kessler D, Schwarze U, Byers PH. The challenge of comprehensive and consistent sequence variant interpretation between clinical laboratories. Genet Med. 2016;18(l):20–4. [DOI] [PubMed] [Google Scholar]
- 46.Bland A, Harrington EA, Dunn K, Pariani M, Platt JCK, Grove ME, et al. Clinically impactful differences in variant interpretation between clinicians and testing laboratories: a single-center experience. Genet Med. 2018;20(3):369–73. [DOI] [PubMed] [Google Scholar]
- 47.Balmana J, Digiovanni L, Gaddam P, Walsh MF, Joseph V, Stadler ZK, et al. Conflicting Interpretation of Genetic Variants and Cancer Risk by Commercial Laboratories as Assessed by the Prospective Registry of Multiplex Testing. J Clin Oncol. 2016;34(34):4071–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Hamilton JG, Long JM, Brandt AC, Brower J, Symecko H, Salo-Mullen EE, et al. Patients’ Medical and Psychosocial Experiences After Detection of a CDH1 Variant With Multigene Panel Testing. JCO Precision Oncology. 2019(3):1–14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 49.Strande NT, Brnich SE, Roman TS, Berg JS. Navigating the nuances of clinical sequence variant interpretation in Mendelian disease. Genet Med. 2018;20(9):918–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Hoskinson DC, Dubuc AM, Mason-Suares H. The current state of clinical interpretation of sequence variants. Curr Opin Genet Dev. 2017;42:33–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Bean LJ, Hegde MR. Gene Variant Databases and Sharing: Creating a Global Genomic Variant Database for Personalized Medicine. Hum Mutat. 2016;37(6):559–63. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Su XW, Simmons Z. Ethical Considerations in Neurogenetic Testing. Semin Neurol. 2018;38(5):505–14. [DOI] [PubMed] [Google Scholar]
- 53.Hall AE, Chowdhury S, Pashayan N, Hallowell N, Pharoah P, Burton H. What ethical and legal principles should guide the genotyping of children as part of a personalised screening programme for common cancer? J Med Ethics. 2014;40(3):163–7. [DOI] [PubMed] [Google Scholar]
- 54.Kilbride MK. Genetic Privacy, Disease Prevention, and the Principle of Rescue. Hastings Cent Rep. 2018;48(3):10–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55.Ormondroyd E, Oates S, Parker M, Blair E, Watkins H. Pre-symptomatic genetic testing for inherited cardiac conditions: a qualitative exploration of psychosocial and ethical implications. Eur J Hum Genet. 2014;22(1):88–93. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Joly Y, Feze IN, Song L, Knoppers BM. Comparative Approaches to Genetic Discrimination: Chasing Shadows? Trends Genet. 2017;33(5):299–302. [DOI] [PubMed] [Google Scholar]
- 57.Tandy-Connor S, Guiltinan J, Krempely K, LaDuca H, Reineke P, Gutierrez S, et al. False-positive results released by direct-to-consumer genetic tests highlight the importance of clinical confirmation testing for appropriate patient care. Genet Med. 2018;20(12):1515–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 58.Evenson SA, Hoyme HE, Haugen-Rogers JE, Larson EA, Puumala SE. Patient and Physician Perceptions of Genetic Testing in Primary Care. S D Med. 2016;69(11):487–93. [PubMed] [Google Scholar]
- 59.National Society of Genetic Counselors. Find a Genetic Counselor. 2019. https://www.nsgc.org/page/find-a-genetic-counselor. Accessed May 29 2019.
- 60.Rubanovich CK, Cheung C, Mandel J, Bloss CS. Physician preparedness for big genomic data: a review of genomic medicine education initiatives in the United States. Hum Mol Genet. 2018;27(R2):R250–r8. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 61.Talwar D, Tseng TS, Foster M, Xu L, Chen LS. Genetics/genomics education for nongenetic health professionals: a systematic literature review. Genet Med. 2017;19(7):725–32. [DOI] [PubMed] [Google Scholar]
- 62.Smith MK, Wood WB. Teaching Genetics: Past, Present, and Future. Genetics. 2016;204(1):5–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Slade I, Subramanian DN, Burton H. Genomics education for medical professionals - the current UK landscape. Clin Med (Lond). 2016;16(4):347–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Nickola TJ, Green JS, Harralson AF, O’Brien TJ. The current and future state of pharmacogenomics medical education in the USA. Pharmacogenomics. 2012;13(12):1419–25. [DOI] [PubMed] [Google Scholar]
- 65.Wilcox RL, Adem PV, Afshinnekoo E, Atkinson JB, Burke LW, Cheung H, et al. The Undergraduate Training in Genomics (UTRIG) Initiative: early & active training for physicians in the genomic medicine era. Per Med. 2018;15(3):199–208. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66.Haspel RL, Atkinson JB, Barr FG, Kaul KL, Leonard DG, O’Daniel J, et al. TRIG on TRACK: educating pathology residents in genomic medicine. Per Med. 2012;9(3):287–93. [DOI] [PubMed] [Google Scholar]
- 67.Nguyen J, Lemons J, Crandell S, Northrup H. Efficacy of a medical genetics rotation during pediatric training. Genet Med. 2016;18(2):199–202. [DOI] [PubMed] [Google Scholar]
- 68.Hagiwara N Application of active learning modalities to achieve medical genetics competencies and their learning outcome assessments. Adv Med Educ Pract. 2017;8:817–29. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.Campion M, Goldgar C, Hopkin RJ, Prows CA, Dasgupta S. Genomic education for the next generation of health-care providers. Genet Med. 2019. [DOI] [PubMed] [Google Scholar]
- 70.Gerhard GS, Jin Q, Paynton BV, Popoff SN. The Anatomy to Genomics (ATG) Start Genetics medical school initiative: incorporating exome sequencing data from cadavers used for Anatomy instruction into the first year curriculum. BMC Med Genomics. 2016;9(1):62. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Gerhard GS, Paynton B, Popoff SN. Integrating Cadaver Exome Sequencing Into a First-Year Medical Student Curriculum. Jama. 2016;315(6):555–6. [DOI] [PubMed] [Google Scholar]
- 72.Paneque M, Cornel MC, Curtisova V, Houwink E, Jackson L, Kent A, et al. Implementing genetic education in primary care: the Gen-Equip programme. J Community Genet. 2017;8(2):147–50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Linderman MD, Sanderson SC, Bashir A, Diaz GA, Kasarskis A, Zinberg R, et al. Impacts of incorporating personal genome sequencing into graduate genomics education: a longitudinal study over three course years. BMC Med Genomics. 2018;11(1):5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74.Korf BR, Berry AB, Limson M, Marian AJ, Murray MF, O’Rourke PP, et al. Framework for development of physician competencies in genomic medicine: report of the Competencies Working Group of the Inter-Society Coordinating Committee for Physician Education in Genomics. Genet Med. 2014;16(11):804–9. [DOI] [PubMed] [Google Scholar]
- 75.Skirton H, Lewis C, Kent A, Coviello DA. Genetic education and the challenge of genomic medicine: development of core competences to support preparation of health professionals in Europe. Eur J Hum Genet. 2010;18(9):972–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 76.Niederhoffer EC, Cline SD, Osheroff N, Simmons JM, Diekman AB, Franklin DS, et al. Teaching Biochemistry and Genetics to Students of Dentistry, Medicine, and Pharmacy 6(th) International Conference of the Association of Biochemistry Educators (ABE) Clearwater Beach, FL, USA, May 7-11, 2017. Med Sci Educ. 2017;27(4):855–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77.Wilkes MS, Day FC, Fancher TL, McDermott H, Lehman E, Bell RA, et al. Increasing confidence and changing behaviors in primary care providers engaged in genetic counselling. BMC Med Educ. 2017;17(1):163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78.Bell RA, McDermott H, Fancher TL, Green MJ, Day FC, Wilkes MS. Impact of a randomized controlled educational trial to improve physician practice behaviors around screening for inherited breast cancer. J Gen Intern Med. 2015;30(3):334–41. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Jackson L, O’Connor A, Paneque M, Curtisova V, Lunt PW, Pourova RK, et al. The Gen-Equip Project: evaluation and impact of genetics e-learning resources for primary care in six European languages. Genet Med. 2019;21(3):718–26. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80.Houwink EJ, Muijtjens AM, van Teeffelen SR, Henneman L, Rethans JJ, Jacobi F, et al. Effect of comprehensive oncogenetics training interventions for general practitioners, evaluated at multiple performance levels. PLoS One. 2015;10(4):e0122648. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.Sharp RR, Goldlust ME, Eng C. Addressing gaps in physician education using personal genomic testing. Genet Med. 2011;13(8):750–1. [DOI] [PubMed] [Google Scholar]
- 82.Garber KB, Hyland KM, Dasgupta S. Participatory Genomic Testing as an Educational Experience. Trends in Genetics.32(6):317–20. [DOI] [PubMed] [Google Scholar]
- 83.Sanderson SC, Linderman MD, Zinberg R, Bashir A, Kasarskis A, Zweig M, et al. How do students react to analyzing their own genomes in a whole-genome sequencing course?: outcomes of a longitudinal cohort study. Genet Med. 2015;17(11):866–74. [DOI] [PubMed] [Google Scholar]
- 84.Houwink EJ, Muijtjens AM, van Teeffelen SR, Henneman L, Rethans JJ, van der Jagt LE, et al. Effectiveness of oncogenetics training on general practitioners’ consultation skills: a randomized controlled trial. Genet Med. 2014;16(1):45–52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85.Houwink EJ, van Teeffelen SR, Muijtjens AM, Henneman L, Jacobi F, van Luijk SJ, et al. Sustained effects of online genetics education: a randomized controlled trial on oncogenetics. Eur J Hum Genet. 2014;22(3):310–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 86.Henricks WH, Karcher DS, Harrison JH Jr., Sinard JH, Riben MW, Boyer PJ, et al. Pathology Informatics Essentials for Residents: A Flexible Informatics Curriculum Linked to Accreditation Council for Graduate Medical Education Milestones. Arch Pathol Lab Med. 2017;141(1):113–24. [DOI] [PubMed] [Google Scholar]
- 87.Tognetto A, Michelazzo MB, Ricciardi W, Federici A, Boccia S. Core competencies in genetics for healthcare professionals: results from a literature review and a Delphi method. BMC Med Educ. 2019;19(1):19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88.Press KR, Bodurtha J. Milestones for medical students completing a clinical genetics elective. Genet Med. 2017;19(2):236–9. [DOI] [PubMed] [Google Scholar]
- 89.Bell GC, Crews KR, Wilkinson MR, Haidar CE, Hicks JK, Baker DK, et al. Development and use of active clinical decision support for preemptive pharmacogenomics. J Am Med Inform Assoc. 2014;21(e1):e93–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90.O’Donnell PH, Wadhwa N, Danahey K, Borden BA, Lee SM, Hall JP, et al. Pharmacogenomics-Based Point-of-Care Clinical Decision Support Significantly Alters Drug Prescribing. Clin Pharmacol Ther. 2017;102(5):859–69. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91.Houwink EJ, van Luijk SJ, Henneman L, van der Vleuten C, Jan Dinant G, Cornel MC. Genetic educational needs and the role of genetics in primary care: a focus group study with multiple perspectives. BMC Fam Pract. 2011; 12:5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92.Heale BSE, Khalifa A, Stone BL, Nelson S, Del Fiol G. Physicians’ pharmacogenomics information needs and seeking behavior: a study with case vignettes. BMC Med Inform Decis Mak. 2017;17(1):113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93.Prawira A, Pugh TJ, Stockley TL, Siu LL. Data resources for the identification and interpretation of actionable mutations by clinicians. Ann Oncol. 2017;28(5):946–57. [DOI] [PubMed] [Google Scholar]
- 94.Dumur CI. Available resources and challenges for the clinical annotation of somatic variations. Cancer Cytopathol. 2014;122(10):730–6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95.Landrum MJ, Lee JM, Benson M, Brown GR, Chao C, Chitipiralla S, et al. ClinVar: improving access to variant interpretations and supporting evidence. Nucleic Acids Res. 2018;46(D1):D1062–d7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 96.Harrison SM, Riggs ER, Maglott DR, Lee JM, Azzariti DR, Niehaus A, et al. Using ClinVar as a Resource to Support Variant Interpretation. Curr Protoc Hum Genet. 2016;89:8 16 1-8 23. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97.Rehm HL, Berg JS, Brooks LD, Bustamante CD, Evans JP, Landrum MJ, et al. ClinGen--the Clinical Genome Resource. N Engl J Med. 2015;372(23):2235–42. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98.Gelb BD, Cave H, Dillon MW, Gripp KW, Lee JA, Mason-Suares H, et al. ClinGen’s RASopathy Expert Panel consensus methods for variant interpretation. Genet Med. 2018;20(11):1334–45. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99.Madhavan S, Ritter D, Micheel C, Rao S, Roy A, Sonkin D, et al. ClinGen Cancer Somatic Working Group - standardizing and democratizing access to cancer molecular diagnostic data to drive translational research. Pac Symp Biocomput. 2018;23:247–58. [PMC free article] [PubMed] [Google Scholar]
- 100.Rivera-Munoz EA, Milko LV, Harrison SM, Azzariti DR, Kurtz CL, Lee K, et al. ClinGen Variant Curation Expert Panel experiences and standardized processes for disease and gene-level specification of the ACMG/AMP guidelines for sequence variant interpretation. Hum Mutat. 2018;39(11):1614–22. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101.Milko LV, Funke BH, Hershberger RE, Azzariti DR, Lee K, Riggs ER, et al. Development of Clinical Domain Working Groups for the Clinical Genome Resource (ClinGen): lessons learned and plans for the future. Genet Med. 2018. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 102.Falk MJ, Shen L, Gonzalez M, Leipzig J, Lott MT, Stassen AP, et al. Mitochondrial Disease Sequence Data Resource (MSeqDR): a global grass-roots consortium to facilitate deposition, curation, annotation, and integrated analysis of genomic data for the mitochondrial disease clinical and research communities. Mol Genet Metab. 2015;114(3):388–96. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103.Shen L, Attimonelli M, Bai R, Lott MT, Wallace DC, Falk MJ, et al. MSeqDR mvTool: A mitochondrial DNA Web and API resource for comprehensive variant annotation, universal nomenclature collation, and reference genome conversion. Hum Mutat. 2018;39(6):806–10. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 104.Sequencing Errors Rife in Genome Databases. Cancer Discov. 2017;7(4):344–5. [DOI] [PubMed] [Google Scholar]
- 105.Kaur P, Porras TB, Ring A, Carpten JD, Lang JE. Comparison of TCGA and GENIE genomic datasets for the detection of clinically actionable alterations in breast cancer. Sci Rep. 2019;9(1):1482. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 106.U.S. Centers for Disease Control and Prevention. Public Health Knowledge Genomics Base (v5.4). 2019. https://phgkb.cdc.gov/PHGKB/phgHome.action?action=home. Accessed March 25 2019.
- 107.Yu W, Gwinn M, Dotson WD, Green RF, Clyne M, Wulf A, et al. A knowledge base for tracking the impact of genomics on population health. Genet Med. 2016;18(12):1312–4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 108.Mensah GA, Yu W, Barfield WL, Clyne M, Engelgau MM, Khoury MJ. HLBS-PopOmics: an online knowledge base to accelerate dissemination and implementation of research advances in population genomics to reduce the burden of heart, lung, blood, and sleep disorders. Genet Med. 2019;21(3):519–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 109.U.S. Centers for Disease Control and Prevention. HLBS-PopOmics 2019. https://phgkb.cdc.gov/PHGKB/specificPHGKB.action?topic=HLBS&query=home. Accessed March 25 2019.
- 110.Seaby EG, Pengelly RJ, Ennis S. Exome sequencing explained: a practical guide to its clinical application. Brief Funct Genomics. 2016;15(5):374–84. [DOI] [PubMed] [Google Scholar]
- 111.Jalali Sefid Dashti M, Gamieldien J. A practical guide to filtering and prioritizing genetic variants. Biotechniques. 2017;62(1):18–30. [DOI] [PubMed] [Google Scholar]
- 112.Sabour L, Sabour M, Ghorbian S. Clinical Applications of Next-Generation Sequencing in Cancer Diagnosis. Pathol Oncol Res. 2017;23(2):225–34. [DOI] [PubMed] [Google Scholar]
- 113.Dienstmann R, Dong F, Borger D, Dias-Santagata D, Ellisen LW, Le LP, et al. Standardized decision support in next generation sequencing reports of somatic cancer variants. Mol Oncol. 2014;8(5):859–73. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 114.Haga SB. Educating patients and providers through comprehensive pharmacogenetic test reports. Pharmacogenomics. 2017;18(11):1047–50. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 115.Dorschner MO, Amendola LM, Shirts BH, Kiedrowski L, Salama J, Gordon AS, et al. Refining the structure and content of clinical genomic reports. Am J Med Genet C Semin Med Genet. 2014;166C(1):85–92. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 116.Crump JK, Del Fiol G, Williams MS, Freimuth RR. Prototype of a Standards-Based EHR and Genetic Test Reporting Tool Coupled with HL7-Compliant Infobuttons. AMIA Jt Summits Transl Sci Proc. 2018;2017:330–9. [PMC free article] [PubMed] [Google Scholar]