Abstract
Development of HIV-1 drug resistance mutations (HDRMs) is one of the major reasons for the clinical failure of antiretroviral therapy. Treatment success rates can be improved by applying personalized anti-HIV regimens based on a patient’s HDRM profile. However, the sensitivity and specificity of the HDRM profile is limited by the methods used for detection. Sanger-based sequencing technology has traditionally been used for determining HDRM profiles at the single nucleotide variant (SNV) level, but with a sensitivity of only ≥ 20% in the HIV population of a patient. Next Generation Sequencing (NGS) technologies offer greater detection sensitivity (~ 1%) and larger scope (hundreds of samples per run). However, NGS technologies produce reads that are too short to enable the detection of the physical linkages of individual SNVs across the haplotype of each HIV strain present. In this article, we demonstrate that the single-molecule long reads generated using the Third Generation Sequencer (TGS), PacBio RS II, along with the appropriate bioinformatics analysis method, can resolve the HDRM profile at a more advanced quasispecies level. The case studies on patients’ HIV samples showed that the quasispecies view produced using the PacBio method offered greater detection sensitivity and was more comprehensive for understanding HDRM situations, which is complement to both Sanger and NGS technologies. In conclusion, the PacBio method, providing a promising new quasispecies level of HDRM profiling, may effect an important change in the field of HIV drug resistance research.
Keywords: PacBio, Tag-sequence, HIV-1 drug resistance mutation, Next generation sequencing, Third generation sequencing, Quasispecies, Haplotype, Linkage, Single nucleotide variant
Introduction
HIV strains are dynamic in the host during infection, with distinct characteristics of high turnover and mutation rates. Many mutations can arise from one HIV generation to the next, resulting in genetic diversity of the HIV population, termed “quasispecies” [1–4]. Under the pressure of certain antiretroviral treatments, some HIV quasispecies with drug resistance mutations (HDRMs) are preferentially selected and propagate. Clinically, the drug resistance quasispecies can become the dominant strain in the patient, thereafter making the treatment ineffective [4]. Different HDRM profiles are resistant to different types of antiretroviral drugs. For example, mutation of D30N in HIV protease usually resists NFV, but not for other anti-protease drugs. These types of correlations have been documented and recorded in a large drug resistance knowledge database [5]. Monitoring the HDRM profile of patients provides not only important guidance to formulate different combinations of drugs in a personalized/stratified medicine practice by utilizing appropriate sensitive drugs and avoiding insensitive drugs, but also to accumulate new knowledge regarding the correlation between HDRM profiles and the response to treatment regimens.
Our traditional approach of detecting HDRMs is the Sanger-based sequencing system (such as TruGene®) that amplifies and sequences the 1.4-kb POL region (the HIV genomic region encoding the viral enzymes protease, reverse transcriptase, and integrase) of the HIV virion population in a patient sample. As a population-based sequencing method, TruGene® is able to reliably detect single nucleotide variants (SNVs) at ≥ 20% in the HIV population of a patient [6]. Next Generation Sequencing (NGS) technologies, such as 454 and Illumina, offer greater sensitivity (~ 1%) and higher throughput (hundreds of samples per run) compared to the TruGene Sequencing System [7–10]. Regardless of these promising improvements from NGS, both TruGene® and NGS systems have a common weakness, that is, their detection capabilities are limited to the individual single nucleotide variant (SNV) level instead of the quasispecies level necessary for complete HDRM profiling (Figure 1A). Because the shorter reads lack the linkage information among the individual mutations, it is very difficult to sort the short reads of NGS in a big mixture and assemble them into each corresponding quasispecies [9]. The SNV view of HDRM profiling is the dominant approach employed in HIV drug resistance research and clinical application. In the current paradigm, a list of individual drug resistance mutations correlating to the drug resistance phenotype is reported, regardless of the potential relationship of the multiple mutations as a co-functional unit (Figure 1B). The multiple mutations within each HIV genome interact cooperatively on a functional level and make an integrative contribution to the final characteristics of the HIV quasispecies. Thus, a quasispecies HDRM view is a way to more precisely evaluate the drug resistance situation. The quasispecies profiling model more closely represents the nature of how HIV functions at the quasispecies level, rather than the individual mutation level, to effect drug resistance. Unfortunately, both Sanger sequencing and NGS shotgun sequencing are population-based detection (as opposed to single molecule/genome detection) so that their resolution is difficult at haplotype/quasispecies level.
To obtain quasispecies-level HDRM profiling, the technique of Single Genome Analysis (SGA) can be used. SGA is accomplished by diluting the HIV population from an individual into single copies in each well of a 96-well plate, and then amplifying and sequencing the single HIV copies separately [11]. This approach bypasses the complications of population-based sequencing by diluting the diversity of HIV genomes into a singleton so that the resolution is at quasispecies level. In this way, any observed mutations derived from the same well of the 96-well plate are known to stem from one single quasispecies. However, this method is extremely labor-intensive, time-consuming and low-throughput. These characteristics of SGA render it impractical either as a routine assay in the lab or for a large-scope study.
Moreover, building re-construction algorithms to sort the population-level shotgun-read mixture generated by NGS into small numbers of contigs at the quasispecies-level have been explored. Even though re-constructing the haplotype contigs from a shotgun-read mixture were reported with successes in some cases [12,13], the reliability of the re-construction algorithms in real-life studies is still questionable [9,14,15]. In our practice, the re-construction algorithms repeatedly generated false positives, e.g. chimerical contigs. Thus, to date, the SNV level of HDRM is still the dominant way in the drug resistant field.
The newer PacBio RS II platform from Pacific Biosciences provides a new potential to study HDRM profiling due to its distinct characteristics of very long (up to 40 kb), single molecule reads [16–18]. The PacBio long reads allow each targeted HIV molecule (usually a bulk PCR product of HIV population) to be continuously sequenced at full-length in one contiguous pass so that the linkage information between every individual mutation on the same HIV molecule is well characterized. The ability of the high-throughput PacBio technology makes feasible the large-scale study of HIV drug resistance at the important quasispecies-level, where other systems have had difficulty, as previously discussed (Figure 1A). However, since the PacBio long reads have higher error rate, special precautions during data analysis must be applied using an appropriate bioinformatics method in order to fully utilize the advantages resulting from having long reads to characterize full-length, contiguous regions of individual HIV molecules [17].
In this report, we first made benchmark samples by admixing two slightly different HIV strains in different ratios to serve as HIV quasispecies positive controls. The benchmark samples were thereafter used to evaluate the sensitivity of quasispecies-level detection using PacBio single-molecule, real-time sequencing. Finally, the PacBio system was applied to two case studies of clinical HIV samples at quasispecies-level HDRM detection.
Materials and Method
Generating benchmark samples
RNA was extracted from HIV pLN4-3 strains by Qiagen RNA kit. RNA of HIV BH10 was obtained from TruGene commercial kit. TruGene proprietary RT-PCR kit was used to amplify 1.4-kb POL region of HIV BH10 strain and pLN4-3 strain respectively. The DNA products derived from the two RT-PCR reactions were purified and quantitated. Thereafter, serial 2-fold admixture samples of the two DNA products were made at different ratios from 20%, 10%, 5%, and so on until 0.125% (Table 1).
Table 1.
# | Benchmark Sample* | Admixture Ratio* | PacBio CCS Reads** |
---|---|---|---|
1 | WT BH10 | 100% | 22 K |
2 | WT pNL4-3 [25] | 100% | 20 K |
3 | Admixture 1 | 10% | 18 K |
4 | Admixture 2 | 5% | 21 K |
5 | Admixture 3 | 2.5% | 14 K |
6 | Admixture 4 | 1.25% | 18 K |
7 | Admixture 5 | 0.625% | 22 k |
8 | Admixture 6 | 0.313% | 17 k |
9 | Admixture 7 | 0.156% | 22 k |
The admixture ratios of artificial benchmark samples cover wide range from high to low.
The corresponding PacBio sequencing typically yields approximately twenty thousands of CCS reads for each sample.
Preparation of clinical samples
HIV RNA was extracted by the Qiagen RNA extraction kit. TruGene proprietary RT-PCR kit was used to amplify the 1.4-kb POL region. The PCR products are directly submitted to TruGene sequencing. The PCR products were also purified by Qiagene DNA purification column kit. The purified DNA products are ready for MiSeq or PacBio deep sequencing.
TruGene sequencing and data analysis
The PCR product was subjected to the TruGene sequencer according to the manufacture’s protocol. The output sequences in fasta format were compared to the wild type reference sequence of HIV LAV1 for SNV analysis by the TruGene built-in software package. A list of SNVs was reported as the final results [19].
Illumina MiSeq deep sequencing and data analysis
One ng of DNA sample was used to construct MiSeq library by the Illumina Nextera kit. Standard MiSeq flow cell and 2×150 cycle MiSeq sequencing kit v2 were used for the deep sequencing. The output sequencing data was converted and demutiplexed into fastq format files by the MiSeq Sequence Analyzer.
The SNV procedure was done in following order:
BWA was used to aligned the reads to the wild type reference sequence of HIV LAV1.
SAM tools were used to generate pileup files based on BWA’s alignment file.
VarScan was used to make variant calls from the pileup file. A list of SNV with corresponding frequencies was reported as the final results.
PacBio deep sequencing and tag-based quasispecies data analysis
One μg of the DNA product was used to construct the PacBio DNA library using the PacBio standard 2 kb template prep protocol. The samples were sequenced on the PacBio RS platform on a single SMRT Cell per sample. C2 Polymerase was used for the sequencing reaction and ninety-minute movie windows were used for signal detection. After raw sequence data were generated, the base calling and CCS read generation were done using version 1.3.0 of PacBio’s instrument control and SMRT Analysis software with default parameters. The output sequences are in fastq format.
The tag-based quasispecies analysis procedure was done in the following order (Figure 1):
The SNV procedure was done in a similar way as the MiSeq procedure except using PacBio’s Blasr for the mapping step instead of BWA. PacBio’s Blasr was found to be more tolerant of the high error rate of PacBio reads [20].
Tag positions were selected for the tag panel based on a combination of prior drug-resistance mutation knowledge and the results of the SNV analysis.
An in-house Perl script using BIO::BAM library was developed to query a tag sequence for each read, and then to create a tag-sequence by linking the nucleotide of each tag position in order. At this point, each tag sequence represents a quasispecies (Figure 1).
The script further clustered the tag- sequences to calculate their frequencies in the population. Any tag-sequence groups with more than 10 tag-sequences were selected for further evaluation. In addition, a “difference” value was calculated for each tag-sequence by comparing it to the dominant (most frequent tag-sequence) quasispecies. For example, the first dominant drug resistant tag-sequence of “AAAGAA” has 3 nucleotide differences comparing to the second drug resistant tag-sequence of “AAgaAg” (Figure 2). Tag-sequences with a difference value ≥ 2 were considered more trustworthy unless they occurred at a frequency greater than 0.4% (Figure 3, 2B) in the final consideration.
Results
HIV benchmark studies: PacBio offers a clear view of HIV quasispecies diversity
The HIV benchmark samples, artificially formed by admixing two slightly different HIV strains at different ratios (Table 1), serve as positive controls to evaluate the minor quasispecies detection ability of PacBio. Average sequencing yield produced approximately 20,000 qualified Circular Consensus Sequence (CCS) reads in full length (Table 1). After the tag-based analysis method was used to analyze the CCS reads at the quasispecies level, the CCS reads were clustered into a smaller number of tag-sequence groups. Each of the tag-sequence groups, a unique combination of artificially linked nucleotides extracted from tag positions of CCS reads, represents a quasispecies in the HIV population (Figure 1 and 4); also see method for details. The quasispecies-level view is able to discover the minor quasispecies down to 0.1% prevalence in the benchmark samples (Figure 4B).
In a cross-platform comparison with Illumina, the same benchmark samples were also sequenced by MiSeq. We conducted an SNV analysis with a similar data processing workflow used by other reported studies [9,10,21,22]. The ~ 1% sensitivity is confirmed with very stable performance at the individual SNV level of analysis (Figure 4A). However, Illumina SNV analysis is unable to reach to 0.1% detection sensitivity. In addition, the re-construction algorithms were also tested on the benchmark samples by a set of software packages including Newbler, Celera Assembler, CLC Bio, MIRA, MINIMUS, Quiver, Vicuna, and PredictHaplo [21]. The results contain high level of chimeric contigs of artifacts (data not shown) consistent with the discussions in other reports [12,13].
The PacBio single molecule long reads obviously offer a unique sequencing ability of maintaining the linkage information of every individual mutations on the same HIV quasispecies strain, that shorter reads from other NGS platforms (such as 454 and Illumina) cannot do. In order to analyze error-prone sequences, a tagging method was used to identify high confidence SNVs and then tag each quazispecies for the presence or absence of each tag SNV. In this way, HIV haplotypes were identified in the benchmark study and exampled clinical studies. The important bioinformatics strategy described in the paper is the tag-based approach, which makes the data analysis to focus on most important spots rather than being distracted by the higher background noises. More specifically speaking, the errors among the single-pass subreads are randomly distributed during sequencing such that the chance of an error recurring at the same tag positions on every subread of each single-molecule sequencing template is extremely low [17]. The promising detection sensitivity of quasispecies-level analysis comes from the co-occurrence pattern of multiple mutations on the same read, which is very difficult to form by random sequencing errors (Figure 3). For example, if mutation 1 has a 5% random chance of being miscalled as a sequencing error, and mutation 2 also has a 5% chance, then the chance of both mutation 1 and mutation 2 being miscalled on the same strain, denoted as the co-occurrence rate, is 0.25% (5% × 5%). Thus, the tag-based quasispecies-level analysis produces much more sensitive detection than the individual-SNV analysis because it takes into consideration the error rate of neighboring mutations on the same read (Figure 3). While the tag-sequence containing randomly distributed errors could not form a strong tag-sequence when present at very low frequencies, errors can be easily filtered out by the criteria such as minimum number of reads supporting the tag-sequence and minimum number of co-variants among the tags (Figure 3).
Moreover, defining a meaningful tag panel is an essential foundation of the quasispecies analysis when using the tag-based approach. We found that a tag number greater than three may give better results, because smaller number of tags (e.g. <= 2) do not provide an advantage over SNV level analysis (Figure 3). In another words, smaller number of tags (e.g. ≤ 2) is closer to SNV level analysis (Figure 3). PacBio being as a complement to the TruGene or Illumina platforms, the tag panel can be selected based on systematic selection from their SNV analysis results (e.g. all SNVs with frequency greater than 1%). For example, sixteen tag positions were selected for use in the tag panel for this benchmark study based on a clear statistical significance reported by the SNV analysis (Figure 4A) of Illumina. In a drug resistance study, the tag panel can also be built with the prior-known drug resistance mutation positions in the HIV drug resistance database.
Case study 1: The PacBio quasispecies-level analysis is able to detect minor drug resistant quasispecies
An HIV-infected patient had a sudden increase of HIV plasma viral load within one month from ~ 3,000 copies/ml at time point 1 to ~ 30,000 copies/ml at time point 2 (Figure 2A). The TruGene standard drug resistance detection showed a profile of three mutations in the protease (PR) and reverse transcriptase (RT) regions at time point 1, with a drug-sensitive interpretation. One month later, the profile contained three additional mutations in the RT region and there was a dramatic increase in viral load to ~ 30,000 copies/ml at time point 2 and the loss of sensitivity to two classes of antiretroviral drugs (ARV) (Figure 2A). An HDRM-development question is raised: how did the HIV drug resistance profile change from a drug-sensitive profile to a drug-resistant profile within just one month?
There are two possible scenarios as illustrated in (Figure 2A):
Drug treatment induces hypermutation and thus the introduction of new drug-resistance mutations.
The drug-resistant quasispecies already existed as a minor species in the HIV population at time point 1. Under the drug treatment pressure, they are quickly selected for and become dominant by time point 2. If so, early treatment of the low frequency drug resistant quasispecies at time point 1 might prevent their outgrowth and the resultant increase in viral load [23,24] (Figure 2A).
The standard TruGene system was able to report the HDRM at the SNV-level, as described earlier, for time points 1 and 2 (Figure 2B). There was no indication that the three additional mutations existed in low frequencies in time point 1, (Figure 2A and 2B). Therefore, the HDRM-development question raised earlier cannot be answered by the TruGene platform. However, given the sensitivity cutoff of TruGene of 20%, it is still possible that these mutations were present at the earlier time point at a lower frequency.
To take advantage of the higher detection sensitivity of NGS, the same HIV samples from the two time points were also sequenced by the Illumina MiSeq. MiSeq deep-sequencing yields much more sensitive SNV detection than that produced using TruGene [10]. MiSeq’s SNV report was able to detect the three additional mutations of the second HDRM profile at frequencies of 3.17%, 1.32%, and 1.08% in the time point 1 sample (Figure 2B), which are frequencies at the MiSeq’s lower detection limit, as suggested in the benchmark section (Figure 4A). At this point, MiSeq’s SNV analysis suggests that the drug-resistant HDRM might exist at lower frequencies at time point 1. But without further linkage information, it is not clear if the three mutations are on the same HIV strain or scattered among different strains.
The same HIV samples from two time points were thereafter sequenced by the PacBio system. PacBio was able to generate approximately 20,000 qualified CCS reads in full length or near full length for each sample. The positions of six previously known drug resistance mutations were selected into the tag panel for tag-based quasispecies analysis based on the relevancy of the SNVs at locations known to convey drug resistance. The tag-based quasispecies analysis was able to build clear tag-sequences representing the HIV quasispecies. The results clearly showed a minority variant with the drug-resistant profile was present at a very low frequency level (0.3%) in time point 1, and this was identical to the dominant variant at time point 2 (Figure 2C). At this point, PacBio quasispecies-level analysis provided the clearest dynamic view of HDRM profiles across the two time points. The PacBio results answered the earlier HDRM development question indicating the patient situation is best described by the second scenario, i.e. the drug resistant strain existed at a low frequency in early time point 1, only to become dominant following drug-resistance selection. This explains why the drug-resistant profile was able to arise so quickly within one month. The high sensitivity and clear quasispecies-level analysis enabled by long reads from PacBio sequencing provides useful information supporting early treatment (and adherence counseling) to avoid this outcome [23,24].
Case study 2: The PacBio quasispecies-level analysis is able to discriminate different HDRM patterns in the HIV population of a patient
A HIV-infected patient had a high HIV viral load of approximately 80,000 copies/ml that was associated with non-adherence to therapy. The TruGene standard drug resistance detection showed that there were six dominant HDRM in PR and two dominant HDRM in RT. In addition, there were10 instances of mixtures of wildtype/HDRM in the RT region (Figure 5A). The question is raised regarding how these mixtures occur at the quasispecies level in the HIV population of the patient. Different answers could potentially cause different treatment approaches. There are two possible scenarios that would result in the detection of mixtures at the SNV level:
All of the HDRM are localized to only one quasispecies, thus drugs directed to the RT region may suppress the co-existing wild-type-like virus (Figure 5A).
The HDRMs in the RT region are produced by a cumulative effect from different quasispecies, thus anti-RT drugs might be less effective for this patient due to the presence of quasispecies containing some combination of HDRM and an insignificant wild-type-like population (Figure 5A).
Since the TruGene SNV report has neither haplotype information nor quantitative information, the question asked above could not be clarified further (Figure 5B).
To take advantage of MiSeq’s quantitative ability in SNV detection, the same HIV samples were also sequenced by the Illumina MiSeq. MiSeq deep sequencing gave quantitative percentage information for each SNV. Each drug-resistance mutation in the mixtures was present at a frequency of ~ 45% (Figure 5B). Because the HDRMs in the RT region were present in highly similar frequencies, the assumption might be made that the HDRMs might come from the same quasispecies. However, without the direct haplotype information of the HDRM, it is difficult to confidently come to that conclusion.
The same HIV samples were thereafter sequenced by the PacBio system. PacBio was able to generate approximately 20,000 qualified CCS reads in full length or nearly full length. The positions of 18 previously known drug resistance mutations were selected into the tag panel based on the relevancy of the SNVs at locations known to convey drug resistance. The tag-based quasispecies analysis showed that the HDRMs composed approximately 20% of the HIV quasispecies (Figure 5C). In contrast, the remaining 80% of quasispecies had no HDRM in their RT region, i.e., was wildtype with regard to drug resistance. At this point, PacBio quasispecies analysis clearly answered the earlier HDRM question posed regarding the distribution of the mutations among the extant quasispecies. This observation is best explained by the first scenario discussed earlier (Figure 5A). It indicates that anti-RT drugs might still be effective to a certain degree by suppressing the wild-type-like species thereby providing health benefits for the patient.
Conclusion
The Third Generation Sequencer (TGS), PacBio RS, offers the unique ability of single-molecule, long reads. Combined with the appropriate bioinformatics analysis strategy, PacBio’s long reads can reliably provide HIV quasispecies-level analysis of HDRM with precision as a complement to the traditional SNV-level analysis. The important quasispecies analysis ability of PacBio is very useful in the drug resistance field, and may provide utility for other studies such as receptor tropism, virus evolution, immune evasion, and virion-to-provirus transition.
Acknowledgments
We thank Biswajit Das, Jun Yang, Xiaojun Hu, Brad Sherman and Ju Qiu for technical support and discussions throughout the study. This work was supported by the National Cancer Institute, National Institutes of Health (Contract HHSN261200800001E). This research was also supported in part by the National Institute of Allergy and Infectious Disease. The contents do not necessarily reflect the views or policies of the Department of Health and Human Services, nor does mention of trade names, commercial products or organizations imply endorsement by the US Government. Plasmid pNL.4.3, cat#114 was obtained through the NIH AIDS Reagent Program, Division of AIDS, NIAID, NIH, from Dr. Malcolm Martin.
References
- 1.Malet I, Delelis O, Soulie C, Wirden M, Tchertanov L, et al. Quasispecies variant dynamics during emergence of resistance to raltegravir in HIV-1-infected patients. The Journal of antimicrobial chemotherapy. 2009;63:795–804. doi: 10.1093/jac/dkp014. [DOI] [PubMed] [Google Scholar]
- 2.Menzo S, Bagnarelli P, Monachetti A, Fiorelli L, Clementi M. Complexity and dynamics of HIV-1 quasispecies. Journal of biological regulators and homeostatic agents. 2000;14:4–6. [PubMed] [Google Scholar]
- 3.Nowak MA, May RM, Anderson RM. The evolutionary dynamics of HIV-1 quasispecies and the development of immunodeficiency disease. Aids. 1990;4:1095–1103. doi: 10.1097/00002030-199011000-00007. [DOI] [PubMed] [Google Scholar]
- 4.Clavel F, Hance AJ. HIV drug resistance. The New England journal of medicine. 2004;350:1023–1035. doi: 10.1056/NEJMra025195. [DOI] [PubMed] [Google Scholar]
- 5.Shafer RW. Rationale and uses of a public HIV drug-resistance database. The Journal of infectious diseases. 2006;194:S51–58. doi: 10.1086/505356. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Grant RM, Kuritzkes DR, Johnson VA, Mellors JW, Sullivan JL, et al. Accuracy of the TRUGENE HIV-1 genotyping kit. Journal of clinical microbiology. 2003;41:1586–1593. doi: 10.1128/JCM.41.4.1586-1593.2003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Archer J, Weber J, Henry K, Winner D, Gibson R, et al. Use of four next-generation sequencing platforms to determine HIV-1 coreceptor tropism. PloS one. 2012;7:e49602. doi: 10.1371/journal.pone.0049602. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Hedskog C, Mild M, Jernberg J, Sherwood E, Bratt G, et al. Dynamics of HIV-1 quasispecies during antiviral treatment dissected using ultra-deep pyrosequencing. PloS one. 2010;5:e11345. doi: 10.1371/journal.pone.0011345. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.McElroy K, Thomas T, Luciani F. Deep sequencing of evolving pathogen populations: applications, errors, and bioinformatic solutions. Microbial informatics and experimentation. 2014;4:1. doi: 10.1186/2042-5783-4-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ram D, Leshkowitz D, Gonzalez D, Forer R, Levy I, et al. Evaluation of GS Junior and MiSeq next-generation sequencing technologies as an alternative to Trugene population sequencing in the clinical HIV laboratory. Journal of virological methods. 2015;212:12–16. doi: 10.1016/j.jviromet.2014.11.003. [DOI] [PubMed] [Google Scholar]
- 11.Jordan MR, Kearney M, Palmer S, Shao W, Maldarelli F, et al. Comparison of standard PCR/cloning to single genome sequencing for analysis of HIV-1 populations. Journal of virological methods. 2010;168:114–120. doi: 10.1016/j.jviromet.2010.04.030. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Pandit A, de Boer RJ. Reliable reconstruction of HIV-1 whole genome haplotypes reveals clonal interference and genetic hitchhiking among immune escape variants. Retrovirology. 2014;11:56. doi: 10.1186/1742-4690-11-56. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Yang X, Charlebois P, Gnerre S, Coole MG, Lennon NJ, et al. De novo assembly of highly diverse viral populations. BMC genomics. 2012;13:475. doi: 10.1186/1471-2164-13-475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Schirmer M, Sloan WT, Quince C. Benchmarking of viral haplotype reconstruction programmes: an overview of the capacities and limitations of currently available programmes. Briefings in bioinformatics. 2014;15:431–442. doi: 10.1093/bib/bbs081. [DOI] [PubMed] [Google Scholar]
- 15.Prosperi MC, Yin L, Nolan DJ, Lowe AD, Goodenow MM, et al. Empirical validation of viral quasispecies assembly algorithms: state-of-the-art and challenges. Scientific reports. 2013;3:2837. doi: 10.1038/srep02837. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Eid J, Fehr A, Gray J, Luong K, Lyle J, et al. Real-time DNA sequencing from single polymerase molecules. Science. 2009;323:133–138. doi: 10.1126/science.1162986. [DOI] [PubMed] [Google Scholar]
- 17.Jiao X, Zheng X, Ma L, Kutty G, Gogineni E, et al. A Benchmark Study on Error Assessment and Quality Control of CCS Reads Derived from the PacBio RS. J Data Mining Genomics Proteomics. 2013;4:16008. doi: 10.4172/2153-0602.1000136. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Roberts RJ, Carneiro MO, Schatz MC. The advantages of SMRT sequencing. Genome biology. 2013;14:405. doi: 10.1186/gb-2013-14-7-405. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Wain-Hobson S, Vartanian JP, Henry M, Chenciner N, Cheynier R, et al. LAV revisited: origins of the early HIV-1 isolates from Institut Pasteur. Science. 1991;252:961–965. doi: 10.1126/science.2035026. [DOI] [PubMed] [Google Scholar]
- 20.Chaisson MJ, Tesler G. Mapping single molecule sequencing reads using basic local alignment with successive refinement (BLASR): application and theory. BMC bioinformatics. 2012;13:238. doi: 10.1186/1471-2105-13-238. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Miller JR, Koren S, Sutton G. Assembly algorithms for next-generation sequencing data. Genomics. 2010;95:315–327. doi: 10.1016/j.ygeno.2010.03.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Beerenwinkel N, Zagordi O. Ultra-deep sequencing for the analysis of viral populations. Curr Opin Virol. 2011;1:413–418. doi: 10.1016/j.coviro.2011.07.008. [DOI] [PubMed] [Google Scholar]
- 23.Gianella S, Richman DD. Minority variants of drug-resistant HIV. The Journal of infectious diseases. 2010;202:657–666. doi: 10.1086/655397. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Li JZ. HIV-1 drug-resistant minority variants: sweating the small stuff. The Journal of infectious diseases. 2014;209:639–641. doi: 10.1093/infdis/jit656. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Adachi A, Gendelman HE, Koenig S, Folks T, Willey R, et al. Production of acquired immunodeficiency syndrome-associated retrovirus in human and nonhuman cells transfected with an infectious molecular clone. Journal of virology. 1986;59:284–291. doi: 10.1128/jvi.59.2.284-291.1986. [DOI] [PMC free article] [PubMed] [Google Scholar]