| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |

From the Arizona Cancer Center,
*
The University of Arizona; and the Arizona Respiratory Center,
The University of Arizona, Tucson, Arizona
| Abstract |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
100 types) the ones classified as oncogenic types are of clinical significance due to their association with cervical neoplastic development and carcinoma. Although most HPV infections are transient, a number of host and viral factors may lead to a persistent infection thus increasing the risk of developing neoplasia.1
Understanding the natural history of oncogenic HPV infection and the predictive value of one or several HPV test, is, therefore, essential for the development of appropriate cervical cancer prevention and control programs. The limitations of cytological analysis have pressured the development of alternative screening methods in population studies, with molecular diagnosis emerging as a promising diagnostic tool in cervical cancer prevention.2
Quality assurance of these emerging technologies is paramount for large-scale clinical investigations.3
In population-based studies, questions of reliability, sensitivity, specificity, reproducibility, and scalable capacity for automation are central in selecting assays to determine factors associated with cervical carcinogenesis. Prevalence studies conducted worldwide indicate that approximately 30% of women are infected with HPV. Therefore, the use of HPV testing as a primarily screening tool is not sufficient.4 Alternative measures that may have greater predicted value, such as HPV viral load, are currently under investigation. Several studies have correlated HPV viral load and its prognostic significance in the evolution of cervical intraepithelial neoplasia.5, 6 The methodologies used to quantitate viral burden have varying levels of specificity and sensitivity and performance evaluation is frequently not comprehensive. Hybrid capture has been a common technique used to determine HPV viral load, but does not have the capacity to differentiate specific types of HPV.7, 8 PCR-based methods using densitometric analysis have frequently been used to determine HPV viral burden and its association with cervical lesion development.9, 10, 11 However, the estimation of viral load using semi-quantitative PCR may be inaccurate due to the inherent efficiency of the detection system as well as the presence of inhibitors in the sample.12
Real-time PCR is a more recent addition in the molecular diagnosis of HPV infection.13 Real-time PCR has the advantage of being highly specific, reproducible, and capable of detecting HPV viral load up to eight orders of magnitude in a linear range.14 These qualities make real-time PCR attractive for use in epidemiological studies and as a potential diagnostic test. Several studies reported the predictive value of HPV viral burden determined by real-time PCR and the persistence of HPV infection.13, 15, 16, 17 These studies, however, only focused on the quantitation of viral load for HPV type 16.
To our knowledge, there has been no systematic evaluation of real-time PCR to determine viral load for oncogenic HPV types based on standardized criteria of quality control assurance. Here, we present a quality control evaluation to assess the sensitivity, specificity, and reproducibility (intra- and inter-assay variability) of viral load quantitation using the ABI Prism 7900 Sequence Detection System for eight oncogenic HPV types (16, 18, 31, 39, 45, 51, 52 and 58). The analytical performance was based on the National Committee for Clinical Laboratory Standards (NCCLS) guideline EP10-T, using a 10-µl volume reaction in a high-throughput format (384-well system for the processing of large number of samples).
| Materials and Methods |
|---|
|
|
|---|
|
Limiting Dilution
The approximate plasmid DNA concentration for each HPV type was determined by a modification of the PCR-based limiting dilution assay described elsewhere18, 19
and used as reference material. Briefly, using a preliminary calculation of plasmid copy number based on PicoGreen quantitation, ten replicates of a 10-fold dilution series for the plasmid DNA were created (from 1:10 to 1:1 x 108). The last dilution of the 10-fold dilution series was used to create a twofold dilution series (from 1:2 to 1:4096) covering a range from 2 x 108 to 4.096 x 1011 copies/µl. One µl of each dilution from the twofold dilution series was added to a 10-µl PCR reaction and subjected to 50 PCR cycles using the ABI PRISM 7900HT (Applied Biosystems). Annealing temperatures for each HPV type were used as determined by the primer titration study, and non-template controls were used in each case to establish the threshold. The proportion of negative end points (fluorescence values not significantly different at 5% level above background) served to estimate the concentration of the undiluted reference material by Poisson probability distribution using the computer program QUALITY V1.1.4 described by Rodrigo et al.18
PCR Optimization
To assess the optimal primer ratio and annealing temperature for each HPV type, a series of six primer ratios were tested covering a range of 50 to 900 mmol/L. Each primer ratio was run in triplicate in a 10-µl PCR reaction using the TaqMan universal PCR master mix (Applied Biosystems). Each PCR was run for 45 cycles covering a gradient of annealing temperature from 52°C to 65°C. The PCR reaction was transferred to a 384-well plate and the fluorescence signal was read using the ABI PRISM 7900HT (Applied Biosystems). The primer ratio and annealing temperature were chosen according to the highest fluorescence signal normalized with a passive internal reference dye in the PCR reaction.
Standard Curves and Controls
External standard curves were generated by serial dilutions of known input concentrations of HPV DNA covering a range from 1 copy to 1 x 107 copies/10 µl reaction. Each dilution was aliquoted in 20-µl volume and stored at 20°C until used. Human blood DNA (known to be HPV negative) was used as background DNA for an equivalent of 100 cells per PCR reaction. DNA from human blood, exfoliated cervical cells, and cell lines were extracted using the QIAamp purification kit (QIAGEN) according to the instructions of the manufacturer. DNA concentration was determined using a real-time PCR quantification assay for the housekeeping gene RNase P (Applied Biosystems). Eight points for each standard curve covering a dynamic range from 100 to 107 were run in triplicate along with non-template controls to set the threshold value. DNA extracted from CaSki cells or HeLa cells was used as positive control for HPV-16 or HPV-18, respectively. Specific HPV clones were used as homologous templates for HPV-31, -39, -45, -51, -52, and -58.
Real-Time PCR
All PCR reactions were performed in a 10-µl volume using the ABI PRISM 7900HT (Applied Biosystems). Each individual reaction contained 5 µl 2X TaqMan universal PCR master mix with uracil-N-glycosylase (Applied Biosystems), 1 µl 200 nmol/L fluorogenic probe, 1 µl primer ratio, 0.65 ng human blood DNA, and up to 3 µl HPV DNA or sterile HPLC-grade water in non-template controls. The amplification profile was initiated by a 2-minute incubation at 50°C, followed by a 10-minute incubation at 95°C, and a two-step amplification of 15 seconds at 95°C and 60 seconds at 59.3°C or 54.1°C for 45 cycles. Data were collected at the end of the amplification step. All experiments were performed in triplicate including the positive controls and non-template controls.
Validation Assay
The accuracy, efficacy, and reliability of HPV DNA quantification by real-time PCR were evaluated using the National Committee for Clinical Laboratory Standards EP10-T guidance: "Preliminary Evaluation of Chemistry Clinical Methods."20
In sum, four concentrations of HPV DNA (101 copies/µl, 102 copies/µl, 104 copies/µl, and 106 copies/µl) for HPV types 16, 18, 31, 39, 45, 51, 52, and 58 were created by diluting the reference solution in TE buffer and analyzed in triplicate in eight independent assays to evaluate intra- and inter-assay variation. Specificity was evaluated using human blood DNA (
5 ng) spiked with clones for HPV-16, HPV-18, HPV-31, HPV-39, HPV-45, HPV-51, HPV-52, or HPV-58 as heterologous DNA templates at an input copy number of 1 x 106 copies/PCR reaction. Each sample was used as unknown in type-specific HPV quantitation assays. Four clinical samples obtained from exfoliated cervical cells with known high and low HPV-16 copy numbers were run to verify accuracy of the assay and their DNA concentration was determined by the RNase-P assay. DNA extracted from CaSki and HeLa cell lines was used as positive controls for HPV-16 and HPV-18, respectively.
Statistical Analysis
Repeatability or intra-assay variation (defined as the degree of agreement among individual tests) was calculated by computing the relative SD of three replicates per assay. Reproducibility was assessed by computing the coefficient of variation (%CV) among the mean values in eight independent assays. The efficiency of the standard curves was calculated based on the slope from eight independent experiments.
| Results |
|---|
|
|
|---|
Validation of Reference Curves for HPV Quantitation
Linearity
The reference curves of all HPV types covered a dynamic range being able to discriminate from one up to 107 copies in a linear fashion as indicated in Table 2
. The limit of detection for HPV-16 was determined to be somewhere between 1 to 10 copies based on the percentage of positive reactions at 100 (54% of replicates positive). It was not possible to detect fluorescence at one copy level for HPV-52 in any of the 24 replicates suggesting the reference solution was diluted beyond this point. At 10 copies per tube, however, all 24 replicates for both HPV-16 and HPV-52 were positive and we determined this value to be the lowest detection limit for these HPV-reference curves.
|
|
Intra- and Inter-Assay Variability
Different dilutions of the reference solutions were used as controls to assess the precision and reproducibility of the standard curves to quantitate HPV viral load. Three replicates of the control samples containing either high (106), medium (104 and 102), or low (101) copy number for each HPV type were run as unknowns in eight independent assays. The coefficient of variation was determined based on the values obtained from the replicates (intra-assay variation) and between the experiments (inter-assay variation). The performance results are summarized in Table 3
. As observed in this table, the intra-assay coefficient of variation for all HPV types ranged from 0.45% to 5.77%. The inter-assay coefficient of variation, however, increased proportionally with the dilution of the samples where the smallest variation was observed in the 106 controls and the highest variation was observed in the 101 controls (%CV = 3.91 and 19.71, respectively).
|
Accuracy
To assess assay accuracy we plotted, in a log-log scale, the theoretical input copy number of HPV controls at four levels of analyte concentration against the mean copy values of three replicates obtained from eight independent experiments. The slopes created by plotting the observed and expected values for each specific HPV type are shown in Figure 1
. The deviation from the line of identity (slope = 1) was within the 90% CI for all type-specific HPV plots and ranged between 0.0121 and 0.0553.
|
|
| Discussion |
|---|
|
|
|---|
The selection of an appropriate material to be used as external control presents a particular challenge in developing a quantitative method for HPV since the viral genome can be present in either episomal or integrated forms at different stages during the natural history of HPV infection. Tucker et al14 reported the design of a real-time fluorogenic assay targeting the E6-E7 region to quantitate HPV-16 and HPV-18 viral load. However, this assay used a 50-µl volume reaction and the standard curve was created using PCR amplicons from the targeted regions diluted in buffer and using tRNA as carrier potentially leading to an overestimation of the sensitivity of the assay due to a less complex environment of the standard in comparison with DNA extracted from cells. A recent study using real-time PCR to determine HPV-16 viral load in cervical scrapes used a plasmid clone that contained the full-length HPV-16 DNA to create standard curves.17 However, the standard curves contained only diluted plasmids and the authors did not mention the usage of carrier DNA, and therefore may introduce systematic error in the sensitivity of the assay. In our quantification assay, human blood DNA was spiked with plasmids harboring the targeted HPV region or the whole HPV clone to create standard curves. The addition of human cell equivalents was conducted to account for the natural complexity of the DNA extracted from exfoliated cervical cells since the ultimate goal for our HPV quantitation assay is to use it as a tool in population-screening studies. We tested a range of input DNA and we observed that the dynamic range of the standard curve decreased with increasing concentrations of human DNA (data not shown). Although a large quantity of DNA can be obtained from cervical swabs, the samples have to be diluted to the optimal range of input DNA concentration to have a more accurate reading of viral load.
Perhaps the single most important factor in quantitative assays is the accuracy of the reference solution used as an external standard. Several studies using real-time PCR for the determination of viral load reported different methods to quantitate their reference solutions such as UV absorption,21
fluorescence,14, 15, 22
or they simply failed to describe the method used. Without a doubt, assessing the exact amount of DNA to be used as reference presents a major challenge for absolute quantification particularly while generating the low-end region of the standard curve. Several reports have used limiting dilution to quantitate targeted analytes with high accuracy and precision.23, 24, 25
Consequently, we used a modification of a novel and highly accurate determination of DNA concentration based on the quantitation of low copy number of the analyte using the PCR-based limiting dilution assay described by Rodrigo et al.18
Based on the concentration of the reference materials determined by limiting dilution, the dynamic range for all HPV standard curves cover a ranged of up to seven orders of magnitude (Table 2)
. It is worth noting, however, that the quantitation of reference materials using limiting dilution can introduce bias within the context of sensitivity since it assumes that one copy of the targeted analyte can be amplified by PCR and that enough signal is actually detected. This can create ambiguity in defining the lower limit of detection as observed in the HPV-16 and HPV-52 standard curves where less than 100% of replicates showed no positive amplification during the PCR reaction at one copy per reaction (Table 2)
. Another possibility explaining the reduction of sensitivity of the HPV-16 and HPV-52 standard curves may be related to the probe sequence itself and the efficiency to anneal when the targets are present in a diluted environment. In the case of the HPV-16 standard curve, not all of the 100 standards showed a positive signal in the PCR amplification reaction reflecting a lack of sensitivity at this concentration. Also, the efficiency of the HPV-16, HPV-18, and HPV-52 standard curves were
1.8 which reflects the need for optimization of the PCR conditions, either Mg+2 concentration, type of Taq polymerase, annealing temperature, or designing alternative sets of probes. The low efficiency observed of these standard curves is reflected in the high variability in the low-end of the standard curve (Figure 1)
. For HPV-16 and -18, these results reflect the difficulties in translating a previously described method to a different format.
The performance evaluation of the eight HPV quantitation assays showed an intra-assay variation of less than 6% and an inter-assay coefficient of variation less than 20% illustrating the high reproducibility of the method (Table 3)
. The inter-assay variability in similar validation protocols for real-time PCR assays has been reported to be up to 50%.21, 25, 26
The high inter-assay variability observed in clinical samples compared to controls is a reflection of the complexity and heterogeneity of DNA extracted from exfoliated cervical cells. The accuracy of the eight HPV quantitation assays was high as determined by the small deviation from the line of identity as depicted in Figure 1
. The increment in variation of the observed versus expected relation is a common observation in PCR reactions since the HPV controls were obtained from bacteria and thus some variations in the PCR reaction may be due to the presence of inhibitors.12
Another possibility includes the variation during PCR preparation where bias can be introduced either by mechanical failure of measuring the correct volume in dilutions or by the stochastic process of targeting analytes in a more diluted environment where the homogeneity of sample plays a key role. In addition, the inherent variability in the PCR reaction per se is an important factor for the PCR performance (ie, enzymatic efficiency, primer-probe annealing, and buffer variation). The robustness of the quantitation assay (the capacity of the method to remain unaffected by small variations in the main parameters) was tested by a multiplex assay to simultaneously quantitate HPV-16 and HPV-18 in the same reaction. The results, however, showed a marked decrease in sensitivity thus suggesting that increasing the complexity of the reaction can lead to competition for PCR components (data not shown). The limitation of the present quantitation method is the need to determine a housekeeping gene as a measure of cell equivalent in a separate reaction, thus introducing variability with respect to viral load quantitation from the same sample.
One of the advantages of using in-house standards is the ability to mimic the complexity of the biological sample being tested. In our assay, the intra- and inter-assay variation showed good reproducibility when DNA from exfoliated cells was used. It was important to evaluate this parameter since the intent is to use the quantitative protocol in population-based screening studies. Although the variability in our quantitative assay was low, the estimation of inter-laboratory reliability is hard to assess since each research laboratory creates its own reference material making the results from independent labs difficult to compare (Gravitt PE, personal communication). In addition, the stability of the in-house reference material can vary overtime even if kept at frozen temperatures, probably due to bacterial remnants during the purification process and the liability of DNA to degrade. It is, therefore, of great importance to develop a reference material with enough robustness in both precision and accuracy that introduces minor systematic error or bias due to batch-to-batch variation for inter-laboratory evaluation.
Our assay showed high degree of specificity for seven of the eight type-specific reactions. The cross-reactivity with HPV-18 observed in the HPV-16 reaction is in agreement with the results obtained by Tucker et al.14 This cross-reactivity could be the result of non-specific primer and probe hybridization under the PCR conditions used. However, this represents only a small variation in the specificity of the HPV-16 reaction since only 100 copies are quantitated after 45 PCR cycles with an input DNA of approximately 1 x 106 copies per reaction. The output/input ratio of 0.001 for HPV-16 indicates that the HPV-16 primers anneal with low efficiency to a similar yet unspecific region. Strategies to improve specificity include changing parameters in the PCR reaction such as the addition of DNA-stabilizing co-solvent to increase the melting temperature and use of conditions that are more stringent in the PCR reaction.27
To our knowledge, this is the first time that an absolute quantitation assay to determine HPV viral load has been evaluated using quality assessment protocols for its potential to be transferred from the research lab to the analytical lab. However, the clinical significance of HPV viral load and the robustness of real-time PCR measure as primary screening tools in cervical cancer prevention and control remains to be determined. The real-time PCR assay developed in our laboratory is highly specific for eight oncogenic HPV types, highly reproducible in a wide dynamic range, performed in minimal reaction volume, and suitable for high-throughput format.
| Acknowledgments |
|---|
| Footnotes |
|---|
Supported in part by a grant from the National Cancer Institute Grant RO1-CA81310.
Accepted for publication January 14, 2004.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
N. Azizi, J. Brazete, C. Hankins, D. Money, J. Fontaine, A. Koushik, A. Rachlis, K. Pourreaux, A. Ferenczy, E. Franco, et al. Influence of human papillomavirus type 16 (HPV-16) E2 polymorphism on quantification of HPV-16 episomal and integrated DNA in cervicovaginal lavages from women with cervical intraepithelial neoplasia J. Gen. Virol., July 1, 2008; 89(7): 1716 - 1728. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Guo, Y. Gong, M. Deavers, E. G. Silva, Y. J. Jan, D. E. Cogdell, R. Luthra, E. Lin, H. C. Lai, W. Zhang, et al. Evaluation of a Commercialized In Situ Hybridization Assay for Detecting Human Papillomavirus DNA in Tissue Specimens from Patients with Cervical Intraepithelial Neoplasia and Cervical Carcinoma J. Clin. Microbiol., January 1, 2008; 46(1): 274 - 280. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |