| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |
Published online before print April 26, 2007
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
From the Department of Molecular and Medical Genetics, Molecular Diagnostic Center, Oregon Health and Science University, Portland, Oregon
| Abstract |
|---|
|
|
|---|
| Introduction |
|---|
|
|
|---|
1 in 25 to 30, in individuals of Ashkenazi Jewish descent 1 in 29, in Hispanics 1 in 46, in Africans 1 in 65, and in Asians 1 in 90.5, 6, 7
In 2001, the American College of Medical Genetics (ACMG) and the American College of Obstetricians and Gynecologists (ACOG) recommended that CF carrier screening be offered to reproductive couples.6
Of the 1300 CFTR sequence variants identified (http://www.genet.sickkids.on.ca), a screening panel of 25 CFTR mutations was initially selected based on inclusion criterion of mutations having a threshold of 0.1% frequency in the general US population.8
In addition, they recommended reflex testing for R117H of the 5/7/9T polymorphic alleles in intron 8, as well as reflex testing for individuals homozygous for
F508, ie, testing for interference from benign variants I506V, I507V, and F508C. This panel was modified in 2004 and currently includes 23 CFTR mutations as well as the R117H and
F508 reflex tests.7
Using this panel, the resulting carrier detection rate, for Ashkenazi Jews, Northern European Caucasians, Hispanics, African Americans, and Asians is 94 to 97%, 90%, 72%, 64 to 69%, and 49%, respectively.6, 7, 8
Frequency and ethnic distribution of additional CFTR mutations in the US population, with prevalence of <0.1%, that may be of interest to clinical laboratories are described by Heim and colleagues.9 The ACMG and ACOG recommendations prompted an increase in CF testing and concomitant stimulation of development of multiple CF testing reagents and systems. In addition, as of 2004, eight states were using newborn screening programs in which DNA analysis to detect specific CFTR mutation followed an elevated immunoreactive trypsinogen test.10 The CF testing options available to clinical laboratories commercially or for evaluation are as diverse as the rapidly evolving technologies used to create them. In 2003, Tomaiuolo and colleagues11 evaluated (accuracy, time, cost) the following four procedures for molecular diagnosis of CF: allele-specific oligonucleotide dot-blot (homebrew), reverse dot-blot (Innogenetics, Gent, Belgium), amplification refractory mutation system (ARMS) (Zeneca Diagnostics, Oxfordshire, UK), and oligonucleotide ligation assay (OLA)-polymerase chain reaction (PCR) (PE Applied Biosystems, Foster City, CA). Recently, a time-motion analysis of six commercially available CF testing platforms was performed by Krafft and Lichy on CF v3 OLA analyte-specific reagent (ASR) (Abbott Laboratories/Celera Diagnostics, Abbott Park, IL), INNO-LiPA CFTR 35 (Innogenetics: INNO-LiPA), CF Gold 1.0 (Roche, Indianapolis, IN), Tag-It CF 40 + 4 (Tm Biosciences, Toronto, ON, Canada), CF eMAP/Bead Chip (BioArray Solutions, Warren, NJ), and Invader (Third Wave Technology, Madison, WI).12 Several platforms have been evaluated individually as well: Tag-It CF 40 + 4 (Tm Biosciences) by Amos and colleagues13 ; Signature (Asuragen, Austin, TX) by Hadd and colleagues14 ; CF eMAP/BeadChip (BioArray Solutions) by Edelmann and colleagues15 ; and CF APEX DNA microarray chip by Schrijver and colleagues.16 The bases of many of the CFTR testing technologies have been reviewed as well.17, 18, 19
Here, we report a comparative study of five technologically diverse CFTR testing platforms: 1) eSensor CF carrier detection system (Osmetech Molecular Diagnostics, Pasadena, CA); 2) CFTR InPlex ASR (Third Wave Technology); 3) CF v3 OLA ASR (Abbott Laboratories/Celera Diagnostics); 4) Signature CF 2.0 ASR (Asuragen); and 5) Tag-It mutation detection kit for CFTR 40 + 4 (currently known as Tag-It cystic fibrosis kit) (Tm Biosciences). Parameters evaluated include sensitivity, specificity, accuracy, ability to genotype, ability to reflex test according to ACMG recommendations, no calls/repeat rate, mutation panel content, hands-on time, start-to-finish time, laboratory work flow, input DNA range, data analysis methods, custom test design options, and required instrumentation. The resulting data demonstrate the diversity among the platforms and underline the need to evaluate the specific requirements and resources of a testing center in an effort to select the most appropriate CF platform.
| Materials and Methods |
|---|
|
|
|---|
|
The CFTR InPlex ASR (Third Wave Technology) uses Third Wave Invader DNA chemistry using cleavase enzymes to recognize and cleave specific structures formed by the addition, in tandem, of two oligonucleotides to a nucleic acid target (multiplex PCR amplicons). Likewise, in a secondary reaction, a detectable fluorescent signal is generated via fluorescence resonance energy transfer. Both reactions take place in a microfluidics card containing dried Invader oligos/FRET cassettes. Signal is detected using a fluorometer.
The CF v3.0 OLA (oligonucleotide ligation assay) ASR (Abbott Laboratories/Celera Diagnostics) is based on hybridization of an exact-match PCR primer to the target sequence. Two oligonucleotide probes, one specific to the genotype and one common, then hybridize to the resulting amplicon. Because the genotype-specific probe carries a mobility-modifying 5' tail, and the common probe contains a fluorescent dye marker, the resulting ligation products can then be separated electrophoretically. Signal is detected using an ABI Prism 3100/3130 genetic analyzer.
The Signature CF 2.0 ASR (Asuragen) technology is based on a multiplex PCR using biotin-modified PCR primers and allele-specific capture probes directly conjugated to coded beads on the Luminex 100xMAP platform.
The Tag-It Mutation Detection Kit for CFTR 40 + 4, currently known as Tag-It Cystic Fibrosis Kit, (Tm Biosciences) incorporates multiplex PCR followed by multiplex allele-specific primer extension with Tms proprietary Universal Tag sorting system on the Luminex 100xMAP platform.
Reagents
Reagents and required instrumentation, not currently used in our laboratory, were generously provided by the manufacturers for evaluation.
DNA Samples and DNA Amplification
Seven independent amplifications and runs were performed to challenge each platform with the same core set of 150 DNA samples (Table 1)
allowing for comparison of study parameters discussed below. This core set represented the ACMG/ACOG 23 and normal samples. All of the ACMG/ACOG recommended panel of 23 CFTR mutations are represented except 2184delA. The samples included coded anonymized patient samples, CAP samples, and Coriell samples. Patient sample DNA was isolated using either MagNa Pure LC DNA isolation kit 1 (Roche) or the Gentra Generation capture column kit (Gentra Systems, Minneapolis, MN). In addition to the core set of samples, DNA from eight additional split patient samples was isolated using both MagNa Pure LC DNA Isolation Kit 1 and Gentra Generation capture column kit for direct comparison of utility of these isolation methods on each panel. For all assays, DNA amplification steps were performed on a PTC-200 DNA engine thermal cycler (MJ Research/Bio-Rad, Hercules, CA).
|
| Results |
|---|
|
|
|---|
|
0.7%). The following platforms were able to resolve a G551D/R553D compound heterozygote: InPlex, Tag-It, Signature, and eSensor. Note that because all platforms were challenged with the same set of 150 DNA samples, only normal samples and samples with genotypes representing the ACMG/ACOG panel of 23 were tested; eSensor and Signature test only the ACMG/ACOG panel of 23.
Reflex Tests
Both the OLA and Signature platforms require poly-T reflex tests to be run separately, whereas the InPlex, Tag-It, and eSensor platforms allow the poly-T reflex test to be run concurrently with other mutations and are masked until user chooses to unmask that data. As to the detection, via reflex testing, of
F508 interfering benign polymorphic variants (I506V, I507V, and F508C), Tag-It, Signature, and OLA require a separate run, whereas eSensor does not require reflex testing for these variants, and InPlex does not require reflex testing for I506V and I507V because, according to the manufacturers, these polymorphisms do not interfere with the hybridization of the wild-type probe on these platforms. We did not test this aspect of either assay. The InPlex probe set does include probes for the identification of F508C and are part of the initial run. The F508C result is masked in the absence of
F508.
Time Considerations
The start-to-finish time and hands-on time are in respect to processing of 24 samples (excluding DNA extrac-tion). We found InPlex to require the least time in both categories. Here, the reported times are based on use of a PTC-200 DNA engine thermal cycler (MJ Research/Bio-Rad).
Input DNA
All platforms tested performed equally well using either MagNa Pure LC DNA Isolation Kit 1 or Gentra Generation capture column kit for DNA isolation from whole blood. The DNA input range, as stated by the manufacturer, is quite broad with the exception of the OLA platform. None of the platforms required DNA quantitation, ie, expected yields as described by the manufacturers of the DNA isolation kits were sufficient to use as estimates of DNA concentration.
Ease of Protocol
We determined ease of protocol based on number of steps, tolerances within those steps, and number of sample transfers. We found the InPlex platform to be of greatest ease, Tag-It to be the most complex, and the remaining three platforms falling in between these.
Signal:Noise Ratio
The signal:noise ratio was not calculable for three of the panels, and therefore this factor was unfortunately not comparable among all platforms.
Required Instrumentation Specific to the Assay
All of the platforms require specialized instrumentation. With the exception of the eSensor, additional tests can be run using the same instrumentation. In addition, three platforms, Tag-It, Signature, and OLA. are considered to be open platforms, ie, enable development of custom tests.
Mutation Panel
All of the panels test, at a minimum, the ACMG/ACOG-recommended panel of 23 CFTR mutations. Of the panels evaluated, InPlex tests for the greatest number of mutations. After the completion of this study, Tm Bioscience introduced a CFTR 70 + 6 ASR; however, this method was not analyzed in this study.
| Discussion |
|---|
|
|
|---|
The ACMG/ACOG panel is panethnic yet primarily based on mutation frequencies in non-Hispanic Caucasian populations and Ashkenazi Jewish population because of high frequency of the disease and availability of mutation data.8 Depending on mutation frequencies of the populations serviced by a particular laboratory, consideration of target mutations may be a determining point in panel selection. Determination of the appropriate test panel may be challenging because of admixture among ethnic groups, inaccurate self-reporting of ethnicity, and extreme heterogeneity of the US population.9
The InPlex, OLA, and Tag-It platforms used in this study contain I148T and 1078delT, which are no longer recommended by ACMG for inclusion in a CF carrier screening panel.7 After completion of this study these variants were removed from the Tag-It panel (which has since been FDA-cleared). Abbott dropped I148T from their OLA panel that has been submitted for FDA clearance. Third Wave Technologies removed I148T and 1078delT from their panel in preparation for FDA regulatory submission. Questions have arisen as to the clinical relevance of two additional mutations, D1270N and D1152H, present in the InPlex panel. Recent publications suggest that D1152H is pathogenic in respect to CF whereas D1270N may not be a causative factor of CF by itself.20, 21, 22 D1270N has been removed from the InPlex panel for FDA submission.
Reflex testing varied significantly throughout the platforms evaluated. Two platforms, OLA and Signature, required poly-T reflex testing be performed on a separate run, ie, the software did not have masking capabilities. eSensor does not reflex for
F508 variants. The manufacturers assert the polymorphisms do not interfere with genotyping. For the same reason, InPlex does not reflex for I506V or I507V. Probes for F508C are included in the initial InPlex run with the result masked in the absence of
F508.
All platforms performed well with DNA extracted using either of the methods used in this study, ie, MagNa Pure LC DNA Isolation Kit 1 and Gentra Generation capture column kit. Although we did not test blood spots, all platform manufacturers except Osmetech Molecular Diagnostics (eSensor) state DNA extracted from blood spots is compatible with their platform. In addition, a recent report summarizing the use of DNA from buccal cells for genotyping suggests that this source of DNA might be a reliable replacement for the analysis of leukocytes for the exclusion of CF in children.23
Information supplied by the manufacturers of the platforms we tested indicate that DNA extracted from buccal swabs has been successfully used with InPlex, Signature, and OLA and has not been fully tested on Tag-It CF or eSensor platforms. As to tolerance of input DNA range (ng), all platforms, except OLA, have a wide window of acceptability (Table 2)
. Although OLA has a narrow range, 1 to 15 ng, in this study we did not quantitate the DNA after extraction and still successfully ran the protocol based on expected DNA extraction concentrations.
The signal-to-noise ratio was not easily compared from platform to platform because of differences in technology, methods of signal calculations and manufacturers definitions of noise. Only Signature and Tag-It, the two liquid bead array assays, provided a signal-to-noise ratio value (Table 2)
. Tag-It demonstrated a very stringent signal to noise ratio.
In consideration of hands-on time and total processing time of each assay, we found the InPlex platform required less than 1 hour and 3.5 to 4 hours, respectively, the least time in both categories of all platforms tested. Throughout the study, MJ PTC-200 thermal cylers were used. After completion of this study, we found that the use of an Eppendorf Mastercycler EP S (Hamburg, Germany) does reduce the start-to-finish time for those assays requiring long or multiple amplification steps. We found the hands-on time determined in this study is a reflection of the complexity of the protocol in the case of Tag-It and for eSensor is attributable to the manual manipulations, eg, dual biochips are required for each sample. Krafft and Lichy12 recently reported a time-motion analysis study of six CF mutation detection systems, including two reported in this study (Tag-It and OLA) as well as the Invader plate system that preceded the InPlex card studied here. Their resulting labor and total assay times are comparable with results reported here.
As shown in Table 2
, all five platforms require instrumentation specific to the detection system, ie, in addition to common laboratory equipment such as a thermal cycler, hybridization oven, and centrifuge. Although instrumentation for four of the platforms is commonly used for detection of mutations in addition to CF, the eSensor is currently used solely for CF testing. The OLA, Signature, and Tag-It platforms are considered to be open platforms allowing for custom test development. Currently, Tag-It and eSensor are FDA-cleared. eSensor is cleared for carrier testing only. Abbott/Celera and Third Wave have completed FDA submissions for their OLA and InPlex products, respectively, whereas Asuragen is actively pursuing a regulatory submission for their expanded Signature panel.
Because pricing of reagents is determined by both the number of tests contracted to be run (including required controls/run) and by the contracted purchase of combinations of multiple test reagents, ie, the number of different test reagents/instrumentation purchased from the same company, calculating actual costs of reagents/patient sample for informational purposes is approximate at best. Here, we estimated the following costs of reagents/patient sample using a capital purchase of equipment model, no discounts for multikit types being run in the laboratory, and
250 samples run per year: InPlex, $39.00; OLA, $64.00; Tag-It, $50.00; Signature, $45.00. Osmetech offers the eSensor 4800 and related reagents as a reagent rental agreement only with the reagent costs being between $65 to $100, depending on volume of tests. A second cost consideration is instrumentation. Future direction of the laboratory may dictate how instruments are acquired, eg, direct purchase or lease. Purchasing an instrument specific to a platform may financially lock the laboratory into using that platform for a period of time that may extend beyond its usefulness. An estimate of direct purchase instrumentation costs (excluding common laboratory equipment such as thermal cyclers, centrifuges, and hybridization ovens) is as follows: InPlex (fluorometer, card bucket and clips, card sealer) $12,900; OLA (ABI Prism 3100/3130 genetic analyzer, 16 capillary), $100,000 to $145,000; Tag-It (Luminex 100xMAP System), $45,000; and Signature (Luminex 100xMAP System), $45,000; eSensor is not offered as a direct purchase. With the exception of the eSensor 4800, all of these instruments are used for multiple platforms. An additional significant arm of cost calculation is the required technician time. Hands-on technician time is shown in Table 2
. Costs of test/patient sample, estimated above, may be reduced with consideration of purchase models, ie, reagent rental versus capital purchase agreements. In addition, test volume and the menu of tests run from the same manufacturer influence reagent cost quotes. All approximate costs of reagents and instrumentation given above are specific to our institution and valid as of the writing of this article and are intended to be used for ballpark comparison purposes only.
Availability of mutation-positive controls is a consideration for all clinical assays. None of the ASRs or in vitro diagnostic tests evaluated in this study includes positive controls. Both DNA and cell line controls for all 23 of the ACMG mutations are available from National Institute of General Medical Sciences Human Genetic Cell Repository (http://locus.umdnj.edu/nigms/). In addition, positive CF controls are available commercially. Aytay and colleagues24 reported the compatibility of Optiqual CF mutation controls (Acrometrix, Benicio, CA) with several CF mutation detection systems including three (Tag-It, OLA, and Signature) evaluated in this study. These synthetic CFTR mutation controls include the 23 ACMG mutations plus five additional mutations. Molecular Controls (Sacred Heart Medical Center, Spokane, WA) offers another synthetic oligonucleotide mixture that has been validated with both the OLA and Tag-It platforms and has applications to other platforms as well. Maine Molecular Quality Controls, Inc. (Scarborough, ME) offers a recently FDA-cleared source of stabilized synthetic nucleic acids CFTR-positive control. This control is designed to mimic whole blood and to be used to assess the performance of the extraction, amplification, and detection protocols for CF. It monitors the presence of the ACMG 23 mutations plus 15 additional mutations and has been validated for OLA, Signature, Tag-It, and eSensor and several other platforms not included in this study. Collaboration with Third Wave regarding validation of this control with InPlex is in progress. This brief description of mutation-positive controls is not intended to be exhaustive, rather to illustrate the commercial variety of choices available to laboratories.
In summary, a prudent choice of a CFTR mutation detection system depends on many parameters, some of which were discussed above. Evaluation of these factors provided valuable information regarding the selection of the CF platform most appropriate for our small academic/hospital clinical laboratory.
| Footnotes |
|---|
C.S.R. was contracted to evaluate the eSensor platform through an agreement with Clinical MicroSensors (now Osmetech) entitled "Multicenter Prospective/Retrospective Evaluation of the Performance Capabilities of the eSensor Cystic Fibrosis Carrier Screening System." Partial support to attend the 2005 Association for Molecular Pathology conference was provided to M.A.J. by Third Wave Technologies.
Accepted for publication February 26, 2007.
| References |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |