| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |

From the Departments of Pathology, Immunology, and Laboratory Medicine
*
and Pediatrics,
University of Florida, Gainesville, Florida
| Abstract |
|---|
|
|
|---|
1.5 days versus
5.2 days for sending the test to a reference laboratory. We hypothesized that the rapid availability of a negative test result would allow physicians to discharge appropriate patients earlier. Six months after implementation, clinical case analysis identified 12 pediatric patients who were discharged earlier based on more rapid test results, with a projected savings of
55.2 hospital days throughout the first year. Actual length of stay for patients tested in-house was significantly less than that of historical controls and was projected to save
70.2 hospital days in the first year. Including projected annual laboratory cost/test savings of
$11,000, a total savings of $38,000 to $43,000 was estimated for the first year of implementation, more than offsetting startup instrument and development cost. | Introduction |
|---|
|
|
|---|
60 to 70% of patients have a typical herpetic skin rash, with or without disseminated infection involving brain, liver, lung, and other organs.1
Because central nervous system HSV can present with seizures, low-grade fever, and other nonspecific symptoms in the absence of the vesicular skin rash, physicians often rely on a negative cerebrospinal fluid (CSF) HSV polymerase chain reaction (PCR) to rule out HSV encephalitis.2, 3, 4
In our hospital HSV CSF PCR was sent to a reference laboratory with an average 5.2-day turnaround time. We attempted to show that performing HSV CSF PCR in the hospital laboratory would shorten this turnaround time and lead to an earlier discharge for a subset of neonates without other complications who were kept in the hospital for observation pending this test result. | Materials and Methods |
|---|
|
|
|---|
18 years).
Estimation of Cost Savings
Preimplementation Study
To estimate hospital cost savings from more rapid reporting of HSV PCR results, we first set up an automatic fax-based notification to one of the authors (K.H.R.) whenever HSV CSF PCR was ordered. For all patients <60 days of age, the author then contacted the attending physician personally 2 to 3 days after the test was ordered and before the report of a result. Each physician was asked, "If I were to tell you now at this time that the HSV CSF PCR was negative for your patient, would you discharge the patient today, yesterday, tomorrow, or would it have no effect on the patients length of stay?" All patients were then followed to determine when they actually were discharged, and the net difference in days was recorded. If the patient was not discharged within a day of the actual report of a negative HSV CSF PCR, the physician was recontacted to determine whether other factors had delayed the patients discharge.
Postimplementation Analysis
After implementation of the test in the hospital laboratory, all patients with HSV PCR ordered on CSF were recorded by the hospitals utilization department. Each case was discussed with the patients attending physician (for adult patients) to ascertain whether the patient was believed to have been discharged from the hospital earlier because of the more rapid reporting of the HSV PCR result, and if so, by how many days. For pediatric patients, all patients were reviewed by one of the authors (R.M.L.), a pediatric infectious diseases specialist to estimate hospital days saved (if any) as a result of the more rapid availability of the result. Cost savings was calculated from the hospitals estimated actual cost/day multiplied by the total estimated days saved. We used 2002 direct variable costs of $450/day for the low-intensity neonatal intensive care unit direct variable cost, $502/day for pediatric, and $609/day for adult nonday of admission or nonday of discharge cost/day.
Because the clinical case reviews were in part subjective, we also looked at the actual length of stay (LOS) in days for all patients with HSV CSF PCR ordered between May 7, 1996 through January 24, 2004, divided by age group and location of PCR test performance, as described above. Patients discharged on day 1 were excluded from this evaluation because the results of the test could not possibly have influenced the discharge decision. Patients discharged between 2 to 10 days after admission were included in the study, because it was possible that test results could have influenced a discharge decision within this time period. Patients discharged after
11 days were not included in the sta-tistical evaluation because patients remaining in the hospital more than 10 days were assumed to have medical condition(s) that would not have been influenced by the results of the CSF HSV PCR performed in the first several days after admission. The distribution of LOSs between the group who had the test sent to a reference laboratory and the group whose test was performed in the hospital laboratory was analyzed by
2 test.
The LOS analysis was performed for all patients who had the test performed. In addition, we attempted to improve the comparability of the groups by matching for primary diagnosis. In this approach, only those in-house tested patients, whose primary diagnosis code was the same as that of one or more control patients, were divided into the same age groups and test location. The distribution of LOSs between the primary diagnosis matched group who had the test sent to a reference laboratory and the group whose test was performed in the hospital laboratory was analyzed by
2 test.
Viral Isolates
A total of 95 strains of HSV-1 and 95 strains of HSV-2 were obtained from the Diagnostic Virology Laboratory at Shands Hospital at the University of Florida, Gainesville, FL. All HSV strains were grown in MRC 5 or A 549 cell lines (obtained from both Viromed, Minnetonka, MN, and Diagnostic Hybrids, Athens, OH). All isolates were typed using fluorescent monoclonal antisera specific for HSV type 1 or type 2 (Bartels, Bellevue, WA).
PCR Development
HSV DNA extraction from tissue culture supernates was performed using Qiagen Blood Mini kit spin columns (Qiagen, Inc., Valencia, CA). Quantitated HSV-1 DNA (1.2 x 104 copies/µl), obtained from ABI (Columbia, MD) was used as a positive control. A TaqMan real-time PCR was developed for use on the Smartcycler II (Cepheid, Sunnyvale, CA). The primer sets were synthesized by GenoMechanix (Alachua, FL) and were all high performance liquid chromatography purified. Labeled probes were synthesized by BioSearch Technologies (Novato, CA). We modified a real-time FRET PCR assay developed by Espy and colleagues5
that targets the HSV DNA polymerase. We modified the sense primer,5
and substituted a unique anti-sense primer to achieve Tms of
60 to 62°C. The primers were: sense, CTCGAGTGCGAAAAGACGTTC and anti-sense, GTATCGTCGTAAAACAGCAGGTC. The following unique probe was synthesized to have a Tm 8 to 10°C greater than the Tm of the primers; FAM-AAG GGC GTG GAT CTG GTG CG-BHQ-1. PCR reaction mixes consisted of OmniMix HS beads (Cepheid) (1.5 U TaKaRa hot start Taq, 200 µmol/L dNTPs, 4 mmol/L MgCl2, HEPES, pH 8), additional MgCl2 to 6 mmol/L, 0.4 µmol/L primers, 0.2 µmol/L probe, 5% dimethyl sulfoxide (DMSO), and 5 µl of DNA per 25 µl of reaction volume. After an initial denaturation step at 95°C for 2 minutes, a two-step PCR was performed with a 15-second denature step at 95°C, and a 30-second anneal step at 64°C, using a maximal ramp-down rate for 45 cycles. The assay detects both HSV-1 and HSV-2 and does not distinguish between them. A total of 190 strains of HSV were successfully amplified using these primers. All 95 HSV-1 and 94 of 95 strains of HSV-2 were detected by the probe. The HSV-2 strain not detected by the probe was sequenced. A specific probe was synthesized for this strain; Quasar 670-AAG GGC GTC GAC CTG GTG CG-BHQ-2. This probe was incorporated into the assay with no apparent loss of sensitivity.
The studies reported here were performed without the addition of an internal control for extraction and amplification. For purposes of determining hospital cost savings, this approach is justified. We currently use a multiplex assay that includes an internal control consisting of 17.5 pg of mouse DNA/reaction mixture and final concentrations of the mouse primers (sense, GTTGTAGGACAGGGTTTGGGT and anti-sense, CTCTGAATTTCCGGTTCCTGTT; each at 0.1 µmol/L) and 0.2 µmol/L probe Cal-Orange-CGGCCTCCGGTAGCCTCTCCA-BHQ-1 (courtesy of Perry Chan, Ph.D., Esoterix, Calabasas Hills, CA). The addition of the internal control had no effect on the end point sensitivity of the assay for HSV as shown in Table 1
.
|
Assay Optimization
Tween-20, bovine serum albumin (BSA), and Trehalose were tested alone and in combination at various concentrations with or without 2% DMSO to improve the sensitivity of the assay.
| Results |
|---|
|
|
|---|
In addition, replicate end point dilutions of the ABI HSV-1 reference DNA were sent blinded to two national reference laboratories and compared with in-house results. Figure 1
shows the interlaboratory comparison of the end point dilution study. The y axis shows the number of copies/reaction mixture and the x axis shows the measured cycle threshold, CT. All laboratories detected both replicates at four copies/reaction mixture, but as expected detection below that level was less inconsistent.
|
2). Of the 15 strains each of HSV-1 and HSV-2 sent to the two national reference laboratories, reference laboratory A did not detect one strain and laboratory B did not detect 2; however, both were detected on repeat testing with a subsequent aliquot. We also tested 30 HSV-1 and HSV-2 culture-positive and 30 culture-negative clinical samples (respiratory, skin, and genital) using the original material submitted for culture. All 30 culture-positive specimens were positive by PCR and 1 of 30 culture-negative specimens was also positive by PCR.
Preimplementation Estimate of Cost Savings
Before HSV PCR test development, attending physicians contacted 2 to 3 days after ordering HSV CSF PCR, stated that four (of a total of 13) infants would have been discharged at the time they were told HSV CSF PCR was (hypothetically) negative. Compared with the time the patient was actually discharged, this would have resulted in a savings of 9 full days (2.25 days per patient) at a direct variable cost of $450 per day, or
$ 4050 throughout a 4-month period, or
$12,150 on an annual basis.
HSV PCR Turnaround Time
Before in-house testing, the time from test order until result reporting from the outside reference laboratory was an average of 5.2 ± 7.2 days with a median of 4.1 days and 95% CI of 4.5 to 5.9 days. When performed in-house on Mondays, Wednesdays, and Fridays, the turnaround time was 1.5 ± 1.0 days, 95% CI 1.3 to 1.7 days for the first 9 months after implementation.
Postimplementation Estimate of Cost Savings
A clinical expert case-based estimate of hospital days saved from the more rapid availability of HSV CSF PCR was performed by one of us (R.M.L., a pediatric infectious diseases specialist) for all pediatric cases (<18 years), and by discussion with the patients attending physician for adult cases (
18 years). Of 32 infants, 5 were thought to have been discharged an average of 2.1 ± 0.55 (95% CI 1.4 to 2.8) days per patient sooner, than if the PCR test had been sent to the reference laboratory (10.5 total hospital days). Of 23 children aged 30 days to 3 years, 4 were thought to have been discharged an average of 2.9 ± 0.75 (95% CI 1.7 to 4.1) days (11.5 days total) sooner. Two older children and one adult were judged to have been discharged 2.5, 2.5, and 2 days, respectively, sooner. In total, 29 hospital days were estimated to have been saved throughout a 6.3-month period, which would be projected to save a total of 55.2 days for 1 year or
$27,011 (assuming a direct variable hospital cost per day of $450 per day for low-intensity neonatal intensive care unit, $502 per day for pediatric, and $609 per day for adults; see Materials and Methods).
Because of the inherent subjectivity of the expert case analysis, we also analyzed the actual LOS before and after implementation of the in-house test. When all patients across all age groups were combined (excluding those with a LOS of 1 day or
11 days; see Materials and Methods), the LOS of the patients whose test was performed in-house was significantly shorter than that of those whose test was sent to the reference laboratory (P < 0.05; Figure 2A
). When broken down by age group, the shorter LOS was statistically significant only for the newborn group (Figure 2B)
, but not for older children or adults. Because health care practices could potentially have changed throughout the 7-year historical control period, we also compared the LOS after the introduction of HSV CSF PCR with that of the year immediately before its implementation. For the newborn age group the LOS was significantly shorter when compared with the 1-year historical controls (P < 0.01; data available on request). When LOS was compared for those patients matched by primary diagnosis, the LOS was again significantly shorter for the entire group (Figure 2C)
and for the newborn age group (Figure 2D)
, P < 0.01 for both, but not for any of the older child or adult age groups.
|
$31,590.
Acyclovir Usage
Mean pediatric acyclovir usage decreased from 58.6 ± 20 g/month for the 2 years before implementation of in-house HSV PCR testing to 37.6 ± 15.8 g for the subsequent 5 months after, t = 2.2, P = 0.018, one-tail. There was no change in adult usage of acyclovir.
| Discussion |
|---|
|
|
|---|
|
One national reference laboratory failed to detect one and the other failed to detect 2 of the 30 total HSV-1 and HSV-2 viral isolates submitted under code. Both labs could detect these strains in follow-up specimens, so it is unlikely sequence variation accounted for the problem. Because the analytic sensitivity of their assays was essentially one to two copies per reaction, we can only speculate that the negative results may represent failure of DNA extraction. We did not specifically inquire if these laboratories included an internal control for extraction; however, the end point dilution study samples were discussed with the laboratory directors and were to be tested without nucleic acid extraction.
As in many institutions, cost was a major consideration in the introduction of new technology into routine clinical laboratory usage. At the time the decision to implement was made, comparable systems such as the LightCycler and ABI real-time PCR instruments cost between $60,000 to $80,000 with accessories, compared with the cost of the SmartCycler (
$29,000). We therefore justified the capital outlay on the expectation that more rapid availability of negative CSF HSV PCR results would lead to earlier patient discharge, especially neonates and young children. Analysis of the patient impact in the first 6 to 7 months after implementation of the PCR, support this conclusion. On the basis of individual case analysis by a pediatric infectious disease specialist and consultation with the attending physicians caring for the adult cases, an estimated 12 patients were discharged a total of 29 days sooner than would have been expected if the test had been sent to a reference laboratory. When annualized and adjusted for hospital ward differences in direct variable cost, an estimated savings of 55.2 hospital days or
$27,011 in the first year would be achieved. This does not take into consideration savings from the lower cost/test by performing the test in-house, nor the savings due to decreased use of acyclovir. Because of the inherently subjective nature of the case analysis, the actual LOS of the patients who had the CSF HSV PCR performed in-house was compared with those whose test was sent to a reference laboratory during the previous 7 years. This analysis also showed statistically earlier discharge and the estimated number of hospital days based on the difference between observed and expected in the
2 distribution was 70.2 days or
$31,590 annually. When the lower cost of the in-house test compared with reference laboratory cost was included, an additional annual savings of
$11,000 was realized, bringing the total savings to $42,590 in the first year. Thus, the estimated actual savings ($42,590) was greater than the cost of the instrument ($29,000) plus the estimated $8000 in test development costs (mostly technologists time).
Cimolai and colleagues10
reported on the clinical impact of the introduction of CSF HSV PCR and also achieved
2-day turnaround time for in-house test reporting. In their study negative test results led to the discontinuation of acyclovir in 34 of 81 patients. They also noted that negative results were likely to lead to earlier hospital discharge, but did not provide cost estimates for the savings from either reduced use of acyclovir or earlier hospital discharge. Several other groups have analyzed the clinical impact of real-time PCR testing for CSF enterovirus. Projected direct variable cost savings were achieved by earlier discharge of patients and decreased use of antibiotics,11, 12, 13
although some of the cost reductions depend on the prevalence of enterovirus meningitis exceeding a certain threshold.13
In conclusion, we developed a real-time PCR for HSV using the Cepheid SmartCycler with sensitivity comparable to that of national reference laboratories using LightCycler. Cost savings achieved through decreased LOS and reduced cost per test were projected to more than offset the capital and development costs within a year.
| Acknowledgments |
|---|
| Footnotes |
|---|
Supported in part by the Department of Pathology, Immunology, and Laboratory Medicine, Shands Hospital at the University of Florida, Gainesville, FL; and Cepheid, Sunnyvale, CA.
Accepted for publication May 16, 2005.
| References |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
T. Solomon, I. J Hart, and N. J Beeching Viral encephalitis: a clinician's guide Practical Neurology, October 1, 2007; 7(5): 288 - 305. [Abstract] [Full Text] [PDF] |
||||
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |