J Med Microbiol International Journal of Systematic and Evolutionary Microbiology
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Right arrow Citation Map
Services
Right arrow Email this article to a friend
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via CrossRef
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by McHugh, T D
Right arrow Articles by Gillespie, S H
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by McHugh, T D
Right arrow Articles by Gillespie, S H
Agricola
Right arrow Articles by McHugh, T D
Right arrow Articles by Gillespie, S H
J Med Microbiol 53 (2004), 1215-1219; DOI: 10.1099/jmm.0.45780-0
© 2004 Society for General Microbiology
ISSN 0022-2615

Prospective evaluation of BDProbeTec strand displacement amplification (SDA) system for diagnosis of tuberculosis in non-respiratory and respiratory samples

T D McHugh1, C F Pope1, C L Ling1, S Patel1, O J Billington1, R D Gosling1, M C Lipman2 and S H Gillespie1

1Centre for Medical Microbiology, Department of Infection, Royal Free & University College Medical School, Pond Street, London NW3 2PF, UK 2Department of Thoracic Medicine, Royal Free Hospital NHS Trust, Pond Street, London NW3 2PF, UK

Correspondence T. D. McHugh t.mchugh{at}rfc.ucl.ac.uk

Received June 16, 2004
Accepted August 18, 2004

Nucleic acid amplification techniques (NAATs) have been demonstrated to make significant improvements in the diagnosis of tuberculosis (TB), particularly in the time to diagnosis and the diagnosis of smear-negative TB. The BD ProbeTec strand displacement amplification (SDA) system for the diagnosis of pulmonary and non-pulmonary tuberculosis was evaluated. A total of 689 samples were analysed from patients with clinically suspected TB. Compared with culture, the sensitivity and specificity for pulmonary samples were 98 and 89 %, and against final clinical diagnosis 93 and 92 %, respectively. This assay has undergone limited evaluation for non-respiratory samples and so 331 non-respiratory samples were tested, identifying those specimens that were likely to yield a useful result. These were CSF (n = 104), fine needle aspirates (n = 64) and pus (n = 41). Pleural fluid (n = 47) was identified as a poor specimen. A concern in using the SDA assay was that low-positive samples were difficult to interpret; 7.8 % of specimens fell into this category. Indeed, 64 % of the discrepant results, when compared to final clinical diagnosis, could be assigned as low-positive samples. Specimen type did not predict likelihood of a sample being in the low-positive zone. Although the manufacturers do not describe the concept of a low-positive zone, we have found that it aids clinical diagnosis.


Abbreviations: FNA, fine needle aspirates; NAAT, nucleic acid amplification techniques; SDA, strand displacement amplification; TB, tuberculosis.


    INTRODUCTION
 TOP
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 ACKNOWLEDGEMENTS
 REFERENCES
 
Nucleic acid amplification techniques (NAATs) have been established in the diagnosis of tuberculosis, making significant improvements in the time to diagnosis with benefits both for the individual patient and in the provision of services. It has been shown that the addition of molecular techniques to our mycobacterial diagnostic service reduced the time to confirmed diagnosis from a mean of 37.5 to 22 days (Davies et al., 1999). Rapid diagnosis reduces the costs of management of multidrug-resistant-tuberculosis, with estimated savings of between £50 000 and £150 000 per annum being achieved following early detection (Drobniewski et al., 2000). Many NAATs have been employed successfully for the detection of Mycobacterium tuberculosis (Huggett et al., 2003). Several commercial systems exist and are in routine use, for example AMPLICOR (Roche Diagnostics; Beavis et al., 1995), Gen-Probe (Gene-Probe; Gamboa et al., 1998), ligase chain reaction (Abbot; Lindbrathen et al., 1997), RealArt M. tuberculosis PCR kit (Artus) and the BDProbeTec SDA system (Becton Dickinson; Down et al., 1996) adopted in this study. The BDProbeTec is a semi-automated real-time system which allows simultaneous amplification and detection of M. tuberculosis target DNA IS6110 using amplification primers and fluorescently labelled probe.

Commercial systems provide benefits of quality assurance for reagents, user-friendly formats and automated handling of large numbers. However, they are often only fully evaluated for specific clinical specimens and indications, and amplification methods for M. tuberculosis are commonly only validated on smear-positive respiratory samples. Non- pulmonary tuberculosis represents a tougher diagnostic challenge. We therefore performed a prospective evaluation of the BDProbeTec system for diagnosis of both non-pulmonary and pulmonary samples. The BDProbeTec system is marketed as a qualitative system, providing a positive or negative result. However, numerical data are produced and a positive result has a value of >3400 MOTA (Metric Other Than Acceleration). During the course of this evaluation we noted that the samples with positive SDA results <40 000 MOTA were responsible for the majority of diagnostic anomalies and so we extended the analysis to investigate the results in this ‘low-positive zone'.


    METHODS
 TOP
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 ACKNOWLEDGEMENTS
 REFERENCES
 
Specimens.

Specimens were obtained prospectively from those submitted routinely to the Molecular Diagnostic Service of the Royal Free Hospital between and including January 2001 and December 2002. Molecular analysis was performed on all those patients in whom the clinician managing the case suspected tuberculosis and requested a M. tuberculosis NAAT.

Microbiological methods.

Specimens were stored at 4 °C prior to decontamination. Respiratory specimens were treated with an equal volume of N-acetyl-L-cysteine (NALC)-NaOH (final concentration 2 %) for 15 min at room temperature and were neutralized with sterile phosphate buffer (0.067 M, pH 6.8). After centrifugation at 3000 g for 30 min, the pellet was resuspended in 10 ml sterile distilled water and further centrifuged at 3000 g for 30 min. Half the deposit was inoculated into the culture medium and the remaining half subjected to SDA investigation.

Liquid non-respiratory specimens were centrifuged at 3000 g for 30 min. Half the resultant pellet was inoculated into culture medium and half submitted to SDA. Similarly, following homogenization in a sterile Griffiths tube homogenizer, tissues were divided into two equal portions. Pellets were resuspended in 2.0 ml phosphate buffer and subjected to both culture and SDA analysis.

All specimens were screened microscopically after concentration using the Auramine stain with positive results confirmed using Ziehl–Neelsen staining. Culture was performed using the MBAlert 3D (bioMérieux) liquid culture system following the manufacturer's instructions.

Molecular methods.

Specimens were treated according to the manufacturer's instructions. In brief, a volume of 100–500 µl decontaminated specimen was washed with 1 ml wash buffer (BD-SDA buffer 1) prior to centrifugation in a microfuge at 12 200 g for 3 min. The supernatant was decanted and mycobacteria killed by heating the pellet to 105 °C for 30 min. DNA was released from cells in the deposit by resuspension in 100 µl lysis buffer (BD-SDA buffer 2), followed by sonication in a soft polymer tube at 65 °C for 45 min. Samples were then neutralized by addition of 600 µl BD-SDA neutralization buffer.

A 150 µl aliquot of the DNA extract was added to a priming well containing dehydrated primers and probes, in the microtitre plate supplied. To ensure complete rehydration of reagents the plate was incubated at room temperature for 20 min. This priming mix was then incubated at 72.5 °C for 10 min. In a separate microtitre plate, amplification wells containing enzymes, dNTPs and buffer were activated by heating to 54 °C for 10 min. Amplification was activated by the addition of 100 µl of the priming mix to the corresponding amplification well and mixing. Plates were then transferred to the ProbeTec analyser.

Each assay run includes positive and negative controls and each test well contains an internal control. Samples that gave a fluorescence reading of >3400 MOTA were regarded as positive.

Clinical data.

Specimens were only entered into the study if a minimal clinical dataset was available (patient identifiers and specimen date, sample type and anatomical site, SDA assay, smear and culture results, symptomatic and radiological evidence of tuberculosis). A final clinical diagnosis of tuberculosis was confirmed by cross-reference to the Statutory Infectious Diseases Notification records.

Statistical analysis.

Analysis was performed on the basis of each specimen or sample and not on the basis of patient. Sensitivity and specificity of the assay was calculated for each specimen type using the formula described previously by Motulsky (1995).


    RESULTS
 TOP
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 ACKNOWLEDGEMENTS
 REFERENCES
 
Over the course of this study a total of 358 respiratory and 331 non-respiratory specimens from 307 patients were investigated. Multiple specimens (2–5/patient) were received from 132 patients, these included sampling of the same site on separate occasions as well as sampling of multiple sites on the same occasion. Each specimen was treated separately in this analysis, as a specimen represents an independent diagnostic event. In assigning a final diagnosis all specimens were considered together with microbiological and clinical data. The respiratory specimens consisted of sputum (169) and bronchial washings/lavages (189). Non-respiratory specimens included cerebrospinal fluid (CSF; 104), fine needle aspirates (FNA; 64), ascitic fluid (18), pus (41), pleural fluid (47), fluids (17) and other specimens (40).

The results of culture, SDA, acid-fast bacilli (AFB) smear and final clinical diagnosis are summarized in Tables 1 and 2. Ninety-five patients had a clinical diagnosis of pulmonary tuberculosis and 69 had a diagnosis of extra-pulmonary tuberculosis. On culture, 83/358 respiratory samples were positive for M. tuberculosis (Table 1) a further 14 samples grew non-tuberculosis mycobacteria (NTM), these were Mycobacterium avium (1), Mycobacterium kansasii (3), Mycobacterium fortuitum (5), Mycobacterium xenopi (3) and two unidentified environmental mycobacteria. Of the non-respiratory samples 54/331 were culture-positive for M. tuberculosis (Table 2) and one specimen grew M. avium. For respiratory samples 111/358 (31 %) were positive by SDA and for non-respiratory samples 60/331 (18 %) were positive by SDA.


View this table:
[in this window]
[in a new window]
 
Table 1. SDA, culture, smear and clinical diagnosis (CD) of 358 respiratory samples (189 bronchial washings, 169 sputum)
 

View this table:
[in this window]
[in a new window]
 
Table 2. SDA, culture, smear and clinical diagnosis (CD) of 331 non-respiratory samples
 

Using the manufacturer's cut-off of 3400 MOTA, the sensitivity and specificity for respiratory samples was 98 and 89 %, respectively, compared to culture (Table 3). When compared to clinical diagnosis the sensitivity was reduced but the specificity increased (Table 3).


View this table:
[in this window]
[in a new window]
 
Table 3. Sensitivity (sens.), specificity (spec.), positive predictive value (PPV) and negative predictive value (NPV) of Mtb SDA for various specimen types compared to smear, culture and final diagnosis for each sample
 

An analysis of assay performance was undertaken for each non-respiratory specimen type where there were adequate sample numbers for valid interpretation (Table 3). When compared to culture, CSF samples gave good sensitivity and specificity (100 and 95 %). The assay characteristics for FNA and pus specimens were adequate to provide useful data, however, pleural fluid samples had very poor sensitivity (30 %).

All other non-respiratory sites were evaluated on the basis of potential clinical relevance and individual case histories.

Review of the false-positive results identified 42 of which 27 (64 %) fell between <3400 MOTA and <40 000 MOTA, designated the low-positive zone. The remaining 15 had values above 40 000 MOTA. Forty-six per cent of the low-positive zone specimens (27/58) were discrepant and of these 15 were respiratory specimens. The remaining 12 non-respiratory specimens came from a range of sites with no single type predominating (pleural fluid, 3; fluid, 2; FNA, 2; ascitic fluid, 1; CSF, 3; pus, 1).


    DISCUSSION
 TOP
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 ACKNOWLEDGEMENTS
 REFERENCES
 
The purpose of NAAT in the diagnosis of tuberculosis is to identify patients requiring treatment rapidly. Using the methods in this way means that applying them to specimens that are smear-positive provides the best diagnostic yield. However, such a policy is less rational than it first appears, as often the clinical presentation, examination and radiology mean that a positive smear is adequate to make a presumptive diagnosis. This is especially true when infections with non-tuberculosis mycobacteria such as M. avium intracellulare are less likely with patients on highly active antiretroviral therapy (HAART). We have previously shown that results from smear-negative patients have the biggest impact on treatment decisions (Conaty et al., 2004). Thus, the application of NAAT to specimens that are smear-negative or from a non-pulmonary source is important.

The BDProbeTec SDA system is now well established in the diagnosis of respiratory tuberculosis and the data presented here reflect both the manufacturer's data and that of other groups (Barrett et al. 2002; Mazzarelli et al., 2003). For respiratory samples, SDA improved sensitivity (Table 3) over smear alone, which has a sensitivity of 58 % against culture and 53 % against final clinical diagnosis. In this study, the specificity of the SDA was notably low (89 %), when compared to other NAATs, although it is comparable to the test characteristics published by the manufacturers (91 %). We have previously reported that there is cross-reactivity between the target (IS6110) and mycobacteria other than tuberculosis (McHugh et al., 1997), such cross-reactivity may contribute to the decreased specificity of the test. This view is supported by the observation that specificity against culture is good in those samples that are likely to have fewer competing bacteria (CSF, FNA and pleural fluid) as compared to pus and respiratory specimens. Of course it should be noted that ‘final diagnosis` includes an element of bias, as the SDA result often contributes to the final diagnosis.

In this study we have identified samples that are low-positive (>3400–< 40 000 MOTA), which formed 7.8 % of all specimens. Of the discrepant results, when compared to final clinical diagnosis, 64 % could be assigned to the low-positive zone. There were 54 samples in this low-positive zone, of which 46 % were discrepant. Specimen type did not predict the likelihood of a sample being in the low-positive zone, 15/27 discrepant results were respiratory samples, the remaining 12 samples were from a wide range of non-respiratory sites with no single site being over-represented (P > 0.05). Although the manufacturers do not describe the concept of a low-positive zone, we have found that its introduction has been an aid to interpretation for clinical diagnosis. These samples represent a small proportion of the total, but our experience is that they demand a disproportionate effort to achieve a satisfactory final diagnosis. The implications for a patient of being treated inappropriately for tuberculosis are substantial. Thus, we propose that any sample with results in the low-positive zone is automatically repeated and a further specimen sought. Only if all three results are concordant should a result be reported. The biological significance of the false-positive results in the low-positive zone remains unclear, the presence of low levels of M. tuberculosis DNA as a result of environmental exposure or non-viable infection are both possibilities. The critical point is that these patients did not go on to develop clinical disease which emphasizes the need to view the molecular test result within the context of the whole clinical picture.

In this 2-year review of our practice we have identified those non-respiratory samples for which an SDA result may be interpreted with some confidence. CSF is a critical specimen with good sensitivity and specificity as compared to smear and culture (Table 3). It should be noted that this analysis is based on 2/104 positive samples. The manufacturers report a sensitivity of 125 c.f.u. ml–1 for the SDA assay, this is tenfold greater than the likely number of organisms in CSF, thus the test is being used at the limit of its analytical sensitivity in this context, and this may contribute to the poor sensitivity in comparison to final diagnosis (40 %). This reflects the importance of non-microbiological markers, such as CSF pleocytosis and biochemistry in the diagnosis of TB meningitis and identifies a role for the SDA in rapid diagnosis. Recently, Johansen et al. (2004) described a modified extraction protocol and subsequent re-evaluation of the 3400 MOTA cut-off for CSF samples; this is a promising development that may increase the sensitivity for this important specimen. The low sensitivity but high specificity of the SDA for FNA samples reflects low organism numbers often found in these specimens, however, the good specificity makes the test very useful clinically. Conversely, applying the SDA to pus samples showed good sensitivity but poor specificity, thus, although a negative result may be helpful, the poor specificity suggests that SDA should be applied to pus samples with caution. Pleural fluid is known to be a poor sample for smear and culture testing due to sampling and dilution effects (Valdes et al., 2003). This is also the case for SDA testing, sensitivity of this test for pleural fluids is so low that the test is of little value.

This is the largest prospective review of NAAT for the diagnosis of non-respiratory samples. As a result we are able to focus our resources on those specimens that are most likely to yield clinically relevant results. We confirm the value of NAAT techniques in diagnosis from respiratory samples, and particularly enhanced sensitivity from smear-negative specimens (Conaty et al., 2004). Also, we have demonstrated that certain non-respiratory samples are appropriate for NAAT diagnosis but there is a significant risk of biological false-positive results and so these tests must be interpreted with caution.


    ACKNOWLEDGEMENTS
 TOP
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 ACKNOWLEDGEMENTS
 REFERENCES
 
Becton Dickinson provided BDProbeTec SDA kits for approximately one third of the samples tested, free of charge.


    REFERENCES
 TOP
 INTRODUCTION
 METHODS
 RESULTS
 DISCUSSION
 ACKNOWLEDGEMENTS
 REFERENCES
 

  • Barrett, A., Magee, J. G. & Freeman, R. (2002). An evaluation of the BD ProbeTec ET system for the direct detection of Mycobacterium tuberculosis in respiratory samples. J Med Microbiol 51, 895–898.[Abstract/Free Full Text]

  • Beavis, K. G., Lichty, M. B., Jungkind, D. L. & Giger, O. (1995). Evaluation of Amplicor PCR for direct detection of Mycobacterium tuberculosis from sputum specimens. J Clin Microbiol 33, 2582–2586.[Abstract]

  • Conaty, S. J., Claxton, A. P., Enoch, D., Hayward, A. C., Lipman, M. C. I. & Gillespie, S. H. (2004). The clinical interpretation of nucleic acid amplification tests for tuberculosis. Do rapid tests change treatment decisions? J Infect, in press.

  • Davies, A. P., Newport, L. E., Billington, O. J. & Gillespie, S. H. (1999). Length of time to laboratory diagnosis of Mycobacterium tuberculosis infection: comparison of in-house methods with reference laboratory results. J Infect 39, 205–208.[CrossRef][Medline]

  • Down, J. A., O'Connell, M. A., Dey, M. S. & 8 other authors (1996). Detection of Mycobacterium tuberculosis in respiratory specimens by strand displacement amplification of DNA. J Clin Microbiol 34, 860–865.[Abstract]

  • Drobniewski, F. A., Watterson, S. A., Wilson, S. M. & Harris, G. S. (2000). A clinical, microbiological and economic analysis of a national service for the rapid molecular diagnosis of tuberculosis and rifampicin resistance in Mycobacterium tuberculosis. J Med Microbiol 49, 271–278.[Abstract/Free Full Text]

  • Gamboa, F., Fernandez, G., Padilla, E., Manterola, J. M., Lonca, J., Cardona, P. J., Matas, L. & Ausina, V. (1998). Comparative evaluation of initial and new versions of the Gen-Probe Amplified Mycobacterium tuberculosis Direct Test for direct detection of Mycobacterium tuberculosis in respiratory and nonrespiratory specimens. J Clin Microbiol 36, 684–689.[Abstract/Free Full Text]

  • Huggett, J. F., McHugh, T. D. & Zumla, A. (2003). Tuberculosis: amplification-based clinical diagnostic techniques. Int J Biochem Cell Biol 35, 1407–1412.[CrossRef][Medline]

  • Johansen, I. S., Lundgren, B., Tabak, F., Petrini, B., Hosoglu, S., Saltoglu, N. & Thomsen, V. O. (2004). Improved sensitivity of nucleic acid amplification for rapid diagnosis of tuberculous meningitis. J Clin Microbiol 42, 3036–3040.[Abstract/Free Full Text]

  • Lindbrathen, A., Gaustad, P., Hovig, B. & Tonjum, T. (1997). Direct detection of Mycobacterium tuberculosis complex in clinical samples from patients in Norway by ligase chain reaction. J Clin Microbiol 35, 3248–3253.[Abstract]

  • Mazzarelli, G., Rindi, L., Piccoli, P., Scarparo, C., Garzelli, C. & Tortoli, E. (2003). Evaluation of the BDProbeTec ET system for direct detection of Mycobacterium tuberculosis in pulmonary and extrapulmonary samples: a multicenter study. J Clin Microbiol 41, 1779–1782.[Abstract/Free Full Text]

  • McHugh, T. D., Newport, L. E. & Gillespie, S. H. (1997). IS6110 homologs are present in multiple copies in mycobacteria other than tuberculosis-causing mycobacteria. J Clin Microbiol 35, 1769–1771.[Abstract]

  • Motulsky, H. (1995). Intuitive Biostatistics. Oxford, UK: Oxford University Press.

  • Valdés, L., Pose, A., San José, E. & Martínez Vázquez, J. M. (2003). Tuberculosis pleural effusions. Eur J Intern Med 14, 77–88.[CrossRef][Medline]




    This article has been cited by other articles:


    Home page
    ThoraxHome page
    R A M Breen, S M Barry, C J Smith, R J Shorten, J P Dilworth, I Cropley, T D McHugh, S H Gillespie, G Janossy, and M C I Lipman
    Clinical application of a rapid lung-orientated immunoassay in individuals with possible tuberculosis
    Thorax, January 1, 2008; 63(1): 67 - 71.
    [Abstract] [Full Text] [PDF]


    Home page
    J. Clin. Microbiol.Home page
    D. C. Bean, A. Hills, T. Ryan, and J. Aitken
    Evaluation of the BD ProbeTec ET System for Direct Detection of Mycobacterium bovis in Veterinary Specimens
    J. Clin. Microbiol., October 1, 2007; 45(10): 3434 - 3435.
    [Abstract] [Full Text] [PDF]


    Home page
    J Med MicrobiolHome page
    K. J. Williams, C. L. Ling, C. Jenkins, S. H. Gillespie, and T. D. McHugh
    A paradigm for the molecular identification of Mycobacterium species in a routine diagnostic laboratory
    J. Med. Microbiol., May 1, 2007; 56(5): 598 - 602.
    [Abstract] [Full Text] [PDF]


    Home page
    ThoraxHome page
    S Greco, E Girardi, A Navarra, and C Saltini
    Current evidence on diagnostic accuracy of commercially based nucleic acid amplification tests for the diagnosis of pulmonary tuberculosis
    Thorax, September 1, 2006; 61(9): 783 - 790.
    [Abstract] [Full Text] [PDF]


    This Article
    Right arrow Abstract Freely available
    Right arrow Full Text (PDF)
    Right arrow Alert me when this article is cited
    Right arrow Alert me if a correction is posted
    Right arrow Citation Map
    Services
    Right arrow Email this article to a friend
    Right arrow Similar articles in this journal
    Right arrow Similar articles in PubMed
    Right arrow Alert me to new issues of the journal
    Right arrow Download to citation manager
    Right arrow reprints & permissions
    Citing Articles
    Right arrow Citing Articles via HighWire
    Right arrow Citing Articles via CrossRef
    Right arrow Citing Articles via Google Scholar
    Google Scholar
    Right arrow Articles by McHugh, T D
    Right arrow Articles by Gillespie, S H
    Right arrow Search for Related Content
    PubMed
    Right arrow PubMed Citation
    Right arrow Articles by McHugh, T D
    Right arrow Articles by Gillespie, S H
    Agricola
    Right arrow Articles by McHugh, T D
    Right arrow Articles by Gillespie, S H


    HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
    INT J SYST EVOL MICROBIOL J MED MICROBIOL MICROBIOLOGY J GEN VIROL ALL SGM JOURNALS