Email updates

Keep up to date with the latest news and content from BMC Research Notes and BioMed Central.

Open Access Highly Accessed Short Report

IGRA tests perform similarly to TST but cause no adverse reactions: pediatric experience in Finland

Esko Tavast14*, Eeva Salo2, Ilkka Seppälä13 and Tamara Tuuminen13

Author Affiliations

1 Department of Bacteriology and Immunology, Haartman Institute, University of Helsinki, Helsinki, Finland

2 Hospital for Children and Adolescents, University of Helsinki, Helsinki, Finland

3 Division of Clinical Microbiology, Helsinki University Hospital, HUSLAB, Helsinki, Finland

4 Department of Industrial Engineering and Management, Helsinki University of Technology, Helsinki, Finland

For all author emails, please log on.

BMC Research Notes 2009, 2:9  doi:10.1186/1756-0500-2-9

The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1756-0500/2/9


Received:25 November 2008
Accepted:15 January 2009
Published:15 January 2009

© 2008 Tavast et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Two commercial interferon gamma release assays (IGRAs) (QuantiFERON®-TB Gold in Tube and T SPOT®-TB) to detect a contact with M. tuberculosis have recently become available. The majority of studies agree that the sensitivity and specificity of these methods are superior to the Tuberculin Skin Tests (TSTs) in detecting an exposure to bacteria in latently infected individuals and in clinical tuberculosis. However, the data in children remains limited.

Findings

Consecutively collected samples from children (n = 99) representing age range from zero to 18 years were analyzed in a retrospective non-blinded study. The two IGRAs were modified and adapted to the needs of Finland, a country of a low tuberculosis incidence. For 27 children, both tests were performed simultaneously and compared with the TST and clinician's diagnosis. The sensitivity, specificity, and accuracy of both IGRAs was determined. QuantiFERON TB Gold and T SPOT-TB performed (respectively) as follows: sensitivities 0.92 (95% confidence interval, CI, 0.67–0.99) and 0.85 (0.64–0.95); specificities 0.91 (0.77–0.97) and 1.00 (0.93–1.00); accuracies 0.91 (0.80–0.97) and 0.96 (0.88–0.99). This compares favorably to the TST whose known figures are 0.90, 0.95, and 0.95, respectively. The agreement between the IGRAs was high, k = 0.89. Finally, both methods agreed well with the TST, k = 0.86 for TST/QuantiFERON-TB Gold and k = 0.76 for TST/T SPOT-TB.

Conclusion

The sensitivity and specificity of IGRA methods compares well with the TST without the inconveniences and complications associated with TST, including exaggerated delayed type hypersensitivity reactions. These properties place them as acceptable substitutes for TST.

Background

Diagnosis of childhood tuberculosis (TB) remains challenging [1]. Two commercial IFN-γ release assays (IGRAs), namely T-SPOT.TB and QuantiFERON®-TB Gold In-Tube (QFGT), have been recently developed. These methods show acceptable diagnostic accuracy for active TB in adults [2] and have better correlation with tuberculosis exposure than the TSTs in contact tracing for revealing latent infections (LTBI) [3,4]. However, pediatric data are limited, and studies evaluating the performance of IGRAs in children have been called for especially in low-incidence countries [2,5,6].

In Finland the incidence of TB is low, 5.6/100 000 inhabitants in 2006 [7]. Only zero to six child TB diagnoses per annum has been registered during the last ten years [8]. Universal BCG vaccination of newborns was practiced until 2006 [9]

Between September 2004 and January 2007 our laboratory adapted the tests to the general needs in Finland. After completion of the field evaluation [10] the methods became available for routine diagnostics. We then evaluated the performance of IGRAs in children and compared them to the TST and clinical diagnoses.

Findings

Study Population

Between 15.9.2004 and 15.10.2007 we analyzed samples from 99 consecutive children and adolescents. The flow diagram of the study is presented in Fig. 1. We reviewed the medical records of the patients and collected data on demographics, clinical, microbiological and radiological examinations, and the BCG vaccination history (Table 1). This study was approved by the Ethical Committee of the Hospital for Children and Adolescents, University of Helsinki (Nr.164/E7/05).

Table 1. Characteristics of children enrolled in the study (n = 99)

thumbnailFigure 1. The outline of the study design. The (*) means that immunoconversion was observed in one patient. In this case the Ly-TbSpot, the Mantoux test and the B-TbIFNγ were done and in August and repeated in December, the two were negative and the B-TbIFNγ was once borderline but the repeated B-TbIFNγ test and the Mantoux turned positive in February (for more details see Table 3).

Ly-TbSpot procedure and quality control

The Ly-TbSpot, a modified version of T-SPOT.TB (Oxford Immunotec, Oxford, UK) [11], was performed using standard operation procedures (SOP). Firstly, the results were expressed as a number of reactive spots/million lymphocytes. The lymphocyte count from isolated peripheral blood mononuclear cell (PBMC) preparation was calculated with an automated hematologic analyzer (Advia® 60, Bayer, Germany). Secondly, duplicate ELISPOT wells were used for each antigen and media. Thirdly, Purified Protein Derivative (PPD) (Statens Serum Institut, Copenhagen, Denmark) was used as an additional positive control. Fourthly, we adopted a double cut-off policy, i.e. the responses below 25 spot/million lymphocytes were considered as non-reactive according to the guidelines by the manufacturer; the responses between 25 and 55 spots were considered borderline and over 55 spots were interpreted as reactive. An internal control of cryopreserved cells was run with each new batch of reagents.

B-TbIFNγ procedure and quality control

B-TbIFNγ is a modified version of the QuantiFERON®-TB Gold In-Tube (Cellestis Limited, Carnegie, Victoria, Australia) [12]. In accordance with the SOP of our laboratory, stimulation of blood cells was done in tubes of the manufacturer. However, for measurement of IFN-γ levels, we used EIA of PeliKine Compact human EIA (Sanquin, Amsterdam, The Netherlands). This resulted in a steeper calibration curve and ensured more accurate result interpretation in the cut-off zone (Fig. 2). Two cut-off levels were applied. The samples showing a net reactivity (the reactivity of a sample minus the reactivity of the nil control) < 0.35 IU/ml were interpreted as non-reactive. Those showing reactivity between 0.35 and 0.50 IU/ml were interpreted as borderline and those with a reactivity exceeding 0.50 IU/ml were interpreted as reactive. For the internal quality control, an artificially prepared IFN-γ solution to simulate a low reactive sample was used.

thumbnailFigure 2. Improvement of the calibration curve for IFNγ-measurement. For measurement of IFN-γ levels, the original EIA reagent from Cellestis (circles) was substituted by that of PeliKine Compact human EIA (squares). This resulted in a steeper calibration curve and the use of the whole dynamic range of the photometer. Analytically, this means more accurate result interpretation in the cut-off zone. OD405 nm, optical densities measured at 405 nm.

Method of TST

TST was performed with two TU, purified protein derivative (PPD, RT23, Statens Serum Institut, Copenhagen, Denmark) according to the Mantoux technique. The result was recorded after 48–72 h. A cut-off for positivity was defined as 10 mm or more in BCG-vaccinated and 5 mm or more in non-vaccinated children. If a child had a negative TST result, but was examined because of contact with an infectious TB case, the test was repeated [13].

Definitions

For methods evaluation we used conventional interpretations of definitive and probable TB and of LTBI.

Exclusion criteria

The results of the tests were considered eligible if the reactivities to the mitogen were as suggested by the manufactures. Seven samples were excluded from the ELISPOT analysis because of high non-specific background.

Statistical analysis

The concordances between the IGRAs, and of each test with the TST, were assessed in three categories by describing proportions of agreement (PA) and with the Cohen's kappa statistic with linear weighting. 95% confidence intervals (CI) were calculated with the Wilson efficient-score method which was corrected for continuity. Using a conservative approach, the cases interpreted in the grey zone were placed into categories of false positives or false negatives for the calculations of specificity, sensitivity and accuracy.

Final diagnosis of the participants

Overall, 99 samples were analyzed, and their characteristics are shown in Table 1, Table 2, and Figure 1. The subjects were tested as follows: with the Ly-TbSpot alone, with the B-TbINFγ alone, and with both Ly-TbSpot and B-TbIFNγ. Participant numbers were 52, 20, and 27 (out of 99 total), respectively. Seven results were excluded from calculations because non-specific background reactivity made it impossible to interpret the samples as definitely non-reactive. Of those tested with the Ly-TbSpot alone, six cases were positive and one was a borderline case; of those tested with the B-TbINFγ alone, one was interpreted as a borderline and one was positive; of those tested with both methods, 11 were positive by both methods and two samples were interpreted as borderline only with the B-TbINFγ method. The majority of the patients were either new immigrants or had at least one parent from a country with a high incidence of TB. The median age of the participants was nine years and the age range was from two weeks to adolescence.

Table 2. Final diagnoses of the patients

The major indication for performing IGRA was recent contact with an infectious case of TB (62 of 99 patients). Thirty-seven children were examined because of symptomatic illness, with TB considered a diagnostic modality. Ten children were diagnosed with TB; five had pulmonary TB, only one of them culture positive; five were diagnosed with extrapulmonary TB. One patient also had an HIV infection, and one patient was HIV infected but had no TB.

Immunological conversion was observed in a 13-year-old boy who was examined several times because of the repeated household contacts with TB. His patient history and the kinetics of the immunological responses in all the three methods are presented in Table 3.

Table 3. Anamnestic data and the observed kinetics of immunological conversion in a 13-year-old boy.

The TST was performed in 87 (out of 99) subjects, in eight the test was not performed, and in four the data was missing from the records. Of those tested, positive TST was recorded in 25 cases, the size of the induration ranging from 10 to 30 mm. In one subject the TST converted from zero to 16 mm (Table 3). In another subject the TST test caused a severe delayed type hypersensitivity reaction, which resulted in a cosmetically unacceptable scar (Fig. 3A–C). A similar severe hypersensitivity reaction was observed in a third case that was not enrolled in the current study (Fig 3D, E).

thumbnailFigure 3. Exaggerated delayed type hypersensitivity reaction in the TST leading to a permanent scar. The upper panel represents results of the TST in a 14-year-old boy with LTBI, A taken three days, B two weeks and C three months after inoculation of 2 TU of PPD RT23. The original size of the induration was 20 mm. Photos: Courtesy of Dr. Peter Floman, Hospital of Porvoo. The lower panel represents results of the TST in a 13-year old girl with TB lymphadenitis, D taken 3 days and E two weeks after performing TST. This child was not enrolled in the current study.

Performance characteristics of the IGRAs

Combined performance characteristics for IGRAs are presented in Table 4. None of the samples tested with the Ly-TbSpot were condemned as false positives, whereas three samples fell into the borderline category with the B-TbIFNγ (see Fig. 1). According to our interpretation criteria, three patients in the Ly-TbSpot and one in the B-TbIFNγ cohorts were grouped as false negatives. One was a 7-year-old boy with tuberculous lymphadenitis who had a borderline Ly-TbSpot result in our definition, but the TST induration was 20 mm. The second was a 15-year-old boy with TB contact who had TST induration of 13 mm but his Ly-TbSpot results were repeatedly negative. The third case was a 6-year-old girl with no symptoms whose sibling was diagnosed with TB. She had a TST conversion within a year, the TST induration at the time of assessment was 10 mm, but both IGRAs remained non-reactive. The fourth case was a 9-year-old boy from a highly endemic area whose TST induration was 11 mm but the B-TbIFNγ remained non-reactive. Because of the lack of the gold standard for LTBI, in the last three cases the diagnosis was based primarily on extensive exposure to TB and positive TST, in accordance with the recommendations in our country [13].

Table 4. Performance characteristics of the IGRA-methods.

Agreement between Ly-TbSpot, B-TbIFNγ and the TST

The calculated data are presented in Table 5. The κ values above 0.75 imply good agreement, more than might have occurred by chance.

Table 5. Agreement between Ly-TbSpot, B-TbIFNγ and the TST

Analysis of non-interpretable results

Non-specific background activation of cells for IFNγ production was observed in seven samples analyzed with the Ly-TbSpot. Of those, six samples were from members of a family newly immigrated from Ethiopia. These patients showed reactivity without stimulation with an added antigen, the size of the spots being very small. This non-specific reactivity was interpreted as the reactivity of other than effector T-cell populations, most probably of NK cells. All results obtained with the B-TbIFNγ-method were acceptable.

The influence of the cut-off levels on performance characteristics of the Ly-TbSpot

Theoretical values for sensitivity, specificity, positive and negative predictive values were plotted against differential cut-off points. The analysis showed that the accuracy of the test peaked to 0.97 in the range of 24 to 48 spots/million lymphocytes (Fig. 4). Hence, by preserving our current double cut-off policy, and a conservative way of interpretation, we achieved an accuracy of 0.96. This means that any pediatric sample falling into the borderline category may most probably represent a pathological condition.

thumbnailFigure 4. Test parameters of Ly-TbSpot using differential cut-off points (n = 72). Theoretical values for sensitivity (blue), specificity (red), positive (dashed purple) and negative predictive values (dashed grey) on the y-axis were plotted against the cut-off points on the x-axis. The accuracy (black) of the tests peaked to 0.97 in the range of 24 to 48 spots/million lymphocytes. Hence, by preserving our current double cut-off policy (25 and 55 spots/million lymphocytes) we achieve an accuracy of 0.96.

We present results of a retrospective, non-blinded study of two modified IGRAs for the diagnosis of childhood TB. The modifications were aimed to avoid false positive interpretations. Because no method can guarantee 100% sensitivity and specificity, we made a pragmatic decision to offer the best possible specificity even at the cost of sensitivity. Changing of the cut-off levels of the commercial IGRA methods has been suggested by other investigators. Lee at al [14] suggested lowering the cut-off in the QFGT method. This change would have resulted in a drop of specificity from 91.6% to 87.0% which we, contrary to Lee, do not regard as a minimal loss. Arend et al [15] also recommended dropping the cut-off of the QFGT to achieve a detection rate of potentially infected persons similar to that of TST. The recommendation is not acceptable for the reason that TST is by no means a gold standard. The sensitivity of QFGT could instead be improved e.g. by using more sensitive EIA techniques. In fact, although there was high agreement between IGRAs and TST in our studies, three earlier studies found a lower agreement: two studies [16,17] performed on pediatric samples in low risk countries observed concordant results between the IGRAs but inferior specificity of the TST, and one large cohort study of TB disease in African children [18] found lower agreement with the TST. In another cohort study of contact tracing, performed on Gambian children, the clinical sensitivity of the TST was found superior to that of the ELISPOT in diagnosing LTBI [19]. In that study, however, the discordance between the tests was not significant [19]. In a recent study from Gambia [20] comparing the new IGRAs to TST in contact tracing, ELISPOT was found more sensitive than the QFGT in the diagnosis of TB disease while equally sensitive in the diagnosis of LTBI. That study showed no significant discordance between IGRAs but the results of the TST were influenced by the BCG vaccination status. The observed discrepancies in the estimation of the three methods are most probably attributed to the differences in the research population, their vaccination status and exposure to other mycobacteria, and most importantly, in the variability of the methods' performance using variable threshold levels.

Our study raises several important issues. When performing TST, intradermal inoculation of PPD in children exposed to M. tuberculosis may produce an excessive delayed type hypersensitivity reaction. Secondly, demonstration of the test variability around the cut-off zone in real laboratory settings convinces that interpretation of immunodiagnostic methods should take into account the method imprecision and utilize a grey zone.

Conclusion

The sensitivity and specificity of IGRA methods compares well with TST but do not cause exaggerated delayed type hypersensitivity reactions.

Abbreviations

(TSTs): Tuberculin Skin Tests; (TU): Tuberculin Unit; (IGRA): Interferon Gamma Release Assays; (TB): Tuberculosis; (LTBI): Latent Tuberculosis Infection; (BCG): Bacille Calmette-Guérin; (SOP): Standard Operation procedure; Positive (PPV) and (NPV): Negative Predictive Values; (CI): Confidence Intervals; (PA): Proportions of Agreement; (ELISPOT): Enzyme-linked Immunosorbent Spot Assay; (Ly-TbSpot): Modified T-SPOT.TB; (ELISA): Enzyme-linked Immunosorbent Assay; (QFGT): QuantiFeronGold in Tube; (B-TbIFNγ): Modified QFGT; (NK): Natural Killer cells; (PHA): Phytohemagglutinin; (PPD): Purified Protein Derivative; (HIV): Human Immunodeficiency Virus.

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

ET carried out statistical analysis and interpretation of the data and was involved in the drafting of the manuscript; TT and IS have contributed to the conception and design of the study, drafting and revision of the manuscript; ES is a clinician who treated presented cases, she contributed to the acquisition of the data and drafting of the manuscript. All authors have given final approval of the version to be published.

Acknowledgements

We wish to thank for financial support in the evaluation of new IGRA-methods the following private Finnish foundations: Finnish Lung Health Association (Filha ry), Pulmonary Association Heli, and the Tuberculosis Association of the University of Tampere.

References

  1. Starke JR: Diagnosis of tuberculosis in children.

    Pediatr Infect Dis J 2000, 19:1095-96. PubMed Abstract | Publisher Full Text OpenURL

  2. Menzies D, Pai M, Comstock G: Meta-analysis: new tests for the diagnosis of latent tuberculosis infection: areas of uncertainty and recommendations for research.

    Ann Int Med 2007, 14:340-54. PubMed Abstract OpenURL

  3. Ewer K, Deeks J, Alvarez L, Bryant G, Waller S, Andersen P, Monk P, Lalvani A: Comparison of T-cell-based assay with tuberculin skin test for diagnosis of Mycobacterium tuberculosis infection in a school tuberculosis outbreak.

    The Lancet 2003, 361:1168-73. Publisher Full Text OpenURL

  4. Zellweger JP, Zellweger A, Ansermet S, de Senerclens B, Wrighton-Smith P: Contact tracing using a new T-cell-based test: better correlation with tuberculosis exposure than tuberculin skin test.

    Int J Tuberc Lung Dis 2005, 9:1242-47. PubMed Abstract | Publisher Full Text OpenURL

  5. Lalvani A, Millington KA: T cell-based diagnosis of childhood tuberculosis infection.

    Curr Opin Infect Dis 2007, 20:264-271. PubMed Abstract | Publisher Full Text OpenURL

  6. Mazurek GH, Jereb J, Lobue P, Iademarco MF, Metchock B, Vernon A, Division of Tuberculosis Elimination, National Center for HIV, STD, and TB Prevention, Centers for Disease Control and Prevention (CDC): Guidelines for using the QuantiFERON-TB Gold test for detecting Mycobacterium tuberculosis infection, United States.

    MMWR Recomm Rep 2005, 54:49-55. PubMed Abstract | Publisher Full Text OpenURL

  7. Infectious diseases in Finland [http:/ / www.ktl.fi/ attachments/ suomi/ julkaisut/ julkaisusarja_b/ 2007/ 2007b13.pdf] webcite

  8. Finnish Infectious Disease Register, National Public Helath Institute [http://www3.ktl.fi/stat/] webcite

    [cited 2008 April 25]

  9. Salo E: BCG in Finland: Changing from a universal to a selected programme.

    Euro Surveill 2006, 11:18-20. PubMed Abstract | Publisher Full Text OpenURL

  10. Tuuminen T, Sorva S, Liippo K, Vasankari T, Soini H, Eriksén-Neuman B, Miettinen A, Seppälä I: Feasibility aspects of commercial interferon (IFN)-γ based methods for the diagnosis of latent Mycobacterium tuberculosis infection in Finland, a country of low incidence and high BCG vaccination coverage.

    Clin Microbiol Infect 2007, 13:836-8. PubMed Abstract | Publisher Full Text OpenURL

  11. Oxford Immunotec. Technical handbook T-SPOT. TB [http:/ / www.oxfordimmunotec.com/ downloads/ Technical%20handbook%20TH-TB-UK-V3% 20300407.pdf] webcite

    2007.

    [cited 2008 April 24]

  12. Cellestis : Clinicians Guide to QuantiFERON-TB Gold. [http://www.cellestis.com/IRM/content/gold/QFT-Gold_US_Clinicianguide.pdf] webcite

    2007.

    [cited 2008 April 24]

  13. Valtakunnallinen tuberkuloosiohjelma: STM 2006:21 (Finnish). [http:/ / www.stm.fi/ Resource.phx/ publishing/ store/ 2006/ 09/ pr1158658370802/ passthru.pdf] webcite

  14. Lee JY, Choi HJ, Park I-N, Hong S-B, Oh Y-M, Lim C-M, et al.: Comparison of two commercial interferon-γ assays for diagnosing Mycobacterium tuberculosis infection.

    Eur Resp J 2006, 28:24-30. Publisher Full Text OpenURL

  15. Arend S, Thijsen S, Leyten E, Bouwman J, Willeke P, Franken , et al.: Comparison of two interferon-γ and tuberculin skin test for tracing tuberculosi contacts.

    Am J Respit Crit Care Med 2007, 175:618-27. Publisher Full Text OpenURL

  16. Detjen AK, Kell T, Roll S, Hauer B, Mauch H, Wahn U, Magdorf K: Interferon-gamma release assays improve the diagnosis of tuberculosis and nontuberculous mycobacterial disease in children in a country with low incidence of tuberculosis.

    Clin Infect Dis 2007, 1:322-8. Publisher Full Text OpenURL

  17. Connell T, Ritz N, Paxton G, Buttery J, Curtis N, Ranganathan S: A three-way comparison of tuberculin skin testing, QuantiFERON-TB Gold and T-SPOT. TB in children.

    PLos ONE 2008, 3:1-8. Publisher Full Text OpenURL

  18. Liebeschuetz S, Bamber S, Ewer K, Deeks J, Pathan AA, Lalvani A: Diagnosis of tuberculosis in South Aftrican children with a T-cell based assay: a prospective cohort study.

    The Lancet 2004, 364:21996-2203. Publisher Full Text OpenURL

  19. Hill PC, Brookes RH, Adetifa IM, Fox A, Jackson-Sillah D, Lugos MD, Donkor SA, Marshall RJ, Howie SR, Corrah T, Jeffries DJ, Adegbola RA, McAdam KP: Comparison of enzyme-linked immunospot assay and tuberculin skin test in healthy children exposed to Mycobacterim tuberculosis .

    Pediatrics 2006, 117:1542-48. PubMed Abstract | Publisher Full Text OpenURL

  20. Adetifa IM, Lugos MD, Hammond A, Jeffries D, Donkor S, Adegbola RA, Hill PC: Comparison of the two interferon gamma release assays in the diagnosis of Mycobacterium tuberculosis infection and disease in the Gambia.

    BMC Infect Dis 2007, 7:122. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL