Email updates

Keep up to date with the latest news and content from BMC Infectious Diseases and BioMed Central.

Open Access Research article

Evaluation of alternative respiratory syndromes for specific syndromic surveillance of influenza and respiratory syncytial virus: a time series analysis

Suzanne K Schindeler1, David J Muscatello1*, Mark J Ferson23, Kris D Rogers1, Paul Grant1 and Tim Churches1

Author Affiliations

1 Centre for Epidemiology and Research, New South Wales Department of Health, North Sydney, Australia

2 South Eastern Sydney and Illawarra Public Health Unit, Randwick, New South Wales, Australia

3 School of Public Health & Community Medicine, University of New South Wales, Sydney, Australia

For all author emails, please log on.

BMC Infectious Diseases 2009, 9:190  doi:10.1186/1471-2334-9-190


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2334/9/190


Received:19 February 2009
Accepted:29 November 2009
Published:29 November 2009

© 2009 Schindeler et al; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Syndromic surveillance is increasingly being evaluated for its potential for early warning of increased disease activity in the population. However, interpretation is hampered by the difficulty of attributing a causative pathogen. We described the temporal relationship between laboratory counts of influenza and respiratory syncytial virus (RSV) detection and alternative groupings of Emergency Department (ED) respiratory diagnoses.

Methods

ED and laboratory data were obtained for the south-eastern area of Sydney, NSW for the period 1 June 2001 - 1 December 2006. Counts of ED visits and laboratory confirmed positive RSV and influenza cases were aggregated by week. Semi-parametric generalized additive models (GAM) were used to determine the association between the incidence of RSV and influenza and the incidence of respiratory syndrome ED presentations while controlling for temporal confounders.

Results

For every additional RSV laboratory count, ED diagnoses of bronchiolitis increased by 3.1% (95%CI: 2.7%-3.5%) in the same week. For every additional influenza laboratory count, ED diagnoses of influenza-like illness increased by 4.7% (95%CI: 4.2%-5.2%) one week earlier.

Conclusion

In this study, large increases in ED diagnoses of bronchiolitis and influenza-like illness were independent and proxy indicators for RSV and influenza activity, respectively.

Background

Syndromic surveillance is increasingly being used for monitoring disease activity because of its potential for early detection of outbreaks and epidemics [1-6], and its potentially widespread coverage of target populations. However, interpretation of surveillance signals is often hampered by the difficulty of implicating a causative pathogen. There is a need to understand whether and how syndromic surveillance can distinguish between specific pathogens circulating in the population.

In temperate climate zones, emergency department visits for respiratory conditions such as bronchiolitis, influenza-like illness, and pneumonia have been found to display a distinctly seasonal pattern, with ED visits peaking in the winter months [7,8]. Previous studies have found that influenza virus and respiratory syncytial virus (RSV) explain most of the variation in presentations of respiratory syndromes to EDs [9,10,7], but these studies did not determine whether syndromic surveillance could distinguish between these viruses.

RSV is the most common cause of lower respiratory tract infection in infants and children worldwide and often manifests as bronchiolitis and pneumonia [11,12]. Almost all children have been infected with RSV by two years of age and re-infection throughout life is common. In adults, RSV is increasingly recognized as an important cause of serious respiratory disease in the elderly and immuno-compromised individuals [11]. In younger, otherwise healthy adults, RSV may have a clinical presentation similar to influenza [13].

Apart from causing typical influenza syndromes, influenza viruses have a well-established relationship with pneumonia morbidity and mortality [14] and can also be a cause of bronchiolitis [15] in younger children. There is strong evidence that RSV and influenza co-circulate [14] and co-infection is possible [16].

Another important consideration for syndromic surveillance is whether it can offer earlier warning of disease activity than surveillance of specific pathogens. Our previous work found at least a 3 day advantage of monitoring daily counts of emergency department diagnoses of influenza compared with laboratory surveillance of influenza [8]. Wijngaard et al [9] found between 0 and 5 weeks advantage for alternative respiratory illness syndromes compared with influenza, and between 3 weeks disadvantage and 2 weeks advantage for the same syndromes against laboratory-confirmed RSV. However, the respiratory syndromes were non-specific and did not discriminate between those pathogens.

No studies, to our knowledge, have investigated whether surveillance of ED diagnoses of specific respiratory syndromes can distinguish between different causative pathogens circulating in the population. Hence, this time series study aimed to determine how RSV and influenza virus activity in the population affect alternative ED-based respiratory syndrome definitions in terms of the degree of association and timing. Understanding this relationship between ED syndromes and underlying viral activity may help in interpreting increases in syndrome activity observed in syndromic surveillance.

Methods

Setting and data sources

RSV is not a notifiable/reportable condition in New South Wales (NSW), Australia. However, we obtained RSV laboratory data from public hospital laboratories participating in the Eastern Sydney Laboratory Surveillance Program, which covers the south-eastern area of Sydney. Influenza is required to be notified by laboratories to the NSW Department of Health [17] and was thus obtained from the NSW Notifiable Diseases Database. Records were selected if the notifying public health unit was within the south-eastern area of Sydney. ED data was obtained from the NSW Emergency Department Data Collection [18] derived from the six public hospitals in the same geographic area. The ED data collection is drawn from data entered in information systems in NSW EDs used by ED personnel for patient management. The longest time period of available data common to all datasets was 1st June 2001 - 1st December 2006.

Syndrome definitions

Syndrome definitions were based on those used in existing ED-based syndromic surveillance in NSW [4]. The system defines syndromes using provisional primary diagnoses selected in patient management information systems used in EDs. These information systems automatically record the corresponding International Classification of Diseases (ICD) Version 9 or 10 code, depending on the information system used. "Bronchiolitis syndrome" was defined as ED presentations assigned a diagnosis of bronchiolitis (ICD-9-CM code 466.1, or ICD-10-AM code J21). "Pneumonia syndrome" was defined as a diagnosis of pneumonia (ICD-9-CM codes 480-486, or ICD-10-AM codes J12-J18). "Influenza-like syndrome" was defined as a diagnosis of influenza (ICD-9-CM code 487, or ICD-10-AM codes J10 and J11). "All acute respiratory infection" syndrome included diagnoses of whooping cough, acute upper respiratory infections, influenza and pneumonia, other acute lower respiratory infections, and cough (ICD -9-CM: 033, 460-466, 480-487, 786.2; ICD-10-AM: A37, J00-J22, R05). "All respiratory syndrome" consisted of the respiratory conditions mentioned above as well as asthma, chronic obstructive pulmonary disease, respiratory distress or arrest, other breathing difficulties, and respiratory conditions during the perinatal period (ICD-9-CM: 033, 460-519, 768-770, 799.1, 786.09, 786.2; ICD-10-AM: A37, J00-J99, P20-P28, R09.2, R06.8, R05).

Analysis

Counts of ED visits and laboratory confirmed positive RSV and influenza cases were aggregated by week. Week of ED visit was used for the ED time series and the week of specimen collection was used for the laboratory series. Semi-parametric generalized additive models (GAM) were used to determine the association between the incidence of RSV and influenza and the incidence of respiratory syndrome ED presentations. GAMs extend traditional GLMs by replacing linear predictors of the form:

η = ∑jβjχj with η = ∑jfjj) where fjj) can be nonparametric smooth functions [19,20], thus incorporating the flexibility of nonparametric regression while still retaining the interpretability of GLMs [21]. Alternative methods, such as Poisson regression (without the use of a spline) but with the inclusion of a covariate to control for seasonality have been used in other studies [22], but were unable to remove autocorrelation in the residuals in our data. The non-parametric flexibility of GAMs has resulted in their widespread use in time-series studies to adjust for the nonlinear confounding effects of seasonality and trend [19,23-27].

The counts of ED visits were assumed to follow a Poisson distribution. Five models were constructed - one for each ED syndrome: bronchiolitis, pneumonia, influenza-like, all acute respiratory infections, and all respiratory visits. The outcome in each model was the time-series of weekly ED visits for the syndrome.

In each model, laboratory counts of RSV and influenza were included as predictors, as well as a non-parametric spline term for time (in weeks) to control for seasonal and secular trends. These factors need to be controlled because they produce autocorrelation (serial dependence) in the model residuals. Like our previous study of just influenza, we used natural cubic smoothing splines to control for autocorrelation and trend [8]. Failure to control for these factors can lead to incorrect inference in time series analysis. Because this study was using weekly rather than daily time increments, we used 4 degrees of freedom per year in the splines as this was sufficient for removing autocorrelation in the residuals for most of the time series we examined. This effectively removed variation occurring over more than a quarterly period and was a good balance between removing too much trend and leaving too little short-term variation in the time series. Autocorrelation was assessed by visual inspection of autocorrelation plots and p-values using the ARIMA procedure in SAS version 9.1.

Where the spline was insufficient to remove autocorrelation from the model residuals an autoregressive term (the previous week's ED syndrome count) was included in the model to remove this residual autocorrelation. This was necessary for the all acute respiratory infections syndrome and the all respiratory syndrome models. Not removing this residual autocorrelation would result in a failure of the modelling assumption of independence in the residuals and thus to incorrect inference.

The modelling was completed in two stages. The first stage was to determine the time lag in weeks that produced the strongest association between each single laboratory time series and the ED syndrome. The lag which produced the strongest association was taken to be the relative risk which was furthest from unity. The second stage was to include the lag producing the strongest association in a final model that included both RSV and influenza as explanatory variables. The lag could be different for each of RSV and influenza. Laboratory time series were lagged in single weeks from -4 to +4 weeks to allow a reasonable window for each virus to plausibly influence ED visits. The final models for each ED syndrome outcome were of the form:

(1)

where Yt denotes the weekly count of ED visits for the syndrome, β1 denotes the log relative risk of ED visits associated with a one-unit increase in laboratory confirmed positive RSV infections, β2 denotes the log relative risk of ED visits associated with a one-unit increase in laboratory confirmed positive influenza infections, and S(time) is the smoothing spline for time (in weeks). LagRSV and lagInfluenza represent the lags at which the strongest association occurred for the individual laboratory series.

Analysis was performed using the GAM procedure in SAS version 9.1. This study used de-identified epidemiological information and therefore ethical approval was not required.

Results

Descriptive statistics

Visual inspection of the time-series of counts revealed similar timing of the seasonal peaks for the ED bronchiolitis syndrome and laboratory RSV, but the peaks for laboratory influenza occurred several weeks later (Figure 1). The seasonal peaks for ED pneumonia syndrome occurred after the peaks for laboratory RSV, but shortly before the peaks for laboratory influenza. The seasonal peaks for ED influenza-like syndrome occurred after the peaks for laboratory RSV, and at a similar time to the peaks of laboratory influenza. Compared with the all acute respiratory infection syndrome, and the all respiratory syndrome, the peaks for laboratory RSV occurred earlier, while the peaks for laboratory influenza occurred later.

thumbnailFigure 1. Weekly counts of Emergency Department (ED) syndromes and laboratory syndromes: 1 June 2001 to 1 December 2006.

The age distribution for the data is shown in Table 1. As expected, the majority of RSV laboratory diagnoses occurred in infants aged <1 year (65.1%), whereas influenza laboratory diagnoses were fairly evenly distributed amongst adults aged 17-34 years (20.4%), 35-64 years (25.8%), and 65+ years (24.4%). The bronchiolitis ED syndrome mostly occurred in infants aged <1 year (86.7%), the pneumonia syndrome mostly occurred in adults aged 65+ years (43.2%), and the influenza-like syndrome mostly occurred in adults aged 17-34 years (40.8%). The all acute respiratory infections syndrome, and the all respiratory syndrome, mainly occurred in children aged 1-4 years (30.1% and 23.2% respectively). The proportions of ED visits admitted to hospital wards were 35.6% for the bronchiolitis, 5.8% for the influenza-like, 24.4% for the all acute respiratory infection, 34.6% for the all respiratory, and 73.8% for the pneumonia ED syndromes, respectively.

Table 1. Number (and percent total) per age group, for laboratory and Emergency Department (ED) syndrome data1.

Influenza A virus accounted for the majority of positive influenza laboratory cases (77.7%). Influenza B accounted for 19.8% of the cases, while 2.5% were positive for both influenza A and B.

Preliminary GAMs to determine lags with largest effects

The results of the preliminary analysis to establish the lags for the final models are given in Table 2. Relative risks refer to changes in ED visits resulting from every additional positive laboratory report for influenza and RSV. ED bronchiolitis syndrome was most associated with RSV laboratory counts in the same week (lag 0 week) (RR 1.031, 95%CI: 1.027-1.035), and with influenza laboratory counts four weeks in the future (lag -4 weeks) (RR: 1.007, 95%CI: 1.003-1.011). ED pneumonia syndrome was most associated with RSV counts four weeks in the past (lag + 4 weeks) (RR: 1.015, 95%CI: 1.012-1.018), and with influenza laboratory counts one week in the future (lag -1 week) (RR: 1.011, 95%CI: 1.008-1.013). ED influenza-like syndrome was most associated with RSV counts one week in the past (lag 1 week) (RR: 0.983, 95%CI: 0.976-0.990), and with influenza laboratory counts one week in the future (lag -1 week) (RR: 1.047, 95%CI: 1.042-1.052). The all acute respiratory infections and all respiratory syndromes were most associated with RSV laboratory counts occurring two weeks in the past (RR: 1.008, 95%CI: 1.006-1.009; and RR: 1.006, 95%CI: 1.005-1.007 respectively), and influenza laboratory counts occurring one week in the future (RR: 1.012, 95%CI: 1.011-1.013; and RR: 1.009, 95%CI: 1.008-1.010 respectively).

Table 2. Change in Emergency Department (ED) syndrome counts (relative risk (RR) and 95% CI) associated with a 1 unit increase in weekly laboratory counts, lagged by up to ± 4 weeks: Univariate analysis.

Final GAMs

The results of the final models that included both RSV and influenza are presented in Table 3. After controlling for long term trend and seasonality, for every additional RSV laboratory count, the bronchiolitis ED syndrome increased by 3.1% (95%CI: 2.7%-3.5%) in the same week, the pneumonia syndrome increased by 1.4% (95%CI: 1.1%-1.7%) four weeks in the future, the influenza-like syndrome decreased by 2.0% (95%CI: 1.3%-2.8%) one week in the future, the all acute respiratory infection syndrome increased by 0.6% (95%CI: 0.5%-0.7%) two weeks in the future, and the all respiratory syndrome increased by 0.4% (95%CI: 0.3%-0.5%) two weeks in the future.

Table 3. Change in ED visits (Relative risk and 95%CI) associated with a 1 unit increase in weekly laboratory counts: final models.

After controlling for long term trend and seasonality, for every additional influenza laboratory count, the bronchiolitis syndrome increased by 0.6% (95%CI: 0.3%-1.0%) 4 weeks in the past, the pneumonia syndrome increased by 1.0% (95%CI: 0.7%-1.2%) one week in the past, the influenza-like syndrome increased by 4.7% (95%CI: 4.2%-5.2%) one week in the past, the all acute respiratory infection syndrome increased by 0.6% (95%CI: 0.5%-0.7%) one week in the past, and the all respiratory syndrome increased by 0.5% (95%CI: 0.4%-0.6%) one week in the past.

Graphs representing the observed counts for ED visits versus the fitted (predicted) values for each of the final models are shown in Figures 2, 3, 4, 5, and 6. These figures reveal good fit for each of the final models.

thumbnailFigure 2. Observed versus predicted values for bronchiolitis ED visits by week: 1 June 2001 to 1 December 2006.

thumbnailFigure 3. Observed versus predicted values for pneumonia ED visits by week: 1 June 2001 to 1 December 2006.

thumbnailFigure 4. Observed versus predicted values for influenza ED visits by week: 1 June 2001 to 1 December 2006.

thumbnailFigure 5. Observed versus predicted values for all acute respiratory infections ED visits by week: 1 June 2001 to 1 December 2006.

thumbnailFigure 6. Observed versus predicted values for all respiratory ED visits by week: 1 June 2001 to 1 December 2006.

Discussion

By fitting time-series models which control for both longer-term and seasonal effects, and which account for the inherent auto-correlation in the data, we found a large, significant, and independent association between ED presentations for influenza and positive laboratory tests for influenza viruses. We also found a large, significant and independent association between ED presentations for bronchiolitis, and RSV laboratory counts. Thus our results confirm the value of monitoring these more specific syndromes in discriminating between influenza and RSV activity in the population.

While the relative increases in ED visits in the bronchiolitis and influenza-like syndromes associated with a unit increase in laboratory-identified RSV and influenza virus were of the order of 3% and 5%, respectively, a small increase in laboratory identified virus could actually represent a very large increase in population levels of illness. This is because only a small proportion of people exposed to the virus and infected are likely to attend an ED and an even smaller proportion are likely to be tested for a virus.

The other, smaller associations found in this study are more difficult to interpret. In the period we studied, RSV laboratory counts peaked before influenza laboratory counts, and RSV was associated with ED diagnoses of pneumonia several weeks later. Hence, it is possible that RSV infection may increase subsequent susceptibility to influenza infection or pneumonia, although other studies are needed to investigate this further.

The relatively small associations found between laboratory RSV and influenza counts, and the all acute respiratory infection and all respiratory syndromes indicate that there are many other factors driving the increase in these ED visits which have not been accounted for in the models for these two syndrome outcomes. These other factors may include additional circulating respiratory pathogens, environmental contributors including temperature, or holidays. The inclusion of the previous week's ED visits in the GAM models for both of these syndromes was required to remove autocorrelation in the residuals, and represents the contribution of these unmeasured factors.

For influenza, our findings were consistent with our previous work using a similar date range and state-wide data, and a different, but sound, statistical method [8]. Our findings were also broadly consistent with those of Wijngaard et al [9] who also controlled for autocorrelation in their regression model. They found a 1-2 week advantage for hospitalisations diagnosed with any acute respiratory illness over laboratory-identified influenza. For RSV, they found that the hospitalisations increased in the same week as laboratory-identified RSV.

The data sources used in this study may have some limitations. Since RSV data was only available for the south-eastern area of Sydney, the scope of our study was limited to this region. Therefore, due to small numbers, analysis by age group for instance was not possible. Another limitation is that ED provisional diagnoses were selected by ED medical, nursing or clerical staff in the course of their work, and selection of codes may vary between staff and hospitals. Limitations for the ED data and laboratory influenza data are discussed further in [8].

Our decision to use GAMs in this study was based on the flexibility they provide through the use of nonparametric regression. The problem with using a parametric approach, such as sinusoidal terms to control for seasonality, is that this assumes that the seasonal peak is the same height and occurs at the same time each year [28]. It can clearly be seen from the time-series graphs (Fig. 1) that this is not the case in our data, and is probably not the case in these time series generally.

Conclusion

In conclusion, syndromic surveillance of ED visits diagnosed with influenza or bronchiolitis can give a reasonable assurance that influenza and RSV, respectively, are circulating in the population, and can be used to discriminate between them. This finding is particularly useful in our state, where RSV infection is not a reportable disease and near real-time ED surveillance is a reality [4].

Competing interests

The authors declare that they have no competing interests.

Authors' contributions

SS designed and performed the analysis and drafted the manuscript. DM conceived of the study, participated in its design and coordination, assisted in the interpretation of the results, and helped to draft the manuscript. MF was involved in the design and interpretation of the study and assisted in its interpretation. KR and PG were involved in the initial literature review and early analyses. TC contributed to the design of the study and assisted in its interpretation. All authors read and approved the final manuscript.

Acknowledgements

We would like to acknowledge the help and support of Alma Nurkic (Public Health Unit, South Eastern Sydney and Illawarra Area Health Service) in the management of data from the South Eastern Sydney Laboratory Surveillance Program. We would also like to thank the reviewers of this journal.

References

  1. Buehler JW, Berkelman RL, Hartley DM, Peters CJ: Syndromic surveillance and bioterrorism-related epidemics.

    Emerging Infectious Diseases 2003, 9(Suppl 10):1197-1204. OpenURL

  2. Heffernan R, Mostashari F, Das D, Karpati A, Kulldorff M, Weiss D: Syndromic surveillance in public health practice, New York City.

    Emerging Infectious Diseases 2004, 10(Suppl 5):858-864. OpenURL

  3. Yuan CM, Love S, Wilson M: Syndromic surveillance at hospital emergency departments - southeastern Virginia.

    Morbidity and Mortality Weekly Report 2004, 53:56-8. OpenURL

  4. Muscatello D, Churches T, Kaldor J, Zheng W, Chiu C, Correll P, Jorm L: An automated, broad-based, near real-time public health surveillance system using presentations to hospital emergency departments in New South Wales, Australia.

    BMC Public Health 2005, 5:141. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  5. Hope K, Merritt T, Eastwood K, Main K, Durrheim DN, Muscatello D, Todd K, Zheng W: The public health value of emergency department syndromic surveillance following a natural disaster.

    Communicable Diseases Intelligence 2008, 32(Suppl 1):92-4. OpenURL

  6. Wu TS, Shih FY, Yen MY, Wu JS, Lu SW, Chang KC, Hsiung C, Chou JH, Chu YT, Chang H, Chiu CH, Tsui FC, Wagner MM, Su IJ, King CC: Establishing a nationwide emergency department-based syndromic surveillance system for better public health responses in Taiwan.

    BMC Public Health 2008, 8:18. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  7. Bourgeois FT, Olson KL, Brownstein JS, McAdam AJ, Mandl KD: Validation of syndromic surveillance for respiratory infections.

    Annals of Emergency Medicine 2006, 47(Suppl 3):265-271. OpenURL

  8. Zheng W, Aitken R, Muscatello D, Churches T: Potential for early warning of viral influenza activity in the community by monitoring clinical diagnoses of influenza in hospital emergency departments.

    BMC Public Health 2007, 7:250. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  9. Wijngaard C, Asten L, Wilfrid P, Nagelkerke N, Verheij R, Neeling A, Dekkers A, Sande M, Vliet H, Koopmans M: Validation of syndromic surveillance for respiratory pathogen activity.

    Emerging Infectious Diseases 2008, 14(Suppl 6):917-925. Publisher Full Text OpenURL

  10. Cooper DL, Smith GE, Edmunds WJ, Joseph C, Gerard E, George RC: The contribution of respiratory pathogens to the seasonality of NHS Direct calls.

    Journal of Infection 2007, 55(Suppl 3):240-248. Publisher Full Text OpenURL

  11. Muller-Pebody B, Edmunds WJ, Zambon MC, Gay NJ, Crowcroft NS: Contribution of RSV to bronchiolitis and pneumonia-associated hospitalizations in English children, April 1995-March 1998.

    Epidemiology and Infection 2002, 129:99-106. Publisher Full Text OpenURL

  12. Shay DK, Holman RC, Newman RD, Liu LL, Stout JW, Anderson LJ: Bronhiolitis-associated hospitalizations among US children, 1980-1996.

    JAMA: The Journal of the American Medical Association 1999, 282(Suppl 15):1440-1446. Publisher Full Text OpenURL

  13. Hashem M, Hall CB: Respiratory syncytial virus in healthy adults: the cost of a cold.

    Journal of Clinical Virology: the official publication of the Pan American Society for Clinical Virology 2003, 27:14-21. PubMed Abstract | Publisher Full Text OpenURL

  14. Upshur REG, Moineddin R, Crighton EJ, Mamdani M: Interactions of viral pathogens on hospital admissions for pneumonia, croup and chronic obstructive pulmonary diseases: results of a multivariate time-series analysis.

    Epidemiology and Infection 2006, 134:1174-1178. Publisher Full Text OpenURL

  15. Hu JJ, Kao CL, Lee PI, Chen CM, Lee CY, Lu CY, Huang LM: Clinical features of influenza A and B in children and association with myositis.

    Journal of Microbiology, Immunology, and Infection 2004, 37(Suppl 2):95-8. OpenURL

  16. Arostegi Kareaga N, Montes M, Perez-Yarza EG, Sardon O, Vicente D, Cilla G: Clinical characteristics of children hospitalized for influenza virus infection.

    Anales de Pediatria 2005, 62(Suppl 1):5-12. Publisher Full Text OpenURL

  17. New South Wales Department of Health: Notification of Infectious Diseases under the Public Health Act. 1991. OpenURL

  18. Centre for Epidemiology and Research NSW Department of Health: Health Outcome Information Statistical Toolkits. OpenURL

  19. Dominici F, McDermott A, Zeger SL, Samet JM: On the use of generalized additive models in time-series studies of air pollution and health.

    American Journal of Epidemiology 2002, 156(Suppl 3):193-203. Publisher Full Text OpenURL

  20. Ramsay TO, Burnett RT, Krewski D: The effect of concurvity in generalized additive models linking mortality to ambient particulate matter.

    Epidemiology 2003, 14(Suppl 1):18-23. Publisher Full Text OpenURL

  21. Hastie T, Tibshirani R: Generalized Additive Models. London: Chapman and Hall; 1990. OpenURL

  22. Mangtani P, Hajat S, Kovats S, Wilkinson P, Armstrong B: The association of respiratory syncytial virus infection and influenza with emergency admissions for respiratory disease in London: An analysis of routine surveillance data.

    Clinical Infectious Diseases 2006, 42(5):640-646. PubMed Abstract | Publisher Full Text OpenURL

  23. Schwartz J: Air pollution and hospital admissions for heart disease in eight U.S. counties.

    Epidemiology 1999, 10(Suppl 1):17-22. OpenURL

  24. Katsouyanni K, Touloumi G, Samoli E, Gryparis A, Tertre AL, Monopolis Y, Giuseppe R, Zmirou D, Ballester F, Boumghar A, Anderson HR, Wojtyniak B, Paldy A, Braunstein R, Pekkanen J, Schindler C, Schwartz J: Confounding and effect modification in the short-term effects of ambient particles on total mortality: results from 29 European cities within the APHEA2 project.

    Epidemiology 2001, 12(Suppl 5):521-531. Publisher Full Text OpenURL

  25. Samet JM, Dominici F, Curriero FC, Coursac I, Zeger SL: Fine particulate air pollution and mortality in 20 U.S. cities, 1987-1994.

    The New England Journal of Medicine 2000, 343(Suppl 24):1742-1749. Publisher Full Text OpenURL

  26. Metzger KB, Tolbert PE, Klein M, Peel JL, Flanders WD, Todd K, Mulholland JA, Ryan PB, Frumkin H: Ambient air pollution and cardiovascular emergency department visits.

    Epidemiology 2004, 15(Suppl 1):46-56. Publisher Full Text OpenURL

  27. Fung KY, Krewski D, Chen Y, Burnett R, Cakmak S: Comparison of time series and case-crossover analyses of air pollution and hospital admission data.

    International Journal of Epidemiology 2003, 32(Suppl 6):1064-1070. Publisher Full Text OpenURL

  28. Schwartz J, Spix C, Touloumi G, Bacharova L, Barumamdzadeh T, Tertre A, Piekarksi T, Leon A, Ponka A, Rossi G, Saez M, Schouten J: Methodological issues in studies of air pollution and daily counts of deaths or hospital admissions.

    Journal of Epidemiology and Community Health 1996, 50(Suppl 1):S3-S11. Publisher Full Text OpenURL

Pre-publication history

The pre-publication history for this paper can be accessed here:

http://www.biomedcentral.com/1471-2334/9/190/prepub