04 June 2015
Performance of case definitions for influenza surveillance
- Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore
- Biodefence Centre, Ministry of Defence, Singapore
- Communicable Disease Centre, Institute of Infectious Disease and Epidemiology, Tan Tock Seng Hospital, Singapore
- Emerging Infectious Diseases Program, Duke-NUS Graduate Medical School, Singapore
- National Public Health Laboratory, Ministry of Health, Singapore
- WHO Collaborating Centre for Reference and Research for Influenza, Victorian Infectious Diseases Reference Laboratory, Melbourne, Australia
- Yale-NUS College, National University of Singapore, Singapore
- Department of Statistics and Applied Probability, Faculty of Science, National University of Singapore, Singapore
- Program in Health Services and Systems Research, Duke-NUS Graduate Medical School, Singapore
Citation style for this article: Jiang L, Lee VJ, Lim WY, Chen MI, Chen Y, Tan L, Lin RT, Leo YS, Barr I, Cook AR. Performance of case definitions for influenza surveillance. Euro Surveill. 2015;20(22):pii=21145. Article DOI: http://dx.doi.org/10.2807/1560-7917.ES2015.20.22.21145
Date of submission:
27 May 2014
Influenza-like illness (ILI) case definitions, such as those from the European Centre for Disease Control and Prevention, World Health Organization (WHO) and United States Centers for Disease Control and Prevention, are commonly used for influenza surveillance. We assessed how various case definitions performed during the initial wave of influenza A(H1N1)pdm09 infections in Singapore on a cohort of 727 patients with two to three blood samples and whose symptoms were reviewed fortnightly from June to October 2009. Using seroconversion (≥ 4-fold rise) to A/California/7/2009 (H1N1), we identified 36 presumptive influenza A(H1N1)pdm09 episodes and 664 episodes unrelated to influenza A(H1N1)pdm09. Cough, fever and headache occurred more commonly in presumptive influenza A(H1N1)pdm09. Although the sensitivity was low (36%), the recently revised WHO ILI case definition gave a higher positive predictive value (42%) and positive likelihood ratio (13.3) than the other case definitions. Results including only episodes with primary care consultations were similar. Individuals who worked or had episodes with fever, cough or sore throat were more likely to consult a physician, while episodes with Saturday onset were less likely, with some consultations skipped or postponed. Our analysis supports the use of the revised WHO ILI case definition, which includes only cough in the presence of fever defined as body temperature ≥ 38 °C for influenza surveillance.
The emergence of influenza A(H1N1)pdm09 virus, a novel strain of influenza virus A(H1N1), in April 2009 and its subsequent rapid global spread have focused attention on influenza surveillance capabilities worldwide . As one of the main components of influenza surveillance, surveillance for influenza-like illness (ILI) among outpatients or patients of emergency departments can provide early warning of increased influenza virus circulation and information on where influenza activity is occurring, track the course of influenza activity during the season, and serve as a source of samples for virus isolation . It is hence important to have a reliable case definition for ILI. While the presence of fever and selected symptoms of acute respiratory tract infection are common features, case definitions used for ILI differ slightly from country to country and have also changed over time [3-8]. Notably, it remains unclear if any of these specific combinations of symptoms or temperature cut-off point is better than others for influenza surveillance.
There have been a number of studies evaluating the performance of ILI case definitions, but most of these studies were based on outpatients visiting EDs and general practices or hospitalised patients [7-12], which may be subject to biases arising from how different individuals and populations access medical care. Moreover, there have recently been initiatives to use self-reported symptoms based on telephone or Internet surveys for influenza surveillance , and it is unclear if ILI case definitions validated on cases seeking medical care are appropriate in such situations. Furthermore, the pattern of medical care consultations in influenza as well as non-influenza related acute illness episodes may also affect the performance of ILI case definitions for influenza surveillance. What is hence needed is a study that can capture data on symptoms in the community, verify which of these might be associated with influenza, and clarify how individual and episode level characteristics associated with medical care consultation might affect the quality of ILI surveillance data [2,14,15].
Singapore, a tropical south-east Asian city-state and global travel hub, detected its first imported case of influenza A(H1N1)pdm09 in late May 2009. Sustained community transmission started in late June 2009, with epidemic activity peaking in early August and subsiding in September 2009 . In this study, we exploited the combination of serological investigations and self-reported data on symptoms and medical consultations from a cohort established in the run-up to the pandemic to compare the ILI case definitions used by the European Centre for Disease Prevention and Control (as mandated by the European Union for communicable disease reporting, and henceforth abbreviated as EU-ECDC) [3,17], the United States Centers for Disease Control and Prevention (US-CDC)  and the World Health Organization (WHO) (previously used (‘old’)  and the January 2014 revised (‘new’) ) with regard to sensitivity, specificity, predictive value and likelihood ratio. We also illustrate the performance of various ILI-based approaches to estimating influenza incidence during the first wave of influenza A(H1N1)pdm09 in Singapore. Finally, we assessed factors associated with primary care consultation, to highlight how consultation patterns vary by population subgroups, disease, symptoms and timing, as these factors may additionally complicate the interpretation of ILI surveillance data.
Study design and recruitment
This prospective community cohort study was part of a larger study to determine serological conversion to influenza A(H1N1)pdm09 virus in different populations [18-20]. We recruited 838 community-dwelling adults aged 21–75 years and aimed to get three blood samples from each participant. Banked samples were used for the baseline sample (sample 1); these were obtained during 29 June 2005 to 27 June 2009, before widespread community transmission of influenza A(H1N1)pdm09 virus in Singapore. Two additional blood samples were obtained: an intra-epidemic sample (sample 2) collected about four weeks after the peak of the epidemic (20–29 August 2009) and a post-epidemic sample (sample 3) collected about four weeks after the epidemic had subsided (6–11 October 2009). Only individuals who contributed at least two blood samples were included in this analysis.
A baseline telephone interview with a standardised questionnaire was conducted at recruitment, followed by fortnightly interviews throughout the epidemic period for new onset of the following symptoms, with dates of onset for each of the individual symptoms collected:
All participants provided written consent, and the study was approved by the Institutional Review Board of the National University of Singapore.
- respiratory symptoms – cough, sore throat, runny or blocked nose and breathlessness;
- constitutional symptoms – fever, myalgia and headache;
- gastrointestinal symptoms – abdominal pain, nausea, vomiting and diarrhoea.
Laboratory methods and definition of seroconversion
Haemagglutination-inhibition assay was performed according to standard protocols of the WHO Collaborating Centre for Reference and Research on Influenza in Melbourne, Australia, as previously described . We defined seroconversion as a fourfold or greater increase in antibody titres to influenza A/California/7/2009 (H1N1) pandemic virus between any successive pairs of blood samples. For each subject, we assigned a ‘seroconversion date’, against which the timing of various illness episodes was assessed. This would be the date of collection of sample 2 if seroconversion had occurred by then, regardless of additional changes in titre in sample 3. We also recorded the date of sample 3 collection if seroconversion was detected then but not in sample 2.
Illness episodes and case definitions
We defined an illness episode as acute onset of at least one of the symptoms listed in the earlier section on study design and recruitment. As symptoms due to an infection could start on different days, we defined onset of an illness episode as a cluster of symptoms starting within seven days of each other, and defined the onset date of that illness episode based on the earliest symptom in the cluster. Any symptoms starting after these seven days were then considered as part of a new illness episode. Since infection with influenza A(H1N1)pdm09 and the resultant illness episode had to have an onset date consistent with the seroconversion date, we therefore defined a probable influenza A(H1N1)pdm09-related episode as an episode in which the earliest symptom occurred at least one day before the seroconversion date. Illness episodes occurring on or after the day when seroconversion was detected, or in individuals who did not seroconvert, could then be classified with some certainty as being unrelated to influenza A(H1N1)pdm09. All combinations of episode occurrences relative to seroconversion, and how these are classified, are given in Figure 1. In some seroconverting individuals, there was more than one probable influenza A(H1N1)pdm09-related episode, based on the timing of symptoms. Since we cannot definitively identify which of these episodes was caused by influenza A(H1N1)pdm09, we opted to exclude such observations, and thus defined a presumptive influenza A(H1N1)pdm09 episode as those episodes that occurred in individuals who had only a single probable influenza A(H1N1)pdm09-related episode.
Figure 1. Permutations of illness episode occurrence relative to seroconversion and classification of illness episode
Several specific case definitions commonly used for influenza surveillance were analysed:
- acute respiratory illness (ARI) – we defined an ARI episode as acute onset of any of the following respiratory symptoms: cough, shortness of breath, sore throat or nasal congestion (runny nose or blocked nose);
- febrile respiratory illness (FRI) – ARI with self-reported fever, regardless of body temperature measurement;
- modified EU-ECDC ILI – sudden onset of symptoms with one or more respiratory symptoms (cough, sore throat and/or shortness of breath) plus one or more systemic symptoms (self-reported fever, headache and/or myalgia); this is an approximation of the EU-ECDC ILI case definition [3,17] (which additionally has malaise as one of the systemic symptoms);
- US-CDC ILI – fever defined as body temperature ≥ 37.8 °C plus cough and/or sore throat in the absence of a known cause other than influenza ;
- WHO old ILI – sudden onset of fever defined as body temperature > 38 °C plus either cough or sore throat ;
- WHO new ILI – fever defined as body temperature ≥ 38 °C plus cough and with onset within the last 10 days .
To assess the performance of different case definitions, we compared how well different symptoms, as well as commonly used case definitions, could distinguish presumptive influenza A(H1N1)pdm09 episodes from those classified as unrelated to influenza A(H1N1)pdm09. Sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), odds ratio (OR), positive likelihood ratio (LR+), negative likelihood ratio (LR−) and 95% confidence intervals (CIs) for OR, LR+ and LR− were calculated.
For each case definition, we also used the total number of episodes per 100 individuals, the number of episodes involving primary care consultation per 100 individuals, and the proportion of individuals who ever had such an episode, to illustrate how these measures might perform in monitoring the progress of an epidemic compared with virological surveillance of ILI based on positive samples from sentinel general practices submitting respiratory samples to the National Public Health Laboratory. We also compared the respective estimates of influenza attack rates with serological data.
Finally, we investigated if demographics, timing of episode onset by day of the week and nature of symptoms affected presentation to primary care, with the outcome of interest being whether that illness episode was associated with a primary care consultation within seven days after onset.
Because each individual could have had more than one illness episode during the whole study period, a multilevel model was used in all logistic regression analyses to control for the effects of multiple episodes in the same individual. All statistical analysis was done with Stata 11.0 and R version 3.0.0; p values reported are two-tailed, with a significance level of 0.05.
Our analysis included 727 individuals who provided two or more blood samples (Figure 2), of whom 98 (13.5%) seroconverted. Those who seroconverted were significantly younger (42.4 vs 44.3 years, p = 0.027), more likely to have baseline haemagglutination-inhibition assay titres < 1:10 (94.9% (95% CI: 88.6–97.8) vs 85.5% (95% CI: 82.6–88.1), p = 0.011) and more likely to report illness episodes (79.6% (95% CI: 70.3–87.1) vs 58.8% (95% CI: 54.9–62.7), p < 0.001) and ARI (73.5% (5% CI: 63.6–81.9) vs 44.2% (95% CI: 40.3–48.2), p < 0.001). About a quarter (n = 159, 25.3% (95% CI: 21.9–28.9)) of non-seroconverting individuals had a primary care consultation compared with almost half (n = 44, 44.9% (95% CI: 34.8–55.3), p < 0.001) of those who seroconverted; the difference was even more marked for visits to hospital (1% (95% CI: 0.4–2.1) vs 6% (95% CI: 2.3–12.9) respectively, p = 0.002). However, even in those who seroconverted, the majority (n = 44, 95.7% (95% CI: 85.2–99.5)) of consultations were at primary care, and of the six individuals who sought care at a hospital, only two did not also first have a primary care consultation.
Figure 2. Characteristics of participants, by seroconversion status, included in study of case definition performance for influenza surveillance, Singapore, June–October 2009 (n = 727)
Of 788 reported illness episodes, there were 36 (4.6%) presumptive influenza A(H1N1)pdm09 episodes and 664 (84.3%) episodes unrelated to influenza A(H1N1)pdm09; the corresponding numbers were 18 (7.2%) and 201 (80.7%) if restricting to those episodes with primary care consultation (n = 249). Reported symptoms for presumptive influenza A(H1N1)pdm09 episodes and episodes unrelated to influenza A(H1N1)pdm09 are shown in Table 1. Among the 36 presumptive influenza A(H1N1)pdm09 episodes, cough (n = 30) and fever (n = 18) were the most common respiratory and constitutional symptoms respectively, while gastrointestinal symptoms were rare. Cough, sore throat, fever and headache were significantly more common among presumptive influenza A(H1N1)pdm09 episodes in the univariate analysis; with the exception of sore throat, these were also significant in the multivariate analysis. The ORs for cough, fever and headache in the multivariate model were 8.8, 4.3 and 3.1 respectively. Results for the small number of presumptive influenza A(H1N1)pdm09 episodes for which there had been primary care consultation were similar.
Table 1. Comparison of symptoms between presumptive and episodes unrelated to influenza A(H1N1)pdm09, Singapore, June–October 2009 (n = 700)
The performance of different case definitions in distinguishing presumptive influenza A(H1N1)pdm09 from unrelated illness episodes is shown in Table 2. Of the 36 presumptive influenza A(H1N1) pdm09 episodes identified, only three did not fulfil any of the case definitions we assessed (one episode where only headache was reported, and two episodes which both had nausea and vomiting only). Among all the case definitions we looked at, ARI gave the highest sensitivity (92%) but the lowest specificity (35%). Using FRI improved the specificity to 90% but reduced the sensitivity to 50%. Among the four ILI case definitions, the modified EU-ECDC ILI case definition was more sensitive (61%) than for FRI but less specific (85%). The other three ILI case definitions had similar sensitivity (36–39%) and specificity (95–97%). On comparing predictive values and likelihood ratios, all four case definitions gave similar NPVs (95–97%), but the WHO new ILI case definition had the highest PPV (42%), followed by the WHO old ILI case definition (39%), the US-CDC ILI case definition (31%) and the modified EU-ECDC ILI case definition (18%). Similarly, while all case definitions gave similar LR−, the WHO new ILI case definition had the highest LR+ (13.32), followed by the WHO old ILI case definition (11.99), US-CDC ILI case definition (8.33) and the modified EU-ECDC case definition (4.10). The performance of the four ILI case definitions relative to each other was unchanged when repeating the analysis using episodes in which the individuals had presented to primary care, but the sensitivities were slightly higher while the specificities and LR+s, PPVs and LR+s were lower.
Table 2. Performance of case definitions in distinguishing presumptive influenza A(H1N1)pdm09 from unrelated illness episodes, Singapore, June–October 2009 (n = 700)
We further explored how the respective case definitions would have performed in capturing influenza A(H1N1)pdm09 episodes in our cohort. Since only a minority of ARI was influenza A(H1N1)pdm09, ARI performed poorly in monitoring epidemic progression (Figure 3, panel A), where we were unable to discern a clear epidemic pattern as compared with the pattern in influenza A(H1N1)pdm09-positive samples from sentinel general practices. There were, however, no substantive differences in the epidemic curves when using the other five case definitions (Figures 3, panels B to F). For attack rates, we present estimates derived from all self-reported episodes, ever having had an episode, and episodes having a consultation at a general practice; these would reflect what might be obtained through repeated Internet or telephone surveys, retrospective surveys after the epidemic for ever having had an episode, and surveillance based on primary care episodes respectively. Estimates using all self-reported ARI episodes and having ever had an ARI episode gave much higher rates than serological attack rates, although overall general practice clinic consultation rates were (perhaps coincidentally) similar. The estimates numerically closest to serological attack rates for all episodes and ever having an episode were those for FRI; estimates from the modified EU-ECDC ILI were slightly higher, while those from the US-CDC ILI, WHO old ILI, and WHO new ILI were substantially lower.
Figure 3. Illness episode rates using different case definitions for all episodes and episodes involving primary care consultation compared with laboratory surveillance and serological attack rates, Singapore, June–October 2009
The influence of participant characteristics and the type and timing of symptoms on determining presentation to primary care is shown Table 3. Having self-reported fever, cough or sore throat was associated with an increase in likelihood to seek primary care both in univariate and multivariate analysis. On the other hand, episodes that were presumptive influenza A(H1N1)pdm09, while significantly associated with seeking primary care in univariate analysis, were not more likely to result in primary care consultation after adjusting for the type of symptoms experienced. For participant characteristics, in the multivariate analysis, those aged 25–34 years and those employed in work outside the home were significantly more likely to seek care. The timing of episodes also affected the probability of seeking care: individuals with episodes in which onset was on a Saturday were significantly less likely to seek care. Individuals with episodes occurring from 9 July to 28 August were also marginally more likely to seek care.
Table 3. Participant and illness episode-level characteristics associated with seeking primary care, Singapore, June–October 2009 (n = 700 episodes)
When considering all illness episodes for which primary care was sought, consultations occurred more frequently on Mondays and less frequently on Saturdays and Sundays as compared with other days of the week (Figure 4). Illness episodes with onset on weekdays (Figure 4, panels B to F) were most likely to consult on the day of onset and the day after (Figures 4, panels B to E), while those with onset on weekends would often delay consultation until Monday (Figure 4, panels G and H); this consultation pattern was consistent regardless of the case definition used (data not shown).
Figure 4. Distribution of illness episodes for which care was sought by day of week of onset and consultation, and cumulative proportion of individuals who sought care, by day of week of consultation, Singapore, June–October 2009 (n = 788 episodes)
Cough, sore throat and fever are commonly included in ILI case definitions [4,6,8]. In our study, cough, sore throat and fever were significantly more common among presumptive influenza A(H1N1)pdm09 episodes in univariate analysis, although sore throat was not in the multivariate model. This is because most influenza episodes with sore throat would also have a cough ; in our data, more than 90% of presumptive influenza A(H1N1)pdm09 episodes with sore throat also reported having a cough. Headache is another symptom that physicians associate with influenza , and headache was significantly more common among presumptive influenza A(H1N1)pdm09 episodes in both univariate and multivariate analysis in our study. A similar study among schoolchildren in Taiwan also indicated that headache had a significant association with influenza infection , although this was not found to be the case in several other studies [7,9,11].
Previous work assessing the appropriateness of influenza case definitions have focused only on patients who seek care for respiratory symptoms or those presenting with a fever [8,10,11], whereas our study captures all events with serological evidence of influenza A(H1N1)pdm09 virus infection. Our results show that the modified EU-ECDC ILI performed rather differently from the other three ILI case definitions, with a much higher sensitivity and a relatively lower specificity, mainly because the EU-ECDC ILI case definition does not require a measured fever, in contrast to the other case definitions (body temperature in US-CDC ILI: ≥ 37.8 °C, WHO old ILI: > 38 °C, WHO new ILI: ≥ 38 °C). One of the objectives of influenza surveillance is to signal the start of an influenza season or influenza epidemic, and an ILI case definition with higher sensitivity integrated with laboratory surveillance can be better at detecting the start of sustained community circulation of influenza, although it may also be more resource intensive in terms of requirements for laboratory testing . The sensitivities and specificities of the other three ILI case definitions were very similar, but the PPVs and LR+s were different, with the US-CDC ILI having the lowest and the WHO new ILI having the highest PPV and LR+. In the analysis using all reported episodes as well as episodes with primary care consultation, the LR+ calculated for the WHO new ILI case definition was higher (13.32 and 8.12 respectively) and provides support for the simplification of removing sore throat as a component of the case definition. Interestingly, although the number of presumptive influenza A(H1N1)pdm09 episodes with primary care consultation was small, the LR+ of 5.29 for the US-CDC ILI and 6.87 for the WHO old ILI case definition was fairly similar to the previous LR+ estimates reported by the studies of Govaert et al.  and Stein et al.  in individuals who sought care for symptoms suggestive of influenza.
When comparing the accuracy of estimates obtained from the various case definitions against serological attack rates, the use of ARI is clearly inadequate due to the substantial noise from episodes unrelated to influenza A(H1N1)pdm09. While the FRI estimates for all episodes and ever having an episode are numerically closest to serological attack rates, we suspect this is an artefact due to causes of FRI unrelated to influenza A(H1N1)pdm09 compensating for the imperfect sensitivity of the case definition, an effect that cannot be expected to be consistent in future epidemics or across regions. The US-CDC ILI, WHO old ILI, and WHO new ILI definitions all underestimate infection rates, as not all cases present with the requisite symptoms, and therefore data on the proportion of infections not meeting these case definitions would be needed as a multiplier to estimate overall attack rates . Feasibly, this proportion could be obtained from serological studies performed with similar influenza strains elsewhere, and may not need to be repeated in different locations and time points, though it may be preferable to use external data only provisionally and later validate estimates with serological data from the same setting and outbreak.
Our previous data also illustrate, however, that how individuals seek care is an important determinant of the performance characteristics of surveillance data collected from primary care doctors . When exploring how various factors influenced consultations, presumptive influenza A(H1N1)pdm09 was not independently associated with seeking care after adjusting for the type of symptoms experienced (specifically, fever, cough and sore throat) and as such the clinical presentation of the particular strain of influenza virus would affect the performance of ILI surveillance based on primary care consultations. Not surprisingly, those employed in work outside the home were significantly more likely to seek care, probably due to the need for time off work, which in Singapore usually requires a physician’s certificate. An Israeli study also found that obtaining a sick-leave note was the main reason to seek medical care for patients aged 30–65 years with influenza-like symptoms . It is also noteworthy that consultations more frequently occurred on Mondays and much less frequently on Saturdays and Sundays, and individuals with episodes with onset on Saturday were significantly less likely to seek care, which is possibly related to the need for certifying absenteeism from work, although it could also reflect heterogeneities in the infection risk across the week, as has been found for dengue . Estimates of infection rates derived from primary care consultations are therefore most stable if performed on a weekly basis to smooth out these fluctuations, or if daily fluctuations are explicitly accounted for in the analysis . In addition, the slightly increased probability of consultation during some weeks of the pandemic (in particular the period 9 July to 29 July (Table 3)), also shows the importance of early and repeated surveys during the course of an epidemic as failure to account for changes in health-seeking behaviour may lead to misleading estimates.
This study has several limitations that should be addressed in future work. Attack rates and clinical presentations of influenza virus infection often vary by age [29,30]. The adult-only cohort (21–75 years) may not be representative of all age groups, and we only identified 36 presumptive influenza A(H1N1)pdm09 episodes with which to assess various case definitions. Moreover, differences in clinical symptoms between influenza virus subtypes [31,32] mean that the case definition may have to be adjusted depending on the circulating strain. Other limitations include the possibility of non-seroconversion upon infection , which may lead to systematic errors in the estimates. Recall bias, in spite of the short interval between surveys, may be present, and we did not consider the timing of symptoms relative to presentation (e.g. sore throat may precede cough). Knowing about the study objectives or that there was a pandemic may also have led participants to seek healthcare more, or over-report certain symptoms. Finally, multiple general practice consultations were not considered as it was not possible to ascertain if individuals fulfilled the case definitions across all consultations.
In conclusion, we evaluated the performance of the modified EU-ECDC ILI, US-CDC ILI, WHO old ILI and WHO new ILI case definitions in detecting illness episodes due to influenza A(H1N1)pdm09. The recently revised WHO ILI case definition was found to be an improvement over the others, with a higher PPV and LR+. Regardless of the performance of the different case definitions, health-seeking behaviour was strongly associated with several factors independent of the symptoms and disease under consideration, and population- and episode-level characteristics, such as the proportion who work and day-of-week effects respectively, would need to be accounted for when interpreting surveillance data based on ILI case definitions.
This project was funded by the grant PPG10-09 from the National Medical Research Council of Singapore. M.I.C., Y.C. and A.R.C. are supported by the Centre for Infectious Disease Epidemiology and Research at the Saw Swee Hock School of Public Health, National University of Singapore and National University Health System. The WHO Collaborating Centre for Reference and Research on Influenza, Melbourne, is supported by the Australian Government Department of Health and Ageing.
Conflict of interest
V. J. L. has received unrelated research grants from GlaxoSmithKline.
Mark I. Chen designed the study and directed its implementation. Mark I. Chen, Wei-Yen Lim, Yee Sin Leo and Linda Tan W.L. supervised the field work. Ian Barr and Raymond T. P. Lin designed and supervised laboratory analyses of the samples collected. Mark I. Chen, Lili Jiang, Vernon J. Lee and Alex R. Cook came up with the study hypothesis and devised the plan for data analysis. Mark I. Chen, Lili Jiang, Yirong Chen and Alex R. Cook conducted the data analysis and interpreted the results. Mark I. Chen, Lili Jiang and Vernon J. Lee helped draft the manuscript. Mark I. Chen, Lili Jiang, Vernon J. Lee and Alex R. Cook conducted critical revision of the manuscript.
- Ortiz JR, Sotomayor V, Uez OC, Oliva O, Bettels D, McCarron M, et al. Strategy to enhance influenza surveillance worldwide. Emerg Infect Dis. 2009;15(8):1271-8. Available from: http://dx.doi.org/10.3201/eid1508.081422 PMID:19751590
- Brammer L, Budd A, Cox N. Seasonal and pandemic influenza surveillance considerations for constructing multicomponent systems. Influenza Other Respi Viruses. 2009;3(2):51-8. Available from: http://dx.doi.org/10.1111/j.1750-2659.2009.00077.x PMID:19496841
- European Centre for Disease Prevention and Control (ECDC). Influenza case definitions. Stockholm: ECDC. [Accessed 21 May 2014]. Available from: http://ecdc.europa.eu/en/activities/surveillance/eisn/surveillance/pages/influenza_case_definitions.aspx?preview=yes&pdf=yes
- World Health Organization (WHO). WHO global technical consultation: global standards and tools for influenza surveillance. Geneva, Switzerland, 8–10 March 2011. Geneva: WHO; 2011. Available from: http://whqlibdoc.who.int/hq/2011/WHO_HSE_GIP_2011.1_eng.pdf?ua=1
- World Health Organization (WHO). Human infection with pandemic (H1N1) 2009 virus: updated interim WHO guidance on global surveillance. 10 July 2009. Geneva: WHO. [Accessed 3 Oct 2013]. Available from: http://www.who.int/csr/disease/swineflu/guidance/surveillance/WHO_case_definition_swine_flu_2009_04_29.pdf?ua=1
- Centers for Disease Prevention and Control (CDC). Overview of influenza surveillance in the United States. Atlanta, GA: CDC. [Accessed 13 Aug 2013]. Available from: http://www.cdc.gov/flu/weekly/overview.htm
- Hirve S, Chadha M, Lele P, Lafond KE, Deoshatwar A, Sambhudas S, et al. Performance of case definitions used for influenza surveillance among hospitalized patients in a rural area of India. Bull World Health Organ. 2012;90(11):804-12. Available from: http://dx.doi.org/10.2471/BLT.12.108837 PMID:23226892
- Chen S-Y, Chen Y-C, Chiang W-C, Kung H-C, King C-C, Lai M-S, et al. Field performance of clinical case definitions for influenza screening during the 2009 pandemic. Am J Emerg Med. 2012;30(9):1796-803. Available from: http://dx.doi.org/10.1016/j.ajem.2012.02.016 PMID:22633701
- Babcock HM, Merz LR, Dubberke ER, Fraser VJ. Case-control study of clinical features of influenza in hospitalized patients. Infect Control Hosp Epidemiol. 2008;29(10):921-6. Available from: http://dx.doi.org/10.1086/590663 PMID:18754739
- Dai XQ, Liu M, Zhang TH, Yang XS, Li SL, Li XG, et al. Clinical predictors for diagnosing pandemic (H1N1) 2009 and seasonal influenza (H3N2) in fever clinics in Beijing, China. Biomed Environ Sci. 2012;25(1):61-8. PMID:22424628
- Boivin G, Hardy I, Tellier G, Maziade J. Predicting influenza infections during epidemics with use of a clinical case definition. Clin Infect Dis. 2000;31(5):1166-9. Available from: http://dx.doi.org/10.1086/317425 PMID:11073747
- Thursky K, Cordova SP, Smith D, Kelly H. Working towards a simple case definition for influenza surveillance. J Clin Virol. 2003;27(2):170-9. Available from: http://dx.doi.org/10.1016/S1386-6532(02)00172-5 PMID:12829039
- de Lange MM, Meijer A, Friesema IH, Donker GA, Koppeschaar CE, Hooiveld M, et al. Comparison of five influenza surveillance systems during the 2009 pandemic and their association with media attention. BMC Public Health. 2013;13(1):881. Available from: http://dx.doi.org/10.1186/1471-2458-13-881 PMID:24063523
- Turbelin C, Pelat C, Boëlle P-Y, Lévy-Bruhl D, Carrat F, Blanchon T, et al. Early estimates of 2009 pandemic influenza A(H1N1) virus activity in general practice in France: incidence of influenza-like illness and age distribution of reported cases. Euro Surveill. 2009;14(39):19341.
- Lee VJ, Chen MI, Yap J, Ong J, Lim W-Y, Lin RTP, et al. Comparability of different methods for estimating influenza infection rates over a single epidemic wave. Am J Epidemiol. 2011;174(4):468-78. Available from: http://dx.doi.org/10.1093/aje/kwr113 PMID:21719743
- Cutter JL, Ang LW, Lai FYL, Subramony H, Ma S, James L. Outbreak of pandemic influenza A (H1N1-2009) in Singapore, May to September 2009. Ann Acad Med Singapore. 2010;39(4):273-82. PMID:20473451
- European Commission. Commission Implementing Decision of 8 August 2012 amending Decision 2002/253/EC laying down case definitions for reporting communicable diseases to the Community network under Decision No 2119/98/EC of the European Parliament and of the Council (notified under document C(2012) 5538). Official Journal of the European Union. Luxembourg: Publications Office of the European Union. 27.9.2012:L 262/16. Available from: http://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32012D0506&qid=1428573336660&from=EN#page=16
- Chen MIC, Lee VJM, Lim W-Y, Barr IG, Lin RTP, Koh GCH, et al. 2009 influenza A(H1N1) seroconversion rates and risk factors among distinct adult cohorts in Singapore. JAMA. 2010;303(14):1383-91. Available from: http://dx.doi.org/10.1001/jama.2010.404 PMID:20388894
- Lee V, Yap J, Cook AR, Chen M, Tay J, Barr I, et al. Effectiveness of public health measures in mitigating pandemic influenza spread: a prospective sero-epidemiological cohort study. J Infect Dis. 2010;202(9):1319-26. Available from: http://dx.doi.org/10.1086/656480 PMID:20863233
- Chen MIC, Lee VJM, Barr I, Lin C, Goh R, Lee C, et al. Risk factors for pandemic (H1N1) 2009 virus seroconversion among hospital staff, Singapore. Emerg Infect Dis. 2010;16(10):1554-61. Available from: http://dx.doi.org/10.3201/eid1610.100516 PMID:20875280
- Chan M, Chen MI, Chow A, Lee CPS, Tan ASH, Lye DC, et al. Pandemic (H1N1) 2009: clinical and laboratory findings of the first fifty cases in Singapore. Ann Acad Med Singapore. 2010;39(4):267-72. PMID:20473450
- Call SA, Vollenweider MA, Hornung CA, Simel DL, McKinney WP. Does this patient have influenza? JAMA. 2005;293(8):987-97. Available from: http://dx.doi.org/10.1001/jama.293.8.987 PMID:15728170
- Hsieh Y-H, Tsai C-A, Lin C-Y, Chen J-H, King C-C, Chao D-Y, et al. Asymptomatic ratio for seasonal H1N1 influenza infection among schoolchildren in Taiwan. BMC Infect Dis. 2014;14(1):80. Available from: http://dx.doi.org/10.1186/1471-2334-14-80 PMID:24520993
- Govaert TM, Dinant GJ, Aretz K, Knottnerus JA. The predictive value of influenza symptomatology in elderly people. Fam Pract. 1998;15(1):16-22. Available from: http://dx.doi.org/10.1093/fampra/15.1.16 PMID:9527293
- Stein J, Louie J, Flanders S, Maselli J, Hacker JK, Drew WL, et al. Performance characteristics of clinical diagnosis, a clinical decision rule, and a rapid influenza test in the detection of influenza infection in a community sample of adults. Ann Emerg Med. 2005;46(5):412-9. Available from: http://dx.doi.org/10.1016/j.annemergmed.2005.05.020 PMID:16271670
- Kahan E, Giveon SM, Zalevsky S, Imber-Shachar Z, Kitai E. Behavior of patients with flu-like symptoms: consultation with physician versus self-treatment. Isr Med Assoc J. 2000;2(6):421-5. PMID:10897230
- Cook AR, Carrasco LR, Lee VJ, Ooi EE, Chen MI-C, Lye DC, et al. Higher risk of infection with dengue at the weekend among male Singaporeans. Am J Trop Med Hyg. 2012;87(6):1116-8. Available from: http://dx.doi.org/10.4269/ajtmh.2012.11-0648 PMID:23128291
- Ong JBS, Chen MI-C, Cook AR, Lee HC, Lee VJ, Lin RTP, et al. Real-time epidemic monitoring and forecasting of H1N1-2009 using influenza-like illness from general practice and family doctor clinics in Singapore. PLoS ONE. 2010;5(4):e10036. Available from: http://dx.doi.org/10.1371/journal.pone.0010036 PMID:20418945
- Clark NM, Lynch JP 3rd. Influenza: epidemiology, clinical features, therapy, and prevention. Semin Respir Crit Care Med. 2011;32(4):373-92. Available from: http://dx.doi.org/10.1055/s-0031-1283278 PMID:21858743
- Soh SE, Cook AR, Chen MIC, Lee VJ, Cutter JL, Chow VTK, et al. Teacher led school-based surveillance can allow accurate tracking of emerging infectious diseases - evidence from serial cross-sectional surveys of febrile respiratory illness during the H1N1 2009 influenza pandemic in Singapore. BMC Infect Dis. 2012;12(1):336. Available from: http://dx.doi.org/10.1186/1471-2334-12-336 PMID:23206689
- Ong AK, Chen MI, Lin L, Tan AS, Nwe NW, Barkham T, et al. Improving the clinical diagnosis of influenza--a comparative analysis of new influenza A (H1N1) cases. PLoS ONE. 2009;4(12):e8453. Available from: http://dx.doi.org/10.1371/journal.pone.0008453 PMID:20041115
- Lee VJ, Yap J, Cook AR, Tan CH, Loh J-P, Koh W-H, et al. A clinical diagnostic model for predicting influenza among young adult military personnel with febrile respiratory illness in Singapore. PLoS ONE. 2011;6(3):e17468. Available from: http://dx.doi.org/10.1371/journal.pone.0017468 PMID:21399686
- Chen MI, Barr IG, Koh GCH, Lee VJ, Lee CPS, Shaw R, et al. Serological response in RT-PCR confirmed H1N1-2009 influenza A by hemagglutination inhibition and virus neutralization assays: an observational study. PLoS ONE. 2010;5(8):e12474. Available from: http://dx.doi.org/10.1371/journal.pone.0012474 PMID:20814575
The opinions expressed by authors contributing to Eurosurveillance
do not necessarily reflect the opinions of the European Centre for Disease Prevention and Control (ECDC) or the editorial team or the institutions with which the authors are affiliated. Neither ECDC nor any person acting on behalf of ECDC is responsible for the use that might be made of the information in this journal. The information provided on the Eurosurveillance
site is designed to support, not replace, the relationship that exists between a patient/site visitor and his/her physician. Our website does not host any form of commercial advertisement. Except where otherwise stated, all manuscripts published after 1 January 2016 will be published under the Creative Commons Attribution (CC BY) licence
. You are free to share and adapt the material, but you must give appropriate credit, provide a link to the licence, and indicate if changes were made. You may do so in any reasonable manner, but not in any way that suggests the licensor endorses you or your use.
Eurosurveillance [ISSN 1560-7917] - ©2007-2016. All rights reserved.