1887
  1. Home
  2. Eurosurveillance
  3. Volume 21, Issue 16, 21/Apr/2016
  4. Article
Systematic Review Open Access
Like 0
Download

Abstract

The World Health Organization's Global Influenza Surveillance and Response System meets twice a year to generate a recommendation for the composition of the seasonal influenza vaccine. Interim vaccine effectiveness (VE) estimates provide a preliminary indication of influenza vaccine performance during the season and may be useful for decision making. We reviewed 17 pairs of studies reporting 33 pairs of interim and final estimates using the test-negative design to evaluate whether interim estimates can reliably predict final estimates. We examined features of the study design that may be correlated with interim estimates being substantially different from their final estimates and identified differences related to change in study period and concomitant changes in sample size, proportion vaccinated and proportion of cases. An absolute difference of no more than 10% between interim and final estimates was found for 18 of 33 reported pairs of estimates, including six of 12 pairs reporting VE against any influenza, six of 10 for influenza A(H1N1)pdm09, four of seven for influenza A(H3N2) and two of four for influenza B. While we identified inconsistencies in the methods, the similarities between interim and final estimates support the utility of generating and disseminating preliminary estimates of VE while virus circulation is ongoing.

© Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.
Loading

Article metrics loading...

/content/10.2807/1560-7917.ES.2016.21.16.30202
2016-04-21
2024-09-07
http://instance.metastore.ingenta.com/content/10.2807/1560-7917.ES.2016.21.16.30202
Loading
Loading full text...

Full text loading...

/deliver/fulltext/eurosurveillance/21/16/eurosurv-21-30202-6.html?itemId=/content/10.2807/1560-7917.ES.2016.21.16.30202&mimeType=html&fmt=ahah

References

  1. Sullivan SG, Tchetgen-Tchetgen E, Cowling BJ. Theoretical basis of the test-negative design for assessment of influenza vaccine effectiveness. Am J Epidemiol. 2016; (Forthcoming).
  2. Foppa IM, Haber M, Ferdinands JM, Shay DK. The case test-negative design for studies of the effectiveness of influenza vaccine. Vaccine. 2013;31(30):3104-9.  https://doi.org/10.1016/j.vaccine.2013.04.026  PMID: 23624093 
  3. Jackson ML, Nelson JC. The test-negative design for estimating influenza vaccine effectiveness. Vaccine. 2013;31(17):2165-8.  https://doi.org/10.1016/j.vaccine.2013.02.053  PMID: 23499601 
  4. Orenstein EW, De Serres G, Haber MJ, Shay DK, Bridges CB, Gargiullo P, et al. Methodologic issues regarding the use of three observational study designs to assess influenza vaccine effectiveness. Int J Epidemiol. 2007;36(3):623-31.  https://doi.org/10.1093/ije/dym021  PMID: 17403908 
  5. Castilla J, Moran J, Martinez-Artola V, Reina G, Martinez-Baz I, Garcia Cenoz M, et al. Effectiveness of trivalent seasonal and monovalent influenza A(H1N1)2009 vaccines in population with major chronic conditions of Navarre, Spain: 2010/11 mid-season analysis. Euro Surveill. 2011;16(7):19799. PMID: 21345321 
  6. Centers for Disease Control and Prevention (CDC). Interim within-season estimate of the effectiveness of trivalent inactivated influenza vaccine--Marshfield, Wisconsin, 2007-08 influenza season. MMWR Morb Mortal Wkly Rep. 2008;57(15):393-8. PMID: 18418344 
  7. Centers for Disease Control and Prevention (CDC). Interim adjusted estimates of seasonal influenza vaccine effectiveness - United States, February 2013. MMWR Morb Mortal Wkly Rep. 2013;62(7):119-23. PMID: 23425960 
  8. Jiménez-Jorge S, de Mateo S, Pozo F, Casas I, Garcia Cenoz M, Castilla J, et al. Early estimates of the effectiveness of the 2011/12 influenza vaccine in the population targeted for vaccination in Spain, 25 December 2011 to 19 February 2012. Euro Surveill. 2012;17(12):20129. PMID: 22490308 
  9. Jiménez-Jorge S, Pozo F, de Mateo S, Delgado-Sanz C, Casas I, Garcia-Cenoz M, et al. Influenza vaccine effectiveness in Spain 2013/14: subtype-specific early estimates using the cycEVA study. Euro Surveill. 2014;19(9):20727.  https://doi.org/10.2807/1560-7917.ES2014.19.9.20727  PMID: 24626206 
  10. Kelly H, Grant K. Interim analysis of pandemic influenza (H1N1) 2009 in Australia: surveillance trends, age of infection and effectiveness of seasonal vaccination. Euro Surveill. 2009;14(31):6419-26. PMID: 19660248 
  11. Kissling E, Valenciano MI-MOVE case-control studies team. Early estimates of seasonal influenza vaccine effectiveness in Europe, 2010/11: I-MOVE, a multicentre case-control study. Euro Surveill. 2011;16(11):19818. PMID: 21435329 
  12. Kissling E, Valenciano MI-MOVE Case-Control Studies Team. Early estimates of seasonal influenza vaccine effectiveness in Europe among target groups for vaccination: results from the I-MOVE multicentre case-control study, 2011/12. Euro Surveill. 2012;17(15):20146. PMID: 22516046 
  13. McMenamin J, Andrews N, Robertson C, Fleming D, Durnall H, von Wissmann B, et al. Effectiveness of seasonal 2012/13 vaccine in preventing laboratory-confirmed influenza infection in primary care in the United Kingdom: mid-season analysis 2012/13. Euro Surveill. 2013;18(5):20393. PMID: 23399421 
  14. Pebody R, Hardelid P, Fleming D, McMenamin J, Andrews N, Robertson C, et al. Effectiveness of seasonal 2010/11 and pandemic influenza A(H1N1)2009 vaccines in preventing influenza infection in the United Kingdom: mid-season analysis 2010/11. Euro Surveill. 2011;16(6):19791. PMID: 21329644 
  15. Pebody RG, Warburton F, Ellis J, Andrews N, Thompson C, von Wissmann B, et al. Low effectiveness of seasonal influenza vaccine in preventing laboratory-confirmed influenza in primary care in the United Kingdom: 2014/15 mid-season results. Euro Surveill. 2015;20(5):21025.  https://doi.org/10.2807/1560-7917.ES2015.20.5.21025  PMID: 25677050 
  16. Savulescu C, Jiménez-Jorge S, de Mateo S, Ledesma J, Pozo F, Casas I, et al. Effectiveness of the 2010/11 seasonal trivalent influenza vaccine in Spain: preliminary results of a case-control study. Euro Surveill. 2011;16(11):19820. PMID: 21435330 
  17. Skowronski D, Chambers C, Sabaiduc S, De Serres G, Dickinson J, Winter A, et al. Interim estimates of 2013/14 vaccine effectiveness against influenza A(H1N1)pdm09 from Canada s sentinel surveillance network, January 2014. Euro Surveill. 2014;19(5):20690.  https://doi.org/10.2807/1560-7917.ES2014.19.5.20690  PMID: 24524234 
  18. Skowronski DM, Janjua NZ, De Serres G, Dickinson JA, Winter AL, Mahmud SM, et al. Interim estimates of influenza vaccine effectiveness in 2012/13 from Canada’s sentinel surveillance network, January 2013. Euro Surveill. 2013;18(5):20394. PMID: 23399422 
  19. Sullivan SG, Kelly H. Late season interim estimates of influenza vaccine effectiveness reliably predict end of season estimates in Victoria, Australia, 2007 to 2012. Euro Surveill. 2013;18(41):20605.  https://doi.org/10.2807/1560-7917.ES2013.18.41.20605  PMID: 24135124 
  20. Turner N, Pierse N, Huang QS, Radke S, Bissielo A, Thompson MG, et al. Interim estimates of the effectiveness of seasonal trivalent inactivated influenza vaccine in preventing influenza hospitalisations and primary care visits in Auckland, New Zealand, in 2014. Euro Surveill. 2014;19(42):20934.  https://doi.org/10.2807/1560-7917.ES2014.19.42.20934  PMID: 25358042 
  21. Valenciano M, Kissling E,I-MOVE Case-Control Study Team. Early estimates of seasonal influenza vaccine effectiveness in Europe: results from the I-MOVE multicentre case-control study, 2012/13. Euro Surveill. 2013;18(7):20400. PMID: 23449183 
  22. Belongia EA, Kieke BA, Donahue JG, Coleman LA, Irving SA, Meece JK, et al. Influenza vaccine effectiveness in Wisconsin during the 2007-08 season: comparison of interim and final results. Vaccine. 2011;29(38):6558-63.  https://doi.org/10.1016/j.vaccine.2011.07.002  PMID: 21767593 
  23. Jiménez-Jorge S, Pozo F, Larrauri AcycEVA Study Team. Interim influenza vaccine effectiveness: A good proxy for final estimates in Spain in the last four seasons 2010-2014. Vaccine. 2015.  https://doi.org/10.1016/j.vaccine.2015.03.051 
  24. Sullivan SG, Feng S, Cowling BJ. Potential of the test-negative design for measuring influenza vaccine effectiveness: a systematic review. Expert Rev Vaccines. 2014;13(12):1571-91.  https://doi.org/10.1586/14760584.2014.966695  PMID: 25348015 
  25. Andrews N, McMenamin J, Durnall H, Ellis J, Lackenby A, Robertson C, et al. Effectiveness of trivalent seasonal influenza vaccine in preventing laboratory-confirmed influenza in primary care in the United Kingdom: 2012/13 end of season results. Euro Surveill. 2014;19(27):20851.  https://doi.org/10.2807/1560-7917.ES2014.19.27.20851  PMID: 25033051 
  26. Carville KS, Grant KA, Sullivan SG, Fielding JE, Lane CR, Franklin L, et al. Understanding influenza vaccine protection in the community: an assessment of the 2013 influenza season in Victoria, Australia. Vaccine. 2015;33(2):341-5.  https://doi.org/10.1016/j.vaccine.2014.11.019  PMID: 25448093 
  27. Castilla J, Martínez-Artola V, Salcedo E, Martínez-Baz I, Cenoz MG, Guevara M, et al. Vaccine effectiveness in preventing influenza hospitalizations in Navarre, Spain, 2010-2011: cohort and case-control study. Vaccine. 2012;30(2):195-200.  https://doi.org/10.1016/j.vaccine.2011.11.024  PMID: 22100636 
  28. Jiménez-Jorge S, de Mateo S, Delgado-Sanz C, Pozo F, Casas I, Garcia-Cenoz M, et al. Effectiveness of influenza vaccine against laboratory-confirmed influenza, in the late 2011-2012 season in Spain, among population targeted for vaccination. BMC Infect Dis. 2013;13(1):441.  https://doi.org/10.1186/1471-2334-13-441  PMID: 24053661 
  29. Jiménez-Jorge S, Savulescu C, Pozo F, de Mateo S, Casas I, Ledesma J, et al. Effectiveness of the 2010-11 seasonal trivalent influenza vaccine in Spain: cycEVA study. Vaccine. 2012;30(24):3595-602.  https://doi.org/10.1016/j.vaccine.2012.03.048  PMID: 22472792 
  30. Kelly HA, Grant KA, Fielding JE, Carville KS, Looker CO, Tran T, et al. Pandemic influenza H1N1 2009 infection in Victoria, Australia: no evidence for harm or benefit following receipt of seasonal influenza vaccine in 2009. Vaccine. 2011;29(37):6419-26.  https://doi.org/10.1016/j.vaccine.2011.03.055  PMID: 21473950 
  31. Kissling E, Valenciano M, Buchholz U, Larrauri A, Cohen JM, Nunes B, et al. Influenza vaccine effectiveness estimates in Europe in a season with three influenza type/subtypes circulating: the I-MOVE multicentre case-control study, influenza season 2012/13. Euro Surveill. 2014;19(6):20701.  https://doi.org/10.2807/1560-7917.ES2014.19.6.20701  PMID: 24556348 
  32. Kissling E, Valenciano M, Cohen JM, Oroszi B, Barret A-S, Rizzo C, et al. I-MOVE multi-centre case control study 2010-11: Overall and stratified estimates of influenza vaccine effectiveness in Europe. PLoS One. 2011;6(11):e27622.
  33. Kissling E, Valenciano M, Larrauri A, Oroszi B, Cohen JM, Nunes B, et al. Low and decreasing vaccine effectiveness against influenza A(H3) in 2011/12 among vaccination target groups in Europe: results from the I-MOVE multicentre case-control study. Euro Surveill. 2013;18(5):20390. PMID: 23399425 
  34. McLean HQ, Thompson MG, Sundaram ME, Kieke BA, Gaglani M, Murthy K, et al. Influenza Vaccine Effectiveness in the United States During 2012-13: Variable Protection by Age and Virus Type. J Infect Dis. 2015;211(10):1529-40.
  35. Pebody R, Warburton F, Andrews N, Ellis J, von Wissmann B, Robertson C, et al. Effectiveness of seasonal influenza vaccine in preventing laboratory-confirmed influenza in primary care in the United Kingdom: 2014/15 end of season results. Euro Surveill. 2015;20(36):30013.  https://doi.org/10.2807/1560-7917.ES.2015.20.36.30013  PMID: 26535911 
  36. Pebody RG, Andrews N, Fleming DM, McMenamin J, Cottrell S, Smyth B, et al. Age-specific vaccine effectiveness of seasonal 2010/2011 and pandemic influenza A(H1N1) 2009 vaccines in preventing influenza in the United Kingdom. Epidemiol Infect. 2013;141(3):620-30.  https://doi.org/10.1017/S0950268812001148  PMID: 22691710 
  37. Pierse N, Kelly H, Thompson MG, Bissielo A, Radke S, Huang QS, et al. Influenza vaccine effectiveness for hospital and community patients using control groups with and without non-influenza respiratory viruses detected, Auckland, New Zealand 2014. Vaccine. 2015.PMID:26685091
  38. Skowronski DM, Chambers C, Sabaiduc S, De Serres G, Winter A-L, Dickinson JA, et al. Integrated sentinel surveillance linking genetic, antigenic and epidemiologic monitoring of influenza vaccine-virus relatedness and effectiveness during the 2013-2014 season. J Infect Dis. 2015;212(5):726-39.  https://doi.org/10.1093/infdis/jiv177 
  39. Skowronski DM, Janjua NZ, De Serres G, Sabaiduc S, Eshaghi A, Dickinson JA, et al. Low 2012-13 influenza vaccine effectiveness associated with mutation in the egg-adapted H3N2 vaccine strain not antigenic drift in circulating viruses. PLoS One. 2014;9(3):e92153.  https://doi.org/10.1371/journal.pone.0092153  PMID: 24667168 
  40. Reed C, Kim IK, Singleton JA, Chaves SS, Flannery B, Finelli L, et al. Estimated influenza illnesses and hospitalizations averted by vaccination--United States, 2013-14 influenza season. MMWR Morb Mortal Wkly Rep. 2014;63(49):1151-4. PMID: 25503917 
  41. Centers for Disease Control and Prevention (CDC). Early estimates of seasonal influenza vaccine effectiveness--United States, January 2013. MMWR Morb Mortal Wkly Rep. 2013;62(2):32-5. PMID: 23325354 
  42. Castilla J, Martinez-Baz I, Martinez-Artola V, Fernandez-Alonso M, Reina G, Guevara M, et al. Early estimates of influenza vaccine effectiveness in Navarre, Spain: 2012/13 mid-season analysis. Euro Surveill. 2013;18(7):2. PMID: 23449182 
  43. Heinze G, Schemper M. A solution to the problem of separation in logistic regression. Stat Med. 2002;21(16):2409-19.  https://doi.org/10.1002/sim.1047  PMID: 12210625 
  44. Barr IG, Russell C, Besselaar TG, Cox NJ, Daniels RS, Donis R, et al. WHO recommendations for the viruses used in the 2013-2014 Northern Hemisphere influenza vaccine: Epidemiology, antigenic and genetic characteristics of influenza A(H1N1)pdm09, A(H3N2) and B influenza viruses collected from October 2012 to January 2013. Vaccine. 2014;32(37):4713-25.  https://doi.org/10.1016/j.vaccine.2014.02.014  PMID: 24582632 
Concordance of interim and final estimates of influenza vaccine effectiveness: a systematic review
<p class="citation"> <span>Citation style for this article:</span> <span class="meta-value authors"> <a href="/search?value1=Vivian+K+Leung&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Leung Vivian K</a>, <a href="/search?value1=Benjamin+J+Cowling&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Cowling Benjamin J</a>, <a href="/search?value1=Shuo+Feng&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Feng Shuo</a>, <a href="/search?value1=Sheena+G+Sullivan&option1=author&noRedirect=true" class="nonDisambigAuthorLink">Sullivan Sheena G</a></span>. Concordance of interim and final estimates of influenza vaccine effectiveness: a systematic review. <a href="/content/ecdc">Euro Surveill.</a> 2016;21(16):pii=30202. <a href="https://doi.org/10.2807/1560-7917.ES.2016.21.16.30202" title="doi link" target="_blank">https://doi.org/10.2807/1560-7917.ES.2016.21.16.30202</a> <span class="ES_Article_citation"> <span class="generated">Received</span>: 10 Sept 2015;&nbsp;&nbsp; <span class="generated">Accepted</span>: 25 Jan 2016 </span> </p>
/content/10.2807/1560-7917.ES.2016.21.16.30202
/content/10.2807/1560-7917.ES.2016.21.16.30202
Loading

Data & Media loading...

Submit comment
Close
Comment moderation successfully completed
This is a required field
Please enter a valid email address
Approval was a Success
Invalid data
An Error Occurred
Approval was partially successful, following selected items could not be processed due to error