Skip to main content

Advertisement

Springer Nature Link
Log in

Methods for meta-analysis in genetic association studies: a review of their potential and pitfalls

  • Review
  • Published:
Human Genetics Aims and scope Submit manuscript

Abstract

Meta-analysis offers the opportunity to combine evidence from retrospectively accumulated or prospectively generated data. Meta-analyses may provide summary estimates and can help in detecting and addressing potential inconsistency between the combined datasets. Application of meta-analysis in genetic associations presents considerable potential and several pitfalls. In this review, we present basic principles of meta-analytic methods, adapted for human genome epidemiology. We describe issues that arise in the retrospective or the prospective collection of relevant data through various sources, common traps to consider in the appraisal of evidence and potential biases that may interfere. We describe the relative merits and caveats for common methods used to trace inconsistency across studies along with possible reasons for non-replication of proposed associations. Different statistical models may be employed to combine data and some common misconceptions may arise in the process. Several meta-analysis diagnostics are often applied or misapplied in the literature, and we comment on their use and limitations. An alternative to overcome limitations arising from retrospective combination of data from published studies is to create networks of research teams working in the same field and perform collaborative meta-analyses of individual participant data, ideally on a prospective basis. We discuss the advantages and the challenges inherent in such collaborative approaches. Meta-analysis can be a useful tool in dissecting the genetics of complex diseases and traits, provided its methods are properly applied and interpreted.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Canada)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  • Aagaard-Tillery K, Sibai B, Spong CY, Momirova V, Wendel G Jr, Wenstrom K, Samuels P, Cotroneo M, Moawad A, Sorokin Y, Miodovnik M, Meis P, O’Sullivan MJ, Conway D, Wapner RJ (2006) Sample bias among women with retained DNA samples for future genetic studies. Obstet Gynecol 108:1115–1120

    PubMed  Google Scholar 

  • Andrulis IL, Anton-Culver H, Beck J, Bove B, Boyd J, Buys S, Godwin AK, Hopper JL, Li F, Neuhausen SL, Ozcelik H, Peel D, Santella RM, Southey MC, van Orsouw NJ, Venter DJ, Vijg J, Whittemore AS (2002) Comparison of DNA- and RNA-based methods for detection of truncating BRCA1 mutations. Hum Mutat 20:65–73

    PubMed  CAS  Google Scholar 

  • Ariyaratnam R, Casas JP, Whittaker J, Smeeth L, Hingorani AD, Sharma P (2007) Genetics of ischaemic stroke among persons of non-european descent: a meta-analysis of eight genes involving approximately 32,500 individuals. PLoS Med 4:e131

    PubMed  Google Scholar 

  • Attia J, Thakkinstian A, D’Este C (2003) Meta-analyses of molecular association studies: methodologic lessons for genetic epidemiology. J Clin Epidemiol 56:297–303

    PubMed  Google Scholar 

  • Banerjee I, Gupta V, Ganesh S (2007) Association of gene polymorphisms with genetic susceptibility to stroke in Asian populations: a meta-analysis. J Hum Genet 52:205–219

    PubMed  CAS  Google Scholar 

  • Begg CB, Mazumdar M (1994) Operating characteristics of a rank correlation test for publication bias. Biometrics 50:1088–1101

    PubMed  CAS  Google Scholar 

  • Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate—a practical and powerful approach to multiple testing. J R Stat Soc B 57:289–300

    Google Scholar 

  • Bertram L, McQueen MB, Mullin K, Blacker D, Tanzi RE (2007) Systematic meta-analyses of Alzheimer disease genetic association studies: the AlzGene database. Nat Genet 39:17–23

    PubMed  CAS  Google Scholar 

  • Bhatti P, Sigurdson AJ, Wang SS, Chen J, Rothman N, Hartge P, Bergen AW, Landi MT (2005) Genetic variation and willingness to participate in epidemiologic research: data from three studies. Cancer Epidemiol Biomarkers Prev 14:2449–2453

    PubMed  Google Scholar 

  • Bogardus ST Jr, Concato J, Feinstein AR (1999) Clinical epidemiological quality in molecular genetic research: the need for methodological standards. JAMA 281:1919–1926

    PubMed  Google Scholar 

  • Botto LD, Yang Q (2000) 5,10-Methylenetetrahydrofolate reductase gene variants and congenital anomalies: a HuGE review. Am J Epidemiol 151:862–877

    PubMed  CAS  Google Scholar 

  • Brockton N, Little J, Sharp L, Cotton SC (2000) N-acetyltransferase polymorphisms and colorectal cancer: a HuGE review. Am J Epidemiol 151:846–861

    PubMed  CAS  Google Scholar 

  • Brooks S (1998) Marcov chain Monte-Carlo method and its application. Statistician 47:69–100

    Google Scholar 

  • Burke W, Khoury MJ, Stewart A, Zimmern RL (2006) The path from genome-based research to population health: development of an international public health genomics network. Genet Med 8:451–458

    PubMed  Google Scholar 

  • Calnan M, Smith GD, Sterne JA (2006) The publication process itself was the major cause of publication bias in genetic epidemiology. J Clin Epidemiol 59:1312–1318

    PubMed  Google Scholar 

  • Cardon LR, Palmer LJ (2003) Population stratification and spurious allelic association. Lancet 361:598–604

    PubMed  Google Scholar 

  • Casas JP, Hingorani AD, Bautista LE, Sharma P (2004) Meta-analysis of genetic studies in ischemic stroke: thirty-two genes involving approximately 18,000 cases and 58,000 controls. Arch Neurol 61:1652–1661

    PubMed  Google Scholar 

  • Casas JP, Bautista LE, Smeeth L, Sharma P, Hingorani AD (2005) Homocysteine and stroke: evidence on a causal link from mendelian randomisation. Lancet 365:224–232

    PubMed  CAS  Google Scholar 

  • Chan AW, Altman DG (2005) Identifying outcome reporting bias in randomised trials on PubMed: review of publications and survey of authors. BMJ 330:753

    PubMed  Google Scholar 

  • Chan AW, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG (2004a) Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA 291:2457–2465

    PubMed  CAS  Google Scholar 

  • Chan AW, Krleza-Jeric K, Schmid I, Altman DG (2004b) Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research. CMAJ 171:735–740

    PubMed  Google Scholar 

  • Chanock SJ, Manolio T, Boehnke M, Boerwinkle E, Hunter DJ, Thomas G, Hirschhorn JN, Abecasis G, Altshuler D, Bailey-Wilson JE, Brooks LD, Cardon LR, Daly M, Donnelly P, Fraumeni JF Jr, Freimer NB, Gerhard DS, Gunter C, Guttmacher AE, Guyer MS, Harris EL, Hoh J, Hoover R, Kong CA, Merikangas KR, Morton CC, Palmer LJ, Phimister EG, Rice JP, Roberts J, Rotimi C, Tucker MA, Vogan KJ, Wacholder S, Wijsman EM, Winn DM, Collins FS (2007) Replicating genotype–phenotype associations. Nature 447:655–660

    PubMed  CAS  Google Scholar 

  • Cochran WG (1954) The combination of estimates from different experiments. Biometrics 10:101–129

    Google Scholar 

  • Contopoulos-Ioannidis DG, Alexiou GA, Gouvias TC, Ioannidis JP (2006) An empirical evaluation of multifarious outcomes in pharmacogenetics: beta-2 adrenoceptor gene polymorphisms in asthma treatment. Pharmacogenet Genomics 16:705–711

    Article  PubMed  CAS  Google Scholar 

  • Cooper GS, Umbach DM (1996) Are vitamin D receptor polymorphisms associated with bone mineral density? A meta-analysis. J Bone Miner Res 11:1841–1849

    Article  PubMed  CAS  Google Scholar 

  • Cotton SC, Sharp L, Little J, Brockton N (2000) Glutathione S-transferase polymorphisms and colorectal cancer: a HuGE review. Am J Epidemiol 151:7–32

    PubMed  CAS  Google Scholar 

  • Cronin S, Furie KL, Kelly PJ (2005) Dose-related association of MTHFR 677T allele with risk of ischemic stroke: evidence from a cumulative meta-analysis. Stroke 36:1581–1587

    PubMed  CAS  Google Scholar 

  • Davey Smith G, Ebrahim S (2003) ‘Mendelian randomization’: can genetic epidemiology contribute to understanding environmental determinants of disease? Int J Epidemiol 32:1–22

    PubMed  Google Scholar 

  • DerSimonian R, Laird N (1986) Meta-analysis in clinical trials. Control Clin Trials 7:177–188

    PubMed  CAS  Google Scholar 

  • Devlin B, Roeder K, Wasserman L (2001) Genomic control, a new approach to genetic-based association studies. Theor Popul Biol 60:155–166

    PubMed  CAS  Google Scholar 

  • Dickersin K, Min YI, Meinert CL (1992) Factors influencing publication of research results. Follow-up of applications submitted to two institutional review boards. JAMA 267:374–378

    PubMed  CAS  Google Scholar 

  • Duval S, Tweedie R (2000) Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics 56:455–463

    PubMed  CAS  Google Scholar 

  • Easterbrook PJ, Berlin JA, Gopalan R, Matthews DR (1991) Publication bias in clinical research. Lancet 337:867–872

    PubMed  CAS  Google Scholar 

  • Easton DF, Pooley KA, Dunning AM, Pharoah PD, Thompson D, Ballinger DG, Struewing JP, Morrison J, Field H, Luben R, Wareham N, Ahmed S, Healey CS, Bowman R; SEARCH collaborators, Meyer KB, Haiman CA, Kolonel LK, Henderson BE, Le Marchand L, Brennan P, Sangrajrang S, Gaborieau V, Odefrey F, Shen CY, Wu PE, Wang HC, Eccles D, Evans DG, Peto J, Fletcher O, Johnson N, Seal S, Stratton MR, Rahman N, Chenevix-Trench G, Bojesen SE, Nordestgaard BG, Axelsson CK, Garcia-Closas M, Brinton L, Chanock S, Lissowska J, Peplonska B, Nevanlinna H, Fagerholm R, Eerola H, Kang D, Yoo KY, Noh DY, Ahn SH, Hunter DJ, Hankinson SE, Cox DG, Hall P, Wedren S, Liu J, Low YL, Bogdanova N, Schurmann P, Dork T, Tollenaar RA, Jacobi CE, Devilee P, Klijn JG, Sigurdson AJ, Doody MM, Alexander BH, Zhang J, Cox A, Brock IW, MacPherson G, Reed MW, Couch FJ, Goode EL, Olson JE, Meijers-Heijboer H, van den Ouweland A, Uitterlinden A, Rivadeneira F, Milne RL, Ribas G, Gonzalez-Neira A, Benitez J, Hopper JL, McCredie M, Southey M, Giles GG, Schroen C, Justenhoven C, Brauch H, Hamann U, Ko YD, Spurdle AB, Beesley J, Chen X; kConFab; AOCS Management Group, Mannermaa A, Kosma VM, Kataja V, Hartikainen J, Day NE, Cox DR, Ponder BA (2007) Genome-wide association study identifies novel breast cancer susceptibility loci. Nature 447:1087–1093

    PubMed  CAS  Google Scholar 

  • Efstathiadou Z, Tsatsoulis A, Ioannidis JP (2001) Association of collagen Ialpha 1 Sp1 polymorphism with the risk of prevalent fractures: a meta-analysis. J Bone Miner Res 16:1586–1592

    PubMed  CAS  Google Scholar 

  • Egger M, Davey Smith G, Schneider M, Minder C (1997a) Bias in meta-analysis detected by a simple, graphical test. BMJ 315:629–634

    PubMed  CAS  Google Scholar 

  • Egger M, Zellweger-Zahner T, Schneider M, Junker C, Lengeler C, Antes G (1997b) Language bias in randomised controlled trials published in English and German. Lancet 350:326–329

    PubMed  CAS  Google Scholar 

  • Evangelou E, Trikalinos TA, Salanti G, Ioannidis JP (2006) Family-based versus unrelated case–control designs for genetic associations. PLoS Genet 2:e123

    PubMed  Google Scholar 

  • Evangelou E, Maraganore DM, Ioannidis JP (2007) Meta-analysis in genome-wide association datasets: strategies and application in Parkinson disease. PLoS ONE 2:e196

    PubMed  Google Scholar 

  • Frayling TM, Timpson NJ, Weedon MN, Zeggini E, Freathy RM, Lindgren CM, Perry JR, Elliott KS, Lango H, Rayner NW, Shields B, Harries LW, Barrett JC, Ellard S, Groves CJ, Knight B, Patch AM, Ness AR, Ebrahim S, Lawlor DA, Ring SM, Ben-Shlomo Y, Jarvelin MR, Sovio U, Bennett AJ, Melzer D, Ferrucci L, Loos RJ, Barroso I, Wareham NJ, Karpe F, Owen KR, Cardon LR, Walker M, Hitman GA, Palmer CN, Doney AS, Morris AD, Smith GD, Hattersley AT, McCarthy MI (2007) A common variant in the FTO gene is associated with body mass index and predisposes to childhood and adult obesity. Science 316:889–894

    PubMed  CAS  Google Scholar 

  • Garcia-Closas M, Wacholder S, Caporaso N et al (2004) Inference issues in cohort and case–control studies of genetic effects and gene–environment interactions. Oxford University Press, New York

    Google Scholar 

  • Gartwaite PH, Kadane JB, O'Hagan A (2005) Statistical methods for eliciting probability distributions. J Am Stat Assoc 100:680–701

    Google Scholar 

  • Greenland S (1994) Invited commentary: a critical look at some popular meta-analytic methods. Am J Epidemiol 140:290–296

    PubMed  CAS  Google Scholar 

  • Guttmacher AE, Collins FS (2003) Welcome to the genomic era. N Engl J Med 349:996–998

    PubMed  CAS  Google Scholar 

  • Harbord RM, Egger M, Sterne JA (2006) A modified test for small-study effects in meta-analyses of controlled trials with binary endpoints. Stat Med 25:3443–3457

    PubMed  Google Scholar 

  • Hardy RJ, Thompson SG (1998) Detecting and describing heterogeneity in meta-analysis. Stat Med 17:841–856

    PubMed  CAS  Google Scholar 

  • Higgins JP, Thompson SG (2002) Quantifying heterogeneity in a meta-analysis. Stat Med 21:1539–1558

    PubMed  Google Scholar 

  • Higgins J, Thompson S, Deeks J, Altman D (2002) Statistical heterogeneity in systematic reviews of clinical trials: a critical appraisal of guidelines and practice. J Health Serv Res Policy 7:51–61

    PubMed  Google Scholar 

  • Higgins JP, Thompson SG, Deeks JJ, Altman DG (2003) Measuring inconsistency in meta-analyses. BMJ 327:557–560

    PubMed  Google Scholar 

  • Higgins JP, Little J, Ioannidis JP, Bray MS, Manolio TA, Smeeth L, Sterne JA, Anagnostelis B, Butterworth AS, Danesh J, Dezateux C, Gallacher JE, Gwinn M, Lewis SJ, Minelli C, Pharoah PD, Salanti G, Sanderson S, Smith LA, Taioli E, Thompson JR, Thompson SG, Walker N, Zimmern RL, Khoury MJ (2007) Turning the pump handle: evolving methods for integrating the evidence on gene–disease association. Am J Epidemiol 166:863–866

    PubMed  Google Scholar 

  • Hill HA, Kleinbaum DG (2000) Bias in observational studies. Wiley, Chichester

    Google Scholar 

  • Hirschhorn JN, Daly MJ (2005) Genome-wide association studies for common diseases and complex traits. Nat Rev Genet 6:95–108

    PubMed  CAS  Google Scholar 

  • Hirschhorn JN, Lohmueller K, Byrne E, Hirschhorn K (2002) A comprehensive review of genetic association studies. Genet Med 4:45–61

    Article  PubMed  CAS  Google Scholar 

  • Hoggart CJ, Shriver MD, Kittles RA, Clayton DG, McKeigue PM (2004) Design and analysis of admixture mapping studies. Am J Hum Genet 74:965–978

    PubMed  CAS  Google Scholar 

  • Huedo-Medina TB, Sanchez-Meca J, Marin-Martinez F, Botella J (2006) Assessing heterogeneity in meta-analysis: Q statistic or I2 index? Psychol Methods 11:193–206

    PubMed  Google Scholar 

  • Hunter DJ (2005) Gene–environment interactions in human diseases. Nat Rev Genet 6:287–298

    PubMed  CAS  Google Scholar 

  • Hunter DJ, Riboli E, Haiman CA, Albanes D, Altshuler D, Chanock SJ, Haynes RB, Henderson BE, Kaaks R, Stram DO, Thomas G, Thun MJ, Blanche H, Buring JE, Burtt NP, Calle EE, Cann H, Canzian F, Chen YC, Colditz GA, Cox DG, Dunning AM, Feigelson HS, Freedman ML, Gaziano JM, Giovannucci E, Hankinson SE, Hirschhorn JN, Hoover RN, Key T, Kolonel LN, Kraft P, Le Marchand L, Liu S, Ma J, Melnick S, Pharaoh P, Pike MC, Rodriguez C, Setiawan VW, Stampfer MJ, Trapido E, Travis R, Virtamo J, Wacholder S, Willett WC (2005) A candidate gene approach to searching for low-penetrance breast and prostate cancer genes. Nat Rev Cancer 5:977–985

    PubMed  CAS  Google Scholar 

  • Ioannidis JP (1998) Effect of the statistical significance of results on the time to completion and publication of randomized efficacy trials. JAMA 279:281–286

    PubMed  CAS  Google Scholar 

  • Ioannidis JP (2005) Why most published research findings are false. PLoS Med 2:e124

    PubMed  Google Scholar 

  • Ioannidis JP (2006a) Commentary: grading the credibility of molecular evidence for complex diseases. Int J Epidemiol 35:572–578 (discussion 593–596)

    PubMed  Google Scholar 

  • Ioannidis JP (2006b) Common genetic variants for breast cancer: 32 largely refuted candidates and larger prospects. J Natl Cancer Inst 98:1350–1353

    PubMed  CAS  Google Scholar 

  • Ioannidis JP (2006c) Journals should publish all “null” results and should sparingly publish “positive” results. Cancer Epidemiol Biomarkers Prev 15:186

    PubMed  Google Scholar 

  • Ioannidis JP (2007a) Molecular evidence-based medicine: evolution and integration of information in the genomic era. Eur J Clin Invest 37:340–349

    PubMed  CAS  Google Scholar 

  • Ioannidis JP (2007b) Non-replication and inconsistency in the genome-wide association setting. Hum Hered 64:203–13

    PubMed  CAS  Google Scholar 

  • Ioannidis JP, Trikalinos TA (2005) Early extreme contradictory estimates may appear in published research: the Proteus phenomenon in molecular genetics research and randomized trials. J Clin Epidemiol 58:543–549

    PubMed  Google Scholar 

  • Ioannidis JP, Trikalinos TA (2007a) The appropriateness of asymmetry tests for publication bias in meta-analyses: a large survey. CMAJ 176:1091–1096

    PubMed  Google Scholar 

  • Ioannidis JP, Trikalinos TA (2007b) An exploratory test for an excess of significant findings. Clin Trials 4:245–253

    PubMed  Google Scholar 

  • Ioannidis JP, O’Brien TR, Rosenberg PS, Contopoulos-Ioannidis DG, Goedert JJ (1998) Genetic effects on HIV disease progression. Nat Med 4:536

    PubMed  CAS  Google Scholar 

  • Ioannidis JP, Ntzani EE, Trikalinos TA, Contopoulos-Ioannidis DG (2001a) Replication validity of genetic association studies. Nat Genet 29:306–309

    PubMed  CAS  Google Scholar 

  • Ioannidis JP, Rosenberg PS, Goedert JJ, Ashton LJ, Benfield TL, Buchbinder SP, Coutinho RA, Eugen-Olsen J, Gallart T, Katzenstein TL, Kostrikis LG, Kuipers H, Louie LG, Mallal SA, Margolick JB, Martinez OP, Meyer L, Michael NL, Operskalski E, Pantaleo G, Rizzardi GP, Schuitemaker H, Sheppard HW, Stewart GJ, Theodorou ID, Ullum H, Vicenzi E, Vlahov D, Wilkinson D, Workman C, Zagury JF, O’Brien TR (2001b) Effects of CCR5-Delta32, CCR2–64I, and SDF-1 3’A alleles on HIV-1 disease progression: an international meta-analysis of individual-patient data. Ann Intern Med 135:782–795

    PubMed  CAS  Google Scholar 

  • Ioannidis JP, Rosenberg PS, Goedert JJ, O’Brien TR (2002) Commentary: meta-analysis of individual participants’ data in genetic epidemiology. Am J Epidemiol 156:204–210

    PubMed  Google Scholar 

  • Ioannidis JP, Bernstein J, Boffetta P, Danesh J, Dolan S, Hartge P, Hunter D, Inskip P, Jarvelin MR, Little J, Maraganore DM, Bishop JA, O’Brien TR, Petersen G, Riboli E, Seminara D, Taioli E, Uitterlinden AG, Vineis P, Winn DM, Salanti G, Higgins JP, Khoury MJ (2005) A network of investigator networks in human genome epidemiology. Am J Epidemiol 162:302–304

    PubMed  Google Scholar 

  • Ioannidis JP, Gwinn M, Little J, Higgins JP, Bernstein JL, Boffetta P, Bondy M, Bray MS, Brenchley PE, Buffler PA, Casas JP, Chokkalingam A, Danesh J, Smith GD, Dolan S, Duncan R, Gruis NA, Hartge P, Hashibe M, Hunter DJ, Jarvelin MR, Malmer B, Maraganore DM, Newton-Bishop JA, O’Brien TR, Petersen G, Riboli E, Salanti G, Seminara D, Smeeth L, Taioli E, Timpson N, Uitterlinden AG, Vineis P, Wareham N, Winn DM, Zimmern R, Khoury MJ (2006) A road map for efficient and reliable human genome epidemiology. Nat Genet 38:3–5

    PubMed  CAS  Google Scholar 

  • Ioannidis JP, Patsopoulos NA, Evangelou E (2007a) Uncertainty in heterogeneity estimates in meta-analyses. BMJ 335:914-916

    PubMed  Google Scholar 

  • Ioannidis JP, Patsopoulos NA, Evangelou E (2007b) Heterogeneity in meta-analyses of genome-wide association investigations. PLoS ONE 2:e841

    PubMed  Google Scholar 

  • John EM, Hopper JL, Beck JC, Knight JA, Neuhausen SL, Senie RT, Ziogas A, Andrulis IL, Anton-Culver H, Boyd N, Buys SS, Daly MB, O’Malley FP, Santella RM, Southey MC, Venne VL, Venter DJ, West DW, Whittemore AS, Seminara D (2004) The Breast Cancer Family Registry: an infrastructure for cooperative multinational, interdisciplinary and translational studies of the genetic epidemiology of breast cancer. Breast Cancer Res 6:R375–R389

    PubMed  Google Scholar 

  • Juni P, Witschi A, Bloch R, Egger M (1999) The hazards of scoring the quality of clinical trials for meta-analysis. JAMA 282:1054–1060

    PubMed  CAS  Google Scholar 

  • Kavvoura FK, Ioannidis JP (2005) CTLA-4 gene polymorphisms and susceptibility to type 1 diabetes mellitus: a HuGE Review and meta-analysis. Am J Epidemiol 162:3–16

    PubMed  Google Scholar 

  • Kavvoura FK, Liberopoulos G, Ioannidis JP (2007) Selection in reported epidemiological risks: an empirical assessment. PLoS Med 4:e79

    PubMed  Google Scholar 

  • Khoury MJ, Dorman JS (1998) The Human Genome Epidemiology Network. Am J Epidemiol 148:1–3

    PubMed  CAS  Google Scholar 

  • Kohler K, Bickeboller H (2006) Case–control association tests correcting for population stratification. Ann Hum Genet 70:98–115

    PubMed  CAS  Google Scholar 

  • Kyzas PA, Loizou KT, Ioannidis JP (2005) Selective reporting biases in cancer prognostic factor studies. J Natl Cancer Inst 97:1043–1055

    PubMed  Google Scholar 

  • Lambert PC, Sutton AJ, Burton PR, Abrams KR, Jones DR (2005) How vague is vague? A simulation study of the impact of the use of vague prior distributions in MCMC using WinBUGS. Stat Med 24:2401–2428

    PubMed  Google Scholar 

  • Lau J, Schmid CH, Chalmers TC (1995) Cumulative meta-analysis of clinical trials builds evidence for exemplary medical care. J Clin Epidemiol 48:45–57(discussion 59–60)

    PubMed  CAS  Google Scholar 

  • Lau J, Ioannidis JP, Schmid CH (1998) Summing up evidence: one answer is not always enough. Lancet 351:123–127

    PubMed  CAS  Google Scholar 

  • Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I (2006) The case of the misleading funnel plot. BMJ 333:597–600

    PubMed  Google Scholar 

  • Lin BK, Clyne M, Walsh M, Gomez O, Yu W, Gwinn M, Khoury MJ (2006) Tracking the epidemiology of human genes in the literature: the HuGE Published Literature database. Am J Epidemiol 164:1–4

    PubMed  Google Scholar 

  • Little J, Khoury MJ (2003) Mendelian randomisation: a new spin or real progress? Lancet 362:930–931

    PubMed  Google Scholar 

  • Little J, Bradley L, Bray MS, Clyne M, Dorman J, Ellsworth DL, Hanson J, Khoury M, Lau J, O’Brien TR, Rothman N, Stroup D, Taioli E, Thomas D, Vainio H, Wacholder S, Weinberg C (2002) Reporting, appraising, and integrating data on genotype prevalence and gene–disease associations. Am J Epidemiol 156:300–310

    PubMed  Google Scholar 

  • Lohmueller KE, Pearce CL, Pike M, Lander ES, Hirschhorn JN (2003) Meta-analysis of genetic association studies supports a contribution of common variants to susceptibility to common disease. Nat Genet 33:177–182

    PubMed  CAS  Google Scholar 

  • Manolio TA, Rodriguez LL, Brooks L, Abecasis G, Ballinger D, Daly M, Donnelly P, Faraone SV, Frazer K, Gabriel S, Gejman P, Guttmacher A, Harris EL, Insel T, Kelsoe JR, Lander E, McCowin N, Mailman MD, Nabel E, Ostell J, Pugh E, Sherry S, Sullivan PF, Thompson JF, Warram J, Wholley D, Milos PM, Collins FS (2007) New models of collaboration in genome-wide association studies: the genetic association information network. Nat Genet 39:1045–1051

    PubMed  CAS  Google Scholar 

  • Mantel N, Haenszel W (1959) Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst 22:719–748

    PubMed  CAS  Google Scholar 

  • Michels KB, Rosner BA (1996) Data trawling: to fish or not to fish. Lancet 348:1152–1153

    PubMed  CAS  Google Scholar 

  • Morimoto LM, White E, Newcomb PA (2003) Selection bias in the assessment of gene–environment interaction in case–control studies. Am J Epidemiol 158:259–263

    PubMed  Google Scholar 

  • Munafo MR, Clark TG, Flint J (2004) Assessing publication bias in genetic association studies: evidence from a recent meta-analysis. Psychiatry Res 129:39–44

    PubMed  Google Scholar 

  • Ntzani EE, Rizos EC, Ioannidis JP (2007) Genetic effects versus bias for candidate polymorphisms in myocardial infarction: case study and overview of large-scale evidence. Am J Epidemiol 165:973–984

    PubMed  Google Scholar 

  • Pan Z, Trikalinos TA, Kavvoura FK, Lau J, Ioannidis JP (2005) Local literature bias in genetic epidemiology: an empirical evaluation of the Chinese literature. PLoS Med 2:e334

    PubMed  Google Scholar 

  • Patsopoulos NA, Analatos AA, Ioannidis JP (2005) Relative citation impact of various study designs in the health sciences. JAMA 293:2362–2366

    PubMed  CAS  Google Scholar 

  • Peters JL, Sutton AJ, Jones DR, Abrams KR, Rushton L (2006) Comparison of two methods to detect publication bias in meta-analysis. JAMA 295:676–680

    PubMed  CAS  Google Scholar 

  • Pompanon F, Bonin A, Bellemain E, Taberlet P (2005) Genotyping errors: causes, consequences and solutions. Nat Rev Genet 6:847–859

    PubMed  CAS  Google Scholar 

  • Poole C, Greenland S (1999) Random-effects meta-analyses are not always conservative. Am J Epidemiol 150:469–475

    PubMed  CAS  Google Scholar 

  • Price AL, Patterson NJ, Plenge RM, Weinblatt ME, Shadick NA, Reich D (2006) Principal components analysis corrects for stratification in genome-wide association studies. Nat Genet 38:904–909

    PubMed  CAS  Google Scholar 

  • Pritchard JK, Stephens M, Rosenberg NA, Donnelly P (2000) Association mapping in structured populations. Am J Hum Genet 67:170–181

    PubMed  CAS  Google Scholar 

  • Ralston SH, Uitterlinden AG, Brandi ML, Balcells S, Langdahl BL, Lips P, Lorenc R, Obermayer-Pietsch B, Scollen S, Bustamante M, Husted LB, Carey AH, Diez-Perez A, Dunning AM, Falchetti A, Karczmarewicz E, Kruk M, van Leeuwen JP, van Meurs JB, Mangion J, McGuigan FE, Mellibovsky L, del Monte F, Pols HA, Reeve J, Reid DM, Renner W, Rivadeneira F, van Schoor NM, Sherlock RE, Ioannidis JP (2006) Large-scale evidence for the effect of the COLIA1 Sp1 polymorphism on osteoporosis outcomes: the GENOMOS study. PLoS Med 3:e90

    PubMed  Google Scholar 

  • Rothman KJ, Greenland S (1998) Modern epidemiology, 2nd edn. Lippincott Williams & Wilkins, Philadelphia

    Google Scholar 

  • Rothman N, Stewart WF, Caporaso NE, Hayes RB (1993) Misclassification of genetic susceptibility biomarkers: implications for case–control studies and cross-population comparisons. Cancer Epidemiol Biomarkers Prev 2:299–303

    PubMed  CAS  Google Scholar 

  • Rothstein HR, Sutton AJ, Borestein M (2005) Publication bias in meta-analysis—prevention, assessment and adjustments. Wiley, Chichester

    Google Scholar 

  • Royle PL, Bain L, Waugh NR (2005) Sources of evidence for systematic reviews of interventions in diabetes. Diabet Med 22:1386–1393

    PubMed  CAS  Google Scholar 

  • Salanti G, Higgins JP, Trikalinos TA, Ioannidis JP (2007) Bayesian meta-analysis and meta-regression for gene–disease associations and deviations from Hardy–Weinberg equilibrium. Stat Med 26:553–567

    PubMed  Google Scholar 

  • Satten GA, Flanders WD, Yang Q (2001) Accounting for unmeasured population substructure in case–control studies of genetic association using a novel latent-class model. Am J Hum Genet 68:466–477

    PubMed  CAS  Google Scholar 

  • Saxena R, Voight BF, Lyssenko V, Burtt NP, de Bakker PI, Chen H, Roix JJ, Kathiresan S, Hirschhorn JN, Daly MJ, Hughes TE, Groop L, Altshuler D, Almgren P, Florez JC, Meyer J, Ardlie K, Bengtsson K, Isomaa B, Lettre G, Lindblad U, Lyon HN, Melander O, Newton-Cheh C, Nilsson P, Orho-Melander M, Rastam L, Speliotes EK, Taskinen MR, Tuomi T, Guiducci C, Berglund A, Carlson J, Gianniny L, Hackett R, Hall L, Holmkvist J, Laurila E, Sjogren M, Sterner M, Surti A, Svensson M, Svensson M, Tewhey R, Blumenstiel B, Parkin M, Defelice M, Barry R, Brodeur W, Camarata J, Chia N, Fava M, Gibbons J, Handsaker B, Healy C, Nguyen K, Gates C, Sougnez C, Gage D, Nizzari M, Gabriel SB, Chirn GW, Ma Q, Parikh H, Richardson D, Ricke D, Purcell S (2007) Genome-wide association analysis identifies loci for Type 2 diabetes and triglyceride levels. Science 316:1331–1336

    PubMed  CAS  Google Scholar 

  • Scott LJ, Mohlke KL, Bonnycastle LL, Willer CJ, Li Y, Duren WL, Erdos MR, Stringham HM, Chines PS, Jackson AU, Prokunina-Olsson L, Ding CJ, Swift AJ, Narisu N, Hu T, Pruim R, Xiao R, Li XY, Conneely KN, Riebow NL, Sprau AG, Tong M, White PP, Hetrick KN, Barnhart MW, Bark CW, Goldstein JL, Watkins L, Xiang F, Saramies J, Buchanan TA, Watanabe RM, Valle TT, Kinnunen L, Abecasis GR, Pugh EW, Doheny KF, Bergman RN, Tuomilehto J, Collins FS, Boehnke M (2007) A genome-wide association study of Type 2 diabetes in Finns detects multiple susceptibility variants. Science 316:1341–1345

    PubMed  CAS  Google Scholar 

  • Seminara D, Khoury MJ, O’Brien TR, Manolio T, Gwinn ML, Little J, Higgins JP, Bernstein JL, Boffetta P, Bondy M, Bray MS, Brenchley PE, Buffler PA, Casas JP, Chokkalingam AP, Danesh J, Davey Smith G, Dolan S, Duncan R, Gruis NA, Hashibe M, Hunter D, Jarvelin MR, Malmer B, Maraganore DM, Newton-Bishop JA, Riboli E, Salanti G, Taioli E, Timpson N, Uitterlinden AG, Vineis P, Wareham N, Winn DM, Zimmern R, Ioannidis JP (2007) The emergence of networks in human genome epidemiology: challenges and opportunities. Epidemiology 18:1–8

    PubMed  Google Scholar 

  • Skol AD, Scott LJ, Abecasis GR, Boehnke M (2006) Joint analysis is more efficient than replication-based analysis for two-stage genome-wide association studies. Nat Genet 38:209–213

    PubMed  CAS  Google Scholar 

  • Smith GD, Gwinn M, Ebrahim S, Palmer LJ, Khoury MJ (2006) Make it HuGE: human genome epidemiology reviews, population health, and the IJE. Int J Epidemiol 35:507–510

    PubMed  Google Scholar 

  • Spiegelhalter DJ, Thomas A, Best NG, Lunn D (2003) WinBUGS version 1.4 users manual

  • Spiegelhalter DJ, Abrams KR, Myles PJ (2004) Evidence synthesis. Wiley, Chichester

    Google Scholar 

  • Sterne JA, Davey Smith G (2001) Sifting the evidence-what’s wrong with significance tests? BMJ 322:226–231

    PubMed  CAS  Google Scholar 

  • Stewart LA, Parmar MK (1993) Meta-analysis of the literature or of individual patient data: is there a difference? Lancet 341:418–422

    PubMed  CAS  Google Scholar 

  • Stewart LA, Tierney JF (2002) To IPD or not to IPD? Advantages and disadvantages of systematic reviews using individual patient data. Eval Health Prof 25:76–97

    PubMed  Google Scholar 

  • Stroup DF, Berlin JA, Morton SC, Olkin I, Williamson GD, Rennie D, Moher D, Becker BJ, Sipe TA, Thacker SB (2000) Meta-analysis of observational studies in epidemiology: a proposal for reporting. Meta-analysis Of Observational Studies in Epidemiology (MOOSE) group. JAMA 283:2008–2012

    PubMed  CAS  Google Scholar 

  • Sudlow C, Martinez Gonzalez NA, Kim J, Clark C (2006) Does apolipoprotein E genotype influence the risk of ischemic stroke, intracerebral hemorrhage, or subarachnoid hemorrhage? Systematic review and meta-analyses of 31 studies among 5961 cases and 17,965 controls. Stroke 37:364–370

    PubMed  CAS  Google Scholar 

  • Sutton AJ, Abrams KR, Jones DR, Sheldon TA, Song F (2000) Methods for meta-analysis in medical research. Wiley, Chichester

    Google Scholar 

  • Tang JL, Liu JL (2000) Misleading funnel plot for detection of bias in meta-analysis. J Clin Epidemiol 53:477–484

    PubMed  CAS  Google Scholar 

  • Terrin N, Schmid CH, Lau J (2005) In an empirical evaluation of the funnel plot, researchers could not visually identify publication bias. J Clin Epidemiol 58:894–901

    PubMed  Google Scholar 

  • Thomas DC, Haile RW, Duggan D (2005) Recent developments in genomewide association scans: a workshop summary and review. Am J Hum Genet 77:337–345

    PubMed  CAS  Google Scholar 

  • Thompson SG, Higgins JP (2002) How should meta-regression analyses be undertaken and interpreted? Stat Med 21:1559–1573

    PubMed  Google Scholar 

  • Trikalinos TA, Ntzani EE, Contopoulos-Ioannidis DG, Ioannidis JP (2004) Establishment of genetic associations for complex diseases is independent of early study findings. Eur J Hum Genet 12:762–769

    PubMed  CAS  Google Scholar 

  • Uitterlinden AG, Ralston SH, Brandi ML, Carey AH, Grinberg D, Langdahl BL, Lips P, Lorenc R, Obermayer-Pietsch B, Reeve J, Reid DM, Amedei A, Bassiti A, Bustamante M, Husted LB, Diez-Perez A, Dobnig H, Dunning AM, Enjuanes A, Fahrleitner-Pammer A, Fang Y, Karczmarewicz E, Kruk M, van Leeuwen JP, Mavilia C, van Meurs JB, Mangion J, McGuigan FE, Pols HA, Renner W, Rivadeneira F, van Schoor NM, Scollen S, Sherlock RE, Ioannidis JP (2006) The association between common vitamin D receptor gene variations and osteoporosis: a participant-level meta-analysis. Ann Intern Med 145:255–264

    PubMed  CAS  Google Scholar 

  • Wacholder S, Rothman N, Caporaso N (2000) Population stratification in epidemiologic studies of common genetic variants and cancer: quantification of bias. J Natl Cancer Inst 92:1151–1158

    PubMed  CAS  Google Scholar 

  • Wacholder S, Chatterjee N, Hartge P (2002a) Joint effect of genes and environment distorted by selection biases: implications for hospital-based case–control studies. Cancer Epidemiol Biomarkers Prev 11:885–889

    PubMed  Google Scholar 

  • Wacholder S, Rothman N, Caporaso N (2002b) Counterpoint: bias from population stratification is not a major threat to the validity of conclusions from epidemiological studies of common polymorphisms and cancer. Cancer Epidemiol Biomarkers Prev 11:513–520

    PubMed  Google Scholar 

  • Wacholder S, Chanock S, Garcia-Closas M, El Ghormli L, Rothman N (2004) Assessing the probability that a positive report is false: an approach for molecular epidemiology studies. J Natl Cancer Inst 96:434–442

    Article  PubMed  Google Scholar 

  • Wakefield J (2007) A Bayesian measure of the probability of false discovery in genetic epidemiology studies. Am J Hum Genet 81:208–227

    PubMed  CAS  Google Scholar 

  • WinBUGS (2003) 1.4 edn. MRC Biostatistic Unit, Cambridge

  • Wong MY, Day NE, Luan JA, Wareham NJ (2004) Estimation of magnitude in gene–environment interactions in the presence of measurement error. Stat Med 23:987–998

    PubMed  CAS  Google Scholar 

  • Yu K, Chatterjee N, Wheeler W, Li Q, Wang S, Rothman N, Wacholder S (2007) Flexible design for following up positive findings. Am J Hum Genet 81:540–551

    PubMed  CAS  Google Scholar 

  • Yusuf S, Peto R, Lewis J, Collins R, Sleight P (1985) Beta blockade during and after myocardial infarction: an overview of the randomized trials. Prog Cardiovasc Dis 27:335–371

    PubMed  CAS  Google Scholar 

  • Zeggini E, Weedon MN, Lindgren CM, Frayling TM, Elliott KS, Lango H, Timpson NJ, Perry JR, Rayner NW, Freathy RM, Barrett JC, Shields B, Morris AP, Ellard S, Groves CJ, Harries LW, Marchini JL, Owen KR, Knight B, Cardon LR, Walker M, Hitman GA, Morris AD, Doney AS, McCarthy MI, Hattersley AT (2007) Replication of genome-wide association signals in U.K. samples reveals risk loci for type 2 diabetes. Science 316:1336–1341

    PubMed  CAS  Google Scholar 

  • Zou GY, Donner A (2006) The merits of testing Hardy–Weinberg equilibrium in the analysis of unmatched case–control data: a cautionary note. Ann Hum Genet 70:923–933

    PubMed  CAS  Google Scholar 

Download references

Acknowledgment

Dr. Kavvoura is supported by a PENED grant co-financed by the European Union-European Social Fund (75%) and the Greek Ministry of Development-General Secretariat of Research and Technology (25%).

Author information

Authors and Affiliations

  1. Clinical and Molecular Epidemiology Unit, Department of Hygiene and Epidemiology, University of Ioannina School of Medicine, University Campus, Ioannina, 45110, Greece

    Fotini K. Kavvoura & John P. A. Ioannidis

  2. Biomedical Research Institute, Foundation for Research and Technology-Hellas, Ioannina, Greece

    John P. A. Ioannidis

  3. Institute for Clinical Research and Health Policy Studies, Department of Medicine, Tufts-New England Medical Center, Tufts University School of Medicine, Boston, MA, USA

    John P. A. Ioannidis

Authors
  1. Fotini K. Kavvoura
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. John P. A. Ioannidis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to John P. A. Ioannidis.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kavvoura, F.K., Ioannidis, J.P.A. Methods for meta-analysis in genetic association studies: a review of their potential and pitfalls. Hum Genet 123, 1–14 (2008). https://doi.org/10.1007/s00439-007-0445-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00439-007-0445-9

Keywords

Search

Navigation