|Year : 2018 | Volume
| Issue : 1 | Page : 83
Comparative effectiveness of prophylactic therapies for necrotizing enterocolitis in preterm infants: Protocol for a network meta-analysis of randomized trials
Behnam Sadeghirad1, Ivan D Florez2, Yaping Chang3, Farid Forutan4, Dena Zeraatkar3, Rebecca L Morgan3, Shaneela Shahid5, Malgorzata M Bala6, Joseph Beyene3, Martin Offringa7, Thomasin Adams-Webber8, Philip M Sherman9, Enas El-Gouhary10, Gordon H Guyatt3, Bradley C Johnston11
1 Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada; HIV/STI Surveillance Research Center, and WHO Collaborating Center for HIV Surveillance, Institute for Futures Studies in Health, Kerman University of Medical Sciences, Kerman, Iran
2 Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada; Department of Pediatrics, University of Antioquia, Medellin, Colombia
3 Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada
4 Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton; Heart Failure/Transplant Program, Toronto General Hospital, University Health Network, Toronto, ON, Canada
5 Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON, Canada; Department of Hygiene and Dietetics, Jagiellonian University Medical College, Krakow, Poland
6 Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, ON, Canada
7 Hospital Library, The Hospital for Sick Children, Toronto, ON, Canada
8 Division of Gastroenterology, Hepatology and Nutrition, Hospital for Sick Children, Department of Pediatrics, University of Toronto, Toronto, ON, Canada
9 Department of Pediatrics, McMaster University, Hamilton, ON, Canada
10 Department of Hygiene and Dietetics, Jagiellonian University Medical College, Krakow, Poland
11 Department of Health Research Methods, Evidence, and Impact (HEI), McMaster University, Hamilton, ON; Department of Community Health and Epidemiology, Dalhousie University, Halifax, NS; Systematic Overviews through advancing Research Technology (SORT), Child Health Evaluative Sciences, The Hospital for Sick Children Research Institute, Toronto, ON, Canada
|Date of Submission||29-Jul-2017|
|Date of Acceptance||17-Aug-2017|
|Date of Web Publication||17-Sep-2018|
Bradley C Johnston
Department of Community Health and Epidemiology, Faculty of Medicine, Dalhousie University, 5790 University Avenue, B3H 1V7 Halifax, Nova Scotia
Source of Support: None, Conflict of Interest: None
Necrotizing enterocolitis (NEC) is a common and devastating disease with high morbidity and mortality in premature infants. Current literature on the prevention of NEC has limitations including lack of direct and indirect comparisons of available therapies. We will search MEDLINE, EMBASE, Science Citation Index Expanded, Social Sciences Citation Index, CINAHL, Scopus, ProQuest Dissertations and Theses database, and grey literature sources to identify eligible trials evaluating NEC preventive therapies. Eligible studies will (1) enroll preterm (gestational age <37 weeks) and/or low birth weight (birth weight <2500 g) infants, (2) randomize infants to any preventive intervention or a placebo, or alternative active or nonactive intervention. Our outcomes of interest are severe NEC (stage II or more, based on Bell's criteria), all-cause mortality, NEC-related mortality, late-onset sepsis, duration of hospitalization, weight gain, time to establish full enteral feeds, and treatment-related adverse events. Two reviewers will independently screen trials for eligibility, assess risk of bias, and extract data. All discrepancies will be resolved by discussion. We will specify a priori explanations for heterogeneity between studies. For available comparisons between treatment and no treatment, and direct comparisons of treatments, we will conduct conventional meta-analysis using a random effects model. We will conduct a network meta-analysis using a random effects model within the Bayesian framework using Markov chain Monte Carlo methods to assess relative effects of eligible interventions. We will assess the certainty in direct, indirect, and network estimates using the Grading of Recommendations Assessment, Development and Evaluation approach. Ethics and Dissemination: We will disseminate our findings through a peer-reviewed publication and conference presentations.
Keywords: Multiple treatment comparison, necrotizing enterocolitis, preterm infants, preventive therapies, systematic review
|How to cite this article:|
Sadeghirad B, Florez ID, Chang Y, Forutan F, Zeraatkar D, Morgan RL, Shahid S, Bala MM, Beyene J, Offringa M, Adams-Webber T, Sherman PM, El-Gouhary E, Guyatt GH, Johnston BC. Comparative effectiveness of prophylactic therapies for necrotizing enterocolitis in preterm infants: Protocol for a network meta-analysis of randomized trials. Int J Prev Med 2018;9:83
|How to cite this URL:|
Sadeghirad B, Florez ID, Chang Y, Forutan F, Zeraatkar D, Morgan RL, Shahid S, Bala MM, Beyene J, Offringa M, Adams-Webber T, Sherman PM, El-Gouhary E, Guyatt GH, Johnston BC. Comparative effectiveness of prophylactic therapies for necrotizing enterocolitis in preterm infants: Protocol for a network meta-analysis of randomized trials. Int J Prev Med [serial online] 2018 [cited 2019 Oct 20];9:83. Available from: http://www.ijpvmjournal.net/text.asp?2018/9/1/83/241416
| Introduction|| |
Necrotizing enterocolitis (NEC) is among the most important diseases of the gastrointestinal tract and the most frequent surgical emergency in neonates. The mechanism of NEC is poorly understood but occurs as a result of death of intestinal tissue, which may occur as a result of bacteria in the intestinal tract, or reduced blood delivery. It is characterized by damage to the intestinal tract, which ranges from mucosal damage to full-thickness necrosis and perforation., The staging system originally described by Bell et al. categorizes NEC into 3 stages: (1) suggestive, (2) definite, and (3) severe. Stage 1 NEC presents as feeding intolerance or symptoms of advanced prematurity; infants with Stage 2 NEC require medical management, and Stage 3 requires surgical intervention.
The incidence of NEC, which varies across countries and neonatal centers, is estimated to be approximately 3/1000 live births; and it occurs in 1%–5% of neonatal intensive care unit admissions., NEC is mainly associated with prematurity and low birth weight. The incidence of NEC in neonates of very low birth weight (<1500 g) remained unchanged from 1997 to 2007, ranging from 3% to 15%., According to data from 2009, the incidence of NEC increased, and it is now the 11th leading cause of death in infants.
Despite advances in neonatal intensive care, morbidity and mortality related to NEC have remained unchanged. The NEC associated rate of death is reported to be 20% to 30%, and the rate is higher among infants in need of surgery-up to 50%.,, NEC is associated with substantial economic burden, with an estimated annual hospitalization cost of more than $500 million in the United States. Infants recovering from NEC are at increased risk for prolonged parenteral nutrition and its related complications, short-bowel syndrome, serious neurodevelopmental delays, and functional disabilities.,
Current recommendations for the management include prompt, early diagnosis, medical management, and surgery if warranted. The preferred approach to combat NEC is prophylactic therapy. More than 10 systematic reviews have evaluated various preventive strategies, including maternal and donor breast milk feeding,, prophylactic probiotics,,,, oral lactoferrin, supplementation of formula milk with prebiotic, arginine, or glutamine, and immunoglobulin administration.
Nevertheless, considerable gaps in the current literature exist. In particular, most randomized controlled trials (RCTs) compare active treatment to nonactive comparators (e.g., placebo) and there are few direct comparisons among preventive strategies. No systematic review has evaluated all RCT evidence of the leading prophylactic therapies for NEC and no review performed or compared the efficacy and safety of all preventive therapies with one another.,,,,,,,,,,,, The only available network meta-analysis assessing the efficacy and safety of food additives (probiotics and prebiotics) for preventing NEC included 25 RCTs, whereas the most recent meta-analyses on probiotics included 49 RCTs. No review has used the Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach for evaluating the certainty of prophylactic therapies for NEC. Further, none of the published meta-analyses used emerging methods for handling missing participant outcome data and for assessing risk of bias associated with missing data on risk of bias for NEC prevention., These limitations highlight the need for a comprehensive review using a systematic approach that compares all available evidence for the prevention of NEC. We aim to conduct a systematic review and network meta-analysis of randomized trials on the effects of preventive therapies in preterm (gestational age <37 weeks) infants on severe NEC, all-cause mortality, NEC-related mortality, and culture-positive sepsis.
| Methods|| |
Our protocol conforms to the preferred reporting items for systematic review and meta-analysis protocols 2015 guideline.
We will systematically search MEDLINE, EMBASE, Science Citation Index Expanded and Social Sciences Citation Index, CINAHL, Scopus, ProQuest Dissertations and Theses database, and Cochrane Central Register of Controlled Trials. Our grey literature search will include trial registries (including ISRCTN registry; clinicaltrials. gov; and WHO international RCT registry), BIOSIS Previews, and Google Scholar to find relevant trials. We will not apply language or publication status restrictions. We will work with an experienced medical librarian to develop a search strategy for each database (see appendix 1 for our proposed search strategy for MEDLINE). Reference lists from eligible trials and relevant literature reviews will be scanned for additional trials that may meet our inclusion criteria.
Eligibility criteria and study selection
Trials will be eligible if they enroll preterm (gestational age <37 weeks) and/or low birth weight (birth weight <2500 g) infants randomized to any of preventive interventions listed below compared to an alternative intervention, placebo, or no intervention. Eligible prophylactic interventions will include maternal or donor breast milk feeding with or without human milk fortifiers, immunoglobulin (IgG or a combination of IgG/IgA) administration, prebiotics (lactoferrin, insulin, galacto- or fructo-oligosaccharides), colostrum, arginine, glutamine, probiotics, and combination of probiotics and prebiotics (synbiotics). Studies published in duplicate or studies that used data from a similar study population in different publications in part or full will be identified and we will extract data from the publication with the most complete dataset (e.g., publications with largest sample size and/or longest duration of follow-up). Appendix 2 presents a draft of the proposed screening tool for determining the eligibility of studies.
Pairs of reviewers, working independently will screen titles and abstracts of identified articles and acquire and assess the full-text publication for eligibility when one or both reviewers consider a study as potentially eligible. Reviewers will resolve disagreements by consensus and if disagreements are unresolved, discuss discrepancies with a more experienced team member with relevant expertise. We will pilot this step on 10 randomly selected articles (with a ratio of 1:1 eligible and noneligible) and repeat the process until we reach 80% agreement.
To help ensure the reliability of independent data extraction, we will begin by piloting our data extraction forms on three randomly selected eligible articles, repeating the process if we find substantial challenges. After our forms have been piloted and standardized, we will conduct calibration exercises between reviewers. To calibrate, we will randomly select four articles that have met our eligibility criteria and each team member will abstract data. Subsequently, team members will meet to resolve the disagreements. We will repeat this process until we reach agreement on 90% of data abstraction items. With accompanying data extraction instructions generated from our piloting and calibration exercises, reviewers, working in pairs, will independently extract all data and resolve discrepancies through discussion. From the included RCTs, the following data will be extracted into a standardized spreadsheet: Study characteristics (the first author, publication year, country of origin, and funding source), participant and trial characteristics (sample size, mean gestational age, birth weight, and corresponding measure of variance (e.g., standard deviation), characteristics of interventions and comparators (time of initiation, doses, species and strains if prebiotics or probiotics used, treatment durations), outcomes of interest (Severe NEC-Stage II or more based on Bell's criteria,, all-cause mortality, NEC related mortality, and late onset sepsis, duration of hospitalization, weight gain, time to establish full enteral feeds, and treatment-related adverse events).
Risk of bias assessment
Among eligible studies, we will independently assess the following risk of bias issues based on the modified version of the Cochrane risk of bias tool for RCTs: random sequence generation, allocation concealment, blinding study participants (in the case of our study, infants' parents), personnel and outcome assessors, incomplete outcome data, and selective outcome reporting. The modified instrument rather than the standard response options (high, low, or unclear risk of bias) will use the following responses: “definitely yes” or “probably yes” (considered as low risk of bias), or “definitely no” or “probably no” (considered as high risk of bias). These response options have published evidence of validity for assessing blinding, and will allow our risk of bias assessments to avoid “unclear” as a response option. Any discrepancy in assessment of risk of bias will be resolved by discussion, or third party adjudication if needed. We will attempt to contact the authors of eligible studies for missing information regarding risk of bias assessments and primary/secondary outcomes.
For each direct paired comparison, we will calculate relative risk and absolute risk, and the associated 95% confidence intervals (CIs) for dichotomous outcomes. For continuous outcomes, we will analyze the results using weighted mean differences with corresponding 95% CIs. We will employ methods described in Cochrane Handbook both to estimate the mean and SD where median, range, and sample size were reported, and to impute the SD if the SE or SD for the differences are not reported. We will use the Q-statistic and I2 to determine statistical heterogeneity for conventional pair-wise meta-analysis and will look for clinical and/or methodological sources of heterogeneity across included RCTs. We will perform subgroup analyses regardless of heterogeneity estimates. We will use the DerSimonian–Laird random-effects model for the meta-analysis of all outcomes.
Network meta-analysis methods
We will use a random effects model within the Bayesian framework using Markov chain Monte Carlo methods to assess the relative effects of eligible preventive interventions., However, if we observe any random-effects network estimate inconsistent with its direct estimate, we will report fixed-effects model outputs. We will simulate 100,000 iterations and test the model convergence using the Gelman–Rubin statistic. For estimating the precision of the effects, we will use 95% credible intervals through the 2.5 and 97.5 percentiles obtained from the simulations.
Although the assumptions for network meta-analysis are similar to conventional meta-analysis, additional key assumptions are transitivity (there are no effect modifiers influencing the indirect comparisons) and coherence (direct and indirect effect estimates being similar). We will identify issues of incoherence by comparing direct evidence (i.e., estimates from pair-wise comparisons) with indirect evidence (i.e., estimates from network meta-analysis) using node splitting method., We will use a Wald test to test any statistical difference between the direct and the indirect estimates.
We expect results to differ between studies and we have developed three hypotheses to explain variability: (1) infants with lower birth weight will show smaller treatment effect; (2) infants receiving intervention added to their mother's milk versus donor's milk or formula will show larger treatment effects; and (3) RCTs with higher risk of bias will show larger treatment effects than trials with lower risk of bias.
We will report our findings with probability statements of intervention effects. Probability rankings allow us to report a chance percentage of which interventions rank higher; however, simplifying the results of a network down to probabilities can lead to misinterpretations, specifically, when particular comparisons (i.e., nodes) are not well-connected and/or when certainty in evidence varies between comparisons. Following display of the rank probabilities using rankogram, we will use the surface under the cumulative ranking (SUCRA) to aid in interpretation of relative effect of the interventions; an intervention with a SUCRA value of 100 is certain to be the best, whereas an intervention with 0 is certain to be the worst. We will use STATA (StataCorp, Release 14.2, College Station, Texas, USA) and WinBUGS (MRC Biostatistics Unit, Version 1.4, Cambridge, UK) for statistical analyses.
Assessing certainty in (quality of) the evidence
To assess the certainty in (quality of) estimates of effect across each outcome of interest, we will use the GRADE approach that classifies evidence as high, moderate, low, or very low quality. The starting point for certainty in estimates for randomized trials is high, but may be rated down based on limitations in: risk of bias, imprecision, inconsistency, and indirectness and publication bias. The GRADE evidence assessment will be presented in a summary of findings table.
We will also use the GRADE approach to assess the certainty in indirect and network (mixed) effect estimates. Indirect effect estimates are calculated from available “loops” of evidence, which includes first-order loops (based on a single common comparator treatment, the difference between the treatment A and B is based on comparisons of A and C as well as B and C) or higher order loops (more than one intervening treatment connecting the two interventions). We will visually examine the network map and where first-order loops are available for indirect comparisons, the certainty of evidence will be the lower of the ratings of certainty for the two direct estimates contributing to the first-order loop (for instance, for the indirect estimate of the effect between A and C through comparisons of A versus C – high quality evidence and B versus C – moderate quality evidence, the certainty will be “moderate” – the lowest of the two direct estimates). In the absence of a first-order loop, a higher order loop will be used to rate certainty in evidence and it will be the lower of the ratings of certainty for the direct estimates contributing to the loop. However, we may rate down the certainty further for intransitivity. The transitivity assumption implies similarity of trials in terms of population, intervention, outcomes, settings, and trial methodology.
| Discussion|| |
NEC is a devastating gastrointestinal condition among low birth weight neonates and has been one of the most challenging diseases to prevent and eradicate., Given its relatively high incidence, the high socioeconomic burden, and scarcity of evidence on the comparative effectiveness of preventive interventions which has likely contributed to variable practice patterns among clinicians, there is a need for a high-quality systematic review and network meta-analysis of the common prophylactic therapies to inform evidence-based prevention of NEC.
There may be limitations to our proposed review methods including the ability to assess risk of publication bias and assess subgroup analysis across diverse interventions using network meta-analysis methods. Our protocol has attempted to document the proposed methods a priori, including plans to address the anticipated challenges of such an NMA (e.g., handling missing participant data, assessing subgroup effects and network meta-regression, calculating absolute risk within network of preventive treatments) and assess the certainty in estimates using the GRADE approach.
To ensure that our findings are translated to the neonatology community, we will publish our results in an accessible peer-reviewed journal and present our findings at national and international scientific conferences and on The Hospital for Sick Children and McMaster Children's Hospital websites.
Financial support and sponsorship
Mitacs funded this project through partnership with Nestlé Canada (Mitacs is a national, not-for-profit organization that has designed and delivered research and training programs in Canada working with universities, companies, and both federal and provincial governments).
Conflicts of interest
There are no conflicts of interest.
| Appendix|| |
Appendix 1: Proposed search strategy for MEDLINE
Database: Ovid MEDLINE(R) In-Process and Other Non-Indexed Citations, Ovid MEDLINE (R) Daily and Ovid MEDLINE (R) <1946 to Present>
Appendix 2: Draft of proposed screening tool for eligibility of studies
- Does this study include infants with gestational age <37 weeks or birth weight <2500 g?
- Did the study participants get any NEC preventive intervention?
- The study design is RCT?
- Is there any comparison used for NEC prevention (e.g., usual care or other NEC prevention intervention?
- Does the study have data for the following outcomes (incidence of Severe NEC, all-cause mortality, NEC-related mortality, and culture-positive sepsis, duration of hospitalization related to NEC, weight gain, duration of parenteral nutrition, time to establish full enteral feeds)?
| References|| |
Neu J, Walker WA. Necrotizing enterocolitis. N Engl J Med 2011;364:255-64.
Yajamanyam PK, Rasiah SV, Ewer AK. Necrotizing enterocolitis: Current perspectives. Res Rep Neonatol 2014;4:31-42.
Bell MJ, Ternberg JL, Feigin RD, Keating JP, Marshall R, Barton L, et al.
Neonatal necrotizing enterocolitis. Therapeutic decisions based upon clinical staging. Ann Surg 1978;187:1-7.
Perrelli F, Mantovani J, Pezzotti P, Guerra MP, Orsi A, Alecci L, et al.
A cross-sectional survey on childhood immunization coverage and reasons of non-compliance in Lazio region, Italy (2007). Ann Ig 2009;21:301-13.
Berman L, Moss RL. Necrotizing enterocolitis: An update. Semin Fetal Neonatal Med 2011;16:145-50.
Christensen RD, Gordon PV, Besner GE. Can we cut the incidence of necrotizing enterocolitis in half – Today? Fetal Pediatr Pathol 2010;29:185-98.
Lin PW, Stoll BJ. Necrotising enterocolitis. Lancet 2006;368:1271-83.
Yee WH, Soraisham AS, Shah VS, Aziz K, Yoon W, Lee SK, et al.
Incidence and timing of presentation of necrotizing enterocolitis in preterm infants. Pediatrics 2012;129:e298-304.
Centers for Disease Control and Prevention. Infant, Neonatal, and Postneonatal Deaths, Percent of Total Deaths, and Mortality Rates for the 15 Leading Causes of Infant Death by Race and Sex. United States; 2009, 2012. Available from: https://www.cdc.gov/nchs/data/nvsr/nvsr60/nvsr60_04.pdf
. [Last accessed on 2015 Mar 12].
Thyoka M, de Coppi P, Eaton S, Khoo K, Hall NJ, Curry J, et al.
Advanced necrotizing enterocolitis part 1: Mortality. Eur J Pediatr Surg 2012;22:8-12.
Raval MV, Hall NJ, Pierro A, Moss RL. Evidence-based prevention and surgical treatment of necrotizing enterocolitis-a review of randomized controlled trials. Semin Pediatr Surg 2013;22:117-21.
Henderson G, Anthony MY, McGuire W. Formula milk versus maternal breast milk for feeding preterm or low birth weight infants. Cochrane Database Syst Rev 2007;4:CD002972.
Quigley M, McGuire W. Formula versus donor breast milk for feeding preterm or low birth weight infants. Cochrane Database Syst Rev 2014;4:CD002971.
AlFaleh K, Anabrees J. Probiotics for prevention of necrotizing enterocolitis in preterm infants. Evid Based Child Health 2014;9:584-671.
Deshpande G, Rao S, Patole S, Bulsara M. Updated meta-analysis of probiotics for preventing necrotizing enterocolitis in preterm neonates. Pediatrics 2010;125:921-30.
Stenger MR, Reber KM, Giannone PJ, Nankervis CA. Probiotics and prebiotics for the prevention of necrotizing enterocolitis. Curr Infect Dis Rep 2011;13:13-20.
Wang Q, Dong J, Zhu Y. Probiotic supplement reduces risk of necrotizing enterocolitis and mortality in preterm very low-birth-weight infants: An updated meta-analysis of 20 randomized, controlled trials. J Pediatr Surg 2012;47:241-8.
Pammi M, Abrams SA. Oral lactoferrin for the prevention of sepsis and necrotizing enterocolitis in preterm infants. Cochrane Database Syst Rev 2011;10:CD007137.
Srinivasjois R, Rao S, Patole S. Prebiotic supplementation of formula in preterm neonates: A systematic review and meta-analysis of randomised controlled trials. Clin Nutr 2009;28:237-42.
Mitchell K, Lyttle A, Amin H, Shaireen H, Robertson HL, Lodha AK, et al.
Arginine supplementation in prevention of necrotizing enterocolitis in the premature infant: An updated systematic review. BMC Pediatr 2014;14:226.
Moe-Byrne T, Wagner JV, McGuire W. Glutamine supplementation to prevent morbidity and mortality in preterm infants. Cochrane Database Syst Rev 2012;1:CD001457.
Foster J, Cole M. Oral immunoglobulin for preventing necrotizing enterocolitis in preterm and low birth-weight neonates. Cochrane Database Syst Rev 2004;1:CD001816.
Bury RG, Tudehope D. Enteral antibiotics for preventing necrotizing enterocolitis in low birthweight or preterm infants. Cochrane Database Syst Rev 2001;1:CD000405.
Morgan J, Young L, McGuire W. Slow advancement of enteral feed volumes to prevent necrotising enterocolitis in very low birth weight infants. Cochrane Database Syst Rev 2013;3:CD001241.
Morgan J, Young L, McGuire W. Delayed introduction of progressive enteral feeds to prevent necrotising enterocolitis in very low birth weight infants. Cochrane Database Syst Rev 2014;12:CD001970.
Yu W, Sui W, Mu L, Yi W, Li H, Wei L, et al.
Preventing necrotizing enterocolitis by food additives in neonates: A network meta-analysis revealing the efficacy and safety. Medicine (Baltimore) 2017;96:e6652.
Ebrahim S, Akl EA, Mustafa RA, Sun X, Walter SD, Heels-Ansdell D, et al.
Addressing continuous data for participants excluded from trial analysis: A guide for systematic reviewers. J Clin Epidemiol 2013;66:1014-210.
Akl EA, Johnston BC, Alonso-Coello P, Neumann I, Ebrahim S, Briel M, et al.
Addressing dichotomous data for participants excluded from trial analysis: A guide for systematic reviewers. PLoS One 2013;8:e57132.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al.
Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015;4:1.
Walsh MC, Kliegman RM. Necrotizing enterocolitis: Treatment based on staging criteria. Pediatr Clin North Am 1986;33:179-201.
Higgins JP, Altman DG, Gøtzsche PC, Jüni P, Moher D, Oxman AD, et al.
The cochrane collaboration's tool for assessing risk of bias in randomised trials. BMJ 2011;343:d5928.
Akl EA, Sun X, Busse JW, Johnston BC, Briel M, Mulla S, et al.
Specific instructions for estimating unclearly reported blinding status in randomized trials were reliable and valid. J Clin Epidemiol 2012;65:262-7.
Higgins JP, Green S. Cochrane Handbook for Systematic Reviews of Interventions, version [5.1.0]. The Cochrane Collaboration; 2011. Available from: http://handbook-5-1.cochrane.org/
. [Last updated on 2016 Mar].
Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003;327:557-60.
Ades AE, Sculpher M, Sutton A, Abrams K, Cooper N, Welton N, et al.
Bayesian methods for evidence synthesis in cost-effectiveness analysis. Pharmacoeconomics 2006;24:1-9.
Lumley T. Network meta-analysis for indirect treatment comparisons. Stat Med 2002;21:2313-24.
Brooks SP, Gelman A. Alternative methods for monitoring convergence of iterative simulations. J Comput Graphical Stat 1998;7:434-55.
Salanti G, Higgins JP, Ades AE, Ioannidis JP. Evaluation of networks of randomized trials. Stat Methods Med Res 2008;17:279-301.
Donegan S, Williamson P, D'Alessandro U, Tudur Smith C. Assessing key assumptions of network meta-analysis: A review of methods. Res Synth Methods 2013;4:291-323.
Lu G, Ades AE. Assessing evidence inconsistency in mixed treatment comparisons. J Am Stat Assoc 2006;101:447-59.
White IR. Network meta-analysis. Stata J 2015;15:951-85.
Salanti G, Ades AE, Ioannidis JP. Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: An overview and tutorial. J Clin Epidemiol 2011;64:163-71.
Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al.
GRADE: An emerging consensus on rating quality of evidence and strength of recommendations. BMJ 2008;336:924-6.
Puhan MA, Schünemann HJ, Murad MH, Li T, Brignardello-Petersen R, Singh JA, et al.
A GRADE working group approach for rating the quality of treatment effect estimates from network meta-analysis. BMJ 2014;349:g5630.