Skip Navigation

NICHD Cochrane Neonatal Home Page

Skip sharing on social media links
Share this:

These systematic reviews were provided by Cochrane Neonatal, and are the result of activity sponsored, by the Eunice Kennedy Shriver National Institute of Child Health and Human Development (NICHD). NICHD has placed a high priority on making the work of this collaboration available because of the importance of relaying this information to health care professionals and to the public.

Additional systematic reviews relevant to neonatal care can also be accessed thanks to the collegiality and hard work of other members of the Cochrane Collaboration.

For more information concerning this site, please contact:

Colleen Ovelman
Cochrane Neonatal
Vermont Oxford Network
33 Kilburn Street
Burlington, Vermont 05401
USA
Phone: +802 865 4814
colleen.ovelman@uvm.edu

Introduction to Neonatal Systematic Reviews

  1. What are systematic reviews, and why do we need them?
  2. Who prepared these systematic reviews?
  3. Methods used in preparing these systematic reviews
  4. Assessing validity
  5. Combining results of independent studies
  6. Making inferences
  7. Viewing and printing analyses from a systematic review
  8. Contact Details

1. What are systematic reviews, and why do we need them?

The practice of evidence-based neonatology requires efficient access to up-to-date, valid evidence concerning the efficacy and safety of treatments. In the field of therapy, effects of only moderate size can be clinically very important and, to be able to detect them, all the available studies must be considered. Avoidance of bias is essential, so assessments of benefits and risks of therapy must be based primarily on evidence from randomized controlled trials.

Busy clinicians, policymakers or patients cannot readily keep abreast of the evidence from individual trials. Moreover, neonatology is a rapidly changing field where there are frequent shifts in the weight of accumulating evidence. Therefore, there is a pressing need for continuously updated reviews of the results of randomized trials. These can provide efficient access to current evidence and avoid a long gap between the time when the efficacy of a treatment has in fact been established and the time when the treatment is routinely recommended.

A systematic review of the results of randomized, controlled trials employs explicit, systematic methods designed to produce unbiased and precise estimates of the effect of a treatment on each of the major outcomes of clinical importance. The term "systematic review" is used to distinguish its explicit methodology from that of a non-systematic review where the methodology of the review process is not made explicit and opinion may be mixed with evidence. The use of statistical methods to aggregate and summarize the results of independent studies (meta-analysis) increases the power to detect treatment effects and can provide more precise estimates of the size of treatment effects than are provided by an individual trial.

The results of such systematic reviews are of importance in informing providers and consumers about the effect of treatments and in identifying priorities for new research.

2. Who prepared these systematic reviews?

The compendium of systematic reviews which is presented here is the work of members of the Cochrane Neonatal Review Group (CNRG) of the Cochrane Collaboration. Additionally, in the spirit of collaboration, we are able to share reviews prepared by other Cochrane Review Groups that are relevant to neonatal care.

The Cochrane Collaboration is an international collaboration of individuals and entities with a mandate to prepare, maintain and disseminate systematic reviews of the effects of health care. Collaborative Review Groups are composed of individuals sharing an interest in an area of health-related care practice. The CNRG is composed of hundreds of individuals (neonatologists, pediatricians, physiotherapists, nursing, nutritionists, statisticians, health science librarians) from many countries around the world. Contact details for the members of the CNRG editorial team are given below. Contact details for the authors of specific reviews are given in the review itself.

Reviews appearing on these web pages are Cochrane Collaboration Reviews which have been or will be published electronically in The Cochrane Library, Cochrane Database of Systematic Reviews.

3. Methods used in preparing these systematic reviews

Reviewers used a systematic, explicit method in preparing these reviews. The general approach is described in detail by Mulrow and Oxman in "How to Conduct a Cochrane Systematic Review", in the Cochrane Collaboration Handbook (1). The following brief description focuses on five essential elements: specifying the objectives of the review, identifying and selecting studies, assessing validity, combining results of independent studies, and making inferences.

  1. Specifying the objectives of the review

    The objectives of the review are formulated a priori as an explicit, focused research question which specifies the population, the intervention, and the outcomes (both beneficial and harmful) of interest. The reviewer frequently will set not only a main objective but also secondary objectives - for example, subgroup analyses or analyses of sources of variation in the results of the primary studies. A protocol is developed which states the objectives of the review, and specifies the methods that will be used at each stage of the review.

  2. Identifying and selecting studies

    The Cochrane Neonatal Group maintains a Register of controlled trials of interventions involving the baby during the first month after birth. The Register incorporates neonatal trials registered in the Oxford Database of Perinatal Trials which contains reports of virtually all neonatal trials up to 1992. The Register has been continuously updated since then as described below. Photocopies are obtained of all reports. The bibliographic details and, if need be, the full report, are supplied to the relevant reviewers. All controlled trials of interventions involving the baby during the first month after birth are potentially eligible for inclusion in the Neonatal Specialized Register. Controlled trials of interventions beyond the first month are also included if they involve the later management of neonatal diseases and would be of interest to neonatologists. Allocation to the treatment groups being compared must be random or quasi-random (e.g. alternate) for the trial to be registered in the Neonatal Specialized Register.

    The search for eligible controlled trials is done as follows:

    1. Electronic search of bibliographic databases

      The National Library of Medicine database Medline has been searched electronically back to 1966 and this search is updated monthly. The search strategy has been adjusted over time (2,3). At present we search for neonatal trials by relying on publication types: randomized controlled trial (PT) or controlled clinical trial (PT), as follows:

      Access via Entrez PubMed: Database, MEDLINE

      1. Search: infant, newborn OR infant, newborn, diseases OR neonat* Limits: publication type - randomized controlled trial. Retrievals are reviewed by title and abstract to identify reports which qualify for the neonatal database. Final decision is based on the full report.
      2. Search: infant, newborn OR infant, newborn, diseases OR neonat* NOT randomized controlled trial [pt]
        Limits: publication type - clinical trial
    2. Handsearch of journals

      Over 700 journals are presently being handsearched through the combined efforts of handsearchers throughout the Cochrane Collaboration. Randomized controlled trials and controlled clinical trials which are identified by handsearching are sent to the US Cochrane Center and tagged as publication type RCT or CCT (Medline upgrade project). Reports of RCTs or CCTs, which are eligible for inclusion in the Neonatal Specialized Register, are ascertained by electronic searching of Medline as described previously.

      The Neonatal Group contributes to the overall effort in hand-searching journals by hand-searching 26 specialty journals in the fields of Pediatrics and neonatology.

    3. Ad hoc notification

      Ad hoc notification results in additional reports of eligible trials being added to the Neonatal register. These reports may be detected through the reviewer's personal knowledge or contacts. We solicit such notification from anyone who knows of an eligible trial that appears to have been overlooked in a review (see Contact details).

4. Assessing validity

Randomized trials, by their design, offer maximum protection against selection bias at entry. However, opportunities for bias arise at multiple points in the design, conduct, analysis and reporting of randomized trials. Therefore, the validity of each primary trial is assessed, and the methodological features of each trial are included as part of the review. Systematic attention is given to blinding of the randomization process, blinding of the intervention, completeness of follow-up, and blinding of the outcome measurement.

5. Combining results of independent studies

The measures of treatment effect include, for categorical dichotomous data, both relative estimators (odds ratio, relative risk) and absolute estimators (risk difference). For data measured on a continuous scale, the effect of treatment is expressed as the mean difference. For each outcome, standard statistical methods (1) are used to calculate the treatment effect (point estimate and 95% confidence interval) as shown in each trial and in the set of included trials as a whole. This latter estimate, the "typical effect", is a weighted average, the weights being the inverse of the variance of the estimate provided by each participating trial. Thus, large trials have more effect on the typical effect than do small trials. These methods are based on either fixed effect or random effects models. The neonatal reviews generally use a fixed effect model.

The statistical significance of a treatment effect is demonstrated when the confidence interval around the point estimate of treatment effect excludes "no difference". This would occur when the confidence interval of the estimate for odds ratio or relative risk does not include one, or when the confidence interval for absolute risk reduction or mean difference does not include zero. By convention, the proportion of adverse events (rather than favorable outcomes) is tabulated. On the graphs, treatment effects that lie to the left of the no effect vertical line (e.g. to the left of an odds ratio, OR, of 1) indicate a result which favors the experimental group.

Reviewers consider not only the direction and size of the typical treatment effect, but whether the results are reasonably consistent within a set of trials. If there is substantial heterogeneity of the results, the reviewer may elect not to calculate a typical effect.

6. Making inferences

The strength of inference concerning the probable effects of a treatment depends on the methodological quality of the primary trials on which the review was based, the degree of consistency of results among the trials contributing to the review, and the degree of confidence that the search for all trials relevant to the review has been comprehensive. When the methodological quality of the included trials is high, and the results are consistent within the set of trials, and there is high confidence that all relevant trials have been detected, there is a basis for strong inference regarding the statistical significance and clinical implications of the results.

7. Viewing and printing analyses from a systematic review

To view the analyses tables and graphs, go to Data Tables & Graphs at the end of the review and click on the specific outcome you want to see. From there you will be able to scroll vertically and horizontally to view the table or graph on the screen. If you choose to print the analyses, changing your print options from portrait to landscape may be necessary.

8. Contact Details

Coordinating Editor

Roger F. Soll 
H. Wallace Professor of Neonatology
Neonatologist
University of Vermont Medical Center
Division of Neonatal Perinatal Medicine
111 Colchester Avenue
Main Campus, McClure, Level 7
Burlington,  Vermont  05401
USA
roger.soll@uvmhealth.org

Managing Editor & Assistant Information Specialist

Colleen Ovelman
Cochrane Neonatal
Vermont Oxford Network
33 Kilburn Street
Burlington Vermont 05401
USA
Phone: +802 865 4814
colleen.ovelman@uvm.edu 

Information Specialist

Jennifer Spano
Cochrane Neonatal
Vermont Oxford Network
33 Kilburn Street
Burlington Vermont 05401
USA
Phone: +802 865 4814
Jennifer.spano@uvm.edu

Webmaster

Yolanda Brosseau 
Cochrane Neonatal
Vermont Oxford Network
33 Kilburn Street
Burlington Vermont 05401
USA
Phone: +802 865 4814
yolanda.brosseau@uvm.edu


Co-Editors

Michael Bracken
Yale University School of Medicine
Department of Epidemiology and Public Health
60 College Street
New Haven, Connecticut 06510
USA
michael.bracken@yale.edu

Jeffrey Horbar
Vermont Oxford Network
33 Kilburn Street
Burlington, Vermont 05401
USA 
horbar@vtoxford.org

Gautham Suresh
Texas Children's Hospital
6621 Fannin t.
W6104
Houston, Texas
USA
gautham.suresh@bcm.edu

William McGuire
Professor of Child Health
Centre for Reviews and Dissemination
Hull York Medical School
University of York
York
Y010 5DD
UK
william.mcguire@hyms.ac.uk


Associate Editors

Maria Ximena Rojas
Associate professor
Departamento de Epidemiologia Clinica y Bioestadistica
Faculty of Medicine
Pontificia Universidad Javeriana
mxrojas@gmail.com

Robert H. Pfister
Attending Neonatologist
NICU Medical Director
Chief of Pediatrics
St. Charles Health Systems
Bend, Oregon, USA

Marie T. Berg
Associate Professor of Pediatrics
Attending Neonatologist
University of Vermont Children's Hospital
Burlington, Vermont, USA

Mohan Pammi
Associate Professor
Section of Neonatology,
Department of Pediatrics
Baylor College of Medicine
Houston, Texas, USA

Prakeshkumar S Shah
Professor
Departments of Paediatrics and HPME
Mount Sinai Hospital and University of Toronto
CIHR Applied Research Chair in Reproductive and Child Health Services and Policy Research
Director, Canadian Neonatal Network
Toronto, Ontario Canada

Jann P Foster
Senior Lecturer
School of Nursing and Midwifery
Western Sydney University
Penrith, DC Australia

Martin Offringa
Professor of Paediatrics,
University of Toronto
Senior Scientist and Program Head
Child Health Evaluative Sciences
Research Institute, The Hospital for Sick Children
Staff Neonatologist,
Department of Paediatrics
Toronto, ON, Canada

John A. F. Zupancic
Associate Professor of Pediatrics
Harvard Medical School
Associate Chief of Neonatology
Beth Israel Deaconess Medical Center
Boston, Massachusetts USA

Haresh Kirpalani
Professor
Department of Pediatrics
Perelman School of Medicine at the University of Pennsylvania and Department of Clinical Epidemiology and Biostatistics, McMaster University
Director, Newborn and Infant Chronic Lung Disease Program
Children's Hospital of Philadelphia
Philadelphia, Pennsylvania USA

Eugene Dempsey
Professors of Paediatrics and Child Health
University College Cork
and Principal Investigator
INFANT Centre
Cork University Maternity Hospital
University College Cork
Cork, Ireland
Newton Opiyo
Editor
Cochrane Editorial Unit
Cochrane Central Executive
St Albans House
London, UK

David A Osborn
Senior Neonatologist and Director NICU
Discipline of Obstetrics,
Gynaecology and Neonatology
Central Clinical School
Sydney Medical School,
University of Sydney
Sydney, NSW Australia

Mohamed E Abdel-Latif
Professor of Neonatology and Senior Staff Specialist
Department of Neonatology, Centenary Hospital for Women and Children
ANU College of Medicine, Biology and Environment
Australian National University
Acton, Canberra, Australia

Jacqueline J Ho
Deputy Dean Academic Affairs and Head of Department
Department of Paediatrics
Penang Medical College
Convenor of Cochrane Malaysia
Penang, Malaysia

Vibhuti S Shah
Associate Professor
Department of Paediatrics and Institute of Health Policy, Management and Evaluation
University of Toronto
Staff Neonatologist, Mount Sinai Hospital
Toronto, ON Canada

Keith J Barrington
Professeur de Pédiatrie
Université de Montréal
Néonatologiste
CHU Sainte Justine
Montréal
Québec, Canada

Georg M Schmölzer
Assistant Professor
Research Neonatologist
Department of Pediatrics, Division of Neonatology
University of Alberta
Royal Alexandra Hospital
Edmonton, AB Canada

Lisa M Askie
Associate Professor
Principal Research Fellow
Director, Systematic Reviews & Health Technology Assessment
NHMRC Clinical Trials Centre
University of Sydney
Australia

James I Hagadorn
Associate Professor of Pediatrics
University of Connecticut School of Medicine
Director of Clinical Research
Division of Neonatology
Connecticut Children’s Medical Center
Hartford, CT USA


Feedback Editor

William McGuire
Professor of Child Health
Centre for Reviews and Dissemination
Hull York Medical School
University of York
York
Y010 5DD
UK
william.mcguire@hyms.ac.uk


Australasian Satellite

David A. Osborn
Senior Neonatologist and Director NICU
Central Clinical School, Discipline of Obstetrics, Gynaecology and Neonatology
University of Sydney
Sydney NSW 2050
Australia
david.osborn@email.cs.nsw.gov.au

Lisa J. Jones
Research Officer/Coordinator
Australasian Satellite of the Cochrane Neonatal Review Group
Neonatal Intensive Care Unit 
John Hunter Children's Hospital 
New Lambton NSW 2305 
Australia
lisa.jones@sydney.edu.au


Regional Coordinator Australasia

Peter Davis
Regional Coordinator Australasia
Royal Women's Hospital
132 Grattan St.
Carlton, Victoria 3053
Australia
pgd@unimelb.edu.au


Regional Coordinator United Kingdom & Europe

William McGuire
Professor of Child Health
Centre for Reviews and Dissemination
Hull York Medical School
University of York
York
Y010 5DD
UK
william.mcguire@hyms.ac.uk

The Cochrane Library can be obtained from:
John Wiley and Sons Ltd.
1 Oldlands Way
Bognor Regis
West Sussex
PO22 9SA
UK
Tel: +44 (0) 1243 843397
Fax: +44 (0) 1243 843232
Email: cs-emrw@wiley.co.uk

OR

John Wiley & Sons Inc
Subscription Department
111 River Street
Hoboken, NJ 07030
USA
Tel: Toll-free USA only: 1 866 465 3817
Tel: Outside USA: 1 201 748 6645
Fax: 1 201 784 5715
Email: emrw@wiley.com

Sources of Support for the Cochrane Neonatal Collaborative Review Group:
Eunice Kennedy Shriver National Institute of Child Health and Human Development, USA

Other Support (past):
David and Lucile Packard Foundation, USA
American Academy of Pediatrics, USA
Perinatal Clinical Epidemiology Unit, Toronto, Canada
Dept. of Pediatrics, McMaster University, Hamilton, Canada
Dept. of Clinical Epidemiology and Biostatistics, McMaster University, Hamilton, Canada

9. References

  1. Mulrow CD, Oxman AD (eds). Cochrane Collaboration Handbook [updated 21 October 1996]. Available in The Cochrane Library [database on disk and CD-ROM]. The Cochrane Collaboration; Issue 3. Oxford: Update Software; 1996. Updated quarterly. Available from: BMJ Publishing Group, London.
  2. Kirpalani H, Schmidt B, McKibbon A, Haynes B, Sinclair JC. Searching Medline for randomized clinical trials on care of the newborn. Pediatrics 85:543-546, 1988.
  3. Haynes RB, Wilczynski N, McKibbon KA, Walker CJ, Sinclair JC. Developing optimal search strategies for detecting clinically sound studies in Medline. J Amer Informatics Assoc 1994;1:447-458.

BOND National Institues of Health Home Home Division of Intramural Population Health Research