Advanced search
Start date
Betweenand
Related content
(Reference retrieved automatically from Web of Science through information on FAPESP grant and its corresponding number as mentioned in the publication by the authors.)

Reliability of evidence-review methods in restoration ecology

Full text
Author(s):
Romanelli, Joao P. [1] ; Meli, Paula [2] ; Naves, Rafaela P. [3] ; Alves, Marcelo C. [4] ; Rodrigues, Ricardo R. [1]
Total Authors: 5
Affiliation:
[1] Univ Sao Paulo, Luiz de Queiroz Coll Agr, Lab Ecol & Forest Restorat LERF, Av Padua Dias 11, BR-13418900 Piracicaba, SP - Brazil
[2] Univ La Frontera, Dept Ciencias Forest, Lab Ecol Paisaje & Conservac, Temuco 4811230 - Chile
[3] Univ Sao Paulo, Dept Forest Sci, Luiz de Queiroz Coll Agr, Av Padua Dias 11, BR-13418900 Piracicaba, SP - Brazil
[4] Univ Sao Paulo, Informat Tech Sect, Luiz de Queiroz Coll Agr, Av Padua Dias 11, BR-13418900 Piracicaba, SP - Brazil
Total Affiliations: 4
Document type: Review article
Source: Conservation Biology; v. 35, n. 1 DEC 2020.
Web of Science Citations: 1
Abstract

In restoration science, evidence reviews play a crucial role in summarizing research findings in practice and policy. However, if unreliable or inappropriate methods are used to review evidence, decisions based on these reviews may not accurately reflect the available evidence base. To assess the current value of restoration reviews, we examined a sample of meta-analyses and narrative syntheses (n = 91) with the Collaboration for Environmental Evidence Synthesis Assessment Tool (CEESAT), which uses detailed criteria to assesses the method of policy-relevant evidence synthesis according to elements important for objectivity, transparency, and comprehensiveness. Overall, reviews scored low based on this standard: median score 16 out of 39, modal score 15, and mean 16.6. Meta-analyses scored higher than narrative syntheses (median 17 vs. 5, respectively), although there were some outlier narrative syntheses that had high scores, suggesting that quantitative synthesis does not solely reflect the reliability of a review. In general, criteria spanning the more fundamental review stages (i.e., searching for studies and including studies) received low scores for both synthesis types. Conversely, criteria comprising the later stages of the review (i.e., critical appraisal, data extraction, and data synthesis) were generally well described in meta-analyses; thus, these criteria achieved the highest individual CEESAT scores. We argue that restoration ecology is well positioned to advance so-called evidence-based restoration, but review authors should elucidate their conceptual understanding of evidence syntheses and recognize that conducting reliable reviews demands the same methodological rigor and reporting standards used in primary research. Given the potential of evidence reviews to inform management, policy, and research, it is of vital importance that the overall methodological reliability of restoration reviews be improved. (AU)

FAPESP's process: 13/50718-5 - Ecological restoration of riparian forests, native forest of economic production and of degraded forest fragments (in APP and RL) based on restoration ecology of reference ecosystems in order to scientifically test the precepts of the New Brazilian Forest Code
Grantee:Ricardo Ribeiro Rodrigues
Support Opportunities: BIOTA-FAPESP Program - Thematic Grants
FAPESP's process: 19/08533-4 - Understanding ecological and social aspects of restoration actions in tropical regions through systematic reviews and meta-analyses
Grantee:João Paulo Romanelli
Support Opportunities: Scholarships in Brazil - Post-Doctoral
FAPESP's process: 18/18416-2 - Understanding restored forests for benefiting people and nature - NewFor
Grantee:Pedro Henrique Santin Brancalion
Support Opportunities: BIOTA-FAPESP Program - Thematic Grants