Reliability of evidence-review methods in restoration ecology

Autor(es)

Romanelli, Joao P. ^[1] ; Meli, Paula ^[2] ; Naves, Rafaela P. ^[3] ; Alves, Marcelo C. ^[4] ; Rodrigues, Ricardo R. ^[1]

Afiliação do(s) autor(es)

^[1] Univ Sao Paulo, Luiz de Queiroz Coll Agr, Lab Ecol & Forest Restorat LERF, Av Padua Dias 11, BR-13418900 Piracicaba, SP - Brazil

^[2] Univ La Frontera, Dept Ciencias Forest, Lab Ecol Paisaje & Conservac, Temuco 4811230 - Chile

^[3] Univ Sao Paulo, Dept Forest Sci, Luiz de Queiroz Coll Agr, Av Padua Dias 11, BR-13418900 Piracicaba, SP - Brazil

^[4] Univ Sao Paulo, Informat Tech Sect, Luiz de Queiroz Coll Agr, Av Padua Dias 11, BR-13418900 Piracicaba, SP - Brazil

• Tipo de documento: Artigo de Revisão
• Fonte: Conservation Biology; v. 35, n. 1 DEC 2020.
• Citações Web of Science: 1

Resumo

In restoration science, evidence reviews play a crucial role in summarizing research findings in practice and policy. However, if unreliable or inappropriate methods are used to review evidence, decisions based on these reviews may not accurately reflect the available evidence base. To assess the current value of restoration reviews, we examined a sample of meta-analyses and narrative syntheses (n = 91) with the Collaboration for Environmental Evidence Synthesis Assessment Tool (CEESAT), which uses detailed criteria to assesses the method of policy-relevant evidence synthesis according to elements important for objectivity, transparency, and comprehensiveness. Overall, reviews scored low based on this standard: median score 16 out of 39, modal score 15, and mean 16.6. Meta-analyses scored higher than narrative syntheses (median 17 vs. 5, respectively), although there were some outlier narrative syntheses that had high scores, suggesting that quantitative synthesis does not solely reflect the reliability of a review. In general, criteria spanning the more fundamental review stages (i.e., searching for studies and including studies) received low scores for both synthesis types. Conversely, criteria comprising the later stages of the review (i.e., critical appraisal, data extraction, and data synthesis) were generally well described in meta-analyses; thus, these criteria achieved the highest individual CEESAT scores. We argue that restoration ecology is well positioned to advance so-called evidence-based restoration, but review authors should elucidate their conceptual understanding of evidence syntheses and recognize that conducting reliable reviews demands the same methodological rigor and reporting standards used in primary research. Given the potential of evidence reviews to inform management, policy, and research, it is of vital importance that the overall methodological reliability of restoration reviews be improved. (AU)

• Processo FAPESP: 13/50718-5 - Restauração ecológica de florestas ciliares, de florestas nativas de produção econômica e de fragmentos florestais degradados (em APP e RL), com base na ecologia de restauração de ecossistemas de referência, visando testar cientificamente os preceitos do Novo Código Florestal Brasileiro
• Beneficiário: Ricardo Ribeiro Rodrigues
• Modalidade de apoio: Auxílio à Pesquisa - Programa BIOTA - Temático
• Processo FAPESP: 19/08533-4 - Compreendendo os aspectos ecológicos e sociais das ações de restauração em regiões tropicais através de revisões sistemáticas e metanálises
• Beneficiário: João Paulo Romanelli
• Modalidade de apoio: Bolsas no Brasil - Pós-Doutorado
• Processo FAPESP: 18/18416-2 - Compreendendo florestas restauradas para o benefício das pessoas e da natureza - NewFor
• Beneficiário: Pedro Henrique Santin Brancalion
• Modalidade de apoio: Auxílio à Pesquisa - Programa BIOTA - Temático