Agreement between ChatGPT and Cochrane systematic reviews on the effects of interventions in surgical emergencies and trauma.

• Grant number: 23/13641-6
• Support Opportunities: Scholarships in Brazil - Scientific Initiation
• Start date: April 01, 2024
• End date: March 31, 2025
• Field of knowledge: Health Sciences - Medicine - Surgery
• Principal Investigator: Diego Adão Fanti Silva
• Grantee: Carolina Rodrigues Novais
• Host Institution: Escola Paulista de Medicina (EPM). Universidade Federal de São Paulo (UNIFESP). Campus São Paulo. São Paulo , SP, Brazil

Abstract

The aim of this study is to assess the agreement between ChatGPT responses and the effect of primary outcomes from Cochrane systematic reviews for surgical emergencies and trauma interventions. It is a descriptive cross-sectional and meta-epidemiological study. ChatGPT responses will be compared to Cochrane reviews for primary outcomes. The ChatGPT website search will be conducted using semi-structured questions. Cochrane reviews will be searched within the "Injuries" and "Emergency and Critical Care" groups, with intervention reviews manually selected from the period of 2019 to 2023.Currently, there is a rapid expansion in the use of this artificial intelligence to answer healthcare-related questions, including during clinical practice. Furthermore, ChatGPT's research base consists of scientific and grey literature, with an unknown search algorithm. In this uncertain scenario, there are no studies evaluating the reliability of the provided answers. Thus, this study is necessary.