A systematic review on the evaluation and characteristics of computer-aided diagnosis systems

Autor(es)

Vagner Mendonça Gonçalves ^[1] ; Márcio Eduardo Delamaro ^[2] ; Fátima de Lourdes dos Santos Nunes ^[3]

Afiliação do(s) autor(es)

^[1] Universidade de São Paulo - USP. Escola de Artes, Ciências e Humanidades. Laboratório de Aplicações de Informática em Saúde - Brasil

^[2] Universidade de São Paulo - USP. Instituto de Ciências Matemáticas e de Computação - Brasil

^[3] Universidade de São Paulo - USP. Escola de Artes, Ciências e Humanidades. Laboratório de Aplicações de Informática em Saúde - Brasil

• Tipo de documento: Artigo Científico
• Fonte: Rev. Bras. Eng. Bioméd.; v. 30, n. 4, p. 355-383, 2014-12-00.

Resumo

INTRODUCTION: One of the challenges in developing Computer-Aided Diagnosis (CAD) systems is their accurate and comprehensive assessment. This paper presents the conduction and results of a systematic review (SR) that aims to verify the state of the art regarding the assessment of CAD systems. This survey provides a general analysis of the current status of the design, development and assessment of such systems and includes discussions on the most used metrics and approaches that could be utilized to obtain more objective evaluation methods. METHODS: The SR was conducted using the scientific databases, ACM Digital Library, IEEE Xplore Digital Library, ScienceDirect and Web of Science. Inclusion and exclusion criteria were defined and applied to each retrieved work to select those of interest. From 156 studies retrieved, 100 studies were included. Results: There is a number of abnormalities that have been used for the development of CAD systems. Images from computed tomographies and mammographies are the most encountered types of medical images. Additionally, a number of studies used public databases for CAD evaluations. The main evaluation metrics and methods applied to CAD systems include sensitivity, accuracy, specificity and receiver operating characteristic (ROC) analyses. In the assessed CAD systems that used the segmentation method, 30.0% applied the overlap measure. DISCUSSION: There remain several topics to explore for the assessment of CAD schemes. While some evaluation metrics are traditionally used, they require a prior knowledge of case characteristics to test CAD systems. We were not able to identify articles that use software testing to evaluate CAD systems. Thus, we realize that there is a gap between CAD assessments and traditional practices of software engineering. However, the scope of this research is limited to scientific and academic works and excludes commercial interests. Finally, we discuss potential research studies within this scope to create a more objective and efficient evaluation of CAD systems. (AU)

• Processo FAPESP: 10/15691-0 - Proposição, implementação e validação de técnicas para treinamento médico virtual interativo
• Beneficiário: Fátima de Lourdes dos Santos Nunes Marques
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Processo FAPESP: 10/09806-0 - Teste e validação de software: estudos teóricos e aplicações
• Beneficiário: Márcio Eduardo Delamaro
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Processo FAPESP: 10/01496-1 - Aplicação de CBIR para avaliação de sistemas de auxílio ao diagnóstico.
• Beneficiário: Vagner Mendonça Gonçalves
• Modalidade de apoio: Bolsas no Brasil - Iniciação Científica