| Texto completo | |
| Autor(es): |
Moraes, Leonardo Mauro Pereira
;
Jardim, Pedro Calciolari
;
Aguiar, Cristina Dutra
Número total de Autores: 3
|
| Tipo de documento: | Artigo Científico |
| Fonte: | ENTERPRISE INFORMATION SYSTEMS, ICEIS 2023, PT I; v. 518, p. 24-pg., 2024-01-01. |
| Resumo | |
Querying massive and heterogeneous text data is challenging, transcending different business domains. Our study outlines the BigQA architecture, which is specifically designed to support text data queries on Big Data systems using natural language. The architectural design comprises several layers that are intentionally built to be independent of the programming language, technology, and querying algorithm utilized. Nevertheless, the implementation of this architecture remains unclear. In this study, we showcase the versatility and adaptability of BigQA by offering a comprehensive set of guidelines and three practical implementation pipelines. In addition, we performed 60 experiments on four different datasets and compared the recall results of three popular algorithms: BM25, TF-IDF, and DPR. Based on our experiments, BM25 had the best overall performance as a document query algorithm. (AU) | |
| Processo FAPESP: | 18/22277-8 - Processamento de Consultas OLAP e SOLAP em Ambientes Computacionais Paralelos e Distribuídos |
| Beneficiário: | Cristina Dutra de Aguiar |
| Modalidade de apoio: | Auxílio à Pesquisa - Regular |
| Processo FAPESP: | 23/08293-9 - Investigação de Algoritmos de Perguntas e Respostas na Arquitetura de Referência de Software BigQA |
| Beneficiário: | Pedro Calciolari Jardim |
| Modalidade de apoio: | Bolsas no Brasil - Iniciação Científica |