To Answer or Not to Answer? Filtering Questions for QA Systems

Autor(es)

Pirozelli, Paulo ; Brandao, Anarosa A. F. ; Peres, Sarajane M. ; Cozman, Fabio G. ; Xavier-Junior, JC ; Rios, RA

• Tipo de documento: Artigo Científico
• Fonte: INTELLIGENT SYSTEMS, PT II; v. 13654, p. 15-pg., 2022-01-01.

Resumo

Question answering (QA) systems are usually structured as strict conditional generators, which return an answer for every input question. Sometimes, however, the policy of always responding to questions may prove itself harmful, given the possibility of giving inaccurate answers, particularly for ambiguous or sensitive questions; instead, it may be better for a QA system to decide which questions should be answered or not. In this paper, we explore dual system architectures that filter unanswerable or meaningless questions, thus answering only a subset of the questions raised. Two experiments are performed in order to evaluate this modular approach: a classification on SQuAD 2.0 for unanswerable questions, and a regression on Pir ' a for question meaningfulness. Despite the difficulties involved in the tasks, we show that filtering questions may contribute to improve the quality of the answers generated by QA systems. By using classification and regression models to filter questions, we can get better control over the accuracy of the answers produced by the answerer systems. (AU)

• Processo FAPESP: 19/07665-4 - Centro de Inteligência Artificial
• Beneficiário: Fabio Gagliardi Cozman
• Modalidade de apoio: Auxílio à Pesquisa - Programa eScience e Data Science - Centros de Pesquisa em Engenharia