Advanced search
Start date
Betweenand


Quantum neural networks successfully calibrate language models

Full text
Author(s):
Suda Neto, Jogi ; Ardila, Lluis Quiles ; Nogueira, Thiago Nascimento ; Albuquerque, Felipe ; Papa, Joao Paulo ; Guido, Rodrigo Capobianco ; Fanchini, Felipe Fernandes
Total Authors: 7
Document type: Journal article
Source: QUANTUM MACHINE INTELLIGENCE; v. 6, n. 1, p. 9-pg., 2024-06-01.
Abstract

Recently, quantum neural networks have been applied to different problems, like in computer vision and natural language processing. In this paper, we show an application of quantum models as probability calibrators to language models in Question and Answering (Q &A) tests. Our experiments show comparable results relative to the baseline Q &A models on all metrics. Here, we show another application of this class of models as confidence calibrators, where the parametrized quantum circuit receives a set of features coming from the language model and has to output a corrected confidence measure. The idea is to have a quantum model tell us when the language model is generating good answers or not. (AU)

FAPESP's process: 21/12407-4 - Improving biometric voice authentication systems: robustness in facing short-term dysphonies
Grantee:Rodrigo Capobianco Guido
Support Opportunities: Regular Research Grants
FAPESP's process: 19/18287-0 - Real-time Urban Forest Management Using Machine Learning
Grantee:Danilo Samuel Jodas
Support Opportunities: Scholarships in Brazil - Post-Doctoral
FAPESP's process: 14/12236-1 - AnImaLS: Annotation of Images in Large Scale: what can machines and specialists learn from interaction?
Grantee:Alexandre Xavier Falcão
Support Opportunities: Research Projects - Thematic Grants
FAPESP's process: 21/04655-8 - Machine learning and its applications in quantum physics: metrology, thermology, phase transitions and dynamical decoupling
Grantee:Felipe Fernandes Fanchini
Support Opportunities: Regular Research Grants
FAPESP's process: 19/07665-4 - Center for Artificial Intelligence
Grantee:Fabio Gagliardi Cozman
Support Opportunities: Research Grants - Research Program in eScience and Data Science - Research Centers in Engineering Program
FAPESP's process: 23/04987-6 - Quantum optimization and machine learning: variational algorithms and applications
Grantee:Felipe Fernandes Fanchini
Support Opportunities: Regular Research Grants
FAPESP's process: 13/07375-0 - CeMEAI - Center for Mathematical Sciences Applied to Industry
Grantee:Francisco Louzada Neto
Support Opportunities: Research Grants - Research, Innovation and Dissemination Centers - RIDC