| Full text | |
| Author(s): |
Pinheiro, Gabriel A.
;
Silva, Juarez L. F.
;
Quiles, Marcos G.
Total Authors: 3
|
| Document type: | Journal article |
| Source: | JOURNAL OF CHEMICAL INFORMATION AND MODELING; v. 62, n. 17, p. 13-pg., 2022-09-12. |
| Abstract | |
Machine learning as a tool for chemical space exploration broadens horizons to work with known and unknown molecules. At its core lies molecular representation, an essential key to improve learning about structure-property relationships. Recently, contrastive frameworks have been showing impressive results for representation learning in diverse domains. Therefore, this paper proposes a contrastive framework that embraces multimodal molecular data. Specifically, our approach jointly trains a graph encoder and an encoder for the simplified molecular-input line-entry system (SMILES) string to perform the contrastive learning objective. Since SMILES is the basis of our method, i.e., we built the molecular graph from the SMILES, we call our framework as SMILES Contrastive Learning (SMICLR). When stacking a nonlinear regressor on the SMICLR's pretrained encoder and fine-tuning the entire model, we reduced the prediction error by, on average, 44% and 25% for the energetic and electronic properties of the QM9 data set, respectively, over the supervised baseline. We further improved our framework's performance when applying data augmentations in each molecular-input representation. Moreover, SMICLR demonstrated competitive representation learning results in an unsupervised setting. (AU) | |
| FAPESP's process: | 18/21401-7 - Multi-User Equipment approved in grant 2017/11631-2: cluster computational de alto desempenho - ENIAC |
| Grantee: | Juarez Lopes Ferreira da Silva |
| Support Opportunities: | Multi-user Equipment Program |
| FAPESP's process: | 17/11631-2 - CINE: computational materials design based on atomistic simulations, meso-scale, multi-physics, and artificial intelligence for energy applications |
| Grantee: | Juarez Lopes Ferreira da Silva |
| Support Opportunities: | Research Grants - Research Centers in Engineering Program |
| FAPESP's process: | 21/08852-2 - Molecular property prediction with high accuracy: a semi-supervised learning approach |
| Grantee: | Gabriel Augusto Lins Leal Pinheiro |
| Support Opportunities: | Scholarships in Brazil - Doctorate |