Explainable Artifacts for Synthetic Western Blot Source Attribution

Author(s)

Cardenuto, Joao P. ; Mandelli, Sara ; Moreira, Daniel ; Bestagini, Paolo ; Delp, Edward ; Rocha, Anderson

• Document type: Journal article
• Source: 2024 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY, WIFS 2024; v. N/A, p. 6-pg., 2024-01-01.

Abstract

Recent advancements in artificial intelligence have enabled generative models to produce synthetic scientific images that are indistinguishable from pristine ones, posing a challenge even for expert scientists habituated to working with such content. When exploited by organizations known as paper mills, which systematically generate fraudulent articles, these technologies can significantly contribute to the spread of misinformation about ungrounded science, potentially undermining trust in scientific research. While previous studies have explored black-box solutions, such as Convolutional Neural Networks, for identifying synthetic content, only some have addressed the challenge of generalizing across different models and providing insight into the artifacts in synthetic images that inform the detection process. This study aims to identify explainable artifacts generated by state-of-the-art generative models (e.g., Generative Adversarial Networks and Diffusion Models) and leverage them for open-set identification and source attribution (i.e., pointing to the model that created the image). (AU)

• FAPESP's process: 23/12865-8 - Horus: artificial intelligence techniques to detect and forestall synthetic realities
• Grantee: Anderson de Rezende Rocha
• Support Opportunities: Research Projects - Thematic Grants
• FAPESP's process: 20/02211-2 - Provenance filtering and analysis
• Grantee: João Phillipe Cardenuto
• Support Opportunities: Scholarships in Brazil - Doctorate (Direct)