Digital forensics: collection, organization, classification and analysis of digital evidences

• Grant number: 10/05647-4
• Support type: Research Grants - Young Investigators Grants
• Duration: December 01, 2010 - November 30, 2014
• Field of knowledge: Physical Sciences and Mathematics - Computer Science
• Principal Investigator: Anderson de Rezende Rocha
• Grantee: Anderson de Rezende Rocha
• Home Institution: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brazil
• Associated grant(s): 14/18289-0 - 7th International Conference on similarity search and applications (SISAP'2014), AR.EXT
• Associated scholarship(s): 11/03808-3 - Digital images source attribution, BP.MS

Abstract

Digital documents (e.g., images, videos) are everywhere --- from our cell phones to the pages of our online news sites. How we choose to use digital document processing tools raises a surprising host of legal and ethical questions that we must address. Is tampering with an image appropriate in cases where the image might affect public behavior? Does an image represent a crime, or is it simply a representation of a scene that has never existed? Before police action can even be taken on the basis of a questionable document, we must detect something about the document itself. Investigators from a diverse set of fields require the best possible tools to tackle the challenges presented by the malicious use of today's digital document processing techniques. In this research project, we endeavor to investigate possible solutions to Digital Forensics problems regarding the collection, organization, classification and analysis of digital evidences. With respect to the collection and organization, we look for approaches to reduce the misuse of possible important evidences. Regarding the classification, we strive for finding digital evidences categorization solutions in order to reduce the required technical efforts when analyzing each evidence. Finally, concerning the analysis, we aim to investigate the source of the evidence as well as whether or not it is authentic. In source device identification, we seek to identify the particular model of a capturing device (e.g., scanner, camera, printer), or the exact device, that produced a document. In forgery detection, we seek to establish the authenticity of a document or to expose any potential tampering the document might has undergone. We intend to carry out the research with our co-partners at the Brazilian Federal Police as well as its counterpart in the State of São Paulo. (AU)

Scientific publications

(32)

(References retrieved automatically from Web of Science and SciELO through information on FAPESP grants and their corresponding numbers as mentioned in the publications by the authors)

MENDES JUNIOR, PEDRO R.; DE SOUZA, ROBERTO M.; WERNECK, RAFAEL DE O.; STEIN, BERNARDO V.; PAZINATO, DANIEL V.; DE ALMEIDA, WALDIR R.; PENATTI, OTAVIO A. B.; TORRES, RICARDO DA S.; ROCHA, ANDERSON. Nearest neighbors distance ratio open-set classifier. MACHINE LEARNING, v. 106, n. 3, p. 359-386, MAR 2017. Web of Science Citations: 6.

PIRES, RAMON; AVILA, SANDRA; JELINEK, HERBERT F.; WAINER, JACQUES; VALLE, EDUARDO; ROCHA, ANDERSON. Beyond Lesion-Based Diabetic Retinopathy: A Direct Approach for Referral. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, v. 21, n. 1, p. 193-200, JAN 2017. Web of Science Citations: 8.

RUPPERT, GUILHERME C. S.; CHIACHIA, GIOVANI; BERGO, FELIPE P. G.; FAVRETTO, FERNANDA O.; YASUDA, CLARISSA L.; ROCHA, ANDERSON; FALCAO, ALEXANDRE X. Medical image registration based on watershed transform from greyscale marker and multi-scale parameter search. COMPUTER METHODS IN BIOMECHANICS AND BIOMEDICAL ENGINEERING-IMAGING AND VISUALIZATION, v. 5, n. 2, p. 138-156, 2017. Web of Science Citations: 2.

FARIA, FABIO A.; ALMEIDA, JURANDY; ALBERTON, BRUNA; MORELLATO, LEONOR PATRICIA C.; ROCHA, ANDERSON; TORRES, RICARDO DA S. Time series-based classifier fusion for fine-grained plant species recognition. PATTERN RECOGNITION LETTERS, v. 81, n. SI, p. 101-109, OCT 1 2016. Web of Science Citations: 5.

MORAES, DANIEL; WAINER, JACQUES; ROCHA, ANDERSON. Low false positive learning with support vector machines. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, v. 38, p. 340-350, JUL 2016. Web of Science Citations: 2.

CARVALHO, TIAGO; FARIA, FABIO A.; PEDRINI, HELIO; TORRES, RICARDO DA S.; ROCHA, ANDERSON. Illuminant-Based Transformed Spaces for Image Forensics. IEEE Transactions on Information Forensics and Security, v. 11, n. 4, p. 720-733, APR 2016. Web of Science Citations: 13.

DE OLIVEIRA, ALBERTO A.; FERRARA, PASQUALE; DE ROSA, ALESSIA; PIVA, ALESSANDRO; BARNI, MAURO; GOLDENSTEIN, SIOME; DIAS, ZANONI; ROCHA, ANDERSON. Multiple Parenting Phylogeny Relationships in Digital Images. IEEE Transactions on Information Forensics and Security, v. 11, n. 2, p. 328-343, FEB 2016. Web of Science Citations: 13.

PINTO, ALLAN; PEDRINI, HELIO; SCHWARTZ, WILLIAM ROBSON; ROCHA, ANDERSON. Face Spoofing Detection Through Visual Codebooks of Spectral Temporal Cubes. IEEE Transactions on Image Processing, v. 24, n. 12, p. 4726-4740, DEC 2015. Web of Science Citations: 41.

PIRES, RAMON; CARVALHO, TIAGO; SPURLING, GEOFFREY; GOLDENSTEIN, SIOME; WAINER, JACQUES; LUCKIE, ALAN; JELINEK, HERBERT F.; ROCHA, ANDERSON. Automated Multi-Lesion Detection for Referable Diabetic Retinopathy in Indigenous Health Care. PLoS One, v. 10, n. 6 JUN 2 2015. Web of Science Citations: 3.

PINTO, ALLAN; SCHWARTZ, WILLIAM ROBSON; PEDRINI, HELIO; ROCHA, ANDERSON DE REZENDE. Using Visual Rhythms for Detecting Video-Based Facial Spoof Attacks. IEEE Transactions on Information Forensics and Security, v. 10, n. 5, p. 1025-1038, MAY 2015. Web of Science Citations: 29.

SILVA, EWERTON; CARVALHO, TIAGO; FERREIRA, ANSELMO; ROCHA, ANDERSON. Going deeper into copy-move forgery detection: Exploring image telltales via multi-scale analysis and voting processes. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, v. 29, p. 16-32, MAY 2015. Web of Science Citations: 59.

MENOTTI, DAVID; CHIACHIA, GIOVANI; PINTO, ALLAN; SCHWARTZ, WILLIAM ROBSON; PEDRINI, HELIO; FALCAO, ALEXANDRE XAVIER; ROCHA, ANDERSON. Deep Representations for Iris, Face, and Fingerprint Spoofing Detection. IEEE Transactions on Information Forensics and Security, v. 10, n. 4, p. 864-879, APR 2015. Web of Science Citations: 148.

FERREIRA, ANSELMO; NAVARRO, LUIZ C.; PINHEIRO, GIULIANO; DOS SANTOS, JEFERSSON A.; ROCHA, ANDERSON. Laser printer attribution: Exploring new features and beyond. Forensic Science International, v. 247, p. 105-125, FEB 2015. Web of Science Citations: 20.

CHIACHIA, GIOVANI; FALCAO, ALEXANDRE X.; PINTO, NICOLAS; ROCHA, ANDERSON; COX, DAVID. Learning Person-Specific Representations From Faces in the Wild. IEEE Transactions on Information Forensics and Security, v. 9, n. 12, p. 2089-2099, DEC 2014. Web of Science Citations: 20.

COSTA, FILIPE DE O.; OIKAWA, MARINA A.; DIAS, ZANONI; GOLDENSTEIN, SIOME; ROCHA, ANDERSON DE REZENDE. Image Phylogeny Forests Reconstruction. IEEE Transactions on Information Forensics and Security, v. 9, n. 10, p. 1533-1546, OCT 2014. Web of Science Citations: 21.

FARIA, F. A.; PERRE, P.; ZUCCHI, R. A.; JORGE, L. R.; LEWINSOHN, T. M.; ROCHA, A.; TORRES, R. DA S. Automatic identification of fruit flies (Diptera: Tephritidae). JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, v. 25, n. 7, p. 1516-1527, OCT 2014. Web of Science Citations: 16.

PIRES, RAMON; JELINEK, HERBERT F.; WAINER, JACQUES; VALLE, EDUARDO; ROCHA, ANDERSON. Advancing Bag-of-Visual-Words Representations for Lesion Classification in Retinal Images. PLoS One, v. 9, n. 6 JUN 2 2014. Web of Science Citations: 29.

COSTA, FILIPE DE O.; SILVA, EWERTON; ECKMANN, MICHAEL; SCHEIRER, WALTER J.; ROCHA, ANDERSON. Open set source camera attribution and device linking. PATTERN RECOGNITION LETTERS, v. 39, n. SI, p. 92-101, APR 1 2014. Web of Science Citations: 27.

FABIAN, JUNIOR; PIRES, RAMON; ROCHA, ANDERSON. Visual words dictionaries and fusion techniques for searching people through textual and visual attributes. PATTERN RECOGNITION LETTERS, v. 39, n. SI, p. 74-84, APR 1 2014. Web of Science Citations: 2.

FARIA, FABIO A.; DOS SANTOS, JEFERSSON A.; ROCHA, ANDERSON; TORRES, RICARDO DA S. A framework for selection and fusion of pattern classifiers in multimedia recognition. PATTERN RECOGNITION LETTERS, v. 39, n. SI, p. 52-64, APR 1 2014. Web of Science Citations: 26.

MORAIS, ERIKSON; FERREIRA, ANESLMO; CUNHA, SERGIO AUGUSTO; BARROS, RICARDO M. L.; ROCHA, ANDERSON; GOLDENSTEIN, SIOME. A multiple camera methodology for automatic localization and tracking of futsal players. PATTERN RECOGNITION LETTERS, v. 39, n. SI, p. 21-30, APR 1 2014. Web of Science Citations: 12.

FARIA, FABIO A.; PEDRONETTE, DANIEL C. G.; DOS SANTOS, JEFERSSON A.; ROCHA, ANDERSON; TORRES, RICARDO DA S. Rank Aggregation for Pattern Classifier Selection in Remote Sensing Images. IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, v. 7, n. 4, p. 1103-1115, APR 2014. Web of Science Citations: 9.

ROCHA, ANDERSON; GOLDENSTEIN, SIOME KLEIN. Multiclass from Binary: Expanding One-Versus-All, One-Versus-One and ECOC-Based Approaches. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, v. 25, n. 2, p. 289-302, FEB 2014. Web of Science Citations: 56.

PIRES, RAMON; JELINEK, HERBERT F.; WAINER, JACQUES; GOLDENSTEIN, SIOME; VALLE, EDUARDO; ROCHA, ANDERSON. Assessing the Need for Referral in Automatic Diabetic Retinopathy Detection. IEEE Transactions on Biomedical Engineering, v. 60, n. 12, p. 3391-3398, DEC 2013. Web of Science Citations: 23.

TOKUDA, ERIC; PEDRINI, HELIO; ROCHA, ANDERSON. Computer generated images vs. digital photographs: A synergetic feature and classifier combination approach. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, v. 24, n. 8, p. 1276-1292, NOV 2013. Web of Science Citations: 12.

DIAS, ZANONI; GOLDENSTEIN, SIOME; ROCHA, ANDERSON. Exploring heuristic and optimum branching algorithms for image phylogeny. JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, v. 24, n. 7, p. 1124-1134, OCT 2013. Web of Science Citations: 20.

DIAS, ZANONI; GOLDENSTEIN, SIOME; ROCHA, ANDERSON. Large-Scale Image Phylogeny: Tracing Image Ancestral Relationships. IEEE MULTIMEDIA, v. 20, n. 3, p. 58-70, JUL-SEP 2013. Web of Science Citations: 20.

SCHEIRER, WALTER J.; ROCHA, ANDERSON DE REZENDE; SAPKOTA, ARCHANA; BOULT, TERRANCE E. Toward Open Set Recognition. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, v. 35, n. 7, p. 1757-1772, JUL 2013. Web of Science Citations: 109.

SCHEIRER, WALTER J.; ROCHA, ANDERSON DE REZENDE; PARRIS, JONATHAN; BOULT, TERRANCE E. Learning for Meta-Recognition. IEEE Transactions on Information Forensics and Security, v. 7, n. 4, p. 1214-1224, AUG 2012. Web of Science Citations: 7.

ROCHA, ANDERSON; PAPA, JOAO PAULO; MEIRA, LUIS A. A. HOW FAR DO WE GET USING MACHINE LEARNING BLACK-BOXES?. INTERNATIONAL JOURNAL OF PATTERN RECOGNITION AND ARTIFICIAL INTELLIGENCE, v. 26, n. 2 MAR 2012. Web of Science Citations: 6.

ROCHA, ANDERSON; SCHEIRER, WALTER; BOULT, TERRANCE; GOLDENSTEIN, SIOME. Vision of the Unseen: Current Trends and Challenges in Digital Image and Video Forensics. ACM COMPUTING SURVEYS, v. 43, n. 4 OCT 2011. Web of Science Citations: 104.

SCHEIRER, WALTER J.; ROCHA, ANDERSON; MICHEALS, ROSS J.; BOULT, TERRANCE E. Meta-Recognition: The Theory and Practice of Recognition Score Analysis. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, v. 33, n. 8, p. 1689-1695, AUG 2011. Web of Science Citations: 46.