Análise de mídias sensíveis usando arquiteturas de aprendizado profundo

• Processo: 17/16246-0
• Modalidade de apoio: Auxílio à Pesquisa - Regular
• Vigência: 01 de maio de 2018 - 30 de abril de 2020
• Área do conhecimento: Ciências Exatas e da Terra - Ciência da Computação - Metodologia e Técnicas da Computação
• Pesquisador responsável: Sandra Eliza Fontes de Avila
• Beneficiário: Sandra Eliza Fontes de Avila
• Instituição Sede: Instituto de Computação (IC). Universidade Estadual de Campinas (UNICAMP). Campinas , SP, Brasil
• Pesquisadores associados: Anderson de Rezende Rocha ; Virgínia Nunes Leal Franqueira ; Zanoni Dias
• Assunto(s): Redes neurais (computação) Redes neurais convolucionais Aprendizado computacional Aprendizagem profunda Visão computacional Computação forense Pornografia Violência
• Palavra(s)-Chave do Pesquisador: Convolutional Neural Networks | Deep Learning | Fisher Vector | Temporal Information | Video Pornography Detection | Violent Scenes Detection | Aprendizado de Máquina, Computação Forense

Resumo

Com o crescimento de vídeos gerados a partir de diversos dispositivos, tais como câmeras, smartphones e CCTVs, aliado com a Internet como meio de rápida propagação, a filtragem de conteúdo de forma inteligente e contínua tornou-se primordial. Neste contexto, a classificação do conteúdo sensível (e.g., pornografia, violência) tem atraído uma quantidade considerável de atenção devido as suas aplicações: detectar comportamento suspeito, por meio de câmeras de vigilância; bloquear conteúdo impróprio ou indesejável que possa ser enviado para redes de propósito geral (e.g., redes sociais, plataformas de aprendizado online, fóruns), ou que possa ser visto em determinados ambientes (e.g., escolas e locais de trabalho); impedir que crianças tenham acesso ao conteúdo adulto nos computadores pessoais, smartphones, smart TVs; e evitar que conteúdo impróprio seja compartilhado por meio de telefones (e.g., sexting). Este projeto tem como objetivo a pesquisa, o desenvolvimento e a implementação de soluções voltadas à detecção de conteúdo sensível em imagens/vídeos digitais, tal como violência, pornografia e conteúdo adulto. Esta pesquisa promoverá o avanço do estado da arte por meio da investigação das arquiteturas de redes profundas, da proposição de novas técnicas de aprendizado profundo eficientes e eficazes, e através da incorporação de soluções móveis para análise de mídias sensíveis. Especificamente, concentraremos nossos esforços em dois aspectos: (1) desenvolver novas técnicas de aprendizado profundo para a extração automática de características espaço-temporais discriminativas; e (2) conceber novas abordagens para lidar com o conteúdo sensível que incorporam as vantagens das representações robustas de nível médio, tais como Fisher Vectors, e o poder de caracterização das técnicas de aprendizado profundo. Ressaltamos que nosso grupo tem se destacado no mundo científico, sendo responsável por resultados pioneiros associados às áreas de computação forense, aprendizado de máquina e visão computacional. (AU)

Publicações científicas

(45)

(Referências obtidas automaticamente do Web of Science e do SciELO, por meio da informação sobre o financiamento pela FAPESP e o número do processo correspondente, incluída na publicação pelos autores)

MIRANDA, GUILHERME HENRIQUE SANTOS; ALEXANDRINO, ALEXSANDRO OLIVEIRA; LINTZMAYER, CARLA NEGRI; DIAS, ZANONI. Approximation Algorithms for Sorting lambda-Permutations by lambda-Operations. ALGORITHMS, v. 14, n. 6, JUN 2021. (13/08293-7, 15/11937-9, 17/16871-1, 17/12646-3, 17/16246-0)

ALEXANDRINO, ALEXSANDRO OLIVEIRA; MIRANDA, GUILHERME HENRIQUE SANTOS; LINTZMAYER, CARLA NEGRI; DIAS, ZANONI. Length-weighted lambda-rearrangement distance. JOURNAL OF COMBINATORIAL OPTIMIZATION, v. 41, n. 3, p. 579-602, APR 2021. (17/16246-0, 15/11937-9, 17/12646-3)

BRITO, KLAIRTON LIMA; JEAN, GERALDINE; FERTIN, GUILLAUME; OLIVEIRA, ANDRE RODRIGUES; DIAS, ULISSES; DIAS, ZANONI. Sorting by Genome Rearrangements on Both Gene Order and Intergenic Sizes. JOURNAL OF COMPUTATIONAL BIOLOGY, v. 27, n. 2, DEC 2019. (17/12646-3, 17/16246-0, 15/11937-9)

SANTOS MIRANDA, GUILHERME HENRIQUE; ALEXANDRINO, ALEXSANDRO OLIVEIRA; LINTZMAYER, CARLA NEGRI; DIAS, ZANONI; ALVES, R. Sorting lambda-Permutations by lambda-Operations. ADVANCES IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, BSB 2018, v. 11228, p. 13-pg., 2018-01-01. (17/12646-3, 15/11937-9, 13/08293-7, 17/16246-0, 17/16871-1)

ALEXANDRINO, ALEXSANDRO OLIVEIRA; SANTOS MIRANDA, GUILHERME HENRIQUE; LINTZMAYER, CARLA NEGRI; DIAS, ZANONI. Approximation Algorithms for Sorting Permutations by Length-Weighted Short Rearrangements. ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, v. 346, p. 12-pg., 2019-08-30. (17/12646-3, 15/11937-9, 13/08293-7, 17/16246-0, 17/16871-1)

BRITO, KLAIRTON LIMA; JEAN, GERALDINE; FERTIN, GUILLAUME; OLIVEIRA, ANDRE RODRIGUES; DIAS, ULISSES; DIAS, ZANONI; CAI, Z; SKUMS, P; LI, M. Sorting by Reversals, Transpositions, and Indels on Both Gene Order and Intergenic Sizes. BIOINFORMATICS RESEARCH AND APPLICATIONS, ISBRA 2019, v. 11490, p. 12-pg., 2019-01-01. (13/08293-7, 17/16246-0, 17/12646-3, 15/11937-9)

OLIVEIRA, ANDRE RODRIGUES; JEAN, GERALDINE; FERTIN, GUILLAUME; BRITO, KLAIRTON LIMA; BULTEAU, LAURENT; DIAS, ULISSES; DIAS, ZANONI. Sorting Signed Permutations by Intergenic Reversals. IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, v. 18, n. 6, p. 2870-2876, NOV 1 2021. (13/08293-7, 19/27331-3, 17/16246-0, 17/12646-3)

VARGAS MUNOZ, JAVIER A.; DIAS, ZANONI; TORRES, RICARDO DA SILVA. A genetic programming approach for searching on nearest neighbors graphs. MULTIMEDIA TOOLS AND APPLICATIONS, v. 81, n. 16, p. 24-pg., 2022-03-18. (14/12236-1, 17/20945-0, 13/50155-0, 13/50169-1, 17/12646-3, 15/11937-9, 16/50250-1, 15/24494-8, 17/16246-0, 14/50715-9)

BISSOTO, ALCEU; FORNACIALI, MICHEL; VALLE, EDUARDO; AVILA, SANDRA; IEEE. (De)Constructing Bias on Skin Lesion Datasets. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), v. N/A, p. 9-pg., 2019-01-01. (17/16246-0)

ISHIKAWA, AKARI; BOLLIS, EDSON; AVILA, SANDRA; IEEE. Combating the Elsagate Phenomenon: Deep Learning Architectures for Disturbing Cartoons. 2019 7TH INTERNATIONAL WORKSHOP ON BIOMETRICS AND FORENSICS (IWBF), v. N/A, p. 6-pg., 2019-01-01. (17/16246-0)

RODRIGUES, CAROLINE MAZINI; SORIANO-VARGAS, AUREA; LAVI, BAHRAM; ROCHA, ANDERSON; DIAS, ZANONI. Manifold Learning for Real-World Event Understanding. IEEE Transactions on Information Forensics and Security, v. 16, p. 2957-2972, 2021. (18/16548-9, 18/16214-3, 17/16246-0, 15/11937-9, 18/05668-3, 13/08293-7, 17/12646-3, 17/16871-1)

RIBEIRO, VINICIUS; AVILA, SANDRA; VALLE, EDUARDO; IEEE COMP SOC. Less is More: Sample Selection and Label Conditioning Improve Skin Lesion Segmentation. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), v. N/A, p. 10-pg., 2020-01-01. (17/16246-0, 19/05018-1)

PEREZ, FABIO; AVILA, SANDRA; VALLE, EDUARDO; IEEE. Solo or Ensemble? Choosing a CNN Architecture for Melanoma Classification. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2019), v. N/A, p. 9-pg., 2019-01-01. (17/16246-0)

DE OLIVEIRA, GABRIEL BIANCHIN; PEDRINI, HELIO; DIAS, ZANONI; IEEE. Fusion of BLAST and Ensemble of Classifiers for Protein Secondary Structure Prediction. 2020 33RD SIBGRAPI CONFERENCE ON GRAPHICS, PATTERNS AND IMAGES (SIBGRAPI 2020), v. N/A, p. 8-pg., 2020-01-01. (17/12646-3, 19/20875-8, 15/11937-9, 17/16246-0)

DE OLIVEIRA, GABRIEL BIANCHIN; PEDRINI, HELIO; DIAS, ZANONI; XAVIER-JUNIOR, JC; RIOS, RA. Protein Molecular Function Annotation Based on Transformer Embeddings. INTELLIGENT SYSTEMS, PT II, v. 13654, p. 11-pg., 2022-01-01. (17/12646-3, 19/20875-8, 15/11937-9, 17/16246-0)

DANTAS, ANA PAULA S.; DE SOUZA, CID C.; DIAS, ZANONI. A heuristic for the convex recoloring problem in graphs. International Transactions in Operational Research, v. 29, n. 3, p. 1454-1478, MAY 2022. (17/16246-0, 17/12646-3, 15/11937-9, 18/04760-3)

TEIXEIRA, VINICIUS; BRAZ, LEODECIO; PEDRINI, HELIO; DIAS, ZANONI; PAIVA, AC; CONCI, A; BRAZ, G; ALMEIDA, JDS; FERNANDES, LAF. DuaLAnet: Dual Lesion Attention Network for Thoracic Disease Classification in Chest X-Rays. PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON SYSTEMS, SIGNALS AND IMAGE PROCESSING (IWSSIP), 27TH EDITION, v. N/A, p. 6-pg., 2020-01-01. (17/16246-0, 19/20875-8, 17/12646-3, 15/11937-9)

DANTAS, ANA PAULA S.; DE SOUZA, CID C.; DIAS, ZANONI. A heuristic for the convex recoloring problem in graphs. International Transactions in Operational Research, NOV 2020. (15/11937-9, 17/12646-3, 18/04760-3, 17/16246-0)

VALLE, EDUARDO; FORNACIALI, MICHEL; MENEGOLA, AFONSO; TAVARES, JULIA; BITTENCOURT, FLAVIA VASQUES; LI, LIN TZY; AVILA, SANDRA. Data, depth, and design: Learning reliable models for skin lesion analysis. Neurocomputing, v. 383, p. 303-313, MAR 28 2020. (19/05018-1, 17/16246-0)

ALEXANDRINO, ALEXSANDRO OLIVEIRA; LINTZMAYER, CARLA NEGRI; DIAS, ZANONI. Sorting permutations by fragmentation-weighted operations. JOURNAL OF BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, v. 18, n. 2, APR 2020. (17/12646-3, 17/16871-1, 17/16246-0, 15/11937-9)

SANTOS, THIAGO T.; DE SOUZA, LEONARDO L.; DOS SANTOS, ANDREZA A.; AVILA, SANDRA. Grape detection, segmentation, and tracking using deep neural networks and three-dimensional association. COMPUTERS AND ELECTRONICS IN AGRICULTURE, v. 170, MAR 2020. (13/08293-7, 17/16246-0)

DE OLIVEIRA, GABRIEL BIANCHIN; PEDRINI, HELIO; DIAS, ZANONI. nsemble of Template-Free and Template-Based Classifiers for Protein Secondary Structure Predictio. INTERNATIONAL JOURNAL OF MOLECULAR SCIENCES, v. 22, n. 21, NOV 2021. (19/20875-8, 17/12646-3, 17/16246-0)

MUNOZ, JAVIER VARGAS; GONCALVES, MARCOS A.; DIAS, ZANONI; TORRES, RICARDO DA S.. Hierarchical Clustering-Based Graphs for Large Scale Approximate Nearest Neighbor Search. PATTERN RECOGNITION, v. 96, DEC 2019. (14/50715-9, 16/50250-1, 17/16246-0, 17/20945-0, 14/12236-1, 13/50169-1, 15/11937-9, 17/12646-3, 13/50155-0, 15/24494-8)

OLIVEIRA, ANDRE R.; JEAN, GERALDINE; FERTIN, GUILLAUME; DIAS, ULISSES; DIAS, ZANONI. Super short operations on both gene order and intergenic sizes. Algorithms for Molecular Biology, v. 14, n. 1, NOV 5 2019. (17/12646-3, 17/16246-0, 13/08293-7, 15/11937-9)

OLIVEIRA, ANDRE RODRIGUES; BRITO, KLAIRTON LIMA; DIAS, ULISSES; DIAS, ZANONI. On the Complexity of Sorting by Reversals and Transpositions Problems. JOURNAL OF COMPUTATIONAL BIOLOGY, v. 26, n. 11, p. 1223-1229, NOV 1 2019. (13/08293-7, 17/16246-0, 15/11937-9, 17/12646-3)

DAVID, LUCAS; PEDRINI, HELIO; DIAS, ZANONI; ROCHA, ANDERSON; IEEE. Connoisseur: Provenance Analysis in Paintings. 2021 IEEE SYMPOSIUM SERIES ON COMPUTATIONAL INTELLIGENCE (IEEE SSCI 2021), v. N/A, p. 8-pg., 2021-01-01. (17/12646-3, 15/11937-9, 17/16246-0)

DIAS, ULISSES; OLIVEIRA, ANDRE RODRIGUES; BRITO, KLAIRTON LIMA; DIAS, ZANONI; KOWADA, L; DEOLIVEIRA, D. Block-Interchange Distance Considering Intergenic Regions. ADVANCES IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, BSB 2019, v. 11347, p. 12-pg., 2020-01-01. (17/12646-3, 15/11937-9, 17/16246-0)

DE OLIVEIRA, GABRIEL BIANCHIN; PEDRINI, HELIO; DIAS, ZANONI; PAIVA, AC; CONCI, A; BRAZ, G; ALMEIDA, JDS; FERNANDES, LAF. Ensemble of Bidirectional Recurrent Networks and Random Forests for Protein Secondary Structure Prediction. PROCEEDINGS OF THE 2020 INTERNATIONAL CONFERENCE ON SYSTEMS, SIGNALS AND IMAGE PROCESSING (IWSSIP), 27TH EDITION, v. N/A, p. 6-pg., 2020-01-01. (17/16246-0, 19/20875-8, 17/12646-3, 15/11937-9)

DE MELLO, FELIPE LOPES; DE OLIVEIRA, GABRIEL BIANCHIN; PEDRINI, HELIO; DIAS, ZANONI; RUTKOWSKI, L; SCHERER, R; KORYTKOWSKI, M; PEDRYCZ, W; TADEUSIEWICZ, R; ZURADA, JM. Prediction of Protein Molecular Functions Using Transformers. ARTIFICIAL INTELLIGENCE AND SOFT COMPUTING, ICAISC 2022, PT II, v. 13589, p. 9-pg., 2023-01-01. (17/16246-0, 19/20875-8, 17/12646-3, 15/11937-9)

PEIXOTO, BRUNO MALVEIRA; AVILA, SANDRA; DIAS, ZANONI; ROCHA, ANDERSON; ACM. Breaking down violence: A deep-learning strategy to model and classify violence in videos. 13TH INTERNATIONAL CONFERENCE ON AVAILABILITY, RELIABILITY AND SECURITY (ARES 2018), v. N/A, p. 7-pg., 2019-01-01. (17/12646-3, 15/11937-9, 13/08293-7, 17/16246-0, 17/16871-1)

RODRIGUES, CAROLINE MAZINI; PEREIRA, LUIS; ROCHA, ANDERSON; DIAS, ZANONI; IEEE. Image Semantic Representation for Event Understanding. 2019 IEEE INTERNATIONAL WORKSHOP ON INFORMATION FORENSICS AND SECURITY (WIFS), v. N/A, p. 6-pg., 2019-01-01. (17/12646-3, 15/11937-9, 13/08293-7, 17/16246-0, 18/16548-9, 18/16214-3, 17/16871-1)

PEIXOTO, BRUNO; LAVI, BAHRAM; PEREIRA MARTIN, JOAO PAULO; AVILA, SANDRA; DIAS, ZANONI; ROCHA, ANDERSON; IEEE. TOWARD SUBJECTIVE VIOLENCE DETECTION IN VIDEOS. 2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), v. N/A, p. 5-pg., 2019-01-01. (17/12646-3, 15/11937-9, 13/08293-7, 17/16246-0, 17/16871-1)

DOS SANTOS DANTASA, ANA PAULA; DE SOUZAA, CID CARVALHO; DIAS, ZANONI. A GRASP for the Convex Recoloring Problem in Graphs. ELECTRONIC NOTES IN THEORETICAL COMPUTER SCIENCE, v. 346, p. 13-pg., 2019-08-30. (17/12646-3, 18/04760-3, 15/11937-9, 13/08293-7, 17/16246-0)

OLIVEIRA, ANDRE RODRIGUES; JEAN, GERALDINE; FERTIN, GUILLAUME; DIAS, ULISSES; DIAS, ZANONI; ALVES, R. Super Short Reversals on Both Gene Order and Intergenic Sizes. ADVANCES IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, BSB 2018, v. 11228, p. 12-pg., 2018-01-01. (17/12646-3, 15/11937-9, 13/08293-7, 17/16246-0, 17/16871-1)

OLIVEIRA, ANDRE RODRIGUES; BRITO, KLAIRTON LIMA; DIAS, ZANONI; DIAS, ULISSES; ALVES, R. Sorting by Weighted Reversals and Transpositions. ADVANCES IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, BSB 2018, v. 11228, p. 12-pg., 2018-01-01. (17/12646-3, 15/11937-9, 13/08293-7, 17/16246-0, 17/16871-1)

TEIXEIRA, MARCOS; AVILA, SANDRA; ASSOC COMP MACHINERY. What should we pay attention to when classifying violent videos?. ARES 2021: 16TH INTERNATIONAL CONFERENCE ON AVAILABILITY, RELIABILITY AND SECURITY, v. N/A, p. 10-pg., 2021-01-01. (13/08293-7, 17/16246-0)

SIQUEIRA, GABRIEL; BRITO, KLAIRTON LIMA; DIAS, ULISSES; DIAS, ZANONI. euristics for Genome Rearrangement Distance With Replicated Gene. IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, v. 18, n. 6, p. 2094-2108, NOV 1 2021. (17/16246-0, 15/11937-9, 17/12646-3)

OLIVEIRA, GABRIEL B.; PEDRINI, HELIO; DIAS, ZANONI. TEMPROT: protein function annotation using transformers embeddings and homology search. BMC Bioinformatics, v. 24, n. 1, p. 16-pg., 2023-06-08. (17/16246-0, 19/20875-8, 17/12646-3, 15/11937-9)

BRITO, KLAIRTON LIMA; ALEXANDRINO, ALEXSANDRO OLIVEIRA; OLIVEIRA, ANDRE RODRIGUES; DIAS, ULISSES; DIAS, ZANONI. Reversals and transpositions distance with proportion restriction. JOURNAL OF BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, v. 19, n. 4, AUG 2021. (19/27331-3, 17/12646-3, 17/16246-0, 13/08293-7, 15/11937-9)

OLIVEIRA, ANDRE RODRIGUES; JEAN, GERALDINE; FERTIN, GUILLAUME; BRITO, KLAIRTON LIMA; DIAS, ULISSES; DIAS, ZANONI; MARTINVIDE, C; VEGARODRIGUEZ, MA; WHEELER, T. A 3.5-Approximation Algorithm for Sorting by Intergenic Transpositions. ALGORITHMS FOR COMPUTATIONAL BIOLOGY (ALCOB 2020), v. 12099, p. 13-pg., 2020-01-01. (13/08293-7, 17/12646-3, 15/11937-9, 17/16246-0)

ALEXANDRINO, ALEXSANDRO OLIVEIRA; OLIVEIRA, ANDRE RODRIGUES; DIAS, ULISSES; DIAS, ZANONI. Genome Rearrangement Distance with Reversals, Transpositions, and Indels. JOURNAL OF COMPUTATIONAL BIOLOGY, v. 28, n. 3, p. 235-247, MAR 1 2021. (17/16246-0, 19/27331-3, 15/11937-9, 17/12646-3)

SIQUEIRA, GABRIEL; BRITO, KLAIRTON LIMA; DIAS, ULISSES; DIAS, ZANONI; MARTINVIDE, C; VEGARODRIGUEZ, MA; WHEELER, T. Heuristics for Reversal Distance Between Genomes with Duplicated Genes. ALGORITHMS FOR COMPUTATIONAL BIOLOGY (ALCOB 2020), v. 12099, p. 12-pg., 2020-01-01. (17/12646-3, 15/11937-9, 17/16246-0)

BOLLIS, EDSON; PEDRINI, HELIO; AVILA, SANDRA; IEEE COMP SOC. Weakly Supervised Learning Guided by Activation Mapping Applied to a Novel Citrus Pest Benchmark. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), v. N/A, p. 10-pg., 2020-01-01. (13/08293-7, 14/12236-1, 17/12646-3, 17/16246-0)

BRAZ, LEODECIO; TEIXEIRA, VINICIUS; PEDRINI, HELIO; DIAS, ZANONI; SETUBAL, JC; SILVA, WM. ImTeNet: Image-Text Classification Network for Abnormality Detection and Automatic Reporting on Musculoskeletal Radiographs. ADVANCES IN BIOINFORMATICS AND COMPUTATIONAL BIOLOGY, BSB 2020, v. 12558, p. 12-pg., 2020-01-01. (19/20875-8, 17/12646-3, 15/11937-9, 17/16246-0)

BISSOTO, ALCEU; VALLE, EDUARDO; AVILA, SANDRA; IEEE COMP SOC. Debiasing Skin Lesion Datasets and Models? Not So Fast. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), v. N/A, p. 10-pg., 2020-01-01. (13/08293-7, 17/16246-0, 19/05018-1)