Novelty detection in UAV images to identify emerging threats in eucalyptus crops

Author(s)

Coletta, Luiz F. S. ; de Almeida, Douglas C. ; Souza, Jefferson R. ; Manzione, Rodrigo L.

• Document type: Journal article
• Source: COMPUTERS AND ELECTRONICS IN AGRICULTURE; v. 196, p. 8-pg., 2022-05-01.

Abstract

Supervised learning-based methods can identify crop threats in the visual data collected by an Unmanned Aerial Vehicle (UAV). However, as these methods induce classification models from a finite set of a priori known classes, they cannot recognize new patterns emerging in visual data to be classified. In agricultural environments, these patterns may appear over time, so that those related to diseases/pests should be addressed by the classifier timely. This study investigates an extension of a semi-supervised classification algorithm to identify new classes of threats appearing in UAV visual data. To do so, the algorithm aggregates information from clusters with Support Vector Machine (SVM) outcomes operating on the unlabeled (target) data. From an iterative active learning procedure, the classification model is then fed back to learn a new class. Experimental results showed that our algorithm can discover a new threat, named Ceratocystis wilt, in Eucalyptus plantations even with labeled data scarcity and class imbalance. Also, even this new class being the minority one, its error rate was reduced to almost zero in few iterations on a tested dataset. This is due to the adopted Entropy and Density-based Selection approach, which explored the new class better than an SVM Margin Sampling baseline. When operating on VGGNet-16 deep features, our algorithm achieved accuracies between 92% and 97% being slightly better than those results based on hand-crafted features. (AU)

• FAPESP's process: 17/00357-7 - Pattern recognition in crops from the combination of classifiers and clusterers
• Grantee: Luiz Fernando Sommaggio Coletta
• Support Opportunities: Regular Research Grants