Seeing through the dark: adaptive switch-guided knowledge distillation via heterogeneous teachers for robust plant disease diagnosis

초록

Computational cost during model deployment can be reduced through knowledge distillation (KD) which transfers knowledge from a teacher model to a lightweight student model while maintaining performance. However, KD methods based on a single teacher often provide limited knowledge diversity and may transfer less informative features. Furthermore, the application of KD for plant disease classification in low-light noisy environments has received little attention. To address these limitations, we propose a KD framework using heterogeneous teachers with adaptive feature alignment (KDHT-AFA) that integrates an adaptive feature distillation switch (AFDS) to selectively align intermediate representations. For effective knowledge transfer, we propose a lightweight custom student model with 5.16 million parameters. The model incorporates a regional statistical hybrid attention (RSHA) to enhance important features semantically while increasing sensitivity to local structure and contrast. Additionally, we introduce a new self-collected real low-light plant disease dataset (ReLL-PDD v1) acquired under realistic agricultural conditions. For performance evaluation, we considered two open-source datasets, PlantVillage and the Potato Leaf Disease dataset, along with the ReLL-PDD v1 dataset. Our model achieved a mean accuracy of 86.88% with a harmonic mean of precision and recall (F1-score) of 86.25% on ReLL-PDD v1 dataset. On the PlantVillage and Potato Leaf Disease datasets, it obtained mean accuracies of 92.64% and 88.97% with F1-scores of 91.48% and 88.92%, respectively. Furthermore, the smart pesticide prescription module (SPPM) uses a large language model Meta artificial intelligence (LLaMA) to recommend pesticides for diseases detected by KDHT-AFA. Hence, the proposed KDHT-AFA supports real-time deployment and plant disease monitoring in low-light noisy environments.

키워드