Camellia oleifera Fruit Static and Dynamic Detection Counting Based on Improved COF-YOLO v8n

WANG Jinpeng, HE Meng, ZHEN Qianguang, ZHOU Hongping

Abstract

Aiming at the problems of severe occlusion, close view and small target Camellia oleifera in Camellia oleifera fruit, the original YOLO v8n network was selected to improve the phenomenon of low detection accuracy and serious missed detection phenomenon by using the original YOLO network. MPDIOU was used as the loss function of YOLO v8n to effectively solve the problem of missed detection caused by fruit overlap. Adjusting the network and adding a small target detection layer to it，so that the network can pay attention to small target Camellia oleifera and Camellia oleifera obscured by leaves;SCConv was used to replace the C2f in the original YOLO v8n, so that the network can balance both detection accuracy and detection speed. The P, R and mAP of the improved COF-YOLO v8n network reached 97.7%, 97% and 99% respectively, which were 3.2 percentages, 4.8 percentages and 2.4 percentages higher than P, R and mAP of the unimproved YOLO v8n, among which the P, R and mAP of Camellia oleifera reached 95.9%, 95% and 98.5% under severe occlusion, respectively, which was 4.0 percentages, 9.1 percentages and 4.6 percentages higher than that of the original YOLO v8n. The COF-YOLO v8n network can significantly improve the recognition accuracy of Camellia oleifera under the conditions of severe occlusion, close vie, and small targets. In addition, the model can realize the counting of Camellia oleifera under dynamic and static input conditions. Dynamic counting draws on the multi-target tracking idea of DeepSORT algorithm, and took the recognition output of COF-YOLO v8n as the input of DeepSORT to realize the recognition and counting of Camellia oleifera fruits, and used the reduced resolution Camellia oleifera data to simulate the target situation in the field environment and restored the real picking environment. The resulting improved model had good robustness and simple model can be embedded in the robotic arm, which can not only be used to guide future automated harvesting, but also for yield estimation of orchards, providing reliable reference for orchard logistics distribution.

 

Keywords:Camellia oleifera fruit;machine vision;COF-YOLO v8n;count;production estimates

 

Download Full Text:

PDF


References


ZHOU Y, TANG Y, ZOU X, et al. Adaptive active positioning of Camellia oleifera fruit picking points: classical image processing and YOLO v7 fusion algorithm[ J ]. Applied Siences, 2022, 12(24) : 12959.

ZHOU Hongping, JIN Shouxiang, ZHOU Lei, et al. Recognition of Camellia oleifera fruit in natural environment based on multimodal image [ J ]. Transactions of the CSAE ,2023 ,39( 10) ; 175 - 182. (in Chinese)

YANG Y, KANG H. An enhanced detection method of PCB defect based on improved YOLO v7 [J ]. Electronics, 2023, 12(9) :2120.

CHEN J, CHEN J, ZHANG D, et al. Using deep transfer learning for image-based plant disease identification [ J ]. Computers and Electronics in Agriculture, 2020, 173; 105393.

LEE C, YANG M, TSENG H, et al. Single-plant broccoli growth monitoring using deep learning with UAV imagery [ J ]. Computers and Electronics in Agriculture, 2023, 207: 107739.

RAI N, ZHANG Y, RAM В G, et al. Applications of deep learning in precision weed management; a review [J] . Computers and Electronics in Agriculture, 2023, 206; 107698.

JANANI M, JEBAKUMAR R. Detection and classification of groundnut leaf nutrient level extraction in RGB images [ J ]. Advances in Engineering Software, 2023, 175: 103320.

ALSHEHHI R, MARPU P R. Change detection using multi-scale convolutional feature maps of bi-temporal satellite high - resolution images[j]. European Journal of Remote Sensing, 2023, 56( 1 ) ; 2161419.

QUAN Y, LI M, HAO Y, et al. Tree species classification in a typical natural secondary forest using UAV-borne LiDAR and hyperspectral data[ J]. Giscience & Remote Sensing, 2023, 60( 1 ) ; 2171706.

IQBAL H M R, HAKIM A. Classification and grading of harvested mangoes using convolutional neural network [ J]. International Journal of Fruit Science, 2022, 22( 1 ) ; 95 - 109.

WANG F, JIANG J, CHEN Y, et al. Rapid detection of Yunnan Xiaomila based on lightweight YOLO v7 algorithm [J ]. Frontiers in Plant Science, 2023, 14: 1200144.

CONG P, LI S, ZHOU J, et al. Research on instance segmentation algorithm of greenhouse sweet pepper detection based on improved Mask RCNN[J]. Agronomy, 2023, 13(1): 196.

HE L, FANG W, ZHAO G, et al. Fruit yield prediction and estimation in orchards: a state-of-the-art comprehensive review for both direct and indirect methods [j ]. Computers and Electronics in Agriculture, 2022, 195; 106812.

GAN H, LEE W S, ALCHANATIS V, et al. Active thermal imaging for immature citrus fruit detection [J ]. Biosystems Engineering, 2020, 198: 291 -303.

JIANG K, XIE T, YAN R, et al. An attention mechanism-improved YOLO v7 object detection algorithm for hemp duck count estimation[ J] . Agriculture, 2022, 12( 10) : 1659.

CHEN X, PU H, HE Y, et al. An efficient method for monitoring birds based on object detection and multi-object tracking networks[J ]. Animals, 2023, 13(10): 1713.

JIANG Q, LI H. Silicon energy bulk material cargo ship detection and tracking method combining YOLO v5 and DeepSORT [J] . Energy Reports, 2023, 9; 151 -158.

ZHOU Q, GUO W, CHEN N, et al. Analyzing nitrogen effects on rice panicle development by panicle detection and time- series tracking [J ]. Plant Phenomics, 2023, 5; 0048.

LI J, WEN Y, HE L. SCConv: spatial and channel reconstruction convolution for feature redundancy [ С ] // Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023; 6153 -6162.

SILIANG M, YONG X. MPDIoU: a loss for efficient and accurate bounding box regression [ J . arXiv preprint arXiv:2307. 07662, 2023.

WOJKE N, BEWLEY A, PAULUS D. Simple online and realtime tracking with a deep association metric [ С ] //2017 IEEE International Conference on Image Processing (ICIP). IEEE, 2017 : 3645 -3649.

BEWLEY A, GE Z, OTT L, et al. Simple online and realtime trackingf С ] //2016 IEEE International Conference on Image Processing (ICIP). IEEE, 2016: 3464 -3468.

LI Y, YUAN G, WEN Y, et al. Efficientformer: vision transformers at mobilenet speedFj]. Advances in Neural Information Processing Systems, 2022, 35: 12934 - 12949.

LI C, ZHOU A, YAO A. Omni-dimensional dynamic convolution [J]. arXiv preprint arXiv ;2209. 07947, 2022.

CHEN J, KAO S, HE H, et al. Run, don’t walk: chasing higher FLOPS for faster neural networks[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023; 12021 - 12031.

XIONG J T, LIN R, LIU Z, et al. The recognition of litchi clusters and the calculation of picking point in a nocturnal natural environment [J ]. Biosystems Engineering, 2018 , 166 : 44 - 57.

SONG Huaibo, W ANG Ya'nan, W ANG Yunfei, et al. Identification method of Camellia oleifera fruit in natural scene based on YOLO v5s [J]. Transactions of the Chinese Society for Agricultural Machinery,2022, 53(7) • 234 -242. ( in Chinese)


Refbacks

  • There are currently no refbacks.