A novel multiscale feature enhancement network using learnable density map for red clustered pepper yield estimation

Chenming Cheng ^1,2 Jin Lei ^1,2 Zicui Zhu ³ Lijian Lu ^1,4 Zhi Wang ^1,4 Jiali Tao ^1,4 Xinyan Qin ^1,2*

• ¹ College of Mechanical and Electrical Engineering, Shihezi University, Shihezi, Xinjiang Uyghur Region, China
• ² Engineering Research Center for Production Mechanization of Oasis Characteristic Cash Crop, Ministry of Education, Shihezi, China
• ³ Town Construction and Management Centre, 170th Regiment, 9th Division, Xinjiang Production and Construction Corps, Emin, China
• ⁴ Key Laboratory of Northwest Agricultural Equipment, Ministry of Agriculture and Rural Affairs, Shihezi, China

Introduction: Accurate and automated yield estimation for red cluster pepper (RCP) is essential to optimize field management and resource allocation. Traditional object detection-based methods for yield estimation often suffer from time-consuming and labor-intensive annotation processes, as well as suboptimal accuracy in dense environments. To address these challenges, this paper proposes a novel multiscale feature enhancement network (MFEN) that integrates a learnable density map (LDM) for accurate RCP yield estimation.The proposed method mainly involves three key steps. First, the kernel-based density map (KDM) method was improved by integrating the Swin Transformer (ST), resulting in LDM method, which produces higher quality density maps. Then, a novel MFEN was developed to improve feature extraction from these density maps. This network combines dilation convolution, residual structures, and an attention mechanism to effectively extract features. Finally, the LDM and the MFEN were jointly trained to estimate both yield and density maps for RCP.The model achieved superior accuracy in RCP yield estimation by using LDM in conjunction with MFEN for joint training. Firstly, the integration of LDM significantly improved the accuracy of the model, with a 0.98% improvement over the previous iteration. Compared to other feature extraction networks, MFEN had the lowest mean absolute error (MAE) of 5.42, root mean square error (RMSE) of 10.37 and symmetric mean absolute percentage error (SMAPE) of 11.64%. It also achieved the highest R-squared (R ² ) value of 0.9802 on the test dataset, beating the best performing DSNet by 0.98%. Notably, despite its multi-column structure, the model has a significant advantage in terms of parameters, with only 13.08M parameters (a reduction of 3.18M compared to the classic single-column network CSRNet). This highlights the model's ability to achieve the highest accuracy while maintaining efficient deployment capabilities.The proposed method provides an robust algorithmic support for efficient and intelligent yield estimation in RCP.