跨分辨率语义引导特征分布自协调小目标检测

Cross-resolution semantic-guided small object detection via feature distribution self-alignment

  • 摘要: 由于小目标检测缺乏视觉信息,且具有较强的表征力,因此小目标检测是计算机视觉的瓶颈问题. 现有的方法在多尺度特征融合时,经常采用强制性的结构对齐策略,这种策略可能造成“特征空间偏移”的问题,使模型不能很好地认识小目标原始特征. 为此提出以YOLOv11为基本的、针对该问题的跨分辨率语义匹配以及特征分布自动协调改进方法(CRSA-YOLO). 该方法提出跨分辨率语义引导模块,使得高分辨率引导低分辩率学习,并且采用“空−频 双域协同约束损失”(spatial-frequency dual-domain collaborative constraint loss,SF-DCCL)方法以实现空间与频率信息的高效融合;同时使用“跨源特征分布协同优化”(cross-source feature distribution collaborative optimization, CF-DCO)与其他真实数据集进行特征分布自协调,以增强模型的范化能力. VisDrone、DsVOC2012等基准数据集上的实验结果表明,VisDrone测试集中把小目标检测精度 AP_\mathrmS 由原来的9.1%提高到现在的12.9%,提高了小目标检测的准确性以及鲁棒性.

     

    Abstract: Small object detection remains a bottleneck in computer vision tasks, as small objects suffer from insufficient visual information yet exhibit complex feature representation characteristics. Existing multi-scale feature fusion pipelines commonly adopt rigid structural alignment strategies, which tend to induce the feature space shift issue and hinder the model’s ability to fully capture the native features of small objects. To address this limitation, this paper proposes CRSA-YOLO, an improved algorithm built upon YOLOv11 that integrates cross-resolution semantic alignment and automatic feature distribution coordination. First, a cross-resolution semantic guidance module is devised to enable high-resolution feature maps to supervise the feature learning of low-resolution counterparts. Second, a Spatial-frequency dual-domain collaborative constraint loss (SF-DCCL) is proposed to facilitate efficient fusion of spatial and frequency-domain information. Furthermore, Cross-Source Feature Distribution Collaborative Optimization (CF-DCO) is introduced to automatically harmonize feature distributions across diverse real-world datasets, strengthening the generalization capability of the detection model. Extensive experiments are conducted on benchmark datasets including VisDrone and DsVOC2012. On the VisDrone test set, the proposed method elevates the average precision for small objects AP_\textS from 9.1% to 12.9%, which verifies the significant improvement in detection accuracy and robustness for small targets.

     

/

返回文章
返回