ESE-Net: Edge-Shape Enhancement Network for Infrared Small Target Detection

Sen Yang; Guanxun Cui

doi:10.71222/ag4mh549

Authors

Sen Yang Chongqing University of Technology, Chongqing, China Author
Guanxun Cui Chongqing University of Technology, Chongqing, China Author

DOI:

https://doi.org/10.71222/ag4mh549

Keywords:

infrared small target detection, edge enhancement, spatial-frequency fusion, semantic segmentation

Abstract

Infrared small target detection (ISTD) aims to segment small targets from infrared images and is widely applied in military and industrial fields. Although recent deep learning-based methods have achieved remarkable performance, they often fail when targets are indistinguishable from complex backgrounds. This is mainly due to the limited use of spatial domain features, which cannot capture subtle boundary cues, making precise segmentation challenging. To address this, we propose an Edge-Shape Enhanced Network (ESE-Net), which reinforces edge feature representations to improve target discrimination in complex infrared scenes. First, we design a Multiscale Spatial Edge Attention (MSEA) module to strengthen target edges by perceiving directional gradient changes. To suppress background noise while highlighting target boundaries, we introduce an Edge Guidance Module (EGM) that extracts edge features in the frequency domain via a wavelet transform and performs reversible down sampling, discarding low-frequency components before fusing with spatial features. Furthermore, a Multiscale Group Convolution Module (MGCM) is integrated in deep layers to preserve target details and mitigate the risk of small target loss. Experiments on the NUAA-SIRST and IRSTD-1K datasets demonstrate the effectiveness of our method.

References

1. M. Zhang, R. Zhang, Y. Yang, H. Bai, J. Zhang, and J. Guo, "ISNet: Shape matters for infrared small target detection," In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2022, pp. 877-886.

2. Y. Dai, Y. Wu, F. Zhou, and K. Barnard, "Asymmetric contextual modulation for infrared small target detection," In Proceedings of the IEEE/CVF winter conference on applications of computer vision, 2021, pp. 950-959. doi: 10.1109/wacv48630.2021.00099

3. F. Hashmi, M. U. Hassan, M. U. Zubair, K. Ahmed, T. Aziz, and R. M. Choudhry, "Near-miss detection metrics: An approach to enable sensing technologies for proactive construction safety management," Buildings, vol. 14, no. 4, p. 1005, 2024. doi: 10.3390/buildings14041005

4. B. Zhao, C. Wang, Q. Fu, and Z. Han, "A novel pattern for infrared small target detection with generative adversarial network," IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 5, pp. 4481-4492, 2020. doi: 10.1109/tgrs.2020.3012981

5. Y. Dai, Y. Wu, F. Zhou, and K. Barnard, "Attentional local contrast networks for infrared small target detection," IEEE transactions on geoscience and remote sensing, vol. 59, no. 11, pp. 9813-9824, 2021. doi: 10.1109/tgrs.2020.3044958

6. T. Zhang, L. Li, S. Cao, T. Pu, and Z. Peng, "Attention-guided pyramid context networks for detecting infrared small target under complex background," IEEE Transactions on Aerospace and Electronic Systems, vol. 59, no. 4, pp. 4250-4261, 2023. doi: 10.1109/taes.2023.3238703

7. B. Li, C. Xiao, L. Wang, Y. Wang, Z. Lin, M. Li, and Y. Guo, "Dense nested attention network for infrared small target detection," IEEE Transactions on Image Processing, vol. 32, pp. 1745-1758, 2022. doi: 10.1109/tip.2022.3199107

8. K. Wang, S. Du, C. Liu, and Z. Cao, "Interior attention-aware network for infrared small target detection," IEEE Transactions on Geoscience and Remote Sensing, vol. 60, pp. 1-13, 2022. doi: 10.1109/tgrs.2022.3163410

9. M. Qi, L. Liu, S. Zhuang, Y. Liu, K. Li, Y. Yang, and X. Li, "FTC-Net: Fusion of transformer and CNN features for infrared small target detection," IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, vol. 15, pp. 8613-8623, 2022. doi: 10.1109/jstars.2022.3210707

10. F. Liu, C. Gao, F. Chen, D. Meng, W. Zuo, and X. Gao, "Infrared small and dim target detection with transformer under complex backgrounds," IEEE Transactions on Image Processing, vol. 32, pp. 5921-5932, 2023. doi: 10.1109/tip.2023.3326396

11. M. Zhang, H. Bai, J. Zhang, R. Zhang, C. Wang, J. Guo, and X. Gao, "Rkformer: Runge-kutta transformer with random-connection attention for infrared small target detection," In Proceedings of the 30th ACM International Conference on Multimedia, October, 2022, pp. 1730-1738. doi: 10.1145/3503161.3547817

12. C. Liu, F. Xie, H. Zhang, Z. Jiang, and Y. Zheng, "Infrared small target detection based on multi-perception of target features," Infrared Physics & Technology, vol. 135, p. 104927, 2023. doi: 10.1016/j.infrared.2023.104927

13. L. Fan, Y. Wang, G. Hu, F. Li, Y. Dong, H. Zheng, and X. Ding, "Diffusion-based continuous feature representation for infrared small-dim target detection," IEEE Transactions on Geoscience and Remote Sensing, vol. 62, pp. 1-17, 2024. doi: 10.1109/tgrs.2024.3395478

14. L. Xu, Y. Wei, H. Zhang, and S. Shang, "Robust and fast infrared small target detection based on pareto frontier optimization," Infrared Physics & Technology, vol. 123, p. 104192, 2022. doi: 10.1016/j.infrared.2022.104192

15. M. Zhang, N. Wang, Y. Li, and X. Gao, "Neural probabilistic graphical model for face sketch synthesis," IEEE transactions on neural networks and learning systems, vol. 31, no. 7, pp. 2623-2637, 2019. doi: 10.1109/tnnls.2019.2933590

16. E. Zhao, L. Dong, and H. Dai, "Infrared maritime target detection based on edge dilation segmentation and multiscale local saliency of image details," Infrared Physics & Technology, vol. 133, p. 104852, 2023. doi: 10.1016/j.infrared.2023.104852

17. X. Wu, D. Hong, and J. Chanussot, "UIU-Net: U-Net in U-Net for infrared small object detection," IEEE Transactions on Image Processing, vol. 32, pp. 364-376, 2022. doi: 10.1109/tip.2022.3228497

18. H. Sun, J. Bai, F. Yang, and X. Bai, "Receptive-field and direction induced attention network for infrared dim small target detection with a large-scale dataset IRDST," IEEE Transactions on Geoscience and Remote Sensing, vol. 61, pp. 1-13, 2023. doi: 10.1109/tgrs.2023.3235150

19. N. Ma, X. Zhang, H. T. Zheng, and J. Sun, "Shufflenet v2: Practical guidelines for efficient cnn architecture design," In Proceedings of the European conference on computer vision (ECCV), 2018, pp. 116-131.

20. C. Y. Wang, H. Y. M. Liao, Y. H. Wu, P. Y. Chen, J. W. Hsieh, and I. H. Yeh, "CSPNet: A new backbone that can enhance learning capability of CNN," In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops, 2020, pp. 390-391.

21. K. Han, Y. Wang, Q. Tian, J. Guo, C. Xu, and C. Xu, "Ghostnet: More features from cheap operations," In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 2020, pp. 1580-1589.

22. J. Hu, L. Shen, and G. Sun, "Squeeze-and-excitation networks," In Proceedings of the IEEE conference on computer vision and pattern recognition, 2018, pp. 7132-7141. doi: 10.1109/cvpr.2018.00745

23. J. F. Rivest, and R. Fortin, "Detection of dim targets in digital infrared imagery by morphological image processing," Optical Engineering, vol. 35, no. 7, pp. 1886-1893, 1996.

24. S. D. Deshpande, M. H. Er, R. Venkateswarlu, and P. Chan, "Max-mean and max-median filters for detection of small targets," In Signal and Data Processing of Small Targets 1999, October, 1999, pp. 74-83.

25. J. Han, S. Moradi, I. Faramarzi, H. Zhang, Q. Zhao, X. Zhang, and N. Li, "Infrared small target detection based on the weighted strengthened local contrast measure," IEEE Geoscience and Remote Sensing Letters, vol. 18, no. 9, pp. 1670-1674, 2020. doi: 10.1109/lgrs.2020.3004978

26. J. Han, S. Moradi, I. Faramarzi, C. Liu, H. Zhang, and Q. Zhao, "A local contrast method for infrared small-target detection utilizing a tri-layer window," IEEE Geoscience and Remote Sensing Letters, vol. 17, no. 10, pp. 1822-1826, 2019. doi: 10.1109/lgrs.2019.2954578

27. C. Gao, D. Meng, Y. Yang, Y. Wang, X. Zhou, and A. G. Hauptmann, "Infrared patch-image model for small target detection in a single image," IEEE transactions on image processing, vol. 22, no. 12, pp. 4996-5009, 2013. doi: 10.1109/tip.2013.2281420

28. L. Zhang, L. Peng, T. Zhang, S. Cao, and Z. Peng, "Infrared small target detection via non-convex rank approximation minimization joint l 2, 1 norm," Remote Sensing, vol. 10, no. 11, p. 1821, 2018.

29. Y. Dai, and Y. Wu, "Reweighted infrared patch-tensor model with both nonlocal and local priors for single-frame small target detection," IEEE journal of selected topics in applied earth observations and remote sensing, vol. 10, no. 8, pp. 3752-3767, 2017. doi: 10.1109/jstars.2017.2700023

30. L. Zhang, and Z. Peng, "Infrared small target detection based on partial sum of the tensor nuclear norm," Remote Sensing, vol. 11, no. 4, p. 382, 2019. doi: 10.3390/rs11040382

31. Y. Sun, J. Yang, and W. An, "Infrared dim and small target detection via multiple subspace learning and spatial-temporal patch-tensor model," IEEE Transactions on Geoscience and Remote Sensing, vol. 59, no. 5, pp. 3737-3752, 2020. doi: 10.1109/tgrs.2020.3022069