任向阳;王杰;马天磊;朱晓东;白珂;王佳奇;

• 1:郑州大学电气工程学院

摘要(Abstract)：

随着红外探测技术的不断发展,对探测距离的要求越来越高,红外弱小目标检测技术已成为国内外红外探测领域的研究重点。简介了红外弱小目标检测的背景及意义;重点综述了目前在红外弱小目标检测领域中各类典型方法的研究现状及最新进展;给出了几种不同类型的红外弱小目标检测方法的实验对比;最后对红外弱小目标检测技术的研究进行总结和展望。

关键词(KeyWords)： 红外弱小目标;目标检测;红外图像;检测性能

Abstract:

Keywords:

基金项目(Foundation): 国家自然科学基金项目(61903340);; 河南省教育厅重点项目(19A413002);; 河南省博士后科研项目(001701002);; 河南省青年人才托举工程项目(2020HYTP028)

作者(Authors): 任向阳;王杰;马天磊;朱晓东;白珂;王佳奇;

DOI: 10.13705/j.issn.1671-6841.2019557

参考文献(References)：

• [1] 杨威,付耀文,潘晓刚,等.弱目标检测前跟踪技术研究综述[J].电子学报,2014,42(9):1786-1793.YANG W,FU Y W,PAN X G,et al.Track-before-detect technique for dim targets:an overview[J].Acta electronica sinica,2014,42(9):1786-1793.
• [2] 韩金辉.基于人类视觉特性的复杂背景红外小目标检测研究[D].武汉:华中科技大学,2016.HAN J H.Infrared small target detection under complex background based on human visual system[D].Wuhan:Huazhong University of Science & Technology,2016.
• [3] 侯旺,孙晓亮,尚洋,等.红外弱小目标检测技术研究现状与发展趋势[J].红外技术,2015,37(1):1-10.HOU W,SUN X L,SHANG Y,et al.Present state and perspectives of small infrared targets detection technology[J].Infrared technology,2015,37(1):1-10.
• [4] 王好贤,董衡,周志权.红外单帧图像弱小目标检测技术综述[J].激光与光电子学进展,2019,56(8):1-14.WANG H X,DONG H,ZHOU Z Q.Review on dim small target detection technologies in infrared single frame images[J].Laser & optoelectronics progress,2019,56(8):1-14.
• [5] 田鹏辉,隋立春,燕莎.红外运动小目标检测方法综述[J].探测与控制学报,2013,35(2):76-80.TIAN P H,SUI L C,YAN S.A review on infrared small moving target detection[J].Journal of detection & control,2013,35(2):76-80.
• [6] FAN Z L,BI D Y,XIONG L,et al.Dim infrared image enhancement based on convolutional neural network[J].Neurocomputing,2018,272:396-404.
• [7] 何诚,刘柯珍,舒立福,等.基于红外热成像的林地余火死灰复燃点诊断方法研究[J].光谱学与光谱分析,2018,38(1):326-332.HE C,LIU K Z,SHU L F,et al.The diagnostic methods for resurgences of smoldering fire in the forests by infrared thermal imaging[J].Spectroscopy and spectral analysis,2018,38(1):326-332.
• [8] COPPO P.Simulation of fire detection by infrared imagers from geostationary satellites[J].Remote sensing of environment,2015,162:84-98.
• [9] 李家琨,金伟其,王霞,等.气体泄漏红外成像检测系统的性能测试方法研究[J].北京理工大学学报,2016,36(6):630-634.LI J K,JIN W Q,WANG X,et al.Research on performance measurement method of gas leak infrared imaging detection system[J].Transactions of Beijing institute of technology,2016,36(6):630-634.
• [10] 张旭,金伟其,李力,等.天然气泄漏被动式红外成像检测技术及系统性能评价研究进展[J].红外与激光工程,2019,48(S2):53-65.ZHANG X,JIN W Q,LI L,et al.Research progress on passive infrared imaging detection technology and system performance evaluation of natural gas leakage[J].Infrared and laser engineering,2019,48(S2):53-65.
• [11] LAW W,XU Z R,YONG K,et al.Manganese-doped near-infrared emitting nanocrystals for in vivo biomedical imaging[J].Optics express,2016,24(16):17553-17561.
• [12] 周娴,黄碧群,许艳巧.中医五脏寒热证素特征的红外热像图识别方法初探[J].中华中医药杂志,2017,32(11):4849-4851.ZHOU X,HUANG B Q,XU Y Q,et al.Study on infrared thermogram recognizing methods of TCM five zang viscera cold and heat syndrome element characteristics[J].China journal of traditional Chinese medicine and pharmacy,2017,32(11):4849-4851.
• [13] CUCCURULLO G,GIORDANO L,ALBANESE D,et al.Infrared thermography assisted control for apples microwave drying[J].Journal of food engineering,2012,112(4):319-325.
• [14] 徐惠荣,应义斌.红外热成像在树上柑橘识别中的应用研究[J].红外与毫米波学报,2004,23(5):353-356.XU H R,YING Y B.Application of infrared thermal imaging in identification of citrus ontrees[J].Journal of infrared and millimeter waves,2004,23(5):353-356.
• [15] 周建民,周其显,刘燕德.红外热成像技术在农业生产中的应用[J].农机化研究,2010,32(2):1-4,51.ZHOU J M,ZHOU Q X,LIU Y D.Application of infrared thermography techniques in agricultural production[J].Journal of agricultural mechanization research,2010,32(2):1-4,51.
• [16] 王力民,张蕊,林一楠,等.红外探测技术在军事上的应用[J].红外与激光工程,2008,37(S2):570-574.WANG L M,ZHANG R,LIN Y N,et al.Application in the military of the IR detection technology[J].Infrared and laser engineering,2008,37(S2):570-574.
• [17] 宦克为,庞博,石晓光,等.红外成像系统的性能测试及评价方法研究[J].红外与激光工程,2008,37(S2):482-486.HUAN K W,PANG B,SHI X G,et al.Research on performance testing and evaluation of infrared imaging system[J].Infrared and laser engineering,2008,37(S2):482-486.
• [18] 谈蕊.红外侦察预警系统站点布设对被动测距精度的影响分析[J].红外,2016,37(3):16-19.TAN R.Analysis of influence of infrared reconnaissance warning system layout on passive ranging accuracy[J].Infrared,2016,37(3):16-19.
• [19] JAIN L C,ICHALKARANJE N S,TONFONI G.Advances in intelligent systems for defence[M].Singapore:World Scientific,2002.
• [20] 崔金辉,张伟.美国天基低轨红外系统中段目标探测方法分析[J].光电工程,2010,37(6):54-57,95.CUI J H,ZHANG W.Analysis of midcourse target detecting method with SBIRS-low[J].Opto-electronic engineering,2010,37(6):54-57,95.
• [21] 王斌.海面目标红外检测方法研究[D].大连:大连海事大学,2018.WANG B.Research on method for infrared maritime target detection[D].Dalian:Dalian Maritime University,2018.
• [22] 孙熊伟.复杂背景下海面红外小目标快速检测技术研究[D].合肥:中国科学技术大学,2019.SUN X W.Research on the rapid detection of infrared small targets under complex marine backgrounds[D].Hefei:University of Science and Technology of China,2019.
• [23] 周洋,杨心武,刘佳丽.美海军无人海空平台通信关键技术研究[J].舰船电子工程,2019,39(10):16-20.ZHOU Y,YANG X W,LIU J L.Research on key technologies of US navy unmanned aerial and surface vehicles communications[J].Ship electronic engineering,2019,39(10):16-20.
• [24] SRIVASTAVA H.Image pre-processing algorithms for detection of small/point airborne targets[J].Defence science journal,2009,59(2):166-174.
• [25] ZHANG W,CONG M Y,WANG L P.Algorithms for optical weak small targets detection and tracking:review[C]//Proceedings of the 2003 International Conference on Neural Networks and Signal Processing.Nanjing,2003.
• [26] 孙继刚.序列图像红外小目标检测与跟踪方法研究[D].长春:中国科学院长春光学精密仪器与物理研究所,2014.SUN J G.Research on algorithm of infrared small target detection and tracking in image sequence[D].Changchun:Changchun Institute of Optics,Fine Mechanics and Physics Chinese Academy of Sciences,2014.
• [27] 郭汝江,袁业术,权太范.高频地波雷达飞行小目标跟踪方法研究[J].电子学报,2005,33(9):1586-1589.GUO R J,YUAN Y S,QUAN T F.Study of anti-weak aerial target tracking for high frequency surface wave radar[J].Acta electronica sinica,2005,33(9):1586-1589.
• [28] 李自勤,李金新,王骐.激光雷达跟踪方法研究[J].红外与激光工程,2006,35(6):696-699.LI Z Q,LI J X,WANG Q.Tracking algorithm of ladar[J].Infrared and laser engineering,2006,35(6):696-699.
• [29] TULLDAHL H M,STEINVALL K O.Simulation of sea surface wave influence on small target detection with airborne laser depth sounding[J].Applied optics,2004,43(12):2462.
• [30] WANG X,PENG Z,ZHANG P,et al.Infrared small target detection via nonnegativity-constrained variational mode decomposition[J].IEEE geoscience and remote sensing letters,2017,14(10):1700-1704.
• [31] MARVASTI F S,MOSAVI M R,NASIRI M.Flying small target detection in IR images based on adaptive toggle operator[J].IET computer vision,2018,12(4):527-534.
• [32] DENG L Z,ZHU H,TAO C,et al.Infrared moving point target detection based on spatial-temporal local contrast filter[J].Infrared physics & technology,2016,76:168-173.
• [33] 赵高鹏,李磊,王建宇.基于结构张量分析的弱小目标单帧检测[J].光子学报,2019,48(1):141-151.ZHAO G P,LI L,WANG J Y.Dim small target single-frame detection based on structure tensor analysis[J].Acta photonica sinica,2019,48(1):141-151.
• [34] 解婷,陈忠,马荣毅.一种基于PGF、BEMD和局部逆熵的新型红外小目标检测方法[J].红外与毫米波学报,2017,36(1):92-101.XIE T,CHEN Z,MA R Y.A novel method for infrared small target detection based on PGF,BEMD and LIE[J].Journal of infrared and millimeter waves,2017,36(1):92-101.
• [35] 何玉杰,李敏,张金利,等.基于相关滤波器的红外弱小目标检测方法[J].光学学报,2016,36(5):96-104.HE Y J,LI M,ZHANG J L,et al.Infrared small target detection method based on correlation filter[J].Acta optica sinica,2016,36(5):96-104.
• [36] YI X,WANG B,ZHOU H,et al.Dim and small infrared target fast detection guided by visual saliency[J].Infrared physics & technology,2019,97:6-14.
• [37] WAN M,GU G,QIAN W,et al.Total variation regularization term-based low-rank and sparse matrix representation model for infrared moving target tracking[J].Remote sensing,2018,10(4):510.
• [38] DAI Y M,WU Y Q.Reweighted infrared patch-tensor model with both non-local and local priors for single-frame small target detection[J].IEEE journal of selected topics in applied earth observations and remote sensing,2017(99):1-16.
• [39] HUANG K Q,TAO D C,YUAN Y,et al.Biologically inspired features for scene classification in video surveillance[J].IEEE transactions on systems,man,and cybernetics,part B (cybernetics),2011,41(1):307-313.
• [40] SERRE T,WOLF L,BILESCHI S,et al.Robust object recognition with cortex-like mechanisms[J].IEEE transactions on pattern analysis and machine intelligence,2007,29(3):411-426.
• [41] SONG D J,TAO D C.Biologically inspired feature manifold for scene classification[J].IEEE transactions on image processing,2010,19(1):174-184.
• [42] ITTI L,KOCH C,NIEBUR E.A model of saliency-based visual attention for rapid scene analysis[J].IEEE transactions on pattern analysis and machine intelligence,1998,20(11):1254-1259.
• [43] WANDELL B,THOMAS S.Foundations of vision[J].Psyccritiques,1997,42(7):649.
• [44] TAGARE H D,TOYAMA K,WANG J G.A maximum-likelihood strategy for directing attention during visual search[J].IEEE transactions on pattern analysis and machine intelligence,2001,23(5):490-500.
• [45] FISER J,SUBRAMANIAM S,BIEDERMAN I.Size tuning in the absence of spatial frequency tuning in object recognition[J].Vision research,2001,41(15):1931-1950.
• [46] VANRULLEN R.Visual saliency and spike timing in the ventral visual pathway[J].Journal of physiology-Paris,2003,97(2/3):365-377.
• [47] CHEN C L P,LI H,WEI Y,et al.A local contrast method for small infrared target detection[J].IEEE transactions on geoscience and remote sensing,2014,52(1):574-581.
• [48] HAN J H,MA Y,ZHOU B,et al.A robust infrared small target detection algorithm based on human visual system[J].IEEE geoscience and remote sensing letters,2014,11(12):2168-2172.
• [49] 王晓阳,彭真明,张萍,等.局部对比度结合区域显著性红外弱小目标检测[J].强激光与粒子束,2015,27(9):38-44.WANG X Y,PENG Z M,ZHANG P,et al.Infrared small dim target detection based on local contrast combined with region saliency[J].High power laser and particle beams,2015,27(9):38-44.
• [50] QIN Y,LI B.Effective infrared small target detection utilizing a novel local contrast method[J].IEEE geoscience and remote sensing letters,2016,13(12):1890-1894.
• [51] DU P,HAMDULLA A.Infrared small target detection using homogeneity-weighted local contrast measure[J/OL].IEEE geoscience and remote sensing letters.[2019- 07- 03].https://ieeexplore.ieee.org/document/8754801.
• [52] WEI Y T,YOU X G,LI H.Multiscale patch-based contrast measure for small infrared target detection[J].Pattern recognition,2016,58:216-226.
• [53] NIE J Y,QU S C,WEI Y T,et al.An infrared small target detection method based on multiscale local homogeneity measure[J].Infrared physics & technology,2018,90:186-194.
• [54] HAN J H,LIANG K,ZHOU B,et al.Infrared small target detection utilizing the multiscale relative local contrast measure[J].IEEE geoscience and remote sensing letters,2018,15(4):612-616.
• [55] DENG H,SUN X P,LIU M L,et al.Small infrared target detection based on weighted local difference measure[J].IEEE transactions on geoscience and remote sensing,2016,54(7):4204-4214.
• [56] 张祥越,丁庆海,罗海波,等.基于改进LCM的红外小目标检测方法[J].红外与激光工程,2017,46(7):270-276.ZHANG X Y,DING Q H,LUO H B,et al.Infrared dim target detection algorithm based on improved LCM[J].Infrared and laser engineering,2017,46(7):270-276.
• [57] WANG X,LV G,XU L Z.Infrared dim target detection based on visual attention[J].Infrared physics & technology,2012,55(6):513-521.
• [58] XIE K,FU K R,ZHOU T,et al.Small target detection based on accumulated center-surround difference measure[J].Infrared physics & technology,2014,67:229-236.
• [59] KIM S,YANG Y,LEE J,et al.Small target detection utilizing robust methods of the human visual system for IRST[J].Journal of infrared,millimeter,and terahertz waves,2009,30(9):994-1011.
• [60] KIM S.Min-local-LoG filter for detecting small targets in cluttered background[J].Electronics letters,2011,47(2):105.
• [61] SHAO X P,FAN H,LU G X,et al.An improved infrared dim and small target detection algorithm based on the contrast mechanism of human visual system[J].Infrared physics & technology,2012,55(5):403-408.
• [62] ZHANG H,ZHANG L,YUAN D,et al.Infrared small target detection based on local intensity and gradient properties[J].Infrared physics & technology,2018,89:88-96.
• [63] DESHPANDE S D,ER M H,VENKATESWARLU R,et al.Max-mean and max-median filters for detection of small targets[J].Processing of small targets international society for optics and photonics,1999,3809:74-83.
• [64] HADHOUD M M,THOMAS D W.The two-dimensional adaptive LMS (TDLMS) algorithm[J].IEEE transactions on circuits and systems,1988,35(5):485-494.
• [65] CAO Y,LIU R M,YANG J.Small target detection using two-dimensional least mean square (TDLMS) filter based on neighborhood analysis[J].International journal of infrared and millimeter waves,2008,29(2):188-200.
• [66] BAE T W,ZHANG F,KWEON I S.Edge directional 2D LMS filter for infrared small target detection[J].Infrared physics & technology,2012,55(1):137-145.
• [67] 张艺璇,李玲,辛云宏.基于自适应双层TDLMS滤波的红外小目标检测[J].光子学报,2019,48(9):186-198.ZHANG Y X,LI L,XIN Y H.Infrared small target detection based on adaptive double-layer TDLMS filter[J].Acta photonica sinica,2019,48(9):186-198.
• [68] SERRA J.Image analysis and mathematical morphology[M].New York:Academic Press,1983.
• [69] BAI X Z,ZHOU F G.Analysis of new top-hat transformation and the application for infrared dim small target detection[J].Pattern recognition,2010,43(6):2145-2156.
• [70] ZHOU J,Lü H,ZHOU F.Infrared small target enhancement by using sequential top-hat filters[C]//International Symposium on Optoelectronic Technology and Application 2014:Image Processing and Pattern Recognition.International Society for Optics and Photonics.Beijing,2014,9301:93011L.
• [71] DENG L,ZHU H,ZHOU Q,et al.Adaptive top-hat filter based on quantum genetic algorithm for infrared small target detection[J].Multimedia Tools and Applications,2018,77(9):10539-10551.
• [72] TOMASI C,MANDUCHI R.Bilateral filtering for gray and color images[C]//Proceedings of Sixth IEEE International Conference on Computer Vision.Bombay,1998:839-846.
• [73] BAE T W,SOHNG K I.Small target detection using bilateral filter based on edge component[J].Journal of infrared,millimeter,and terahertz waves,2010,31(6):735-743.
• [74] LAI L,QU SH R.A novel approach of infrared small weak target detection based on an improved nonsubsampled contourlet transform[C]//2011 IEEE International Conference on Signal Processing,Communications and Computing (ICSPCC).Xi'an,2011:1-4.
• [75] GU Y F,WANG C,LIU B X,et al.A kernel-based nonparametric regression method for clutter removal in infrared small-target detection applications[J].IEEE geoscience and remote sensing letters,2010,7(3):469-473.
• [76] COMANICIU D.An algorithm for data-driven bandwidth selection[J].IEEE transactions on pattern analysis and machine intelligence,2003,25(2):281-288.
• [77] YANG L,YANG J,YANG K.Adaptive detection for infrared small target under sea-sky complex background[J].Electronics letters,2004,40(17):1083-1085.
• [78] SUN Y Q,TIAN J W,LIU J.Background suppression based-on wavelet transformation to detect infrared target[C]//2005 International Conference on Machine Learning and Cybernetics.Guangzhou,2005:4611-4615.
• [79] BUADES A,COLL B,MOREL J M.A non-local algorithm for image denoising[C]//2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.San Diego,CA,2005:60-65.
• [80] GENIN L,CHAMPAGNAT F,LE BESNERAIS G,et al.Point object detection using a NL-means type filter[C]//2011 18th IEEE International Conference on Image Processing.Brussels,2011:3533-3536.
• [81] GENIN L,CHAMPAGNAT F,LE BESNERAIS G.Background first- and second-order modeling for point target detection[J].Applied optics,2012,51(31):7701-7713.
• [82] DABOV K,FOI A,KATKOVNIK V,et al.Image denoising by sparse 3-D transform-domain collaborative filtering[J].IEEE transactions on image processing,2007,16(8):2080-2095.
• [83] LEBRUN M.An analysis and implementation of the BM3D image denoising method[J].Image processing on line,2012,2:175-213.
• [84] CHEN Y,NASRABADI N M,TRAN T D.Sparse representation for target detection in hyperspectral imagery[J].IEEE journal of selected topics in signal processing,2011,5(3):629-640.
• [85] ZHOU W N,XUE X Y,CHEN Y.Low-rank and sparse decomposition based frame difference method for small infrared target detection in coastal surveillance[J].IEICE transactions on information and systems,2016,99(2):554-557.
• [86] WANG X Y,PENG Z M,KONG D H,et al.Infrared dim target detection based on total variation regularization and principal component pursuit[J].Image and vision computing,2017,63:1-9.
• [87] GAO C Q,MENG D Y,YANG Y,et al.Infrared patch-image model for small target detection in a single image[J].IEEE transactions on image processing,2013,22(12):4996-5009.
• [88] WANG X Y,PENG Z M,KONG D H,et al.Infrared dim and small target detection based on stable multisubspace learning in heterogeneous scene[J].IEEE transactions on geoscience and remote sensing,2017,55(10):5481-5493.
• [89] DAI Y M,WU Y Q,SONG Y,et al.Non-negative infrared patch-image model:Robust target-background separation via partial sum minimization of singular values[J].Infrared physics & technology,2017,81:182-194.
• [90] WANG X,SHEN S Q,NING C,et al.A sparse representation-based method for infrared dim target detection under sea-sky background[J].Infrared physics & technology,2015,71:347-355.
• [91] HE Y J,LI M,ZHANG J L,et al.Small infrared target detection based on low-rank and sparse representation[J].Infrared physics & technology,2015,68:98-109.
• [92] YANG C W,LIU H P,LIAO S Y,et al.Small target detection in infrared video sequence using robust dictionary learning[J].Infrared physics & technology,2015,68:1-9.
• [93] LI L,GAO F,LI H,et al.Infrared small target detection in compressive domain[J].Electronics letters,2014,50(7):510-512.
• [94] LIU D,LI Z,LIU B,et al.Infrared small target detection in heavy sky scene clutter based on sparse representation[J].Infrared physics & technology,2017,85:13-31.
• [95] QIAN K,ZHOU H X,WANG B J,et al.Infrared dim moving target tracking via sparsity-based discriminative classifier and convolutional network[J].Infrared physics & technology,2017,86:103-115.
• [96] ZHANG X M,REN K,WAN M J,et al.Infrared small target tracking based on sample constrained particle filtering and sparse representation[J].Infrared physics & technology,2017,87:72-82.
• [97] SUN Y,YANG J G,LONG Y L,et al.Infrared small target detection via spatial-temporal total variation regularization and weighted tensor nuclear norm[J].IEEE access,2019,7:56667-56682.
• [98] BARNIV Y.Dynamic programming solution for detecting dim moving targets[J].IEEE transactions on aerospace and electronic systems,1985,21(1):144-156.
• [99] BARNIV Y,KELLA O.Dynamic programming solution for detecting dim moving targets part II:analysis[J].IEEE transactions on aerospace and electronic systems,1987,23(6):776-788.
• [100]BUZZI S,LOPS M,VENTURINO L.Track-before-detect procedures for early detection of moving target from airborne radars[J].IEEE transactions on aerospace and electronic systems,2005,41(3):937-954.
• [101]强勇,焦李成,保铮.动态规划方法进行弱目标检测的机理研究[J].电子与信息学报,2003,25(6):721-727.QIANG Y,JIAO L C,BAO Z.Study on mechanism of dynamic programming algorithm for dim target detection[J].Journal of electronics and information technology,2003,25(6):721-727.
• [102]TONISSEN S M,EVANS R J.Peformance of dynamic programming techniques for track-before-detect[J].IEEE transactions on aerospace and electronic systems,1996,32(4):1440-1451.
• [103]JOHNSTON L A,KRISHNAMURTHY V.Performance analysis of a dynamic programming track before detect algorithm[J].IEEE transactions on aerospace and electronic systems,2002,38(1):228-242.
• [104]ARNOLD J,SHAW S W,PASTERNACK H.Efficient target tracking using dynamic programming[J].IEEE transactions on aerospace and electronic systems,1993,29(1):44-56.
• [105]ORLANDO D,RICCI G,BAR-SHALOM Y.Track-before-detect algorithms for targets with kinematic constraints[J].IEEE transactions on aerospace and electronic systems,2011,47(3):1837-1849.
• [106]GROSSI E,LOPS M,VENTURINO L.Track-before-detect for multiframe detection with censored observations[J].IEEE transactions on aerospace and electronic systems,2014,50(3):2032-2046.
• [107]陈帅霖,罗丰,张林让,等.采用动态规划的机动目标检测前跟踪方法[J].西安电子科技大学学报,2017,44(5):39-45.CHEN S L,LUO F,ZHANG L R,et al.Maneuvering target track-before-detect method using dynamic programming[J].Journal of xidian university,2017,44(5):39-45